Data Engineer Ridgeant
Ridgeant
Office Location
Full Time
Experience: 0 - 3 years required
Pay: INR 1 - INR 10001 /Month
Type: Full Time
Location: Ahmedabad
Skills: Data validation, RDBMS, analytical, Schema, Data structures, Data Quality, Monitoring, SQL
About Ridgeant
Job Description
Roles and Responsibility :
- Develop expertise in the different upstream data stores and systems.
- Design, develop and maintain data integration pipelines for growing data sets and product offerings.
- Build testing and QA plans for data pipelines.
- Skillful in ETL Data Engineering.
- Build data validation testing frameworks to ensure high data quality and integrity.
- Write and maintain documentation on data pipelines and schemas
- Extensive experience in data integration tools to analyse root cause and provide a fix for production and development issues.
- Good in Understanding of Hive, Spark, Hadoop architecture and optimization.
Skill Requirement:
- 2+ years of experience in relevant role
- Expert in RDBMS(preferably in SQL,Postgres,Snowflake) including advanced analytical queries
- Proficiency in Python (data structures, algorithms, object oriented programming, using API s)
- Experience building and monitoring Airflow DAGs, developing custom operators, using script templating solutions.
- Experience with ETL processes,schema design and data modelling
- Experience or knowledge on cloud tech (AWS and\or Azure)
- Experience with Terraform and Docker (Good to Have).
Qualification : Bachelor s or Master s degree in Computer Science or related field.