Data Engineer ( Google Cloud Platform) Talent Shark
Talent Shark
Office Location
Full Time
Experience: 7 - 7 years required
Pay:
Salary Information not included
Type: Full Time
Location: Maharashtra
Skills: Software engineering, Python, SQL, GCP, Data flow, Data Fusion, spark, airflow, ETL frameworks, Apache Beam, Terraform, big data technologies, cloud sql, Big query, Cloud Composer, DataForm
About Talent Shark
Job Description
Candidate should have 7 to 10 year of IT experience Ideally you will have a background in software engineering along with experience in working in a complex cloud environment (Google Cloud Platform) Experience working with Python and SQL. You have experience building data pipelines and ETL frameworks both batch and real time using Python and any of the GCP capabilities such Apache Beam, Data Flow, Data Fusion You have Experience with using Terraform to build Infrastructure-as-a-code Experience working with Big Data Technologies (Spark, Cloud SQL, Big Query) preferably in an Enterprise environment. Experience in orchestrating end-end data pipelines with tools like cloud composer, Dataform is highly desired. Experience in managing complex and reusable dataflow pipelines is highly desired. Experience with Airflow is must. Experienced working with operations and architecture groups developing scalable and supportable solutions (desired but not mandatory) Understand customer needs to make sound judgments Understanding of current state landscape and relevant technologies. Job Types: Full-time, Permanent Benefits: Health insurance Life insurance Provident Fund Schedule: Day shift UK shift Joining bonus Experience: total work: 10 years (Preferred) Work Location: In person,