GCP Data Enginner ARTECH INFOSYSTEMS PRIVATE LIMITED

About ARTECH INFOSYSTEMS PRIVATE LIMITED

Job Description

Key Responsibilities:

• Develop scalable ETL/ELT pipelines using PySpark on distributed data processing systems.

• Integrate and manage data flows between Apache Kafka, MongoDB, and cloud data warehouses such as Google BigQuery.

• Design and implement robust data ingestion frameworks, ensuring performance, reliability, and scalability.

• Work closely with data scientists, analysts, and platform engineers to deliver real-time and batch data solutions.

• Build and consume RESTful APIs for data integration.

• Write and maintain Unix shell scripts for automation and data processing workflows.

• Collaborate in an Agile environment using modern CI/CD practices and tools (e.g., Jenkins, GitLab CI, or similar).

• Ensure adherence to data quality, governance, and security standards.

Required Skills and Experience:

• 5+ years of experience in data engineering or software development.

• Strong hands-on experience with Apache Spark and PySpark.

• Proficiency with Google Cloud Platform (GCP), particularly BigQuery, Dataflow, and Cloud Storage.

• Working knowledge of MongoDB and experience integrating NoSQL databases into data pipelines.

• Experience working with Kafka for real-time data streaming and processing.

• Strong understanding of API design/integration, including RESTful services.

• Proficiency in Unix/Linux shell scripting.

• Experience with CI/CD pipelines for data workflows.

• Solid understanding of data modeling, data warehousing, and SQL.

Interested Candidate Please share your Resume (+91 8267992494)