GCP Data Engineer BigQuery Hucon Solutions India Pvt.Ltd.

About Hucon Solutions India Pvt.Ltd.

Job Description

Job Title: GCP Data Engineer BigQuery

Experience: 6 -10 years
Salary Range: 15 - 30 LPA
Location: Bangalore

Job Summary:

We are looking for a talented GCP Data Engineer with expertise in BigQuery to design, develop, and optimize data pipelines for large-scale data analytics. The ideal candidate will leverage Google Cloud Platform (GCP) services to build high-performance, scalable data solutions and contribute to data-driven business decision-making.

Key Roles & Responsibilities (R&Rs):

1. Data Pipeline Development

• Design, build, and maintain efficient ETL/ELT data pipelines on Google Cloud Platform (GCP).

• Utilize BigQuery for large-scale data storage, querying, and reporting.

• Optimize data pipelines for speed, reliability, and cost-efficiency.

2. BigQuery Development

• Create and manage data models in BigQuery, ensuring optimal performance for complex queries and aggregations.

• Implement and manage BigQuery partitions, clustering, and query optimization techniques to ensure fast query performance.

• Ensure proper data governance, including access controls, roles, and auditing on BigQuery datasets.

3. Integration with GCP Services

• Work with other GCP services like Google Cloud Storage, Dataflow, Pub/Sub, and Cloud Composer to support data processing and orchestration.

• Integrate data from diverse sources into the GCP ecosystem.

4. Data Quality & Security

• Ensure high data quality and consistency across various pipelines and sources.

• Implement best practices for data security, including encryption and access controls in GCP.

• Collaborate with data scientists, analysts, and business users to ensure the right data is available for analytics and decision-making.

Required Skills & Qualifications:

• Bachelor's/Masters degree in Computer Science, Engineering, or related field.

• 610 years of experience in data engineering, with a focus on GCP.

• Strong hands-on experience with BigQuery (designing, querying, performance tuning).

• Proficiency in SQL and optimizing complex queries for BigQuery.

• Experience with GCP services like Google Cloud Storage, Dataflow, Pub/Sub, and Cloud Composer.

• Programming skills in Python or Java for data engineering tasks.

Preferred Skills (Good to Have):

• Certifications: Google Professional Data Engineer or similar GCP certifications.

• Experience with data orchestration tools such as Apache Airflow, Cloud Composer.

• Knowledge of CI/CD practices and version control (Git).

• Familiarity with machine learning models and data science workflows on GCP.