Data Engineer Hucon Solutions India Pvt.Ltd.
Hucon Solutions India Pvt.Ltd.
Office Location
Full Time
Experience: 6 - 6 years required
Pay: INR 1800000 - INR 3000000 /year
Type: Full Time
Location: Bangalore
Skills: Data Engineering, Data Quality, Microsoft Azure, Azure, ETL, Databricks, pyspark
About Hucon Solutions India Pvt.Ltd.
Job Description
Job Title: Data Engineer Databricks, Azure, PySpark
Experience: 6 -10 years
Salary Range: 15- 30 LPA
Location: Bangalore (BLR)
Job Summary:
We are seeking a skilled Data Engineer with solid hands-on experience in Databricks, Microsoft Azure, and PySpark. The candidate will be responsible for building and managing data pipelines, optimizing data processing workflows, and collaborating with cross-functional teams to deliver data-driven solutions on cloud-native platforms.
Key Roles & Responsibilities (R&Rs):
1. Data Engineering & Development
-
Design and build scalable data pipelines using Databricks and PySpark.
-
Develop ETL/ELT workflows for large-scale data processing in a cloud environment.
-
Implement data transformations, cleansing, and aggregations.
2. Cloud Data Platform Management
-
Manage and optimize Azure Data Lake, Azure Synapse, and other Azure-native services.
-
Configure and monitor Databricks clusters for performance and cost efficiency.
-
Handle data storage, access, and security in the Azure ecosystem.
3. Collaboration & Delivery
-
Work with data scientists, analysts, and business teams to understand data requirements.
-
Translate business needs into technical specifications and scalable data solutions.
-
Ensure timely delivery of data solutions adhering to coding and performance standards.
4. Data Quality & Governance
-
Implement data validation and quality checks within pipelines.
-
Support metadata management, lineage, and monitoring across the platform.
-
Contribute to data governance practices and documentation.
Required Skills & Qualifications:
-
Bachelor's or Masters in Computer Science, Engineering, or a related field.
-
610 years of experience in data engineering or similar roles.
-
Strong programming skills in PySpark and Python.
-
Proven hands-on experience with Databricks (not just notebooks, but workspace, jobs, clusters).
-
Solid knowledge of Azure Data Services: Azure Data Lake, Azure Data Factory, Synapse, etc.
-
Good understanding of performance tuning and big data best practices.
Nice to Have (Good to Mention):
-
Experience with CI/CD for data pipelines (Azure DevOps, GitHub Actions).
-
Exposure to Delta Lake, MLflow, or Unity Catalog.
-
Certifications: Azure Data Engineer Associate, Databricks Certified Data Engineer.