Azure Databricks Viraaj HR Solutions Private Limited
Viraaj HR Solutions Private Limited
Office Location
Full Time
Experience: 3 - 3 years required
Pay:
Salary Information not included
Type: Full Time
Location: Haryana
Skills: Performance tuning, SQL, Automated Testing, Git, Scala, devops, spark, pyspark, Event Hub, cicd, Data Factory, Key Vault, Azure Data Lake Storage Gen2, data modelling, azure databricks, Delta Lake, sql optimisation, data synapse
About Viraaj HR Solutions Private Limited
Job Description
Azure Databricks Engineer Industry & Sector: We are a fast-growing cloud data and analytics consultancy serving global enterprises across finance, retail, and manufacturing. Our teams design high-throughput lakehouse platforms, predictive analytics, and AI services on Microsoft Azure, unlocking data-driven decisions at scale. Role & Responsibilities Design, develop, and optimise end-to-end data pipelines on Azure Databricks using PySpark/Scala and Delta Lake. Build scalable ETL workflows to ingest structured and semi-structured data from Azure Data Lake, SQL, and API sources. Implement lakehouse architectures, partitioning, and performance tuning to ensure sub-second query response. Collaborate with Data Scientists to prepare feature stores and accelerate model training and inference. Automate deployment with Azure DevOps, ARM/Bicep, and Databricks CLI for secure, repeatable releases. Monitor pipeline health, cost, and governance, applying best practices for security, lineage, and data quality. Skills & Qualifications Must-Have 3+ years building large-scale Spark or Databricks workloads in production. Expert hands-on with PySpark/Scala, Delta Lake, and SQL optimisation. Deep knowledge of Azure servicesData Lake Storage Gen2, Data Factory/Synapse, Key Vault, and Event Hub. Proficiency in CI/CD, Git, and automated testing for data engineering. Understanding of data modelling, partitioning, and performance tuning strategies. Preferred Exposure to MLflow, feature store design, or predictive model serving. Experience implementing role-based access controls and GDPR/PCI compliance on Azure. Certification: Microsoft DP-203 or Databricks Data Engineer Professional. Benefits & Culture Work on cutting-edge Azure Databricks projects with Fortune 500 clients. Flat, learning-centric culture that funds certifications and conference passes. Hybrid leave policy, comprehensive health cover, and performance bonuses. Skills: performance tuning,pyspark,event hub,sql,ci/cd,data factory,automated testing,key vault,azure data lake storage gen2,data modelling,azure databricks,git,delta lake,scala,devops,sql optimisation,spark,data synapse,