Lead I - Data Engineering - Databricks Developer UST

About UST

Job Description

Role Description Job Title: Databricks Developer Experience: 5 to 9 Years Locations: Bangalore / Hyderabad (Only) Work Mode:Hybrid Job Summary We are looking for an experienced Databricks Developer with strong expertise in Python/PySpark, Databricks, and advanced SQL. The ideal candidate should have hands-on experience building scalable data pipelines and transforming large datasets on cloud-based data platforms. Key Responsibilities Design, develop, and maintain data pipelines using Databricks, Python/PySpark, and SQL. Implement scalable ETL solutions to process structured and unstructured data. Work closely with data architects, analysts, and business stakeholders to understand data needs. Optimize data workflows for performance, scalability, and reliability. Ensure data quality and integrity across systems. Monitor production data pipelines and troubleshoot issues proactively. Write clear, maintainable code and documentation. Collaborate in Agile environments and contribute to sprint planning and reviews. Mandatory Skills Strong hands-on experience with Databricks platform. Expertise in Python and PySpark for data engineering tasks. Advanced SQL skills for complex data querying and transformation. Experience working with large-scale datasets in distributed environments. Good understanding of data warehousing concepts and cloud data architecture. Nice To Have Experience with Azure Data Lake, Delta Lake, or AWS S3. Familiarity with CI/CD pipelines and version control (Git). Exposure to data governance, cataloging, and security best practices. Education Bachelor's or Master's degree in Computer Science, Data Engineering, or related field. Skills Databricks,Python,Pyspark,Sql,