Databricks Engineer VirtueVin Solutions
VirtueVin Solutions
Office Location
Full Time
Experience: 4 - 4 years required
Pay:
Salary Information not included
Type: Full Time
Location: Chennai
Skills: SQL, ETL tools, ADF, ADB, Reporting tools, RDBMS, Star Schema, azure devops, Python, SSIS, azure data factory, azure databricks, ETL concepts, data modelling, FactsDimensions, relationships, Sparkbased data transformations, Databricks Unity Catalog, SDLC Practices, CICD practices
About VirtueVin Solutions
Job Description
We're looking for Data Engineer who is having strong experience in Data Bricks and Available to join Immediately. Experience : 4 to 6Yrs Mode of Work : WFO Only Location : Chennai Job description: Key Skills: SQL, ETL Tools, ADF, ADB, Reporting Tools Key Requirements: The day-to-day development activities will need knowledge of the below concepts. Expert-level knowledge in RDBMS (SQL Server) with clear understanding of SQL query writing, object creation and management and performance and optimisation of DB/DWH operations. Good understanding of Transactional and Dimensional Data Modelling, Star Schema, Facts/Dimensions, Relationships Good understanding of ETL concepts and exposure to tools such as Azure Data Factory, Azure Databricks, Airflow. In-depth expertise in Azure Data Factory and Databricks, including building scalable data pipelines, orchestrating complex workflows, implementing dynamic and parameterized pipelines, and optimizing Spark-based data transformations for large-scale integrations. Hands-on experience with Databricks Unity Catalog for centralized data governance, fine-grained access control, auditing, and managing data assets securely across multiple workspaces. Should have worked on at least 1 development lifecycle of one of the below: End-to-end ETL project (Involving above mentioned ETL tools) Ability to write and review test cases, test code and validate code. Good understanding of SDLC practices like source control, version management, usage of Azure Devops and CI/CD practices. Preferred skills: Knowledge of Python is a bonus Knowledge of SSIS is a bonus Knowledge of Azure Devops, Source Control/Repos is good to have.,