Data Concepts & Data Modelling Developer Phygital Insights

About Phygital Insights

Job Description

As a Data Concepts & Data Modelling Developer with 6 to 8 years of relevant experience, you will be responsible for working in a QA environment with a minimum of 3 years of experience handling Big Data testing projects. Your key tasks will include identifying, isolating, and reporting data defects, as well as verifying the resultant changes to the data curation pipeline. You will be required to maintain and enhance existing automated data quality test tools to prevent regressions and design and execute test scenarios, tools, and scripts to verify the quality of new curated data sets. Collaboration with data engineers to integrate automated testing seamlessly into the data curation pipeline will be a crucial aspect of your role. Working closely with the Data Product Owner, you will gain an understanding of each dataset, including expected formats, flaws, and deficiencies. Monitoring and documenting post-implementation issues and revision requests will also be part of your responsibilities to ensure alignment with end user needs. Your expertise should extend to working in a Cloud environment, such as Azure, AWS, or GCP, utilizing serverless components, SQL query language, Notebooks in Databricks, and Data warehousing on the cloud. Proficiency in unit testing in Python (pytest), validation testing, and simulation testing is essential. Detailed knowledge of automated testing in a Continuous Integration/Continuous Deployment (CI/CD) pipeline, including tools like Jenkins, is required. You must possess deep expertise in independently designing and executing complex test plans, as well as knowledge of cloud-based automated test tools. Your ability to comprehend complex data concepts, work in an agile environment, and use tools like JIRA and Azure DevOps is crucial. Experience in Commercial Business and Analytics within an agile environment is a must. The role demands demonstrated ability to manage multiple projects and requirements concurrently. The hiring process for the position will involve screening through an HR round, followed by two technical rounds, and a final HR round. If you are looking to contribute your skills and expertise in data concepts and data modelling within a dynamic and collaborative environment, this opportunity might be the right fit for you.,