Data Engineer (Mid-Level) QBrainX Inc

About QBrainX Inc

Job Description

As a Mid-Level Data Engineer at our organization, you will be responsible for designing, developing, and maintaining scalable data pipelines using technologies such as Python and SQL. Your role will involve collaborating with data scientists, analysts, and business stakeholders to ensure that our data infrastructure meets the evolving needs of the organization. Your key responsibilities will include developing and implementing data quality checks, automating data ingestion processes from various sources to Snowflake, and utilizing cloud platforms like AWS, Azure, and GCP to manage data infrastructure. You will also work with Infrastructure as Code (IaC) tools such as Terraform for provisioning cloud resources. In this role, you will collaborate closely with data scientists and analysts to understand data requirements and translate them into technical solutions. Additionally, you will be expected to version control code using Git, document data pipelines and processes for future reference, and engage in knowledge sharing within the team. To qualify for this position, you should have a minimum of 3 years of experience in data engineering or a related field. You must have proven expertise in designing, developing, and deploying data pipelines, along with hands-on experience in Snowflake or Data Bricks, Python or Pyspark, and SQL. Experience with data warehousing, data modeling concepts, and cloud platforms is highly desirable. If you possess working knowledge of Terraform, Infrastructure as Code (IaC) principles, and Git for version control, along with excellent communication, collaboration, problem-solving, and analytical skills, you are an ideal candidate for this role. Candidates with experience in data orchestration tools such as Airflow, Luigi, and data visualization tools like Tableau, Power BI, will be considered as bonus points. Join us in building the infrastructure that drives data-driven decision making and contribute to our team's success!,