Lead Data Engineer UST

About UST

Job Description

You are a talented GCP Data Engineer with 6 to 10 years of experience, and you will be joining the UST team to take on a crucial role in designing and implementing efficient data solutions on the Google Cloud Platform (GCP). Your strong data engineering skills, expertise in GCP services, and proficiency in data processing technologies, particularly PySpark, will be essential for this role. Your responsibilities will include: Data Pipeline Development: - Designing, implementing, and optimizing end-to-end data pipelines on GCP with a focus on scalability and performance. - Developing and maintaining ETL workflows for seamless data processing. GCP Cloud Expertise: - Utilizing GCP services such as BigQuery, Cloud Storage, and Dataflow for effective data engineering. - Implementing and managing data storage solutions on GCP. Data Transformation with PySpark: - Leveraging PySpark for advanced data transformations to ensure high-quality and well-structured output. - Implementing data cleansing, enrichment, and validation processes using PySpark. Requirements: - Proven experience as a Data Engineer with a strong emphasis on GCP. - Proficiency in GCP services such as BigQuery, Cloud Storage, and Dataflow. - Expertise in PySpark for data processing and analytics is a must. - Experience with data modeling, ETL processes, and data warehousing. - Proficiency in programming languages such as Python, SQL, or Scala for data processing. - Relevant certifications in GCP or data engineering are a plus. Skills required: - GCP - PySpark,