Solution Architect - Data Engineering UsefulBI Corporation

About UsefulBI Corporation

Job Description

The Solution Architect role is a remote position requiring a minimum of 8+ years" experience in Data Engineering. You should possess a strong knowledge and hands-on experience in Python, along with expertise in Pyspark or Spark. Proficiency in AWS/Azure (Glue, EMR) is essential for this role. Your responsibilities will involve working with very large datasets, conducting relevant analysis, and having a deep understanding of scientific programming in scripting languages like Python. As a Solution Architect, you will be responsible for creating and maintaining optimal data pipeline architecture, assembling complex data sets to meet business requirements, and identifying opportunities for process improvements through automation and optimization. You will need to build infrastructure for efficient data extraction, transformation, and loading using SQL and AWS "big data" technologies. Collaborating with stakeholders from various teams, you will address data-related technical issues and support the enhancement of data infrastructure. The ideal candidate for this role will have superior verbal and written communication skills, enabling you to effectively communicate complex mathematical concepts to non-experts. You will play a key role in developing analytics tools that provide actionable insights into customer acquisition, operational efficiency, and other essential business metrics. Additionally, you will create data tools to support the analytics and data science teams in optimizing the product and driving innovation in the industry. If you are a motivated professional with a strong background in Data Engineering, Python programming, and cloud technologies, this role offers an exciting opportunity to contribute to a dynamic and forward-thinking team.,