Apache Airflow Consultant Cartol

About Cartol

Job Description

As an Apache Airflow Consultant at our organization, you will be responsible for designing, developing, and maintaining data pipelines using Apache Airflow. You will also play a key role in mentoring and upskilling team members, ensuring proficiency in Airflow best practices. With a strong background in Python and prior experience in Airflow production environments, you will contribute to ongoing projects and deliver structured training sessions. Your primary responsibilities will include designing, implementing, and maintaining scalable data pipelines and workflows using Apache Airflow. You will offer hands-on support and troubleshooting for Airflow-related issues across various projects. Additionally, you will develop and conduct structured training sessions, workshops, and documentation for team members with different levels of experience. Collaboration with data engineers, analysts, and other stakeholders will be crucial as you work to understand workflow requirements and optimize Airflow usage. You will establish and promote best practices for Airflow DAG development, deployment, and monitoring. Staying abreast of the latest developments in Apache Airflow and related technologies, you will recommend improvements as necessary. Your role will also involve assisting in the integration of Airflow with other data tools and platforms, such as cloud services like AWS and Snowflake. Your expertise in Snowflake, Python, Apache Airflow, AWS, DAG, training and mentoring, among other skills, will be instrumental in fulfilling the responsibilities of this position.,