Data Engineer - Pyspark o9 Solutions

  • company name o9 Solutions
  • working location Office Location
  • job type Full Time

Experience: 2 - 2 years required

Pay:

Salary Information not included

Type: Full Time

Location: All India

Skills: Python, Scala, Performance tuning, Git, Unit Testing, pyspark, Spark SQL, Dataframes, datasets, Pandas, ETL design, Big Data tools, data pipelines, cicd

About O9 Solutions

Job Description

Join o9 Solutions, a revolutionary company leading the digital transformation for enterprises with our AI-powered platform, the o9 Digital Brain. Our mission is to be the Most Valuable Platform (MVP) for businesses, helping them integrate planning capabilities and capture significant value while reducing waste for a better planet. We are seeking passionate and dedicated individuals to be part of our transformative journey. At o9 Solutions, you will have the opportunity to work in a nurturing environment and contribute to something extraordinary that makes a real difference for companies and the world. As a Data Engineer at o9 Solutions, you will: - Utilize your 2 years of coding experience in Pyspark - Work with various aspects of the Spark ecosystem including Spark SQL, DataFrames, Datasets, and streaming - Have 3-4 years of overall experience as a data engineer - Demonstrate deep understanding and experience in Pyspark, data lakes, and delta tables - Possess skills in big data tools, building data pipelines, ETL design, and implementation - Strong programming skills in Python (Scala is a plus) - Familiarity with Python libraries like Pandas and expertise in performance tuning and data movement using Pyspark - Experience in writing production-level code, optimizing data processing, and identifying performance bottlenecks - Collaborate effectively with cross-functional teams and follow software development best practices At o9 Solutions, we offer: - Flexibility to work from home - Fun after-work activities and social events - Flat organizational structure with an entrepreneurial culture - Great colleagues and an enjoyable work environment - Opportunities to make a difference in a scale-up environment - Support network for continuous learning and development - International working environment promoting diversity - Benefits such as Internet reimbursement, professional development, health club, and medical insurance The hiring process involves: - Applying online - Initial contact with the hiring team to discuss the role - Hacker Earth Test - Two rounds of technical discussions - Discussion with the Hiring Manager - Final round of discussion with the HR Manager Join us at o9 Solutions, a high-growth AI-powered digital transformation company, and be part of a team that aims for 10x growth. With our o9 Digital Brain platform, we are driving digital transformations for major global enterprises like Google, Walmart, and Starbucks. Headquartered in Dallas, we have offices in various cities around the world. Apply now and be part of our innovative journey towards a better future.,