Data Engineer Big Data Litmus7
Litmus7
Office Location
Full Time
Experience: 3 - 3 years required
Pay:
Salary Information not included
Type: Full Time
Location: Kerala
Skills: Data Processing, Data Transformation, analytical, Machine Learning, Performance optimization, Scalability, reliability, Monitoring, Troubleshooting, Data Quality, data integrity, Data validation, emerging technologies, Documentation, Big Data processing, Distributed Computing Systems, Data Ingestion, Error Handling, Best practices
About Litmus7
Job Description
Design, develop, and maintain scalable and efficient big data processing pipelines distributed computing systems. Collaborate with cross-functional teams to understand data requirements and design appropriate data solutions. Implement data ingestion, processing, and transformation processes to support various analytical and machine learning use cases. Optimize and tune data pipelines for performance, scalability, and reliability. Monitor and troubleshoot pipeline performance issues, identifying and resolving bottlenecks. Ensure data quality and integrity throughout the pipeline, implementing data validation and error handling mechanisms. Stay updated on emerging technologies and best practices in big data processing and analytics, incorporating them into our data engineering practices. Document design decisions, technical specifications, and data workflows.,