Pyspark Architect Infosys

About Infosys

Job Description

You have experience with most of these technologies including Pyspark, AWS, Databricks, Spark, HDFS, and Python. Your primary responsibility will be to build robust, performing, and highly scalable data pipelines that are flexible and focus on time to market with quality. As an active team member, you will ensure high code quality by implementing unit testing and regression tests to deliver projects on time and within budget. It is essential to document the delivered code and solutions accurately. You will also be involved in the implementation of releases following the change and release management processes. In case of major incidents requiring engineering knowledge, you will provide support to the operation team. Effort estimations and providing solutions (bug fixes) for problem management are also key aspects of the role. It is important to have a good knowledge of software configuration management systems. Additionally, having strong business acumen, strategic thinking, and cross-industry thought leadership will be beneficial. Keeping up to date with the latest technologies and industry trends is crucial. Logical thinking, problem-solving skills, and the ability to collaborate effectively are essential qualities for this role. Having knowledge of two or three industry domains, understanding financial processes for various projects, familiarity with different pricing models, client interfacing skills, and knowledge of SDLC and agile methodologies are desired attributes. Project and team management skills will also be valuable in this position.,