Senior AI Python Quality Analyst RapidBrains

About RapidBrains

Job Description

Job Title : Senior AI Python Quality Analyst Experience: 5+ Years Location: Mumbai (On-site) Contract Type: Long-Term Contract Work Shift: IST (Indian Standard Time) About the Role: We're seeking a Senior Python Quality Analyst with a strong background in software QA and a deep understanding of AI systems. This is a unique opportunity to work on cutting-edge AI and agentic systems, ensuring the reliability and quality of our AI products. During lighter QA periods, you'll also contribute to agentic development projects. Key Responsibilities: Design, implement, and maintain robust test suites for AI and agentic systems. Build automated testing frameworks in Python to validate AI model outputs and system behavior. Develop test cases for edge cases, failure modes, and model misbehavior (e.g., hallucinations, biases). Perform thorough regression testing for all releases and updates. Ensure AI systems meet performance benchmarks and functional requirements. Collaborate with AI engineers to understand architectures and identify weak points. Document and track bugs with detailed reproduction steps. Support development in debugging and issue resolution. Participate in agentic development during reduced QA workload. Requirements: 5+ years of experience in Software QA, especially with Python. Proficiency in Python testing frameworks like pytest, unittest. Familiarity with AI/ML workflows and evaluation methodologies. Experience testing complex, integrated systems. Solid understanding of CI/CD pipelines, version control (Git), and test automation. Comfortable with bug tracking tools and collaborative development environments.,