Lead AI Quality Engineer & Test Automation Architect

Descripción del puesto / Funciones

• Design and execute end-to-end testing strategies specifically tailored for Machine Learning models, Generative AI systems, RAG architectures, and Autonomous Agents.

• Validate model accuracy, fairness, bias detection, explainability, robustness, and performance across diverse and edge-case datasets.

• Execute adversarial testing, prompt-injection, jailbreaking, and red-teaming to evaluate prompt robustness and behavioral variations under stress.

• Validate agentic workflows, including multi-step reasoning paths, state transitions, tool execution, and fallback behaviors during service failures.

• Evaluate LLM outputs for correctness, grounding, factuality, consistency, safety, and hallucination reduction.

• Assess vector store behavior, document chunking logic, retriever configurations, and semantic search accuracy.

• Conduct API, performance, latency, throughput, and concurrency testing on AI inference endpoints and data pipelines.

• Ensure compliance with AI ethics, data privacy laws, business rules, and insurance regulatory guidelines, maintaining audit-ready test evidence and behavioral reports.

• Define AI quality KPIs, establish test governance, and build automated testing frameworks integrated into CI/CD pipelines.

• Collaborate closely with Data Scientists, ML Engineers, SMEs, and Dev