Quality Assurance (QA) - Lead - MiDAS

Roles & Responsibilities :
AI Quality Strategy: Develop and own the evaluation framework for GenAI solutions, focusing on Faithfulness, Relevancy, and Hallucination detection using LLM-as-a-judge frameworks.

• Hybrid Test Automation: Architect a dual-layered automation suite:

  • Deterministic: E2E UI (Playwright) and API testing (Pytest/Requests).

  • Probabilistic: Automated evaluation of non-deterministic LLM outputs.

• Shift-Left Integration: Embed automated quality checks directly into GitHub Workflows, enabling seamless CI/CD.

Performance & Resilience: Lead JMeter-based performance testing.