Senior AI Test Automation Engineer, Madrid

Senior AI Test Automation Engineer

We are looking for a Senior AI Test Automation Engineer to lead and evolve the test automation strategy for an advanced AI MLOps platform. You will combine strong hands‑on expertise in Python‑based automation with the ability to design scalable frameworks and ensure quality across complex systems, including APIs, UIs, data pipelines, and AI/ML‑driven components such as LLMs and RAG systems.

Responsibilities

• Own the design, architecture, and evolution of the test automation framework for the AI MLOps platform
• Define and implement scalable, reusable automation patterns (UI, API, data, BDD)
• Automate test cases using the Python stack (Playwright, pytest, requests, pytest‑bdd/Behave) applying clean code practices
• Design and execute AI/ML‑specific tests (e.g., LLM evaluation, RAG validation, non‑deterministic outputs)
• Integrate and orchestrate automated tests within CI/CD pipelines (Git...