About the Role
We are looking for an AI QA Engineer to join an innovative and fast-growing technology team focused on building AI-powered solutions using Generative AI, LLMs, and modern cloud technologies.
You will be responsible for ensuring the quality, reliability, and performance of AI-driven applications, APIs, and automated workflows in a collaborative Agile environment.
Key Responsibilities
* Design and maintain automated test frameworks for AI-powered applications.
* Execute functional, integration, and regression testing for backend services and APIs.
* Validate LLM-based applications, conversational AI systems, and RAG pipelines.
* Test semantic search and retrieval quality in AI solutions.
* Collaborate with developers, AI engineers, and product teams to define quality standards and acceptance criteria.
* Develop and maintain automated test suites using Python and Playwright.
* Participate in Agile/Scrum ceremonies and QA process improvements.
* Identify edge cases, performance issues, and potential risks in AI systems.
Required Experience
* 3+ years of experience in QA Automation or Software Testing.
* Strong experience with Python.
* Hands‑on experience with Playwright and Cucumber.
* Experience testing APIs and backend services.
* Experience working with AI/LLM-based applications (Generative AI, RAG, conversational AI, etc.).
* Experience with AWS environments.
* Familiarity with Docker and Kubernetes.
* Experience working in Agile/Scrum teams.
* Advanced English level.
Nice to Have
* Experience with LangChain, LangSmith, RAGAS, or similar AI evaluation tools.
* Experience with CI/CD pipelines and GitHub Actions.
* Knowledge of AI observability tools.
* Experience with performance testing tools.
* Familiarity with Terraform or Infrastructure-as-Code.
Location
Hybrid position based in Barcelona (2 days onsite per week).
What We Offer
* Versatíl working hours
* Competitive salary + flexible compensation plan
#J-18808-Ljbffr