We are looking for an AI Analyst – Generative AI to support the evaluation, validation, and quality assurance of GenAI solutions. This role focuses on testing, analysis, datasets, and model behavior, rather than model building.
It is a key role to ensure reliability, groundedness, and accuracy of AI systems.
Key Responsibilities
* Execute functional and quality evaluations of GenAI solutions.
* Validate outputs for accuracy, groundedness, and hallucination risks.
* Support prompt testing, dataset curation, and evaluation frameworks.
* Document findings and support continuous improvement cycles.
* Collaborate with engineers and architects during validation phases.
Required Skills & Qualifications
* Degree in Computer Science, Data, Engineering, or similar.
* Analytical mindset and attention to detail.
* Basic understanding of AI and Generative AI concepts.
* Ability to work with structured and unstructured data.
* Strong documentation and communication skills.
Nice to Have
* Exposure to LLMs, prompt testing, or AI evaluation tools.
* Experience in QA, data analysis, or validation roles.
#J-18808-Ljbffr