Responsibilities
* Review and quality-check annotations, gradings, and evaluations produced for LLM and multimodal projects (text, image, audio, and/or video).
* Validate that annotations and ratings adhere to project guidelines, rubrics, and quality standards.
* Identify errors, inconsistencies, ambiguities, and potential biases in annotated data and AI-generated outputs.
* Provide clear, actionable feedback to annotators to improve accuracy and consistency.
* Flag systematic issues and contribute insights to improve guidelines, workflows, and QA processes.
* Collaborate closely with the Quality Management (QM) and project teams to implement QA strategies and calibration efforts.
* Support quality audits, spot checks, and escalation of complex edge cases when required.
* Conduct production support as required and perform final data corrections to ensure data quality.
* Support Quality Management (QM) initiatives, including the development, refinement, and maintenance of project guidelines and processes.
Qualifications
* Experience in quality assurance, content review, or data annotation for AI/ML projects.
* Familiarity with LLMs and multimodal AI systems (text, image, audio, video) is a strong plus.
* Experience reviewing gradings, ratings, or structured annotations is highly desirable.
* Strong analytical skills and ability to apply detailed guidelines consistently.
* Excellent written communication skills for providing clear, constructive feedback.
* High attention to detail and commitment to quality.
* Ability to work independently while collaborating effectively within a distributed team.
* Ability to manage multiple projects simultaneously, each with distinct guidelines, workflows, and quality standards.
* Demonstrated flexibility in taking on different tasks as the role and organizational needs evolve.
* Ability to remain composed and effective in fast‑paced environments, including adapting to last‑minute changes in daily priorities.
* Ability to prioritize pilot projects, effectively managing the unique challenges, ambiguity, and frequent changes inherent to pilot initiatives.
Nice to have
* Background in linguistics, content analysis, digital moderation, or AI evaluation.
* Previous experience working with annotation platforms or QA tools.
* Content writing or prompt authoring experience (helpful, but not required).
Why Join Us?
If you are a detail‑oriented QA professional interested in contributing to the development of cutting‑edge AI systems, this role offers the opportunity to work on real‑world LLM and multimodal projects, directly impacting model quality and reliability.
Equal Employment Opportunity
Centific is committed to creating a diverse environment and is proud to be an equal‑opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. In compliance with the General Disability Law, the submission of the corresponding disability certificate will be valued.
In compliance with the applicable data protection regulations (General Data Protection Regulation 679/2016), we at Centific, as data Controllers, inform you that the data collected will be processed to manage your application in the selection process. This processing is legitimized by the consent given upon submitting your application, and the data will be retained for a maximum of two years. You may exercise your rights of access, rectification, deletion, opposition, restriction of processing, and data portability by contacting Centific. Furthermore, if deemed necessary, you may file a complaint with the relevant supervisory authority.
#J-18808-Ljbffr