QA STEM Expert (Physics, Chemistry, Biology) No espere a enviar su solicitud después de leer esta descripción; se espera un gran volumen de candidaturas para esta oportunidad.
We are hiring a QA STEM Expert to serve as a high-caliber quality gatekeeper for AI-generated responses to complex STEM questions. This is not traditional academic proofreading. You will evaluate whether questions truly challenge frontier AI models and whether the model outputs meet rigorous standards of factual accuracy, logical soundness, and scientific validity.
This role is adecuado for a deep-thinking scientist who enjoys stress-testing AI capabilities, identifying subtle reasoning flaws, and shaping high-quality benchmarks in AI model evaluation.
Key Responsibilities Review and refine STEM questions (Physics, Chemistry, Biology) to ensure they effectively test conceptual depth and challenge AI models.
Evaluate AI-generated responses for: Factual accuracy and scientific correctness
Logical consistency and soundness of reasoning
Step-by-step derivation accuracy (including math, units, and terminology)
Absence of hallucinations, flawed assumptions, or incomplete explanations
Assess whether a question successfully "stumps" the model and classify failure modes (reasoning-based, knowledge-based, interpretation, computational, etc.).
Apply strict evaluation rubrics and guidelines while providing structured, actionable feedback.
Document evaluations, error categorizations, and scoring reports with high clarity.
Collaborate with AI teams and fellow STEM experts to improve question design, rubrics, and overall benchmarking standards.
Required Qualifications Master's or PhD in Physics, Chemistry, Biology, or a closely related STEM field.
4+ years of relevant experience in academic research, teaching, assessment, or technical evaluation.
Strong conceptual mastery in at least one core STEM domain (multi-domain expertise is highly preferred).
Exceptional critical thinking skills with the ability to dissect complex reasoning chains.
Excellent written English and structured analytical communication.
Preferred Qualifications Prior experience evaluating AI/LLM outputs or participating in model benchmarking.
Familiarity with rubric-based grading, prompt engineering, or AI testing frameworks.
Exposure to logic validation or red-teaming complex systems.
Core Competencies Deep scientific rigor and intellectual skepticism
Analytical precision in identifying subtle errors
Structured thinking and guideline adherence
Root-cause analysis of model failures
Intellectual curiosity and commitment to truth-seeking
#J-18808-Ljbffr