Our partner is looking for a STEM Expert with experience in biology / physics / chemistry theory and problem-solving to develop and refine high-quality reasoning questions that evaluate AI models. Your knowledge in biology / physics / chemistry will ensure the accuracy, rigor, and instructional quality of these test items.
Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions.
Define and Document Evaluation Standards: Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubric.
Conduct Model Testing and Grading: Run prompts through models and assess preliminary outputs against expectations.
Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific rigor, maintaining consistency and reliability before integration into official benchmarks.
BS or BA in Biology / Physics / Chemistry
Familiarity with undergraduate-level biology / physics / chemistry topics
Strong writing and critical thinking skills.
Ability to work independently and meet deadlines.
This is a remote and asynchronous role â work on your own schedule.
Expect to contribute at least 20 hours per week.
Expect a commitment of around 1 month.
Youâll be working in a structured project environment with clear goals and tools.