Note: The job is a remote job and is open to candidates in USA. 24-MAG is offering a specialized part-time consulting opportunity for board-certified psychiatrists. The role focuses on AI psychiatric reasoning evaluation, advanced clinical case design, and providing structured feedback on psychiatric outputs.
Responsibilities
- Develop expert-level psychiatric cases involving diagnostic reasoning, nuanced differentials, risk assessment, and treatment considerations
- Create clinically realistic prompts that reflect advanced psychiatric practice and complex patient-care scenarios
- Design reasoning challenges involving edge cases, comorbidities, subspecialty considerations, or clinically ambiguous presentations
- Prepare gold-standard answers with clear, authoritative clinical reasoning and evidence-based psychiatric judgment
- Review AI-generated psychiatric responses for clinical accuracy, reasoning quality, completeness, and patient-care relevance
- Evaluate whether responses appropriately address diagnosis, differential considerations, risk factors, safety concerns, and clinical decision-making
- Identify weak reasoning, missing nuance, unsupported conclusions, unsafe recommendations, or incomplete psychiatric assessment
- Assess written outputs against structured rubrics and project-specific psychiatric evaluation criteria
- Provide clear, precise, and evidence-based written feedback on AI-generated psychiatric outputs
- Explain evaluation decisions with professional judgment, consistency, and attention to psychiatric standards
- Identify common failure modes in model reasoning and communicate them clearly through structured feedback
- Participate in onboarding, calibration, screening, or specialty alignment activities when required
Skills
- Board-certified psychiatry expertise with independent clinical practice experience
- Strong psychiatric diagnostic reasoning skills across complex cases, nuanced differentials, and risk assessment
- Ability to evaluate psychiatric written outputs with accuracy, clinical nuance, and attention to patient-care implications
- Strong written communication skills and ability to produce clear, structured, gold-standard clinical explanations
- Comfort applying detailed rubrics, psychiatric review criteria, and evaluation guidelines consistently
- Ability to work independently in a remote, asynchronous, project-based environment
- Strong attention to detail and ability to complete high-quality review work within project timelines
- Completed psychiatry residency through an accredited or nationally recognized training pathway is required
- Medical degree required, including MD, DO, or recognized international medical degree equivalents
- Active board certification in psychiatry or recognized national equivalent is required
- Active, unrestricted medical license is required, with no suspension, revocation, or open disciplinary action
- 3+ years of independent psychiatry practice after residency is preferred, current or within the last two years
- Current direct patient-contact experience in psychiatric care
- Subspecialty depth in Addiction Psychiatry, Child and Adolescent Psychiatry, Forensic Psychiatry, Geriatric Psychiatry, or Consultation-Liaison Psychiatry
- Fellowship training, subspecialty board certification, or 2+ years of focused subspecialty practice
- Experience developing OSCE materials, serving as an OSCE examiner, or creating structured clinical assessment content
- Current or recent faculty appointment in a department of psychiatry
- Experience with medical education, clinical assessment, peer review, quality improvement, or structured psychiatric case development
Benefits
- Remote structure with competitive hourly compensation
- Fully remote with asynchronous project work
- Weekly payments via Stripe or Wise
- Part-time commitment depending on project availability, screening, and onboarding status
- Projects may be extended, shortened, or adjusted depending on scope and performance
Company Overview