Remote | Physician Clinical AI Evaluation Consultant — Up to $130/hour

  • New York, New York, United States
  • Contractor
  • Remote

Job Description:

We are sharing a specialised part-time consulting opportunity for experienced physicians with clinical practice experience, strong medical judgment, patient-safety awareness, and expertise in evaluating diagnosis, clinical reasoning, and care-related outputs.

This role supports current and upcoming remote consulting opportunities focused on clinical AI evaluation, medical reasoning review, diagnostic output assessment, care workflow analysis, and high-quality project execution. Selected professionals will apply their physician expertise to review health-related model outputs, assess clinical accuracy and safety, evaluate reasoning quality, and provide structured feedback based on expert medical judgment.

Key Responsibilities

Professionals in this role may contribute to:

Clinical Output Evaluation

  • Evaluate health-related AI model outputs for clinical accuracy, safety, clarity, and alignment with medical standards
  • Review outputs involving diagnosis, case reasoning, care recommendations, and clinical workflow scenarios
  • Score diagnoses, medical explanations, and care-related recommendations against expert physician judgment
  • Identify incomplete reasoning, unsafe recommendations, unclear clinical logic, or outputs requiring stronger medical rigor

Patient Safety & Clinical Risk Review

  • Flag failure modes that may compromise patient safety, clinical accuracy, or appropriate care guidance
  • Assess whether model outputs handle medical uncertainty, escalation needs, and safety-sensitive scenarios appropriately
  • Review clinical responses for appropriate caution, clarity, scope, and alignment with accepted medical standards
  • Apply sound judgment across generalist and specialty-adjacent medical scenarios

Structured Feedback & Medical Review

  • Write clear, structured feedback on clinical rigor, safety, clarity, and reasoning quality
  • Apply project-specific evaluation guidelines consistently across submitted work
  • Collaborate asynchronously with project teams to support quality improvement and review workflows
  • Maintain accuracy, professionalism, and strong documentation standards across medical evaluation tasks

Ideal Profile

Strong candidates may have:

  • MD or DO from a reputable medical school
  • 2+ years of clinical practice experience, especially within the United States
  • Experience across primary care, internal medicine, hospital-based medicine, public health, mental health, or related specialties
  • Relevant background in fields such as Family Medicine, General Internal Medicine, Pediatrics, Cardiology, Nephrology, Occupational Medicine, Anesthesiology, Critical Care, or Psychiatry
  • Strong clinical reasoning and patient-safety judgment
  • Sharp attention to detail and clear written communication skills
  • Ability to evaluate medical outputs independently in a remote, project-based environment

Educational Background

  • MD or DO qualification is expected
  • Clinical training, residency experience, board eligibility, board certification, or active/recent practice experience is highly relevant
  • Experience reviewing clinical cases, teaching, supervising, quality improvement work, clinical documentation, or medical guideline application may be especially valuable

Nice to Have

  • Experience evaluating clinical reasoning, medical documentation, case summaries, diagnosis explanations, or care recommendations
  • Familiarity with clinical safety review, medical quality assurance, utilization review, chart review, or guideline-based assessment
  • Experience working asynchronously with cross-functional teams or structured review workflows
  • Comfort providing clear written feedback on complex clinical outputs
  • Availability for part-time work of 20+ hours per week depending on project scope

Why This Opportunity

  • Apply physician expertise to structured remote clinical evaluation work
  • Contribute to high-quality medical reasoning review, clinical safety assessment, and care workflow evaluation
  • Work on flexible assignments aligned with your clinical background and medical judgment
  • Use your experience to identify safety issues, reasoning gaps, and quality concerns in health-related outputs
  • Remote structure with competitive hourly compensation

Contract Details

  • Independent contractor role
  • Fully remote with flexible scheduling
  • Eligible professionals may be based in the United States, United Kingdom, or Canada depending on project needs
  • Expected part-time commitment of 20+ hours per week depending on project availability
  • Expected project duration of approximately 6 weeks, with potential adjustment depending on scope and performance
  • Competitive rates up to $130 per hour depending on expertise and project scope
  • Weekly payments via Stripe or Wise
  • Projects may be extended, shortened, or adjusted depending on scope and performance
  • Work will not involve access to confidential or proprietary information from any employer, client, or institution

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.