Skip to content
Domain expertsFreelanceNot in Africa

Physician (MD/DO) – Medical AI Evaluation

On Mindrift, run by Toloka

Rate not listed

Physicians check a medical AI benchmark by grading written patient cases, the answers proposed for them and the reasoning that links the two. The posting now asks for doctors with a full, active US medical license who are based in eligible US states, so it does not appear to be open to people living in Nigeria, Kenya, Ghana, South Africa or Egypt.

Opens the listing on jobs.workable.com. ASV earns nothing from this link. Disclosure

Pay

Rate not listed

Paid per approved task, at a fixed rate set in advance for each task type; the listing no longer gives a figure. QA and adjudication tasks pay more, a one-time $50 reward follows your first approved task, and high-quality work can earn extra.

Type
Freelance
Hours
Self-scheduled, with no minimum hours or set schedule; how much work there is depends on the project's phase
Africa
Not in Africa
Platform
Mindrift
Posted
Nov 3, 2026

01 · The role

What you would do

  • Read patient cases built from health records, each paired with a question, a proposed answer and a planted wrong answer
  • Rate each case on accuracy and completeness, on whether it hints at the answer, and on the quality of both answers
  • Confirm the answer follows from the case facts alone, correct flawed reasoning and justify each rating briefly
  • Review each case blind as one of three physicians, with a further physician resolving differences

02 · Requirements

What they ask for

  • An MD or DO with an active US medical license free of restrictions, checked at onboarding and monthly after that
  • Board certification or a completed residency, with direct patient care experience; attending-level doctors are preferred, and retired physicians are welcome
  • Diagnosis and treatment experience across many body systems, for example in internal, family, emergency or hospital medicine
  • Strong clinical reasoning, including differential diagnosis, next-step management and evidence-based guidelines
  • Written English at C1 or higher

Helpful, not required

  • Past work evaluating medical AI, reviewing clinical content or exam items, or annotating and quality-checking medical data
  • Internal medicine
  • Clinical reasoning
  • Differential diagnosis
  • Medical AI evaluation

03 · Eligibility

Who can apply

Remote. Workable files the posting under South Africa, but its text says the project is open to US-licensed physicians based in eligible US states, so none of the five countries is treated as eligible.

Countries named in the listing: United States.

Not in Africa

  • NigeriaCannot apply
  • KenyaCannot apply
  • GhanaCannot apply
  • South AfricaCannot apply
  • EgyptCannot apply

That is as far as the listing and Mindrift's country rules show: the listing has the last word, and rules change. Mindrift in Africa

Apply from where you live, as yourself. Using a VPN or someone else's identity to get around a country rule breaks these platforms' terms, and it is the quickest way to lose an account and any unpaid earnings.

04 · Applying

How to get in

You apply through Mindrift's own process. The steps from sign-up to first paid task are on its profile.

05 · Source

About this listing

We last confirmed this opening on Nov 6, 2026, and it was posted on Nov 3, 2026. Rates and hours come from the listing unless the note beside the rate says otherwise. Where the listing names no countries, the Africa status is our reading of it and of what is known of Mindrift's country rules, set out on its profile, and never marks a role more open than they show. The listing itself has the final word.

The listing on jobs.workable.com(opens in a new tab)

More open roles like this.

All openings

The platform

Mindrift

Toloka

Toloka's project-based platform for experts and writers who train AI.

VariesSelectiveGeneralist, Software & code, Math & science, Languages, Domain experts

Mindrift

Ready to apply? Read the listing first.

Check the rate, the hours and who can apply against the listing, follow the platform's own steps, and keep a second application going.

Physician (MD/DO) – Medical AI Evaluation

Rate not listed

Apply(opens in a new tab)