Sign up to access all features of our service
  • Job search
  • Favorites
  • Create a CV
    New
  • Subscriptions

Licensed Physician (MD/DO) - Freelance AI Trainer

$100 per hour
Part-time

Mindrift (Toloka)

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.  Participation is project-based.

What this opportunity involves

We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;
  • Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.

If you’re a practicing physician ready to take on this challenging and engaging project, join us!

What we look for  

This opportunity is a good fit for US-based physicians open to part-time, non-permanent projects. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board);
  • Board certification or completed residency training, with recent direct patient care (attending-level preferred);
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This opportunity is not fit to medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

Project time expectations 

For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted. 

Compensation

Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $100/hr. Because payment is per approved task, a faster pace raises your effective hourly rate.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Licensed Physician (MD/DO) - Freelance AI Trainer in Remote vacancy
  • $37 per hour

     ...About the role  Help train and evaluate AI agents on expert-level fluid simulation tasks. You'll take CAD geometry, set up and run...  ...earning levels based on their requirements. Why this freelance opportunity might be a great fit for you?  Work fully remote on... 

    Mindrift (Toloka)

    Remote
    6 days ago
  •  ...Full-time availability is required until end of contract Are you a Backend Engineer looking to craft large-scale software using AI-first techniques to drive growth and create experiences that end users love? At Make, we’re proud to have created award-winning... 

    Make

    Remote
    5 days ago
  •  ...This is a freelance position: Expected project duration is 7 months, starting as soon as possible, full-time. Why Valtech? We’re the experience...  ...migrations (content mapping, transformation and validation) AI and automation tooling to improve content workflows and... 

    Valtech

    Remote
    9 days ago
  •  ...Sumsub is the first AI-powered trust infrastructure for compliance operations at scale. It connects identity and business verification, fraud prevention, transaction monitoring, and risk workflows, helping teams reduce manual work and enter new markets. Trusted by... 

    Sumsub

    Remote
    1 day ago
  •  ...High-growth company driven by high performance Expected salary range: $174,100 - $184,350 CAD THE OPPORTUNITY: As an Applied AI Solutions Architect, you’ll turn real business problems into working AI solutions that deliver measurable results for TechInsights... 

    TechInsights

    Remote
    4 days ago
  •  ...and to meet our business needs, this role requires you to be based within the EMEA or AMER regions. You’ll join Oyster as a Senior AI Solutions Engineer, reporting to the AI Director and partnering closely with functional leadership across Oyster. Your mandate... 

    Oyster

    Remote
    5 days ago
  •  ...trading, margin, futures, staking, and OTC services, with products built for both individual investors and institutional clients. The AI Infrastructure team builds and operates the production systems that power intelligent agents at scale. This team sits at the... 

    Kraken

    Remote
    5 days ago
  •  ...Department: Sales Location: Remote (US or Canada) Rate: OTE $250K (rates vary in Canada) Position Overview As a Principal Cloud & AI Solutions Architect at Cyclotron, you will be responsible for driving sales wins through a disciplined presales methodology, strong... 

    Cyclotron, Inc.

    Remote
    2 days ago
  • $100 - $200 per hour

     ...STAFF SOFTWARE ENGINEER (AI EVALS) Contract | $100–$200/hour | 20-40 hrs/week | Start ASAP We’re looking for highly experienced software engineer to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code. This is... 

    G2i

    Remote
    3 days ago
  •  ...Speech Collection Evaluator (Arabic-Qatar_MSA) Qatar AI Trainers - Domain Experts – Data Collection / Independent Contractor - Project Based / Remote apply for this job We're looking for native Modern Standard Arabic speakers in Qatar. You'll record voice... 

    Appen

    Remote
    24 days ago
  •  ...We're hiring: AI Facilitators/Instructors across MENA Manara is looking for experienced AI Facilitators/Instructors to help educators across the MENA region build the confidence and skills to use AI in their classrooms. As part of a large-scale, multi-year AI education... 
    Remote job

    Manara

    Remote
    25 days ago
  • Requirements Native Arabic (Gulf) speaker in Qatar. Please make sure that GULF ARABIC language is listed in your Language Skills list before applying to the project Age 18 or older Smartphone compatible with the Appen Mobile app Ability to follow recording ...

    Appen

    Remote
    24 days ago
  •  ...candidates who have the instinct to spot a “normalized” problem and the AI-native curiosity to create a solution using the latest tools....  ...under these U.S. export laws without sponsorship for an export license. Cloudflare is proud to be an equal opportunity employer. We... 

    Cloudflare

    Remote
    4 days ago
  • $20 - $30 per hour

     ...remote contractor role, you will work as a Malayalam Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across Malayalam AI training projects. You will review AI-generated Malayalam content and trainer/QA work, evaluate output quality... 

    Braintrust

    Remote
    23 days ago
  •  ...into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members...  ...a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked... 

    GitLab

    Remote
    10 days ago
  •  ...into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members...  ...a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked... 

    GitLab

    Remote
    10 days ago
  • $180000 - $225000 per year

     ...migrations and hybrid cloud strategies. Understanding of Microsoft licensing models and subscription management. $180,000 - $225,000 a year...  ...restricted positions. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing... 

    TrueTandem

    Remote
    5 days ago
  •  ...candidates who have the instinct to spot a “normalized” problem and the AI-native curiosity to create a solution using the latest tools....  ...under these U.S. export laws without sponsorship for an export license. Cloudflare is proud to be an equal opportunity employer. We... 

    Cloudflare

    Remote
    7 days ago
  •  ...to/from external systems, such as Planon Knowledge of German What We Offer Interesting project in an international environment Flexible, primarily remote working model Part-time engagement (approx. 2 days/week) with clear scope, freelance/contractor... 

    Yopeso

    Remote
    6 days ago
  •  ...· Familiarity with GIS integration and mobile workforce management solutions. · Knowledge of emerging technologies such as IoT, AI, and Machine Learning as they apply to Field Service Management. · Professional certifications in solution architecture or relevant... 

    Celerity

    Remote
    8 days ago
  •  ...maintenance and development , help keep the platform reliable, and contribute to practical improvements across the team’s web and AI workflows. Learn more about us here ! We’re passionate about solving complex engineering challenges while fostering a... 

    Stack Builders

    Remote
    7 days ago
  •  ...ABOUT ELEVENLABS ElevenLabs is an AI research and product company transforming how we interact with technology. We launched in January 2023 with the first human-like AI voice model. Today, we serve millions of users and thousands of businesses – from fast-growing... 

    ElevenLabs

    Remote
    10 days ago
  •  ...architectural decisions captured as ADRs without becoming a bottleneck or single point of approval.  You will be the CTO’s partner on AI strategy, drive standardisation across backend, web and mobile engineering, and work closely with our SRE team on reliability,... 

    Xapo Bank

    Remote
    22 hours ago
  •  ...engineering consistency across 100+ engineers spanning multiple federal programs — including how teams adopt and build with agentic AI tools Own engineering talent decisions — identifying and promoting top performers, developing those with growth potential, and maintaining... 

    Oddball

    Remote
    1 day ago
  •  ...encryption, and sensitive data protection. Develop internal engineering tools such as our Service Catalog, API Registry, SLO platform, and AI-assisted development tools, making them useful and easy to adopt. Drive complex initiatives from problem discovery and design through... 

    Tabby

    Remote
    7 days ago
  •  ...mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality datasets, reinforcement learning environments, and frontier research benchmarks that improve model... 

    Turing

    Remote
    5 days ago
  •  ...The company and our mission:  Zartis is a global AI transformation and technology consulting partner where talented engineers and technologists work on cutting edge innovation. We partner with ambitious organizations to design, build, and scale technology solutions that... 

    Zartis

    Remote
    7 days ago
  •  ...be part of a company that is changing the market — it will be challenging, fun, and exciting We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying... 

    RainFocus

    Remote
    3 days ago
  •  ...Senior Solution Engineer – GPU & AI Infrastructure About Civo: Civo is revolutionising the cloud industry by providing developers and businesses with cutting-edge, developer-friendly cloud solutions. With a focus on simplicity, performance, and reliability, Civo enables... 

    Civo

    Remote
    7 days ago
  •  ...ABOUT ELEVENLABS ElevenLabs is an AI research and product company transforming how we interact with technology. We launched in January 2023 with the first human-like AI voice model. Today, we serve millions of users and thousands of businesses – from fast-growing... 

    ElevenLabs

    Remote
    10 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Licensed Physician (MD/DO) - Freelance AI Trainer. Be the first to apply!