Licensed Physician (MD/DO) - Freelance AI Trainer
$100 per hourMindrift (Toloka)
Please submit your CV in English and indicate your level of English proficiency.
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based.
What this opportunity involves
We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may:
- Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
- Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
- Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;
- Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.
If you’re a practicing physician ready to take on this challenging and engaging project, join us!
What we look for
This opportunity is a good fit for US-based physicians open to part-time, non-permanent projects. Ideally, contributors will have:
- Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board);
- Board certification or completed residency training, with recent direct patient care (attending-level preferred);
- Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
- Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
- Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
- Strong written English (C1+).
This opportunity is not fit to medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.
Project time expectations
For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
Compensation
Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $100/hr. Because payment is per approved task, a faster pace raises your effective hourly rate.
$37 per hour
...About the role Help train and evaluate AI agents on expert-level fluid simulation tasks. You'll take CAD geometry, set up and run... ...earning levels based on their requirements. Why this freelance opportunity might be a great fit for you? Work fully remote on...- ...Full-time availability is required until end of contract Are you a Backend Engineer looking to craft large-scale software using AI-first techniques to drive growth and create experiences that end users love? At Make, we’re proud to have created award-winning...
- ...This is a freelance position: Expected project duration is 7 months, starting as soon as possible, full-time. Why Valtech? We’re the experience... ...migrations (content mapping, transformation and validation) AI and automation tooling to improve content workflows and...
- ...Sumsub is the first AI-powered trust infrastructure for compliance operations at scale. It connects identity and business verification, fraud prevention, transaction monitoring, and risk workflows, helping teams reduce manual work and enter new markets. Trusted by...
- ...High-growth company driven by high performance Expected salary range: $174,100 - $184,350 CAD THE OPPORTUNITY: As an Applied AI Solutions Architect, you’ll turn real business problems into working AI solutions that deliver measurable results for TechInsights...
- ...and to meet our business needs, this role requires you to be based within the EMEA or AMER regions. You’ll join Oyster as a Senior AI Solutions Engineer, reporting to the AI Director and partnering closely with functional leadership across Oyster. Your mandate...
- ...trading, margin, futures, staking, and OTC services, with products built for both individual investors and institutional clients. The AI Infrastructure team builds and operates the production systems that power intelligent agents at scale. This team sits at the...
- ...Department: Sales Location: Remote (US or Canada) Rate: OTE $250K (rates vary in Canada) Position Overview As a Principal Cloud & AI Solutions Architect at Cyclotron, you will be responsible for driving sales wins through a disciplined presales methodology, strong...
$100 - $200 per hour
...STAFF SOFTWARE ENGINEER (AI EVALS) Contract | $100–$200/hour | 20-40 hrs/week | Start ASAP We’re looking for highly experienced software engineer to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code. This is...- ...Speech Collection Evaluator (Arabic-Qatar_MSA) Qatar AI Trainers - Domain Experts – Data Collection / Independent Contractor - Project Based / Remote apply for this job We're looking for native Modern Standard Arabic speakers in Qatar. You'll record voice...
- ...We're hiring: AI Facilitators/Instructors across MENA Manara is looking for experienced AI Facilitators/Instructors to help educators across the MENA region build the confidence and skills to use AI in their classrooms. As part of a large-scale, multi-year AI education...Remote job
- Requirements Native Arabic (Gulf) speaker in Qatar. Please make sure that GULF ARABIC language is listed in your Language Skills list before applying to the project Age 18 or older Smartphone compatible with the Appen Mobile app Ability to follow recording ...
- ...candidates who have the instinct to spot a “normalized” problem and the AI-native curiosity to create a solution using the latest tools.... ...under these U.S. export laws without sponsorship for an export license. Cloudflare is proud to be an equal opportunity employer. We...
$20 - $30 per hour
...remote contractor role, you will work as a Malayalam Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across Malayalam AI training projects. You will review AI-generated Malayalam content and trainer/QA work, evaluate output quality...- ...into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members... ...a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked...
- ...into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members... ...a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked...
$180000 - $225000 per year
...migrations and hybrid cloud strategies. Understanding of Microsoft licensing models and subscription management. $180,000 - $225,000 a year... ...restricted positions. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing...- ...candidates who have the instinct to spot a “normalized” problem and the AI-native curiosity to create a solution using the latest tools.... ...under these U.S. export laws without sponsorship for an export license. Cloudflare is proud to be an equal opportunity employer. We...
- ...to/from external systems, such as Planon Knowledge of German What We Offer Interesting project in an international environment Flexible, primarily remote working model Part-time engagement (approx. 2 days/week) with clear scope, freelance/contractor...
- ...· Familiarity with GIS integration and mobile workforce management solutions. · Knowledge of emerging technologies such as IoT, AI, and Machine Learning as they apply to Field Service Management. · Professional certifications in solution architecture or relevant...
- ...maintenance and development , help keep the platform reliable, and contribute to practical improvements across the team’s web and AI workflows. Learn more about us here ! We’re passionate about solving complex engineering challenges while fostering a...
- ...ABOUT ELEVENLABS ElevenLabs is an AI research and product company transforming how we interact with technology. We launched in January 2023 with the first human-like AI voice model. Today, we serve millions of users and thousands of businesses – from fast-growing...
- ...architectural decisions captured as ADRs without becoming a bottleneck or single point of approval. You will be the CTO’s partner on AI strategy, drive standardisation across backend, web and mobile engineering, and work closely with our SRE team on reliability,...
- ...engineering consistency across 100+ engineers spanning multiple federal programs — including how teams adopt and build with agentic AI tools Own engineering talent decisions — identifying and promoting top performers, developing those with growth potential, and maintaining...
- ...encryption, and sensitive data protection. Develop internal engineering tools such as our Service Catalog, API Registry, SLO platform, and AI-assisted development tools, making them useful and easy to adopt. Drive complex initiatives from problem discovery and design through...
- ...mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality datasets, reinforcement learning environments, and frontier research benchmarks that improve model...
- ...The company and our mission: Zartis is a global AI transformation and technology consulting partner where talented engineers and technologists work on cutting edge innovation. We partner with ambitious organizations to design, build, and scale technology solutions that...
- ...be part of a company that is changing the market — it will be challenging, fun, and exciting We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying...
- ...Senior Solution Engineer – GPU & AI Infrastructure About Civo: Civo is revolutionising the cloud industry by providing developers and businesses with cutting-edge, developer-friendly cloud solutions. With a focus on simplicity, performance, and reliability, Civo enables...
- ...ABOUT ELEVENLABS ElevenLabs is an AI research and product company transforming how we interact with technology. We launched in January 2023 with the first human-like AI voice model. Today, we serve millions of users and thousands of businesses – from fast-growing...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Licensed Physician (MD/DO) - Freelance AI Trainer. Be the first to apply!
