Weekday, Inc. Logo

Weekday, Inc.

General Clinician (MD/DO) - HLS

Posted One Month Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
150-150 Hourly
Junior
Remote
Hiring Remotely in United States
150-150 Hourly
Junior
Evaluate and improve clinical AI systems through grading-criteria development, dialogue evaluation, clinical reasoning annotation, output review, guideline authoring, and difficult-case writing. The role requires physicians to assess accuracy, safety, completeness, clinical reasoning, and escalation guidance without providing direct patient care. Work is assigned across shared clinical AI workstreams and requires at least 20 hours weekly.
The summary above was generated by AI

This role is for one of our clients

Compensation: $150 per hour

We are hiring residency-trained physicians across specialties for non-clinical work developing and evaluating clinical AI systems. You will apply your clinical judgment to grading-criteria development, dialogue evaluation, and structured annotation work that determines how these systems are measured.

This is a non-clinical role — no direct patient care, and no responsibility for live diagnosis.

This is a shared expert pool. After onboarding you may be matched to any of several concurrent clinical workstreams based on your specialty, availability, and interest. You are not committing to a single project, and you may move between streams as priorities shift.


Requirements

What you may work on

Work varies by workstream and may include:

  • Grading criteria development — taking a clinical question and breaking the ideal answer into discrete, checkable criteria, so a model response can be graded consistently rather than impressionistically.
  • Clinical dialogue evaluation — reviewing multi-turn clinical conversations and judging them for accuracy, safety, completeness, appropriate hedging, and whether escalation advice was correct.
  • Clinical reasoning annotation — recording how you would work through a case, including the differential you considered and rejected, not only the conclusion.
  • Output review — flagging hallucinated findings, dangerous omissions, unsupported certainty, and advice that is technically correct but clinically unsafe.
  • Guideline authoring — defining edge cases and standards of care for your specialty so annotation stays consistent across a large group of clinicians.
  • Difficult-case writing — constructing clinical questions that probe the limits of current model reasoning.

Task length varies by stream, from roughly 45 minutes for a dialogue evaluation up to an hour or more for grading-criteria authoring. You will get a specific throughput target for whichever stream you are matched to.

Required qualifications

  • MD or DO with a completed residency in any specialty
  • Active, unrestricted medical license in your country of practice
  • 2+ years post-residency clinical experience, practising or previously practising
  • Comfort writing structured clinical rationale that a non-specialist reviewer can follow
  • Written and spoken English fluency
  • Minimum 20 hours per week, with the ability to concentrate hours when a stream is time-boxed

Preferred qualifications

  • Board certification in your specialty
  • U.S. licensure, and familiarity with U.S. standards of care and clinical guidelines
  • Primary care, internal medicine, emergency medicine, or hospitalist background, where breadth of presentation matters most
  • Prior clinical annotation, AI evaluation, medical education, or question-writing experience
  • Grading-criteria design, resident assessment, or clinical guideline development experience
  • Published research or sustained technical writing (please link a sample)

Why this work

Most clinical AI failures are not exotic — they are ordinary questions answered with misplaced confidence. Catching that requires someone who has actually carried clinical responsibility. The standard these systems get held to is written by physicians, and here you would be writing it.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Similar Jobs

An Hour Ago
In-Office or Remote
174K-274K Annually
Expert/Leader
174K-274K Annually
Expert/Leader
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Principal Software Engineer leading frontend and full-stack architecture for Atlassian’s Growth Platform. The role defines technical strategy for messaging, personalization, notifications, and experimentation systems; designs scalable microservices, APIs, data models, and React/TypeScript components; drives performance, reliability, security, accessibility, observability, and CI/CD standards; and influences multiple teams through architecture reviews, cross-functional partnership, and mentorship.
Top Skills: APIsAutomated TestingCi/CdClient SdksClient-Side State ManagementCore Web VitalsCSSData ModelingDistributed SystemsDistributed TracingHTML5Javascript Es6+MicroservicesObservabilityReactTelemetryTypescript
An Hour Ago
In-Office or Remote
Seattle, WA, USA
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Provides organization-wide technical leadership for Atlassian’s Dev AI platforms and autonomous developer initiatives. Defines multi-year architectures for agent runtimes, orchestration engines, execution sandboxes, memory systems, and context retrieval. Drives distributed-system architecture, reliability, security, responsible AI governance, evaluation, and operational standards. Leads cross-organizational technical initiatives, resolves architectural ambiguity, mentors senior engineers, partners with product and engineering leaders, and remains hands-on with strategic prototypes and architectural validation.
Top Skills: Agent OrchestrationAi Evaluation FrameworksArtificial IntelligenceAtlassian Teamwork GraphAutonomous Ai AgentsBitbucketCode IntelligenceCode SynthesisDistributed SystemsJIRAResponsible AiRetrieval SystemsRuntime SandboxesSemantic SearchTelemetry
An Hour Ago
In-Office or Remote
149K-235K Annually
Senior level
149K-235K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead enterprise customer engagements to adopt and operationalize Atlassian’s Rovo AI platform. Facilitate discovery, design and configure AI agents and connectors, guide deployments from sandbox to production, and drive measurable adoption outcomes. Own engagement playbooks, enable internal teams, provide product feedback, and collaborate with sales, customer success, product, and engineering teams. The role involves supporting complex enterprise use cases, mentoring without direct authority, and up to 15% domestic and international travel.
Top Skills: Agentic WorkflowsAi AgentsAtlassianConfluenceGitGoogle DriveJIRALlm-Powered ArchitecturesPrompt EngineeringRovoRovo StudioSharepointSlack

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account