Builds a talent network of experienced data scientists for potential future AI evaluation projects. Responsibilities may include creating grading criteria, evaluating AI-generated or human-produced data science work, writing evidence-based justifications, applying consistent judgment, and incorporating reviewer feedback. Candidates should have professional data science experience, strong Python and SQL skills, expertise in statistical modeling, machine learning, experimentation, causal inference, and excellent technical communication.
This role is for one of our clients
Compensation: $100-$150 per hour
We are building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data science work.
There is no immediate project opening, but qualified applicants may be contacted as relevant opportunities become available.
Requirements
Potential Responsibilities
Future projects may involve:
- Designing precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, experimentation and A/B test write-ups, feature engineering, and technical reports or notebooks
- Evaluating AI-generated or human-created work against established criteria
- Providing detailed written justifications for evaluations and scores
- Applying consistent, evidence-based judgment so that assessments are reproducible and defensible
- Incorporating structured feedback from senior reviewers and iterating on submitted work
Specific responsibilities will vary depending on the project.
Ideal Qualifications
- 1+ years of professional data science experience
- Experience at a leading technology, research, or quantitative firm (such as top FAANG, AI labs, top-tier quant funds, or equivalent)
- Strong command of Python, SQL, statistical modeling, machine learning, experimentation and causal inference, and translating messy real-world data into rigorous analyses
- Exceptional written communication skills, including the ability to convey technical findings clearly
- A detail-oriented and consistent approach to evaluating complex work
- Comfort receiving feedback and calibrating judgment against established standards
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Similar Jobs
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Lead the Performance and Quality Frameworks team, owning scalable performance engineering platforms and shared functional testing frameworks. Drive architecture, reliability, adoption, documentation, self-service, and roadmap execution across product teams. Apply AI tools such as Cursor and Claude Code to improve test development, maintenance, analysis, and engineering efficiency. Partner with cross-functional stakeholders, mentor engineers, measure framework outcomes, and support highly distributed SaaS systems using cloud, microservices, containers, and CI/CD technologies.
Top Skills:
Amazon BedrockAmazon Web Services (Aws)Ci/CdClaude CodeCursorDockerKubernetesLarge Language Models (Llms)MicroservicesNumpyPandasPythonPyTorchScikit-LearnVertex Ai
Healthtech • Social Impact • Software • Telehealth
Own a Midwest healthcare sales territory, sourcing prospects through outbound phone and digital outreach, managing full-cycle deals, closing healthcare providers, and building ongoing account relationships. After 90 days, the associate conducts field meetings and manages accounts within a 2.5-hour radius of a major Midwest metro hub. The role requires quota-carrying sales experience, cold-calling expertise, CRM proficiency, reliable transportation, and residence in an approved target market.
Top Skills:
CRMSalesforce
Fintech • Payments • Real Estate • Software • Financial Services
Lead the technical roadmap for partner integrations across APIs, SDKs, and web experiences. Design and build scalable products, standardize external partner integrations, and deliver payment and data-sharing capabilities. Collaborate with Engineering, Product, Design, Infrastructure, Sales, Partner, and Customer Success teams while remaining hands-on. Drive architecture, code quality, delivery, stakeholder alignment, and technical strategy for high-impact fintech products.
Top Skills:
APIsAWSPayment RailsSdksWeb Applications
What you need to know about the Seattle Tech Scene
Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.
Key Facts About Seattle Tech
- Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Amazon, Microsoft, Meta, Google
- Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Madrona, Fuse, Tola, Maveron
- Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute


.jpg)
