Builds a talent network of experienced data scientists for potential future AI evaluation projects. Responsibilities may include creating grading criteria, evaluating AI-generated or human-produced data science work, writing evidence-based justifications, applying consistent judgment, and incorporating reviewer feedback. Candidates should have professional data science experience, strong Python and SQL skills, expertise in statistical modeling, machine learning, experimentation, causal inference, and excellent technical communication.
This role is for one of our clients
Compensation: $100-$150 per hour
We are building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data science work.
There is no immediate project opening, but qualified applicants may be contacted as relevant opportunities become available.
Requirements
Potential Responsibilities
Future projects may involve:
- Designing precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, experimentation and A/B test write-ups, feature engineering, and technical reports or notebooks
- Evaluating AI-generated or human-created work against established criteria
- Providing detailed written justifications for evaluations and scores
- Applying consistent, evidence-based judgment so that assessments are reproducible and defensible
- Incorporating structured feedback from senior reviewers and iterating on submitted work
Specific responsibilities will vary depending on the project.
Ideal Qualifications
- 1+ years of professional data science experience
- Experience at a leading technology, research, or quantitative firm (such as top FAANG, AI labs, top-tier quant funds, or equivalent)
- Strong command of Python, SQL, statistical modeling, machine learning, experimentation and causal inference, and translating messy real-world data into rigorous analyses
- Exceptional written communication skills, including the ability to convey technical findings clearly
- A detail-oriented and consistent approach to evaluating complex work
- Comfort receiving feedback and calibrating judgment against established standards
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Similar Jobs
Cloud • Information Technology • Security • Software • Cybersecurity
Lead the global partnership with Accenture, drive revenue growth, and develop joint offerings while managing key relationships within GSI partners.
Top Skills:
Internet SecurityNetworkingSaaS
Automotive • Hardware • Internet of Things • Mobile • Software • App development • PropTech
Leads ODM and contract manufacturing sourcing strategy across the full new product development lifecycle, from RFP and supplier selection through mass production. Manages sourcing deliverables, supplier risks, capacity, negotiations, NRE budgets, tooling, costs, IP discussions, and launch readiness. Partners with engineering, product management, finance, legal, program management, and executive stakeholders to drive supplier accountability, make-versus-buy decisions, and successful product launches.
Top Skills:
ExcelMicrosoft Office SuitePower BIPowerPointSAP
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Leads regional sales executives to drive new business growth, develop territory and sales strategies, manage quotas and forecasts, and achieve revenue goals. Recruits, coaches, and develops high-performing teams while supporting opportunity creation and closure. Builds C-level customer relationships and collaborates with consulting, services, marketing, sales operations, partners, and executives. Retains and expands existing customer relationships and drives pipeline generation through marketing and partner ecosystems.
Top Skills:
AICRM
What you need to know about the Seattle Tech Scene
Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.
Key Facts About Seattle Tech
- Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Amazon, Microsoft, Meta, Google
- Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Madrona, Fuse, Tola, Maveron
- Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute



