Jobs at Handshake

Leads complex AI safety and evaluation programs, establishing quality strategies, annotation frameworks, audit systems, scalable workflows, and operational processes. Manages Strategic Projects Leads and model trainers, makes high-stakes policy and quality decisions, partners with frontier AI labs and senior stakeholders, and drives improvements across safety, throughput, cost, and delivery reliability.

Leads Handshake AI’s Seattle site operations for approximately 200 employees and 3–4 Area Managers. Oversees security compliance, workforce management, hiring, employee wellbeing, workplace standards, employee relations, and operational excellence. Partners with HR, Legal, Security, Recruiting, Workplace Experience, and technical teams to maintain a secure, compliant, efficient workplace, develop management capabilities, improve reporting and metrics, and support audits, inspections, and customer visits.

Execute large-scale human data programs for frontier AI model training and evaluation. Design annotation frameworks, coordinate annotators, maintain playbooks, analyze labeling data, identify policy gaps and systemic errors, and support policy-program delivery with AI labs and internal stakeholders. The role requires strong analytical judgment, communication, ownership, and comfort handling sensitive content.

Evaluate AI models for cybersecurity risks by crafting adversarial prompts and multi-turn attack chains. Assess model-generated malware, exploit code, phishing content, privilege-escalation scripts, and other offensive tooling for functional correctness and real-world exploitability. Score responses using harm taxonomies, document technical findings, develop evaluation frameworks, and collaborate with AI researchers, red teamers, and policy teams to improve model safety.

Stress-test large language models by crafting adversarial prompts and multi-turn scenarios that expose safety, bias, hallucination, prompt injection, and guardrail vulnerabilities. Evaluate model responses using harm taxonomies and severity rubrics, document findings, refine testing methods, and collaborate with engineers, data scientists, and researchers to improve AI safety and robustness. The role involves regular exposure to disturbing harmful content.

Own the full sales cycle for landing new Fortune 500 and Fortune 100 employer accounts. Build pipeline through outbound outreach, manage named accounts, lead executive conversations, run demos, negotiate complex six-figure partnerships, and close new business. The role requires disciplined forecasting, account planning, relationship building, customer events, and regular travel with high autonomy.

Evaluate AI models for dangerous CBRNE-related outputs, designing adversarial prompts, multi-turn attack chains, and threat models. Assess technical accuracy and real-world risk, distinguish open-source information from harmful uplift, score responses using severity rubrics, and document failures. Collaborate with AI researchers and policy teams to improve model safeguards and evaluation frameworks while following strict ethical and operational security protocols.