Microsoft Logo

Microsoft

Senior Data Scientist - M365 Copilot, Agents & Platform - Turing Team

Posted 3 Days Ago
Be an Early Applicant
In-Office
Redmond, WA, USA
120K-261K Annually
Senior level
In-Office
Redmond, WA, USA
120K-261K Annually
Senior level
Conduct large-scale data analysis, develop evaluation datasets, design experiments and A/B tests, define metrics, and assess AI and human evaluations for Microsoft 365 Copilot. Translate findings into product recommendations, dashboards, and executive-ready insights while partnering with engineering, product, and applied science teams. Mentor others and guide analytical best practices across complex AI product initiatives.
The summary above was generated by AI
Overview

Join the Microsoft Turing team and help shape the future of enterprise and consumer productivity with M365 Copilot. 

Join a fast-paced, high-visibility, and diverse team delivering innovative platform capabilities and solutions across Microsoft to hundreds of millions of users every month. As a Senior Data Scientist on the Microsoft Turing team, you will help transform how organizations use data by preparing and analyzing large-scale datasets, designing evaluations, running experiments, and driving evidence-based decisions with measurable business impact. You’ll work in small, multidisciplinary crews alongside engineers, product managers, applied scientists, and domain experts, owning the analytical lifecycle from data discovery and study design through measurement, insight generation, and product recommendations. 

Our work is powered by AI, applying data, experimentation, and evaluation across the development lifecycle while maintaining the highest standards of security, quality, and trust. The Microsoft Turing team is an innovative applied research and engineering organization advancing large language models and pioneering conversational search experiences. We build core platform capabilities behind Microsoft 365 Copilot, bringing AI-powered experiences into production at enterprise scale and transforming how organizations work every day. We spearhead platform innovation for multiple core Copilot experiences across Microsoft’s ecosystem. 

We are a fast-growing team with a broad and evolving set of opportunities. Project assignments are shaped by your interests, experience, and strengths, allowing you to grow while working on problems that matter to you.  

Recent launches, such as the Analyst agent in Microsoft 365 Copilot, demonstrate the importance of rigorous measurement and evaluation across the AI stack. The Microsoft Turing team combines engineering and research excellence to advance large-scale AI systems. In this environment, Data Scientists define measurement strategies, build evaluation datasets, design experiments, and translate results into product recommendations, while partnering with software engineers and applied scientists who develop and productionize the underlying systems and models. 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.


Responsibilities

Data Analysis & Evaluation Dataset Development 

  • Write efficient, readable code in Python, SQL, KQL, or similar languages to prepare and analyze large-scale datasets, including customer feedback, text, and consented multimodal logs. 

  • Build representative evaluation datasets across enterprise and consumer scenarios, including information retrieval, text creation and editing, image and file workflows, shopping, education, coding, technical support, health, sports, news, and finance. 

  • Design evaluation coverage for text and voice inputs, single- and multi-turn conversations, and location- or geography-sensitive prompts. 

Cross-Functional Collaboration 

  • Partner with engineering, product management, and applied science teams to define measurement strategies and inform product decisions. 

  • Share findings, limitations, and recommendations that improve Microsoft 365 Copilot experiences. 

Experimentation & A/B Testing 

  • Own experiment design and impact measurement for optimization hypotheses, including success metrics, guardrails, and interpretation of results. 

  • Contribute to response-quality side-by-side evaluations by designing studies and rubrics, analyzing results, and assessing statistical and practical significance. 

  • Compare LLM-based and human evaluations, validate alignment, investigate false positives and branding bias, and refine studies accordingly. 

Insights & Decision Influence 

  • Develop decision-relevant metrics, dashboards, and compelling narratives that translate analyses into actionable product recommendations. 

  • Present findings and analytical limitations to technical and executive audiences, build stakeholder support, and guide decisions on key product initiatives. 

Thought Leadership 

  • Stay current with AI offerings and competitive developments, using data and evaluation results to identify feature gaps and opportunities. 

  • Provide mentorship through analytical code reviews, study-design guidance, innovation, and sharing data science best practices. 

  • Embody our culture and values. 


Qualifications

Required Qualifications:

  • Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) 

    • OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) 

    • OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) 

    • OR equivalent experience.

Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
 
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

  • Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
      • OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 6+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
      • OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 8+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
      • OR equivalent experience. 
  • 4+ years of experience using Python, SQL, KQL, R, or similar languages to analyze large-scale structured and unstructured datasets.
  • Experience driving effective cross-organizational communication, end-to-end analytical problem solving, collaboration, customer focus, and the ability to navigate ambiguity.
  • Demonstrated ability to communicate technical details clearly across organizational boundaries.   
  • Demonstrated ability to work end to end in complex analytical problem domains, from problem definition and study design through execution, interpretation, and communication of results.
  • One Microsoft and Values: Self-driven and results-oriented, with high integrity and a demonstrated ability to collaborate across disciplines, solve complex problems with diverse groups, and develop mutually beneficial solutions.
  • Customer Obsession: Customer- and metrics-driven approach to evaluation, experimentation, and product decision-making.
  • Growth Mindset: Demonstrated ability and motivation to learn, enter new domains, and manage through ambiguity.   
#CACore #CAP

Data Science IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

HQ

Microsoft Redmond, Washington, USA Office

1 Microsoft Way, Redmond, WA, United States, 98052

Microsoft Bellevue, Washington, USA Office

Bellevue, United States

Microsoft Issaquah, Washington, USA Office

Issaquah, United States

Microsoft Kirkland, Washington, USA Office

Kirkland, United States

Microsoft Mercer Island, Washington, USA Office

Mercer Island, United States

Microsoft Sammamish, Washington, USA Office

Sammamish, United States

Microsoft Seattle, Washington, USA Office

Seattle, United States

Similar Jobs

A Minute Ago
Hybrid
Seattle, WA, USA
121K-147K Annually
Mid level
121K-147K Annually
Mid level
Artificial Intelligence • HR Tech • Information Technology • Software • Business Intelligence
Develop and operate scalable, highly available SaaS data-platform microservices. Responsibilities include designing systems, implementing features, optimizing performance, troubleshooting, collaborating with product, UX, and TechOps teams, participating in Agile delivery, and serving on-call rotations. The role involves distributed systems, data processing, storage, event-driven architecture, containerization, and full-stack development.
Top Skills: AgileCachingContainerizationData ModelingData ProcessingData StorageDistributed SystemsEvent-Driven SystemsFull-Stack DevelopmentMicroservicesQueue ManagementRoutingSaaS
14 Minutes Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
220K-285K Annually
Expert/Leader
220K-285K Annually
Expert/Leader
Real Estate • Sales • Software • PropTech
Leads product design across multiple product lines, setting design strategy, standards, systems, research, accessibility, and AI-enabled practices. Manages and develops the design team, partners with product, engineering, and sales leadership, defines long-term design vision and roadmaps, represents design in executive planning, and owns hiring, resourcing, prioritization, quality, and business impact.
Top Skills: AmplitudeConfluenceDesign-System ToolingFigjamFigmaJIRAPrototyping Tools
17 Minutes Ago
Remote or Hybrid
17 Locations
125K-135K Annually
Senior level
125K-135K Annually
Senior level
Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
Own global sales incentive plan administration and continuous improvement, ensuring accurate performance-to-payout calculations. Resolve commission inquiries, produce reporting and insights, manage UAT for plan changes, maintain system hierarchies and eligibility, and collaborate with Sales Operations, HR, and Payroll on employee changes. The role requires expertise in commission calculations, Spiff, Salesforce, advanced Excel, data analysis, plan design, and stakeholder communication.
Top Skills: ExcelSalesforceSpiff

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account