Microsoft Logo

Microsoft

Senior/Principal Applied Scientist - CoreAI

Posted 9 Days Ago
In-Office
Redmond, WA, USA
120K-304K Annually
Senior level
In-Office
Redmond, WA, USA
120K-304K Annually
Senior level
Develop and productionize state-of-the-art agentic retrieval and knowledge-search techniques. Build LLM prompts, agents, query workflows, evaluation datasets, metrics, and experimentation infrastructure. Improve experimental code quality, incorporate customer feedback, collaborate with engineering and product teams, and advance scalable AI capabilities for enterprise search and knowledge bases.
The summary above was generated by AI
Overview
Microsoft’s Enterprise customers have a challenge – they need the tools to build agentic experiences over public and private knowledge. The Azure AI Knowledge team is leading the way to deliver the next chapter of agentic retrieval through Foundry IQ Knowledge bases to bring together many sources of structured and unstructured enterprise data and transform it into knowledge. We are continuously developing and deploying new capabilities to meet the demands of complex queries that require reasoning and reflection to deliver high-quality results. Our customers span many different industries, corpus sizes and scenarios, and our work includes multiple aspects, such as: 
  • Developing LLM prompts, agents and query execution workflows, often with tight latency constraints 
  • Collection, generation and filtering of training and evaluation data 
  • Building off state of the art techniques from across Microsoft and the industry 
  • Use of AI coding patterns to parallelize and accelerate experimentation 
 
You can follow our progression from better search, to RAG, to agentic retrieval: 
  • Azure AI Search: Outperforming vector search with hybrid retrieval and ranking capabilities – Microsoft Community Hub  
  • Raising the bar for RAG excellence: introducing generative query rewriting and new ranking model 
  • Up to 40% better relevance for complex queries with new agentic retrieval engine 
  • Foundry IQ: boost response relevance by 36% with agentic retrieval | Microsoft Community Hub 
  • Foundry IQ: Improve recall by up to 54% with knowledge bases | Microsoft Community Hub 
As a team, we leverage the diverse backgrounds and experiences of passionate engineers, scientists, and program managers to help us realize our mission to empower every person and every organization on the planet to achieve more. We believe great products are built by inclusive teams of customer-obsessed individuals who trust each other and work closely together.  We collaborate regularly across the company with teams like M365, Bing and Microsoft Research.  
 
A major aspect of this role is to push our development of knowledge retrieval to the frontier. This requires a capable individual who can leverage multiple coding agents to explore new techniques and bring them to production at scale. 
If you are passionate about working on the latest and hottest areas in Artificial Intelligence, Machine Learning, and data science, all the while making search better for customers across the world, then this is the team you’re looking for! 

Responsibilities
  1. Drive the state of the art research incorporation into techniques shipped to production. 
  2. Proactively develop and build metrics to use across the full range of search engine components. 
  3. Seek out and incorporate customer feedback into dataset construction, evaluation, and technique development. 
  4. Drive technical excellence and contribute to experimentation infrastructure and proofs-of-concept using AI coding agents. 
  5. Advances the quality of the team’s experimental codebase to ensure experiments are efficient and repeatable.  
  6. Nurtures collaborative relationships with product management, engineers, and other functions across products. 
  7. Drive clear and efficient plans, documents, and communication 

Qualifications

Required Qualifications

  • Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)
    • OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
    • OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
    • OR equivalent experience. 
Other Requirements
 
Ability to meet Microsoft, customer and/or government security screening requirements is required for this role. These requirements include, but are not limited to, the following specialized security screenings:
 
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
  •  
Preferred Qualifications
 
  • Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 9+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience. 
  • 3+ year(s) experience developing and deploying products or systems at multiple points in the product cycle from ideation to shipping. 
  • Experience with agentic coding systems, including scaffolding for long‑running agents.  
  • Strong hybrid collaboration skills, with clear async/sync communication and teamwork.  
  • Experience defining task‑specific metrics and evaluation datasets.  
  • Customer‑focused and execution‑driven, with strong ownership and bias for action.  
  • Strong problem‑solver, comfortable with novel, open‑ended problems. 

Applied Sciences IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

Applied Sciences IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

HQ

Microsoft Redmond, Washington, USA Office

1 Microsoft Way, Redmond, WA, United States, 98052

Microsoft Bellevue, Washington, USA Office

Bellevue, United States

Microsoft Issaquah, Washington, USA Office

Issaquah, United States

Microsoft Kirkland, Washington, USA Office

Kirkland, United States

Microsoft Mercer Island, Washington, USA Office

Mercer Island, United States

Microsoft Sammamish, Washington, USA Office

Sammamish, United States

Microsoft Seattle, Washington, USA Office

Seattle, United States

Similar Jobs

2 Hours Ago
Remote or Hybrid
United States
142K-195K Annually
Senior level
142K-195K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Lead CFO-level client advisory engagements, manage change initiatives, provide financial analysis, develop client budgets, and mentor staff.
Top Skills: Bill.ComIntaactNetSuiteQuickbooks Online
2 Hours Ago
Remote or Hybrid
United States
142K-195K Annually
Senior level
142K-195K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
The CFO will oversee month-end close, financial reporting, audit readiness, client relationship management, and mentoring staff for casino industry clients.
Top Skills: Accounting Software
2 Hours Ago
Remote or Hybrid
United States
107K-144K Annually
Senior level
107K-144K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Manage complex tax returns and consulting for partnerships, mentor staff, and develop tax planning strategies while ensuring compliance with tax regulations.
Top Skills: Internal Revenue CodeIrs RegulationsTax-Related Software

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account