Microsoft Logo

Microsoft

Senior AI Hardware Product Manager

Reposted 10 Days Ago
Be an Early Applicant
In-Office
Redmond, WA, USA
120K-261K Annually
Senior level
In-Office
Redmond, WA, USA
120K-261K Annually
Senior level
Leads product definition and development for next-generation AI hardware supporting Azure training and inference workloads. Identifies customer needs, market opportunities, and competitive gaps; translates them into product requirements, roadmaps, investment proposals, and hardware strategies. Drives technical programs from concept through execution while collaborating with architecture, engineering, business teams, customers, and senior leadership. Requires expertise in AI systems, GPU architecture, networking, data centers, reliability, and cloud infrastructure.
The summary above was generated by AI
Overview

Do you want to be at the forefront of innovating the latest hardware designs to propel Microsoft’s cloud growth? Are you seeking a unique career opportunity that combines technical capabilities, cross-team collaboration, with business insight and strategy?  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to achieve our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. 

Join the Systems Planning and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, the team behind Microsoft’s expanding Cloud Infrastructure and for powering Microsoft’s “Intelligent Cloud” mission. Microsoft delivers more than 200 online services to more than one billion individuals worldwide, and AHSI is the team behind our expanding cloud infrastructure. We deliver the core infrastructure and foundational technologies for Microsoft's cloud businesses including Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live.    

We are seeking a Senior AI Hardware Product Manager to join the AI Hardware Products Planning team to drive definition of the next generation hardware used in Azure to train and infer on the best-in-class AI models for a plethora of use cases.  This role will help define the future of Supercomputing systems at a planet scale. 


Responsibilities

Responsibilities: 

  • Collaborate with customers and partner organizations to define future generations of Artificial Intelligence (AI) Hardware for Azure at Microsoft.  

  • Identify and prioritize customer needs, market opportunities, and competitive gaps, and translate them into clear and actionable product requirements and specifications.  

  • Drive executive decision making for new investments, including competitive analysis, program goals and business requirements, architectural concepts, risk management strategies, financial analysis, schedule and hardware strategy.  

  • Lead technical programs from concept to execution, collaborating with architecture, engineering and business teams to develop and drive end-to-end product development  

  • Develop and maintain a high level of technical proficiency in AI workload requirements, AI technology landscape and AI Industry roadmaps. 

  • Engage with senior leadership, highlighting risks across functional teams and providing recommendations to support product level decisions.  

  • Operate effectively in ambiguity. Apply process where it creates value, and design process where it’s needed. Recognize the situations where each approach is most appropriate.


Qualifications

Required/Minimum Qualifications 

  • Bachelor's Degree AND 5+ years experience in product/service/program management or software development OR equivalent experience.

Other Requirements 

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Preferred Skills:

  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience.
    2+ years experience taking a product, feature, or experience to market (e.g., design, addressing product market fit, and launch, internal tool/framework).
    4+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn).
    4+ years experience disrupting a market for a product, feature, or experience (e.g., competitive disruption, taking the place of an established competing product).
  • 2+ years of experience working on AI systems as an architect or a product manager 
  • Familiar with AI systems roadmaps from Nviida, AMD, Microsoft and AI infrastructure challenges 

  • Strong understanding of several of the below areas: GPU Architecture, Scale Up and Scale out networking, Data Center Specifications, Model Architecture and System Reliability 

  • 3+ years of technical product management experience, including products within datacenter Hardware systems and/or Cloud infrastructure.  

  • 3+ years experience creating product roadmap(s) from conception to launch, driving end-to-end program execution, defining product go-to-market strategy, and leading program direction discussions.  
     


Product Management IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

HQ

Microsoft Redmond, Washington, USA Office

1 Microsoft Way, Redmond, WA, United States, 98052

Microsoft Bellevue, Washington, USA Office

Bellevue, United States

Microsoft Issaquah, Washington, USA Office

Issaquah, United States

Microsoft Kirkland, Washington, USA Office

Kirkland, United States

Microsoft Mercer Island, Washington, USA Office

Mercer Island, United States

Microsoft Sammamish, Washington, USA Office

Sammamish, United States

Microsoft Seattle, Washington, USA Office

Seattle, United States

Similar Jobs

Senior level
Financial Services
Manage a portfolio of Middle Market Merchant Services clients, maintaining executive relationships and achieving revenue and margin goals. Develop client strategies, identify cross-sell and incremental business opportunities, coordinate with Commercial Banking, Treasury Services, FX, and Card Services, and lead re-contracting efforts. Apply consultative selling to recommend payment solutions, deliver quarterly business reviews, provide financial and market analysis, and represent JPMorgan at industry conferences.
Top Skills: Data SecurityFraud PreventionPayment OptimizationPayment Processing
4 Minutes Ago
Hybrid
Senior level
Senior level
Financial Services
Operate and support IBM MQ middleware across development, testing, and production environments. Lead infrastructure projects, troubleshoot complex issues, improve resilience and disaster recovery, establish service health monitoring, maintain operational runbooks, automate recurring tasks, coordinate post-incident remediation, and advise application teams on MQ integration, security, and operational practices. The role includes follow-the-sun shift work, on-call coverage, high-severity incident response, and resilience testing.
Top Skills: AutomationIbm MqItilJavaPrivate CloudPublic CloudPythonScriptingUnixWindows
4 Minutes Ago
Hybrid
Senior level
Senior level
Financial Services
Leads architecture and development of a secure, multi-tenant cloud platform operating across SaaS and isolated AWS environments. Provides technical direction, mentors engineers, develops and reviews production code, and drives SDLC, automation, AI-assisted engineering, security, privacy, and resiliency practices. Designs backend APIs, ingestion and data pipelines, customer dashboards, Kubernetes deployments, infrastructure-as-code, and AWS services while establishing standards for tenant isolation, regulated environments, and responsible AI usage.
Top Skills: Amazon EcrAmazon EksAmazon EventbridgeAmazon RdsAmazon S3Amazon SqsSparkAWSAws BedrockCi/CdCloudFormationDatabricksDelta LakeDjangoFastapiHelmIamIrsaJavaJavaScriptKmsKubernetesLlmsPostgresPulumiPythonReactSecrets ManagerTerraformTypescriptVllm

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account