Microsoft Logo

Microsoft

Principal AI Systems Architect

Reposted 29 Days Ago
Be an Early Applicant
In-Office
Redmond, WA, USA
166K-331K Annually
Expert/Leader
In-Office
Redmond, WA, USA
166K-331K Annually
Expert/Leader
Owns system architecture for AI accelerator rack- and cluster-scale platforms. Defines requirements, specifications, and proof-of-concepts; evaluates architecture options using performance simulations and hardware models; makes tradeoffs across performance, total cost, networking, memory, storage, power, cooling, and datacenter constraints. Drives alignment among engineering and leadership teams, influences vendor roadmaps, and participates in industry standards development.
The summary above was generated by AI
Overview

Do you want to be at the forefront of innovating the latest hardware designs to propel Microsoft’s cloud growth? Are you seeking a unique career opportunity that combines technical capabilities, cross-team collaboration, with business insight and strategy?  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to achieve our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. 

Join the Systems Pathfinding and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, the team behind Microsoft’s expanding Cloud Infrastructure and for powering Microsoft’s “Intelligent Cloud” mission. Microsoft delivers more than 200 online services to more than one billion individuals worldwide, and AHSI is the team behind our expanding cloud infrastructure. We deliver the core infrastructure and foundational technologies for Microsoft's cloud businesses including Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live.    

We are seeking a passionate Principal AI System Architect to join the team. In this role you will own and define the system architecture requirements; it is a broad role with the ability to make a direct impact on Microsoft AI accelerator systems. 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  


Responsibilities
  • Define AI rack- and cluster-scale architecture across accelerator, host, network, memory, storage, power, cooling, and datacenter constraints. Make quantitative tradeoffs across performance and TCO.
  • Develop functional proof-of-concepts to evaluate and de-risk new capabilities
  • Write and own high-level product requirements and specifications
  • Drive alignment across cross-functional engineering and leadership teams. Own the outcomes.
  • Use performance simulations and hardware models for what-if studies to evaluate and choose between architecture options.
  • Industry influence: Participate in industry consortiums to shape standards, and influence vendor roadmaps. 

Qualifications

Required Qualifications 

  • Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 9+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 11+ years technical engineering experience OR equivalent experience

Other Requirements 

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.  

Preferred Qualifications 

  • Doctorate in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 12+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 15+ years technical engineering experience OR equivalent experience
  • Experience in large scale AI datacenter systems and their network
  • Demonstrated expertise in one or more of these domains: networking (RoCE, Infiniband transports, congestion control, network topology design), reliability and serviceability, datacenter architecture for large scale AI systems
  • Experience owning hardware system architecture at scale – machine, rack row and cluster, authoring specifications and requirements
  • Ability to make decision trade-offs across domains
  • Deep expertise in AI systems or a key domain such as networking, reliability, power management
  • Skilled in partnering and influencing architects, hardware engineers, and software leads
  • Ability to manage through ambiguity, bringing clarity to establish direction and driving decisions
  • Collaboration skills, teamwork, and sense of presumed responsibility  

Hardware Engineering IC6 - The typical base pay range for this role across the U.S. is USD $165,600 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

HQ

Microsoft Redmond, Washington, USA Office

1 Microsoft Way, Redmond, WA, United States, 98052

Microsoft Bellevue, Washington, USA Office

Bellevue, United States

Microsoft Issaquah, Washington, USA Office

Issaquah, United States

Microsoft Kirkland, Washington, USA Office

Kirkland, United States

Microsoft Mercer Island, Washington, USA Office

Mercer Island, United States

Microsoft Sammamish, Washington, USA Office

Sammamish, United States

Microsoft Seattle, Washington, USA Office

Seattle, United States

Similar Jobs

13 Minutes Ago
Remote or Hybrid
USA
91K-203K Annually
Senior level
91K-203K Annually
Senior level
Machine Learning • Payments • Security • Software • Financial Services
Owns cloud security capabilities across Azure, AWS, and Palo Alto platforms, including CNAPP enablement, vendor relationships, security control ownership, attestation evidence, and control effectiveness reviews. Develops Microsoft Power BI dashboards for cloud configuration violations and stakeholder reporting. The role also designs, implements, documents, and supports security solutions, partners with architecture and operations teams, and drives cloud security improvements.
Top Skills: Amazon Web Services (Aws)Azure DefenderCloud-Native Application Protection Platforms (Cnapp)Cortex CloudAzureMicrosoft Power BiPalo AltoPrisma Cloud
35 Minutes Ago
Remote or Hybrid
Seattle, WA, USA
32K-63K Hourly
Mid level
32K-63K Hourly
Mid level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Guide SMB and mid-market sellers through onboarding and implementation, including scoping calls, training, product guidance, launch readiness, and post-launch support. Manage 20–30 concurrent seller engagements, track milestones, resolve blockers, escalate technical issues, and contribute to process improvements. Maintain product expertise across POS, online, and integrations while collaborating with sales, account management, product, and marketing teams. Use AI tools to improve seller experiences and internal processes.
Top Skills: LookerSalesforce
An Hour Ago
Hybrid
3 Locations
Senior level
Senior level
Financial Services
Manages and grows a portfolio of large business banking clients through relationship development, prospecting, referrals, deposit and cash management solutions, credit opportunities, and financial advice. Builds customized banking strategies, partners with internal specialists, supports business lending, conducts client visits, deepens primary banking relationships, and ensures regulatory and risk-management compliance.
Top Skills: ExcelMS OfficeOutlookPowerPointWord

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account