Microsoft Logo

Microsoft

Principal AI System Architect

Posted Yesterday
Be an Early Applicant
In-Office
Redmond, WA, USA
143K-304K Annually
Senior level
In-Office
Redmond, WA, USA
143K-304K Annually
Senior level
Owns AI rack- and cluster-scale hardware system architecture for Microsoft Azure infrastructure. Defines requirements and specifications, evaluates architecture tradeoffs across accelerators, networking, memory, storage, power, cooling, and datacenter constraints, and develops proof-of-concepts and performance models. The role drives cross-functional engineering alignment, influences industry standards and vendor roadmaps, and helps deliver scalable AI accelerator systems.
The summary above was generated by AI
Overview

Do you want to be at the forefront of innovating the latest hardware designs to propel Microsoft’s cloud growth? Are you seeking a unique career opportunity that combines technical capabilities, cross-team collaboration, with business insight and strategy?  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to achieve our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. 

Join the Systems Pathfinding and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, the team behind Microsoft’s expanding Cloud Infrastructure and for powering Microsoft’s “Intelligent Cloud” mission. Microsoft delivers more than 200 online services to more than one billion individuals worldwide, and AHSI is the team behind our expanding cloud infrastructure. We deliver the core infrastructure and foundational technologies for Microsoft's cloud businesses including Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live.    

We are seeking a passionate Principal AI System Architect to join the team. In this role you will own and define the system architecture requirements; it is a broad role with the ability to make a direct impact on Microsoft AI accelerator systems. 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.  


Responsibilities
  • Define AI rack- and cluster-scale architecture across accelerator, host, network, memory, storage, power, cooling, and datacenter constraints. Make quantitative tradeoffs across performance and TCO. 

  • Develop functional proof-of-concepts to evaluate and de-risk new capabilities 

  • Write and own high-level product requirements and specifications 

  • Drive alignment across cross-functional engineering and leadership teams. Own the outcomes. 

  • Use performance simulations and hardware models for what-if studies to evaluate and choose between architecture options. 
  • Industry influence: Participate in industry consortiums to shape standards, and influence vendor roadmaps. 


Qualifications

Required Qualifications 

  • Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 7+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR equivalent experience.

Other Requirements 

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.  

Preferred Qualifications 

  • Doctorate in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 5+ years of technical engineering experience OR Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 12+ years technical engineering experience OR equivalent experience
  • Experience in large scale AI datacenter systems and their network
  • Demonstrated expertise in one or more of these domains: networking (RoCE, Infiniband transports, congestion control, network topology design), reliability and serviceability, datacenter architecture for large scale AI systems
  • Experience owning hardware system architecture at scale – machine, rack row and cluster, authoring specifications and requirements
  • Ability to make decision trade-offs across domains
  • Deep expertise in AI systems or a key domain such as networking, reliability, power management
  • Skilled in partnering and influencing architects, hardware engineers, and software leads
  • Ability to manage through ambiguity, bringing clarity to establish direction and driving decisions
  • Collaboration skills, teamwork, and sense of presumed responsibility  

Hardware Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

HQ

Microsoft Redmond, Washington, USA Office

1 Microsoft Way, Redmond, WA, United States, 98052

Microsoft Bellevue, Washington, USA Office

Bellevue, United States

Microsoft Issaquah, Washington, USA Office

Issaquah, United States

Microsoft Kirkland, Washington, USA Office

Kirkland, United States

Microsoft Mercer Island, Washington, USA Office

Mercer Island, United States

Microsoft Sammamish, Washington, USA Office

Sammamish, United States

Microsoft Seattle, Washington, USA Office

Seattle, United States

Similar Jobs

8 Minutes Ago
Hybrid
Mid level
Mid level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Build and support authenticated owner web experiences across front-end React UIs and backend Java/Spring Boot services. Design, implement, test, and troubleshoot features and APIs, collaborate with product and design, contribute to architecture and CI/CD practices, and improve developer velocity and platform consistency.
Top Skills: Automated TestingCi/CdJavaJavaScriptReactRestful ApisSpring BootTypescript
9 Minutes Ago
Hybrid
Senior level
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Design and develop backend services, APIs, microservices, integrations, and event-driven solutions for digital commerce and order management. Own testing, CI/CD, deployments, observability, cloud infrastructure, and production reliability using Azure, Docker, and Kubernetes. Troubleshoot incidents, improve security and scalability, apply AI-assisted development practices, mentor engineers, participate in hiring, and communicate technical risks and decisions to stakeholders.
Top Skills: AzureAzure Event HubsCi/CdDatadogDockerDroolsGitGithub CopilotGraphQLIbm Order Management SystemJavaKafkaKubernetesNode.jsPythonRestShopifyTerraform
12 Minutes Ago
In-Office
70K-90K Annually
Senior level
70K-90K Annually
Senior level
Manufacturing
Manages and grows an established sales territory across the greater Houston area for Moen. Builds relationships with plumbing wholesalers, contractors, builders, plumbers, and trade professionals; identifies new business opportunities; executes territory sales plans; presents products and training; supports merchandising and promotional programs; manages customer accounts through CRM tools; shares market insights; and travels up to 50% by vehicle.
Top Skills: CRMHubspotExcelMicrosoft Office SuiteMicrosoft OutlookMicrosoft PowerpointMicrosoft WordSalesforce

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account