Microsoft Logo

Microsoft

Senior Software Engineer - Infrastructure

Reposted 3 Days Ago
Be an Early Applicant
In-Office
Redmond, WA, USA
120K-261K Annually
Senior level
In-Office
Redmond, WA, USA
120K-261K Annually
Senior level
Designs, develops, and operates secure, scalable Kubernetes infrastructure for Microsoft Foundry AI workloads. Responsibilities include AKS fleet management, infrastructure and configuration as code, networking, security and compliance, observability, CI/CD automation, reliability engineering, production troubleshooting, on-call support, and technical leadership through architecture and code reviews.
The summary above was generated by AI
Overview
The Infrastructure team in Finetuning, Inference and Training (FIT) group is looking for a Senior Software Engineer who loves to build scalable, highly available, and secure microservices that run in Kubernetes. The Infrastructure team focuses on managing a large fleet of Azure Kubernetes Services (AKS) that represents the control and data plane services for AI Platform.
The team focuses on: Managing Kubernetes Cluster Deployments at Scale. Secure Control and Data Plane assets from malicious attacks and unauthorized access using industry standard tools and frameworks. Automate monitors and critical alerts using best in class observability tools such as: Azure Monitor, Prometheus, Azure Data Explorer, Grafana. Automate CI/CD deployments using YAML builds and releases.
We build tools to increase the observability of the applications running in the Kubernetes clusters, improve the speed, security, and reliability of our deployments, secure our supply chain and services, and debug production with ease. We use the best of open source, like Prometheus, Grafana, KEDA and Istio, and build solutions to enable AI Platform to deliver a global service that handles large scale Microsoft Foundry training and inferencing workloads.
As a Senior Infrastructure Engineer, you will design and automate secure, highly available Kubernetes low-latency/high throughput services and the systems that deploy, observe, and operate them at scale. You will deepen your expertise in cloud infrastructure, 1P/3P model deployments, network Isolation, distributed systems, reliability engineering, security, and production operations while partnering with software engineers and service teams.
 
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

As a Senior Software Engineer on our team, you will drive the design, development, and support of the platform that powers Microsoft Foundry Infrastructure team. You’ll work across teams to help make the whole organization successful. Your responsibilities will include the following:

  • Extensive experience with Kubernetes cluster creation, management, and optimization. Hands-on experience with CPU/GPU support in Kubernetes.
  • Expert level knowledge around security and compliance experience for Kubernetes.
  • Extensive experience developing Infrastructure as Code (IaC) and Configuration as Code (CaC) solutions using tools like YAML, Bicep, and Helm.
  • Solid understanding of networking in k8s for inter, intra and external pod-to-pod, control and data plane communications.
  • Write clean and concise code with unit tests.
  • Design, implement, and support new features as well as extend existing systems.
  • Investigate live site issues and implement and deploy fixes.
  • Participate in an on-call rotation.
  • Security Configuration and Compliance: Configure, update, and maintain security tools used for endpoint security, log collection and reporting, vulnerability, and compliance scanning. Hardening and compliance with best practices, benchmarks, and remediate vulnerabilities as reported by security.
  • Uses appropriate artificial intelligence (AI) tools and practices across the software development lifecycle (SDLC) in a disciplined manner. Takes responsibility for the content of their AI-generated changes to artifacts, reviewing all changes and applying appropriate tooling and processes with minimal guidance.
  • Build and operate large-scale Kubernetes-based infrastructure that powers Microsoft Foundry, focusing on reliability, security, scalability, and observability. 
  • Own platform engineering areas including AKS fleet management, monitoring and alerting, CI/CD automation, and production operations. 
  • Drive operational excellence by troubleshooting live-site issues, participating in on-call, and continuously improving service quality and engineering practices. 
  • Provide technical leadership through architecture decisions, cross-team collaboration, code and design reviews, and raising the engineering quality bar across the organization.

Qualifications

Required Qualifications:

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience
Other Requirements:
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
    • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Preferred Qualifications:
  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience
  • Experience in K8s platform design and implementation at scale
  • 5+ years of experience with coding in one of C#, Python, Go, Rust, Java, C or C++.
  • Experience with improving service operations or engineering fundamentals
  • Excellent collaboration skills, team player, thrive to make a difference
  • Excellent architecture and design skills

#AIINFRA

 

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

HQ

Microsoft Redmond, Washington, USA Office

1 Microsoft Way, Redmond, WA, United States, 98052

Microsoft Bellevue, Washington, USA Office

Bellevue, United States

Microsoft Issaquah, Washington, USA Office

Issaquah, United States

Microsoft Kirkland, Washington, USA Office

Kirkland, United States

Microsoft Mercer Island, Washington, USA Office

Mercer Island, United States

Microsoft Sammamish, Washington, USA Office

Sammamish, United States

Microsoft Seattle, Washington, USA Office

Seattle, United States

Similar Jobs

10 Days Ago
Hybrid
Seattle, WA, USA
Senior level
Senior level
Financial Services
Leads infrastructure platform engineering within an agile team, delivering secure, scalable production software. Provides technical direction, reviews code, drives software development lifecycle governance, and promotes responsible AI-assisted engineering practices. Designs and troubleshoots systems independently while serving as a technical subject matter expert. The role emphasizes cloud-native infrastructure, automation, operational stability, and collaboration with technical teams, contractors, and vendors.
Top Skills: Aws EksCniCockroachdbContainersCriCsiGcp GkeKubernetesMicrosoft Sql ServerOracle
One Month Ago
In-Office
Bellevue, WA, USA
182K-242K Annually
Senior level
182K-242K Annually
Senior level
Cloud • Information Technology • Machine Learning
Senior Software Engineer focused on AI infrastructure performance insights and observability. Responsible for designing and building monitoring, instrumentation, metrics, and tooling to measure and optimize compute and platform performance while collaborating with infrastructure and ML teams.
11 Days Ago
In-Office or Remote
2 Locations
184K-357K Annually
Senior level
184K-357K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Design, deploy, operate, and automate reliable large-scale EDA infrastructure services on NVIDIA hardware. Build tools that reduce manual work, support distributed private and public cloud systems, define service-level objectives, improve observability, and participate in incident response and on-call rotations. The role also provides systems-design guidance to peer teams and may involve Kubernetes, OpenStack, Docker, Slurm, multi-cloud infrastructure, networking, storage, and GPU-based systems.
Top Skills: Ai AgentsBare Metal As A ServiceCloud InfrastructureContainersContinuous IntegrationDistributed SystemsDockerGoInfrastructure AutomationKubernetesLinuxMcp ServersNetworkingNvidia GpusOpenstackPythonSlurmStorageWorkflow Engines

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account