MLabs Logo

MLabs

Staff Software Engineer - Backend & AI Infra

Reposted 20 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Lead design and implementation of high-performance agent runtimes, backend services, and self-hosted model/agent infrastructure. Build low-latency execution systems, real-time data pipelines, telemetry loops, CI/CD for zero-downtime deployments, and ensure fleet reliability on AWS/EKS.
The summary above was generated by AI

Staff Software Engineer - Backend & AI Infra

Remote | Full-time
Location:
Based in US to GMT timezones

Compensation: Competitive Compensation Package

Our client is a high-growth technology firm. They are seeking a Staff Software Engineer to spearhead two critical domains: the core agent runtime and backend infrastructure powering a high-frequency trading fleet, and the comprehensive migration of model hosting and agent deployment to in-house, proprietary infrastructure.

This is a foundational, high-impact building role. The successful candidate will design and implement the backend services, runtime engines, and deployment systems that enable a fleet of autonomous agents to operate with superior speed, reliability, and intelligence. By moving away from third-party LLM providers and hosted platforms, this role will establish the sovereign infrastructure necessary for the next generation of autonomous financial software.

Key Responsibilities

Agent Runtime & Backend Development

  • Plugin Runtime Ownership: Lead the evolution of the per-agent process, migrating from a distributed Go/Python hybrid to a centralized, high-performance Go service utilizing Postgres state and real-time websocket price feeds.
  • Rules Engine Engineering: Build a YAML-configurable "Scanner Gateway" to bridge signal production and execution, allowing for complex scoring and filtering without direct code manipulation.
  • Advanced Execution Systems: Develop and maintain the RatchetStop Backend, a centralized profit-trailing service capable of sub-second evaluation and websocket-based order execution to protect capital even when agents are offline.
  • Data & Connectivity: Manage the Model Context Protocol (MCP) server bridging agents to platform tools, and oversee a high-throughput data pipeline (Redis, Postgres, ClickHouse) for real-time market intelligence ingestion.

Model & Agent Hosting Migration

  • Infrastructure Sovereignty: Lead the technical execution of migrating agents from third-party platforms to a custom-built, Senpi-hosted environment featuring isolated workspaces and state persistence.
  • Model Serving: Evaluate and implement the transition from external LLM APIs (Anthropic, Google) to self-hosted inference, optimizing for telemetry capture and performance.
  • Telemetry & Feedback Loops: Architect systems to capture every agent decision and score, creating a self-reinforcing loop where the fleet learns and improves from collective performance data.
  • Deployment Pipelines: Build robust CI/CD pipelines for zero-downtime rollouts, ensuring that updates to scanner logic or runtime patches do not interrupt active market positions.

Infrastructure & Operations

  • System Reliability: Design monitoring and alerting frameworks to detect agent failures, state corruption, or authentication expirations before they impact financial performance.
  • Cloud Orchestration: Manage AWS/EKS environments using Infrastructure-as-Code (IaC).
  • Incident Response: Own the operational health of the fleet, acting as the primary responder for high-stakes trading system incidents.

IInterview Process

  1. Founder / CEO Interview: Introduction to the vision and strategic goals.
  2. Take-Home Test: A practical assessment of technical design and coding capabilities.
  3. Technical Interview: A deep dive into systems architecture and engineering expertise.
  4. Final Interview: Cultural alignment and final technical synthesis.

Requirements
  • Technical Essentials
    • Expert Backend Engineering: Proficiency in writing production-grade code in Go, Python, and Node.js/TypeScript (Go is strongly preferred for runtime services).
    • Startup Experience: A proven track record of building complex backend services (APIs, job scheduling, distributed systems) from scratch in a fast-paced environment.
    • Real-Time Systems: Deep understanding of low-latency environments, websocket management, and sub-second condition evaluation.
    • Database Mastery: Production experience with Postgres, Redis, and at least one analytical database (e.g., ClickHouse, TimescaleDB, or BigQuery).
    • Orchestration: Hands-on experience deploying, scaling, and debugging production workloads on Kubernetes (AWS EKS).
    • End-to-End Ownership: Demonstrated ability to design, build, deploy, and maintain systems throughout their entire lifecycle.
  • Preferred Qualifications
    • LLM Infrastructure: Experience with model serving and optimizing inference (e.g., vLLM, TGI, or TensorRT-LLM).
    • FinTech/Trading: Background in exchange APIs, wallet operations, or on-chain infrastructure where uptime has direct financial consequences.
    • Agentic Frameworks: Familiarity with Model Context Protocol (MCP) or orchestrating multi-agent platforms.

Benefits
    • Competitive compensation and equity packages.
    • The opportunity to build foundational infrastructure in a new category of autonomous software.
    • High-autonomy environment with a focus on engineering excellence.
    • Collaborative culture working alongside industry-leading founders and engineers.

Due to the high volume of applications we anticipate, we regret that we are unable to provide individual feedback to all candidates. If you do not hear back from us within 4 weeks of your application, please assume that you have not been successful on this occasion. We genuinely appreciate your interest and wish you the best in your job search.

Commitment to Equality and Accessibility:

At MLabs, we are committed to offer equal opportunities to all candidates. We ensure no discrimination, accessible job adverts, and providing information in accessible formats. Our goal is to foster a diverse, inclusive workplace with equal opportunities for all. If you need any reasonable adjustments during any part of the hiring process or you would like to see the job-advert in an accessible format please let us know at the earliest opportunity by emailing [email protected].

MLabs Ltd collects and processes the personal information you provide such as your contact details, work history, resume, and other relevant data for recruitment purposes only. This information is managed securely in accordance with MLabs Ltd’s Privacy Policy and Information Security Policy, and in compliance with applicable data protection laws. Your data may be shared only with clients and trusted partners where necessary for recruitment purposes. You may request the deletion of your data or withdraw your consent at any time by contacting [email protected].

Similar Jobs

3 Minutes Ago
Remote
USA
Entry level
Entry level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Build AI-powered workflows, agents, integrations, and internal tools that automate People Operations. Partner with People, Engineering, and IT to modernize onboarding and other employee processes, while implementing secure access controls, human oversight, escalation paths, and production-ready architectures. Prototype with users, iterate quickly, and measure improvements in efficiency, employee experience, and operational consistency.
Top Skills: AIAi AgentsAPIsHrisInternal ToolsSlackWorkflow Automation
8 Minutes Ago
In-Office or Remote
130K-163K Annually
Senior level
130K-163K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Develop novel AI/ML solutions for healthcare using structured and unstructured data. Build agentic, generative AI, deep learning, and traditional machine learning systems in distributed environments. Design experiments, perform statistical analysis, create visualizations, communicate findings, support responsible AI compliance, document models, and collaborate on MLOps, LLMOps, and data pipelines.
Top Skills: Agentic Ai FrameworksDistributed ComputingGitLlmopsLlmsMlopsPythonPyTorchRelational DatabasesSnowflakeSparkTensorFlow
8 Minutes Ago
In-Office or Remote
113K-193K Annually
Senior level
113K-193K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Manages strategic PBM client accounts, contract relationships, service delivery, renewals, upselling, and client retention. Acts as the primary client advocate, coordinates implementations and internal service efforts, addresses ongoing needs, and partners with brokers and account teams. Presents to senior client leaders, manages a portfolio of ten or more accounts, and mentors new Strategic Account Executives. The role is fully remote within the U.S. with travel of up to 25%.

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account