Ravenna Logo

Ravenna

AI Engineer

Reposted 2 Months Ago
Remote
Hiring Remotely in USA
160K-200K Annually
Senior level
Remote
Hiring Remotely in USA
160K-200K Annually
Senior level
The AI Engineer will design and build production systems, focusing on LLM integration, system reliability, evaluation frameworks, and high-quality product features while maintaining strong engineering practices.
The summary above was generated by AI
About the Role

At Ravenna, we are looking for experienced engineers with a passion for AI and a strong track record of building and shipping production systems. Our team is combining the latest advances in large language models with proven machine learning techniques to build modern, intelligent product experiences.

This role requires strong engineering fundamentals and a deep curiosity about how AI systems work in practice. You will design, build, and operate LLM powered systems that are reliable, scalable, and deeply integrated into real product workflows.

You will work across the stack. This includes designing AI systems, building backend infrastructure, implementing product features, and iterating quickly based on evaluation and real user feedback. We care deeply about strong engineering practices and expect our AI engineers to think carefully about system design, observability, performance, and reliability.

If you are excited about applying cutting edge AI to disrupt large and established markets, we want to talk to you.

ResponsibilitiesBuild production AI systems

Design and implement systems that integrate LLMs into real product workflows. This includes prompt pipelines, tool integration, structured outputs, and systems that combine models with traditional software components.

Design reliable LLM architectures

Develop robust systems that account for model limitations and failure modes. Build safeguards, retries, evaluation loops, and observability into LLM powered features so they behave reliably in production.

Develop evaluation and experimentation frameworks

Create evaluation datasets and tooling that allow the team to measure model performance, iterate on system design, and prevent regressions as models and prompts evolve.

Build retrieval and knowledge systems

Design and optimize retrieval pipelines that power LLM applications. This includes chunking strategies, indexing approaches, vector search, and improving the quality and speed of knowledge retrieval.

Ship high quality product features

Collaborate with product, design, and engineering teammates to build polished features that leverage AI in ways that feel natural and valuable to users.

Maintain strong engineering standards

Write clean, maintainable, well tested code. Contribute to system architecture, code reviews, and engineering processes that ensure the platform remains reliable and scalable.

About YouStrong engineering fundamentals

You are a strong software engineer first. You have at least five years of experience building production systems and are comfortable designing complex systems that are reliable, maintainable, and scalable.

You think carefully about architecture, testing, observability, performance, and operational reliability.

LLM systems experience

You have built systems around large language models in production environments. You understand that successful AI products require thoughtful system design, not just calling an API.

You have experience designing prompts, managing context, orchestrating tool usage, and improving the reliability of model outputs.

Evaluation mindset

You care deeply about measuring quality. You have experience building evaluation frameworks, designing datasets, and using experiments to guide improvements to prompts, models, and system architecture.

Retrieval and embedding systems

You have experience with retrieval augmented generation systems and understand how retrieval quality affects model performance.

You are comfortable working with embeddings, vector databases, and semantic search, and you understand how these approaches differ from traditional search and indexing systems.

LLM fundamentals

You understand how modern language models work at a conceptual level and can speak about transformers, attention mechanisms, and the tradeoffs between different model architectures.

AI system intuition

You understand the strengths and weaknesses of LLMs in practice. You think about hallucinations, prompt sensitivity, context limits, latency, and cost when designing systems.

Experimentation and iteration

You are comfortable running experiments across prompts, models, and system designs. You use evaluation data and real world feedback to guide improvements.

Benefits
Competitive Salary
  • We believe great people should be compensated well. While we are an early stage company, we offer competitive salaries and aim to pay top of market for exceptional talent.

  • We are building an ambitious company and know that attracting great people requires strong compensation.

Meaningful Equity
  • We hire people who want to help build Ravenna from the ground up. Equity ensures that when the company succeeds, the people who helped build it share in that success.

  • Early team members have the opportunity to make a real impact on both the product and the future of the company.

Choose Your Setup
  • Great work requires great tools. At Ravenna you can choose the hardware and setup that helps you do your best work.

  • Most of the team uses high performance Mac laptops, but you have the flexibility to select the tools and environment that fit your workflow.

Flexible Time Off
  • Doing great work requires time to recharge. We offer flexible paid time off so you can take the time you need to rest and stay at your best.

  • We trust our team to manage their time responsibly while delivering meaningful results.

HQ

Ravenna Seattle, Washington, USA Office

Seattle, WA, United States

Similar Jobs

Yesterday
In-Office or Remote
99K-176K Annually
Mid level
99K-176K Annually
Mid level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Build and deploy production-grade AI/ML software, APIs, and applications for healthcare provider use cases. Develop prompt-based AI capabilities, integrate enterprise data and cloud services, create automated tests and evaluation pipelines, and ensure security, observability, scalability, and reliability. Collaborate with product, architecture, data science, and platform teams while owning technical work from proof of concept through production.
Top Skills: APIsCi/CdCloud PlatformsDockerGitJavaJava EeJwtModel EvaluationMongoDBMySQLOauthOpenshiftPrompt EngineeringReactRestSplunkSpring Boot
Yesterday
In-Office or Remote
2 Locations
Senior level
Senior level
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Build and own evaluation infrastructure, observability tooling, datasets, annotation workflows, and diagnostic systems for production AI agents. Lead experiments across prompts, models, routing, caching, cost, and latency. Diagnose failures across planning, tool use, and agent execution, while partnering with AI Core engineering. Manage and grow the AI Quality team as a hands-on player-coach, contributing directly to production code and technical direction.
Top Skills: Ai AgentsAnnotation WorkflowsBraintrustCachingCi/CdEvaluation FrameworksLangsmithLlmsModel RoutingObservability ToolingPythonRuby On Rails
Yesterday
Remote or Hybrid
CA, USA
238K-322K Annually
Senior level
238K-322K Annually
Senior level
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Set the technical direction for Rapid7’s LLM and agentic AI systems. Lead architecture, model strategy, fine-tuning, post-training, inference optimization, evaluation standards, and complex cross-team initiatives. Build critical model and inference code, mentor senior engineers, resolve technical trade-offs, and influence product and platform strategy across cybersecurity products.
Top Skills: Agentic AiAWSClassical Machine LearningCudaDeepspeedDistributed TrainingDpoFsdpGrpoLlmsLoraPredictive AiPythonPyTorchQloraSglangTensorrt-LlmTransformer ArchitectureTritonVllm

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account