Progress Partners Logo

Progress Partners

Senior AI Product Engineer

Reposted 4 Days Ago
Remote
Hiring Remotely in Georgia, USA
Senior level
Remote
Hiring Remotely in Georgia, USA
Senior level
Own and improve the quality of AI-powered customer experiences by building evaluation frameworks, running experiments on prompts and model settings, reducing AI costs, diagnosing failure modes, and translating findings into prioritized fixes that drive activation, conversion, retention, and satisfaction.
The summary above was generated by AI
About Progress Partners

Progress Partners is a fast-growing technology company building and scaling next-generation SaaS and mobile platforms. We blend creativity with data-driven execution to ship high-impact products, including AI-powered tools, productivity platforms, and workflow software, used by millions of people in more than 160 countries.

Our global team of experts in software development, product design, growth, and analytics collaborates across time zones to deliver category-defining innovations. We work end-to-end across the product lifecycle: design, build, launch, and scale.

If you’re passionate about building transformative products, Progress Partners is a place to make a lasting impact.

About the Role

We're looking for a Senior AI Product Engineer to own the continuous improvement of our customer-facing AI products, making them more accurate, reliable, cost-efficient, and genuinely useful to the people who rely on them every day. This isn't a prompt-writing job, it's about building the structured loop of evaluation, experimentation, and analytics that turns AI from a feature into a measurable product advantage. You'll work at the intersection of Product, Growth, and Engineering, with real influence over how AI behavior gets measured, improved, and shipped.

What You’ll Do
  • Own the end-to-end quality of our AI-powered product experiences, improving response usefulness, consistency, and reliability in ways users actually notice.

  • Build evaluation frameworks and repeatable test sets so we can measure AI quality objectively, not anecdotally.

  • Design and run experiments on prompts, context strategies, and model settings, connecting every change to activation, conversion, retention, or satisfaction metrics.

  • Monitor and reduce AI-related costs (tokens, latency, model choice, retrieval) without compromising the user experience.

  • Translate AI failure patterns, hallucinations, inconsistent outputs, weak reasoning, into clear, prioritized fixes for Product and Engineering.

  • Help Product, Growth, and Engineering teams understand where AI changes create real user and business impact.

What We’re Looking For
  • 5+ years in software engineering, AI product engineering, ML engineering, or a related technical role, plus 2+ years hands-on with LLMs, prompt engineering, or applied AI systems.

  • Proven experience improving AI features post-launch through analytics, experimentation, and structured evaluation, not just initial prompt design.

  • Strong grasp of product analytics, funnel metrics, and how to connect AI behavior to business outcomes.

  • Ability to diagnose whether an AI quality issue stems from prompts, context, model limitations, UX, or data, and to fix the right layer.

  • Strong written communication and the ability to work autonomously in a remote, async environment.

  • Comfort working closely with Product, Growth, Design, Engineering, QA, and Analytics.

  • Comfort with ownership, transparency, and a results-driven mindset.

Nice to Have
  • Experience with A/B testing frameworks, AI observability tools, or custom evaluation pipelines.

  • Hands-on work with OpenAI, Anthropic, Gemini, AWS Bedrock, or similar LLM providers.

  • Familiarity with RAG, embeddings, semantic search, or tool-calling architectures.

  • Background in chatbot, assistant, content generation, or recommendation products.

How We Work

We’re fully remote and distributed across time zones. We default to async, communicate in writing, and trust people to deliver outcomes, not log hours. Decisions are transparent, ownership is clear, and your work is visible from day one.

What We Offer

We believe great work starts with taking care of our people and we want everyone on our team to have the support and resources they need to thrive, both professionally and personally. Here's what you can expect when you join our team:

  • Remote-first: Live and work wherever you're happiest and most productive. No relocation, ever.

  • Flexible hours: we measure outcomes, not time spent at a desk.

  • Unlimited PTO: take the time you need to rest, recharge, and do your best work.

  • Learning & development budget: courses, books, conferences, certifications, whatever helps you grow.

  • Home office & wellness allowance: a dedicated budget to set up your workspace and support your health.

  • Performance-based compensation: your impact directly shapes your pay and career trajectory.

  • A small, senior, collaborative team where your work is visible and your decisions matter.

  • The chance to build products used by millions of people across 160+ countries.

Equal Opportunity

Progress Partners is an equal opportunity employer, and we’re serious about building a diverse, inclusive team. We welcome applications from people of all genders, gender identities and expressions, sexual orientations, ages, ethnicities, nationalities, religions, disabilities, neurotypes, family situations, socioeconomic backgrounds, and life experiences.

We hire on skills, experience, potential, and values fit, never on protected characteristics. If you need accommodations during the application or interview process, just let us know.

Similar Jobs

12 Hours Ago
Remote
Senior level
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
The Pre-Sales Solutions Engineer leads technical discovery, designs and executes POCs, advises on architectural needs, triages issues, and collaborates with teams to ensure customer success and continuous engagement throughout the project lifecycle.
Top Skills: DockerHTTPJavaScriptKubernetesPythonSipTypescriptWebrtc
12 Hours Ago
Remote
Senior level
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
The Solutions Architect will lead enterprise deployments, ensure technical success for customers, and contribute to product improvements. Responsibilities include architecture design, post-sales support, technical problem-solving, and customer engagement.
Top Skills: DockerJavaScriptKubernetesPythonRust
12 Hours Ago
Remote
Senior level
Senior level
Gaming • Software
The People Business Partner will work closely with leadership to address organizational challenges, enhance decision-making, and maintain high talent quality without bureaucratizing HR processes.

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account