AI Infrastructure / Product Engineer

About the Role As an AI Infrastructure / Product Engineer, you will work at the intersection of AI research and product development at a healthtech company building AI products. You will help turn experiments into dependable systems and features, and build ways to measure and improve their quality. What You'll Do • Build repeatable benchmarks and evaluation pipelines to measure model accuracy, hallucinations, retrieval quality, latency, and cost. • Create dashboards that make changes in system performance visible to the team. • Develop production retrieval, drafting, document, and agent workflows from research prototypes. • Build backend services, APIs, and internal tools to help test and release improvements. • Deploy and operate cloud infrastructure, including monitoring, databases, delivery pipelines, and reliable operations. • Collaborate with AI research while staying connected to product and user needs. What We're Looking For • At least 3 years of experience as a software, infrastructure, or product engineer building and deploying production systems. • Strong Python skills and hands-on cloud deployment experience. • Experience with APIs, databases, backend services, deployment pipelines, and production monitoring. • Experience building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI systems. • Ability to turn ambiguous ideas and experimental code into usable, maintainable products. • Interest or experience in LLMs, retrieval-augmented generation, agents, AI benchmarks, or document automation. • Full-stack experience is helpful. Familiarity with FastAPI, Docker, React, Next.js, Postgres, or vector databases is a plus. Compensation & Benefits Annual base salary is $180,000 to $260,000 USD, depending on skills, experience, and role scope. Visa sponsorship is not available. Location Remote within the United States.