Job Title: AI Platform Engineer - LLM Agents & RAG Company Name: Signant Health Job Details: RemoteFull,Time Job Url: https://hiring.cafe/viewjob/tcny8rzliykhljp6 Job Description: Posted 1d agoAI Platform Engineer - LLM Agents & RAG@ Signant HealthView All JobsWebsiteUnited StatesRemoteFull TimeResponsibilities:Build AI-powered agents, Implement RAG solutions, Develop AI platform componentsRequirements Summary:5+ years software engineering; 2+ years AI/ML or LLM-based apps in production; Python proficiency; experience with RAG, vector databases, and AI safety.Technical Tools Mentioned:Python, APIs, Distributed systems, Git, CI/CD, Prompt engineering, RAG, Vector databases, Knowledge stores, LLM platforms About the Role The AI Engineer – Platform will build and optimize Signant Health’s AI platform and intelligent agents that automate workflows across the organization. This role sits at the intersection of production software engineering and applied generative AI—delivering agentic applications, RAG capabilities, evaluation frameworks, and guardrails that ensure safe, reliable, and compliant AI outcomes. What you will do Build AI-powered agents that automate multi-step workflows and integrate with internal tools and data sources Implement Retrieval-Augmented Generation (RAG) solutions to ground responses in trusted knowledge Develop and maintain AI platform components and reusable services (APIs, pipelines, orchestration) Design evaluation frameworks to measure quality (accuracy, relevance, safety) and improve performance over time Monitor production AI systems; optimize latency, cost, reliability, and user outcomes Engineer datasets and support fine-tuning and model selection decisions (RAG vs fine-tuning vs prompting) Implement guardrails and security controls (prompt injection resistance, sensitive data handling, safe output behaviors) Partner with Security/Legal/Compliance to align AI implementations to governance and regulatory expectations Document designs, standards, and operational runbooks; participate in code reviews and knowledge sharing Preferred Qualifications 5+ years of software engineering experience with strong proficiency in Python and production systems 2+ years building and deploying AI/ML or LLM-based applications in production Hands-on experience with prompt engineering and context management for LLM apps Proven experience implementing RAG systems and using vector databases/knowledge stores Experience building evaluation metrics/frameworks for AI quality and reliability Strong engineering fundamentals (APIs, distributed systems, Git, CI/CD, testing) Solid understanding of AI safety and security principles (guardrails, hallucination mitigation, prompt injection prevention) Desired Qualifications Experience with autonomous/agentic workflows (tool use, planning, state management) Experience optimizing model inference (performance/cost trade-offs; deployment optimization) Observability experience for AI systems (monitoring, logging, alerting, dashboards) Experience operating in regulated environments (GDPR, HIPAA, SOC2 or similar) Healthcare, life sciences, or clinical trial technology experience Experience with AI safety testing/red-teaming approaches Familiarity with common AI platforms/frameworks and model providers (agent frameworks and managed LLM services) Willingness to collaborate across teams and communicate clearly with technical and non-technical stakeholders Why Signant Health? At Signant Health, your work has real impact. Everything we build, support, and deliver helps advance clinical research and bring new treatments to patients faster — improving lives around the world. Our teams combine science, technology, and operational expertise to solve complex clinical trial challenges, and every role contributes to that mission. We offer a collaborative, global environment where you can grow your career while working alongside experts across clinical, technology, data, and operations, with opportunities to learn, take ownership, and drive meaningful innovation — not just maintain the status quo. If you are looking for purpose-driven work, smart colleagues, and the opportunity to help shape the future of clinical research and digital health, Signant Health is the place to do it. #LI-AS1 #LI-Remote   At Signant Health, accepting difference isn’t enough—we celebrate it, we support it, and we nurture it for the benefit of our team members, our clients and our community.  Signant Health is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, colour, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or veteran status.