Job Title: Founding Principal Software Engineer Company Name: Convoy Health Job Url: https://www.linkedin.com/jobs/view/4383378404/?eBP=NOT_ELIGIBLE_FOR_CHARGING&trk=flagship3_search_srp_jobs&refId=7FHBNPt73Z0JV1QgFQZBFA%3D%3D&trackingId=%2BQwCirfX2AIHN1G80PKd8g%3D%3D Job Description: Convoy Health Founding Principal Software Engineer United States · 30 minutes ago · 8 applicants Company review time is typically 1 week Remote Full-time Easy Apply Save Use AI to assess how you fit Get AI-powered advice on this job and more exclusive features with Premium. Try Premium for Rs 0 Show match details Tailor my resume Help me stand out People you can reach out to Meet the hiring team CJ Connett, CFA • 3rd+ Convoy Health | MIT MBA Job poster Message About the job Founding Principal Software Engineer Location: Remote (US-based preferred)  Reports To: Chief Technology Officer  Team: Engineering & AI    About Convoy Convoy is building the “AI-powered CFO” for medical groups. Our platform delivers benchmarking, revenue forecasting, vendor optimization, and capital access with minimal lift from customers. Our data strategy embraces federated, zero-lift implementation, while our product vision embraces agentic software development—where AI tools serve as first-class collaborators in building healthcare infrastructure.  Convoy is backed and incubated by AlleyCorp, one of New York’s leading venture studios and early-stage investors. We’re a small, execution-driven team building the financial operating system for independent healthcare providers.    Role Overview We’re hiring a Founding Principal Software Engineer to architect and scale Convoy’s Platform, AI layer—the intelligence that powers onboarding, financial reasoning, and natural language interaction. You’ll own the design and implementation of multi-agent orchestration systems, prompt frameworks, retrieval pipelines, and verification logic that drive our “AI-powered CFO” experience.  This role combines deep hands-on engineering with product intuition. You’ll work closely with product and data science leadership to translate real-world financial workflows into reliable, context-aware AI systems that reason securely over federated healthcare data.  As one of Convoy’s earliest technical hires, you’ll shape our AI stack, agentic workflow standards, and the underlying infrastructure that powers intelligent product modules.    Key Responsibilities AI Architecture & Agentic Systems  Design and build Convoy’s multi-agent orchestration layer using Bedrock, LangChain, or similar frameworks.  Implement prompt routing, model selection, and delegation strategies to enable task-specific reasoning.  Define standards for prompt construction, context window optimization, and memory management.  Integrate structured data reasoning via metadata augmentation, embeddings, and contextual retrieval.  LLM Infrastructure & Integration  Develop APIs and backend services that connect LLM workflows to Convoy’s federated data layer.  Implement validation, traceability, and feedback pipelines to ensure reliable AI output.  Support versioning, evaluation, and auditability for LLM prompts and reasoning chains.  Work with the product team to embed AI workflows directly into Convoy’s onboarding, benchmarking, and financial modeling tools.  Product & Experimentation  Prototype AI-driven product experiences—such as conversational copilots, forecasting explainers, and financial chat assistants.  Collaborate cross-functionally to identify opportunities for agentic automation and intelligent UX.  Conduct experimentation and model evaluations across prompts, architectures, and data contexts.    Ideal Background & Experience 4–8 years of experience in applied machine learning, NLP, or AI systems engineering.  Deep familiarity with LLM development frameworks (Bedrock, LangChain, LlamaIndex, Haystack).  Hands-on experience with OpenAI APIs (GPT-4/5), Anthropic Claude, or open-weight models.  Strong programming fluency in Python and TypeScript, with a focus on backend systems.  Experience building retrieval-augmented generation (RAG) or embedding-based systems.  Understanding of data privacy, security, and compliance considerations for healthcare or financial applications.    Bonus Experience Prior work building agentic AI systems or co-pilot experiences in production.  Experience with multi-agent reasoning, vector databases (Pinecone, FAISS), and prompt evaluation tools.  Familiarity with healthcare or financial reasoning domains.  Prior experience at an early-stage AI or data infrastructure startup.    Key Traits Architect mindset with a builder’s instinct—comfortable designing and coding production systems.  Systems thinker who can balance performance, reliability, and explainability in AI workflows.  Pragmatic, product-oriented engineer who focuses on business value over research novelty.  Excited by early-stage environments where your work defines the foundation.  Mission-aligned with Convoy’s vision to transform healthcare finance through intelligent, AI-native software.  Set alert for similar jobs Principal Software Engineer, United States