Company Name: BrightHire

Job Details: Hiring Remotely in USA Remote Senior level

Job Url: https://builtin.com/job/staff-principal-applied-ai-engineer/6949839

Job Description: BrightHire is a category-creating, Series B software company with a mission to give everyone the hiring experience they deserve.We deliver on this mission by transforming the way many of the world’s leading companies build exceptional teams. We created the Interview Intelligence category, and our clients include some of the world’s most innovative companies—from Canva and Zapier to HCA Healthcare—as well as members of the Fortune 100.LocationRemote - USAAbout the RoleYou will be the bridge between breakthrough prototypes and rock-solid production AI. Partnering closely with our Staff Full Stack Engineers, Product, and Design, you will transform early-stage GenAI features into polished, scalable, and governable capabilities that delight users at scale. Your focus will be relentless quality: devising rigorous evaluation frameworks, refining prompts and retrieval pipelines, and optimizing model choices for cost, latency, accuracy, tone, and safety. You will help build the shared AI platform that powers products such as:AI Interviewer conversation loops that adapt in real timeAI Fraud Signals that flag suspicious behavior with minimal false positivesAI Candidate skills matrices and assistants that surface instant insightsModular, model-agnostic architectures that allow us to confidently swap models as new model versions are released.What You’ll DoDesign and own comprehensive eval harnesses that measure accuracy, completeness, style, hallucination rate, bias, and safety across every releaseTune and iterate on RAG pipelines, prompt chains, conversation loops, provider selections, and fine-tunes until quality bars are met or exceededBuild reusable data and evaluation pipelines, a shared semantic layer, and monitoring dashboards that make it easy for product teams to ship reliable AI quicklyOptimize for cost and latency, continuously benchmarking models and negotiating trade-offs between performance and spendImplement robust data governance, lineage, and AIOps practices that satisfy enterprise compliance requirements and support our AI bias audit processCollaborate daily with the data science team and cross-functional squads to embed evaluations into CI/CD and ensure every deploy meets our candidate-first standardsContribute to a modular, model-agnostic architecture that lets us switch or upgrade LLMs with minimal frictionDocument best practices and share knowledge to raise the bar for AI development across BrightHireWhat You’ll Bring5+ years building production machine-learning or NLP systems, including at least 1 year focused on generative-AI or LLM applicationsDemonstrated experience creating automated evaluation suites for LLM outputs (accuracy, safety, bias, tone, style) and using results to guide iterative improvementsDeep knowledge of prompt engineering, RAG techniques, vector search, embeddings, fine-tuning, and model selection across multiple providersStrong Python skills and familiarity with modern LLMOps/MLOps stacks (e.g., Prefect, dbt, vector databases, promptfoo or other evaluation harnesses)Comfort working with both structured (SQL) and unstructured (text, audio, embeddings) data, and building pipelines that join them seamlesslyA mindset for governance: understanding of data privacy, AI ethics, bias mitigation, and enterprise compliance frameworksAbility to communicate complex AI trade-offs clearly to engineers, designers, and executives alikeBias toward action, curiosity, and a passion for building high-quality user experiencesAbout Our TeamHigh-impact projects in small, autonomous squads where you can lead platform initiatives or dive deep as a specialistThoughtful developer experience with fast CI, 1-click deploys, strong observability, and clean codebasesSustainable remote culture: regular working hours, no-meeting Wednesdays, and flexible time offCollaborative, kind teammates who value learning and growthPerks & BenefitsWork-from-home stipend and quarterly snack deliveriesAnnual learning stipend and generous vacation stipend to rechargeCompetitive compensation, equity, and benefits packageEqual Employment Opportunity (EEO) StatementOur company does not discriminate in employment on the basis of race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, retaliation, parental status, military service, or other non-merit factor.*Note to Recruiters and Placement Agencies: We do not accept unsolicited agency resumes. Please do not forward unsolicited agency resumes to our website. We will not pay fees to any third party agency or firm and will not be responsible for any agency fees associated with unsolicited resumes. Unsolicited resumes received will be considered our property.