Job Url: https://www.linkedin.com/jobs/search/?currentJobId=4326188882&distance=25&f_AL=true&f_TPR=r3600&f_WT=2&geoId=103644278&keywords=software%20engineer&origin=JOB_SEARCH_PAGE_JOB_FILTER&refresh=true&start=50

Job Description: AI QA Engineer 
United States · 31 minutes ago · 6 applicants
Company review time is typically 1 week


 Remote
Matches your job preferences, workplace type is Remote.

Full-time

Easy Apply

Save
Save AI QA Engineer  at United IT
AI QA Engineer
United IT · United States (Remote)

Easy Apply

Save
Save AI QA Engineer  at United IT
Show more options
Job match summary not available
This job post doesn't have enough information to generate a match summary.
Get personalized tips to stand out to hirers
Practice mock interviews personalized to every role and get custom feedback

Try Premium for PKR0
About the job
AI QA Engineer 

Remote

Expereince:12+ Years 

 

 Responsibilities: 
 - Ensure trust, safety, and quality. 

 - Design/execution of test plans for LLMs & RAG. 

 - Validate agentic AI with automation. 

 - Evaluate outputs in Turkish & English. 

 - Maintain golden datasets for benchmarking. 

 - Build automated pipelines for testing. 

 - Work on SOC2/HIPAA compliance validation. 

 - Track QA metrics: grounding, latency, confidence. 

 
 Preferred: 

 - 5+ yrs QA for SaaS/Cloud/AI. 

 - Conversational AI testing experience. 

 - RAG/hallucination/bias testing expertise. 

 - API + automation knowledge. 

 - Agile + defect mgmt experience. 

 - Strong communication skills. 

 
 Nice to Have: 

 - CI/CD (GitHub/Jenkins) 

 - SQL/NoSQL 

 - Customer engagement platforms 

 - Agentic tool protocols (MCP)