Company Name: CoinMarketCap

Job Details: 13 Locations In-Office or Remote Junior

Job Url: https://builtin.com/job/ai-prompt-and-quality-engineer/6626722

Job Description: Responsibilities- Quality Monitoring: Conduct daily quality assurance on AI Chatbot responses through manual sampling and user feedback to assess accuracy, relevance, and naturalness.- Issue Resolution: Detect response-quality issues promptly; document root causes, propose actionable improvements, and follow through to closure.- Model Tuning: Collaborate with engineering teams to optimize AI models by participating in data annotation, parameter adjustment, and other enhancement tasks to boost performance and answer quality.- Data Analysis: Collect and analyze user-conversation data to uncover user needs and pain points, providing data-driven insights for optimization.- Process Improvement: Refine quality-control workflows to increase efficiency and ensure standardization of QA and tuning processes.Requirements1. Technical Skills- Solid understanding of AI Chatbot mechanisms and quality-evaluation criteria.- Basic data-analysis skills; proficient in SQL, Excel, and related tools.- Foundational knowledge of Natural Language Processing (NLP) and Machine Learning.2. Experience- 2+ years of relevant experience; prior optimization experience with AI or conversational products is preferred.- Experience with industry-leading AI Chatbot products is a strong plus.3. Soft Skills- Strong communication and collaboration abilities.- Meticulous, patient, and adept at identifying and solving problems.- Thrives in a fast-paced environment and demonstrates a strong learning aptitude.