Job Title: Senior QA Engineer - AI-Native Platform

Company Name: Social Links

Job Details: RemoteFull,Time

Job Url: https://hiring.cafe/viewjob/tlxvr3ur4ltvkums

Job Description: Posted 1d agoSenior QA Engineer - AI-Native Platform@ Social LinksView All JobsWebsiteNorth AmericaRemoteFull TimeResponsibilities:build framework, test pipelines, design testsRequirements Summary:3+ years QA automation/SDET; hands-on AI/ML testing; strong Python (pytest, async testing); ability to build test infrastructure from scratch; experience testing distributed/event-driven systems; multi-tenant testing; autonomous work style; English B1+.Technical Tools Mentioned:Python, pytest, async testing, LangGraph, LangChain, BentoML, MLflow, Great Expectations, Dagster
We are a global OSINT company headquartered in the US, empowering investigators and security professionals with cutting-edge AI-powered products. Our technology collects and analyzes massive volumes of data from open sources, including social media, messengers, and the dark web, to create a comprehensive picture for data-driven investigations and decision-making.
Our customers include S&P 500 companies and law enforcement agencies in 80+ countries worldwide. Social Links is scaling rapidly, growing 2x annually, with the ambition of becoming a unicorn valued at $1B+.
We are looking for a hands-on Senior QA Engineer building test infrastructure and evaluation frameworks from scratch for a distributed AI platform. Primary focus: testing non-deterministic AI agent outputs, RAG pipeline quality, multi-tenant data isolation, and cross-service integration.

Your Tasks Will Be:

Build and maintain AI evaluation framework
Test RAG pipeline quality and retrieval relevance
Design testing approaches for non-deterministic LLM outputs
Build multi-tenant isolation test suite, including AI layer isolation
Write cross-service integration and contract tests
Test Temporal workflows, event-driven flows, and YAML DSL validation
Build and maintain automated regression suites


Our Ideal Candidate Has:

3+ years in QA automation / SDET
Hands-on experience testing AI/ML systems
Strong Python (pytest, async testing)
Experience building test infrastructure from scratch
Experience testing distributed or event-driven systems
Experience testing multi-tenant applications
Autonomous work style
English – B1 level or higher


Nice To Haves:

RAG / vector search quality evaluation
LangGraph, LangChain, or similar agent frameworks
Go test automation
BentoML / MLflow or equivalent MLOps tooling
Security testing: prompt injection, context leakage
Performance / load testing for ML inference endpoints
Data pipeline testing (Delta Lake, Great Expectations, Dagster)
Russian – advanced level or higher


What We Offer:

Remote-first setup: work from anywhere in the world (except Russia and Belarus)
Work on a greenfield, technically challenging product (distributed system at scale)
Direct collaboration with senior technical stakeholders (engineering leadership, product)
Ownership and impact: influence QA strategy, tooling, and quality gates from the early stage of the product
Fast iteration environment: work closely with engineering to improve reliability and release confidence

We are an equal-opportunity employer and are committed to fostering a diverse and inclusive environment for all candidates.