French LLM AI Quality Analyst – Remote

About the role

We are looking for a French-speaking LLM AI Quality Analyst to join our remote team. In this role you will evaluate AI model responses for personalization quality, ensuring they are grounded, integrated, and helpful for users.

Key responsibilities

• Assess AI model outputs for personalization, grounding, integration, and usefulness.
• Design and execute multi‑turn prompts based on personal context to test model capabilities.
• Identify hallucinations, incorrect personalization, and flawed inferences in responses.
• Conduct side‑by‑side comparisons of model outputs to determine quality and effectiveness.
• Write clear, structured rationales for evaluations and rankings.
• Extract insights from model behavior and provide detailed feedback for improvement.
• Maintain strict data hygiene and accurate documentation of all evaluations.

Required profile

• Strong proficiency in French with excellent reading and writing skills.
• Experience in data annotation, AI evaluation, content moderation, or similar roles.
• Analytical mindset capable of evaluating nuanced AI responses.
• Ability to design creative multi‑turn prompts based on personal context.
• Excellent written communication and attention to detail.
• Full‑time availability with flexibility to overlap with PST time zones.
• Bachelor’s degree or equivalent experience in a relevant analytical field.

Required skills

What we offer

• Hourly contract with pay ranging from $11.5 to $15.3 per hour.
• Fully remote work environment.
• Opportunity to shape the quality of cutting‑edge AI models.