Quality Analyst

Hire Feed is hiring a Remote Quality Analyst for one of its clients to support the evaluation and improvement of advanced AI systems. This role focuses on assessing AI-generated responses, testing personalization capabilities, and providing detailed feedback to enhance model performance.

The ideal candidate should have strong analytical skills, excellent English communication abilities, and experience with AI evaluation, prompt design, or testing workflows. This opportunity offers a chance to contribute to the development of innovative AI technologies with global impact.

Key Responsibilities:

• Evaluate the quality and relevance of personalized AI-generated responses.

• Create creative multi-turn prompts to test AI models and personalization features.

• Analyze AI outputs for accuracy, grounding, helpfulness, and proper integration of information.

• Review side-by-side AI response comparisons to identify differences in quality and relevance.

• Provide detailed feedback to improve AI model performance.

• Identify incorrect personalization, inconsistencies, and potential improvements.

• Support ongoing AI evaluation projects and quality improvement initiatives.

Requirements:

• Strong English proficiency with excellent reading and writing skills.

• Experience in prompt engineering or designing test cases for AI models.

• Ability to analyze complex and ambiguous AI responses.

• Familiarity with AI personalization concepts and evaluation metrics.

• Strong attention to detail and analytical thinking.

• Willingness to use a primary Google account and enable personal data sources for assessment purposes.

• Availability to work full-time in your local time zone as part of a global 24-hour operations team.

• Strong knowledge of:

    • AI Model Evaluation & Quality Analysis

    • Prompt Engineering & Test Case Design

    • Data Analysis, AI Personalization & Response Assessment