Job Details

About the Role:
We are looking for native US English speakers with experience in working with Large Language Models (LLMs). The project involves watching YouTube videos and generating X to X complex queries per video along with golden answers - these should be questions that advanced models like Gemini X.X Pro are unlikely to answer correctly.

Project Description:

• Review YouTube videos of varying lengths
• Create X-X complex queries per video
• Provide "golden answers" (high-quality, ground truth answers)
• Focus is on creating edge cases that challenge advanced LLMs
• Each video task is estimated to take ~XX minutes

• Duration: X weeks
• Weekend work: Yes, need to work in weekends.

• Language Proficiency: Native-level US English
• Experience: X+ years working with LLMs or in AI/ML data annotation/evaluation (preferred but not mandate)
• Location: United States-based candidates only

1. Sample Profiles: Request submission of sample candidate profiles for evaluation.
2. Shortlisting Criteria: Candidates will undergo an assessment for shortlisting.