What You’ll Do
- Evaluate AI model outputs and provide structured, high-quality feedback
- Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes
- Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios
- Contribute to improving evaluation frameworks, not just executing them
- Identify trends in model performance and communicate insights clearly
- Participate in team discussions, calibrations, and stakeholder syncs
- Partner with leads and cross-functional teams to refine quality standards
- Document findings in a clear, concise, and actionable way
What We’re Looking For
- Native-level Portuguese (Portugal) language proficiency and a university degree (Bachelor’s or higher).
- B2 or superior level of English.
- 1–2 years of professional writing experience with strong, structured writing skills
- Ability to apply complex writing rules and guidelines consistently
- Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
- Strong critical thinking and attention to detail
- Ability to make sound judgment calls in ambiguous situations
- Naturally curious about AI, technology, and how systems behave
- Comfortable speaking up, asking questions, and contributing ideas
- Strong written and verbal communication skills
- Ability to stay consistent while working with evolving guidelines
- Experience in data quality, QA, annotation, or analysis is helpful — but not required
Benefits
- Paid Vacation: 6 days
- Paid Company Holidays: 2 days (Memorial Day and Labor Day)
- Paid Sick Leave: accrued per applicable state law and company policy
- Medical, Dental, and Vision Insurance (eligibility applies)
- Health Savings Account (HSA)
- 401(k) Retirement Plan
- Employee Assistance Program
- Additional voluntary benefits (life, accident, critical illness, etc.)
- Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
- Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
- Unique Campus Features: Some locations include roof-top nature parks
- Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.