This role is for one of our clients
Compensation: $120-$170 per hour
Join a leading AI research organization working on the next generation of intelligent systems. We are seeking experienced Data Science Experts to help evaluate how effectively AI performs real-world data science tasks. Rather than building models or delivering business analyses yourself, you will define what high-quality work looks like by creating robust evaluation frameworks and assessing AI-generated outputs with structured, evidence-based feedback.
This is an excellent opportunity to apply your industry expertise to improve advanced AI systems while influencing how they reason through complex analytical problems.
Requirements
Key Responsibilities
- Design detailed, task-specific evaluation criteria for real-world data science deliverables, including:
- Data analyses
- Predictive and statistical models
- Dashboards and visualizations
- Experiment results
- Executive recommendations and business insights
- Evaluate AI-generated and human-produced work using objective scoring frameworks.
- Provide detailed written justifications for each evaluation, ensuring consistency and technical accuracy.
- Apply sound analytical judgment to produce reproducible and defensible assessments.
- Incorporate structured reviewer feedback and continuously refine evaluation methodologies.
- Collaborate with cross-functional teams to improve AI training quality and evaluation standards.
Required Qualifications
- 5+ years of professional experience in Data Science within an industry environment.
- Strong background in business operations, product analytics, growth analytics, or similar data science functions at technology-driven organizations.
- Deep expertise in:
- Experimental design and A/B testing
- Statistical analysis
- SQL and Python
- Metric development and performance measurement
- Translating analytical findings into business recommendations
- Excellent written communication skills with the ability to clearly explain technical reasoning.
- Exceptional attention to detail and the ability to evaluate work consistently against structured rubrics.
- Comfortable receiving feedback and calibrating evaluation standards with peer reviewers.
Preferred Qualifications
- Experience contributing to AI evaluation, model training, human feedback, or data annotation initiatives.
- Familiarity with large language models (LLMs), AI-assisted analytics, or machine learning workflows.
- Experience reviewing technical work or mentoring analytical teams is a plus.
Application Process
- Submit your resume or relevant technical background to begin the application process.
- Qualified candidates may be invited to complete a short technical assessment or provide additional information relevant to their expertise.
Why Join?
- Contribute to the development of next-generation AI systems used for real-world analytical reasoning.
- Apply your professional data science expertise to high-impact AI evaluation projects.
- Work remotely with flexible scheduling.
- Collaborate with a network of experienced technical professionals helping define the future of AI quality and reasoning.
We welcome applicants from all backgrounds and are committed to providing equal opportunities and reasonable accommodations throughout the recruitment process.
Contract Details
- Independent contractor engagement.
- Fully remote with flexible working hours.
- Project duration may be extended or concluded based on project requirements and performance.
- Weekly payments based on approved work completed.
- Please note that H1-B and STEM OPT sponsorship is not available for this engagement.