This role is for one of our clients
Compensation: $150-$160 per hour
We are seeking experienced in-house legal counsel based in France to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving French law.
As an expert reviewer, you will assess responses generated by two AI platforms, compare their legal reasoning and conclusions, and evaluate each response against a standardized rubric. Your professional judgment will help establish reliable benchmarks for the quality and accuracy of AI-generated legal work.
Requirements
Key Responsibilities
- Run identical legal prompts across two AI/LLM platforms.
- Review and compare AI-generated legal responses side by side.
- Evaluate responses against a standardized assessment rubric.
- Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability.
- Identify material differences, omissions, inconsistencies, or inaccuracies between responses.
- Provide concise, clear, and well-supported written feedback for each evaluation.
- Apply the evaluation criteria consistently and objectively across all assigned tasks.
- Complete assignments independently while adhering to project guidelines and deadlines.
Requirements
- 5+ years of experience as in-house legal counsel practicing in France.
- Strong command of French law, particularly commercial and contract law.
- Practical experience advising businesses on legal matters and evaluating real-world legal risk.
- Excellent attention to detail and strong analytical judgment.
- Exceptional written communication skills, with the ability to explain legal conclusions clearly and concisely.
- Comfortable reviewing AI-generated content and distinguishing legally sound analysis from plausible but incorrect reasoning.
- Ability to work independently, follow structured evaluation rubrics, and meet established deadlines.
- Professional proficiency in written English is preferred for working with project instructions and evaluation materials.
Engagement Details
- Initial Commitment: Approximately 10 hours
- Potential: Strong opportunity for additional work based on project requirements and performance
- Work Arrangement: Fully remote
- Confidentiality: All project work is subject to applicable confidentiality requirements and NDA obligations.
- Engagement Type: Independent contractor
Equal Employment Opportunity
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms
- The engagement is fully remote and can be completed on a flexible schedule.
- Projects may be extended, shortened, or concluded early depending on project needs and performance.
- Work will not require access to confidential or proprietary information belonging to any employer, client, or institution.
- Payments are made weekly based on services rendered through supported payment platforms.
- H-1B and STEM OPT candidates are not eligible for this opportunity at this time.