This role is for one of our clients
Compensation: $100-$150 per hour
Join a leading AI research organization and bring your senior-level legal expertise to the development of advanced AI systems. We are seeking an experienced Partner & General Counsel - Legal Domain Expert to work closely with research and program management teams to improve how frontier AI models understand, analyze, and reason about complex legal work.
Your practical legal experience will be central to the role. You will evaluate legal knowledge-work tasks and AI-generated outputs, develop detailed instruction specifications and reference solutions, and help build benchmarks that accurately measure sophisticated legal reasoning.
This is a full-time position requiring approximately 40 hours per week for an initial six-month engagement.
Location: Hybrid — Bay Area, California. Candidates must currently reside in the Bay Area and be available to work on-site with the client team multiple days per week, as required. Candidates outside the Bay Area must be willing to relocate at their own expense before the engagement begins. Relocation assistance is not provided.
Requirements
2. Key Responsibilities
Legal Task & Model Evaluation
- Review legal knowledge-work tasks and AI-generated responses for accuracy, completeness, sound reasoning, and practical relevance.
- Identify missing legal considerations, unsupported conclusions, weak reasoning, and responses that may appear persuasive but would not withstand professional legal scrutiny.
- Assess whether tasks accurately represent real-world legal workflows and decision-making.
Instruction & Reference Solution Development
- Develop detailed instruction specifications that clearly define expected legal reasoning, analysis, and outcomes.
- Produce high-quality reference or "golden" solutions to complex legal problems.
- Design realistic legal tasks based on professional practice, including transactional, regulatory, litigation, compliance, and other specialized legal workflows.
Benchmark Development
- Create challenging legal benchmarks and evaluation datasets designed to test advanced legal reasoning.
- Help define legal-specific capabilities, skills, and evaluation criteria for frontier AI systems.
- Collaborate with research teams to identify areas where models demonstrate gaps in legal knowledge or professional judgment.
Expert Calibration
- Work with researchers and specialists across related domains to maintain consistent evaluation standards.
- Translate practical legal judgment and professional experience into clear, structured, and measurable evaluation criteria.
- Provide precise written feedback that helps improve task quality, benchmark design, and model performance.
3. Core Qualifications
- Juris Doctor (JD) from an accredited law school. A degree from a highly ranked law school is strongly preferred.
- 5+ years of substantive post-qualification legal experience at an established law firm, corporate legal department, regulatory organization, court, or comparable institution. Internships and clerkships alone do not qualify.
- Deep specialization in at least one substantive practice area, such as:
- Corporate and transactional law
- Litigation and dispute resolution
- Regulatory and compliance
- Intellectual property
- Employment and labor law
- Tax law
- Commercial law
- Corporate governance
- Demonstrated progression to a senior legal position, such as Partner, Of Counsel, Counsel, Senior Associate, Senior In-House Counsel, General Counsel, or equivalent.
- Active admission to at least one U.S. state bar and in good standing.
- Significant ownership of legal matters, including the ability to independently analyze complex issues, assess risks, and provide defensible recommendations.
- Hands-on familiarity with large language models and AI tools in professional workflows, with the ability to distinguish rigorous legal reasoning from plausible but legally incorrect analysis.
- Exceptional written communication skills and the ability to provide clear, precise, and well-structured legal feedback.
- Strong analytical judgment, attention to detail, and comfort working through ambiguous and complex legal scenarios.
- Ability to commit reliably to 40 hours per week for an initial six-month engagement.
- Currently based in the Bay Area, California, with availability for hybrid, on-site collaboration multiple days per week as required.
4. Equal Opportunity
We are committed to providing equal employment opportunities to all qualified applicants. We do not discriminate based on legally protected characteristics and provide reasonable accommodations to qualified individuals throughout the application and engagement process.
5. Engagement Details
- Role: Partner & General Counsel - Legal Domain Expert
- Employment Type: Full-Time
- Work Arrangement: Hybrid
- Location: Bay Area, California
- Expected Commitment: 40 hours per week
- Initial Engagement: 6 months
- Relocation: Candidates outside the Bay Area must relocate at their own expense
- Primary Focus: Legal expertise, AI evaluation, benchmark development, legal reasoning, task design, and quality assessment