Log inSign up free
  • Home
  • Profile
  • Jobs
    • Applications
    • Career
    • Resume
    • Cover letters
  • Content
    • Posts
    • Media
  • Messages
  • Analytics
    • Overview
    • Pages
    • Events
  • Portfolio
  • More tools
    • Hiring
  • Settings
All jobs
JLJudgment Labs logo

Judgment Labs

San Francisco

Applied AI Engineer.

FULL TIMEDATA & ML

The Role:

We are looking for Applied AI Engineers to build AI systems that use agent interaction data to understand how agents behave, evaluate them at scale, and improve them through learning and feedback.

Your research will not live on a whiteboard. You’ll work directly with real-world agent data, apply frontier methods in production, and see your work ship into the product. By making agent behavior measurable and debuggable, your systems will support teams deploying agents across finance, legal, operations, and other high-stakes workflows. You will own projects end-to-end, with significant autonomy, and work closely with the team to build self-improving agent systems.

What You'll Do:

  • Build AI systems to aggregate, index, and analyze large-scale long-running agent interaction data in order to extract meaningful signals

  • Design and implement post-training and optimization workflows to improve agents, both internally and for customers

  • Build agent platform infrastructure, including orchestration, runtimes, and developer tools that help teams define, test, deploy, and iterate on complex agent workflows

  • Build internal tools and infrastructure that support rapid experimentation, analysis, and training

  • Work closely with product to integrate agents into customer-facing workflows

  • Collaborate with external companies and research partners on frontier AI research

What We're Looking For

Every hire clears three bars, no exceptions:

  • Agency. You are intellectually curious, self-directed, and stay up to date with the latest research, blogs, trends, and ideas.

  • Depth of thought. You can reason clearly about abstract systems, and ideally have experience working on agents, RL, or the infrastructure that supports them.

  • Ownership. You own outcomes, not just tasks. You use freedom to experiment responsibly, make business-driven decisions, and focus first on work that moves the company forward.

More specifically, you should bring strength in at least one of the following areas:

  • Data quality, evaluation, benchmarking, and hands-on work with messy production data

  • Agent systems built or evaluated in real-world or production settings

  • Reinforcement learning, post-training, agents, or machine learning fundamentals

  • Infrastructure and systems work across training, data pipelines, evaluation, or model serving

  • Translating research into product while balancing customer constraints, technical tradeoffs, and business impact

  • Turning ambiguous problems into clear, well-designed plans

Pay
Not stated
Where
San Francisco
Work
Not stated
Type
Full time
Posted
11 Jan, 2026
Apply on the original postingSign in to prepare an application

Verified board

more at Judgment Labs.

14 Jul, 2026

Judgment Labs

Product Engineer, Full Stack

JLJudgment Labs logo
  • Full time
  • Engineering

San Francisco

Full time

Details
15 Jun, 2026

Judgment Labs

Backend/Infra Engineer

JLJudgment Labs logo
  • Full time
  • On-site
  • Engineering

San Francisco

On-site

Details
13 Aug, 2026

Judgment Labs

Product Engineer, Agent

JLJudgment Labs logo
  • Full time
  • Engineering

San Francisco

Full time

Details

similar roles.

13 Oct, 2026

Axle

Scientific Program Analyst

AXAxle logo
  • Data & ML

Rockville, MD

Salary not listed

Details
13 Oct, 2026

Axle

Scientific Program Analyst

AXAxle logo
  • Data & ML

Durham, NC

Salary not listed

Details
23 Sep, 2026

Adswerve

Senior Consultant 1, Analytics

ADAdswerve logo
  • Contract
  • Senior level
  • Remote
  • Data & ML

$80k–100k/mo

United States - Remote

Details
4 Jun, 2026

Constructor

Senior Machine Learning Engineer: ML Recall

COConstructor logo
  • Full time
  • Senior level
  • Remote
  • Data & ML

$80k–120k/yr

Remote - EMEA

Details
13 Oct, 2026

Diabolocom

Project Manager

DIDiabolocom logo
  • Full time
  • Lead
  • Data & ML

Paris

Full time

Details
11 Aug, 2026

Cirrus Logic

Senior AI Engineer

CLCirrus Logic logo
  • Full time
  • Senior level
  • Data & ML

Austin, Texas

Full time

Details