Job Title
Junior Applied AI Engineer (LLM Systems)
Key Skills
LLMs, Generative AI, AWS Bedrock, Prompt Engineering, AI Agent Evaluation, Langfuse, Python, FastAPI, MCP, Guardrails & Moderation, REST APIs, Git
Experience
1-3+ years of experience in AI/ML Engineering, Applied AI, Data Science, or related fields.
Location
LATAM (Remote)
Mode
Remote
We at Coforge are hiring Junior Applied AI Engineer (LLM Systems) (20848-10-1) with the following skill set.
Key Responsibilities
- Design and execute evaluation frameworks for AI agents, including test datasets, LLM-as-a-Judge methodologies, human reviews, and regression testing.
- Build, configure, and optimize AI guardrails and moderation systems for regulated domains such as financial services and credit products.
- Develop, test, and continuously improve prompts based on evaluation results and production trace analysis.
- Create and maintain MCP (Model Context Protocol) servers and tool integrations that enable AI agents to interact with internal data and services.
- Support fine-tuning and evaluation of language models using domain-specific datasets.
- Prototype and validate AI workflows using System One models such as Jev and Laya for classification, routing, and verification tasks.
- Monitor AI system quality, latency, performance, and costs through Langfuse and implement improvement initiatives.
- Collaborate with Engineering, Data Science, and Compliance teams to ensure AI solutions are reliable, secure, and compliant.
Required Skills & Qualifications
- 1-3+ years of experience in Machine Learning, Applied AI, Data Science, or Software Engineering.
- Experience working with Large Language Models (LLMs) and AI-powered applications.
- Knowledge of LLM evaluation techniques, including benchmark datasets, scoring frameworks, and LLM-as-a-Judge approaches.
- Understanding of AI agent behavior across multi-turn conversations and tool-calling workflows.
- Experience with prompt engineering, structured outputs, and prompt optimization.
- Familiarity with AI safety concepts including moderation, prompt injection prevention, jailbreak mitigation, and guardrails.
- Hands-on experience with AWS cloud services, preferably Amazon Bedrock.
- Experience with Langfuse or similar observability and evaluation platforms for LLM applications.
- Strong programming skills in Python.
- Experience developing REST APIs using FastAPI or similar frameworks.
- Knowledge of software engineering best practices including unit testing, code reviews, and Git-based development workflows.
- Advanced English communication skills (written and verbal).
Preferred Skills
- Experience developing MCP (Model Context Protocol) servers.
- Hands-on experience with fine-tuning LLMs using techniques such as LoRA or full fine-tuning.
- Familiarity with Small Language Models (SLMs), model distillation, and deployment strategies.
- Exposure to System One models such as Jev and Laya.
- Experience in financial services, fintech, banking, or other regulated industries.
- Knowledge of AI evaluation, observability, and production monitoring best practices.
Posted On
27-10-2026
At Coforge, we hire professionals based solely on their skills and qualifications and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.