Judge jobs in India
121 judge jobs found: showing 1 - 50
Ai Solution Architect
Company: Antino |
-as-judge, Ragas, DeepEval, LangSmith, Langfuse or Arize Phoenix, tracing agent runs. Security · governance Prompt injectionLocation: Gurgaon, Haryana, India
| Salary: unspecified | Date posted: 02 Oct 2026
Visual Storytelling Lead
Company: JioStar |
generation policies, the guardrails, the LLM-as-judge prompts, and the agentic role prompts (for asset creation, shot framingLocation: Mumbai, Maharashtra, India
| Salary: unspecified | Date posted: 02 Oct 2026
Layout Engineer, Power Modules
Company: onsemi |
what an AI agent must be able to do at each step. You will own selected module layouts, judge whether generated or edited layoutsLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 02 Oct 2026
Fellowship : (agent Intelligence & Evaluations)
Company: ixigo |
, and build LLM-as-judge rubrics for task completion, empathy, and recovery from tool failures. End-to-end observabilityLocation: New Delhi, India
| Salary: unspecified | Date posted: 01 Oct 2026
Platform Engineer
Company: NewPage Solution Inc |
to judge which capability is worth enabling and what the resulting data is good for. Technology evaluation. A track recordLocation: India, India
| Salary: unspecified | Date posted: 01 Oct 2026
Bharat Banking:caro Team
Company: Axis Bank |
of the job, the candidate should possess the following: Remain updated with regulatory guidelines and judge the effectLocation: Mumbai, Maharashtra, India
| Salary: unspecified | Date posted: 01 Oct 2026
Senior Software Engineer
Company: Mimecast |
, and we judge engineers on the outcomes they ship and the quality they sustain — not on lines of code written. MimecastLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 01 Oct 2026
Senior Machine Learning Engineer
Company: SAP |
. Evaluation as a Service will run systematic checks of prompts and agents against labeled datasets: traces, scorers, LLM-as-judge... quality: datasets, LLM-as-judge, tool-call correctness, and prompt/agent optimization loops. You solve data-consistencyLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 30 Sep 2026
Senior Automation And Ai Developer
Company: EY |
the use of LLM as a Judge patterns and alignment to agent lifecycle governance and runtime protection controls (e.g... on operational needs. Continuous Evaluation using LLM-as-a-Judge (Core): Implement evaluation pipelines for LLM/agent outputsLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 30 Sep 2026
Synthetic Chemist - Fully Remote
Company: Mercor |
. Evaluate AI model responses against a defined policy standard. Judge the correctness of each response. Write reference answersLocation: Mumbai, Maharashtra, India
| Salary: unspecified | Date posted: 30 Sep 2026
Senior Machine Learning Engineer
Company: SAP |
. Evaluation as a Service will run systematic checks of prompts and agents against labeled datasets: traces, scorers, LLM-as-judge... quality: datasets, LLM-as-judge, tool-call correctness, and prompt/agent optimization loops. You solve data-consistencyLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 30 Sep 2026
Associate Vice President
Company: National Australia Bank |
: Build comprehensive evaluation pipelines using techniques like LLM-as-a-judge, offline golden datasets, and tracingLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 30 Sep 2026
Staff Software Engineer - Ai Foundation
Company: Intuit |
components of the eval platform - golden datasets, LLM-as-judge pipelines, trajectory and correctness scoring, and regression...-as-judge evaluation, or agent frameworks (e.g., LangGraph) Experience with ML pipeline orchestration - Kubeflow PipelinesLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 30 Sep 2026
Staff Network Engineer - Network,cisco
Company: Blue Yonder |
Advanced troubleshooting methodology Ability to judge priorities and adjust their work accordingly Preferred SkillsLocation: Hyderabad, Telangana, India
| Salary: unspecified | Date posted: 30 Sep 2026
Content Creator — Learning & Development
Company: r3 Consultant |
and also make sense on its own when nobody is teaching it. The hard part is how we judge this work. Content here is not judgedLocation: Hyderabad, Telangana, India
| Salary: unspecified | Date posted: 30 Sep 2026
Quality Assurance Engineer (bangalore)
Company: GeneralMind |
?"). Track down bugs, crashes, display issues, and illogical behaviour, and document them clearly with steps to reproduce. JudgeLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 29 Sep 2026
Senior Research Scientist, Agent Evaluation
Company: ServiceNow |
, reliability, and safety — across LLM-as-a-Judge, trajectory-based, and human evaluation Take problems from research questionLocation: Hyderabad, Telangana, India
| Salary: unspecified | Date posted: 29 Sep 2026
Senior Analyst
Company: National Australia Bank |
comprehensive evaluation pipelines using techniques like LLM-as-a-Judge, offline golden datasets, and tracing telemetry to ensureLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 29 Sep 2026
Ai Specialist Ii
Company: Coursera |
with AI evaluation techniques such as golden datasets, LLM-as-judge, regression evaluation, human evaluation, ranking metricsLocation: India, India
| Salary: unspecified | Date posted: 29 Sep 2026
Eafs Is Manager
Company: EisnerAmper |
Job Description EisnerAmper | Fund Services Investor Services Manager Position Overview Investors judge a fundLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 29 Sep 2026
Director, Product Management Ai Quality & Evaluation
Company: FactSet |
and online eval harnesses, LLM-as-judge pipelines with calibrated human review, golden dataset management, and regression suites... review operations. Evaluation at scale depends on people producing labels on a schedule: judge calibration sets, ground-truthLocation: Hyderabad, Telangana, India
| Salary: unspecified | Date posted: 29 Sep 2026
Senior Ai Engineer
Company: Varite |
and online evaluation, LLM-as-judge and its limits, regression testing across model and prompt changes, and metricsLocation: Karnataka, India
| Salary: unspecified | Date posted: 29 Sep 2026
Senior Research Scientist, Agent Evaluation
Company: ServiceNow |
, reliability, and safety - across LLM-as-a-Judge, trajectory-based, and human evaluation Take problems from research questionLocation: Hyderabad, Telangana, India
| Salary: unspecified | Date posted: 29 Sep 2026
Senior Software Engineer - Ai Evals
Company: Chegg |
accuracy) where correctness isn't binary. Build automated, model-graded (LLM-as-judge) and rule-based evaluators...-as-judge pipelines, human annotation platforms, or A/B and offline/online eval frameworks. Strong programming skillsLocation: India, India
| Salary: unspecified | Date posted: 29 Sep 2026
Data Science I-ho & Support-cvm Coe - Corporate Centre Of Excellence
Company: Kotak Securities |
& Guardrails Implement LLM-as-a-Judge, evaluation frameworks, prompt tests, and model benchmarking. Apply model risk assessment... AI-driven orchestration systems across business workflows. 4. Model Evaluation & Guardrails Implement LLM-as-a-JudgeLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 28 Sep 2026
Ux Product Designer (networking)
Company: Hewlett Packard Enterprise |
, and support the path toward scaled evaluation (LLM-as-a-Judge) rather than one-off spot checks. Collaboration & Impact... for AI systems (rubrics, golden datasets, LLM-as-a-Judge). Familiarity with front-end fundamentals (React, Tailwind, componentLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 26 Sep 2026
Senior Research Engineer/scientist
Company: ServiceNow |
, and safety; establish rigorous approaches for LLM-as-a-Judge, trajectory-based, and human evaluation. Identify systematic model... running evaluations, including benchmark design, trajectory-based evaluation, LLM-as-a-Judge, human evaluation, and theLocation: Hyderabad, Telangana, India
| Salary: unspecified | Date posted: 25 Sep 2026
Senior Research Engineer/scientist
Company: ServiceNow |
, and safety; establish rigorous approaches for LLM-as-a-Judge, trajectory-based, and human evaluation. Identify systematic model... running evaluations, including benchmark design, trajectory-based evaluation, LLM-as-a-Judge, human evaluation, and theLocation: Hyderabad, Telangana, India
| Salary: unspecified | Date posted: 25 Sep 2026
Manager - Voice & Data Core Ops
Company: Vodafone Idea |
of changes, judge impact of changes, pre / post service confirmation for each of the change including KPI tracking and impactLocation: Kolkata, West Bengal, India
| Salary: unspecified | Date posted: 25 Sep 2026
Technical Assistant (m/f/d)
Company: Hella |
by visual test characteristics (Poison test) And / or with instruments and gages (To judge machine /equipment conditionsLocation: Haryana, India
| Salary: unspecified | Date posted: 25 Sep 2026
Fp&a Specialist - Fully Remote
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Mumbai, Maharashtra, India
| Salary: unspecified | Date posted: 24 Sep 2026
Sr Agentic Systems Engineer
Company: RingCentral |
, including LLM-as-a-judge, task-based evaluations, benchmark design, and automated regression testing. Understanding of accessLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 24 Sep 2026
Sr Agentic Systems Engineer
Company: RingCentral |
, including LLM-as-a-judge, task-based evaluations, benchmark design, and automated regression testing. Understanding of accessLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 24 Sep 2026
Software Asset & License Analyst Iii
Company: Astreya |
, and judge a high-risk agreement without waiting for the next window to open. Level I is measured on throughput, Level IILocation: Hyderabad, Telangana, India
| Salary: unspecified | Date posted: 23 Sep 2026
Junior Level 'advocate'
Company: Acme Services |
to a judge and/or jury should the case go to trial. Prepare and draft legal documents, including legal briefs and appealsLocation: Maharashtra, India
| Salary: unspecified | Date posted: 23 Sep 2026
Supervisor, Sam & Clh
Company: Astreya |
and licence failures — and judge correctly what must go to the ESAM Manager or the client rather than be absorbed. Run a cleanLocation: Hyderabad, Telangana, India
| Salary: unspecified | Date posted: 22 Sep 2026
Controls Engineer
Company: OpenTrain AI |
prepare examples, test systems, and judge whether model outputs or real-world behaviors are accurateLocation: India - USA, India
| Salary: unspecified | Date posted: 22 Sep 2026
Fp&a Specialist - Fully Remote
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Mumbai, Maharashtra, India
| Salary: unspecified | Date posted: 22 Sep 2026
Software Asset Analyst Iii
Company: Astreya |
, and judge a high-risk agreement without waiting for the next window to open. Level I is measured on throughput, Level IILocation: Hyderabad, Telangana, India
| Salary: unspecified | Date posted: 22 Sep 2026
Process Chemist - Route Design Expert
Company: Mercor |
. Evaluate AI model responses against a defined policy standard. Judge the correctness of each response. Write reference answersLocation: Mumbai, Maharashtra, India
| Salary: unspecified | Date posted: 22 Sep 2026
Genai Engineer
Company: DocuSign |
, implementing LLM-as-judge patterns, running regression tests on prompt and model changes, and reporting on quality metrics...-as-judge, golden dataset management, or A/B comparison infrastructure Proficiency in Python and comfort workingLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 22 Sep 2026
Project Manager, Journals
Company: Thieme |
to be able to manage relationships and share information with stakeholders. Must have the good technical knowledge to judgeLocation: Noida, Uttar Pradesh, India
| Salary: unspecified | Date posted: 22 Sep 2026
Hiring || Gen Ai Quality Assurance (blr/pune)
Company: 2COMS |
-as-a-Judge methodologies to measure critical quality indicators such as hallucination rates, faithfulness, contextual precision... and refine LLM-as-a-Judge evaluation protocols, establishing clear rubrics and custom scoring mechanisms to objectively assessLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 22 Sep 2026
Platform Lead
Company: Michael Page |
), preferably in an international context Excellent judge of top tier talent * Strong understanding of the Indian startupLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 21 Sep 2026
Hiring || Gen Ai Quality Assurance (blr/pune)
Company: 2COMS |
of AI interactions via APIs, employing both standard automation protocols and innovative LLM-as-a-Judge methodologies to measure critical... suites for RAG performance, summarization fidelity, and groundedness. Develop and refine LLM-as-a-Judge evaluationLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 21 Sep 2026
Senior Security Specialist
Company: London Stock Exchange Group |
protocols, operating systems and cloud/containerised environments (AWS, Azure, GCP, Docker, Kubernetes) to judge testingLocation: India, India
| Salary: unspecified | Date posted: 21 Sep 2026
Ai Architect
Company: Zensar |
eval suites - ground-truth Q&A sets, LLM-as-judge rubrics, frozen baselines - that gate every release rather than validate...: building or governing eval suites, LLM-as-judge frameworks, ground-truth datasets, frozen baselines and red-teamingLocation: Pune, Maharashtra, India
| Salary: unspecified | Date posted: 20 Sep 2026
Fp&a Expert - Financial Forecaster
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Mumbai, Maharashtra, India
| Salary: unspecified | Date posted: 19 Sep 2026
Sde Ii - Ai Platform
Company: SAFE |
, and safe rollout/rollback. Own the evaluation layer: Offline and online eval harnesses, golden datasets, LLM-as-a-judge... - accuracy and quality measurement, LLM-as-a-judge pipelines, eval datasets, and regression testing for models and promptsLocation: Bangalore, Karnataka, India
| Salary: unspecified | Date posted: 19 Sep 2026
Data Platform Engineer
Company: Guidant Global India |
such as Mosaic AI Evaluation, RAGAS, or equivalent, including LLM-as-Judge approaches and metrics such as faithfulness, relevance