Overview
Develop and improve ranking and reranking models for search results, retrieved passages, source selection, answer candidates, tool choices, and agent actions. Build grounding systems that help AI agents generate reliable, source-backed answers using trusted documents, web content, enterprise data, tool outputs, and user context. Improve end-to-end search and retrieval quality, including query understanding, semantic and hybrid retrieval, freshness, relevance, source quality, personalization, and latency-aware ranking. Advance multi-turn agent experiences by improving context understanding, tool use, task completion, clarification behavior, planning, and recovery from errors. Tune and optimize models for grounded and agentic behavior using methods such as supervised fine-tuning, preference optimization, reward modeling, distillation, synthetic data generation, and scalable experimentation
Full job description
Full Job Description
Develop and improve ranking and reranking models for search results, retrieved passages, source selection, answer candidates, tool choices, and agent actions. Build grounding systems that help AI agents generate reliable, source-backed answers using trusted documents, web content, enterprise data, tool outputs, and user context. Improve end-to-end search and retrieval quality, including query understanding, semantic and hybrid retrieval, freshness, relevance, source quality, personalization, and latency-aware ranking. Advance multi-turn agent experiences by improving context understanding, tool use, task completion, clarification behavior, planning, and recovery from errors. Tune and optimize models for grounded and agentic behavior using methods such as supervised fine-tuning, preference optimization, reward modeling, distillation, synthetic data generation, and scalable experimentation. Define and own evaluation methods and success metrics for ranking quality, retrieval quality, groundedness, factuality, citation correctness, hallucination reduction, task success, user satisfaction, latency, and cost. Partner with engineering, product, research, and design teams to ship science improvements into production, influence architecture, mentor scientists and engineers, and drive high-impact initiatives from ambiguity to measurable product impact. Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience. Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 9+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience. 10+ industry experience building, evaluating, and deploying machine learning models or AI systems in production. Deep expertise in at least two of the following areas: search, information retrieval, learning-to-rank, recommendation systems, grounded generation, LLM-based ranking, retrieval-augmented generation, conversational AI, or agentic AI systems. Experience with offline and online evaluation, including relevance metrics, A/B experimentation, human evaluation, model diagnostics, and production quality monitoring. Experience working with large-scale datasets, production ML pipelines, distributed training or inference systems, and cross-functional engineering teams. Demonstrated ability to lead ambiguous technical projects as a senior individual contributor and influence product, engineering, and science direction. Communication skills, with the ability to explain scientific tradeoffs clearly to technical and non-technical stakeholders. Experience with production-scale LLM systems, agent frameworks, search engines, ranking systems, or retrieval-augmented generation systems. Experience improving multi-turn AI assistant or agent experiences in real products. Experience with tool-using agents, planning systems, memory, personalization, source ranking, or enterprise search. Experience building evaluation frameworks for factuality, grounding, hallucination, relevance, safety, and task completion. Experience with large-scale experimentation platforms, A/B testing, human evaluation, and model quality monitoring. Experience collaborating with product teams to translate model improvements into measurable customer impact. Experience with publication record, patents, open-source contributions, or demonstrated technical leadership in applied AI, IR, NLP, or ML systems.
Tips for this job
Practical JobOpportunity guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
Verification notes
Verified from public schema.org JobPosting structured data on the official source page. The complete published description, responsibilities, requirements and benefits were normalized when present; unstated facts were not inferred.
JobOpportunity is the discovery and verification layer. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Apply through JobOpportunity →Browse current JobOpportunity listings from Microsoft Careers →