Overview
Create evaluations and establish evaluation frameworks to measure both technical/practical performance and non-deterministic performance like EQ Research & implement novel prompting techniques Spin the data flywheel to extract insights from extensive language datasets to uncover issues and opportunities to improve model response quality. Accountable to own the status of key projects, proactively identifying risks and proposing solutions to ensure timely delivery. Bachelor's Degree in Computer Science, Philosophy, Linguistics, Psychology, Literature, or related discipline AND 1+ years experience in context engineering with foundational software engineering knowledge. 3+ years experience working in a fast-paced environment, managing multiple priorities, and adapting to changing requirements and deadlines. Hands-on experience with prompt design, context window management, and model evaluati
Full job description
Full Job Description
Create evaluations and establish evaluation frameworks to measure both technical/practical performance and non-deterministic performance like EQ Research & implement novel prompting techniques Spin the data flywheel to extract insights from extensive language datasets to uncover issues and opportunities to improve model response quality. Accountable to own the status of key projects, proactively identifying risks and proposing solutions to ensure timely delivery. Bachelor's Degree in Computer Science, Philosophy, Linguistics, Psychology, Literature, or related discipline AND 1+ years experience in context engineering with foundational software engineering knowledge. 3+ years experience working in a fast-paced environment, managing multiple priorities, and adapting to changing requirements and deadlines. Hands-on experience with prompt design, context window management, and model evaluation. 2+ years of experience shipping consumer-facing products. You've brought products to market, collected user feedback, defined success metrics and iteratively improved products. 1+ years of experience in building LLM applications with familiarity in agent and orchestration frameworks, tool use, LLM evaluations and driving efficiency improvements. Technical depth in software development, data science and machine learning. While you are not expected to write code on the critical path, you're able to navigate and contribute to code repositories to implement context engineering improvements and write LLM scorers and classifiers to evaluate model response quality.
Tips for this job
Practical JobOpportunity guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
Verification notes
Verified from public schema.org JobPosting structured data on the official source page. The complete published description, responsibilities, requirements and benefits were normalized when present; unstated facts were not inferred.
JobOpportunity is the discovery and verification layer. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Apply through JobOpportunity →Browse current JobOpportunity listings from Microsoft Careers →
