Senior Software Engineer(M365 Copilot Inferencing)

Full Job Description

Requirements & design: Partner with stakeholders to determine user requirements for a set of scenarios; lead identification of dependencies and contribute to the development of design documents for a product, application, service, or platform. Build & ship: Initiate and build solutions to improve performance, maintainability, and effectiveness; deliver features through to production with quality and reliability. Service and system thinking: Contribute to architecture and implementation of services that support large-scale model serving, including considerations for request serving at scale (routing, load balancing, distributed caching/storage, networking, geo/disaster recovery). Operational excellence / live site: Hold accountability as a Designated Responsible Individual (DRI) within your scope; participate in on-call and work with partners to monitor system/product/service for degradation, downtime, or interruptions and take action to restore service. Reliability, observability, performance: Proactively seek new knowledge and adapt to new trends, technical solutions, and patterns that improve availability, reliability, efficiency, observability, and performance, while driving consistency in monitoring and operations at scale. Collaboration & execution: Work closely with engineers, PM, and partner teams to execute project plans, release plans, and work items; communicate clearly across organizational boundaries. Grow others: Lead by example and mentor others through code reviews and design reviews, helping improve code quality and engineering practices across the team. Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python These requirements include but are not limited to the following specialized security screenings: Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Experience building applications and/or services in the cloud and delivering production-quality software with solid debugging and problem-solving skills. Ability to reason for modern distributed software design patterns and cloud systems architecture (e.g., microservices, containers, load-balancing, queuing, caching) and to build/ship/operate reliable solutions. Solid communication and collaboration abilities to align and deliver across organizational boundaries. Demonstrated ownership mindset to drive end-to-end for delivering and operating reliable services. Experience designing distributed systems, near real-time processing solutions, or large data platforms; experience working with large-scale distributed systems (cloud/SaaS) in complex environments. Experience improving production systems with an engineering mindset around reliability, performance, and observability at scale. Familiarity with inference platform concerns such as model serving, GPU efficiency, and large-scale request routing; experience improving GPU inference efficiency (profiling, scheduling, batching, memory management, runtime optimization) is a plus.

Verified from public schema.org JobPosting structured data on the official source page. The complete published description, responsibilities, requirements and benefits were normalized when present; unstated facts were not inferred.