Senior Software Engineer
Microsoft
The MAI-A Fundamentals team is dedicated to building one of the world’s largest distributed systems to power Bing Search, Copilot Search, Grounding APIs, and drive advancements in relevance through cutting-edge deep learning techniques. We are currently developing the next generation of grounding APIs and their hosting platform services, with the goal of creating the fastest and most modern search API business.
Our efforts focus on constructing a system with a tens-of-billions-level index, an orchestration engine capable of operating within hundreds of milliseconds, and an online GPU inference system. These innovations will enable rapid, scalable, and intelligent search capabilities for a wide range of applications.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.
Responsibilities
- Understand User Requirements
- Collaborates with appropriate stakeholders (e.g., relevance customers teams, project manager, other team members, and all other service owners) to determine user requirements for each scenario on the service gaps based on their scenarios. Well understands detailed asks in different scenarios and make sure to build efficient functionalities and services to fulfill their requirement.
- Design, coding and implementation
- Takes part in the discussions for the architecture of products/solutions and creates proposals for architecture by testing design hypotheses and helping to refine code plans. Provides reactions, proposed solutions, and inputs to architects.
- Independently creates a clear plan for testing and assuring quality of solutions, and defines success for outcomes of tests (e.g., unit tests).
- Writes extensible and maintainable code. Optimizes, debugs, refactors, and reuses code to improve performance and maintainability, effectiveness, and ROI. Reviews the code from other team members to assure it meets the team's and Microsoft’s quality standards.
- Scenario onboarding and online supporting
- Collaborates closely with scenario owners to facilitate their onboarding process and offers essential support to ensure their business success.
- Delivers efficient toolsets designed to enhance the platform's usability, debugging capabilities, and monitoring functionalities.
Qualifications
Required Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- At least 4 years of experience in designing, developing and maintaining distributed information management systems.
- Familiar with cloud computing platforms such as Azure, K8s.
- Good communication, collaboration and problem solving skills, fluent English speaking and writing.
Preferred Qualifications:
- Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- 6+ years experience in designing, developing and maintaining distributed computing platform. Experience in writing high quality code and conducting code reviews.
- Experiences in Bing search or other search engine platform services, or other large scale platform services.
- Nice to have knowledges for deep learning techniques and frameworks and experiences in LLM prompt engineering.
#MicrosoftAI
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.