Connecting people I'd hire with companies I'd work at

Matt Wallaert
companies
Jobs

Senior Software Engineer

Microsoft

Microsoft

Software Engineering
Beijing, China · China · Jiangsu, China · Suzhou, Jiangsu, China
Posted on Dec 29, 2025
Overview

Join the Copilot Team and be at the forefront of AI-powered innovation. We are redefining the future of intelligent solutions, creating seamless connections across Windows, M365, and Azure. Our mission is to empower every person and organization on the planet to achieve more. We embrace a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Our values of respect, integrity, and accountability drive our inclusive culture where everyone can thrive. #CopilotTeam

As a Senior Software Engineer (AI Engineer), you will be responsible for designing, optimizing, and implementing advanced prompt engineering strategies to enhance the performance, controllability, and application effectiveness of large language models (LLMs). You will work closely with cross-functional teams (product, AI/ML, and engineering) to drive prompt optimization across real-world business scenarios, ensuring efficient inference, high-quality responses, and seamless user experience.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Starting January 26, 2026, Microsoft AI (MAI) employees who live within a 50- mile commute of a designated Microsoft office in the U.S. or 25-mile commute of a non-U.S., country-specific location are expected to work from the office at least four days per week. This expectation is subject to local law and may vary by jurisdiction.



Responsibilities
  • Design, develop, and implement robust and scalable software applications that utilize AI techniques.
  • Develop and optimize LLM prompt engineering techniques (e.g., Chain of Thought, ReAct, Few-Shot Learning, Self-Consistency, Prompt Chaining) to enhance model coherence, reasoning, and controllability.
  • Optimize LLM models and their performance for specific use cases.
  • Improve model accuracy, contextual understanding, and response reliability while minimizing hallucinations and irrelevant outputs.
  • Help identify opportunities to improve and optimize existing systems using LLM.
  • Work closely with Finetuning & Evaluation teams, engineering, and product teams to integrate LLM-powered solutions into Copilot.
  • Stay up to date with the latest LLM research and best practices, applying new advancements to real-world applications.
  • Provide technical leadership, mentoring junior engineers on prompt engineering, LLM optimization, and AI best practices.


Qualifications

Required Qualifications:

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.
  • Hands-on experience working with LLMs such as ChatGPT, LLaMA, Claude, Mistral, and a deep understanding of prompt engineering techniques.
  • Solid problem-solving skills in LLM inference optimization, token efficiency, and response tuning.
  • Experience with AI frameworks and libraries such as LangChain.
  • Deep understanding of AI ethics, bias mitigation, and RAI principles.
  • Proven experience in leading technical teams and making architectural decisions for AI-powered applications.
  • Solid communication and collaboration skills, with the ability to work across product, engineering, and F&E teams.

Preferred Qualifications:

  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.
  • Experience in optimizing LLM inference efficiency, including token budgeting, temperature tuning, and latency reduction.
  • Experience in AI-powered web/mobile/backend development.
  • Solid analytical mind and a confident decision maker.
  • Ability to balance competing demands and adapt to changing priorities.

#MicrosoftAI


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.




Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.