Connecting people I'd hire with companies I'd work at

Matt Wallaert
companies
Jobs

Principal Applied Scientist

Microsoft

Microsoft

Posted on Oct 31, 2025

Principal Applied Scientist

Beijing, China

Save

Share job

Date posted
Oct 30, 2025
Job number
1903044
Work site
Fully on-site
Travel
0-25 %
Role type
Individual Contributor
Profession
Software Engineering
Discipline
Software Engineering
Employment type
Full-Time

Overview

We are seeking an Applied Scientist / AI Architect with strong hands-on experience in building and optimizing large language models (LLMs), agentic AI systems, and end-to-end model training workflows. This role is ideal for scientists with a solid applied background who can translate state-of-the-art research into real-world impact. A research-oriented mindset with publications in top AI/ML venues is highly preferred but not strictly required.
Our mission is to innovate in collaborative office area by exploring LLM and agentic AI. You will collaborate closely with product, engineering, and research teams to ship intelligent, reliable, and innovative AI capabilities at scale.

Qualifications

• M.S. or Ph.D. in Computer Science, Machine Learning, or a related field, or equivalent practical experience.
• 5+ years of experience in applied machine learning, with a focus on LLMs, agent systems, or reinforcement learning.
• Strong hands-on experience with prompt engineering, context engineering, retrieval-augmented generation (RAG), tool use, planning agents, and long-context modeling, etc.
• Familiarity with model training pipelines using PyTorch, TensorFlow, JAX, or similar frameworks, evaluation strategies, and model deployment best practices.
• Solid publication record (e.g., NeurIPS, ICLR, ACL, ICML, EMNLP) is a plus, but emphasis is placed on practical contributions.
• Strong coding and debugging skills, and comfort working in cross-functional, agile environments.

Responsibilities

• Design and implement advanced LLM-based architectures and agentic systems for real-world product scenarios.
• Translate research breakthroughs into production-ready algorithms, contributing to core capabilities such as reasoning, planning, long-term memory, code-gen based design.
• Monitor and improve model performance post-deployment through data-driven iteration and error analysis.
• Collaborate across teams to deliver robust, scalable models aligned with product objectives and user value.
• Contribute to the organization’s scientific direction by identifying research opportunities that drive long-term differentiation.


Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Industry leading healthcare
Educational resources
Discounts on products and services
Savings and investments
Maternity and paternity leave
Generous time away
Giving programs
Opportunities to network and connect

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.