Senior Software Engineer(Data)

Share job

Microsoft’s Copilot team is looking for passionate and experienced data engineers to join the team. If you’ve ever enjoyed watched a massive data pipeline process billions of records without breaking a sweat, felt genuine satisfaction debugging a business-critical schema migration, or gotten excited about shaving milliseconds off pipeline latency, then you’re in the right spot. We’re looking for the best data engineers—engineers who have built and scaled systems that others depend on, who take pride in delivering rock-solid data quality, and who genuinely enjoy the craft of data engineering.
Join us to architect and implement the data backbone that powers Copilot for millions of users worldwide. You’ll own the full lifecycle of data—building scalable ETL pipelines, ensuring data integrity across systems, and enabling insights generation that drive product and business decisions. In our fast-paced environment, you’ll have the freedom to innovate and the support to build world-class data products that make a real impact.
If you thrive on solving complex data challenges, enjoy collaborating across product, marketing, and data teams, and get energized by building infrastructure that just works, this role is for you.

Required
• Master’s Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor’s Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience.
• Experience building and maintaining production data pipelines at scale using technologies such as Apache Spark, Kafka, or similar distributed processing frameworks.
• Experience writing production-quality Python, Scala, or Java code for data processing applications.
• Experience with cloud data platforms (Azure, AWS, or GCP) and their data services.
• Experience with schema management and data governance practices.
Preferred
• Experience with real-time data processing and streaming architectures.
• Experience with orchestration frameworks such as ADF, Airflow, Prefect, or Dagster.
• Experience with containerization (Docker, Kubernetes) for data pipeline deployment.
• Experience implementing data quality frameworks and monitoring solutions.

• Build, maintain, and enhance data ETL pipelines for processing large-scale data with low latency and high throughput to support Copilot operations.
• Own data quality initiatives including monitoring, validation, and remediation to ensure integrity across attribution datasets and downstream dashboards.
• Implement schema management solutions that enable quick and seamless evolution of attribution data without disrupting consumers.
• Develop and maintain infrastructure that supports both batch and real-time attribution requirements.
• Collaborate with product managers, marketing analysts, and data scientists to deliver insights for campaign optimization and growth strategies.
• Design scalable attribution data architectures that can handle growing data volumes and evolving business needs.
• Implement comprehensive monitoring and observability solutions for attribution pipelines, including SLA tracking and automated alerting.