Principal Data Engineer

Share job

We are looking for a Principal Data Engineer as part of Teams data engineering team in Redmond. You will grow your skills by working on highly scalable systems and latest technologies, processing petabyte scale data daily with the latest big data tools like Microsoft Fabric, Azure Data Lake and Azure Data Explorer. You will collaborate closely with data science to derive actionable insights and influence our product and growth strategy.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Required Qualifications:

• Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience.
• 6+ years of big data experience with big processing tool like as Apache Spark.

Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

• Experience in any of the following languages or equivalent language: Scala, Pyspark, C#, Java, Python, Rust.
• Experience with Azure cloud.
• Experience in other big data technologies.
• Data driven, customer focused, and organized.
• Experience operationalizing and supporting services.

Data Engineering IC5 - The typical base pay range for this role across the U.S. is USD $139,900 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Microsoft will accept applications for the role until August 5, 2025.

• You will build advanced code to extract raw data, coach the team on techniques to validate its quality, and ensure the correct data is ingested across the pipeline. You’ll also provide expertise on techniques to transform raw data into forms compatible with downstream data sources.
• Using your technical expertise, you’ll improve data tools used to transform, manage, and access data across the organization. You’ll also write code to optimize storage and availability of data platforms so that they’re more resilient.
• You will improve performance monitoring protocols across the project, building automation into data visualizations and aggregations to address pipeline health patterns. You’ll also implement robust solutions and self-healing processes that prevent recurring points of failure across products.
• You will interpret laws and develop procedures that ensure compliance with all applicable laws and policies across the entire pipeline. You’ll also govern data accessibility across multiple data pipelines and/or models.
• Embody our Culture and Values.