Data Engineer II
Microsoft
Data Engineer II
Redmond, Washington, United States
Save
Overview
Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft’s mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers’ heterogeneous environments, as well as ensuring the security of our own internal estate.
Organization Summary:
If you love the pursuit of excellence and are inspired by the challenges that come through driving innovations that impact how the world lives, works and plays, then we invite you to learn more about CFAR - and the value we deliver across Microsoft and to our customers and partners. We offer unique opportunities to work on interesting global initiatives in an environment that appreciates diversity, focuses on talent development, recognizes, and rewards great work
Position Description:
Do you have a passion for big data, analytics, insights, and technology? Do you want to be part of a team that enables end-to-end visibility, insights, and optimization, while doing good in the world? We’re looking for a talented Data Engineer who wants to get their hands on large scale and complex data landscape, with deep knowledge of data architecture and management, and distributed systems, who is interested in working alongside Software Engineers to drive business impact.
The Central Fraud Risk and Abuse (CFAR) organization, the Data Services team is leveraging data and modeling in new ways to increase visibility & transparency, improve insights and decisions, and optimize service levels, costs and customer experience.
We are looking for a Data Engineer who can help us build optimized data pipelines to scale from hundreds of millions of events per day to billions. If your toolbox includes proficiencies in Big Data, Azure Data Factory, Cloud Data Architecture, Data analytics and reporting, Synapse, Data Warehouse, SQL and MS Fabric we would love to apply your data expertise to have real world impact. All this needs to be done with a focus on engineering best practices, efficiency, scalability, and reliability.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Qualifications
Minimum Qualifications:
- Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering.
- OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering.
- OR equivalent experience.
- 2+ years of experience in data engineering with proven coding and debugging skills in C#, Python, SQL, Spark, Scala.
- 2+ years of experience in writing queries using SQL, KQL, Scope script.
- 2+ years of experience with data cloud computing technologies such as – Azure Synapse, Azure Data Factory, SQL, Azure Data Explorer.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
Microsoft Cloud Background Check:
- This position will be required to pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications:
- Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering.
- OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 5+ years experience in business analytics, data science, software development, data modeling, or data engineering.
- OR equivalent experience.
- 1+ year(s) experience with data governance, data compliance and/or data security.
- 1+ years of experience in developing solutions with Microsoft Power Platform, including Power BI, Fabric, Power Automate & M365 Dataverse
- 1+ years of experience in developing solutions and implementing MS Fabric.
- Microsoft Certified: Fabric Data Engineer Associate.
- Experience building and optimizing large-scale data processing, integration and storage.
- Analytical skills with a systematic and structured approach to software and data design.
- Experience with extracting and handling data with REST APIs, messaging and event technologies.
- Understanding and experience implementing Data Privacy and Security controls to protect the data.
Data Engineering IC3 - The typical base pay range for this role across the U.S. is USD $100,600 - $199,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $131,400 - $215,400 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Microsoft will accept applications for the role until July 15, 2025.
Responsibilities
As a Data Engineer, you will:
- Design, develop, and maintain data pipelines and models for real-time and batch ingestion, analysis, reporting, optimization, data collection at scale and reusable
- Design and develop application components and services to support data related processes, presentation, and consumption.
- Considers testability, monitoring, reliability, and maintainability to develop solutions for quality validation and continuous improvement.
- Collaborate with PMs, engineers, and business stakeholders to understand business and technical requirements, plan and execute projects, and communicate status, risks and issues.
- Perform root cause analysis of system and data issues and develop solutions as required.
- Use large data sets to provide insight into business and functional issues while improving data reliability, efficiency, and quality.