Principal Software Engineering Manager - Data Analytics
Microsoft
Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.
Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture.
Within Azure Data, the big data analytics team provides a range of products that enable data engineers and data scientists to extract intelligence from all data – structured, semi-structured, and unstructured. We build the Data Engineering, Data Science, and Data Integration pillars of Microsoft Fabric.
The Fabric Data Engineering Experience & Infrastructure team is looking for a passionate engineer to help build the next generation of infrastructure services for Microsoft Fabric Data Engineering, powered by Apache Spark.
If you enjoy working on high-scale distributed systems, developer experiences, and platform infrastructure that makes engineers more productive, this is a great place to do it.
What you’ll work on:
- Build and operate core infrastructure services that power Fabric Data Engineering on Spark
- Improve scalability, resiliency, and observability across Spark-based services
- Partner closely with product, client/UX, and runtime teams to ship end-to-end experiences
- Drive engineering excellence through design reviews, testing, incident learnings, and performance tuning
- Intelligent job/session orchestration and scheduling improvements
- Runtime performance optimizations (caching, adaptive execution, cost/perf tuning)
- Debuggability & observability (logs/metrics/traces, diagnostics experiences)
- Reliability tooling (auto-heal, safe rollouts, incident reduction)
- Data engineering developer experience improvements (config, templates, integrations)
What we’re looking for:
- Extensive software engineering fundamentals and experience shipping production services
- Comfort working with distributed systems and performance-critical code
- Experience with Spark and/or big data systems is a big plus (but not required if you’re eager to learn)
- Collaborative mindset and ownership mentality—someone who likes building, iterating, and improving systems over time
We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served.
Responsibilities
- Lead the design and delivery of world-class experiences for a new big data cloud offering, with emphasis on scale, reliability, and performance.
- Manage and grow a team building core infrastructure services for data engineering and analytics workloads (compute, runtime services, job/session management, configuration, platform integrations).
- Own technical strategy and execution end-to-end: translate product requirements into architecture, milestones, and high-quality production outcomes.
- Drive operational excellence by establishing troubleshooting practices (logs, metrics, traces), guiding root-cause analysis, and converting operational learnings into engineering improvements.
- Improve platform scalability, resiliency, and observability, including automation to reduce operational toil; ensure best practices are adopted consistently across the team.
- Partner cross-functionally with product and engineering leaders to deliver end-to-end features, align priorities, and continuously raise the quality bar.
- Coach and mentor engineers, provide technical guidance and performance feedback, and foster a culture of ownership, high standards, and continuous learning.
Qualifications
Required/minimum qualifications
- Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
Additional Job Requirements:
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:
- This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
- Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- 4+ years people management experience.
- Software engineering foundation (data structures, algorithms, testing, debugging, performance) with the ability to guide and review technical decisions.
- Demonstrated experience leading teams that build and ship production infrastructure (backend services, distributed systems, platform components) in cloud environments.
- Understanding of distributed systems concepts, including fault tolerance, scaling, scheduling, and resource management, and ability to apply them to team-level architecture.
- Proficiency in at least one backend/system language (e.g., Java, Scala, C#, C++, Python) and the ability to stay hands-on enough to unblock teams and assess designs.
- Proven ability to ramp up quickly in new domains, tools, and codebases; growth mindset and learning agility.
- Ability to operate effectively in an AI-powered engineering environment—adopting AI-assisted workflows (copilots/agents), improving team productivity, and elevating quality.
- Experience leading large-scale infrastructure efforts for data platforms or compute services (e.g., orchestration, runtime services, cluster/resource management, multi-tenant systems).
- Experience establishing and running observability and operations programs (SLOs/SLIs, alerting, incident response, postmortems) and improving reliability over time.
- Background in performance and reliability engineering (profiling, optimization, capacity planning, cost/performance tradeoffs).
- Familiarity with cloud-native operating models: service ownership, CI/CD, safe deployments, automation, and modern incident management practices.
#azdat
#azuredata
#analytics
Software Engineering M5 - The typical base pay range for this role across Canada is CAD $142,400 - CAD $257,500 per year.
Find additional pay information here:
https://careers.microsoft.com/v2/global/en/canada-pay-information.html
Software Engineering M5 - L'échelle salariale de base typique pour ce rôle dans l'ensemble du Canada est de 142,400 $ CAD à 257,500 $ CAD par année.
Pour plus d'information au sujet de la rémunération, veuillez cliquer ici:
https://careers.microsoft.com/v2/global/en/canada-pay-information.html
Ce poste sera ouvert pendant au moins cinq jours et les candidatures seront acceptées de façon continue jusqu’à ce que le poste soit pourvu.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft est un employeur offrant l’égalité d’accès à l’emploi. Tous les candidats qualifiés seront pris en considération pour l’emploi, sans égard à l’âge, à l’ascendance, à la citoyenneté, à la couleur, aux congés médicaux ou familiaux, à l’identité ou à l’expression de genre, aux renseignements génétiques, à l’état d’immigration, à l’état matrimonial, à l’état de santé, à l’origine nationale, à un éventuel handicap physique ou mental, à l’affiliation politique, au statut de vétéran protégé ou au statut militaire, à la race, à l’ethnie, à la religion, au sexe (y compris la grossesse), à l’orientation sexuelle ou à toute autre caractéristique protégée par les lois, ordonnances et règlements locaux applicables. Si vous avez besoin d’aide avec des accommodements religieux et/ou d’un accommodement raisonnable en raison d’un handicap pendant le processus de candidature, apprenez-en plus sur la demande d’accommodement.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.