EY - GDS Consulting - AI & DATA – Architect Snowflake and Databricks or Big data or Pyspark- Manager

EY's GDS Consulting AI & DATA is a unique, industry-focused business unit that provides a broad range of integrated services that leverage deep industry experience with strong functional and technical capabilities and product knowledge. EY’s financial services practice provides integrated advisory services to financial institutions and other capital markets participants, including commercial banks, retail banks, investment banks, broker-dealers & asset management firms, and insurance firms from leading Fortune 500 Companies. Within EY’s Advisory Practice, Data and Analytics team solves big, complex issues and capitalize on opportunities to deliver better working outcomes that help expand and safeguard the businesses, now and in the future. This way we help create a compelling business case for embedding the right analytical practice at the heart of client’s decision-making.

The opportunity

We’re looking for Manager – Architect Snowflake and Databricks or Big data (Hadoop) or pyspark with expertise in Financial Services domain hand-on experience with Big data ecosystem.

Primary skills and key responsibilities

• Platform and solution leadership: Design and implement end-to-end Databricks-based data platforms, ensure performance, scalability, reliability, and compliance; produce architecture diagrams and documentation; lead governance and best practices.
• Core technical stack: Databricks (including Spark, Delta Lake/Lakehouse), Python/PySpark, SQL; Azure services (ADLS, ADF, Synapse, Azure SQL), identity/security (SAML/OAuth/OIDC, MFA, RBAC), and often Kubernetes/Docker for deployment patterns.
• Should have strong technical expertise in Neo4j.
• Data architecture depth: Data modelling, data integration/ETL, batch and streaming pipelines, data quality/profiling/cleansing, MPP designs, and data governance frameworks; optimization across ingestion, transformation, and consumption layers in Databricks.
• Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution.
• Excellent communicator (written and verbal formal and informal).
• Ability to multi-task under pressure and work independently with minimal supervision.
• Strong verbal and written communication skills.
• Must be a team player and enjoy working in a cooperative and collaborative team environment.
• Adaptable to new technologies and standards.
• Participate in all aspects of Big Data solution delivery life cycle including analysis, design, development, testing, production deployment, and support

Nice to have skills

• Understanding & familiarity with all Hadoop Ecosystem components and Hadoop Administrative Fundamentals
• Experience working with NoSQL in at least one of the data stores - HBase, Cassandra, MongoDB
• Experience in HDFS, Hive, Impala
• Experience is schedulers like Airflow, Nifi etc.
• Experienced in Hadoop clustering and Auto scaling.
• Develop standardized practices for delivering new products and capabilities using Big Data technologies, including data acquisition, transformation, and analysis.
• Define and develop client specific best practices around data management within a Hadoop environment on Azure cloud

To qualify for the role, you must have

• BE/BTech/MCA/MBA
• Minimum 10+ years hand-on experience in one or more relevant areas.
• Total of 12+ years industry experience

Ideally, you’ll also have

Experience on Banking and Capital Markets domains

Skills and attributes for success

• Use an issue-based approach to deliver growth, market and portfolio strategy engagements for corporates
• Strong communication, presentation and team building skills and experience in producing high quality reports, papers, and presentations.
• Experience in executing and managing research and analysis of companies and markets, preferably from a commercial due diligence standpoint.

What we look for

• A Team of people with commercial acumen, technical experience and enthusiasm to learn new things in this fast-moving environment
• An opportunity to be a part of market-leading, multi-disciplinary team of 1400 + professionals, in the only integrated global transaction business worldwide.
• Opportunities to work with EY Advisory practices globally with leading businesses across a range of industries

What working at EY offers

At EY, we’re dedicated to helping our clients, from start–ups to Fortune 500 companies — and the work we do with them is as varied as they are.

You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:

• Support, coaching and feedback from some of the most engaging colleagues around
• Opportunities to develop new skills and progress your career
• The freedom and flexibility to handle your role in a way that’s right for you