Find Your Dream Job Today

Our mission is to help high-achieving LGBTQ+ undergraduates reach their full potential.

Senior Consultant -Data Engineer - PySpark and Databricks Specialist - Mumbai



Data Science
Mumbai, Maharashtra, India
Posted on Friday, July 5, 2024

As a global leader in assurance, tax, transaction and advisory services, we hire and develop the most passionate people in their field to help build a better working world. This starts with a culture that believes in giving you the training, opportunities and creative freedom. At EY, we don't just focus on who you are now, but who you can become. We believe that it’s your career and ‘It’s yours to build’ which means potential here is limitless and we'll provide you with motivating and fulfilling experiences throughout your career to help you on the path to becoming your best professional self.

The opportunity : Senior Consultant -Data Engineer - PySpark and Databricks Specialist - Mumbai

CNS - Risk - Internal Audit :

EY Consulting is building a better working world by transforming businesses through the power of people, technology and innovation. Our client-centric approach focuses on driving long-term value for our clients by solving their most strategic problems. EY Consulting is made up of three sub-service lines: Business Consulting (including Performance Improvement and Risk Consulting), Technology Consulting and People Advisory Services.

We help our clients in identifying and managing the interplay between upside and downside risk in order to make the long-term decisions to prevent risk and impact on their organization's ability to meet its future business strategy and objectives.

The 3 key fields of play are :

Enterprise Risk - helps clients identify and address key risk areas, while building the agility to respond quickly. The areas of focus include Enterprise risk and resilience, Internal audit, Compliance and Internal controls

Technology Risk - helps clients to achieve sustainable growth by supporting their efforts to protect their business performance and by providing trusted communications on internal control and regulatory compliance to investors, management, regulators, customers and other stakeholders. EY teams accomplish this by assessing the technology risks that are introduced to businesses.

Financial Services Risk - helps clients in the financial sector to identify, manage and monitor the risks in their business. It is done through a transformative and agile approach including process and procedures, risk, data modeling and analytics, reporting to stakeholders and third parties, business requirements (for software selection and IT implementation), analysis of assets and liabilities, and capital and liquidity management.

Your key responsibilities

Job Description:We are seeking a highly skilled and motivated Data Engineer with a strong background in PySpark and Databricks to join our data team. The successful candidate will be responsible for designing and implementing robust, scalable data pipelines that support our analytics and data science efforts.

Key Responsibilities:

  • Develop and maintain scalable data pipelines within Databricks and ensure the seamless flow of data across our data ecosystem.
  • Utilize PySpark to process large datasets efficiently and perform complex data transformations.
  • Collaborate with data scientists and analysts to support data modeling, data mining, and machine learning efforts.
  • Optimize data retrieval and develop ETL processes to improve data quality and efficiency.
  • Implement best practices for data security, compliance, and governance within the Databricks environment.
  • Troubleshoot and resolve any issues related to data performance and integrity.
  • Stay current with emerging technologies and industry trends to enhance our data capabilities.


  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Minimum of 3 years of experience as a Data Engineer with a focus on PySpark and Databricks.
  • Proficient in SQL, data modeling, and schema design.
  • Experience with cloud services (AWS, Azure, GCP) and understanding of cloud architecture.
  • Strong analytical and problem-solving skills.
  • Excellent communication and teamwork abilities.

Preferred Skills:

  • Experience with additional big data tools (Hadoop, Kafka, etc.).
  • Familiarity with data visualization tools and techniques.
  • Knowledge of machine learning frameworks and libraries.

What we look for

People with the ability to work in a collaborative manner to provide services across multiple client departments while following the commercial and legal requirements. You will need a practical approach to solving issues and complex problems with the ability to deliver insightful and practical solutions. We look for people who are agile, curious, mindful and able to sustain postivie energy, while being adaptable and creative in their approach.

What we offer

With more than 200,000 clients, 300,000 people globally and 33,000 people in India, EY has become the strongest brand and the most attractive employer in our field, with market-leading growth over compete. Our people work side-by-side with market-leading entrepreneurs, game- changers, disruptors and visionaries. As an organisation, we are investing more time, technology and money, than ever before in skills and learning for our people. At EY, you will have a personalized Career Journey and also the chance to tap into the resources of our career frameworks to better know about your roles, skills and opportunities.

EY is equally committed to being an inclusive employer and we strive to achieve the right balance for our people - enabling us to deliver excellent client service whilst allowing our people to build their career as well as focus on their wellbeing.

If you can confidently demonstrate that you meet the criteria above, please contact us as soon as possible.

Join us in building a better working world. Apply now.