About EY

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture, and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.

The opportunity

EY is looking for a Senior Big Data Engineer to join our dynamic team, that focuses on implementing scalable data solutions and working in client engagement teams to deliver advanced analytics and technology consulting services. In this role, you will leverage your extensive experience in Big Data technologies to design and implement robust data pipelines and architectures that drive business success. You will play a crucial role in optimizing data processing workflows and ensuring the integrity, security, and availability of large-scale data assets.

Your key responsibilities

· Business Analysis: Collaborate with stakeholders to gather and analyze business requirements, translating them into technical specifications for Big Data solutions.

· Data Architecture & Design: Define and implement modern data architectures using distributed processing paradigms and scalable frameworks.

· Pipeline Development: Design, develop, and maintain data pipelines and frameworks for ingestion, transformation, and processing of structured and unstructured data.

· Performance Optimization: Optimize data workflows and distributed processing jobs to ensure efficiency and reliability at scale.

· Cross-Functional Collaboration: Work closely with data scientists, analysts, and other teams to integrate Big Data solutions into business processes.

· Monitoring & Troubleshooting: Ensure operational stability of Big Data platforms, proactively identifying and resolving issues.

· Data Security & Governance: Apply best practices for data quality, security, and compliance throughout the data lifecycle.

· Leadership & Planning: Coordinate technical teams, provide estimates, manage risks, and ensure timely delivery of Big Data projects.

· Documentation: Maintain comprehensive documentation of solution designs, processes, and procedures to facilitate knowledge sharing and compliance with organizational standards.

· Technical Support and Training: Provide technical support and training to end-users and development teams, fostering a culture of continuous improvement and knowledge sharing.

Skills and attributes for success

• Communication is essential, must be able to listen and understand the question and develop and deliver clear insights, in both verbal and written, with the ability to convey complex technical concepts to non-technical stakeholders. • Independent and able to manage and prioritize workload. • Ability to adapt quickly and positively to change. • This position will require strong analytical and problem-solving skills, with a keen attention to detail. • You will also be a part of larger team (incl. client-side stakeholders), so communication and collaboration skills will also help you to succeed.

· A proactive approach to identifying and resolving issues

To qualify for the role, you must have

• Proven experience (more than 4 years) in Big Data projects, including design, modeling, implementation, and evolution of data solutions (data lakes, lakehouses, pipelines).

• Deep knowledge of Big Data fundamentals and lifecycle (collection, integration, quality control, processing, visualization, dissemination).

• Hands-on experience with Big Data platforms and technologies (e.g., Spark, Databricks, Azure Synapse, Kafka, MS Fabric).

• Expertise in distributed storage (S3, Blob, ADLS) and file formats (Parquet, Avro, Delta).

• Advanced programming skills in Python and SQL.

• Familiarity with cloud Big Data services (Azure, AWS, GCP).

• Experience as team leader or tech lead, including planning, risk management, and stakeholder engagement.

• Strong background in Agile methodologies and DevOps/DataOps practices.

• Knowledge of CI/CD principles, version control, and automated testing (e.g., TFS, GitHub).

Ideally, you'll also have

· Experience with visualization tools and preparing data for business consumption.

· Relevant certifications in Big Data or cloud technologies.

What we look for
An effective communicator and you’ll be a confident team player equipped with strong people management skills; Creative, proactive, a team player, and able to work under pressure. It’s important to have a strategically focused mindset and the ability to deliver multiple projects and present information in a clear and concise manner. Business mindset and some commercial acumen. We value a strong work ethic, forward-thinking, and being a self-starter; If you’re ready to take on a wide range of responsibilities and are committed to seeking out new ways to make a difference, this role is for you.

What we offer

We offer a competitive remuneration package where you’ll be rewarded for your individual and team performance. Plus, we offer support and coaching, opportunities to develop new skills and progress your career, and the freedom and flexibility to handle your role in a way that’s right for you.

• Continuous learning: You’ll develop the mindset and skills to navigate whatever comes next.

• Success as defined by you: We’ll provide the tools and flexibility, so you can make a meaningful impact, your way.
• Transformative leadership: We’ll give you the insights, coaching and confidence to be the leader the world needs.
• Diverse and inclusive culture: You’ll be embraced for who you are and empowered to use your voice to help others find theirs.

If you can demonstrate that you meet the criteria above, please contact us as soon as possible.

The exceptional EY experience, it’s yours to build.

EY | Shape the future with confidence

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.

Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.

Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.

At EY, we're committed to providing recruitment and career opportunities to all, regardless of gender, sexual orientation, social background or disability. We believe that equality and diversity are central to our recruitment process, as they enhance creativity and efficiency, leading to improved performance and productivity. In line with this commitment, EY Portugal recently became a member of the Inclusive Community Forum. This initiative, led by Nova SBE, focuses on the recruitment of individuals with disabilities, advocating for a more inclusive community. Moreover, EY Portugal has also endorsed the Diversity Charter of APPDI (the Portuguese Association for Diversity and Inclusion), pledging to establish and develop internal policies and practices which support diversity. Through these initiatives, EY seeks to actively contribute to the inclusion process, and promote a more inclusive community for people with disabilities, by actively participating in creating solutions.

#LI-HYBRID