Spark/Databricks/ PySpark-Software Engineer
UBS
Spark/Databricks/ PySpark-Software Engineer
India
Information Technology (IT)
Group Functions
Your role
We’re looking for a Reporting/Data engineering software engineer :
• with over 11 years of experience in the field of Apache Spark, Databricks, and PySpark, you will be responsible for leading a team of 5-7 technical experts. Your role will encompass a broad spectrum of technical skills, focusing on big data processing, data engineering, and related technologies. The ideal candidate will possess deep expertise in Spark job optimization, data modeling, and performance tuning within the Databricks environment. Additionally, proficiency in Python programming, advanced data integration, and SDLC (Software Development Life Cycle) processes is crucial.
Qualifications and Skills:
• bachelor’s/Masters degree in Computer Science, Data Science, or a related field.
• proven experience leading and managing technical teams.
Soft Skills:
• excellent leadership and team management abilities.
• effective communication skills to convey technical concepts to both technical and non-technical stakeholders.
• analytical and problem-solving mindset.
• proactive in staying abreast of industry trends and emerging technologies.
Job Reference #
332687BR
City
Hyderabad, Pune
Job Type
Full Time
Your team
You’ll be working in Finance IT in Pune. We provide excellent exposure to latest technologies and ability to ‘make a mark’ in our delivery team. It benefits our clients with greater insights into their business and provides extra agility in change. As a Software Engineer you’ll play an important role in achieving important change milestones.
We are results-oriented, multi-cultural group and would welcome you on the Azure World journey with us.
Your expertise
• employ Python and PySpark to perform advanced data manipulation, analysis, and distributed processing, handling large volumes of data efficiently across clusters.• • work closely with various Databricks components and services to ensure seamless data integration and operational efficiency across data engineering workflows.
• foster a cohesive approach to using Apache Spark and PySpark for large-scale data processing, ensuring smooth integration and optimal performance in data pipelines.
• extensive experience in big data technologies, real-time analytics, data engineering, data science, and large-scale data processing using Apache Spark and Databricks and familiarity with the Hadoop ecosystem, Kafka, and other big data technologies for end-to-end data solutions.
• lead data engineering and machine learning projects using Databricks, leveraging its robust platform capabilities for data integration, transformation, and analytics.• implement and manage security measures within Databricks, including role-based access control (RBAC) and cluster access control for granular data security and compliance.
• spearhead initiatives to optimize the performance of Spark jobs, including tuning job configurations, managing resource allocation, and improving job execution efficiency.
• oversee the design, implementation, and management of complex ETL pipelines in Databricks, ensuring reliable, efficient, and scalable data workflows for various data processing needs.
About us
UBS is a leading and truly global wealth manager and the leading universal bank in Switzerland. We also provide diversified asset management solutions and focused investment banking capabilities. Headquartered in Zurich, Switzerland, UBS is present in more than 50 markets around the globe.
We know that great work is never done alone. That’s why we place collaboration at the heart of everything we do. Because together, we’re more than ourselves. Want to find out more? Visit ubs.com/careers.
How we hire
We may request you to complete one or more assessments during the application process. Learn more
Join us
At UBS, we know that it's our people, with their diverse skills, experiences and backgrounds, who drive our ongoing success. We’re dedicated to our craft and passionate about putting our people first, with new challenges, a supportive team, opportunities to grow and flexible working options when possible. Our inclusive culture brings out the best in our employees, wherever they are on their career journey. And we use artificial intelligence (AI) to work smarter and more efficiently. We also recognize that great work is never done alone. That’s why collaboration is at the heart of everything we do. Because together, we’re more than ourselves.
We’re committed to disability inclusion and if you need reasonable accommodation/adjustments throughout our recruitment process, you can always contact us.
Contact Details
UBS Business Solutions SA
UBS Recruiting
Disclaimer / Policy statements
UBS is an Equal Opportunity Employer. We respect and seek to empower each individual and support the diverse cultures, perspectives, skills and experiences within our workforce.