My job alerts

Lead Data Engineer

Becton Dickinson

Software Engineering, Data Science

Bengaluru, Karnataka, India

Posted on Dec 20, 2024

Apply now

Job Description Summary

COMPANY BACKGROUND
Founded in 1897 and headquartered in Franklin Lakes, New Jersey, Becton Dickinson (BD) is a medical technology company that serves healthcare institutions, life science researchers, clinical laboratories, industry and the general public. BD manufactures and sells a broad range of medical supplies, devices, laboratory equipment and diagnostic products. It employs nearly 65,000 people serving more than 190 countries throughout the world.

The company's customers include healthcare institutions, science researchers, clinical laboratories, the pharmaceutical industry and the general public. BD was one of the first companies to sell U.S.-made glass syringes. It was also a pioneer in the production of hypodermic needles.

Becton Dickinson operates through three worldwide segments:

BD Medical
 Medication Management Solutions
 Medication and Procedural Solutions
 Pharmaceutical Systems
BD Life Sciences
 Biosciences
 Integrated Diagnostic Solutions
BD Interventional
 Peripheral Intervention
 Surgery
 Urology and Critical Care

BD Core Values
We do what is right
 We act in alignment with our Company’s high ethical standards and protect our Company's reputation, always. We are honest and trustworthy. We speak openly when we have concerns or questions.

We are authentic
 We remain true to our Values. We are humble, sincere, transparent and explicit in our intentions. We serve others and guide them to a shared purpose.

We are all accountable
 We take personal ownership and responsibility for BD decisions, actions and outcomes, and reliably deliver on personal and professional commitments.

We improve every day
 We continuously raise the bar. We relentlessly improve our ideas, products, solutions, services, and processes, to drive the transformation of healthcare, globally. We are curious and never stop learning.

We help each other be great
 We support and respect one another, challenge ideas, embrace feedback and work together for the good of our customers, the Company and patients.

Job Description

Position Summary

7 years of experience working in data engineering role.
Expertise in Databricks, with hand-on experience in data transformation using PySpark and Spark SQL.
In-depth knowledge on Azure Data Factory, Azure Data Lake, Delta Lake, Azure SQL, Azure Blob Storage.
Comprehensive understanding of ETL and big data principles, including Hive and the Spark framework.
Experience in troubleshooting and optimizing Spark on Databricks.
Apply medallion architecture to design and develop data warehouses that support efficient analytics. Ensure data is organized, clean, and easily accessible for reporting purposes.
Experience with developing solutions on cloud computing services and infrastructure in the data and analytics space.
Hand-on experience with various file formats, including CSV, JSON, XML, XLS and PARQUET.
Ability to formulate complex SQL queries and a solid grasp of Data Warehouse principles.
Knowledge with DevOps and Agile project methodologies, with the ability to implement requirements using Databricks and Azure Data Factory.
Experience in version control systems such as Git/Bitbucket.
Familiarity with SAP, MS Azure, and Power BI is a plus.
Strong work ethic, flexibility to changes in work direction as the project develops and ability to work at an abstract level and gain consensus.
Passionate about Agile software processes, data-driven development, reliability, and experimentation.
Self-motivated with strong problem-solving and learning skills.
Excellent communication, listening, and influencing skills.
Experience working on a collaborative Agile product team.

Educational Background

Bachelor’s in information technology or computer science

Professional Experience

7-12 Years

Job Responsibilities

Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL and Data Engineering principles and business goals.
Work with Data Engineering Technical and Functional Lead, SMEs and Business Stakeholders to Provide Data & Analytics solution and support by leveraging Data Engineering standards and guidelines using Azure Databricks and ADF.
Solve complex data problems to deliver insights that helps the organization's business to achieve their goals.
Create data products for analytics and data scientist team members to improve their productivity.
Design the solutions for multiple large data warehouses in Azure cloud environment utilizing the parallel architecture and appropriate technology stack.
Perform various proof of concepts to test the ideas and technology capabilities and subsequently drives these concepts into real solutions.
Work with various business units to identify the requirements and build corresponding data models and data pipelines.
Advise, consult, mentor and coach other data and analytic professionals on data standards and practices.
Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering to improve the organization's productivity as a team.
Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.

Knowledge and Skills

ETL and SQL
Databricks, Azure Data Factory.
GIT/Bitbucket
Power BI or similar reporting tool.
Critical Thinking Skills
Behavioural Skills
Soft Skills
Leadership Skills

Desired / Additional Skills & Knowledge (Not essential to the job but will be an advantage to possess)

Working experience on Microsoft Azure cloud platform
Power BI

Any additional Information (Specially if needed for Quality or legal purposes)

Required Skills

Optional Skills

Primary Work Location

IND Bengaluru - Technology Campus

Additional Locations

Work Shift