With ever-increasing channels of communication and heightened regulatory scrutiny, organizations need to continuously archive and monitor their activities and data. Our clients seek a one-stop shop for compliant storage and reconstruction of communication, collaboration, and financial transaction information. That’s where Bloomberg Vault (BVAULT) steps in. Thousands of organizations trust BVAULT to manage and archive their enterprise communications and trade data, including Bloomberg Message, Instant Bloomberg, email, instant messages, mobile data, files, voice data, social media, and more.

As a Senior Software Engineer within the BVAULT Archive Metadata team, you will be pivotal in designing and implementing systems that harness metadata to unlock the full potential of the petabytes of data we collect. Metadata plays a key role, not just in organizing data, but in understanding how it moves through systems, uncovering valuable insights, and enabling advanced analytics using AI/ML. You will work with state-of-the-art tools to ensure our datasets are optimized for analysis and reporting, empowering the business to make faster, more informed decisions.

In this role, you’ll also be at the forefront of applying metadata to the next generation of cutting edge applications such as trade reconstruction and surveillance, where it provides essential context and structure for more accurate model training. By leveraging metadata, we solve complex business challenges, driving innovation and value at scale. As part of this dynamic and young team, you’ll have the opportunity to shape the future of this critical infrastructure from the ground up.

Key Responsibilities:

• Build scalable, distributed data ingestion and processing pipelines.

• Develop data models and architecture for data lakes.

• Optimize data retrieval for dashboards and reporting.

• Ensure compliance with data governance and security standards.

• Collaborate with stakeholders to deliver data-driven solutions.

• Monitor performance and recommend infrastructure improvements.

You'll need to have:

• 4+ years of experience as a Data Engineer, Software Engineer or similar role.

• 4+ years experience with SQL, Python, Java or C++.

• Strong skills in distributed systems and open-source technologies.

• Excellent problem-solving and communication skills.

• A Degree in Computer Science, Engineering, Mathematics, similar field of study or equivalent work experience.

We'd love to see:

• Experience with open-table formats (e.g., Parquet), cloud platforms (e.g., S3), and technologies like Apache Iceberg, Spark, Kubernetes and Airflow/Argo.

Why Join Us?
Our team prioritizes maintaining a healthy work-life balance through clear communication and setting realistic project timelines. We foster a supportive environment that allows our engineers to thrive both personally and professionally. Additionally, we dedicate four weeks at the end of the year for “Innovation Month,” where team members are encouraged to collaborate on engineering-driven projects and explore new technologies.

Interested?

For more information, visit our Compliance Flickr page: Compliance Flickr Page.