Job Title: Integrator - YARS Support Team

Job Description:

We are seeking a skilled Integrator to join our support team to manage and maintain the YARS tool, which is responsible for synchronizing data from our on-premise Hadoop cluster to Azure cloud storage. The ideal candidate will have a strong background in Hadoop ecosystems, cloud technologies, and data synchronization processes. The Integrator will play a crucial role in ensuring the smooth operation of data transfers and the overall performance of the YARS tool.

Roles and Responsibilities:

Tool Management

· Oversee the operation and maintenance of the YARS tool within the Cloudera distribution.

· Ensure that the tool is configured correctly for optimal performance and reliability.

Data Synchronization

· Manage the synchronization process of data from the on-premise Hadoop cluster to Azure cloud storage.

· Monitor data transfer jobs to ensure they are completed successfully and within the expected timeframes.

Production Support

· Provide production support for the YARS tool, addressing any issues that arise during data synchronization.

· Troubleshoot and resolve problems related to data transfer and tool performance.

Performance Monitoring

· Implement monitoring solutions to track the performance of the YARS tool and data synchronization processes.

· Analyse logs and metrics to identify potential bottlenecks or issues in the data transfer workflow.

Collaboration

· Work closely with data engineering and IT teams to ensure seamless integration of the YARS tool with existing systems.

· Collaborate with cloud architects to optimize data storage solutions in Azure.

Documentation

· Maintain comprehensive documentation of the YARS tool configuration, processes, and troubleshooting steps.

· Update user manuals and provide training to team members on the use of the YARS tool.

Continuous Improvement

· Identify opportunities for process improvements and implement best practices in data synchronization and tool management.

· Stay updated on the latest technologies and trends in Hadoop, cloud storage, and data synchronization.

Compliance and Security

· Ensure that data transfers comply with organizational policies and relevant regulations.

· Implement security best practices to protect sensitive data during synchronization.