Data Ingestion Manager

Data Ingestion Manager

Job Overview

Location
Edinburgh, Scotland
Job Type
Permanent Job
Job ID
18601
Date Posted
1 year ago
Recruiter
Jessica Jones
Job Views
55

Job Description

Our people work differently depending on their jobs and needs. From home working to job sharing, visit the remote and flexible working page on our website to find out more.

This role is based in the United Kingdom and as such all normal working days must be carried out in the United Kingdom.

Join us as a Data Ingestion Manager

  • This role will see you managing data ingestion processes and data quality exceptions
  • Working with internal and external stakeholders, you’ll optimise our data ingestion processes while monitoring the ingestion and loading of data and reporting exceptions
  • This is an opportunity to utilise and develop your specialist skills in Microsoft Azure data ingestion patterns (Azure Storage, Azure Data Factory, Azure SQL Server), ensuring data required for all new and existing use cases is identified, profiled, ingested into the platform correctly and validated for quality and integrity

What you'll do

As a Data Ingestion Manager, you will work with the firms technology group to facilitate the ingestion of new data sources, monitor automated checks against a sophisticated rules engine, ensuring data content passes the required data quality checks. You’ll also be responsible for the maintenance of the data quality rule set, designing, implementing, and testing new rules based on client, business, or system feedback.

As well as this you’ll be:

  • Liaising with data vendors, clients, and service providers to resolve file-based exceptions
  • Tracking how exceptions are resolved over time
  • Managing and implementing the onboarding and off boarding of new data providers onto the platform
  • Managing the collation and analysis of ingestion metrics across the provider base to inform discussions on service quality, frequency and any persistent issues
  • Helping the implementation, refinement and maintenance of a best-in-class system

The skills you'll need

We’re looking for someone with knowledge and experience in data governance and strong SQL skills, specifically Microsoft Azure SQL.

You’ll also demonstrate:

  • Familiarity with Kimball dimensional data modelling principles
  • Knowledge and experience of data ingestion management and pipeline automation
  • A keen eye for detail

If you need any adjustments to support your application, such as information in alternative formats or special requirements to access our buildings, or if you’re eligible under the Disability Confident Scheme please contact us and we’ll do everything we can to help.

Job ID: 18601

Similar Jobs

Enterprise Holdings

Full Time Job

Data ingestion manager Data ingestion manager

Make eye contact and greets all customers; identify and attend to customer by na...

Full Time Job

Beam Suntory

Full Time Job

Data ingestion manager Data ingestion manager

Beam Suntory is the world’s third largest premium spirits company with an...

Full Time Job

7-Eleven

Full Time Job

Data ingestion manager Data ingestion manager

ResponsibilitiesBeing a 7-Eleven Area Leader isn’t easy. In fact, itâ€...

Full Time Job

America's Best Contacts & Eyeglasses

Full Time Job

Data ingestion manager Data ingestion manager

America's Best is part of National Vision, one of the largest and fastest-growi...

Full Time Job

Cookies

This website uses cookies to ensure you get the best experience on our website.

Accept