- Design, develop, and maintain scalable data pipelines and workflows using Azure Data Factory and Databricks.
- Perform data transformation and integration tasks to consolidate and enrich data from various sources into a unified format, whilst also ensuring data governance and compliance by design
- Implement data quality checks and validation processes to ensure accuracy, completeness, and consistency of data.
- Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements, perform UAT and deliver solutions accordingly.
- Monitor pipeline performance and troubleshoot issues promptly to ensure uninterrupted data processing.
- Document data pipelines, workflows, and processes to ensure knowledge sharing and maintainability.
- Ensures the effective & timely management and closure of 2nd line data and reporting support requests, through the appropriate ticketing systems, to minimise impact on the operations of the wider business.
- Actively participate in daily stand ups, weekly stakeholder meetings, retrospectives.
- Hands-on Experience with Azure Data Factory: Proven experience in designing, developing, and managing data pipelines using Azure Data Factory.
- Good knowledge of Databricks for data processing and analytics
- Experience with data modelling techniques and data warehousing concepts.
- Proficiency in SQL for data querying and manipulation.
- Ability to work effectively in a fast-paced, dynamic environment and manage multiple priorities, following the Agile way of working
- Problem-solving Skills: Ability to analyse complex data problems and propose effective solutions.
- Communication and Collaboration: Good communication skills with the ability to collaborate effectively with cross-functional teams.
- Experience with Python is highly desirable
-
Data Engineer
2 days ago
Applause IT Birmingham, United Kingdom**Data Engineer** · **- Fully Remote - £70,000 - £80,000 + Benefits** · ApplauseIT are looking for an experienced Data Engineer with a strong understanding of ETL, Python and Cloud exposure is sought by a rapidly growing E-Commerce Marketplace. The environment for the successful ...
-
Data Engineer
2 days ago
Harnham Birmingham, United Kingdom**DATA ENGINEER** · **REMOTE (MUST BE UK BASED)** · **UP TO £85,000** · **THE COMPANY** · This company is one of the UK's largest telecommunication businesses. They are a very 'member focused' business, focusing on a great customer experience. Alongside this, they are also B Corp ...
-
Data Engineer
3 days ago
Opus Recruitment Solutions Ltd West Midlands (Region), United Kingdom**Data Engineer |Up to £70,000 | Fully Remote** · **SQL | Python | Kafka | Kuberenetes | Spark | Cloud | ** · Interested in working with cross functional teams, working across Software, Data and DevOps? · A well-established software consultancy firm that're growing at a fast rate ...
-
Data Engineer
1 week ago
Trust In Soda West Midlands (Region), United KingdomAre you looking to work for a fast growing company that is looking to change how the real estate industry operates completely? They are looking to use data to change the real estate market completely and you can be a decisive part of that change. · Your responsibilities include: ...
-
Data Engineer Manager
4 days ago
Harnham Birmingham, United Kingdom**Data Engineering Manager** · **Up to £100,000 per annum** · **Location** - Fully remote · We have a fantastic new opportunity for a data engineering manager at a new and innovative food technology start-up company · **The Company** · This company is a start-up that uses technol ...
-
Data Engineering Manager
1 week ago
Harnham - Data & Analytics Recruitment Birmingham, United Kingdom**DATA ENGINEERING MANAGER** · **REMOTE (1x MONTH IN OFFICE) - NORTH LONDON** · **UP TO £95,000** · **THE COMPANY** · This company is one of the world's leading aviation companies. They may be facing the biggest challenge in history, but they are confident that throughout the pan ...
-
D365fo Data Engineer
1 week ago
Akkodis Birmingham, United KingdomMy end user client is looking for a D365FO Data Engineer to join their team on a permanent basis. They can offer a hybrid working model, and they've got offices in: London, Edinburgh, Newcastle, Bristol, Basingstoke OR Dundee and you can be part office basedin of these locations. ...
-
Senior Azure Data Engineer
4 days ago
Nigel Frank International Birmingham, United Kingdom**Senior Azure Data Engineer - Remote - £65-70k** · Our client is a market-leading Legal researching organisation. They are looking to add an experienced Azure Data Engineer to join a diverse, results-driven, and collaborative team. The purpose of the team is to support the ongoi ...
-
Senior & Lead Data Engineers / / Tech
3 days ago
SR2 Birmingham, United Kingdom"A company of the 22nd century" · While they're not working on flying cars just yet, that's a quote on Glassdoor from an employee who reckons that the work/life balance, the professional & personal growth, the emphasis on environment, social responsibility & community engagement, ...
-
Senior & Lead Data Engineers / / Tech
1 week ago
SR2 Birmingham, United Kingdom"A company of the 22nd century" · While they're not working on flying cars just yet, that's a quote on Glassdoor from an employee who reckons that the work/life balance, the professional & personal growth, the emphasis on environment, social responsibility & community engagement, ...
-
Lead Data Engineer Work From Home
1 day ago
Experis LTD West Midlands (Region), United Kingdom**Lead Data Engineer** (work from home) · I am looking for a Data Engineer with strong experience in **SQL and Power BI**. You will work with customers on their **Azure / Dynamics / SQL platforms** through **pre-sales to implementation**. Must have the capability to **create, imp ...
-
Senior Data Engineer- Start Up- Fully Remote
1 week ago
Sanderson West Midlands (Region), United Kingdom**Senior Data Engineer · - Start Up · - Fully Remote** · **£85k · - £95k + Fantastic Benefits** · I am working with a well-funded, SaaS Tech business that are looking to grow significantly over the next 12 months. · The Senior Data Engineer will help drive forward automation & in ...
-
Data Engineer
1 day ago
Nigel Frank International Stafford, United Kingdom**Data Engineer - Hybrid - Up to £55,000** · I'm currently working with rapidly growing consultancy who work with clients in a range of industries including retail and finance, who are looking for experienced Data Engineer's to join their team. This is a fantastic opportunity to ...
-
Data Engineer
1 day ago
Akkodis Warwickshire, United KingdomData Engineer / BI / Business Intelligence / Developer / Consultant / Azure Synapse / SQL / Customer Data / Data Analytics / Data Science / Data Lead / Remote / Warwickshire / £ per day Inside IR35, 3-6 month contract. · One of our leading clients is looking to recruit a Data Eng ...
-
Data Engineer
12 hours ago
eFinancialCareers Rugby, United Kingdom**Data Engineer** · **OUTSIDE IR35** · **REMOTE** · The role of a Data Engineer will contribute to will be responsible for designing and implementing high quality, robust, and scalable web solutions using. They will have hands on experience in Spark, coding experience in java/spr ...
-
Data Engineer
1 week ago
Harnham - Data & Analytics Recruitment Stratford-upon-Avon, United Kingdom**Data Engineer** · **Hybrid, 2x per week in office, Stratford-Upon-Avon** · **£60, 000-£65, 000** · **Permanent** · An exciting opportunity for a Data Engineer to join a major automotive company and join their innovative digital transformation team. · **The Company** · An amazin ...
-
Data Engineer
1 week ago
Experis LTD Staffordshire, United Kingdom**Data Engineer - ETL - SQL - PowerBI - Data Modelling - Microsoft Technologies - Azure -** · **SQL, SSRS, SSIS, SSAS, MS Technology Stack, ETL, Data Modelling, PowerBI, DAX, Data Marts & Data Models, T-SQL Data Warehouse Design.** · **West Midlands, Shropshire, Staffordshire** · ...
-
Data Engineer
3 days ago
Homes England Coventry, United KingdomThis is a hybrid role. Locations of work can be: Bristol, Coventry, Guildford, Leeds, Liverpool, Manchester, Newcastle or Northstowe · **What we offer...** We understand how important life is outside of work so, as well as competitive salary and 33 days annual leave, we are total ...
-
Data Engineer
1 week ago
Lorien Birmingham, United KingdomJob Description · Senior Data Engineer- Fast growing SaaS Scale up · West Midlands- hybrid working · Up to £86K base with bonus and benefits · The client · SaaS Software business platform which is revolutionising financial management for their customers. · Responsibility: · Wor ...
-
Data Engineer
6 days ago
Talent Birmingham, United KingdomPermanent Data Opportunity working within a critical public service organisation · Hybrid working in the West Midlands · Salary starting at £40,005 per a year · Talent is proud to be working with Government client to manage the Data Engineering capabilities, developing and implem ...
Data Engineer - Birmingham, United Kingdom - Experis
Description
Data Engineer
Role purpose:
The Data Engineer position is an integral part of the Data team within the Digital and Information function. This role entails overseeing the availability, integrity, quality, and accuracy of data. The primary responsibilities include designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI reporting and analytics delivery. The Data Engineer will contribute to enhancing our Azure-based data platform using technologies such as Azure Data Factory and Azure Databricks and will have the opportunity to work on exciting digital transformation projects.
Operating within Agile principles and methodologies, the Data Engineer collaborates with other data engineers and key stakeholders to shape and manage the portfolio of reporting and data requirements. Working alongside peers, this role contributes to refining the overall data strategy.
Key Responsibilities:
Technical / Professional Qualifications / Requirements: