- Building new data pipelines and optimizing data flows using the Azure cloud stack.
- Building data products from scratch.
- Support Business Analysts and Data Architects with discovery and best practices.
- Self-directed and comfortable supporting the data needs of multiple teams, systems and products.
- Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure.
- Experience building and optimizing 'big data' data pipelines, architectures and data sets using Py-spark.
- Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Cloud Big Data Analytics in Azure Synapse Analytics, Azure Analysis Services
- Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics
-
Data Engineer
1 week ago
Circle Recruitment Leeds, United Kingdom**Data Engineer** · **From £ 400 - £ 500 p/d - inside IR35** · **Hybrid Newcastle/Leeds** · **6-month contract** · We are seeking a Data Engineer for our government client. The role location is hybrid, based between 2 days a week on-site and the remainder of the week working remo ...
-
Data Engineering
3 days ago
TransUnion Leeds, United KingdomTransUnion's Job Applicant Privacy Notice · **What We'll Bring**: · We Are TransUnion: · TransUnion is a major credit reference agency, and we offer specialist services in fraud, identity and risk management, automated decisioning and demographics. We support organisations across ...
-
Data Engineer
1 week ago
Harnham Leeds, United Kingdom**Data Engineer** · **Up to £120,000 per annum** · **WFH: fully remote** · We have a fantastic new opportunity for a data engineer at an exciting new and innovative fintech company · **The Company** · This is a remittance company that is currently going through an extraordinary p ...
-
Data Engineer
1 week ago
NonStop Consulting Ltd Leeds, United KingdomNonStop Consulting is looking to recruit a **Data Engineer** for a government department, with a mid term contract, 60-80% remote schedule and a competitive rate. · This is a fantastic opportunity for someone who is looking to join the public sector and gain reputable experience, ...
-
Data Engineer
1 week ago
NonStop Consulting Ltd Leeds, United KingdomNonStop Consulting is looking to recruit a Data Engineer for a government department, with a mid term contract, 60-80% remote schedule and a competitive rate. · This is a fantastic opportunity for someone who is looking to join the public sector and gain reputable experience, whi ...
-
Senior Data Engineer
3 days ago
Harnham - Data & Analytics Recruitment Leeds, United Kingdom**Senior Data Engineer** · **Remote - 1 day per month in London per month** · **Up to £80, 000** · **Permanent** · An opportunity for a Senior Data Engineer has opened up at a massive media company, who are looking to build out their APIs and query the datasets. · **The Company** ...
-
Senior Data Engineer
3 days ago
Harnham - Data & Analytics Recruitment Leeds, United Kingdom**Senior Data Engineer** · **Fully Remote** · **Up to £85, 000** · **Permanent** · A major telecommunications company is looking for a Data Engineer to join them and assist with their migration to AWS. · **The Company** · An exciting opportunity for a Senior Data Engineer, or an ...
-
Data Engineer Azure
1 week ago
NonStop Consulting Ltd Leeds, United KingdomNonStop Consulting is looking to recruit a professional Data Engineer for an esteemed Central Government department, available for hybrid work in either Leeds or Newcastle on an initial 6 months contract with potential extension to be confirmed. · This Public Sector client is loo ...
-
Lead Data Engineer
1 week ago
Harnham Leeds, United Kingdom**Lead Data Engineer** · **Up to £100,000 per annum** · **Location** - Fully remote · We have a fantastic opportunity for a Lead Data Engineer · **The Company** · The company is a growing group of committed colleagues, in financially responsible schools around the world, all of w ...
-
Master Data Engineer
1 week ago
Page Group Leeds, United KingdomTo maintain Engineering documentation for the Manufacturing Department. · Carry out projects within the Manufacturing Department to improve efficiency and reduce costs · **Client Details** · One of the world's leading engineering companies which helps customers to use electrical ...
-
Senior Data Cabling Engineer
4 days ago
KMH Group Leeds, United Kingdom Full timeSenior Data Cabling Engineer · Location: Covering the Leeds area · Salary: £25 - £35k basic, Negotiable, DOE + Overtime & Vehicle · Contract: Permanent, Full Time · The Benefits awarded to the successful Cabling Engineer: · • Competitive salary · • Company van & mobile phone for ...
-
Senior & Lead Data Engineers / / Tech
1 week ago
SR2 Leeds, United Kingdom"A company of the 22nd century" · While they're not working on flying cars just yet, that's a quote on Glassdoor from an employee who reckons that the work/life balance, the professional & personal growth, the emphasis on environment, social responsibility & community engagement, ...
-
AWS Data Engineer 3 month contract
5 days ago
Corecom Consulting Leeds, United Kingdom Full timeI'm working with an industry leading brand that are currently undertaking a large scale data transformation across the whole group. · You will be joining an fast paced Engineering team that need support from an analytical perspective. Your responsibilities will include extracting ...
-
Data Engineer- Fully Remote- Outside Ir35
1 week ago
Oscar Technology Leeds, United KingdomMy Client, a consultancy are looking for a Data Engineer to join them on an inital 6 month contract. · **Requirements**: · - Experience with SQL/NoSQL databases · - CI/CD · - AWS, Azure · - Worked within an agile environment · - Broad IT knowledge · Oscar Technology is acting as ...
-
Data Engineer
8 hours ago
Broster Buchanan Ltd Brierfield, United KingdomMy client is looking for an experienced Data Migration and Backend Engineer to join their growing business on a permanent, fully remote basis. The main purpose of the role is migrating customer data for new and existing clients from 3rd party systems ontotheir internal systems, a ...
-
Data Engineer
1 week ago
Fruition IT Resources Limited Leeds, United KingdomJob Description · Data Engineer · Leeds - on site 2x per week · up to £55,000 · Looking to join a dynamic team in the financial sector? Fruition IT are looking for an experienced Data Engineer to join a leading company specializing in financial solutions. · Working closely with ...
-
Data Engineer
5 days ago
Fruition IT Leeds, United KingdomData Engineer · Leeds - on site 2x per week · up to £55,000 · Looking to join a dynamic team in the financial sector? Fruition IT are looking for an experienced Data Engineer to join a leading company specializing in financial solutions. · Working closely with the Senior Data E ...
-
Data Engineer
5 days ago
The Cloud Recruitment Company Leeds, United KingdomData Engineer: · Full time permanent role · Fully remote working · Key Responsibilities: · • Design and construct dependable, resilient, and precise data pipelines in accordance with established best practices. · • Establish the necessary infrastructure to ensure efficient extra ...
-
Data Engineer
31 minutes ago
Moda in Pelle Leeds, United KingdomData Engineer · Full time - 40hrs a week · Head office based - Leeds · Salary- Competitive · Hybrid · Founded in 1975, Moda in Pelle has been crafting beautiful shoes for over 40 years. We take great pride in combining British sophistication with fine Italian quality and gor ...
-
Data Engineer
2 days ago
Careeraddict Leeds, United Kingdom2 days ago Be among the first 25 applicants · This range is provided by CareerAddict. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. · Base pay range · Data Engineer · Leeds - on site 2x per week · up to £55,000 · Lookin ...
Lead Data Engineer - Leeds, United Kingdom - HCLTech
Description
Job Description
Lead Data Engineer:
We need some strong Data engineer profiles... they need good experience with
Pyspark, Python, SQL, ADF and preferably Databricks experience
Job description:
What's required ?
Experience with Object-oriented/ object function scripting languages: Python preferred