- Building new data pipelines and optimizing data flows using the Azure cloud stack.
- Building data products from scratch.
- Support Business Analysts and Data Architects with discovery and best practices.
- Self-directed and comfortable supporting the data needs of multiple teams, systems and products.
- Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure.
- Experience building and optimizing 'big data' data pipelines, architectures and data sets using Py-spark.
- Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Cloud Big Data Analytics in Azure Synapse Analytics, Azure Analysis Services
- Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics
-
Data Engineer
1 week ago
Harnham Leeds, United Kingdom**Data Engineer** · **Up to £120,000 per annum** · **WFH: fully remote** · We have a fantastic new opportunity for a data engineer at an exciting new and innovative fintech company · **The Company** · This is a remittance company that is currently going through an extraordinary p ...
-
Data Engineer
5 days ago
Circle Recruitment Leeds, United Kingdom**Data Engineer** · **From £ 400 - £ 500 p/d - inside IR35** · **Hybrid Newcastle/Leeds** · **6-month contract** · We are seeking a Data Engineer for our government client. The role location is hybrid, based between 2 days a week on-site and the remainder of the week working remo ...
-
Data Engineer
5 days ago
NonStop Consulting Ltd Leeds, United KingdomNonStop Consulting is looking to recruit a **Data Engineer** for a government department, with a mid term contract, 60-80% remote schedule and a competitive rate. · This is a fantastic opportunity for someone who is looking to join the public sector and gain reputable experience, ...
-
Data Engineer
5 days ago
NonStop Consulting Ltd Leeds, United KingdomNonStop Consulting is looking to recruit a Data Engineer for a government department, with a mid term contract, 60-80% remote schedule and a competitive rate. · This is a fantastic opportunity for someone who is looking to join the public sector and gain reputable experience, whi ...
-
Master Data Engineer
4 days ago
Page Group Leeds, United KingdomTo maintain Engineering documentation for the Manufacturing Department. · Carry out projects within the Manufacturing Department to improve efficiency and reduce costs · **Client Details** · One of the world's leading engineering companies which helps customers to use electrical ...
-
Lead Data Engineer
4 days ago
Harnham Leeds, United Kingdom**Lead Data Engineer** · **Up to £100,000 per annum** · **Location** - Fully remote · We have a fantastic opportunity for a Lead Data Engineer · **The Company** · The company is a growing group of committed colleagues, in financially responsible schools around the world, all of w ...
-
Data Engineer Azure
1 week ago
NonStop Consulting Ltd Leeds, United KingdomNonStop Consulting is looking to recruit a professional Data Engineer for an esteemed Central Government department, available for hybrid work in either Leeds or Newcastle on an initial 6 months contract with potential extension to be confirmed. · This Public Sector client is loo ...
-
Senior Data Cabling Engineer
19 hours ago
KMH Group Leeds, United Kingdom Full timeSenior Data Cabling Engineer · Location: Covering the Leeds area · Salary: £25 - £35k basic, Negotiable, DOE + Overtime & Vehicle · Contract: Permanent, Full Time · The Benefits awarded to the successful Cabling Engineer: · • Competitive salary · • Company van & mobile phone for ...
-
Senior & Lead Data Engineers / / Tech
1 week ago
SR2 Leeds, United Kingdom"A company of the 22nd century" · While they're not working on flying cars just yet, that's a quote on Glassdoor from an employee who reckons that the work/life balance, the professional & personal growth, the emphasis on environment, social responsibility & community engagement, ...
-
AWS Data Engineer 3 month contract
1 day ago
Corecom Consulting Leeds, United Kingdom Full timeI'm working with an industry leading brand that are currently undertaking a large scale data transformation across the whole group. · You will be joining an fast paced Engineering team that need support from an analytical perspective. Your responsibilities will include extracting ...
-
Data Engineer- Fully Remote- Outside Ir35
1 week ago
Oscar Technology Leeds, United KingdomMy Client, a consultancy are looking for a Data Engineer to join them on an inital 6 month contract. · **Requirements**: · - Experience with SQL/NoSQL databases · - CI/CD · - AWS, Azure · - Worked within an agile environment · - Broad IT knowledge · Oscar Technology is acting as ...
-
Data Engineer
3 days ago
Fruition IT Resources Limited Leeds, United KingdomJob Description · Data Engineer · Leeds - on site 2x per week · up to £55,000 · Looking to join a dynamic team in the financial sector? Fruition IT are looking for an experienced Data Engineer to join a leading company specializing in financial solutions. · Working closely with ...
-
Data Engineer
2 days ago
Fruition IT Leeds, United KingdomData Engineer · Leeds - on site 2x per week · up to £55,000 · Looking to join a dynamic team in the financial sector? Fruition IT are looking for an experienced Data Engineer to join a leading company specializing in financial solutions. · Working closely with the Senior Data E ...
-
Data Engineer
2 days ago
The Cloud Recruitment Company Leeds, United KingdomData Engineer: · Full time permanent role · Fully remote working · Key Responsibilities: · • Design and construct dependable, resilient, and precise data pipelines in accordance with established best practices. · • Establish the necessary infrastructure to ensure efficient extra ...
-
Data Engineer
1 week ago
Asda Stores Ltd Leeds, United Kingdom Full timeJob Title · Data Engineer · Location · Asda House · Employment Type · Full time · Contract Type · Permanent Graduate (Fixed Term) · Hours per Week · 37.5 · Salary · Competitive salary · Category · Data Science · Closing Date · 26 May 2024 Are you ...
-
Apply Recruitment Leeds, United KingdomRR100) Head of Data Engineering & Automation · Head of Data Engineering – Hybrid – Permanent – 95 to 105k plus bonus, car & bens. · The client is looking for an Engineering Leader for their Data & Automation work. You will be creating data strategy and building a new scalable d ...
-
Azure Data Engineer
14 hours ago
Nigel Frank International York, United KingdomI'm looking for Azure Data Engineers to join a rapidly growing Consultancy as they look to grow their Data offering - the role can be fully remote across the UK, although they do have an office in London and some occasional travel to client site may be required. · This is an incr ...
-
Senior Data Engineer
3 days ago
ON Data Staffing Leeds, United KingdomOur client, a boutique Data & AI Consultancy in London is actively seeking multiple Senior Data Engineer Consultants to play a pivotal role in delivering innovative Databricks technical solutions to their end clients. · This client-facing role requires a unique blend of technical ...
-
Lead Data Engineer
4 days ago
HCLTech Leeds, United KingdomJob Description · Lead Data Engineer: · We need some strong Data engineer profiles... they need good experience with · Pyspark, Python, SQL, ADF and preferably Databricks experience · Job description: · Building new data pipelines and optimizing data flows using the Azure cloud s ...
-
Lead Engineer/Data Engineer
1 day ago
HCLTech Leeds, United KingdomLead Data Engineer:We need some strong Data engineer profiles... they need good experience withPyspark, Python, SQL, ADF and preferably Databricks experience Job description:Building new data pipelines and optimizing data flows using the Azure cloud stack.Building data products f ...
Lead Data Engineer - Leeds, United Kingdom - HCLTech
Description
Lead Data Engineer:
We need some strong Data engineer profiles... they need good experience with
Pyspark, Python, SQL, ADF and preferably Databricks experience
Job description:
What's required ?
Experience with Object-oriented/ object function scripting languages: Python preferred