- Lead theplanning design and execution of data migration projects from BigData platforms to Azure Data Factory.
- Collaborate with stakeholders to understand datamigration requirements and develop migration strategies andplans.
- Assess source data systems and identifydata migration requirements challenges andopportunities.
- Design and implement scalableand efficient data migration pipelines using Azure DataFactory.
- Ensure data quality and integritythroughout the migration process by implementing data validationand reconciliation mechanisms.
- Optimize datamigration processes for performance reliability andscalability.
- Work closely with crossfunctionalteams to integrate migrated data into Azurebased data solutions andapplications.
- Provide technical guidance andsupport to junior team members and stakeholders throughout themigration process.
- Bachelors degree in Computer Science Engineering orrelated field.
- Proven experience as a DataEngineer with a focus on data migration from Big Data platforms toAzure cloud environments.
- Strong proficiencyin Azure Data Factory (ADF) and other Azure cloudservices.
- Indepth understanding of datamigration strategies methodologies and best practices.
- Experience with Big Data technologies such as HadoopSpark or Kafka.
- Proficiency in SQL Python orother programming languages.
- Excellentanalytical and problemsolving skills.
- Strongcommunication and interpersonal skills.
- Ability to work independently and collaboratively in afastpaced environment.
- Microsoft Azure certifications (e.g. AzureData Engineer Associate Azure Solutions ArchitectExpert).
- Experience with other Azure servicessuch as Azure SQL Database Azure Synapse Analytics or AzureHDInsight.
- Knowledge of data governancecompliance and security principles.
- Familiarity with DevOps practices and tools for CI/CDpipelines.
- Experience with Agilemethodologies.
-
Data Engineer
3 weeks ago
Nigel Frank International Finland, United Kingdom**Role & Responsibilities** · Real time streaming analytics is going to be so crucial in collecting data from multiple sources e.g wind turbines, solar panels, thermal energy from the ocean, nuclear reactors. This is the key towards the company being carbon neutral - this hire wi ...
-
Data Engineer
2 weeks ago
GerrardWhite Peterborough, United Kingdom**Data Engineer** · **Hybrid Flexible Working, 1 day per week in Peterborough, rest from home** · We are currently looking for a Data Engineer to join a large insurance group within the Data Solutions Team. · The team provide value by harvesting the organisation's data, transform ...
-
Data Engineer
3 weeks ago
BJSS Lincoln, United Kingdom**About Us** We're an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we've been finding better, more sustainable ways to solve complex technology problems for some of the world's leading organisations and delivered solutionsthat million ...
-
Data Engineer
3 weeks ago
GerrardWhite Peterborough, United KingdomData Engineer · Hybrid role Office in Peterborough · Salary up to £55.000 dependant on experience · **What you can expect to be working on**: · - Within the first 6 months you will be on rotation around the team completing commercial developments, undertaking DBA tasks, and helpi ...
-
Data Engineer
1 week ago
BJSS Lincoln, United Kingdom**About Us** · We're an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we've been finding better, more sustainable ways to solve complex technology problems for some of the world's leading organisations and delivered solutionsthat milli ...
-
Data Engineer
3 weeks ago
GerrardWhite Peterborough, United KingdomData Engineer · Hybrid role Office in Peterborough 3/2 Split · Salary up to £55.000 dependant on experience · **Key Accountabilities and Responsibilities**: · - Work within an agile team to deliver robust solutions that meet the functional and technical requirements of the custom ...
-
Data Engineer
2 days ago
Jump IT Recruitment Peterborough, United KingdomClient based in Peterborough is looking for a Data Engineer to join there current team. · If you have the following skillset please get in touch: · - Intermediate experience of ETL principles · - Experience of relational database design principles · - Great written and oral commu ...
-
Lead Data Engineer
2 weeks ago
Anson McCade Ltd - IT and Finance Recruitment Netherlands, United KingdomMy Client, one of the most successful & exclusive consulting firms in the world, are looking to acquire a Lead Data Engineer. · **What you will do as a Lead Data Engineer**: · As a forward-deployed Lead Data Engineer, you'll be part of the Client's rapidly growing engineering tea ...
-
Nigel Frank International Finland, United Kingdom**Open Application** · Though the year is coming to a close and a lot of us are on shut down right now, there is no better time to set yourself up for a successful 2023 · Many of our clients are constantly on the lookout for the best and brightest professionals such as yourself t ...
-
Enterprise Data Engineer
1 week ago
Anglian Water Services Ltd Lincoln, United Kingdom£43k - £50k, salary dependant on skills and experience · Base location in either Lincoln or Huntingdon (depending on your location) and home working (expectation is 2 days in the office) · Permanent · Full time, 37 hours per week · Do you have prior experience of Data Engineering ...
-
Azure Data Engineer's
2 weeks ago
Nigel Frank International Finland, United Kingdom**Azure Data Engineer's & Azure Data Architect's - Helsinki region - Permanent job** · I am working with a fast growing company currently around 60 big but looking to expand by 90 in the next 5 years based in the heart of Helsinki The company focuses solely on Azure Data warehous ...
-
Data Architect, Data Engineers, BI Consultants
2 weeks ago
Nigel Frank International Finland, United Kingdom**Open Application** · There is no better time to set yourself up for a successful 2023 · Many of our clients are constantly on the lookout for the best and brightest professionals such as yourself to join their growing teams across Finland and we want to share those opportunitie ...
-
Enterprise Data Engineer
3 days ago
Anglian Water Lincoln, United Kingdom**£40k - £45k, salary dependant on skills and experience** · **Base location in either Lincoln or Huntingdon (depending on your location) and home working (expectation is 2 days in the office)** · **Permanent** · **Full time, 37 hours per week** · **Do you have prior experience o ...
-
Data Warehouse Engineer
6 days ago
Altum Consulting Lincoln, United KingdomAltum are working alongside an NHS Trust based in Lincolnshire on the search for a Data Warehouse Engineer to join the Finance and Business Intelligence department. This role will report to the Principal Analyst Developer and be a part of the team that isresponsible for providing ...
-
Senior Snowflake Data Engineer
3 weeks ago
Nigel Frank International Finland, United KingdomIn this role you will participate in the design, development and maintenance of cloud-based data platforms, data pipelines and interface services. You will work in customer teams that build world class business-oriented data and analytics solutions for customers.The role will be ...
-
Senior Manager Data Engineering
1 week ago
Sumeru Solutions Boston, United KingdomJob Title: Manager DataEngineering · Location Onsite inBoston..If Remote then 2 days in Boston each week ( at least forinitial 2 months and then it can be 2 days every 2 weeks) · JD Ability to analyze and organizeraw data. Transform large complex sets of data to meetnonfunctional ...
-
Data Cabling Engineer with Ipaf 3a
1 week ago
DCS Recruitment Lincoln, United KingdomDCS Recruitment currently seek an established data cabling engineer in **Lincoln**on behalf of a national client. · Vacancies: 1 · 1 night shift - Monday 27th February 2023. · Duration: Ad hoc requirement · Working up to an 8-hour night shift. 5pm start. · Location: LN5 postcode ...
-
EC&I Technician
2 weeks ago
Mac Recruit Group Boston, United Kingdom Full timeMac Recruitment Group are delighted to represent our client, a UK wide leader in the energy from waste and renewable sector. An EC&I Technician is required to join the Boston, Lincolnshire plant on a full time and permanent basis. · As the EC&I Technician, you will be responsibl ...
-
Contract Administrator
2 weeks ago
Aaron Services Boston, United Kingdom**Aaron Services, part of The Sureserve Group are a market leading heating and hot water specialist with 35 years of successful delivery and a growing client base, we are on the lookout for a contract administrator to join our team in our Boston Office.** · **Benefits**: · - Shar ...
-
Maintenance Engineering Planner
1 week ago
Metsä Group Boston, United KingdomMetsä Wood · Metsä Wood is one of Europe's leading manufacturers of engineered wood products. We refine renewable Nordic wood into sustainable and high quality wood products. Our main products are Kerto LVL, birch and spruce plywood and further processed sawn timber. Material-eff ...
Azure Data Engineer - Boston, United Kingdom - Princeton IT Services
1 week ago
Description
Job Title: Azure DataEngineer
Location: BostonMA
Role Type:Contract
RoleOverview:
We are seeking a highlyskilled Azure Data Engineer with expertise in data migration fromBig Data platforms to Azure Data Factory (ADF) to join our team.The ideal candidate will have a strong background in designing andexecuting complex data migration projects with a focus onleveraging Azure cloud technologies. As an Azure Data Engineer youwill play a key role in migrating data from various Big Dataplatforms to Azure Data Factory while ensuring data integritysecurity and performance.
KeyResponsibilities:
Requirements:
Preferred Qualifications:
