- Create and maintain optimal data pipeline architecture to support data orchestration.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and ingestion of data from a wide variety of data sources using SQL, ETL and Azure Data Factory technologies.
- Support analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics.
- Work with stakeholders including the Executive, Product, Data and Technology teams to assist with data-related technical issues and support their data infrastructure needs.
- Create data tools for analytics and data scientist team members that assist them in executing and optimizing data projects.
- Work with data and analytics experts to strive for greater functionality in our data systems.
- Collaborating with colleagues for the purpose of collecting and structuring data.
- Communicate internally and with clients externally to collect and validate data as well as answer questions regarding data.
- Apply advanced knowledge and understanding of concepts, principals, and technical capabilities to manage a wide variety of projects.
- Recommends new practices, processes and procedures.
- Provides solutions that may set precedent or have significant impact.
- Build automation and additional efficiencies into manual efforts.
- At least five to seven years of data related or analytical work experience in a Data Engineer role, who has experience with data orchestration and pipeline creation in the Azure ecosystem.
- Experience building and optimizing 'big data' data pipelines, architectures and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Strong analytic skills related to working with unstructured datasets and blob storage.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- A successful history of manipulating, processing and extracting value from large disconnected datasets.
- Strong project management and organizational skills.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience supporting and working with cross-functional teams in a dynamic environment.
-
Lead Data Engineer
12 hours ago
Nigel Frank International Norwich, United KingdomSoftware Implementation Manager - Remote - up to £70,000 · I am looking for an experienced Implementation Manager to join a great Client of mine. who specialises in regulatory compliance, systems implementation and business process engineer. This is a global consultancy with clie ...
-
Data Cable Engineer
3 days ago
Romans Recruitment Group Norwich, United Kingdom Full time*** MULTIPLE DATA CABLE ENGINEERS REQUIRED IN NORWICH - IMMEDIATE START*** · We are looking for multiple ECS carded data cable engineers to start work on the 13/05/24 doing night shifts on the UKs leading departments store. · Experience of CAT 6 & Cat 6A are a must as having pr ...
-
Data Cabling Engineer
5 days ago
Romans Recruitment Group Ltd Norwich, Norfolk, United KingdomMULTIPLE DATA CABLE ENGINEERS REQUIRED IN NORWICH - IMMEDIATE START*** · We are looking for multiple ECS carded data cable engineers to start work on the 13/05/24 doing night shifts on the UKs leading departments store. · Experience of CAT 6 & Cat 6A are a must as having previous ...
-
Data Cable Engineer
5 days ago
Romans Recruitment Group Norwich, United Kingdom Full time*** MULTIPLE DATA CABLE ENGINEERS REQUIRED IN NORWICH - IMMEDIATE START*** · We are looking for multiple ECS carded data cable engineers to start work on the 13/05/24 doing night shifts on the UKs leading departments store. · Experience of CAT 6 & Cat 6A are a must as having pr ...
-
Data Cabling Engineer
5 days ago
iCobus Limited Norwich, Norfolk, United KingdomJob ID: 33917 · Job Title: Data Cabling Engineer · Location: Sites in London, Norfolk & Essex · Salary: £400 - £420 per day per TEAM / Lump Sum per site · Duration: 8-10 month contract The Role * iCobus are looking for Qualified, 2-man Structured Cabling Teams to work on a Nat ...
-
Senior Mechanical Engineer
5 days ago
Bennett and Game Recruitment LTD Norwich, United Kingdom Full timeSenior Mechanical Engineer required for our client based in Norwich. Our client specialises within the building services and construction industry. The Senior Mechanical Engineer will be within the Building Services department delivering projects in variety in sectors including s ...
-
Technical Safety Engineer
1 day ago
Risktec Solutions Ltd Norwich, United Kingdom Full timePosition Technical Safety Engineer · Term Ongoing Contract · Location Norwich – Office Based 5 Days a week · Company · This is a great opportunity for an enthusiastic individual to join our clients QSHE department. The successful candidate will be responsible for the development ...
-
Process Engineer
4 days ago
Science Solutions Recruitment Ltd Norfolk, United KingdomExcellent Opportunity - Process Engineer - #Norfolk · One of the leading Chemical Manufacturing companies in the UK are currently recruiting for a Process Engineer join their operations department. As a Process Engineer you will be developing new and existing production processes ...
-
Civil Design Engineer
9 hours ago
ALDWYCH CONSULTING LTD Norwich, United KingdomCivil Design Engineer · Norwich, Norfolk · Salary: £32,000 - £40,000 · Are you a Civil Design Engineer based in Norfolk? Do you want to work with high-profile clients on exciting development infrastructure projects? · We are seeking a Civil Design Engineer to join our client's ...
-
Processing Geophysicist
1 day ago
Spencer Ogden Norwich, United KingdomJob details · **Location** · Norwich · **Salary** · £35k - 45k per year · **Job Type** · Permanent · **Ref** · 248575 · **Posted** · 15 minutes ago · **Job Title: Geophysicist** · **Company: Leading Technical and Advisory Consultancy within the Energy Sector** · **Location: Norwi ...
-
Gas Engineer
17 hours ago
Network Plus Services Limited Norwich, United Kingdom Full timeGas Engineer · Our Role · As a Gas Engineer, using your technical expertise, you will deliver a first-class service to our customers with safety being paramount. You will work within a regional team of engineers and be part of a regular standby rota. It is essential you have a fu ...
-
Technical Author
3 days ago
Service Service Employment Agency Limited Norwich, United KingdomAn excellent opportunity has arisen for a Technical Author to join a niche market engineering business in Sprowston, Norwich. · The role involves providing a focal point to produce technical manuals and training material to support the operation and maintenance of the company's p ...
-
Lead Developer
1 week ago
Pure Resourcing Solutions Norwich, United KingdomWork for a market-leading and globally recognised business as the Lead Developer for their Norwich offices and be at the forefront of a 3-stage companywide deployment project. This business allows organisations to maximise the lifespan of technology productsthrough a suite of env ...
-
Multi-skilled Engineer Support
3 days ago
Hanto Recruitment Norwich, United KingdomWe are working with one of our regular manufacturing solutions clients who are looking for a Multi-Skilled Engineer to join them on an initial 3-month assignment to support a new contract. · **Responsibilities of a Multi-Skilled Engineer**: · - Provide effective change-over and b ...
-
Engineering Stores Clerk
12 hours ago
Berry Global Norwich, United Kingdom**Engineering Stores Clerk** · Working as part of a team you will be responsible for ensuring the day to day running of the Engineering Stores, maintaining control of parts inventory onto the JDE Data Base System, receiving goods inwards deliveries and unloading to the correct lo ...
-
Cost Controller
1 day ago
Todd Hayes Ltd Norwich, United Kingdom Full timeElectrical Design Engineer · Our prestigious, manufacturing client within the Marine and Luxury Yacht industry, are currently seeking an Electrical Design Engineer to join their team. · This is a full time, permanent position, based in Wroxham. · Focussed on the vessel electrical ...
-
Data Analytics Manager
1 week ago
Careers In Group Norwich, United Kingdom**Your new company** · A major player in the financial services market offer hybrid working 2 days a week in the office. This role an be based in Norwich or Bristol. · **Your new role** · You will work collaboratively as part of an increasingly diverse and inclusive international ...
-
Fibre Planning Coordinator
1 week ago
OCU Norwich, United KingdomDue to rapid growth within the business, we are currently recruiting for a Fibre Planning Coordinator to join our vibrant and dynamic team based in Norwich · At OCU Opals (part of the OCU Group of Companies), we design, build, manage and maintain vital communications infrastructu ...
-
Project Administrator
1 week ago
Proeon Systems Norwich, United Kingdom**The Vacancy** · **About Us** · **Key Responsibilities**: · Project Document Control - lead role in the control of all project incoming & outgoing documents (client / internal / suppliers), document status reporting and DMS recording. · - Cost To Completes (CTC) - preparation of ...
-
Project Coordinator
6 days ago
OCU Norwich, United KingdomDue to rapid growth within the business, we are currently recruiting for a Project Coordinator to join our vibrant and dynamic team · At OCU Opals (part of the OCU Group of Companies), we design, build, manage and maintain vital communications infrastructure for every-day use for ...
Senior Data Engineer - Norwich, United Kingdom - Baldwin Risk Partners
Description
Position Summary:
The Senior Data Engineer will be responsible for building and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced problem solver adept at designing repeatable patterns. Additionally, this person is an experienced data pipeline builder and data wrangler who enjoys data orchestration and optimizing data systems and building them from the ground up. The Data Engineer will support our business intelligence analysts, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of designing our company's data architecture to support our next generation of products and data initiatives. You will use various methods to transform raw data into useful data systems
Principal Responsibilities:
·Collect, audit, compile, and validate data from multiple sources.
Education, Experience, Skills and Abilities Requirements:
·Bachelor's degree in related field preferred, equivalent years' experience considered.
·Insurance industry experience preferred.
Special Working Conditions:
Fast paced, multi-tasking environment.
Important Notice:
This position description is intended to describe the level of work required of the person performing in the role and is not a contract. The essential responsibilities are outlined; other duties may be assigned as needs arise or as required to support the organization. All requirements may be modified to reasonably accommodate physically or mentally challenged colleagues.
#LI-REMOTE
#LI-BM1
Click for some insight into our culture
Senior Data Engineer professionals in Norwich
-
Deborah Taylor
Lectures in Cyber Security
-
veenashree kottur
I have more than 7 years of experience in IT healthcare · worked as a hl7 integration engineer and ...
-
Stephen Pascoe
Engineering Manager
-
Adela Matin
Recruitment and HR