- Design, build and test data products and services using standard techniques and tools.
- Deliver data solutions which are scalable, resilient and future proof.
- Understand typical problems in databases, data processes, data products and services. You understand and can apply typical solutions to those problems.
- Undertake data profiling and source system analysis including techniques like reverse engineering.
- Design, code, test and document, pipelines, Web APIs, services or scripts.
- Work in an Agile and cross-functional team
- Agile methodologies. Experience in working in agile methodologies on data projects.
- Data development process. You can design, build and test data products based on feeds from multiple systems using a range of different storage technologies and/or access methods. You know how to create repeatable and reusable products.
- Data modelling. You understand the concepts and principles of data modelling and can produce, maintain and update relevant data models for specific business needs. You know how to reverse-engineer data models from a live system.
- Problem resolution (data). You know about the types of problems in databases, data processes, data products and services.
- Programming and build (data engineering). You can design, code, test, correct and document simple programs or scripts using Python and SQL. You can use source control to manage your code.
- Technical understanding (data engineering). You understand core technical concepts like data normalisation, modelling, performance of data intensive solutions. You understand basic software development concepts.
- Communication skills (data). You know about the need to translate technical concepts into non-technical language and understand what communication is required for internal and external stakeholders.
- Data analysis and synthesis. You know how to undertake data profiling and source system analysis and can present clear insights to colleagues to support the end use of the data.
- Testing. You can execute test scripts under supervision. You understand the role of testing and how it works.
- Learning and development tailored to your role
- An environment with flexible working options
- A culture encouraging inclusion and diversity
- A with an average employer contribution of 27%
Data Engineer - Salford, United Kingdom - UK Civil Service
Description
Job summary
About the organisation
The recently created Department for Business and Trade is at the heart of the UK�s relationship with the global economy. We have��but in essence, we are the department for economic growth. We support businesses to invest, grow and export, creating jobs and opportunities across the , innovation, and data-centric decision making underpin the work of the department and in particular the way that digital services to support the businesses and the economy are delivered. Professionals like you will enable the department to continue to deliver at pace and achieve the ambitious departmental goals.�
This role is available in seven UK locations and can only be worked from within the UK, not overseas. If your office location is London, you will be eligible to receive London weighting. DBT employees work in a hybrid pattern, spending 2-3 days a week (pro rata) in the office on average. Changes to these working arrangements are available in certain circumstances but must be agreed with the vacancy manager and in line with the requirements of the role and can only be discussed with successful candidates. Travel to your primary office location will not be paid for by DBT, but costs for travel to an office which is not your main location will be covered.�Find out about life at DBT, our benefits and meet the team by watching our recruitment��visiting our��or reading�
Job description
About the team
To enable the work of the department you will join our� team of over 400 colleagues working across the full spectrum of the DDaT specialisms, in a modern, user-centric, agile will join the team that build and operate innovative tools and services such as �that support businesses in the UK and overseas. Our public-facing services are visited millions of times each year and the tools we develop for our staff, across the globe, help them be more efficient in their daily working is possible due to the state-of-the-art data infrastructure our teams build and maintain. We work on critical national infrastructure that powers trade at the UK border and innovative data projects looking at global supply chains and future ways of believe in creativity, curiosity, diversity of thought, entrepreneurship, delivery focus and collaboration. We embody the DBT values to be expert, enterprising, engaged and inclusive. These values have helped us become a high performing team that continuously delivers high quality outputs.
About the role
As a�r you will help us design, implement, test and operate our data products, pipelines and services. You will work in a cross-functional, agile, team to integrate them into wider systems and business you will have opportunities to contribute to the wider solution to satisfy our user needs, the team will rely on your hands-on expertise in querying and transforming data, automating common tasks, building efficient data pipelines and creating services that expose the data through do this, you will work with multiple raw data formats like csv, json, xml, parquet, use languages like SQL and Python in multiple cloud-based solutions.�
The role follows the DDaT framework:�
As a Data Engineer, you will
Person specification
You will need to have demonstrable skills and experience of:
�Desirable Skills and Experience�
These are not necessary but would be ideal if you:
Benefits