- Your initial focus will be on modernising an existing key business solution, reverse engineering and rearchitecting for Azure.
- You will be involved in designing and implementing systems to effectively handle large volumes of data and integrate cleanly with other systems.
- You will take a pragmatic, well-structured approach to designing and developing solutions while keeping in mind the firm's Information Security standards, policies and procedures.
- You will be a member of the company's data engineering expert group which aims to keep abreast of the latest developments in Azure data tooling, promoting best practice and guidance to the wider business.
- We love learning at Hymans so you will have freedom and flexibility to look at new technology and bring your own stamp to what we are doing.
- Comfortable dealing with large volumes of data, generally time series and numeric data
- Established background in SQL database technologies
- Experience of or willing to learn the following technologies: Microsoft Fabric or its related technologies: Azure Databricks Azure Synapse Analytics Azure DW Azure SQL DB Azure Data Factory Azure Data Lake
- Experience of taking different business applications and use cases and supporting their needs (query patterns etc) within appropriate data solutions, whilst maintaining data integrity and provenance.
- Experience building robust, production ready, scalable data pipelines
- Familiarity with optimising strategies, pipeline architectures, data sets and ETL/ELT processes
- Confidence to engage constructively in a multi-disciplined team environment
- Experience or familiarity with some of the following: Accessing data from c# .net applications (e.g. using entity framework to apply schema-on-read to a data lake or similar). BI visualisation tools such as Power BI or similar Exposure to R, or Python Microsoft Power Apps Modelling and data science practices NoSQL technologies
- Understanding and experience of provisioning APIs for data consumption
- Familiarity with continuous integration, continuous delivery, agile methodologies and Azure DevOps
- Self-motivated with a drive to learn and share knowledge
- Focused on continuous learning and improvement
- An effective communicator and a great team player
- Able to forge strong and professional relationships at all levels
- Able to think expansively and seek new perspectives
Data Engineer - Edinburgh, United Kingdom - Hymans Robertson
Description
The Vacancy
This is your opportunity to play a key role within our Insights & Analytics practice focused on the delivery of platforms and processes that enable the effective use of data by the wider consulting business.
Our firm invests in the very latest technologies to facilitate the delivery of our ground-breaking business solutions. Our team are passionate about working at the cutting edge and you will have the chance to work with the most up to date Microsoft tools and technologies on Azure. You will be part of a team that employs an agile approach to software design and implementation.
The role sits within our Actuarial Public business unit which is the largest provider of consulting services for the Local Government Pensions Scheme. You will join the Actuarial Public Client Applications team – a multi-disciplinary team where you will be able to showcase your abilities in data engineering as we tackle our ambition of building a modern data platform. You will play an influential role and contribute to the company's wider data strategy.
About You
You will be comfortable working as part of a team, as well as having the initiative to explore solutions on your own. The position offers an excellent opportunity for a commercially experienced data engineer to work with the latest tools whilst also contributing to architectural and technical design decisions. You will also enjoy collaborating with software developers, modellers, core IT and the wider business to deliver high quality solutions.
In order to succeed in and enjoy this role, you will either be working with Azure tools already or have an established background in Microsoft SQL database technologies and be excited about transitioning these skills to the cloud.
Highly Desirable
Great to have
You will likely be
Passionate about technology including the Hymans chosen technology stack (Microsoft development stack, Azure Cloud computing, Data Science technologies)