- Your initial focus will be on modernising an existing key business solution, reverse engineering and re-architecting for Azure.
- You will lead the design and implementation of solutions to effectively handle large volumes of data and integrate cleanly with other systems.
- You will take a pragmatic, well-structured approach to designing and developing solutions while keeping in mind the firm's Information Security standards, policies and procedures.
- You will be a member of the company's data engineering expert group which aims to keep abreast of the latest developments in Azure data tooling, promoting best practice and guidance to the wider business.
- We love learning at Hymans so you will have freedom and flexibility to look at new technology and bring your own stamp to what we are doing.
- Comfortable dealing with large volumes of data, generally time series and numeric data
- Understanding and experience of provisioning APIs for data consumption
- Accessing data from C# .NET applications (e.g. using entity framework to apply schema-on-read to a data lake or similar)
- Azure Databricks
- Azure Synapse Analytics
- Azure SQL DB
- Azure Data Factory
- Azure Data Lake
- Microsoft Fabric or its related technologies
- Experience of taking different business applications and use cases and supporting their needs (query patterns etc) within appropriate data solutions, whilst maintaining data integrity and provenance.
- Hands-on experience building robust, production ready, scalable data pipelines
- Familiarity with continuous integration, continuous delivery, agile methodologies and Azure DevOps
- Familiarity with optimising strategies, pipeline architectures, data sets and ETL/ELT processes
- Confidence to engage constructively in a multi-disciplined team environment
- Established background in SQL database technologies
- BI visualisation tools such as Power BI or similar
- Microsoft Power Apps
- Modelling and data science practices
- NoSQL technologies
- Passionate about technology including the Hymans chosen technology stack (Microsoft development stack, Azure Cloud computing, Data Science technologies)
- Self-motivated with a drive to learn and share knowledge
- Focused on continuous learning and improvement
- An effective communicator and a great team player
- Able to forge strong and professional relationships at all levels
- Able to think expansively and seek new perspectives
Data Engineer - Edinburgh, United Kingdom - Hymans Robertson LLP
Description
This is your opportunity to play a key role within our Insights & Analytics practice; focused on the delivery of platforms and processes that enable the effective use of data by the wider consulting business.
Our firm invests in the very latest technologies to facilitate the delivery of our ground-breaking business solutions. Our team are passionate about working at the cutting edge and you will have the chance to work with the most up to date Microsoft tools and technologies on Azure. You will be part of a team that employs an agile approach to software design and implementation.
The role sits within our Actuarial Public business unit which is the UK'S largest provider of consulting services for the Local Government Pensions Scheme. You will join the Actuarial Public Client Applications team – a multi-disciplinary team where you will be able to showcase your abilities in data engineering as we tackle our ambition of building a modern data platform. You will play an influential role and contribute to the company's wider data strategy.
About You
You will be comfortable working as part of a team, as well as having the initiative to explore solutions on your own. The position offers an excellent opportunity for a commercially experienced data engineer or software engineer with a passion for data solutions. You will work with the latest tools, leading and driving architectural and technical design decisions. You will be comfortable collaborating closely with software developers, modellers, core IT and the wider business to deliver high quality solutions.
In order to succeed in and enjoy this role, you will already be working with Azure tools and have an established background in Microsoft SQL database technologies. You will also have significant coding experience which may be in Python, R, C# or similar.
Required
Hands-on commercial experience of two or more of the following:
Great to have
Experience or familiarity with some of the following:
You will likely be