Data Engineer - London, United Kingdom - Russell Tobin

Description

Job Description

Data Engineer – London – 6 months contract - £400 per day Umbrella

You'll work with the one of the solution team in the biggest functional practice in the firm, focusing on client operations improvement. Our clint fosters innovation driven by analytics, design thinking, by developing new products/services and integrating them into our client work. It is helping to shift our model toward asset-based consulting and is a foundation for –and expands our investment in –our entrepreneurial culture.

You will join our community of people with business and technical background, supporting multiple of our digital assets. You will closely interact with colleagues representing, product management, information security, cloud infrastructure and solution management paths.

You will support product development activities in our solutions within Operations practice. You'll be involved from creating proof of concepts, to building production ready solutions aligned with our Firm IT ecosystem and its standards. Core of your responsibilities will be in building data pipelines to fuel our advanced analytics models. In these efforts you'll leverage cloud native services (e.g., Azure, AWS), our Firm frameworks (e.g., Kedro), and variety of industry standard tools.

Responsibilities:

• Collaborate with stakeholders and product managers to build and recommend appropriate data requirements.
• Data transformation: Identify data sources and build advanced code to extract, transform and load different sources of data using query languages, programming languages and tools to create the necessary processes to generate the required data products.
• Data management: Collaborate with the team to find opportunities to optimize data tools and platforms (e.g. Azure, AWS) or proprietary tools.
• Data Ops: Manage the life cycle of products developed to ensure the integrity and continuity of developed processes through CI/CD.
• Data visualization: Create and manage dashboards.

Qualifications:

• Bachelor's degree in computer science or equivalent area
• 4+ years of experience in IT, data engineering roles or cloud engineering oriented to data.
• Knowledgeable in application development process and in principles to organize, orchestrate and deploy projects into the cloud environment and related tools (GitHub, JFrog, Docker)
• Knowledge of data ops processes (GitHub actions, GitLab, etc). Managing the continuous deployment and integration of ETLs and processes created, to ensure the quality of the life cycle of products.
• Strong knowledge of python for data engineering. Focus on frameworks for data manipulation processes, APIs, QA libraries, cloud integration libraries and automation.
• Strong knowledge of databases (cloud managed), both analytical and OLTP. Capable of building complex queries and designing database schemas to solve application requirements.
• Knowledge of data-oriented cloud services in AWS or Azure. Understanding of hosting APIs to receive data, deploying ETLs using cloud native tools (Power BI, Data Factory, Azure SQL, Synapse, Glue, Lambda, etc.), hosting docker images and implementing frameworks to integrate different services into ETLs (Secrets Manager, Lambda, Event Bridge, ECR, etc.)
• Strong knowledge of data visualization tools (Power BI, Tableau, Qlick, etc.). Capable of building complex dashboards to allow users to easily interact with the data.
• Familiarity with Terraform would be a great plus.
• Passion in learning technologies balanced with pragmatic approaches to implementations.
• Strong command of English language (both verbal and written)

Education:

• Bachelor's degree in quantitative field like Computer Science, Engineering, Statistics, Mathematics or related field required. Advanced degree is a strong plus