Data Engineer - London, United Kingdom - eFinancialCareers
Description
Join us as a Data Engineer- This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences
- You'll be simplifying the bank through developing innovative data driven solutions, inspiring to be commercially successful through insight, and keeping our customers and the bank safe and secure
- Participating actively in the data engineering community, you'll deliver opportunities to support our strategic direction while building your network across the bank
- We're recruiting for multiple roles across a range to levels, up to and including experienced managers
What you'll do
We'll look to you to drive value for the customer through modelling, sourcing and data transformation.
You'll be working closely with core technology and architecture teams to deliver strategic data solutions, while driving Agile and DevOps adoption in thedelivery of data engineering.
We'll also expect you to be:
- Delivering the automation of data engineering pipelines through the removal of manual stages
- Developing comprehensive knowledge of the bank's data structures and metrics, advocating change where needed for product development
- Educating and embedding new data techniques into the business through role modelling, training and experiment design oversight
- Delivering data engineering strategies to build a scalable data architecture and customer feature rich dataset for data scientists
- Developing solutions for streaming data ingestion and transformations in line with streaming strategy
The skills you'll need
To be successful in this role, you'll need to be a programmer and Data Engineer with a qualification in Computer Science or Software Engineering.
You'll also need a strong understanding of data usage and dependencies with wider teams and the end customer, aswell as a proven track record in extracting value and features from large scale data.
You'll need knowledge of programming languages in data engineering such as Python or PySpark, SQL, Java, and Scala.And you'll have an understanding of Apache Spark and ETL tools like Informatica PowerCenter, Informatica BDM or DEI, Stream Sets and Apache Airflow.
You'll also demonstrate:
- Knowledge of messaging, event or streaming technology such as Apache Kafka, and of big data platforms such as Snowflake, AWS Redshift, Postgres, MongoDB, Neo4J and Hadoop
- Good knowledge of cloud technologies such as Amazon Web Services, Google Cloud Platform and Microsoft Azure
- Experience of ETL technical design, automated data quality testing, QA and documentation, data warehousing, data modelling and data wrangling
- Extensive experience using RDMS and ETL pipelines
- A good understanding of modern code development practices
- Good critical thinking and proven problem solving abilities
More jobs from eFinancialCareers
-
Sales Support Executive
Edinburgh, United Kingdom - 4 days ago
-
Credit Financing
London, United Kingdom - 1 week ago
-
Client Operations Specialist, Senior Associate
London, United Kingdom - 1 week ago
-
Modelled Market Risk Manager
Glasgow, United Kingdom - 1 week ago
-
Principal, Product Management
London, United Kingdom - 14 hours ago
-
Director, Business Unit Corporate Accounting
London, United Kingdom - 1 week ago