- Analyse existing data pipelines and identify areas for improvement, optimisation, and scalability.
- Work closely with Bioinformaticians and annotators to integrate data pipelines with existing systems and applications.
- Monitor data pipeline performance, troubleshoot issues, and implement solutions to ensure reliability and efficiency.
- Stay current with industry trends and best practices in data engineering and recommend new technologies or tools to enhance data infrastructure.
- Document data pipelines, processes, and workflows for internal reference and knowledge sharing.
- Contract duration: 1 year 8 months (estimated 01/07/2024-31/01/2026).
- Grading: Grade 5 or 6 depending on qualification and experience (monthly salary starting at £3,090 or £3,456 after tax) + benefits
- Reference number: EBI02234
- MSc in computer science, IT or a related field, or in bioinformatics with a demonstrated IT expertise
- Expert in Data Modelling and Advanced SQL
- Proficiency in Python programming
- Proficiency in ETL (Extract, Transform, Load) processes and tools for large-scale data processing.
- Strong understanding of relational databases (Oracle, PostgreSQL) and experience optimising database performance.
- Proficiency in data warehousing (Redshift, BigQuery)
- Strong communication and collaboration skills, with the ability to work effectively in a team environment.
- Proficiency in oral and written English
- PhD in computer science, IT or a related field, or in bioinformatics with a demonstrated IT expertise
- Experience in big data technologies and frameworks, such as Apache Spark, Hadoop or similar platforms
- Hands-on experience with CI/CD (GitLab CI/GitHub Actions)
- Familiarity with Java
- Familiarity with Google Cloud Platform or AWS
- Familiarity with data modelling techniques for AI (Artificial Intelligence) and ML (Machine Learning) applications
- Familiarity with Neo4J or other graph databases is an added advantage
- Familiarity with data visualisation (Tableau, PowerBI)
- Knowledge of, or affinity with, structural biology and bioinformatics
- Experience working in international teams
-
Senior Data Scientist
Found in: Talent UK C2 - 4 days ago
Lifelancer Hinxton, United Kingdom Full timeYou will be responsible for: · Independently manage and lead machine learning research projects and write outcomes in a scientific publication for submission to journals or machine learning conferences (ICLR, ICML, CVPR, etc). · Collaborate with team members, propose, develop, an ...
-
ELIXIR Science Officer
Found in: Talent UK C2 - 19 hours ago
Embl-Ebi Hinxton, United KingdomYour role · Reporting to ELIXIR's Chief Technical Officer, you will play an active role in teams led by the ELIXIR Coordinators, and work closely with other members of the ELIXIR Hub and ELIXIR Nodes. · Your key responsibilities will be: · Delivering technical contributions to t ...
-
Senior Data Scientist
Found in: Talent UK C2 - 5 days ago
Wellcome Sanger Institute Hinxton, United Kingdom Full timeDo you want to help us improve human health and understand life on Earth? Make your mark by shaping the future to enable or deliver life-changing science to solve some of humanity's greatest challenges. · Senior Research Data Scientist · We seek a Senior Research Data Scientist w ...
-
Senior Data Scientist
Found in: Talent UK C2 - 5 days ago
Wellcome Sanger Institute Hinxton, United Kingdom Full timeDo you want to help us improve human health and understand life on Earth? Make your mark by shaping the future to enable or deliver life-changing science to solve some of humanity's greatest challenges. · Senior Research Data Scientist · We seek a Senior Research Data Scientist w ...
-
Tech Talent Scheme
Found in: Talent UK C2 - 1 day ago
Wellcome Sanger Institute Hinxton, United Kingdom Full timeDo you want to help us improve human health and understand life on Earth? Make your mark by shaping the future to enable or deliver life-changing science to solve some of humanity's greatest challenges. · Join our exciting Technology Talent Scheme at the Wellcome Sanger Institute ...
Data Engineer - Hinxton, United Kingdom - Embl-Ebi
Description
Your role
We seek a skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in optimising and enhancing our data pipelines, ensuring efficient data processing, storage and retrieval. You will work closely with cross-functional teams to analyse requirements, propose new data pipeline architectures, and implement solutions to improve performance and scalability.
The tasks for this post include the following:
The successful candidate will report directly to the PDBe Technical Project Lead as a Technical Officer. This post is an opportunity for the right person to bring IT skills and innovative ideas to help sustain the growing amount of structural biology data in the PDB and ensure that PDBe, PDBe-KB and AFDB services remain sustainable.
Closing date: 12 May 2024
Related
You have
You might also have