- Analyse existing data pipelines and identify areas for improvement, optimisation, and scalability.
- Work closely with Bioinformaticians and annotators to integrate data pipelines with existing systems and applications.
- Monitor data pipeline performance, troubleshoot issues, and implement solutions to ensure reliability and efficiency.
- Stay current with industry trends and best practices in data engineering and recommend new technologies or tools to enhance data infrastructure.
- Document data pipelines, processes, and workflows for internal reference and knowledge sharing.
- Contract duration: 1 year 8 months (estimated 01/07/2024-31/01/2026).
- Grading: Grade 5 or 6 depending on qualification and experience (monthly salary starting at £3,090 or £3,456 after tax) + benefits
- Reference number: EBI02234
- MSc in computer science, IT or a related field, or in bioinformatics with a demonstrated IT expertise
- Expert in Data Modelling and Advanced SQL
- Proficiency in Python programming
- Proficiency in ETL (Extract, Transform, Load) processes and tools for large-scale data processing.
- Strong understanding of relational databases (Oracle, PostgreSQL) and experience optimising database performance.
- Proficiency in data warehousing (Redshift, BigQuery)
- Strong communication and collaboration skills, with the ability to work effectively in a team environment.
- Proficiency in oral and written English
- PhD in computer science, IT or a related field, or in bioinformatics with a demonstrated IT expertise
- Experience in big data technologies and frameworks, such as Apache Spark, Hadoop or similar platforms
- Hands-on experience with CI/CD (GitLab CI/GitHub Actions)
- Familiarity with Java
- Familiarity with Google Cloud Platform or AWS
- Familiarity with data modelling techniques for AI (Artificial Intelligence) and ML (Machine Learning) applications
- Familiarity with Neo4J or other graph databases is an added advantage
- Familiarity with data visualisation (Tableau, PowerBI)
- Knowledge of, or affinity with, structural biology and bioinformatics
- Experience working in international teams
-
Data Engineer
4 days ago
European Molecular Biology Laboratory (EMBL) Hinxton, United Kingdom Full time· About the team/job · The Velankar team maintains macromolecular structure databases that form essential resources for biologists and other life scientists worldwide. PDBe is a founding partner of the Worldwide Protein Data Bank organisation (wwPDB; ), which maintains the globa ...
-
Senior Engineer, Data Engineering
25 minutes ago
Society of Research Software Engineering Hinxton, Cambridgeshire, United KingdomTheVelankar teammaintains macromolecular structure databases that form essential resources for biologists and other life scientists worldwide. PDBe is a founding partner of the Worldwide Protein Data Bank organisation (wwPDB; org), which maintains the global archive of 3D structu ...
-
Elixir Science Officer
1 week ago
European Molecular Biology Laboratory Hinxton, United KingdomBioinformatics · Hinxton, UK · In this job · Your role · You have · You might also have · Why join us · What else you need to know · More about EMBL-EBI · ELIXIR is seeking an experienced life scientist with wide interests in the technologies and disciplines of the biological sci ...
-
Elixir Science Officer
6 days ago
Springer Nature Hinxton, United Kingdom**ELIXIR Science Officer**: · - Employer- European Molecular Biology Laboratory (EMBL)- Location- Hinxton- Salary- Competitive- Closing date- 12 May 2024- Discipline · Life Science · Job Type · Bioinformatician · Employment - Hours · Full time · Duration · Fixed term · Qualificat ...
-
Senior Staff Scientist
6 days ago
Wellcome Sanger Institute Hinxton, United KingdomDo you want to help us improve human health and understand life on Earth? Make your mark by shaping the future to enable or deliver life-changing science to solve some of humanity's greatest challenges. · About the Role: · We have an exciting opportunity for a Senior Staff Scient ...
-
Research Programme Officer
5 days ago
Springer Nature Hinxton, United Kingdom**Research Programme Officer**: · - Employer- European Molecular Biology Laboratory (EMBL)- Location- Hinxton- Salary- Competitive- Closing date- 12 May 2024- Discipline · Life Science · Job Type · Engineer · Employment - Hours · Full time · Duration · Fixed term · Qualification ...
-
Research Software Engineer
1 week ago
Embl-Ebi Hinxton, United KingdomYour role · We are seeking a highly skilled and motivated Research Software Engineer with expertise in Python and databases to join the AI knowledge management project for 3 years. We are open to applicants at various career stages, with particular interest in individuals who ar ...
-
Senior Data Scientist
4 days ago
Lifelancer Hinxton, United Kingdom Full timeYou will be responsible for: · Independently manage and lead machine learning research projects and write outcomes in a scientific publication for submission to journals or machine learning conferences (ICLR, ICML, CVPR, etc). · Collaborate with team members, propose, develop, an ...
-
ELIXIR Science Officer
4 days ago
Embl-Ebi Hinxton, United KingdomYour role · Reporting to ELIXIR's Chief Technical Officer, you will play an active role in teams led by the ELIXIR Coordinators, and work closely with other members of the ELIXIR Hub and ELIXIR Nodes. · Your key responsibilities will be: · Delivering technical contributions to t ...
-
Tech Talent Scheme
5 days ago
Wellcome Sanger Institute Hinxton, United Kingdom Full timeDo you want to help us improve human health and understand life on Earth? Make your mark by shaping the future to enable or deliver life-changing science to solve some of humanity's greatest challenges. · Join our exciting Technology Talent Scheme at the Wellcome Sanger Institute ...
-
Research Software Engineer
4 days ago
European Molecular Biology Laboratory (EMBL) Hinxton, United Kingdom Full time· About the team/job · Open Targets (OT) is a unique public-private partnership working to deliver experimental data and informatics platforms that enable researchers to make more informed decisions about target selection for drug discovery. OT is a shared initiative between the ...
-
ELIXIR Science Officer
4 days ago
European Molecular Biology Laboratory (EMBL) Hinxton, United Kingdom Full time· About the team/job · ELIXIR is seeking an experienced life scientist with wide interests in the technologies and disciplines of the biological sciences and a good understanding of the principles and approaches underpinning Open Science, reproducibility and the re-use of data a ...
-
Research software Engineer
4 days ago
European Molecular Biology Laboratory (EMBL) Hinxton, United Kingdom Full time· About the team/job · Open Targets (OT) is a unique public-private partnership working to deliver experimental data and informatics platforms that enable researchers to make more informed decisions about target selection for drug discovery. OT is a shared initiative between the ...
-
Full Stack Software Developer
1 week ago
European Molecular Biology Laboratory (EMBL) Hinxton, United Kingdom Full time· About the team/job · We are looking for a full-stack developer to join the Computational Chemical Biology team at the European Bioinformatics Institute (EMBL-EBI) located on the Wellcome Genome Campus near Cambridge in the UK. · The role is primarily to develop a series of web ...
Data Engineer - Hinxton, United Kingdom - Embl-Ebi
Description
Your role
We seek a skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in optimising and enhancing our data pipelines, ensuring efficient data processing, storage and retrieval. You will work closely with cross-functional teams to analyse requirements, propose new data pipeline architectures, and implement solutions to improve performance and scalability.
The tasks for this post include the following:
The successful candidate will report directly to the PDBe Technical Project Lead as a Technical Officer. This post is an opportunity for the right person to bring IT skills and innovative ideas to help sustain the growing amount of structural biology data in the PDB and ensure that PDBe, PDBe-KB and AFDB services remain sustainable.
Closing date: 12 May 2024
Related
You have
You might also have
&v=024){kind=logo}
