Jobs
>
Basildon

    Senior Data Engineer - Basildon, United Kingdom - Lifelancer

    Lifelancer
    Lifelancer Basildon, United Kingdom

    5 days ago

    Default job background
    Full time
    Description

    About the role:

    We are seeking a highly skilled and motivated Senior Data Engineer to join our team to help define and build Pharmanovias long-term data management strategy. Pharmanovia is aiming to build a highly autonomous self-service data and analytics platform, which can extract and align data from many best-in-class SaaS platforms (e.g. SAP S4 HANA, Salesforce CRM, Veeva RIMS and others) to deliver efficient business insights to Pharmanovia management and operational teams.

    As a Senior Data Engineer, you will play a crucial role in defining Pharmanovias long-term data analytics strategy, covering but not limited to:

    Data Architecture Infrastructure (AWS):

    Design and implement scalable data architectures to support various data sources and types

    Select appropriate database technologies data warehouses and/or data lakes

    Manage cloud infrastructure to support data processing and storage need

    Data Integration ETL:

    Develop pipelines to ingest, clean, and integrate data from disparate sources

    Automate data integration processes to improve efficiency and reliability

    Implementing reporting and visualization tools for data exploration and analysis

    Identify and implement optimizations to enhance data processing and query performance

    Data Analytics:

    Building analytical capabilities to support self-service data analytical tools

    Reporting and maintenance of data quality of core datasets and define improvement strategies

    Develop data infrastructure to support potential AI/ML use-cases

    Data Governance:

    Establishing data governance frameworks, policies, and standards

    Defining data ownership, stewardship, and quality management processes

    Implementing data management practices for data acquisition, storage, integration, and archival

    Data Security:

    Ensuring compliance with relevant data privacy regulations (e.g., GDPR, CCPA, HIPAA)

    Conducting regular audits and assessments to assess and mitigate data security risks

    In addition to the above, you will need to demonstrate a good understanding of the real-life use cases for the data to ensure activities are appropriately prioritised and any data issues or concerns that could impact decision making are identified and well communicated. You will be required to collaborate with various technical and non-technical teams across Pharmanovia to understand business problems and deliver solutions appropriate to the business requirements.

    You should have extensive experience working with the AWS platform as well as additional tools, such as Databricks, and have demonstrated proficiency in designing and managing databases and data platforms.

    As a Senior Data Engineer, you will play a crucial role in building and optimising our data infrastructure, ensuring scalability, reliability, and efficiency. This role is essential for driving data-driven decision-making and enhancing our ability to extract insights from vast amounts of data.

    Main responsibilities duties:

    • Collaborate with cross-functional teams to understand business requirements and translate them into scalable, secure, and reliable AWS solutions
    • Support the definition of Pharmanovias long-term data management strategy
    • Define and implement key tools to enact Pharmanovias data management strategy
    • Design and development of data pipelines using AWS services such as Lambda, EC2, S3, RDS, DynamoDB, etc. from a variety of sources (SaaS platforms, excel, email attachments, sFTPs etc)
    • Optimise system performance, reliability, and cost-efficiency through continuous monitoring, troubleshooting, and optimization of AWS resources
    • Ensure compliance with industry standards and regulations (e.g., HIPAA, GDPR) for data security and privacy in AWS environments
    • Implement best practices for infrastructure as code (IaC) using tools like AWS CloudFormation or Terraform to automate provisioning and deployment processes.
    • Stay updated on emerging AWS technologies and trends and evaluate their potential to enhance Pharmanovias cloud infrastructure.
    • Provide technical guidance and mentorship to junior team members, fostering a culture of learning and innovation within the engineering team

    About you:

    • Bachelors or Masters degree in Computer Science, Engineering, or related field
    • ITIL Foundation desirable
    • Knowledge of ITIL 4 and change management practices
    • Proven experience designing, developing, and deploying cloud-based solutions on AWS
    • In-depth knowledge of AWS services and their use cases, with a focus on compute, storage, networking, security, and monitoring
    • Proficiency in programming languages such as Python, Java, or , and experience with serverless computing (AWS Lambda)
    • Hands-on experience with containerization technologies (e.g., Docker, Kubernetes) and familiarity with container orchestration on AWS (Amazon EKS)
    • Strong understanding of DevOps principles and experience with CI/CD pipelines using tools like AWS Code Pipeline, Jenkins, or GitLab CI/CD
    • Excellent problem-solving skills and ability to troubleshoot complex issues in distributed systems
    • Effective communication skills with the ability to collaborate effectively with cross-functional teams
    • Service-oriented with excellent customer service persona
    • Great analytical skills, methodical and high attention to detail
    • Creative solution-oriented mindset, and the ability to take own initiative
    • Approachable, helpful, and flexible attitude
    • Strong verbal and written English language skills
    • Ability to travel internationally if required
    • Driving licence

    Please use the below link for job application and quicker response.

  • ADLIB

    Data Engineer

    2 weeks ago

    ADLIB City of London, United Kingdom

    **Luxury Fashion House**: · - End-to-end BI development in a multi-cloud environment. · - Path to Lead Data Engineer. · - Great benefits package and remote working. · My client is a luxury fashion brand who are currently on the hunt for a Data Engineer to join their BI Platform T ...

  • ITECCO

    Data Engineer

    2 weeks ago

    ITECCO London, United Kingdom

    Data Engineer - Education Industry - London - £65,000 · I am looking for an experienced **Data Engineer** to join a **renowned Education organisation** based in **London**. This is an excellent opportunity for someone to join a large team and drive significant change in data infr ...

  • Anson McCade Ltd - IT and Finance Recruitment

    Data Engineer

    1 week ago

    Anson McCade Ltd - IT and Finance Recruitment London, United Kingdom

    **About the Role** · As a**Data Engineer** you will be expected to carry out the following roles: · - You will have experience in developing, testing, and suppoting the collection & intergration of data. · - Bring structure to orders of work through modelling data requirements, s ...

  • Data Idols

    Data Engineer

    2 weeks ago

    Data Idols London, United Kingdom

    **Data Engineer** Are you a mid-level **Data Engineer** skilled in **Azure technologies**, seeking an new 'feel-good' permanent opportunity? Data Idols are proud to be supporting a HealthTech client, who use remote-first technology focusing on engagingpatients across their health ...

  • eFinancialCareers

    Data Engineer

    2 weeks ago

    eFinancialCareers London, United Kingdom

    **Summary**: · A globally leading, systematic, quant trading firm are looking for a Data Engineer to join their technical team in London. · The successful Data Engineer will be utilising both analytical and technical skillsets, building data pipelines in the Python and PyData sta ...

  • Tiro Partners Limited

    Data Engineer

    5 days ago

    Tiro Partners Limited London, United Kingdom

    Data Engineer | Python | R | ETL | SQL| Azure | AWS | Healthcare · Title: Data Engineer (Python / R) · Company: Healthcare · Location: Remote · **Salary**: Up to £75,000 · Benefits: 20% Bonus + Shares · The Role: · You will be working for one of most exciting Healthcare companies ...

  • Highams

    Data Engineer

    2 weeks ago

    Highams London, United Kingdom

    **Data Engineer - Insurance** · This is an exciting opportunity to join a global organisation within the London Insurance Market. · Hybrid working - 3 days pw in their City of London office · As a Data Engineer, you will have experience of building large scale, cloud-based distri ...

  • Data Idols

    Data Engineer

    2 weeks ago

    Data Idols London, United Kingdom

    **Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. · **Skills and Exp ...

  • Explore Group

    Data Engineer

    5 days ago

    Explore Group London, United Kingdom

    Data Engineer - £55,000 - £65,000 · Multinational Data and Insights firm · Job title: Data Engineer · **Salary**: £55,000 - £65,000 · Job type: Permanent · Location: London · WFH: Flexible working - in office every now and again · No sponsorship provided · Join a global Data and ...

  • Nigel Frank International

    Data Engineer

    2 weeks ago

    Nigel Frank International London, United Kingdom

    **Data Engineer - London - £65k** · Currently, I am working closely with a leading transport service organisation. Their purpose is to provide passenger transport services across the United Kingdom, and they have been doing this successfully for decades. · Whilst they offer up a ...

  • Nigel Frank International

    Data Engineer

    1 week ago

    Nigel Frank International London, United Kingdom

    Data Engineer - Azure Databricks - London - £60K · I'm looking for a Data Engineer to work on developing products and solutions in Azure. you will have the opportunity to upskill in complex areas of cloud based engineering solutions in the very latest tech. · My client sit within ...

  • Explore Group

    Data Engineer

    1 week ago

    Explore Group London, United Kingdom

    **Data Engineer - Hybrid** I have partnered up with a leading data consultancy who are looking for a Data Engineerto join their ever growing team. · **In return for your hard work**: · - Up to £70,000 p/a · - Hybrid working (No set days) · - All expenses paid for client travel · ...

  • Harnham

    Data Engineer

    1 week ago

    Harnham London, United Kingdom

    **DATA ENGINEER** · **LONDON BASED** · **£70,000-80,000 PER ANNUM** · This Large-Scale UK Retailer are searching for a new Data Engineer to take responsibility for the development of the company's cloud platform in AWS. You will also be responsible for building new Data Pipelines ...

  • Anson McCade Ltd - IT and Finance Recruitment

    Data Engineer

    2 weeks ago

    Anson McCade Ltd - IT and Finance Recruitment Southwark, United Kingdom

    **Data Engineer** · Our client is a leading name in cyber defence, aiding Governments, Nations and Societies to defend themselves from an ever-evolving world of cybercrime. They are currently looking for a Data Engineer to join a new high performance engineering team in designing ...

  • Understanding Recruitment

    Data Engineer

    2 weeks ago

    Understanding Recruitment London, United Kingdom

    **Data Engineer** · A brand new and exciting opportunity has recently arisen for a Data Engineer with an extensive knowledge in designing, developing and managing ETL processes and writing SQL code to join the UK's Largest Government department based remote. As the Data Engineery ...

  • Canada Life

    Data Engineer

    1 week ago

    Canada Life Potters Bar, United Kingdom

    **Job Title: Data Engineer** · **Location: Potters Bar** · **Type: Permanent** · Canada Life UK looks after the retirement, investment and protection needs of individuals, families and companies. We help to build better futures for our customers, our intermediaries and our employ ...

  • Lynx Recruitment Ltd

    Data Engineer

    1 week ago

    Lynx Recruitment Ltd London, United Kingdom

    **Data Engineer - London - £45,000 - £65,000** · **Hybrid working - 1/2 days a week in the office maximum** · Data Engineer/Junior DataArchitectrequired by an award-winning technology consultancy based in London paying £45,000 - £65,000 depending on experience plus bonus and bene ...

  • The People Network

    Data Engineer

    1 week ago

    The People Network London, United Kingdom

    Senior Data Engineer · Are you passionate Senior Data Engineer looking to work for one of the UK's most innovative software houses? They are utilising cutting edge cloud technology to deliver data storage, processing and analytics services. · The Senior Data Engineer's responsibi ...

  • eFinancialCareers

    Data Engineer

    2 weeks ago

    eFinancialCareers London, United Kingdom

    Join us as a Data Engineer · - This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences · - You'll be simplifying the bank through developing innovative data driven solutions, inspiring ...

  • Lynx Recruitment Ltd

    Data Engineer

    5 days ago

    Lynx Recruitment Ltd London, United Kingdom

    Data Engineer | London / Remote | Up to £81,000 (DOE) · We're looking for a Data Engineer to work with an Electric Utility company in London focussed on data and analytics services. Our client's data stack is based in AWS and utilises a range of cloud technologies to coordinate d ...