Data Engineer - Birmingham, United Kingdom - SF Technology Solutions

    SF Technology Solutions background
    Description


    An exciting opportunity has arisen for a proficient and collaborative Data Engineer to join a leading company in the UK.

    As a Data Engineer, you will play a pivotal role in building robust data pipelines to deliver impactful solutions across various business sectors within the organisation.


    Key Responsibilities:
    Collaborate closely with reporting, analytics, and data science teams to comprehend data sources and business requirements.
    Engage in Agile methodologies, ensuring adherence to best practices, documentation standards, and fostering knowledge sharing within the team.
    Develop, cleanse, enrich, and transform data through the implementation of data pipelines, primarily utilising Informatica.
    Monitor pipeline performance, document infrastructure changes, and ensure compliance with ETL and programming best practices.
    Contribute to the evolution of our data architecture and pipeline design, making valuable inputs to the product roadmap.
    Identify existing data assets, understand their formats, volume, ownership, and ensure data integrity and accessibility.

    Collaborate with business stakeholders to identify gaps in data availability, define required formats, volumes, and processes for data capture and maintenance.

    Provide support during the testing phase, ensuring alignment with original requirements and incorporating feedback from business stakeholders.
    Undertake routine operational tasks related to all data pipelines.


    Required Skills:
    experience in ETL or Data Engineering roles, demonstrating proficiency in building and deploying data pipelines.
    Strong proficiency in Informatica is highly desirable.
    Solid understanding of data structures and data warehousing concepts.
    Proficient in SQL with the ability to write efficient queries.
    Previous experience working within a collaborative team environment.
    Highly self-motivated with keen attention to detail.
    Familiarity with event-driven architecture.
    Working knowledge of AWS.Familiarity with Azure DevOps or similar task management tools.