Experis Academy - City of London, United Kingdom - Undisclosed Company

    Undisclosed Company
    Undisclosed Company City of London, United Kingdom

    2 weeks ago

    Default job background
    Description
    Data Engineer - Advanced Analytics
    Remote


    Essential Skills:
    Computer Science or equivalent education and experience
    BPSS (SC desired)
    2+ years of data experience with data analysis and preparation, including experience with very large data sets

    Data manipulation and extraction using Python, SQL, AWS Redshift

    Skills required:
    Python, SQL, AWS Glue, AWS Redshift, AWS Lambda, AWS Step Functions, AWS App Config

    Understanding of data migration, migration of existing data platforms to new environment
    Strong understanding of Python (other languages an advantage), AWS technologies (as above)
    Strong understanding Data Governance tooling
    Strong experience in SQL, database development & data modeling
    Solid business and collaboration skills, and responsive to service needs and operational demands


    Day to day activities:
    Act as a liaison between consumer teams and source system/data owners
    Assess and understand data feeds and create design for target platform using data onboarding proforma
    Collects, blends, and transforms data using ELT tools, database management system tools, and code development (e.g. AWS Glue, AWS Step Functions, AWS Event Bridge, AWS Redshift, AWS S3, Python, SQL)
    Assess, design and implement data quality correction and profiling algorithms
    Interacts with end user teams, and capable of understanding how data needs to be structured for consumption. Implements data models and structures data in ready-for consumption using PowerBI
    Test data pipelines from functional and performance perspective.