Data Engineer - London, United Kingdom - Damia Group

    Default job background
    Description

    Job Description

    Data Engineer – Remote – £550-£650 per day – 4 months+

    All applicants must hold an active SC clearance.

    My client is a global leading IT consultancy. They are looking for a Data Engineer to be involved in an Oracle to PostgreSQL migration.

    The on-premises source database is Oracle with roughly 50-100GB of data to be migrated. The target data is an AWS PostgreSQL database. This will not be a simple migration, and several steps to convert, map and assess the source data will need to be implemented before the data can be added to the target database.

    Requirements:

    • AWS - Glue, Lambda, Sample Storage Service (S3), Schema Conversion Tool (SCT), Elastic Compute Cloud (EC2) and Database Migration Service (DMS)
    • DB experience (postgres for queries / quality check etc.)
    • Automation and events
    • Data migration project experience - preferably on-premises to AWS and Oracle to PostgreSQL.
    • Communication – proficiency talking to both technical and non-technical people.

    Desirables:

    • Document creation / review (build docs etc.)
    • Logging
    • Identity and Access Management (IAM)
    • Python experience (for Glue and Lambda if not using the GUI).
    • Data Mapping