Data Engineer - Cardiff, United Kingdom - Creditsafe

    Default job background
    Description

    Job Description

    Here at Creditsafe, we are looking for a Data Engineer, to join the Data engineering team.

    WHO ARE WE?

    Our success over the last 25 years and our ongoing growth can be attributed to our people and our strong culture. Culture and engagement really are part of our DNA here at Creditsafe and we take pride in making Creditsafe a great place to work. It's important to us that people can be themselves, feel a sense of professional and personal growth and feel part of a global community.

    We offer a varied range of benefits that support a good work-life balance, including a hybrid approach to work, which enables you the flexibility needed to thrive.

    THE TEAM

    The Data Engineering department at Creditsafe Group comprises four delivery teams covering over 1000 data pipelines, scorecard processing, and also data services to facilitate access to the data via API. Reporting to the Director of Data Engineering, we are a friendly and supportive team working across Creditsafe's data universe, building out and managing our centralised data warehouse, and delivering processed "business ready" data to the downstream products and services used by Creditsafe's customers. We engage with stakeholders at all levels of the organisation to achieve the business's objectives.

    We use modern tools and methodologies, leveraging cloud services (AWS), Step Functions, Glue, Athena , PySpark and of course, SQL and Python. We work in an agile manner, delivering iteratively through a metadata-driven approach which allows us to generate and deploy consistent, repeatable code."

    JOB PROFILE

    You will be working closely with the analytics team facilitating the transformation and derivation of Creditsafe data. The role will define and build data pipelines that will enable faster, better, data-informed decision-making both within the business and for Creditsafe customers. This is an opportunity to gain exposure to big data architectures and mpp processes.

    KEY DUTIES AND RESPONSIBILITIES

    Perform a role as part of an Agile team to develop, test and maintain high quality systems that fulfil business needs.

    Help evolve our data platform with a view towards growth and high throughput aggregations.

    Execute practices such as continuous integration and test driven development to enable the rapid delivery of working code.

    Design analytical workloads using Python and SQL in accordance with guidelines set by the Data Architect

    Work within a team to ship medium to large features independently using industry standard processing patterns

    SKILLS AND QUALIFICATIONS

    Experience within a commercial environment creating ETL pipelines in python

    Exposure to analytical data warehouses such as Snowflake, Redshift or BigQuery (Redshift Preferred)

    Experience with data orchestrators such as Airflow, AWS Step Functions, AWS Batch

    Knowledge of Agile development methodologies

    Knowledge of automated delivery processes

    Experience designing and building autonomous data pipelines

    BENEFITS

    • Competitive Salary.
    • Company Laptop supplied.
    • Bonus Scheme.
    • 25 Days Annual Leave (plus bank holidays).
    • Hybrid working model.
    • Healthcare & Company Pension.
    • Cycle to work and Wellbeing Programme.
    • Global Company gatherings and events.
    • E-learning and excellent career progression opportunities.
    • Plus more that can be found on the benefits section on the Careers page,

    Creditsafe is an equal opportunities employer that values diversity. Please contact Creditsafe if there is any support you need with your application.