Data Engineer - Hereford, United Kingdom - Richmond Square Consulting Ltd

Richmond Square Consulting Ltd

Verified Company

Hereford, United Kingdom

2 weeks ago

Posted by:

Tom O´Connor

beBee Recruiter

Description

Data Engineer

Remote working available with 1 day per week in Hereford, Herefordshire
Data Engineer required by a thriving cutting-edge next generation technology company within the Defence and Security sector. The Data Engineer will have strong experience of Apache NiFi, programming and scripting languages (i.e. SQL, Linux, Python, Java),experience of working in a team / squad using Agile methodologies, DevOps and IaC tooling.

Benefits
As a Data Engineer for this awesome company you will benefit from:

Day rate of £500
£600 per day outside of IR3
Likely extensions
Exciting project work with cuttingedge tech
Fantastic work environment and offices with onsite gym, swimming pool, squash courts, restaurant and cafe (if ever in Farnborough, Hampshire HQ).

What you will need
As a Data Engineer you will work in a fantastic company and have a diverse, challenging, interesting and rewarding position

Essential experience includes:

Knowledge of functionalities surrounding Apache NiFi. Development of custom processors and end to end data flow management.
Programming and scripting languages, e.g. SQL, Python, Linux, Java
Experience working closely in a team/squad/tribe using agile methodologies (Scrum and/or Kanban,), practicing DevOps and Continuous Integration / Delivery.
Experience in using Elastic stack products to ingest, manage and visualise data.
Data modelling and understanding of different data structures (structured and unstructured).
Experience in using IaC tooling (e.g. Terraform, ARM, Pulumi) to deploy to Cloud environments.
Either holds or has recently held government security clearance already, or is suitable for and willing to go through the vetting process (suitability would include an absence of a serious criminal record, a right to work and live in UK and, preferably,a record of 5 years' UK residency)

Nice to have

Experience with Hadoop Platform & Ecosystem at Enterprise scale would be nice to have.
Knowledge in administration of Big Data systems in a production / live environment
Experience deploying solutions on top of Microsoft Azure. (e.g Azure Event Hubs, Azure Data Factory, Azure DataBricks)
Knowledge of Apache Airflow
Understanding of Apache Kafka / Eventbased architecture and design patterns

All the best,

Charlie Syrett
Richmond Square Consulting Ltd