Senior Data Engineer - London, United Kingdom - Harnham

Harnham
Harnham
Verified Company
London, United Kingdom

1 month ago

Tom O´Connor

Posted by:

Tom O´Connor

beBee Recruiter
Description

Senior Data Engineer

Up to £120,000 + competitive pension + private health-care

London
***Fancy joining a global organisation that is revolutionising the digital landscape? Today, as clients across industries are moving from digitally extending their businesses to placing digital at the core, this company has an unprecedented opportunityto help them succeed. This is an excellent opportunity to perform advanced engineering techniques to determine how the company can integrate platforms into the business and build streaming data pipelines for its clients.

**THE COMPANY
**A digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers. They help unlock value through a start-up mindset and modern methods,fusing strategy, consulting and customer experience with agile engineering and problem-solving creativity. The company's 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting and customer obsession toaccelerate their clients' businesses through designing the products and services their customers truly value.

**THE ROLE
**As a Senior Data Engineer, you can expect to be analysing and interpreting results of operating models and delivering this data to clientele.
In specific, you can expect to be involved in the following:

  • Responsible for consulting clients on data solutions
  • You will architect, design, estimate, developing and deploy cutting edge software products and services that leverage large scale data ingestion, processing, storage and querying, instream & batch analytics for Cloud and onprem environments.
  • Delivering high quality solutions while driving design discussions across Data Engineering topics
  • Enable enterprise scale digital transformation of many of the biggest companies in the world.
**YOUR SKILLS AND EXPERIENCE

**The successful Senior Data Engineer will have the following skills and experience: - Extensive experience with Data related technologies, including knowledge of Big Data Architecture

  • Patterns and Cloud services (AWS / Azure / GCP)
  • Experience delivering end to end Big Data solutions on premise and/or on Cloud
  • Knowledge of the pros and cons of various database technologies like Relational, NoSQL, MPP, Columnar databases
  • Expertise in the Hadoop ecosystem with one or more distributionlike Cloudera and cloud specific distributions
  • Proficiency in Java and Scala programming languages (Python a plus)
  • Expertise in one or more NoSQL database (Mongo DB, Cassandra, HBase, DynamoDB, Big Table etc.)
  • Experience with one or more big data ingestion tools (Sqoop, Flume, NiFI etc.), distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub etc.)
  • Expertise with at least one distributed data processing framework e.g. Spark (Core, Streaming, SQL),
  • Storm, Flink etc.
  • Knowledge of flexible, scalable data models addressing a wide variety of consumption patterns including randomaccess, sequential access including necessary optimisations like bucketing, aggregating, sharding
  • Knowledge of performance tuning, optimization and scaling solutions from a storage/processing standpoint
  • Experience building DevOps pipelines for data solutions, including automated testing

BENEFITS

  • 25 days paid annual leave
  • Life assurance
  • Dental Insurance
  • Income protection
  • Private healthcare for you AND your family
  • Competitive pension
**HOW TO APPLY
More jobs from Harnham
See all jobs of Harnham