Jobs
>
London

    Data Engineer - London, United Kingdom - Tata Consultancy Services

    Tata Consultancy Services
    Tata Consultancy Services London, United Kingdom

    1 week ago

    Default job background
    Description

    Role: Data Engineer - Tech Lead

    Job Type: Permanent

    Location: London, UK

    Do you strive for engineering excellence and are ready to lead a modern tech transformation?

    Do you have experience as a Azure, Pyspark, Cloud?

    We have the perfect role for you- Data Engineer - Tech Lead

    Careers at TCS: It means more

    TCS is a purpose-led transformation company, built on belief. We don't just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation.

    • Provide coaching and mentoring to other engineers.
    • Work with some of the brightest global minds in the industry.
    • Be exposed to the future of data.

    The Role

    Being a Data Engineering Tech Lead, you will be at the forefront of leveraging Azure cloud services to design, develop, and implement cutting-edge data engineering solutions. You will be leading a team of data engineers in harnessing the power of Databricks and Synapse to build scalable and efficient data pipelines, data lakes, and analytical solutions.

    • Lead Data Engineering Solutions Development: Lead the design, development, and maintenance of Azure-based data pipelines and analytical solutions using Databricks, Synapse, and other relevant services.
    • Perform Data Transformations: Leverage SQL, PySpark, and Python to perform data transformations, aggregations, and analysis on large datasets.
    • Architect Data Storage Solutions: Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance.
    • Collaborate with Cross-functional Teams: Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand business requirements and deliver impactful data solutions.
    • Monitor and Optimize Data Pipelines: Monitor and optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging Azure monitoring and logging services.

    Your Profile

    • Expertise in Azure cloud services, Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage.
    • Expertise in Data Engineering, Solution designing and Cloud Computing.
    • Programming skills in Python, with developing data processing applications using PySpark.
    • Understanding of SQL for data manipulation, querying, and optimization in Azure environments.
    • Control systems such as GitHub and DevOps practices for automated deployment and infrastructure management.
    • Data streaming technologies such as Kafka for building event-driven architectures.
    • Experience with CI/CD pipelines for automated testing, build, and deployment of data engineering solutions.

    Good to have: (As applicable)

    • Kafka for building real-time data streaming pipelines and event-driven architectures.
    • CI/CD tools such as Azure DevOps or Jenkins for automating the deployment and testing of data engineering solutions.
    • Agile methodologies such as Scrum or Kanban, and experience working in cross-functional agile teams.
    • Technologies such as Docker and orchestration tools like Kubernetes for containerized deployments.
    • Workflow management tools such as Airflow for orchestrating complex data pipelines and ETL processes.
    • Certifications in Azure cloud services and data engineering technologies, demonstrating expertise and proficiency in the Azure ecosystem.

    Rewards & Benefits:

    TCS is consistently voted a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.

    Diversity, Inclusion & Wellbeing:

    At TCS, we believe in building and sustaining a culture of equity and belonging where everyone can thrive. Our diversity motto is 'Inclusion without Exception'.

    You'll find a welcoming culture and many internal volunteering and social networks to join. Our diversity, inclusion and social activities include LGBTQ+ and mental health networks, as well as health and wellness initiatives and sports events (we even sponsor the London Marathon).

    TCS celebrates inclusion without exception. We are open to all and treat applications equally, regardless of ethnicity, disability, gender, age, sexual orientation or beliefs.

    If you are an applicant who needs an accommodation due to a disability to complete an employment application, or during any phase of the hiring process, please contact us at with the subject line: "Disability Accommodation Request".

    Due to a high volume of applications, we will be unable to contact each applicant individually on the status of their application. If you have not received a direct response within 30 days, then it should be deemed unsuccessful on this occasion.

    Application Process

    1. Online application > 2. Technical discussion > 3. Managerial discussion > 4. HR discussion

    Join us and do more of what matters. Apply online now.

  • ITECCO

    Data Engineer

    1 week ago

    ITECCO London, United Kingdom

    Data Engineer - Education Industry - London - £65,000 · I am looking for an experienced **Data Engineer** to join a **renowned Education organisation** based in **London**. This is an excellent opportunity for someone to join a large team and drive significant change in data infr ...

  • Anson McCade Ltd - IT and Finance Recruitment

    Data Engineer

    3 days ago

    Anson McCade Ltd - IT and Finance Recruitment London, United Kingdom

    **About the Role** · As a**Data Engineer** you will be expected to carry out the following roles: · - You will have experience in developing, testing, and suppoting the collection & intergration of data. · - Bring structure to orders of work through modelling data requirements, s ...

  • Data Idols

    Data Engineer

    1 week ago

    Data Idols London, United Kingdom

    **Data Engineer** Are you a mid-level **Data Engineer** skilled in **Azure technologies**, seeking an new 'feel-good' permanent opportunity? Data Idols are proud to be supporting a HealthTech client, who use remote-first technology focusing on engagingpatients across their health ...

  • eFinancialCareers

    Data Engineer

    1 week ago

    eFinancialCareers London, United Kingdom

    **Summary**: · A globally leading, systematic, quant trading firm are looking for a Data Engineer to join their technical team in London. · The successful Data Engineer will be utilising both analytical and technical skillsets, building data pipelines in the Python and PyData sta ...

  • Highams

    Data Engineer

    1 week ago

    Highams London, United Kingdom

    **Data Engineer - Insurance** · This is an exciting opportunity to join a global organisation within the London Insurance Market. · Hybrid working - 3 days pw in their City of London office · As a Data Engineer, you will have experience of building large scale, cloud-based distri ...

  • eFinancialCareers

    Data Engineer

    3 days ago

    eFinancialCareers London, United Kingdom

    Join us as a Data Engineer, Streaming · - This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences · - You'll be simplifying the bank through developing innovative data driven solutions ...

  • Data Idols

    Data Engineer

    1 week ago

    Data Idols London, United Kingdom

    **Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. · **Skills and Exp ...

  • Nigel Frank International

    Data Engineer

    1 week ago

    Nigel Frank International London, United Kingdom

    **Data Engineer - London - £65k** · Currently, I am working closely with a leading transport service organisation. Their purpose is to provide passenger transport services across the United Kingdom, and they have been doing this successfully for decades. · Whilst they offer up a ...

  • Lorien

    Data Engineer

    5 days ago

    Lorien London, United Kingdom

    **Data Engineer - Insurance** · We are currently recruiting for a Data Engineer with Insurance Industry experience to join one of our Insurance Clients on a 6 month initial contract, remote working. · Please note this role is **Inside IR35.** · You will support the team with on-g ...

  • Anson McCade Ltd - IT and Finance Recruitment

    Data Engineer

    6 days ago

    Anson McCade Ltd - IT and Finance Recruitment London, United Kingdom

    **Data Engineer** · **_London, Bristol, Gloucester_** · **_£55-75k_** · Attention all Data Engineers Are you looking for an exciting and challenging opportunity to work on large scale projects and help shape specific solutions for clients? Then we want you · We are currently seek ...

  • Nigel Frank International

    Data Engineer

    3 days ago

    Nigel Frank International London, United Kingdom

    Data Engineer - fully remote - £60,000 · Nigel Frank are teamed up with an industry leading organisation that are currently looking to hire a Data Engineer to join their team. This organisation has been going through major growth over the past few years, with significant investme ...

  • Nigel Frank International

    Data Engineer

    6 days ago

    Nigel Frank International London, United Kingdom

    Data Engineer - Azure Databricks - London - £60K · I'm looking for a Data Engineer to work on developing products and solutions in Azure. you will have the opportunity to upskill in complex areas of cloud based engineering solutions in the very latest tech. · My client sit within ...

  • Explore Group

    Data Engineer

    5 days ago

    Explore Group London, United Kingdom

    **Data Engineer - Hybrid** I have partnered up with a leading data consultancy who are looking for a Data Engineerto join their ever growing team. · **In return for your hard work**: · - Up to £70,000 p/a · - Hybrid working (No set days) · - All expenses paid for client travel · ...

  • Harnham

    Data Engineer

    4 days ago

    Harnham London, United Kingdom

    **DATA ENGINEER** · **LONDON BASED** · **£70,000-80,000 PER ANNUM** · This Large-Scale UK Retailer are searching for a new Data Engineer to take responsibility for the development of the company's cloud platform in AWS. You will also be responsible for building new Data Pipelines ...

  • ADLIB

    Data Engineer

    6 days ago

    ADLIB London, United Kingdom

    **Leading financial services data & analytics consulting arm.**: · - **Work with Azure, AWS and GCP services.**: · - **Client-facing role working alongside data architects and scientists.** · A market leading consultancy is growing out its Financial Services Data & Analytics prac ...

  • Circle Recruitment

    Data Engineer

    1 week ago

    Circle Recruitment London, United Kingdom

    **Data Engineer** · **£600 - £700/Day Inside IR35** · **London, Hybrid** · **6 Months** · We are seeking a Data Engineer for our Government client based in London. This role will be office based 2 days per week and the remaining remote. The Data Engineer role will be and initial ...

  • eFinancialCareers

    Data Engineer

    1 week ago

    eFinancialCareers London, United Kingdom

    **Permanent Role** · **London Based (Hybrid)** · **No Sponsorship** · **Role** · - Test/evaluate new alternative datasets in collaboration with quant researchers and data teams · - Once identified with machine learning and statistical methods, automate the extraction of predictiv ...

  • Harnham

    Data Engineer

    1 week ago

    Harnham London, United Kingdom

    **Data Engineer** · **Birmingham** · **Up to £70,000 + Competitive bonus & Benefits** · **The Company** · Be part of a global organisation that will help you develop your career and progress through the company. This reputable Footsie-100 company operates in over 180 countries an ...

  • Data Idols

    Data Engineer

    1 week ago

    Data Idols London, United Kingdom

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key parto ...

  • Harnham

    Data Engineer

    3 days ago

    Harnham London, United Kingdom

    **DATA ENGINEER** · **LONDON BASED** · **£80,000-90,000 PER ANNUM** · This UK-based finance provider are hiring for a new Data Engineer. You will be building Data Pipelines that power the company's analytical solutions, using Python and SQL. You will be responsible for ensuring a ...