Jobs
>
London

    Data Engineer - London, United Kingdom - Tata Consultancy Services

    Tata Consultancy Services
    Tata Consultancy Services London, United Kingdom

    2 weeks ago

    Default job background
    Description

    Role:
    Data Engineer - Tech Lead Job Type: Permanent
    Do you strive for engineering excellence and are ready to lead a modern tech transformation ?
    We have the perfect role for you- Data Engineer - Tech Lead

    TCS is a purpose-led transformation company, built on belief. We don't just help businesses to transform through technology.

    We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide.

    For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation.
    Be exposed to the future of data.

    Being a Data Engineering Tech Lead, you will be at the forefront of leveraging Azure cloud services to design, develop, and implement cutting-edge data engineering solutions.

    You will be leading a team of data engineers in harnessing the power of Databricks and Synapse to build scalable and efficient data pipelines, data lakes, and analytical solutions.


    Lead Data Engineering Solutions Development:

    Lead the design, development, and maintenance of Azure-based data pipelines and analytical solutions using Databricks, Synapse, and other relevant services.


    Perform Data Transformations:
    Leverage SQL, PySpark, and Python to perform data transformations, aggregations, and analysis on large datasets.

    Architect Data Storage Solutions:

    Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance.

    Collaborate with Cross-functional Teams: Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand business requirements and deliver impactful data solutions.

    Monitor and

    Optimize Data Pipelines:
    Monitor and optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging Azure monitoring and logging services.

    Expertise in Azure cloud services, Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage.
    Expertise in Data Engineering, Solution designing and Cloud Computing.
    Programming skills in Python, with developing data processing applications using PySpark.
    Understanding of SQL for data manipulation, querying, and optimization in Azure environments.
    Control systems such as GitHub and DevOps practices for automated deployment and infrastructure management.
    Data streaming technologies such as Kafka for building event-driven architectures.
    Experience with CI/CD pipelines for automated testing, build, and deployment of data engineering solutions.

    Kafka for building real-time data streaming pipelines and event-driven architectures.
    CI/CD tools such as Azure DevOps or Jenkins for automating the deployment and testing of data engineering solutions.
    Agile methodologies such as Scrum or Kanban, and experience working in cross-functional agile teams.
    Technologies such as Docker and orchestration tools like Kubernetes for containerized deployments.
    Workflow management tools such as Airflow for orchestrating complex data pipelines and ETL processes.
    Certifications in Azure cloud services and data engineering technologies, demonstrating expertise and proficiency in the Azure ecosystem.

    Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.


    Diversity, Inclusion & Wellbeing:
    At TCS, we believe in building and sustaining a culture of equity and belonging where everyone can thrive. Our diversity motto is 'Inclusion without Exception'.

    You'll find a welcoming culture and many internal volunteering and social networks to join.

    Our diversity, inclusion and social activities include LGBTQ+ and mental health networks, as well as health and wellness initiatives and sports events (we even sponsor the London Marathon).

    TCS celebrates inclusion without exception. We are open to all and treat applications equally, regardless of ethnicity, disability, gender, age, sexual orientation or beliefs.

    If you are an applicant who needs an accommodation due to a disability to complete an employment application, or during any phase of the hiring process, please contact us at with the subject line: "Disability Accommodation Request".

    Online application 2. Apply online now.
  • Nigel Frank International

    Data Engineer

    3 days ago

    Nigel Frank International London, United Kingdom

    Data Engineer - fully remote - £60,000 · Nigel Frank are teamed up with an industry leading organisation that are currently looking to hire a Data Engineer to join their team. This organisation has been going through major growth over the past few years, with significant investme ...

  • Circle Recruitment

    Data Engineer

    1 week ago

    Circle Recruitment London, United Kingdom

    **Data Engineer** · **£600 - £700/Day Inside IR35** · **London, Hybrid** · **6 Months** · We are seeking a Data Engineer for our Government client based in London. This role will be office based 2 days per week and the remaining remote. The Data Engineer role will be and initial ...

  • Data Idols

    Data Engineer

    1 week ago

    Data Idols London, United Kingdom

    **Senior Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Senior Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key parto ...

  • ITECCO

    Data Engineer

    1 week ago

    ITECCO London, United Kingdom

    Data Engineer - Education Industry - London - £65,000 · I am looking for an experienced **Data Engineer** to join a **renowned Education organisation** based in **London**. This is an excellent opportunity for someone to join a large team and drive significant change in data infr ...

  • Anson McCade Ltd - IT and Finance Recruitment

    Data Engineer

    2 days ago

    Anson McCade Ltd - IT and Finance Recruitment London, United Kingdom

    **About the Role** · As a**Data Engineer** you will be expected to carry out the following roles: · - You will have experience in developing, testing, and suppoting the collection & intergration of data. · - Bring structure to orders of work through modelling data requirements, s ...

  • Harnham

    Data Engineer

    4 days ago

    Harnham London, United Kingdom

    **Data Engineer** · **£500 a day, outside IR35.** · **Hybrid, London-based.** · **6-Month Contract.** · **The Company** · A great opportunity to join an insurance company in a recently set-up and growing team. You will join the business as a Data Engineer playing a major role in ...

  • Data Idols

    Data Engineer

    1 week ago

    Data Idols London, United Kingdom

    **Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. · **Skills and Exp ...

  • The Consultancy Group

    Data Engineer

    5 days ago

    The Consultancy Group London, United Kingdom

    We are seeking a talented Data Engineer with Salesforce experience to join a leading consultancy. In this role, you will be responsible for building and maintaining our data infrastructure and integrating our Salesforce system with other data sources. Youwill work closely with ou ...

  • Data Idols

    Data Engineer

    1 week ago

    Data Idols London, United Kingdom

    **Data Engineer** Are you a mid-level **Data Engineer** skilled in **Azure technologies**, seeking an new 'feel-good' permanent opportunity? Data Idols are proud to be supporting a HealthTech client, who use remote-first technology focusing on engagingpatients across their health ...

  • eFinancialCareers

    Data Engineer

    1 week ago

    eFinancialCareers London, United Kingdom

    **Summary**: · A globally leading, systematic, quant trading firm are looking for a Data Engineer to join their technical team in London. · The successful Data Engineer will be utilising both analytical and technical skillsets, building data pipelines in the Python and PyData sta ...

  • Method Resourcing

    Data Engineer

    2 weeks ago

    Method Resourcing London, United Kingdom

    **Data Engineer | Python | SQL | GCP | BigQuery | Data Studio | ETL | DBT | Stitch | Fivetran | Singer | £40,000-£50,00** · Method Resourcing are currently working with a Media Publication company that report on the world of data and provide publications to over 300,000 data prof ...

  • Highams

    Data Engineer

    1 week ago

    Highams London, United Kingdom

    **Data Engineer - Insurance** · This is an exciting opportunity to join a global organisation within the London Insurance Market. · Hybrid working - 3 days pw in their City of London office · As a Data Engineer, you will have experience of building large scale, cloud-based distri ...

  • VALLUM ASSOCIATES LIMITED

    Data Engineer

    1 week ago

    VALLUM ASSOCIATES LIMITED London, United Kingdom

    **Mid-Senior Data Engineer - Energy & Financial Solutions (Commodities/Trading) - Permanent** · **Location: London or Swindon (Hybrid remote working)** · **Salary : Mid 70-85k, Snr 85-100k + bonus** · Are you an experienced or passionate Data Engineer looking to broaden your hori ...

  • eFinancialCareers

    Data Engineer

    1 week ago

    eFinancialCareers London, United Kingdom

    **Data Engineer - Macro Hedge Fund - Base up to £150k + Bonus** · You take pride in your ability to not only manage complex pipelines, processes, and models but build the pipelines from scratch to ensure their efficacy. Your last greenfield project seems like a lifetime ago. Comp ...

  • Morgan McKinley

    Data Engineer

    1 week ago

    Morgan McKinley London, United Kingdom

    **Data Engineer** · **6 month rolling contract - up to £700 PD Inside - London/Hybrid** · I am currently looking for a Data Engineer to join a global financial services organisation on a 6-month rolling contract. As the Data Engineer, you will be extensively involved in hands-on ...

  • Harnham

    Data Engineer

    5 days ago

    Harnham London, United Kingdom

    **DATA ENGINEER** · **LONDON - HYBRID** · **£60, ,000** · **THE COMPANY**: · One of the UK's leading independent (re)insurance broker firms is looking for a skilled Data Engineer to have ownership of the cloud migration project they will be piloting in the New Year. The company h ...

  • Data Idols

    Data Engineer

    1 week ago

    Data Idols London, United Kingdom

    **Data Engineer** Data Idols are excited to be working with one of the top 100 companies in the world to recruit a Data Engineer A company which owns multiple brands and who are investing heavily into 'all things data' to revolutionise their extraordinary team. · **Skills and Exp ...

  • Nigel Frank International

    Data Engineer

    1 week ago

    Nigel Frank International London, United Kingdom

    **Data Engineer - London - £65k** · Currently, I am working closely with a leading transport service organisation. Their purpose is to provide passenger transport services across the United Kingdom, and they have been doing this successfully for decades. · Whilst they offer up a ...

  • eFinancialCareers

    Data Engineer

    1 week ago

    eFinancialCareers London, United Kingdom

    **Summary**: · A market-leading quant trading hedge fund are looking for a data engineer to join their London-based operations team, building data and trading pipelines from scratch. The successful data engineer will be developing Extract, Transform, Load (ETL) pipelinesin Python ...

  • Nigel Frank International

    Data Engineer

    6 days ago

    Nigel Frank International London, United Kingdom

    **Data Engineer - Azure - London** · I am currently working with a market leading organisation in the travel industry. They are heavily invested in expanding their data and analytics team with a view to being more data driven. This is a fantastic opportunity to help shape their d ...