Jobs
>
Belfast

    Data Reliability Engineer - Belfast, United Kingdom - CME Group

    Default job background
    Full time
    Description

    Data System Reliability Engineer (dSRE)

    Role Overview:

    A crucial role in CME's Cloud data transformation, the data SRE will be aligned to data product pods ensuring the our data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidly.

    Accountabilities:
    • Automate data tasks on GCP
    • Work with data domain owners, data scientists and other stakeholders to ensure that data is consumed effectively on GCP
    • Design, build, secure and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing platforms on GCP
    • Measure and monitor the quality of data on GCP data platforms
    • Implement robust monitoring and alerting systems to proactively identify and resolve issues in data systems. Respond to incidents promptly to minimize downtime and data loss.
    • Develop automation scripts and tools to streamline data operations and make them scalable to accommodate growing data volumes and user traffic.
    • Optimize data systems to ensure efficient data processing, reduce latency, and improve overall system performance.
    • Collaborate with data and infrastructure teams to forecast data growth and plan for future capacity requirements.
    • Ensure data security and compliance with data protection regulations. Implement best practices for data access controls and encryption.
    • Collaborate with data engineers, data scientists, and software engineers to understand data requirements, troubleshoot issues, and support data-driven initiatives.
    • Continuously assess and improve data infrastructure and data processes to enhance reliability, efficiency, and performance.
    • Maintain clear and up-to-date documentation related to data systems, configurations, and standard operating procedures.

    Qualifications:
    • Bachelor's or Master's degree in Computer Science, Software Engineering, Data Science or related field, or equivalent practical experience
    • Experience as a Data Site Reliability Engineer or a similar role, with a focus on data infrastructure management
    • Proficiency in data technologies, such as relational databases, data warehousing, big data platforms (e.g., Hadoop, Spark), data streaming (e.g., Kafka), and cloud services (e.g., AWS, GCP, Azure).
    • Ideally some programming skills in languages like Python, Java, or Scala, with experience in automation and scripting.
    • Experience with containerization and orchestration tools like Docker and Kubernetes is a plus.
    • Experience with data governance, data security, and compliance best practices.
    • Understanding of software development methodologies and best practices, including version control (e.g., Git) and CI/CD pipelines.
    • Analytical and problem-solving abilities, with a proactive attitude towards identifying and resolving issues.
    • Excellent communication and collaboration skills to work effectively in a team-oriented environment.
    • Ideally a background in cloud computing and data-Intensive applications and services, with a focus on Google Cloud Platform
    • 3+ years of experience in data engineering or data science.
    • Experience with data quality assurance and testing.
    • Ideally knowledge of GCP data services (BigQuery; Dataflow; Data Fusion; Dataproc; Cloud Composer; Pub/Sub; Google Cloud Storage)
    • Understanding of logging and monitoring using tools such as Cloud Logging, ELK Stack, AppDynamics, New Relic, Splunk, etc.
    • Proven ability to learn new technologies, including open source and cloud-native offerings
    • Knowledge of AI and ML tools is a plus
    • Google Associate Cloud Engineer or Data Engineer certification is a plus

    Responsibilities:
    • Automate provisioning of infrastructure as code, using tools such as Terraform and KCC
    • Build self-service capabilities for development teams to improve time-to-market and promote cloud adoption
    • Create CI/CD pipelines using Jenkins, Bitbucket/Git
    • Create monitoring dashboards and metrics using Splunk, Prometheus, Grafana
    • Write unit tests in Go/Python/Java
    • Work on a globally distributed team


    CME Group: Where Futures Are Made

    CME Group ) is the world's leading derivatives marketplace. But who we are goes deeper than that. Here, you can impact markets worldwide. Transform industries. And build a career shaping tomorrow. We invest in your success and you own it, all while working alongside a team of leading experts who inspire you in ways big and small. Problem solvers, difference makers, trailblazers. Those are our people. And we're looking for more.

    At CME Group, we embrace our employees' diverse experiences, cultures and skills, and work to ensure that everyone's perspectives are acknowledged and valued. As an equal opportunity employer, we recognize the importance of a diverse and inclusive workplace and consider all potential employees without regard to any protected characteristic.
    The Candidate Privacy Policy can be found here.


  • CME Group Belfast, United Kingdom

    Applications processed via employer's online application form · A crucial role in CME's Cloud data transformation, the data SRE will be aligned to data product pods ensuring the our data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidl ...


  • CME Group Belfast, United Kingdom Full time

    Data System Reliability Engineer (dSRE) · A crucial role in CME's Cloud data transformation, the data SRE will be aligned to data product pods ensuring the our data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidly. · Automate data ta ...


  • CME Group Inc Belfast, United Kingdom

    Data System Reliability Engineer (dSRE) · A crucial role in CME's Cloud data transformation, the data SRE will be aligned to data product pods ensuring the our data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidly. · Automate data tas ...


  • Imperva Belfast, United Kingdom

    Imperva is an analyst-recognized cybersecurity leader—championing the fight to secure data and applications wherever they reside. Once deployed, our solutions proactively identify, evaluate, and eliminate current and emerging threats, so you never have to choose between innovatin ...


  • CME Group Inc Belfast, United Kingdom

    Description · Data System Reliability Engineer (dSRE) · Role Overview: · A crucial role in CME's Cloud data transformation, the data SRE will be aligned to data product pods ensuring the our data infrastructure is reliable, scalable, and efficient as the GCP data footprint expa ...


  • CME Group Belfast, United Kingdom

    Applications processed via employer's online application form · As the world's leading and most diverse derivatives marketplace, CME Group ( · A crucial role in CME's Cloud data transformation, the data SRE will be aligned to data product pods ensuring the our data infrastructur ...


  • Symphony Belfast, United Kingdom

    About us @Symphony · We've spent the last 10 years building the financial markets largest, most trusted communication network. Over 500 market participants across the buy-side, sell-side, securities servicing, and beyond. Over half a million users from trading desks to operation ...


  • Imperva Belfast, United Kingdom

    Imperva is an analyst-recognized cybersecurity leader—championing the fight to secure data and applications wherever they reside. Learn more: , our blog , on Twitter . · Imperva's Infrastructure and Cloud team is 2 years old and is staffed with senior leadership from Netflix, Cl ...


  • CME Group Belfast, United Kingdom

    Applications processed via employer's online application form · As the world's leading and most diverse derivatives marketplace, CME Group ( · Job Title: Network Reliability Engineer III · Description: · As we embark on a journey to transform the Network Services Group in CME, ...


  • aPriori Technologies Belfast, United Kingdom

    Job Summary: · Join us as a Senior Site Reliability Engineer (SRE), where you'll play a pivotal role in working with our customers and developers by providing expert guidance on cloud infrastructure best practices and streamlining build and deployment processes at scale. Your pri ...


  • CME Group Belfast, United Kingdom

    Applications processed via employer's online application form · We are seeking a highly-skilled and passionate SRE to join our dynamic team and help ensure the reliability and performance of our Markets trading applications. These systems that must achieve a unique blend of ultr ...


  • MCS Group Belfast, United Kingdom

    MCS Group is partnering with a global solutions company in their search for a Site Reliability Engineer keen to involved in a new greenfield re-architecture project. Working with one of the highest grossing industries in the world, the successful SRE will be helping kick off this ...


  • MCS Group Belfast, United Kingdom

    MCS Group is partnering with a global solutions company in their search for a Site Reliability Engineer keen to involved in a new greenfield re-architecture project. Working with one of the highest grossing industries in the world, the successful SRE will be helping kick off this ...


  • eFinancialCareers Belfast, United Kingdom

    **Description** · The Manager Software Engineering independently manages a team that is accountable for engineering secure, scalable and reliable technology solutions to advance CMEG in the global marketplace and serve risk management needs of customers around the world. · Princi ...

  • Vickerstock

    Fitter's Mate

    1 day ago


    Vickerstock Belfast, United Kingdom

    Posted 25 January 2024 · Salary Negotiable · LocationBelfast · Job type Temporary · Discipline Engineering & Manufacturing · ReferenceSMD9138_ · Contact NameSarah McDevitt · **Job description**: · **Fitter's Mate** · **Belfast** · **Monday to Friday, 8am - 4pm** · Seeking a skil ...


  • eFinancialCareers Belfast, United Kingdom

    **Description** · The Ld Software Engineer independently engineers secure, scalable and reliable technology solutions to advance CMEG in the global marketplace and serve risk management needs of customers around the world. · Principal Accountabilities: · - Conducts full system te ...


  • eFinancialCareers Belfast, United Kingdom

    **Description** · The Software Engineer II engineers secure, scalable and reliable technology solutions, with appropriate mentoring, to advance CMEG in the global marketplace and serve risk management needs of customers around the world. · Principal Accountabilities: · - Applies ...

  • eFinancialCareers

    Software Engineer I

    1 week ago


    eFinancialCareers Belfast, United Kingdom

    **Description** · Develop Software Engineering skills to fast track your career · Our software engineer roles provide the opportunity to innovate, design, build and implement enterprise quality software solutions that help power the global economy. Our engineers learn how to buil ...


  • Crown Industries Ltd. Belfast, United Kingdom

    **Trainee Data Engineers** · **Crown Infrastructure Solutions** is a multi-disciplined provider of I.P focused and complementary building solutions. Our service offering spans the commercial, industrial and data centre sectors across the UK and Ireland marketspace. · With offices ...


  • Morrow Group Belfast, United Kingdom

    Morrow Contracts was founded nearly 40 years ago and is one of the most respected utilities and civil engineering companies in Northern Ireland. Morrow Contracts is an integral member of the utilities industry, a joint-venture company undertaking electricity, sewer, telecoms, gas ...