DevOps Engineer - London, United Kingdom - Reload Search Ltd

Description

Job Description

We are seeking a talented and versatile individual to join our team as a DevOps Engineer focused on LLMs. In this hybrid role, you will be responsible for developing and maintaining robust data pipelines, optimizing data workflows, and ensuring the reliability and scalability of our infrastructure through efficient DevOps practices.

RESPONSIBILITIES

• Utilize LLM capabilities to enhance automation, decision-making, and data analysis in infrastructure and pipelines.
• Integrate LLM-based solutions for task automation, workflow optimization, and system efficiency improvement.
• Collaborate with data scientists and engineers to deploy LLM-powered applications for NLP, sentiment analysis, and content generation.
• Stay informed on LLM technology advancements to address business challenges.
• Architect and maintain cloud infrastructure on Google Cloud, AWS, Azure to support applications and workflows.
• Automate CI/CD pipelines for efficient software delivery using GitHub Actions, CircleCI, or similar tools.
• Implement monitoring systems to proactively identify and resolve pipeline issues and bottlenecks.
• Design and maintain cloud infrastructure for data storage, processing, and analysis.
• Implement security best practices to safeguard data integrity and confidentiality.
• Ensure compliance with security standards across all infrastructure components.

QUALIFICATIONS

• Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent practical experience).
• Proven experience (3+ years) working as a Data Engineer, DevOps Engineer, or similar role in a fast-paced environment.
• Strong programming skills in languages such as Python, JavaScript, with experience in building and maintaining data pipelines using tools like Apache Kafka, Google Cloud Dataflow or similar frameworks.
• Knowledge of natural language processing (NLP) techniques and frameworks, with experience working with LLMs.
• Experience with cloud platforms (Google Cloud, AWS, Azure) and proficiency in infrastructure as code tools such as Terraform or CloudFormation.
• Familiarity with DevOps practices and tools (e.g. Docker, Kubernetes, GitHub Actions, CircleCI) for automating deployment, monitoring, and scaling of applications.
• Proficiency in SQL and experience with relational and NoSQL databases (e.g., PostgreSQL, MySQL, BigQuery).
• Excellent problem-solving skills, attention to detail, and ability to work collaboratively in a cross-functional team environment.