Principal Data Engineer - Belfast, United Kingdom - Cloudsmith
Description
Job Description
nineDots are excited to be helping Cloudsmith ramp up their data engineering function. They are on a truly amazing upward trajectory with fantastic seasoned pros at the helm. It's gonna be a fun journey.
Are you ready to lead the design and implementation of a best-in-class data platform on AWS?Doyou have a deep understanding of data engineering principles and a passion for creating scalable, efficient, and secure data solutions?
If you're seeking a challenging and rewarding role, join Cloudsmith as our Principal Data Engineer
We help our customers manage and secure their software supply chain, and improve their developer experience. We are by developers, for developers.
Our culture operates with openness and transparency, driven by our ambition to build a great company. We enjoy working with great people and customers. We learn, support one another, and we're growing. Now is a great time to join us. The Opportunity that lies ahead As Principal Data Engineer, you will be instrumental in designing and building our new data platform.
This platform is critical to our business strategy and will serve as the backbone for providing insights to customers to help improve their software supply chain, and serve as the foundation for AI-powered features that leverage our large amounts of static and event data across all of our customers' build usage
Your Role:
● Designand Development: Spearhead the design and development of our new data platform. Your expertise will guide the architecture, data modelling, and implementation of scalable, maintainable and efficient data pipelines.
● Collaborate with Cross-Functional Teams: Work closely with data engineers, software engineers, and business stakeholders to ensure the platform meets business needs and integrates seamlessly with other systems.
● Innovation and Continuous Improvement: Stay abreast of the latest developments in data engineering and AWS technologies. Drive innovation and continuous improvement in our data practices.
● DataGovernance and Security: Help establish and maintain data governance practices, ensuring data security, quality, and compliance.
● Mentoring and Leadership: Mentor junior data engineers and promote a culture of learning and excellence within the team. Required Skills and Experience:
● Extensive Experience in Data Engineering: Proven track record in designing and building large-scale data platforms, particularly on AWS.
● Expertise in AWS Services: Deep knowledge of AWS services related to data engineering (e.g., Redshift, S3, Glue, Lambda, Kinesis).
● Strong Programming Skills: Proficiency in languages like Python, SQL, and experience with data pipeline tools.
● DataModeling and Warehousing: Expertise in data modeling techniques and experience with data warehousing solutions.
● Excellent Problem-Solving Skills: Ability to tackle complex challenges and provide efficient, innovative solutions.
● Leadership and Communication: Strong leadership skills with the ability to communicate effectively across various levels of the organization.
Technology Stack We are cloud-native, born in AWS, and embrace their services across our platform. Our technology stack includes Python, Django, ECS, Kinesis, Cloudfront, Flink, Elasticsearch, Lambda, Amazon MQ, Terraform, and Postgres