- Data Pipeline Management: Design, build, and maintain scalable data pipelines using Azure Databricks.
- ETL Processes: Develop and implement robust ETL processes using big data technologies.
- Data Modelling: Apply strong expertise in data modelling techniques and warehousing solutions to support operational and analytical use cases.
- Programming and Querying: Use Python for complex data manipulation tasks and SQL to query large datasets.
- Data Integration: Seamlessly integrate data from various internal and external sources, including third-party vendors and APIs, to enrich existing datasets and expand the scope of actionable insights.
- System Optimisation: Continuously analyse and optimise data systems for enhanced performance and scalability.
- Professional Experience: At least four years of relevant data engineering experience.
- Technical Proficiency: Strong familiarity with Azure Databricks, Spark, Hive, Python, and SQL. Knowledge of Azure cloud services such as Data Factory and Storage accounts is highly regarded.
- Data System Mastery: Proven ability to handle data at scale, including data warehousing and data lakes.
- Collaboration and Communication: Excellent communication skills, with the ability to work effectively in a remote team environment.
- Machine Learning: Experience with machine learning models and familiarity with frameworks like TensorFlow or PyTorch.
- Data Visualisation: Proficiency in using Power BI to create impactful visualisations that drive strategic decisions.
- Real-Time Processing: Experience with real-time data processing technologies.
- Salary: £60,000 - £70,000 (depending on experience)
- Holidays per annum: 25 days + your birthday
- Pension: Biscuit will match employee contributions up to 6%
- Private Medical Insurance
- 4 x salary Life Cover
- 2 x salary for Critical Illness
- 75% salary Income Protection
- Professional Development: £500 towards personal development to support your career growth
Data Engineer - England, United Kingdom - Biscuit
Description
At Biscuit, our mission is to make pet wellbeing easy, fun and rewarding for members – leading to happier and healthier pets. We understand the importance of our connection to our pets and the pivotal role they play in our lives.
We are looking for a talented Data Engineer to join our dynamic team. In this role, you will leverage cutting-edge technologies to enhance our data capabilities, providing critical insights that drive our mission forward. If you're passionate about making a significant impact through innovative data solutions, we'd love to hear from you.
Your Role:
Requirements:
Nice to have:
We are looking for passionate innovators who are also interested in shaping an environment where people can flourish, are curious about our vision, motivated by our mission, and value the strength of team work.
Due to the nature of working remotely, Biscuit is acutely focused on team culture and hiring people who are excellent at collaborating and creating world-class products. We aim to get together at least six times a year for social events where travel expenses are covered.
Remuneration:
The role reports directly to Head of Data.