- Design, build, and manage Azure-based data pipelines, including Databricks integration, to cater to the analysis and reporting needs of our clients.
- Develop, test, and optimise Azure SQL databases, data models, reports, and dashboards.
- Collaborate closely with the senior engineering team to comprehend project requirements and play a hands-on role in their realisation.
- Expertly use Azure data services (including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and others) to extract, transform, and load (ETL) data from various sources.
- Take initiative in data governance and quality control tasks, ensuring the integrity and security of client data within the Azure platform.
- Monitor, evaluate, and optimise performance within Azure cloud services, including Databricks workflows.
- Thoroughly document systems and processes, including detailed Azure data flows, schemas, and Databricks notebooks.
- Proactively identify and implement ways to enhance system performance and efficiency within the Azure ecosystem, including optimisations in Databricks.
- Master's or Bachelor's Degree in Computer Science, Cloud Computing, or a related field.
- 1-3 years of experience in a similar role, with hands-on experience in Databricks.
- Advanced proficiency in SQL and deep knowledge of Azure SQL databases.
- Proficiency with Python or another relevant programming language.
- Hands-on experience with the Azure Data Platform Stack.
- Outstanding problem-solving skills and a meticulous attention to detail.
- Strong communication skills with the knack for simplifying complex topics.
- Resilience to thrive in a dynamic environment, adeptly managing multiple projects.
- Proactive mindset with a readiness to embrace and overcome challenges.
- A chance to be part of a pioneering data consultancy during its formative phase and directly influence its trajectory of growth and accomplishment.
- Enhanced mentorship and a rich, hands-on experience across a spectrum of ground-breaking projects.
- Attractive compensation and benefits package.
- The privilege and convenience of remote work.
Data Engineer - London, United Kingdom - Krystal Clarity
Description
Job Description
Job Title: Junior-Mid Level Data Engineer
Company: Krystal Clarity
Location: London/Remote
Job Type: Full-Time
About Us:
Krystal Clarity is a rapidly emerging data engineering consultancy that helps businesses leverage data to achieve their strategic objectives. As a lean, fast-paced, and dynamic company, we are looking for an ambitious Data Engineer who thrives in an entrepreneurial environment and seeks to be part of the foundational team driving the company's growth and success.
Position Overview:
We are seeking a dedicated and driven Data Engineer with solid experience in Azure Data Platforms and Databricks. The successful candidate will play a pivotal role in diverse and exciting data-centric projects, collaborating closely with senior engineers and making significant contributions. This role provides an excellent platform to further sharpen your skills and make a notable impact in a vibrant entrepreneurial environment.
Responsibilities:
Requirements:
What We Offer:
To apply, please forward your CV along with a cover letter expressing your enthusiasm for the role to