No more applications are being accepted for this job
- Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load data from diverse sources into data warehouses or data lakes.
- Collaborate with data architects and data analysts to understand data requirements and translate them into technical data models and structures.
- Implement data integration strategies and design data flow processes to ensure smooth data movement and transformation.
- Develop and maintain ETL workflows, scripts, and data processing jobs using programming languages (e.g., Python, Java, Scala) and ETL tools (e.g., Apache Spark, Apache Airflow).
- Identify and address data quality issues and implement data cleansing, validation, and enrichment processes.
- Collaborate with software developers to integrate data engineering solutions into applications and systems.
- Monitor and optimize data pipelines for performance, reliability, and scalability.
- Implement data security and privacy measures, including access controls and data encryption.
- Stay up to date with industry trends and emerging technologies in data engineering and recommend relevant tools and techniques for continuous improvement.
- Document data engineering processes, workflows, and standards.
- Proven experience as a Data Engineer or in a similar role, preferably as a contractor or consultant.
- Strong knowledge and understanding of data engineering principles, methodologies, and best practices.
- Proficiency in designing and implementing data pipelines, ETL processes, and data integration solutions.
- Experience with programming languages such as Python,
Data Engineer - London, United Kingdom - Tech Kinect
Description
Job Description
Job Description:
Data Engineer Contractor
Position Summary:
We are seeking a skilled and experienced Data Engineer Contractor to join our team on a contractual basis.
As a Data Engineer Contractor, you will be responsible for designing, developing, and maintaining data pipelines and systems to support our organization's data needs.
Your primary focus will be on extracting, transforming, and loading (ETL) data from various sources into data warehouses or data lakes, implementing data integration solutions, and ensuring data quality and availability.
You will collaborate closely with cross-functional teams, including data architects, data analysts, and software developers, to understand data requirements and deliver scalable and efficient data solutions.
Responsibilities:
Requirements: