technical architect - Telford, United Kingdom - Coforge

Description

Job Description

Azure Technical Architect Experience – 10+ years Skillset -
• At least 7-8 years of relevant experience in data engineering tools like Spark, Hadoop, Azure Data pipelines, Azure Data factory, Azure Databricks, Azure Data Lake Storage, Delta Lake, Python, SQL Server
• Strong knowledge and experience designing and implementing solutions on Azure cloud
• Demonstrated experience in building, tuning data pipelines on Spark, Cloud native tools like Azure Data Factory and Databricks notebooks
• Understand of both batch and stream ingestion patterns
• Experience working with business teams, dev teams and producing designs to deliver data solutions with best practices and standards
• Working in an agile environment Responsibilities:
• Design, develop, and implement scalable and efficient data pipelines, ETL processes, and workflows to collect, process, and store data from various sources
• Build and maintain data warehouses, data lakes, and other data storage systems to facilitate data accessibility, reliability, and performance
• Develop and optimize database schemas, data models, and queries to support efficient data retrieval and analysis
• Implement data quality assurance processes, including data validation, data cleansing, and error handling to ensure data accuracy and integrity
• Monitor and troubleshoot data pipelines and systems to identify and resolve issues, ensuring high availability and performance

Posted On

Azure Technical Architect Experience – 10+ years Skillset -
• At least 7-8 years of relevant experience in data engineering tools like Spark, Hadoop, Azure Data pipelines, Azure Data factory, Azure Databricks, Azure Data Lake Storage, Delta Lake, Python, SQL Server
• Strong knowledge and experience designing and implementing solutions on Azure cloud
• Demonstrated experience in building, tuning data pipelines on Spark, Cloud native tools like Azure Data Factory and Databricks notebooks
• Understand of both batch and stream ingestion patterns
• Experience working with business teams, dev teams and producing designs to deliver data solutions with best practices and standards
• Working in an agile environment Responsibilities:
• Design, develop, and implement scalable and efficient data pipelines, ETL processes, and workflows to collect, process, and store data from various sources
• Build and maintain data warehouses, data lakes, and other data storage systems to facilitate data accessibility, reliability, and performance
• Develop and optimize database schemas, data models, and queries to support efficient data retrieval and analysis
• Implement data quality assurance processes, including data validation, data cleansing, and error handling to ensure data accuracy and integrity
• Monitor and troubleshoot data pipelines and systems to identify and resolve issues, ensuring high availability and performance

Department

UK Europe

Posted On UK Europe Open Positions

1

Posted On 31-Dec- Skills Required

AZURE DATA BRICKS

Posted On AZURE DATA BRICKS Location

Telford, Shropshire

Posted On Telford, Shropshire Years Of Exp

10.0 to 15.0 Years

Posted On 10.0 to 15.0 Years Posted On 11-Apr-