Data Engineer - Ash, United Kingdom - Maxamtech Digital Ventures Pvt Ltd

Description

Overview:

KeyResponsibilities:

• Design and developrobust scalable data pipelines for ingesting integrating andtransforming large volumes of structured and unstructureddata
• Implement ETL processes to efficientlyextract load and transform diverse datasources
• Create and maintain data models andschema designs to support analytics and reportingrequirements
• Optimize data infrastructure andarchitecture for performance reliability andcosteffectiveness
• Collaborate withcrossfunctional teams to understand data requirements and implementsolutions
• Implement data security andcompliance measures to protect sensitiveinformation
• Monitor and troubleshoot datapipeline and infrastructure issues
• Documentdata processes data flow and infrastructurecomponents
• Keep abreast of emergingtechnologies and best practices in dataengineering
• Contribute to the continuousimprovement of data quality consistency andaccuracy

RequiredQualifications:

• Bachelors or Mastersdegree in Computer Science Engineering or relatedfield
• Proven experience in data engineeringdatabase development or relatedroles
• Proficiency in SQL and databasetechnologies for data manipulation andoptimization
• Strong programming skills inPython for data processing
• Experience with datamodeling Data clearing visualization text processing Imageprocessing
• Knowledge of Big Data technologiessuch as Hadoop Spark or Hive
• Handson experiencewith cloud platforms like AWS (quicksight glueRDS)
• Expertise in ETL tools and processes tomanage data pipelines
• Familiarity with datavisualization tools like Power BI orsimilar
• Excellent problemsolving analytical andcommunication skills
• Ability to workeffectively in a collaborative agileenvironment
• Strong attention to detail andcommitment to delivering highqualitysolutions

sql,python,etl,datamodeling,big data,data warehousing,aws,spark,datavisualization,visualization,processing,excel,powerbi