- Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.
- Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
- SME Be able to understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
- Be able to monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
- Knowledge of understanding how Cloudera Spark is set up and how the run time libraries are used by PySpark code.
- High level understanding of Low-Code No-Code prophecy set up and its use to generate PySpark code.
-
Spark Architect
Found in: Ziprecruiter UK C2 - 8 hours ago
PRACYVA Sheffield, United KingdomJob Description · Spark Architect / SME · Contract Role- 6 months to begin with & its extendable · Location: Sheffield, UK (min 3 days onsite) · Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converter ...
-
Spark Architect
Found in: Talent UK 2A C2 - 2 hours ago
PRACYVA Sheffield, United KingdomSpark Architect / SME · Contract Role- 6 months to begin with & its extendable · Location: Sheffield, UK (min 3 days onsite) · Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. · Converted cod ...
-
Director of Engineering
Found in: Talent UK 2A C2 - 2 hours ago
SimplifyVMS Sheffield, United KingdomWho are we · SimplifyVMS is a leading global SAAS provider of contingent workforce VMS solutions and is one of the fastest growing extended workforce technology providers globally. Ranked by various industry analysts a leading platform SimplifyVMS continues to evolve and be the p ...
-
Director of Engineering
Found in: Jooble UK O C2 - 3 days ago
SimplifyVMS Sheffield, United KingdomWho are we · SimplifyVMS is a leading global SAAS provider of contingent workforce VMS solutions and is one of the fastest growing extended workforce technology providers globally. Ranked by various industry analysts as a leading platform, SimplifyVMS continues to evolve and be ...
-
Junior Architect
Found in: Jooble UK O C2 - 5 days ago
Searchability® Barnsley, South Yorkshire, United KingdomSoftware Architect · .Net Core/. C#/ Azure / SQL · Opportunity to join a market leader in the development and provision of Retail software environments · Visits to the office near Barnsley 2-3 times a week · We are a successful Software House who are leading in our market. Thi ...
-
NET Developer – Buxton
Found in: Appcast UK C C2 - 2 days ago
Noir Consulting Buxton, United Kingdom Undefined.NET Developer - Leading E-Book Firm - Buxton, Derbyshire · (Tech stack: .NET Developer, .NET 8, ASP.NET, C#, React, Angular 17, Microservices, , TypeScript, Azure, Web API 2, Agile, SQL Server 2022, Programmer, Full Stack Engineer, Architect, .NET Developer) · Our client are a l ...
-
Infrastructure Solutions Architect
Found in: Appcast UK C C2 - 3 days ago
Xpertise Recruitment Nottinghamshire, United KingdomSolution Architect - IT Infrastructure · Nottingham (5 days a week in the office) · 80k · Reporting to the Lead Solution Architect, your role will be to produce IT infrastructure high-level designs and proposals in response to internal customer requests and project demands. · Yo ...
-
Infrastructure Specialist
Found in: Appcast UK C C2 - 1 day ago
Pearson Carter Leeds, United KingdomInfrastructure Engineer · Pearson Carter are working with a fast growing global End User looking for an experiences IT Infrastructure Engineer to work within the IT Infrastructure team to maintain, support and develop the global IT Infrastructure. · Responsibilities: · Supporting ...
-
Lead Engineer/Data Engineer
Found in: Appcast UK C C2 - 4 days ago
HCLTech Leeds, United KingdomLead Data Engineer: · We need some strong Data engineer profiles... they need good experience with · Pyspark, Python, SQL, ADF and preferably Databricks experience · Job description: · Building new data pipelines and optimizing data flows using the Azure cloud stack. · Build ...
-
Infrastructure Specialist
Found in: Ziprecruiter UK C2 - 8 hours ago
Pearson Carter Leeds, United KingdomJob Description · Infrastructure Engineer · Pearson Carter are working with a fast growing global End User looking for an experiences IT Infrastructure Engineer to work within the IT Infrastructure team to maintain, support and develop the global IT Infrastructure. · Responsibili ...
-
Platform Engineer
Found in: Appcast UK C C2 - 5 days ago
Omni Leeds, United KingdomOmniTech is working with a confidential client to source a Platform Engineer who will work collaboratively with other teams within the business to create, update and maintain well-architected and best practice standards of Cloud Infrastructure across our multi cloud strategy. · T ...
-
Software Engineer
Found in: Appcast UK C C2 - 1 day ago
TBA Group Doncaster, United KingdomSoftware Engineer · Are you enthusiastic about software development that simplifies real-world complex terminal operations around the globe? · TBA Group is a leading international provider of software and services for ports, terminals, and warehouses with over 150 live installati ...
-
Python Developer Job
Found in: Jooble UK O C2 - 4 days ago
HCLTech Bradford, United KingdomHCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered around digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major ve ...
-
Software Engineer
Found in: Ziprecruiter UK C2 - 8 hours ago
TBA Group Doncaster, United KingdomJob Description · Software Engineer · Are you enthusiastic about software development that simplifies real-world complex terminal operations around the globe? · TBA Group is a leading international provider of software and services for ports, terminals, and warehouses with over 1 ...
-
ICT Configuration Analyst
Found in: Jooble UK O C2 - 1 day ago
Pearson Carter Leeds, United KingdomIT Development Analyst - Leeds · Pearson Carter are currently working with a fast-growing company who are passionate about transforming performance for a green productive world. They are currently looking for candidates with strong DevOps experience and knowledge. · Implementat ...
-
Infrastructure Specialist
Found in: Jooble UK O C2 - 1 day ago
Pearson Carter Leeds, United KingdomInfrastructure Engineer · Pearson Carter are working with a fast growing global End User looking for an experiences IT Infrastructure Engineer to work within the IT Infrastructure team to maintain, support and develop the global IT Infrastructure. · Responsibilities: · Support ...
-
Remote .NET Developer with React
Found in: Jooble UK O C2 - 2 days ago
Noir Consulting Buxton, Derbyshire, United KingdomNET Developer - Leading E-Book Firm - Buxton, Derbyshire · (Tech stack: .NET Developer, .NET 8, ASP.NET, C#, React, Angular 17, Microservices, , TypeScript, Azure, Web API 2, Agile, SQL Server 2022, Programmer, Full Stack Engineer, Architect, .NET Developer) · NET Developer at a ...
-
IT Development Analyst
Found in: Jooble UK O C2 - 1 day ago
Allied Healthcare Leeds, United KingdomIT Development Analyst - Leeds · Pearson Carter are currently working with a fast-growing company who are passionate about transforming performance for a green productive world. They are currently looking for candidates with strong DevOps experience and knowledge. · Responsibi ...
-
Specialist Infrastructure Engineer
Found in: Jooble UK C2 - 1 day ago
Energy Jobline ZR Leeds, United KingdomPearson Carter are working with a fast growing global End User looking for an experiences IT Infrastructure Engineer to work within the IT Infrastructure team to maintain, support and develop the global IT Infrastructure. · Supporting the day-to-day management of our existing IT ...
-
Infrastructure Solutions Architect
Found in: Jooble UK O L C2 - 3 days ago
Xpertise Recruitment Nottinghamshire, United KingdomSolution Architect - IT Infrastructure Nottingham (5 days a week in the office)80kReporting to the Lead Solution Architect, your role will be to produce IT infrastructure high-level designs and proposals in response to internal customer requests and project demands.You will ensur ...
SQL Architect - Sheffield, United Kingdom - PRACYVA
Description
Spark Architect / SMEContract Role- 6 months to begin with & its extendableLocation: Sheffield, UK (min 3 days onsite)Context:
Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues.
Skills:
Spark Architecture - component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
Spark SME