- Implement extensible optimizations in various query processing components such as batch processing code, data parsing, shuffling and data partitioning algorithms.
- Maintain the solution up to date and compatible with a variety of supported Apache Spark runtimes.
- Independently and diligently write, test and deploy production code driven by modern software engineering practices.
- Work with the internals of leading open-source software for Big Data analytics as part of our core product for the cloud.
- Collaborate with team members to drive new innovations on big data processing lying at the intersection of Big Data and compilers.
- 3+ years of experience working with performance optimization and complex codebases.
- Strong Java and C++ programming skills, as well as knowledge of GitHub workflows.
- Experience with profiling and debugging tools.
- Strong grasp of computer science fundamentals such as algorithms and data structures.
- Critical thinking and ability to work independently without direct supervision.
- Entrepreneurial spirit and previous experience in early stage startups.
- Experience with Scala.
- Experience with query processing optimization.
- Understanding of Big Data file formats (e.g. Parquet, ORC, Avro).
-
Developer - .NET/java/scala
1 week ago
Nigel Frank International Manchester, United Kingdom**Developer - Junior to Senior Level - .NET/Java/Scala** · Nigel Frank International is looking for a collaborative and skilled Developer (Java/Scala/.NET) to work on a remote basis in the UK. This full-time role offers a salary of up to £75k and some great employee benefits. · A ...
-
Technical Lead
4 days ago
Quantexa Liverpool, United Kingdom**What we're all about.** · It isn't often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtuall ...
-
Technical Lead
2 days ago
Reqiva Ltd Liverpool, United Kingdom**Technical Lead** · *** · Reqiva are currently partnered with a fantastic MedTech company based in Oxford, who are looking for a · **Technical Lead (Java) **to join their team. They are looking for an lead engineer who enjoys hands on work but also enjoys the responsibilities of ...
-
Data Cleanser
4 days ago
Veesupportservices Ltd Liverpool, United KingdomJob Summary: · Data Cleanser to work within children's social care service · To support and expedite accurate generic information on children's social care files there is a significant amount of data tidy up that is required. work with the data base and liaising with social worke ...
-
Hyperion Functional Consultant
5 days ago
Kryptos Technologies limited Liverpool, United KingdomTasks · Hyperion Consultant · Liverpool, UK · 12months Contract + Extension · **Roles & Responsibilities**: · - Responsible for HFM Month end close activities · - Strong knowledge on Hyperion financial Management Task flows / Consolidations · - Strong Knowledge on HFM business ru ...
-
Junior Data Engineer
1 week ago
Circle Recruitment Manchester, United KingdomJunior Data Engineer - Manchester · Key words: Data Engineer, Python, Java, Scala, R Programming, SQL, Data Analytics, Data Analyst · My client is a well-established software house in Manchester who are going through a big growth phase and as part of a large recruitment drive are ...
-
Lead Developer
21 hours ago
Searchability (UK) Ltd Manchester, United Kingdom Full timeLead Developer · Salary of £70k · Lead a high performing team of Developers · Hybrid working - 2-3 days onsite in Manchester · Java, Scala, MySQL, TDD, AWS · Join our team as a Lead Developer, where you'll play a pivotal role in shaping both our product and our team's growth. We ...
-
Scala Developer
1 week ago
Nigel Frank International Manchester, United Kingdom**Scala Developer - Fully remote - Up to £75,000.** · This client i am working with is a trusted global technology consultancy who deliver a quality service and ongoing support and assistance to client and helping with the delivery of ongoing projects and products. This client is ...
-
Lead Data Engineer
1 day ago
FOCUS 5 RECRUITMENT LTD Manchester, United Kingdom**Lead Data Engineer** · Focus 5 Recruitment are looking for a Contract Lead Data Engineer for a 6-month (minimum) contract with a large client, therefore operating inside of IR35. · **What you'll do as the Lead Data Engineer**: · - Hands-on participation in Engineering tasks suc ...
-
Data Engineer
4 days ago
Ikhoi Recruitment Trafford Park, United KingdomA fantastic opportunity has arisen for an aspiring Data Engineer to come and join a cutting edge market research company. · You'll be a bright graduate looking for your next move with at least a year's experience. · You will be working in the data pipeline team whose main functio ...
-
DevOps Kafka
2 days ago
Hyperloop Recruitment Manchester, United Kingdom* Kakfa Experience · - Java/Scala · - Data Integration Experience · Contract Kakfa Engineer · DevOps Team · Data Processing · 450/ Months Likely Extensions beyond · Fully Remote Working Outside IR35 · As a Kafka Engineer, you will be responsible for building a data integration pl ...
-
Data Engineer Aws
6 days ago
Lorien Manchester, United Kingdom**IND_PC2** · You will join a market leading, growing, and successful independent communications, IT, and cloud services provider, who offer products and services to clients in the UK and worldwide. The company fosters an inclusive, co-operative, and supportive cultureto help eve ...
-
Java Team Lead
2 days ago
Erin Associates Chorley, United Kingdom Full timeSoftware Engineering Team Lead – Chorley, Lancashire · Java Development Team Lead– Agile, Java, Hibernate, Spring, Junit, HTML, CSS · This well-established software solutions provider is looking to add a Java Team Lead / Software Engineering Team Leader to join their talented dev ...
-
Senior Java Developer
2 days ago
Applause IT Manchester, United Kingdom**Senior Java Developer (Java Spring Microservices Linux Docker Kubernetes) - Established Global Ecommerce** · **Fully remote (anywhere in the UK) - £70,000 - £80,000 + benefits** · Applause IT are working closely with a global ecommerce business to build out their expanding engi ...
-
Software Engineering Team Lead
4 days ago
Erin Associates Chorley, United Kingdom Full timeSoftware Engineering Team Lead – Chorley (hybrid) · Software Engineering Team Lead– Agile, Java, Hibernate, Spring, Junit, HTML, CSS · This well-established software solutions provider is looking to add a Software Engineering Team Lead to join their talented development team base ...
-
Senior Java Engineer
1 week ago
Adria Solutions Ltd Manchester, United KingdomSenior Java Engineer - Remote Working - £65K-£80K · On behalf of our industry-leading client, we are recruiting several Senior Java Engineers. As Senior Java Engineer, you should be comfortable working with high-performing systems handling big data volumes with high availability ...
-
Software Engineer
1 week ago
CPS Group Salford, United KingdomSoftware Engineer · Salford, Manchester · Salary circa £50,000 - £65,000 + performance/annual bonus+ benefits · Hybrid · - flexible approach 1-2 days a week in the office · CPS are working with a rapidly expanding IT Consultancy who have a great opportunity for a Software Enginee ...
-
Software Engineer
4 days ago
CPS Group Manchester, United KingdomSoftware Engineer · Salford, Manchester · Salary circa £50k-£65k+ performance/annual bonus+ benefits · Hybrid · - flexible approach 1-2 days a week in the office · CPS are working with a rapidly expanding IT Consultancy who have a great opportunity for a Software Engineer to join ...
-
Senior Test Engineer
4 days ago
Circle Recruitment Manchester, United Kingdom**Senior Test Engineer - SEIT - Python, Java, Data, AWS · Manchester (1 day a month in the office) · £60,000-£70, % Pension, Bonus · **A household giant in the Automotive space has recently partnered with Amazon to deliver the data services that is going to drive/train the AI and ...
-
Quantexa - Tech Lead
1 week ago
KPMG-UnitedKingdom Manchester, United Kingdom**Job description** · **Quantexa Tech Lead** · **Service Line Information**: · In KPMG's Digital Lighthouse Advanced Analytics Consulting practice, we don't limit ourselves to either strategy or implementation. Instead, we deliver both - equally well. Indeed, it's this broad capa ...
Senior Software Engineer, Query Performance, Java/Scala - Liverpool, United Kingdom - Xonai
Description
We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs.
So far, we have raised a total of $3.5M in Seed funding. This gives us the flexibility to grow our team, provide world-class support to our customers, and expand our solution to new markets.To learn more about us, visit our blog.
About the role
As a Senior Software Engineer for this role, you will collaborate with the founding team to expand the integration of our Big Data processing acceleration technology with Apache Spark to drive new optimizations and broader SQL operation coverage. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is being deployed.
Join us in building a cutting edge solution for the cloud to realize cost-effective data infrastructure at scale and with unparalleled flexibility.
What you will do:
What you will bring:
Nice-to-haves:
Since we are a remote company, we are open to candidates from overseas.
No recruitment agencies please.