Senior Data Engineer (PySpark)

  • Permanent
  • City of London, London
  • Salary: £50000 - £80000 per annum
  • Job Reference: BBBH1979_1630427660

Data Idols

Senior Data Engineer – Spark / PySpark

It is rare that we enjoy working with brands so much, but as a family run company, this retail organisation know how to look after their staff and give their employees control over their work (and working day!) and the freedom to try new things out.

They’re seeking a Senior Data Engineer to join them on a permanent basis to work with one of the many Data teams in their London office, with the role being split between remote and office working.

THE ROLE

You’ll be working with an ambitious team who are keen to explore new projects. You’ll be building reliable and scalable data platforms whilst working with some of the best Data Analysts and Data Scientists out there.

As a Senior Data Engineer you will be joining an existing team of 6 Engineers, in wider data org of 20 people. This is a modern data environment, applications written in Python and Scala and deployed to the cloud using TeamCity and Octopus. Microservices are packaged in containers and deployed to Kubernetes. Big data pipelines run on Spark and PySpark and are orchestrated using ADF. Git and VSTS for source control and Jira for backlog management.

YOUR SKILLS AND EXPERIENCE

  • Excellent understanding of Python
  • Strong experience using Azure
  • Very strong understanding and commercial experience using Spark, ideally with PySpark
  • Confident in using Databricks

This is a great opportunity for a Senior Data Engineer to join a household name who provide both professional and personal growth. Please submit your CV for further details and consideration. They are London based but set up for flexible working and hiring candidates based anywhere in the UK.

SALARY:

£50,000 – £80,000

Senior Data Engineer – Spark / PySpark

Upload your CV/resume or any other relevant file. Max. file size: 1 MB.