Senior Data Engineer | Databricks | Azure | PySpark
ABOUT YOU
You are an experienced Data Engineer with a passion for building scalable, production-grade data platforms. You thrive in environments where engineering excellence, automation, and data quality are key priorities. With strong expertise in Databricks, PySpark, and Azure technologies, you enjoy designing high-performance data solutions, driving technical improvements, and mentoring fellow engineers while contributing to a culture of continuous improvement and collaboration.
WHAT ARE YOU GOING TO DO
- Design, build, and optimise scalable data pipelines using PySpark and Databricks for large-scale data processing environments
- Develop and maintain high-quality Python code while applying engineering best practices such as code linting, formatting, and type hinting
- Contribute to automated testing frameworks using pytest to ensure reliability and maintainability of data solutions
- Support and enhance CI/CD pipelines within Azure DevOps to enable robust and repeatable deployments
- Collaborate with cross-functional teams to drive technical decisions, improve engineering standards, and mentor junior and medior Data Engineers
AN IDEAL PROFILE WOULD BE
- Around 10 years of experience in Data Engineering with a strong track record of delivering production-grade data platforms
- Extensive hands-on experience with Databricks, PySpark, and Python for large-scale data processing and orchestration
- Strong experience with Azure Data Factory, Azure DevOps, CI/CD practices, and automated testing frameworks
- Passionate about software engineering best practices, code quality, peer reviews, and maintainable solutions
- Proven ability to mentor engineers, influence technical direction, and contribute to engineering excellence across teams
Tick all the boxes? Then smash that button and let’s have a chat.
Levy is a leading Tech Recruitment agency connecting exceptional technology professionals with some of the most innovative organisations across Europe. We believe in building long-term relationships and matching the right talent with the right opportunities.
