Job
- Level
- Senior
- Job Field
- Data, Back End
- Employment Type
- Part Time/Full Time
- Contract Type
- Permanent employment
- Location
- Leipzig
- Working Model
- Hybrid, Onsite
Job Summary
In this role, you will design and implement efficient data pipelines on Databricks, mentoring your team in best practices while applying modern architectures and optimizations.
Job Technologies
Your role in the team
- This role as "Senior Software Engineer (f/m/d) - Databricks Data Engineering & Analytics" in our team "Data Development" is an opportunity to do more than contribute your technical expertise.
- You will take ownership of data engineering and play a key role in shaping the culture, standards, and practices of a growing team.
- As a catalyst for change, you will not simply fill an existing gap.
- You will raise the capabilities of the entire team and organization, creating an impact that is multiplicative rather than additive.
- You will work with Databricks from your first day, building on a modern, cloud-native platform instead of maintaining legacy systems.
- With dedicated teams responsible for infrastructure, platform engineering, and DevOps, you can concentrate on what you do best: advancing data engineering and mentoring your colleagues.
- The purpose behind this work is equally significant.
- ECC's data is mission-critical for European energy markets, meaning your contribution will help ensure that homes stay warm and that Europe can successfully move towards a green future.
- Design and build production-grade data pipelines on Databricks (Google Cloud) using Databricks Workflows, Spark SQL, and Python.
- Focus on creating solutions that are fast to implement, cheap to maintain, and highly reliable.
- Lead the adoption of Databricks best practices across the team: Delta Lake optimization, Photon query acceleration, cost governance, and performance tuning.
- Document and teach these practices so your teammates become independent.
- Architect scalable lakehouse solutions that support both analytics and operational workloads, applying modern design patterns (medallion architecture, data mesh principles).
- Mentor and upskill the team in Databricks: conduct code reviews, pair-programming sessions, and knowledge-sharing workshops.
- Your technical depth should elevate the entire group.
This text has been machine translated. Show original
Our expectations of you
Qualifications
- Delta Lake table design, optimization, and troubleshooting.
- Databricks Workflows for orchestration.
- Performance tuning.
- Cost optimization and monitoring.
- Python and/or Scala proficiency is essential; SQL expertise is critical.
- Modern tooling: Familiarity with Git-based version control, CI/CD principles, and testing frameworks for data code.
- Cloud comfort: You have worked with Google Cloud Platform (or AWS/Azure) and understand cloud data warehouse/lakehouse architecture.
- Analytical thinking: You can break down complex data problems, propose multiple solutions, and evaluate trade-offs (speed vs. cost vs. reliability).
- Communication: You can explain technical concepts to non-technical stakeholders (business analysts, product owners) and translate their requirements into data engineering solutions.
- Fluent in Business English and German at an intermediate level minimum.
Experience
- Databricks mastery: You have hands-on production experience with Databricks (1+ years), including building and optimizing ETL/ELT pipelines with Apache Spark (PySpark or Scala), Lakeflow Connect, Lakeflow Pipelines.
- Backend data engineering: Several years of professional experience building data pipelines in distributed systems.
This text has been machine translated. Show original
What we offer
- Attraktives Gehaltspaket mit vielen Vorteilen wie Kinderbetreuung, Essenszulage, Jobticket, Sport- und Freizeitveranstaltungen.
- Flexible hybrid work concept and flexible working hours.
- Personal development through extensive training opportunities.
- A place in a dynamic and international team within EEX Group and Deutsche Börse Group.
- A long-term perspective in the constantly growing and evolving energy industry.
- Bespoke onboarding plan.
This text has been machine translated. Show original
Benefits
Work-Life-Integration
Health, Fitness & Fun
Higher Take-Home Pay
Food & Drink
Topics You Will Work On
Job Locations
About Your Employer
Deutsche Börse AG
Deutsche Börse Group is one of the world's leading trading platforms. As a financial market organizer, the company offers a full range of services to cover the entire process: trading and clearing of securities and derivatives, netting and settlement of transactions, opening of accounts and provision of market information services.
Description
- Language
- English
- Company Type
- Established Company
- Working Model
- Hybrid, Onsite
- Industry
- Banking, Finance, Insurance
Senior Software Engineer - Databricks Data Engineering & Analytics
- Location
- Leipzig
- Working Model
- Hybrid, Onsite
- Diversity
- Open for all genders
