Workplace image SQUER

Lead Data Engineer - Data Migration & Lakehouse

SQUER

Job

In this role, you lead complex data migrations from legacy systems to modern cloud lakehouse architectures. You design robust data pipelines, establish data quality standards, and communicate risks effectively to all stakeholders.

Job summary

This listing has been machine translated. Show original

Job technologies

Your role in the team

  • You thrive on turning decades of legacy complexity into clean, modern data architecture.
  • You feel at home navigating undocumented mainframes, tangled schemas, and ambiguous specs — and you know how to translate that chaos into a clear technical path forward.
  • If you love owning complex migrations end-to-end, building trust with stakeholders through clarity and honesty, and shaping how data moves from legacy into the lakehouse era — this is for you.
  • Migration Ownership: Lead large-scale migration projects from legacy systems (ranging from SQL over ERP to mainframes) into modern cloud/lakehouse targets, taking full technical responsibility.
  • Databricks Architecture: Design and implement robust pipelines using Spark, Delta Lake, Unity Catalog, Lakeflow Declarative Pipelines, and Databricks Asset Bundles for CI/CD-style deployment.
  • Data Modeling & Reconciliation: Own data modeling, schema mapping, and reconciliation across heterogeneous systems, resolving structural mismatches independently.
  • Discovery & Assessment Leadership: Reviewing source documentation, interviewing SMEs, producing gap analyses, and translating ambiguous or outdated specs into concrete technical requirements.
  • Data Quality & Validation: Establish data quality frameworks and automated validation as team standards.
  • Stakeholder Communication: Proactively surface risks — documentation gaps, structural mismatches — clearly and early to non-technical stakeholders, representing SQUER with confidence.

Our expectations of you

Qualifications

  • Databricks Depth: Hands-on mastery of the Databricks ecosystem — Spark, Delta Lake, Unity Catalog, Lakeflow Declarative Pipelines, and Asset Bundles for CI/CD-style deployment.
  • Data Modeling & Reconciliation: Strong command of data modeling and schema mapping across heterogeneous systems, from mainframes to legacy ERPs.
  • Communication & Risk Ownership: Ability to break down complex topics and surface risks early and clearly to both technical and non-technical stakeholders.
  • AI-Assisted Workflows: Comfort using AI/LLM-assisted tooling in a data pipeline context.
  • Exposure to agentic AI
  • Metadata management or data catalog tooling beyond Unity Catalog

Experience

  • Migration Track Record: Over 5 years of experience in data engineering, with several large-scale legacy-to-cloud/lakehouse migrations independently led.
  • Discovery Experience: Experience in discovery/assessment phases end-to-end — interviewing SMEs, identifying gaps between legacy systems and target architecture, turning ambiguity into concrete requirements.
  • Data Quality Rigor: Practical experience with data quality frameworks and automated validation (e.g., Great Expectations, dbt tests, custom reconciliation tooling).
  • Experience with legacy system archaeology (undocumented COBOL/mainframe systems, EDI, proprietary ERPs)
  • Experience building or evaluating LLM-based mapping/matching tools (schema matching, entity resolution)

What we offer

  • Ownership & Responsibility: At SQUER, we believe in empowering our team. In our flat hierarchies, your ideas and actions matter more than titles.
  • Learn & Grow: Tap into a € 5,000 annual training budget to sharpen your skills and take advantage of our in-house Leadership Academy.
  • Join and be part of our active tech community through meetups, hackathons and training sessions.
  • Get up to 40 hours per year of additional time off for your personal education.
  • Exciting Challenges & Real Impact: Dive into diverse projects where your work truly makes a difference – for our clients and for SQUER.
  • Flexibility for Performance: Benefit from hybrid work options, flexible hours, workations within the EU, and additional vacation days – giving you the freedom to perform at your best.
  • Tailored Tools for Success: Choose your preferred hardware configuration and leverage our suite of AI tools and licenses (Anthropic, OpenAI, and more) to suit your working style.
  • We Value You: Beyond perks and benefits, we offer a competitive annual salary to recognize your exceptional contributions.
  • Be Part of a Thriving Team Culture: At SQUER, collaboration and connection are at the heart of what we do.
  • Through open communication, shared successes, and meaningful team events – including our annual SQUER offsite – we cultivate a culture where everyone feels valued and inspired to grow together.
  • A Perks-Packed Workplace: Work in a central office near Ostbahnhof and enjoy meal vouchers, EGYM Wellpass membership, a free Deutschland-Ticket, JobRad, referral bonuses, Corporate Benefits, and Pluxee employee gifts for special occasions.
  • We believe in transparent and fair compensation. For this role, the annual gross salary ranges between € 81,000 and € 103,000 – the exact placement depends on the seniority level we assess together during the process.

Benefits

Topics you will work on

Job locations

Map of the job locations
© OpenMapTiles, © OpenStreetMap contributors
  • Location Munich
    August-Everding-Straße 25, 81671 München, Germany

About your employer

SQUER

Wien, München

We are a full-service provider that thinks agile and solves complex problems with technology. The result is efficient software solutions, successful product developments, and a precise agile evolution of our partner businesses.

Company size
50-249 Employees
Founding year
2019
Language
German, English
Company type
Digital Agency
Work model
Hybrid
Industry
Consulting · Internet, IT, Telecommunication

Employer reviews

4.9Total(1 review)
Working conditions
x
5.0
Team culture
x
5.0
Career growth
x
5.0
Engineering
x
4.9
  • HUK-COBURG VersicherungsgruppeCoburg

    • Hybrid
    • Onsite
    • Full Time

    Hello, let's say WE! We - the HUK-COBURG Insurance Group - are among the top 10 in Germany. Founded over 90 years ago, we are now the leading insurer for private households with over 13 million customers and the largest German auto insurer. Our...

    • Java
    • Spring Boot
    • Apache Kafka
  • GGW GroupHamburg

    • Easy Apply
    • Hybrid
    • Full Time

    The role As a Forward Deployed AI Engineer, you go directly into our specialist departments, understand the processes, and develop production-ready AI and automation solutions that will fundamentally change the way the entire GGW Group operates. You do...

  • ATSPMannheim

    • Easy Apply
    • Hybrid
    • Onsite
    • Part Time/Full Time
    • Senior

    Consultant & Project Manager – You are the primary contact for our clients and take on the leadership of new projects. Optimize processes & create added value – With your expertise, you will design more efficient workflows and support our clients with...

    • SAP for Healthcare
    • ABAP

Lead Data Engineer - Data Migration & Lakehouse

SQUER