Logo Atolls

Data Engineer

Atolls

Job

  • Level
    Experienced
  • Job Field
    Data, Back End
  • Employment Type
    Full Time
  • Contract Type
    Permanent employment
  • Location
    Munich
  • Working Model
    Hybrid, Onsite

    • Job Summary

    In this role, you will develop robust data pipelines using Python and Spark, orchestrate them with Apache Airflow, and implement infrastructure as code to optimize a cloud-based data platform.

    Job Technologies

    Your role in the team

    • Design, build, and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability using Python, Spark, and Clickhouse.
    • Develop and operate workflow orchestration with Apache Airflow to schedule, monitor, and manage data pipelines and transformations.
    • Manage, model and document critical data systems for analytics using SQL and dbt to support business intelligence and reporting workloads.
    • Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based data platform components.
    • Containerize and deploy services using Docker and Kubernetes (and related tooling such as Helm).
    • Collaborate with analysts, application teams, and other stakeholders to turn requirements into technical designs and delivered solutions.

    This text has been machine translated. Show original

    Our expectations of you

    Qualifications

    • Python - robust, idiomatic, tested. You write pipelines that others can read and easily debug.
    • SQL - advanced. Window functions, CTEs, query plans, and the instinct to know why a query got slow.
    • Data modeling & warehousing - dimensional modeling, incremental vs. full-refresh strategies, slowly changing dimensions, and the trade-offs between them.
    • dbt - building, testing, and documenting models in a real project.
    • Apache Airflow - authoring DAGs, plus the operational side: backfills, retries, SLAs, and debugging a failed run.
    • Docker & Kubernetes - you can containerize a job and understand what happens when a pod won't schedule.
    • Git and CI/CD - branching, code review, and pipelines that gate merges.
    • Knowledge of ClickHouse or another columnar OLAP engine (BigQuery, Redshift) table engines, partitioning, and MergeTree tuning are a big plus.
    • Vertrautheit mit Infrastructure as Code (IaC) - Terraform, Helm, Ansible.
    • Working knowledge of Apache Spark - PySpark or Scala.
    • Attention to detail - You care about correctness and you build the checks that prove it. In data engineering, a silently wrong number is worse than a loud failure.
    • Ownership - you run what you build, and you improve it when needed.
    • Clear communication - you can effectively explain in a pipeline to an analyst and a trade-off to a stakeholder.
    • Pragmatism - you can tell the difference between the right long-term design and the short-term solution, and you know when each one applies.
    • Collaboration - you work well with data engineers, analysts, and other product and backend teams.
    • English - fluent, written and spoken.

    Experience

    • 4+ years building and running production data pipelines.
    • AWS - practical experience with S3 and the surrounding data services (Athena, Kinesis, EKS, Lambda).
    • Good experience with streaming data ingestion technologies such as Kafka, Kinesis, or similar.
    • Experience with data lake architectures - Parquet, Iceberg, or Delta Lake, and an understanding of layered lake design (bronze, silver, gold).
    • Experience with BI tooling - Apache Superset, Looker, Tableau, or equivalent.
    • Starke Erfahrung in der Integration von APIs Dritter - Umgang mit inkonsistenten Schemata, Rate Limits und unvorhersehbaren Fehlerarten in großem Maßstab.

    This text has been machine translated. Show original

    What we offer

    • A culture that values personal and professional development, with internal mobility opportunities.
    • A supportive and open-minded team that embraces diverse perspectives and innovative ideas.
    • 32 days of paid vacation plus your birthday off, giving you the time you need to recharge.
    • A flexible hybrid working scheme to balance work and life.
    • Access to a learning budget and internal training to help you grow in your role.
    • Mental health coaching to support your well-being.
    • Regular global and local get-togethers to celebrate successes and build connections.
    • The possibility of taking a sabbatical after three years with the company.
    • A cloud-based company setup, providing flexibility and collaboration opportunities no matter where you are.

    This text has been machine translated. Show original

    Topics that you deal with on the job

    Job Locations

    • Location Munich

      Bayern

      Germany

    This is your employer

    Atolls

    Atolls

    Atolls GmbH is Europe's largest shopping engagement platform with over 1,000 employees and a presence in more than 20 markets. The company connects consumers with brands and retailers to enable smart purchasing decisions. Well-known platforms include mydealz.de, Shoop, and Coupons.com.

    Description

  • Company Type
    Established Company
  • Working Model
    Hybrid, Onsite
  • Industry
    Internet, IT, Telecommunication
    • Logo Atolls

    Data Engineer

    Atolls
    Location
    Munich
    Working Model
    Hybrid, Onsite
    Diversity
    Open for all genders
    English Only
    English only required

    More Jobs