Job
- Level
- Experienced
- Job Field
- BI, Data
- Employment Type
- Full Time
- Contract Type
- Permanent employment
- Location
- Berlin
- Working Model
- Hybrid, Onsite
Job Summary
In this role, you will develop efficient data pipelines using Python and Spark, orchestrate them with Apache Airflow, and document data models with SQL and dbt for our analytics workloads.
Job Technologies
Your role in the team
- We are looking for a Data Engineer to join our Data Products team. At Atolls, your role will be instrumental in helping us shape the future of internal data products, creating exceptional user experiences and empowering consumers to make informed and confident shopping decisions.
- In this role, you will:
- Design, build, and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability using Python, Spark, and Clickhouse.
- Develop and operate workflow orchestration with Apache Airflow to schedule, monitor, and manage data pipelines and transformations.
- Manage, model and document critical data systems for analytics using SQL and dbt to support business intelligence and reporting workloads.
- Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based data platform components.
- Containerize and deploy services using Docker and Kubernetes (and related tooling such as Helm).
- Collaborate with analysts, application teams, and other stakeholders to turn requirements into technical designs and delivered solutions.
This text has been machine translated. Show original
Our expectations of you
Qualifications
- Must have:
- Python - robust, idiomatic, tested. You write pipelines that others can read and easily debug.
- SQL - advanced. Window functions, CTEs, query plans, and the instinct to know why a query got slow.
- Data modeling & warehousing - dimensional modeling, incremental vs. full-refresh strategies, slowly changing dimensions, and the trade-offs between them.
- dbt - building, testing, and documenting models in a real project.
- Apache Airflow - authoring DAGs, plus the operational side: backfills, retries, SLAs, and debugging a failed run.
- Docker & Kubernetes - you can containerize a job and understand what happens when a pod won't schedule.
- Git and CI/CD - branching, code review, and pipelines that gate merges.
- Nice to have:
- Knowledge of ClickHouse or another columnar OLAP engine (BigQuery, Redshift) table engines, partitioning, and MergeTree tuning are a big plus.
- Familiarity with infrastructure as code (IaC) - Terraform, Helm, Ansible.
- Working knowledge of Apache Spark - PySpark or Scala.
- Soft skills:
- Attention to detail - You care about correctness and you build the checks that prove it. In data engineering, a silently wrong number is worse than a loud failure.
- Ownership - you run what you build, and you improve it when needed.
- Clear communication - you can effectively explain in a pipeline to an analyst and a trade-off to a stakeholder.
- Pragmatism - you can tell the difference between the right long-term design and the short-term solution, and you know when each one applies.
- Collaboration - you work well with data engineers, analysts, and other product and backend teams.
- Language requirements:
- English - fluent, written and spoken.
Experience
- We're looking for someone with data engineering experience, who is dedicated to creating exceptional user experiences and driving innovation.
- 4+ years building and running production data pipelines.
- AWS - practical experience with S3 and the related data services (Athena, Kinesis, EKS, Lambda).
- Good experience with streaming data ingestion technologies such as Kafka, Kinesis, or similar.
- Experience with data lake architectures - Parquet, Iceberg, or Delta Lake, and an understanding of layered lake design (bronze, silver, gold).
- Experience with BI tooling - Apache Superset, Looker, Tableau, or equivalent.
- Starke Erfahrung in der Integration von APIs Dritter - Umgang mit inkonsistenten Schemata, Ratenbegrenzungen und unvorhersehbaren Fehlerarten in großem Maßstab.
This text has been machine translated. Show original
What we offer
- At Atolls, we believe in nurturing both your professional and personal growth. Here's what you can expect:
- A culture that values personal and professional development, with internal mobility opportunities.
- A supportive and open-minded team that embraces diverse perspectives and innovative ideas.
- 32 days of paid vacation plus your birthday off, giving you the time you need to recharge.
- A flexible hybrid working scheme to balance work and life.
- Access to a learning budget and internal training to help you grow in your role.
- Mental health coaching to support your well-being.
- Regular global and local get-togethers to celebrate successes and build connections.
- The possibility of taking a sabbatical after three years with the company.
- A cloud-based company setup, providing flexibility and collaboration opportunities no matter where you are.
- These are global benefits that apply to all employees, with additional local perks based on your location.
This text has been machine translated. Show original
Topics that you deal with on the job
Job Locations
This is your employer
Atolls
Atolls GmbH is Europe's largest shopping engagement platform with over 1,000 employees and a presence in more than 20 markets. The company connects consumers with brands and retailers to enable smart purchasing decisions. Well-known platforms include mydealz.de, Shoop, and Coupons.com.
Description
- Company Type
- Established Company
- Working Model
- Hybrid, Onsite
- Industry
- Internet, IT, Telecommunication
Data Engineer
- Location
- Berlin
- Working Model
- Hybrid, Onsite
- Diversity
- Open for all genders
- English Only
- English only required
