Job
In this role, you will develop scalable ETL pipelines, integrate data from various sources, and ensure high data quality for analytics and machine learning. You will work closely with interdisciplinary teams.
This listing has been machine translated. Show original
Job technologies
Your role in the team
- As a Data Engineer, you are responsible for building, developing, and reliably operating modern data platforms and data pipelines.
- You ensure that data from different sources is efficiently integrated, processed, stored, and made available for analytics, reporting, machine learning, and operational applications.
- You work closely with Data Analysts, Data Scientists, Software Engineers, IT, and the business units.
- Development and operation of scalable ETL/ELT data pipelines.
- Connection and integration of data from various sources such as databases, APIs, files, and cloud systems.
- Development and enhancement of Data Warehouses, Data Lakes, and Lakehouse architectures.
- Transformation, cleansing, and validation of large data sets.
- Ensuring data quality, data consistency, and data availability.
- Development and optimization of data models for reporting and analytics.
- Automation of data processes and workflows.
- Monitoring and optimizing existing data pipelines in terms of performance, stability, and cost.
- Implementation of monitoring, logging, and alerting solutions.
- Implementation of requirements for data protection, security, and governance.
- Documentation of data flows, interfaces, and technical solutions.
- Collaboration with Data Analysts and Data Scientists in providing suitable data.
- Support in the development of a modern and scalable data platform.
Our expectations of you
Education
- Completed university degree or equivalent qualification in fields such as computer science, business informatics, data science, mathematics, statistics, electrical engineering, or a comparable technical or analytical discipline.
Qualifications
- Excellent knowledge of SQL.
- Good programming skills, preferably in Python.
- Understanding of Data Warehouse and Data Lake concepts.
- Basic understanding of cloud technologies.
- Knowledge of Databricks, Snowflake, or Microsoft Fabric.
- Knowledge of orchestration tools such as Apache Airflow.
- Knowledge of Infrastructure as Code, e.g., Terraform.
- Knowledge of streaming technologies such as Kafka.
- Analytical and structured thinking skills.
- High degree of personal responsibility and a solution-oriented working approach.
- Interest in modern data and cloud technologies.
- Ability to communicate complex technical issues clearly.
- Ability to work in a team and enjoyment of interdisciplinary collaboration.
- Quality awareness and a high standard for reliable data.
- Willingness to continuously improve existing processes.
Experience
- Professional experience in Data Engineering, Software Engineering, or Data Platform Engineering.
- Experience with relational databases and data modeling.
- Experience with ETL/ELT processes and data pipelines.
- Experience with Git and modern development processes.
- Experience with AWS, Microsoft Azure, or Google Cloud.
- Experience with Apache Spark.
- Experience with Docker and Kubernetes.
- Experience with CI/CD and DevOps.
- Experience with Data Governance, Data Catalogs, and Data Quality Tools.
- Experience in building Lakehouse architectures.
- Career changers with relevant practical experience and demonstrable technical skills are also welcome.
What we offer
- Success in the position is particularly demonstrated by stable and reliable data pipelines, high data quality and availability, short processing and deployment times, scalable and cost-efficient data architectures, a high degree of automation, traceable and documented data flows, and satisfaction among internal data and business teams.
Benefits
Food & drink
Work-Life-Integration
Topics you will work on
Job locations
About your employer
EUROPART Holding GmbH is a Europe-wide provider of spare and accessory parts for commercial vehicles, buses, vans, and special vehicles. Additionally, the company supplies workshop equipment and products for daily use in workshops and fleet operations. EUROPART is represented in several European countries through an international network of branches and partners.
- Established Company
- Hybrid, Onsite
- Trade
More jobs
These jobs might also interest you
The role As a Forward Deployed AI Engineer, you go directly into our specialist departments, understand the processes, and develop production-ready AI and automation solutions that will fundamentally change the way the entire GGW Group operates. You do...
Hello, let's say WE! We - the HUK-COBURG Insurance Group - are among the top 10 in Germany. Founded over 90 years ago, we are now the leading insurer for private households with over 13 million customers and the largest German auto insurer. Our...
Consultant & Project Manager – You are the primary contact for our clients and take on the leadership of new projects. Optimize processes & create added value – With your expertise, you will design more efficient workflows and support our clients with...
