Job
- Level
- Experienced
- Job Field
- BI, Data
- Employment Type
- Full Time
- Contract Type
- Permanent employment
- Location
- Hagen
- Working Model
- Onsite
Job Summary
In this role, you will develop scalable ETL pipelines, integrate data from various sources, and ensure high data quality for analytics and machine learning. You will work closely with interdisciplinary teams.
Job Technologies
Your role in the team
- As a Data Engineer, you are responsible for building, developing, and reliably operating modern data platforms and data pipelines.
- You ensure that data from different sources is efficiently integrated, processed, stored, and made available for analytics, reporting, machine learning, and operational applications.
- You work closely with Data Analysts, Data Scientists, Software Engineers, IT, and the business units.
- Development and operation of scalable ETL/ELT data pipelines.
- Connection and integration of data from various sources such as databases, APIs, files, and cloud systems.
- Development and enhancement of Data Warehouses, Data Lakes, and Lakehouse architectures.
- Transformation, cleansing, and validation of large data sets.
- Ensuring data quality, data consistency, and data availability.
- Development and optimization of data models for reporting and analytics.
- Automation of data processes and workflows.
- Monitoring and optimizing existing data pipelines in terms of performance, stability, and cost.
- Implementation of monitoring, logging, and alerting solutions.
- Implementation of requirements for data protection, security, and governance.
- Documentation of data flows, interfaces, and technical solutions.
- Collaboration with Data Analysts and Data Scientists in providing suitable data.
- Support in the development of a modern and scalable data platform.
This text has been machine translated. Show original
Our expectations of you
Education
- Completed university degree or equivalent qualification in fields such as computer science, business informatics, data science, mathematics, statistics, electrical engineering, or a comparable technical or analytical discipline.
Qualifications
- Excellent knowledge of SQL.
- Good programming skills, preferably in Python.
- Understanding of Data Warehouse and Data Lake concepts.
- Basic understanding of cloud technologies.
- Knowledge of Databricks, Snowflake, or Microsoft Fabric.
- Knowledge of orchestration tools such as Apache Airflow.
- Knowledge of Infrastructure as Code, e.g., Terraform.
- Knowledge of streaming technologies such as Kafka.
- Analytical and structured thinking skills.
- High degree of personal responsibility and a solution-oriented working approach.
- Interest in modern data and cloud technologies.
- Ability to communicate complex technical issues clearly.
- Ability to work in a team and enjoyment of interdisciplinary collaboration.
- Quality awareness and a high standard for reliable data.
- Willingness to continuously improve existing processes.
Experience
- Professional experience in Data Engineering, Software Engineering, or Data Platform Engineering.
- Experience with relational databases and data modeling.
- Experience with ETL/ELT processes and data pipelines.
- Experience with Git and modern development processes.
- Experience with AWS, Microsoft Azure, or Google Cloud.
- Experience with Apache Spark.
- Experience with Docker and Kubernetes.
- Experience with CI/CD and DevOps.
- Experience with Data Governance, Data Catalogs, and Data Quality Tools.
- Experience in building Lakehouse architectures.
- Career changers with relevant practical experience and demonstrable technical skills are also welcome.
This text has been machine translated. Show original
What we offer
- Success in the position is particularly demonstrated by stable and reliable data pipelines, high data quality and availability, short processing and deployment times, scalable and cost-efficient data architectures, a high degree of automation, traceable and documented data flows, and satisfaction among internal data and business teams.
This text has been machine translated. Show original
Topics You Will Work On
Job Locations
About Your Employer
EUROPART Holding GmbH
EUROPART Holding GmbH is a Europe-wide provider of spare and accessory parts for commercial vehicles, buses, vans, and special vehicles. Additionally, the company supplies workshop equipment and products for daily use in workshops and fleet operations. EUROPART is represented in several European countries through an international network of branches and partners.
Description
- Company Type
- Established Company
- Working Model
- Onsite
- Industry
- Trade
Data Engineer
- Location
- Hagen
- Working Model
- Onsite
- Diversity
- Open for all genders
