Job
- Level
- Experienced
- Location
- Merzig
- Working Model
- Hybrid, Onsite
- Job Field
- BI, Data
- Employment Type
- Full Time
- Contract Type
- Permanent employment
Job Summary
In this role, you will develop scalable ETL/ELT data pipelines in AWS, orchestrate data flows with Dagster, and structure data into bronze, silver, and gold layers while continuously ensuring data quality.
Job Technologies
Your role in the team
- Development and operation of scalable ETL/ELT data pipelines.
- Development, enhancement, and optimization of our Data Platform in AWS/Amazon Redshift.
- Development and orchestration of data pipelines and data assets with Dagster.
- Development of data integrations and transformations with Python and SQL.
- Structuring and processing our data along the Bronze, Silver, and Gold layers.
- Integration of various data sources via databases, APIs, files, and other interfaces.
- Further development of our data warehouse and data modeling standards.
- Ensuring data quality, data lineage, and traceability.
- Development of automated testing, monitoring, and alerting.
- Optimization of our data processes in terms of performance, scalability, and cost.
- Collaboration with business units, development, and IT in implementing new data requirements.
- Clean and continuous documentation of data models, data pipelines, interfaces, dependencies, and technical processes.
This text has been machine translated. Show original
Our expectations of you
Qualifications
- You bring very good knowledge in:
- Python and SQL
- AWS and Amazon Redshift
- Dagster or comparable orchestration platforms
- Data Warehousing and Data Modeling
- ETL/ELT processes
- Bronze, Silver, and Gold Architectures
- relational databases
- Git and Modern Software Development
- AWS S3 and other AWS Data Services
- Docker and CI/CD
- REST APIs
- Data Quality and Data Lineage
- Monitoring and Alerting
- Infrastructure as Code
- BI and Analytics Environments
- You don't just think in individual data pipelines, but understand the interconnections of a modern data architecture.
- You can analyze complex data flows, structure them meaningfully, and translate them into maintainable and reusable solutions.
- In doing so, you emphasize clean and maintainable code, comprehensible data models, and structured technical documentation.
- For you, clear documentation is just as essential to a production-ready solution as testing, monitoring, and high data quality.
Experience
- You have practical experience in Data Engineering and have already developed and operated data pipelines or Data Warehouse solutions in production.
- Ideally, you also have experience with:
This text has been machine translated. Show original
What we offer
- You are working on a data platform that is currently undergoing significant technological development, and you can actively shape its future architecture.
- You will have the opportunity not only to operate existing processes but also to actively shape new standards, architectures, and technologies.
- Flexible working hours and the possibility of working from home.
- Open corporate culture with short decision-making paths in a steadily growing company.
- Modern development environment and current technologies.
- A motivated team with extensive e-commerce and development experience.
- Fun and Benefits: Employee events, bike leasing, and numerous additional perks.
This text has been machine translated. Show original
Benefits
Work-Life-Integration
Health, Fitness & Fun
Topics You Will Work On
Job Locations
About Your Employer
Deuba Gmbh & Co. Kg
With more than 4,500 high-quality articles at fair prices, DEUBA GmbH & Co. KG offers its customers a comprehensive range of products. The company from Merzig in the Saarland relies on both its own products and exclusive, high-quality articles from partner companies.
Description
- Company Type
- Established Company
- Working Model
- Hybrid, Onsite
- Industry
- Trade