Job
- Level
- Experienced
- Job Field
- Data, Back End
- Employment Type
- Full Time
- Contract Type
- Permanent employment
- Location
- Stuttgart
- Working Model
- Hybrid, Onsite
Job Summary
In this role, you will develop automated data ingestion pipelines, implement schema validations, and optimize data processing workflows for modern hybrid data platforms.
Job Technologies
Your role in the team
- You develop and maintain automated data ingestion pipelines and ensure the reliable processing of batch and streaming data.
- You support the development of modern, hybrid data platforms (e.g., based on Spark/Databricks or comparable technologies) and implement features for modern data architectures (Lakehouse & DWH).
- You implement schema validations and data quality checks during the ingestion process and assist with metadata extraction.
- You are involved in implementing access controls and data versioning to ensure the reproducibility of datasets.
- You assist in optimizing data processing workflows and help minimize unnecessary data movements within the system.
- In collaboration with our seniors, you will deepen your knowledge in distributed systems, MLOps tooling, and modern Lakehouse designs.
This text has been machine translated. Show original
Our expectations of you
Education
- Very good German and English skills as well as a degree in Computer Science, Data Engineering, or a related field.
Qualifications
- Good knowledge of Python as well as confident handling of relational databases (SQL).
- Basic understanding of cloud technologies (Azure or AWS) and initial contact with Docker.
- Proficient in Git and understanding of Data Lineage concepts.
- Basic understanding of automated workflows and deployments.
- Knowledge of partitioning and fundamental architectural principles of Data Lakes.
- Basic understanding of dimensional data modeling (Star/Snowflake Schema) and architecture principles of Data Lakes.
- You are highly motivated to immerse yourself in the rapidly evolving Data and AI landscape.
- You enjoy working collaboratively with engineering and analytics teams.
- You approach tasks methodically and have an eye for data integrity.
Experience
- Initial practical experience with Distributed Computing (e.g., Spark/Databricks or comparable technologies) and building data pipelines.
- Experience with testing procedures for data processes and Clean Code standards.
This text has been machine translated. Show original
What we offer
- You can work in a role-based company.
- You will find open corporate communication and short decision-making processes with us.
- An extensive and personalized onboarding program is ready to ensure your optimal start at BCM.
- Colleagues at eye level and our HR development support you in advancing both professionally and personally to the next level.
- Unforgettable employee events: monthly team activities and a BCM vacation in summer.
- BCM strengthens your balance, whether it's work or life, we are always behind you.
- Casual or suit? Office or home office? Early bird or night owl? You decide, with us you have the freedom to work in the way that suits you best.
- You kick off the weekend with our BCM Community with a (hoppy) refreshing drink.
This text has been machine translated. Show original
Benefits
Work-Life-Integration
Food & Drink
Health, Fitness & Fun
Topics that you deal with on the job
Job Locations
This is your employer
BCM Solutions GmbH
BCM Solutions GmbH stands for high-quality software solutions and services in the field of software development.
Description
- Company Type
- Digital Agency
- Working Model
- Full Remote, Hybrid, Onsite
- Industry
- Internet, IT, Telecommunication
Dev Reviews
by devworkplaces.com
Total
(2 Reviews)3.9
Engineering
3.3Workingconditions
4.1Culture
4.1Career Growth
4.3
Intermediate Data Engineer
- Location
- Stuttgart
- Working Model
- Hybrid, Onsite
- Diversity
- Open for all genders
