Job
- Level
- Experienced
- Job Field
- Data, Back End
- Employment Type
- Part Time/Full Time
- Contract Type
- Permanent employment
- Location
- Essen
- Working Model
- Onsite
Job Summary
In this role, you will develop systems for a Data Mesh, implement automated data quality mechanisms, and ensure precise data classification and security using modern technologies.
Job Technologies
Your role in the team
- As a Data Governance & Platform Engineer, you are the technical responsible person for the Data Mesh. You develop and operate the systems that make data products discoverable, of high quality, traceable regarding their origin (Data Lineage), and access-controlled. Furthermore, you translate governance and classification policies from mere guidelines into enforced, automated control mechanisms within the platform.
- Development and operation of the Data-Quality Framework: Automated Data Contracts, validation rules, quality checks, and Quality Gates in the pipelines, e.g., Databricks DQ, including alerting for violations.
- Implementation of end-to-end lineage and metadata automation across Lakehouse and catalog, e.g., Unity Catalog and Microsoft Purview, so that lineage is automatically captured and not maintained manually.
- Development of access control and data classification as code: fine-grained access management in Unity Catalog, row- and column-level security, masking, tagging, and purpose-based access, linked to identities such as Entra ID.
- Automation of the data products lifecycle: templates, CI/CD for data products, catalog registration, and technical checks that certify a product as compliant before publication.
- Technical implementation of classification and sharing rules, internally open by default, with masking or restrictions for contractually protected and personal data, in collaboration with Cyber Security and Data Protection.
- Instrumentation of usage and quality telemetry, e.g., usage, timeliness, and quality assessments, so that modularity and the reuse/credit model are based on real data.
- Support of domain teams with tooling and reference implementations so that they can quickly deliver compliant data products.
This text has been machine translated. Show original
Our expectations of you
Education
- University degree or equivalent qualification in Computer Science, Computer Engineering, Information Technology, or a related field.
Qualifications
- Excellent knowledge in Data Engineering: Python and advanced SQL, Spark, pipeline and orchestration tools, e.g., Airflow, dbt or comparable, CI/CD, and Infrastructure as Code.
- Comprehensive knowledge of Databricks and Unity Catalog: governance features, access control, lineage, tagging; additionally, Microsoft Purview or a comparable catalog/lineage stack.
- Expertise in Data-Quality Engineering, particularly Data Contracts, Validation Frameworks, and Observability.
- Expertise in access control and security engineering: RBAC/ABAC, row- and column-level security, masking, encryption and key management, as well as identity integration, e.g., Entra ID.
- Practical knowledge of GDPR, data classification, and critical infrastructure (KRITIS), as well as their translation into technical controls in the sense of a Policy-as-Code approach.
- Sufficient architectural understanding to work closely with the Data Architect as well as a pragmatic and implementation-oriented approach.
Experience
- Practical experience in designing and implementing data pipelines as well as Data Mesh architectures in regulated, decentralized corporate environments.
This text has been machine translated. Show original
What we offer
- Independent assumption of exciting and responsible tasks.
- Close collaboration with a motivated team that fosters your personal and professional development through an open feedback culture.
- Insights into a globally operating energy company.
- Free use of the Health Center, modern open workspaces, free parking, e-charging stations, and much more.
This text has been machine translated. Show original
Benefits
Work-Life-Integration
- 🏠Home Office
- 🅿️Employee Parking Space
- 🚌Excellent Traffic Connections
- ⏰Flexible Working Hours
- 🍼Day Care for Kids
More net
Health, Fitness & Fun
Food & Drink
Topics that you deal with on the job
Job Locations
This is your employer
RWE AG
RWE AG is an essential part of the European energy system, ensuring security of supply for Europe. With its three operating segments - lignite & nuclear power, European electricity generation from gas, coal, hydropower and biomass, and energy trading - it is one of the leading European energy companies.
Description
- Company Size
- 250+ Employees
- Company Type
- Established Company
- Working Model
- Hybrid, Onsite
- Industry
- Power Sector, Economy
Data Governance & Platform Engineer
- Location
- Essen
- Working Model
- Onsite
- Diversity
- Open for all genders
