Job
In this role, you will develop data pipelines for processing corporate data, conduct quality tests, and manage entity resolution projects to enhance data integration and utilization.
This listing has been machine translated. Show original
Job technologies
Your role in the team
- Ingestion and pipelines: vendor feeds, APIs and scraping jobs—scheduled, idempotent, monitored, with backfills and alerts when a feed stops or drifts.
- Schema and data model: the Postgres schema and data dictionary as the source of truth, including migrations and the Hasura layer on top.
- Entity resolution: matching and deduplicating companies across sources, with measurable precision and recall.
- LLM extraction and classification: pipelines that turn unstructured sources into structured records, evaluated on labeled samples and tuned for cost per record.
- Signals: funding, acquisitions, shutdowns, case studies, and headcount as event pipelines with change detection and accurate event dates.
- Data quality and observability: automated tests and metrics for coverage, accuracy, freshness, and completeness.
- Data sources: You test vendors, APIs, and scraping partners using real samples and provide a clear recommendation on quality and cost per data point.
- You join sprint planning and review, triage data errors reported by users and agents, and take datapoints from prototype to production yourself.
- By day 90: every feed is monitored and has alerting in place, relationship data is classified with measured precision, entity resolution has a baseline, 3–5 new data points are live in production, and our search benchmark has improved against a target you set in month 1.
- Month 1: baseline and observability
- Inventory every pipeline, vendor feed and scraping job; assign each one an owner, a runbook, monitoring and alerting.
- Data dictionary v1 for the top 25 data points, including source, lineage, and quality metrics.
- Automated quality checks (coverage, freshness, nulls, duplicates) running on every load.
- Quick win: Scale partnership data point collection.
- Month 2: Corporate-Technology Relationships
- Model relationship types in the schema: mention, partnership, PoC, implementation, investment, acquisition.
- Build an LLM classification pipeline for existing and incoming records; report precision on a labeled sample and cost per record.
- Set a recall and lag baseline, then improve the relationship pipeline against it.
- Integrate a live acquisition source and keep acquired companies out of recommendations.
- Month 3: new datapoints, entity resolution and agents
- Run 6–8 time-boxed datapoint experiments, each ending in a ship, kill, or park decision. Ship 3–5 to production.
- Entity resolution v2: measurable matching across sources, with a review queue for uncertain cases.
- Add provenance, confidence, and freshness to the top 25 fields, and make customer data (lists, PoCs, notes) usable by agents with the appropriate permissions.
- Document the data platform: architecture, runbooks and on-call handover.
Our expectations of you
Qualifications
- A senior data engineer who ships. You care about reliability and clean data models, and you understand what the data is used for. You'd rather put a rough datapoint live this week than a perfect one next quarter.
- Must-haves
- You've built and operated production data pipelines end to end: orchestration (e.g., Airflow, Dagster, or Prefect), monitoring, alerting, and backfills.
- Fluent Python: scrapers and enrichment services (requests or Playwright, pandas or polars), tested and production-ready.
- Strong SQL on a production Postgres database: schema design, migrations, indexing, and query performance.
- Hands-on experience with LLMs for extraction and classification, evaluated on a labeled sample, with a focus on cost and latency.
- Practical entity resolution and deduplication at scale.
- Data quality testing (e.g., dbt tests, Great Expectations, or your own checks).
- Working knowledge of GDPR for company and people data.
- Based in Berlin, or willing to relocate.
- Nice to have
- dbt, Docker and a major cloud platform (AWS or GCP); infrastructure as code.
- Event or signal pipelines: change detection, event dating, alerting.
- Vector search or embeddings for matching and retrieval.
- GraphQL / Hasura.
- German at reading level: DACH registers are a big part of our upside.
- Working with data from providers such as PitchBook, Crunchbase, Dealroom, or company registers.
- Knowledge of the corporate innovation, VC or emerging technology ecosystem.
Experience
- 5+ years in data engineering (or backend engineering with a data focus), ideally working with company, market, or B2B data at a data business, marketplace, or SaaS company.
What we offer
- Salary band: €80 - €110k
- Real ownership of a core part of our product and its data platform.
- Fast impact: your data shows up for corporate customers, in agent answers and in weekly company updates within weeks.
- A small, senior team. Full-time, Berlin office.
Topics you will work on
Job locations
About your employer
GlassDollar GmbH, based in Berlin, is an innovative company that has developed a software platform to assist large firms in finding and implementing suitable startups and innovative solutions. This platform enables the aggregation of startup data and the efficient management of innovation processes. Since its founding in 2019, GlassDollar has established itself as a startup in the field of corporate innovation.
- Startup
- Onsite
- Internet, IT, Telecommunication
More jobs
These jobs might also interest you
The role As a Forward Deployed AI Engineer, you go directly into our specialist departments, understand the processes, and develop production-ready AI and automation solutions that will fundamentally change the way the entire GGW Group operates. You do...
Hello, let's say WE! We - the HUK-COBURG Insurance Group - are among the top 10 in Germany. Founded over 90 years ago, we are now the leading insurer for private households with over 13 million customers and the largest German auto insurer. Our...
As a Senior Software Engineer (m/f/d), you will take on a central technical role in challenging client projects and develop sustainable, scalable software solutions in complex enterprise environments. In your role, you will primarily be responsible for:...