Job
- Level
- Senior
- Job Field
- Application, Back End
- Employment Type
- Full Time
- Contract Type
- Permanent employment
- Location
- Berlin
- Working Model
- Full Remote
Job Summary
In this role, you will develop high-throughput database integrations and optimize real-time data replication while tackling complex challenges in distributed architectures.
Job Technologies
Your role in the team
- The ClickPipes - Database Integrations team builds the platform that enables real-time data replication from databases into ClickHouse at petabyte scale.
- As a member of this team, you will be solving complex database-related challenges and distributed systems problems, such as understanding database internals to optimize snapshotting strategy, handling schema evolution during live replication, managing data type compatibility across systems, maintaining low end-to-end latency under unpredictable loads, and leveraging durable execution frameworks to ensure data consistency over unreliable networks.
- Build data-intensive systems: Design and develop high-throughput integrations with databases (Postgres, MySQL, MongoDB), data lakes (Iceberg, Delta Lake), and data warehouses (BigQuery, Snowflake).
- Handle edge cases in real-world production scenarios: unconventional database setups, internals of data types, database upgrades/failovers, large transactions, etc.
- Design integration solutions to enable users to fully harness ClickHouse's performance and throughput.
- Own end-to-end reliability: Debug complex issues in production leveraging runtime diagnostics (e.g., pprof, parca) and observability tools (e.g., metrics, logging, tracing).
- Build and improve infrastructure and tools to increase system reliability, reduce incident response time, and simplify/automate operations.
- Write clear documentation, both publicly and internally.
- Participate in on-call rotation.
- Drive product innovation: Work directly with customers to understand integration requirements and discover gaps in existing product.
- Collaborate cross-functionally with internal teams to ensure operational efficiency.
- Lead technical discussions and influence product roadmaps.
This text has been machine translated. Show original
Our expectations of you
Qualifications
- Strong problem solver and solid production debugging skills.
- Clear communication in writing (design docs, code review) and verbally (technical discussions, customer calls, incident response).
Experience
- 5+ years of industry experience building data-intensive software solutions.
- Proficient in Go, or experienced in systems programming with willingness to ramp up quickly in Go.
- Cloud-native experience deploying and operating services on at least one major cloud platform (AWS/GCP/Azure).
- Practical experience with Kubernetes.
- Bonus Points: Experience with database replication technologies (CDC, logical replication).
- Experience with durable execution frameworks (Temporal).
- Experience with data formats and protocols (Avro, Parquet, Protobuf).
- Experience with modern data processing frameworks (e.g., Kafka, Spark, Flink).
- Experience with maintaining/contributing to open-source software.
This text has been machine translated. Show original
What we offer
- Work on challenging problems at the intersection of database technologies, distributed systems, and cloud-native architecture.
- Work on a team that builds software in the open (PeerDB), and that cares about the craft of engineering, documentation, and continuous learning.
- Be part of a high-visibility team that delivers meaningful impact to customers in a dynamic, hyper-growth environment.
This text has been machine translated. Show original
Benefits
Work-Life-Integration
Topics that you deal with on the job
Job Locations
This is your employer
Clickhouse
ClickHouse GmbH, based in Harxheim, Germany, is an experienced digital agency specializing in E-commerce, web development, and online marketing. It supports clients in implementing their digital projects with a comprehensive range of services.
Description
- Company Type
- Digital Agency
- Working Model
- Full Remote, Hybrid, Onsite
- Industry
- Internet, IT, Telecommunication
Software Engineer - Database Integrations
- Location
- Berlin
- Working Model
- Full Remote
- Diversity
- Open for all genders
- English Only
- English only required
