Design, build, and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability using Python, Spark, and Clickhouse. Develop and operate workflow orchestration with Apache Airflow to schedule, monitor, and...
- Airflow
- Python
- Apache Parquet
- Apache Iceberg
- Apache Spark
- Delta Lake
- ClickHouse
- SQL
- Terraform
- +16