Senior Software Engineer – Stream Storage, Apache Flink

Job Description

About the Role: We are innovating stream-native storage systems with table semantics. Our Stream Storage team is dedicated to developing high-performance distributed systems that enable real-time analytics, streaming pipelines, and transactional workloads. As a Senior Software Engineer, you will contribute to core stream storage infrastructure, Apache Fluss (open-source), and internal production-grade systems built on Fluss. This role is positioned at the intersection of distributed systems, storage engines, streaming systems, and database internals. What You’ll Do: Core Engineering: - Design and implement distributed storage components for streaming tables. - Work on table lifecycle: schema evolution, ingestion, compaction, retention, indexing. - Enhance the Fluss Lakehouse ecosystem support. - Contribute features and fixes to the Apache Fluss OSS project. - Participate in design discussions and Fluss Improvement Proposals (FIPs). - Improve Fluss table engine performance and reliability. - Enhance integration with streaming engines (e.g., Flink). - Engage with the open-source community via PR reviews and discussions. Internal Platform Development: - Build internal tooling and services on top of Fluss. - Improve observability (metrics, logging, failure diagnostics). - Optimize production deployments. - Contribute to benchmarking and testing frameworks.

Qualifications

What We’re Looking For: Required Experience: 1. 5+ years building distributed systems or storage systems 2. Strong experience in Java, Go, Rust, or similar systems languages 3. Good understanding of: - Consensus and replication (Raft, Paxos, etc.) - Storage engines (LSM trees, B-Trees, WAL, compaction) - Streaming systems (Kafka, Pulsar, Flink, etc.) - Transactional systems and consistency models 4. Experience debugging production distributed systems Strongly Preferred: 1. Experience with database internals or stream processing engines 2. Familiarity with table formats (Iceberg, Hudi, Delta, etc.) 3. Contributions to open-source projects (better if ASF) 4. Experience with Flink or streaming SQL engines

Benefits

Why Join Us: - Work on table-first stream storage, focusing on modern approaches. - Direct impact on Apache Fluss open-source evolution and community. - Solve intricate consistency and performance trade-offs. - Influence architectural decisions in an emerging technological domain. - Collaborate with engineers passionate about distributed systems and innovation.