Kafka → Iceberg minus the headaches

Copying data from Kafka to Iceberg unlocks huge analytical power. But for most teams, the excitement quickly hits roadblocks - snapshot expiration, schema evolution, re-partitioning and more...

🚧 Reconciliation 🚧

1. 🚧 Snapshot Expiration 🚧
2. 🚧 Compaction 🚧
3. 🚧 Schema Evolution 🚧
4. 🚧 Re-partitioning 🚧

Press enter or space to select a node.You can then use the arrow keys to move the node around. Press delete to remove it and escape to cancel.

Press enter or space to select an edge. You can then press delete to remove it or escape to cancel.

Streambased I.S.K. (Iceberg Service for Kafka) does things differently! Instead of copying, I.S.K. creates a logical Iceberg view of your Kafka data with no physical movement.

1. Metadata only snapshots
2. Kafka driven schemas
3. Logical partitioning
4. No compaction necessary

Press enter or space to select a node.You can then use the arrow keys to move the node around. Press delete to remove it and escape to cancel.

Press enter or space to select an edge. You can then press delete to remove it or escape to cancel.

With this approach you get:

1. A single source of truth - data remains in Kafka for total consistency
2. Instant Schema evolution - as applied in Kafka
3. Logical Snapshots - create and delete snapshots at will
4. No compaction required - No small files are created so no need to compact them away.
5. The freshest view - Kafka contains all the most recent data and it's all accessible

Turn your Iceberg migration from 12 months to 12 days with Streambased I.S.K.