Apache Kafka — , , . , prefetch, zero-copy — , . , , — , Kafka.
. , (. . ) — , . . Kafka .
Apache ZooKeeper. : , . . ZooKeeper , , , - API . Kafka — API pub/sub (-) . , , , , — . , ZooKeeper Kafka.
, , .
, KIP-500 Kafka — Zookeeper. !
— (Ben Stopford)
, KIP-500 trunk 2.8. Kafka ZooKeeper. Kafka Raft Metadata, —KRaft ( «»).
. ACL . JBOD KRaft (, Apache Kafka ). . : , Kafka , ( . ).
:
Kafka , , Kafka ZooKeeper, , Kafka. , .
. KRaft, . ZooKeeper ZAB Raft, — , , .
, - . , ( ), , . , . , , . .
KRaft , ZooKeeper ZooKeeper, . . , , KRaft. , RPC, . ( , ) — Kafka , . .
Kafka
Kafka : . . KIP , . Kafka . , .
. , , 2018 , Kafka. , . O ( ). , Kafka.
, , 200K . , (ZooKeeper) ( Kafka). . , . 2 ( 10 ):
| ZooKeeper | ||
|---|---|---|
| (2 ) | 135 | 32 |
| (2 ) | 503 | 37 |
. , rolling restart — . , (RTO) , , , , , -. , , ZooKeeper.
, , — . , 2018 .
Kafka —
Kafka , ZooKeeper. - , ActiveMQ RabbitMQ, Kafka .
, Kafka , Netflix Instagram. , Kafka , Kafka Streams, ksqlDB . (Kafka Zookeeper) , .
. KIP-500 KRaft Kafka , ActiveMQ RabbitMQ. . . , , Confluent Cloud, . , , , — . , .
Kafka ZooKeeper
, , , Apache Kafka 2.8. ? — , , Kafka , .
, , , . KRaft Early Access, . , TLA+ Confluent Cloud.
. . README GitHub.