...
"Apache Kafka is a distributed commit log service that functions much like a publish/subscribe messaging system, but with better throughput, built-in partitioning, replication, and fault tolerance. Increasingly popular for log collection and stream processing" 0
Kafka core concepts:
"Kafka is run as a cluster on one or more servers.
The Kafka cluster stores streams of records in categories called topics.
Each record consists of a key, a value, and a timestamp" 2.
- "Producers – consume the data feed and send it to Kafka for distribution to consumers". 1
- "Consumers – applications that subscribe to topics; for example, a custom application or any of the products listed at the bottom of this post". 1
- "Brokers – workers that take data from the producers and send it to the consumers. They handle replication as well". 1
...
1 https://anturis.com/blog/apache-kafka-an-essential-overview/
...
2 Documentation (http://kafka.apache.org/documentation.html)
- Benchmarking Apache Kafka (https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines)
- Robust high performance C/C++ library with full protocol support (https://github.com/edenhill/librdkafka)
...