Category: Hadoop Projects

Storage and Streaming System

Kafka as a Storage System Kafka’s publishing is not bound to consuming. So the messages that are published can live in Kafka very long time, until they are consumed. This makes kafka a good storage...

Kafka Messaging System

Messaging has two models: Queuing : ♦ In a queue, a pool of consumers may read from a server and each record goes to one of them. ♦ Allows you to divide up the...

consumer-groups

Kafka producers and consumers

Producers: Producers publish data to the topics of their interest. The producer decides which record to publish to which partition within a topic. Producer can distribute records based on some key or in a...

kafka-logo

Apache Kafka

Apache Kafka has become quite popular over the last few years and now runs in production in thousands of companies. Prominent kafka users are LinkedIn, Yahoo, Twitter, Netflix, Square, Spotify, Pinterest, Box, Airbnb, Mozilla, Cisco, Coursera, etc. What is Kafka ? Topics. Kafka...

Kafka topic subscribers

Kafka Topic

Kafka provides an abstraction for streams of records called Topics. A topic is a category for which the input records or messages are published. Kafka recommend single publisher to a topic, but a Topic...

Kafka environment

What is Apache Kafka ?

Kafka is a distributed data streaming platform. Through Kafka, you can Publish and subscribe to streams of records/messages. Process streams of records as they arrive. Can store streams of records in a fault-tolerant way, when...