devops-exercises/topics/kafka/README.md

# Apache Kafka

## Kafka Exercises

|Name|Topic|Objective & Instructions|Solution|Comments|
|--------|--------|------|----|----|

## Kafka Self Assessment

* [Kafka 101](#questions-kafka-101)

<a name="questions-kafka-101"></a>
### Kafka 101

<details>
<summary>What is Kafka?</summary><br><b>

[kafka.apache.org](https://kafka.apache.org): "Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications."

In other words, Kafka is a sort of distributed log where you can store events, read them and distribute them to different services and do it in high-scale and real-time.
</b></details>

<details>
<summary>What Kafka is used for?</summary><br><b>

- Real-time e-commerce
- Banking
- Health Care
- Automotive (traffic alerts, hazard alerts, ...)
- Real-time Fraud Detection
</b></details>

<details>
<summary>What is a "Producer" in regards to Kafka?</summary><br><b>

An application that publishes data to the Kafka cluster.
</b></details>

<a name="questions-kafka-architecture"></a>
### Kafka Architecture

<details>
<summary>What's in a Kafka cluster?</summary><br><b>

- Broker: a server with kafka process running on it. Such server has local storage. In a single Kafka clusters there are usually multiple brokers.
</b></details>

<details>
  <summary>What is the role of ZooKeeper is Kafka?</summary><br/><b>
In Kafka, Zookeeper is a centralized controller that manages metadata for producers, brokers, and consumers.
Zookeeper also:
    <ul>
      <li>Tracks which brokers are part of the Kafka cluster</li>
      <li>
Determines which broker is the leader of a given partition and topic
      </li>
      <li>
Performs leader elections
      </li>
      <li>
Manages cluster membership of brokers
      </li>
    </ul>

  </b>
</details>