What is the role of ZooKeeper in Kafka

Ads
 

What is the role of ZooKeeper in Kafka

Hi,

What is the role of ZooKeeper in Kafka?

Thanks

View Answers

December 9, 2017 at 7:59 PM

Hi,

ZooKeeper works as high-performance co-ordinatior services in distributed Kafka cluster. You can't run Kafka(cluster) without it.

Kafka connects to Zookeper and if ZooKeeper is down Kafka won't run.

  • ZooKeeper is used as communication middleware to communicate between different nodes in Kafka cluster.

  • ZooKeeper is used to commit offset in the Kafka cluster and if node fails it retrieves the data from perviously committed offset.

  • ZooKeeper is also responsible with the functionalities like leader detection, distributed synchornization, configuration management etc..

  • It also handles cluster activities like leaves or joins by nodes, node status in real-time, hearbeat management etc..

  • It is also used to track the status of each node present in the Kafka cluster and keep track of topics, messagess, status etc..

Check more tutorials: Apache Kafka Tutorials

Thanks

Big Data Analytics on Spark 2.2 http://datapao.com/trainings/apache-spark-trainings/

Ads









Related Tutorials/Questions & Answers:
What is the role of ZooKeeper in Kafka
What is the role of ZooKeeper in Kafka  Hi, What is the role of ZooKeeper in Kafka? Thanks   Hi, ZooKeeper works as high-performance co...) without it. Kafka connects to Zookeper and if ZooKeeper is down Kafka won't run
what is key in kafka?
what is key in kafka?  Hi, I was searching for Big Data jobs on internet and almost all the Big Data Job recruiters are asking for Kafka skills. what is key in kafka? How to learn Kafka? Thanks   Hi, Yes in most
Advertisements
Mention what is Apache Kafka
technologies. So, Mention what is Apache Kafka? Thanks   Hi, Apache Kafka in Big Data world as it provides reliable solution for messaging. Kafka is Open...Mention what is Apache Kafka  Hi, This is the most frequently
What are job role of Hadoop Developer?
What are job role of Hadoop Developer?  Hi, I am planning to get the the job in Hadoop Development as Hadoop Developer. What are the roles of a Hadoop Developer? Thanks
What is Kafka max message size
What is Kafka max message size  Hi, What is Kafka max message size? Thanks   Hi, It is defined in Kafka with the variable.... Check more tutorials: Apache Kafka Tutorials Thanks Big Data Analytics
What is benefits of Apache Kafka over the traditional messaging
What is benefits of Apache Kafka over the traditional messaging  Hi, What is benefits of Apache Kafka over the traditional messaging? How you will compare Apache Kafka with JMS based messaging? Thanks
What is benefits of Apache Kafka over the traditional messaging
What is benefits of Apache Kafka over the traditional messaging  Hi, What is benefits of Apache Kafka over the traditional messaging? How you will compare Apache Kafka with JMS based messaging? Thanks
What do you understand by Kafka broker
What do you understand by Kafka broker  Hi, What do you understand by Kafka broker? Thanks   Hi, Kafka is designed in mind with clustring and there can be many sever in Kafka cluster. The term Kafka Broker is used
Creating topic in Apache Kafka
Creating topic in Apache Kafka  Hi, What is command for creating topic in Apache Kafka? Thanks   Hi, In Kafka message are grouped... is command for creating topic from command line: bin/kafka-topics.sh --create
Role of Project Manager
Role of Project Manager  What are the role of a project manager in an Organisation
ModuleNotFoundError: No module named 'zookeeper'
ModuleNotFoundError: No module named 'zookeeper'  Hi, My Python... 'zookeeper' How to remove the ModuleNotFoundError: No module named 'zookeeper' error? Thanks   Hi, In your python environment you
Kafka Big Data tutorial
by various devices and here Kafka plays one of the major role. Kafka can ingest millions...Kafka Big Data tutorial  Hi, I want to learn Kafka and use it one of Big Data project. Which is the tutorials of Kafka Big Data? Thanks  
Version of com.bluejeans>zookeeper-utils dependency
List of Version of com.bluejeans>zookeeper-utils dependency
Version of com.englishtown>vertx-zookeeper dependency
List of Version of com.englishtown>vertx-zookeeper dependency
Version of com.hazelcast>hazelcast-zookeeper dependency
List of Version of com.hazelcast>hazelcast-zookeeper dependency
Version of com.neovisionaries>nv-zookeeper dependency
List of Version of com.neovisionaries>nv-zookeeper dependency
Version of com.sonian>elasticsearch-zookeeper dependency
List of Version of com.sonian>elasticsearch-zookeeper dependency
ModuleNotFoundError: No module named 'cabalgata-zookeeper'
ModuleNotFoundError: No module named 'cabalgata-zookeeper'  Hi, My... named 'cabalgata-zookeeper' How to remove the ModuleNotFoundError: No module named 'cabalgata-zookeeper' error? Thanks   Hi
ModuleNotFoundError: No module named 'flask-zookeeper'
ModuleNotFoundError: No module named 'flask-zookeeper'  Hi, My... named 'flask-zookeeper' How to remove the ModuleNotFoundError: No module named 'flask-zookeeper' error? Thanks   Hi, In your python
ModuleNotFoundError: No module named 'gevent-zookeeper'
ModuleNotFoundError: No module named 'gevent-zookeeper'  Hi, My... named 'gevent-zookeeper' How to remove the ModuleNotFoundError: No module named 'gevent-zookeeper' error? Thanks   Hi, In your
ModuleNotFoundError: No module named 'gevent-zookeeper'
ModuleNotFoundError: No module named 'gevent-zookeeper'  Hi, My... named 'gevent-zookeeper' How to remove the ModuleNotFoundError: No module named 'gevent-zookeeper' error? Thanks   Hi, In your
ModuleNotFoundError: No module named 'pandas-zookeeper'
ModuleNotFoundError: No module named 'pandas-zookeeper'  Hi, My... named 'pandas-zookeeper' How to remove the ModuleNotFoundError: No module named 'pandas-zookeeper' error? Thanks   Hi, In your
ModuleNotFoundError: No module named 'zookeeper-healthcheck'
ModuleNotFoundError: No module named 'zookeeper-healthcheck'  Hi...: No module named 'zookeeper-healthcheck' How to remove the ModuleNotFoundError: No module named 'zookeeper-healthcheck' error? Thanks   Hi
ModuleNotFoundError: No module named 'zookeeper_monitor'
ModuleNotFoundError: No module named 'zookeeper_monitor'  Hi, My... named 'zookeeper_monitor' How to remove the ModuleNotFoundError: No module named 'zookeeper_monitor' error? Thanks   Hi, In your
ModuleNotFoundError: No module named 'Zookeeper-Watcher'
ModuleNotFoundError: No module named 'Zookeeper-Watcher'  Hi, My... named 'Zookeeper-Watcher' How to remove the ModuleNotFoundError: No module named 'Zookeeper-Watcher' error? Thanks   Hi, In your
o.a.h.h.z.RecoverableZooKeeper - Possibly transient ZooKeeper, quorum=
o.a.h.h.z.RecoverableZooKeeper - Possibly transient ZooKeeper, quorum= ... ZooKeeper, quorum= How to solve this? Thanks   Hi, You should check the ip address of your zookeeper machine in your application. Also check you are able
ModuleNotFoundError: No module named 'dubbo_zookeeper_thrift'
ModuleNotFoundError: No module named 'dubbo_zookeeper_thrift'  Hi...: No module named 'dubbo_zookeeper_thrift' How to remove the ModuleNotFoundError: No module named 'dubbo_zookeeper_thrift' error? Thanks   Hi
ModuleNotFoundError: No module named 'dubbo_zookeeper_thrift'
ModuleNotFoundError: No module named 'dubbo_zookeeper_thrift'  Hi...: No module named 'dubbo_zookeeper_thrift' How to remove the ModuleNotFoundError: No module named 'dubbo_zookeeper_thrift' error? Thanks   Hi
ModuleNotFoundError: No module named 'dubbo_zookeeper_thrift'
ModuleNotFoundError: No module named 'dubbo_zookeeper_thrift'  Hi...: No module named 'dubbo_zookeeper_thrift' How to remove the ModuleNotFoundError: No module named 'dubbo_zookeeper_thrift' error? Thanks   Hi
ModuleNotFoundError: No module named 'vmshepherd-zookeeper-driver'
ModuleNotFoundError: No module named 'vmshepherd-zookeeper-driver'  ...: No module named 'vmshepherd-zookeeper-driver' How to remove the ModuleNotFoundError: No module named 'vmshepherd-zookeeper-driver' error? Thanks
ModuleNotFoundError: No module named 'zc-zookeeper-static'
ModuleNotFoundError: No module named 'zc-zookeeper-static'  Hi, My... named 'zc-zookeeper-static' How to remove the ModuleNotFoundError: No module named 'zc-zookeeper-static' error? Thanks   Hi

Ads