MacOS 安装 kafka

安装

使用homebrew安装

1	brew install

修改配置文件

1
2
3

vim /usr/local/etc/kafka/server.properties
#listeners = PLAINTEXT://your.host.name:9092
listeners=PLAINTEXT://localhost:9092

启动zookeeper

1	zkServer start

启动kafka

1	kafka-server-start /usr/local/etc/kafka/server.properties

创建topic

1	./kafka-topics -create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic dblab

列出topic

1	./kafka-topics --list --zookeeper localhost:2181

producer生产点数据

1	./kafka-console-producer --topic dblab --broker-list localhost:9092

并尝试输入如下信息

1
2
3

hello hadoop
hello xmu
hadoop world

使用consumer来接收数据

1	./kafka-console-consumer --zookeeper localhost:2181 --topic dblab --from-beginning

使用kafka-python

创建consumer ERROR:
NoBrokersAvailable: NoBrokersAvailable

解决方法：

from kafka import KafkaConsumer
consumer = KafkaConsumer(
    'qos_ic_board', group_id='my_group_id',
    bootstrap_servers='localhost:9092', api_version=(0,10))