kafka和zookeeper安装部署(版本弄不好就是坑)

与世无争的帅哥 提交于 2020-05-02 12:04:36

yum install -y unzip zip

配置host

vi /etc/host
172.19
.68.10 zk1

1. zookeeper

zookeeper下载地址

http://mirror.bit.edu.cn/apache/zookeeper/zookeeper-3.4.14/zookeeper-3.4.14.tar.gz

tar -zxvf apache-zookeeper-3.4.14.tar.gz

mv apache-zookeeper-3.4.14 zookeeper

cd /opt/zookeeper

拷贝zoo_sample.cfg文件重命名为zoo.cfg,然后修改dataDir属性

# 数据的存放目录
dataDir=/opt/zkdata
# 端口,默认就是2181
clientPort=2181
server.1=zk1:2888:3888

配置环境变量

# Zookeeper Environment Variable
export ZOOKEEPER_HOME=/opt/zookeeper
export PATH=$PATH:$ZOOKEEPER_HOME/bin

在/opt/zookeeper/data文件下创建myid
  vi myid
  1

Zookeeper 启动停止命令

zkServer.sh start
zkServer.sh stop

2. kafka

kafka下载地址

http://kafka.apache.org/quickstart

http://mirror.bit.edu.cn/apache/kafka/2.2.0/kafka_2.12-2.2.0.tgz

tar -zxvf kafka_2.12-2.2.0.tgz

修改config/server.properties

#broker的全局唯一编号,不能重复

broker.id=0

#kafka消息存放的路径

log.dirs=/opt/kafka/logs

#broker需要使用zookeeper保存meta数据

zookeeper.connect=localhost:2181

https://blog.csdn.net/lizhitao/article/details/25667831 配置属性说明

启动

nohup bin/kafka-server-start.sh config/server.properties &

3. 安装kafka-manager

下载地址 https://github.com/yahoo/kafka-manager/releases

 sbt编译

cd /etc/yum.repos.d/
curl https://bintray.com/sbt/rpm/rpm > bintray-sbt-rpm.repo
yum install sbt
下载sbt
wget https://dl.bintray.com/sbt/native-packages/sbt/0.13.6/sbt-0.13.6.tgz
tar -zxvf sbt-0.13.6.tgz
添加环境变量
vi /etc/profile

export SBT_HOME=/opt/sb 
export PATH=$PATH:/$SBT_HOME/bin
/×修改sbt文件权限×/
$ chmod u+x sbt 

验证:检查sbt是否安装成功,查看命令输出

修改镜像提高下载速度
cd ~
mkdir .sbt
vim repositories

[repositories]
local
aliyun: http://maven.aliyun.com/nexus/content/groups/public
typesafe: http://repo.typesafe.com/typesafe/ivy-releases/, [organization]/[module]/(scala_[scalaVersion]/)(sbt_[sbtVersion]/)[revision]/[type]s/[artifact](-[classifier]).[ext], bootOnly

sbt -version

编译kafka-manager

./sbt clean dist

出现此图表示更新成功

cd  /opt/kafka-manager/target/universal/

unzip kafka-manager-2.0.0.1.zip

修改配置

kafka-manager.zkhosts="localhost:2181"此行中的localhost,改为你的Zookeeper服务器的IP地址

启动

nohup ./kafka-manager -Dconfig.file=/opt/kafka-manager/target/universal/kafka-manager-2.0.0.1/conf/application.conf -Dhttp.port=9001 &

 win10上面运行连接远程kafka记得在C:\Windows\System32\drivers\etc下修改hosts

47.103.*.* node1

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!