Flink standalone cluster registration failed

Environment

2 machines, 203204
plans to run jobmanager and taskmanager

on each of these two machines.
master
hz203:9081
hz204:9081
slaves
hz203
hz204
flink-conf.yaml
jobmanager.rpc.port: 6123
rest.port: 9081
blob.server.port: 6124
query.server.port: 6125
web.tmpdir: /home/ctu/flink/deploy/webTmp
web.log.path: /home/ctu/flink/deploy/log
taskmanager.tmp.dirs: /home/ctu/flink/deploy/taskManagerTmp
high-availability: zookeeper
high-availability.storageDir: file:///home/ctu/flink/deploy/HA
high-availability.zookeeper.quorum: 10.0.1.79:2181
high-availability.zookeeper.path.root: /flink
high-availability.cluster-id: /flink
run . / start-cluster.sh

clipboard.png

clipboard.png

question

  1. akka.tcp://flink@127.0.0.1:33567/user/resourcemanager ip has always been 127.0.0.1, not the ip
  2. of jobmanager in the masters file.
  3. high-availability.storageDir if it is hdfs:// , do you have to install hadoop to run jobmanager and taskmanager (there are hdfs:// on other machines), use hdfs://xxxx to prompt CLASSPATH that hadoop cannot be found.

@ codecraft @ Fan Lei Thank you

Mar.06,2022

Please refer to here . The answer to the same question is given in stackoverflow . I hope it can help you

.
  • How flink initializes spring

    I have a few questions about using flink, just now. I would like to ask all of you to help me. flink how to initialize spring context flink how to use scheduled tasks @ codecraft @ Ali Yunqi Community @ Fan Xuan Thank you ...

    Jan.08,2022
  • Can kafka-dependent Flink tasks forcibly increase resources dynamically by copying job?

    due to the current version, it seems that flink does not support dynamic scaling,. If you need to increase resource allocation, you must first stop the running job. Currently I have a flink job that is used to consume data from kafka topic and then sink ...

    Mar.18,2022
Menu