Kafka startup fails with zookeeper timeout (remote server), yet the machine can connect to zookeeper directly -

-

when start kafka up, fails while complaining cannot connect zookeeper. running zookeeper standalone cluster/ensemble. confused because there no firewall between servers (as evidenced zookeeper-shell.sh test).

from /var/log/kafka/server.log

2016-02-24 16:07:12,101 info kafka.server.kafkaserver: [kafka server 1], connecting zookeeper on 10.7.20.100:2181,10.7.20.101:2181,10.7.20.102:2181 2016-02-24 16:07:20,291 fatal kafka.server.kafkaserverstartable: fatal error during kafkaserverstable startup. prepare shutdown org.i0itec.zkclient.exception.zktimeoutexception: unable connect zookeeper server within timeout: 6000     @ org.i0itec.zkclient.zkclient.connect(zkclient.java:880)     @ org.i0itec.zkclient.zkclient.<init>(zkclient.java:98)     @ org.i0itec.zkclient.zkclient.<init>(zkclient.java:84)     @ kafka.server.kafkaserver.initzk(kafkaserver.scala:113)     @ kafka.server.kafkaserver.startup(kafkaserver.scala:69)     @ kafka.server.kafkaserverstartable.startup(kafkaserverstartable.scala:34)     @ kafka.kafka$.main(kafka.scala:46)     @ kafka.kafka.main(kafka.scala) 2016-02-24 16:07:20,294 info kafka.server.kafkaserver: [kafka server 1], shutting down 2016-02-24 16:07:20,312 info kafka.server.kafkaserver: [kafka server 1], shut down completed 2016-02-24 16:07:20,317 info kafka.server.kafkaserver: [kafka server 1], shutting down

however /opt/kafka install directory able connect zookeeper using esemble connection string - doubt network or firewall.

[me@dckafka01 kafka]$ cd /opt/kafka [me@dckafka01 kafka]$ bin/zookeeper-shell.sh 10.7.20.100:2181,10.7.20.101:2181,10.7.20.102:2181  connecting 10.7.20.100:2181,10.7.20.101:2181,10.7.20.102:2181 welcome zookeeper! jline support disabled watcher::watchedevent state:syncconnected type:none path:null  /blah null czxid = 0x400000009 ctime = tue feb 16 09:00:28 est 2016 mzxid = 0x400000009 mtime = tue feb 16 09:00:28 est 2016 pzxid = 0x40000017e cversion = 2 dataversion = 0 aclversion = 0 ephemeralowner = 0x0 datalength = 0 numchildren = 2  ls /blah [applications, registry]

which expected. have angle me investigate?

well - changing timeout helped. need chase network delays down

cat config/server.properties 

# coding: utf-8  # file created chef template. not hand edit file  log.dirs=/var/kafka port=9092 num.partitions=4 default.replication.factor=3 log.flush.interval.messages=1 log.retention.minutes=43200 log.retention.check.interval.ms=3600000 num.replica.fetchers=4 replica.fetch.wait.max.ms=5000 replica.lag.max.messages=10000 auto.leader.rebalance.enable=true num.network.threads=8 advertised.host.name=10.7.20.71 zookeeper.connection.timeout.ms=16000 broker.id=1 zookeeper.connect=10.7.20.100:2181,10.7.20.101:2181,10.7.20.102:2181

Comments

Post a Comment

Popular posts from this blog

java - Suppress Jboss version details from HTTP error response -

-
my jboss verson jboss eap 6.3 when kind of error response sent jboss, adds server information response. following sample row response: http/1.1 400 bad request server: apache-coyote/1.1 content-type: text/html;charset=utf-8 content-length: 2391 date: tue, 19 jul 2016 09:30:46 gmt connection: close jboss web/7.4.8.final-redhat-4 - jbweb000064: error report jbweb000065: http status 400 - org.codehaus.jackson.map.jsonmappingexception: can not construct instance of mybean.type string value 'xyz': value not 1 of declared enum instance names @ [source: org.jboss.resteasy.core.interception.messagebodyreadercontextimpl$inputstreamwrapper@5e421c2b; line: 14, column: 26] (through reference chain: requestargs["request"]) jbweb000309: type jbweb000067: status report jbweb000068: message org.codehaus.jackson.map.jsonmappingexception: can not construct instance of mybean.type string value 'xyz': value not 1 of declared enum instance names @ [source: org.jboss...
Read more

gridview - Yii2 DataPorivider $totalSum for a column -

-
i have order , ordersearch models. in order list (actionindex) gridview there filtering , sorting. on of columns in order order_total (sum of products in order). i need implement sum of order_total in gridview. if manually counting activedataprovider->getmodels() array_map spend 3 seconds 3000 orders (localhost). don't want miss time. i see 2 ways make faster: create cache every filter , update lifetime (horrible) the interesting can right in ordersearch->search() method $query method. don't understand how can pass in controller. example of code 2nd way: class ordersearch extends order { public $totalsum; public function search($params) { $query = order::find(); $dataprovider = new activedataprovider([ 'query' => $query, ]); $this->load($params); $this->totalsum = $query->sum('order_total'); // works fast return $dataprovider; } } after i...
Read more

Sass watch command compiles .scss files before full sftp upload -

-
i use winscp download , edit .scss files , sass on linux (on server) compile them .css . after saving file, use: sass scss/style.scss css/style.css , replaces css file compiled sccs. the problem i want skip part return command line after editing scss file, sake of automation , saving time. but, if use watch command: sass --watch scss/style.scss:css/style.css synchronize 2 files, alerts nonexistent css errors pop up: change detected to: scss/style.scss error scss/style.scss (line 232: invalid css after "...ht: bold; line-": expected "{", "") note that when file uploads quicker usual (sometimes happens) watch command job, no errors. this because, when file upload takes time, sass compiles scss file (on server) before uploaded remote folder. thus, compiles part of file, resulting in css errors. is there way set timer watch command waits few seconds after detects changes , before compiling? any other way overcome is, of course, ...
Read more