请稍等 ...
×

采纳答案成功！

向帮助你的同学说点啥吧！感谢那些助人为乐的人

关于kafka集群isr经常只剩一个的问题

老师您好，我创建的kafka集群有两个broker，就是下图的16和8；在运行时，我发现这两个节点中，所有的partition的leader节点只有一个，如下图；
图片描述
而且，其中一个节点经常性的掉线，如下图；
图片描述

这个时候，消费者会经常报如下的错误：

[11:03 19:55:41.466] [WARN] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Offset commit failed on partition DNS-BEA-DNSC2R-LOG-6 at offset 51661: The request timed out.
[11:03 19:55:41.467] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null) is unavailable or invalid due to cause: error response REQUEST_TIMED_OUT.isDisconnected: false. Rediscovery will be attempted.
[11:03 19:55:41.569] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Discovered group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null)
[11:03 19:55:41.570] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Discovered group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null)
[11:03 19:55:41.570] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null) is unavailable or invalid due to cause: coordinator unavailable.isDisconnected: false. Rediscovery will be attempted.
[11:03 19:55:41.673] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Discovered group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null)
[11:03 19:55:46.681] [WARN] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Offset commit failed on partition DNS-BEA-DNSC2R-LOG-6 at offset 51661: The request timed out.
[11:03 19:55:46.682] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null) is unavailable or invalid due to cause: error response REQUEST_TIMED_OUT.isDisconnected: false. Rediscovery will be attempted.
[11:03 19:55:46.785] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Discovered group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null)
[11:03 19:55:46.786] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Discovered group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null)
[11:03 19:55:46.786] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null) is unavailable or invalid due to cause: coordinator unavailable.isDisconnected: false. Rediscovery will be attempted.
[11:03 19:55:46.889] [INFO] [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Discovered group coordinator 159.226.16.116:29097 (id: 2147483631 rack: null)

其中159.226.16.116:29097对应的就是节点16。被这个问题困扰很久了，希望老师能指明一个解决问题的方向。

目前集群使用的kafka版本是 kafka_2.13-3.0.0 ，总共设置了3个controller和两个broker，都是运行在kvm虚拟机中，其中broker机器的配置是，500G磁盘，64G内存，8核cpu。

谢谢！

1.目前已经排除网络等问题；
2.因为此处节点是8和16，所以我认为leader节点应该既包括8，也包括16，我这边发现只有16是leader节点；
3.在报错的时候，错误日志如下：

[00:30:54:104] [ERROR] - org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:1188) - [Consumer clientId=consumer-new-dns-bea-1, groupId=new-dns-bea] Offset commit failed on partition DNS-BEA-DNSC2R-LOG-6 at offset 9913151: The coordinator is not aware of this member.
[00:30:54:104] [ERROR] - com.iscas.consumer.application.KafkaConsumerApplication$CunsumerExecutor.execute(KafkaConsumerApplication.java:112) - 提交offset失败: 
org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured max.poll.interval.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing max.poll.interval.ms or by reducing the maximum size of batches returned in poll() with max.poll.records.
	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:1260) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:1161) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:1184) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:1159) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:206) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:169) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:129) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.fireCompletion(ConsumerNetworkClient.java:602) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.firePendingCompletedRequests(ConsumerNetworkClient.java:412) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:297) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:236) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:215) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:1003) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1491) ~[kafka-clients-3.0.0.jar!/:?]
	at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1439) ~[kafka-clients-3.0.0.jar!/:?]
	at com.iscas.consumer.application.KafkaConsumerApplication$CunsumerExecutor.execute(KafkaConsumerApplication.java:107) [classes!/:0.0.1-SNAPSHOT]
	at com.iscas.consumer.application.KafkaConsumerApplication.run(KafkaConsumerApplication.java:85) [classes!/:0.0.1-SNAPSHOT]
	at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:782) [spring-boot-2.5.5.jar!/:2.5.5]
	at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:772) [spring-boot-2.5.5.jar!/:2.5.5]
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:345) [spring-boot-2.5.5.jar!/:2.5.5]
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1343) [spring-boot-2.5.5.jar!/:2.5.5]
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:1332) [spring-boot-2.5.5.jar!/:2.5.5]
	at com.iscas.consumer.ConsumerApplication.main(ConsumerApplication.java:13) [classes!/:0.0.1-SNAPSHOT]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
	at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:49) [consumer-0.0.1-SNAPSHOT.jar:0.0.1-SNAPSHOT]
	at org.springframework.boot.loader.Launcher.launch(Launcher.java:108) [consumer-0.0.1-SNAPSHOT.jar:0.0.1-SNAPSHOT]
	at org.springframework.boot.loader.Launcher.launch(Launcher.java:58) [consumer-0.0.1-SNAPSHOT.jar:0.0.1-SNAPSHOT]
	at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:88) [consumer-0.0.1-SNAPSHOT.jar:0.0.1-SNAPSHOT]
[16:50:06:799] [ERROR] - com.iscas.consumer.application.KafkaConsumerApplication$CunsumerExecutor.execute(KafkaConsumerApplication.java:114) - 提交超时: 
org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before successfully committing offsets {DNS-BEA-DNSR2A-LOG-1=OffsetAndMetadata{offset=10856520, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-5=OffsetAndMetadata{offset=10884298, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-2=OffsetAndMetadata{offset=10857454, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-9=OffsetAndMetadata{offset=10862269, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-2=OffsetAndMetadata{offset=10866053, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-1=OffsetAndMetadata{offset=10864331, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-7=OffsetAndMetadata{offset=10883777, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-5=OffsetAndMetadata{offset=10884329, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-1=OffsetAndMetadata{offset=10869069, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-6=OffsetAndMetadata{offset=10841883, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-9=OffsetAndMetadata{offset=10867495, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-2=OffsetAndMetadata{offset=10876075, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-6=OffsetAndMetadata{offset=10863863, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-2=OffsetAndMetadata{offset=10880983, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-6=OffsetAndMetadata{offset=10889363, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-6=OffsetAndMetadata{offset=10860143, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-2=OffsetAndMetadata{offset=10883515, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-1=OffsetAndMetadata{offset=10858111, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-6=OffsetAndMetadata{offset=10863199, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-2=OffsetAndMetadata{offset=10844604, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-9=OffsetAndMetadata{offset=10855417, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-6=OffsetAndMetadata{offset=10881226, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-6=OffsetAndMetadata{offset=10861467, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-5=OffsetAndMetadata{offset=10869441, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-2=OffsetAndMetadata{offset=10879292, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-1=OffsetAndMetadata{offset=10869283, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-5=OffsetAndMetadata{offset=10873270, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-3=OffsetAndMetadata{offset=10848590, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-3=OffsetAndMetadata{offset=10867922, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-7=OffsetAndMetadata{offset=10858354, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-7=OffsetAndMetadata{offset=10886267, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-7=OffsetAndMetadata{offset=10871525, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-7=OffsetAndMetadata{offset=10873600, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-0=OffsetAndMetadata{offset=10851168, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-3=OffsetAndMetadata{offset=10895303, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-0=OffsetAndMetadata{offset=10882191, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-8=OffsetAndMetadata{offset=10855342, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-9=OffsetAndMetadata{offset=10877034, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-3=OffsetAndMetadata{offset=10864047, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-4=OffsetAndMetadata{offset=10857215, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-3=OffsetAndMetadata{offset=10869806, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-0=OffsetAndMetadata{offset=10893502, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-7=OffsetAndMetadata{offset=10863704, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-4=OffsetAndMetadata{offset=10868957, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-0=OffsetAndMetadata{offset=10888053, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-8=OffsetAndMetadata{offset=10882698, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-4=OffsetAndMetadata{offset=10878119, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-4=OffsetAndMetadata{offset=10865505, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-4=OffsetAndMetadata{offset=10879273, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-8=OffsetAndMetadata{offset=10881371, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-8=OffsetAndMetadata{offset=10868559, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-0=OffsetAndMetadata{offset=10885418, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-8=OffsetAndMetadata{offset=10860320, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-1=OffsetAndMetadata{offset=10854007, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-7=OffsetAndMetadata{offset=10845713, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-8=OffsetAndMetadata{offset=10885806, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-0=OffsetAndMetadata{offset=10839159, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-0=OffsetAndMetadata{offset=10873894, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-3=OffsetAndMetadata{offset=10840694, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-4=OffsetAndMetadata{offset=10879088, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-4=OffsetAndMetadata{offset=10881639, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-8=OffsetAndMetadata{offset=10858490, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-1=OffsetAndMetadata{offset=10850021, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-3=OffsetAndMetadata{offset=10866042, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-5=OffsetAndMetadata{offset=10882422, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-9=OffsetAndMetadata{offset=10870796, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-5=OffsetAndMetadata{offset=10862959, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-9=OffsetAndMetadata{offset=10871214, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-5=OffsetAndMetadata{offset=10871016, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-9=OffsetAndMetadata{offset=10880800, leaderEpoch=null, metadata=''}}
[16:51:34:763] [ERROR] - com.iscas.consumer.application.KafkaConsumerApplication$CunsumerExecutor.execute(KafkaConsumerApplication.java:114) - 提交超时: 
org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before successfully committing offsets {DNS-BEA-DNSR2A-LOG-1=OffsetAndMetadata{offset=10856520, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-5=OffsetAndMetadata{offset=10884298, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-2=OffsetAndMetadata{offset=10857454, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-9=OffsetAndMetadata{offset=10862269, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-2=OffsetAndMetadata{offset=10866053, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-1=OffsetAndMetadata{offset=10864331, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-7=OffsetAndMetadata{offset=10883777, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-5=OffsetAndMetadata{offset=10884329, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-1=OffsetAndMetadata{offset=10869069, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-6=OffsetAndMetadata{offset=10841883, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-9=OffsetAndMetadata{offset=10867495, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-2=OffsetAndMetadata{offset=10876075, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-6=OffsetAndMetadata{offset=10863863, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-2=OffsetAndMetadata{offset=10880983, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-6=OffsetAndMetadata{offset=10889363, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-6=OffsetAndMetadata{offset=10860143, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-2=OffsetAndMetadata{offset=10883515, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-1=OffsetAndMetadata{offset=10858111, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-6=OffsetAndMetadata{offset=10863199, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-2=OffsetAndMetadata{offset=10844604, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-9=OffsetAndMetadata{offset=10855417, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-6=OffsetAndMetadata{offset=10885696, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-6=OffsetAndMetadata{offset=10861467, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-5=OffsetAndMetadata{offset=10869441, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-2=OffsetAndMetadata{offset=10879292, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-1=OffsetAndMetadata{offset=10874203, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-5=OffsetAndMetadata{offset=10873270, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-3=OffsetAndMetadata{offset=10848590, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-3=OffsetAndMetadata{offset=10867922, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-7=OffsetAndMetadata{offset=10858354, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-7=OffsetAndMetadata{offset=10886267, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-7=OffsetAndMetadata{offset=10871525, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-7=OffsetAndMetadata{offset=10873600, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-0=OffsetAndMetadata{offset=10851168, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-3=OffsetAndMetadata{offset=10895303, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-0=OffsetAndMetadata{offset=10882191, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-8=OffsetAndMetadata{offset=10855342, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-9=OffsetAndMetadata{offset=10877034, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-3=OffsetAndMetadata{offset=10864047, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-4=OffsetAndMetadata{offset=10857215, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-3=OffsetAndMetadata{offset=10869806, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-0=OffsetAndMetadata{offset=10893502, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-7=OffsetAndMetadata{offset=10863704, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-4=OffsetAndMetadata{offset=10868957, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-0=OffsetAndMetadata{offset=10888053, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-8=OffsetAndMetadata{offset=10882698, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-4=OffsetAndMetadata{offset=10878119, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-4=OffsetAndMetadata{offset=10865505, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-4=OffsetAndMetadata{offset=10879273, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-8=OffsetAndMetadata{offset=10881371, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-8=OffsetAndMetadata{offset=10868559, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-0=OffsetAndMetadata{offset=10885418, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-8=OffsetAndMetadata{offset=10861265, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-1=OffsetAndMetadata{offset=10854007, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-7=OffsetAndMetadata{offset=10845713, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-8=OffsetAndMetadata{offset=10885806, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-0=OffsetAndMetadata{offset=10839159, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-0=OffsetAndMetadata{offset=10873894, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R_V6-LOG-3=OffsetAndMetadata{offset=10840694, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A_V6-LOG-4=OffsetAndMetadata{offset=10879088, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-4=OffsetAndMetadata{offset=10881639, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F_V6-LOG-8=OffsetAndMetadata{offset=10858490, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-1=OffsetAndMetadata{offset=10850021, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2R-LOG-3=OffsetAndMetadata{offset=10866186, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-5=OffsetAndMetadata{offset=10882422, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-9=OffsetAndMetadata{offset=10870796, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-5=OffsetAndMetadata{offset=10862959, leaderEpoch=null, metadata=''}, DNS-BEA-DNSC2F-LOG-9=OffsetAndMetadata{offset=10871214, leaderEpoch=null, metadata=''}, DNS-BEA-DNSR2A-LOG-5=OffsetAndMetadata{offset=10871016, leaderEpoch=null, metadata=''}, DNS-BEA-DNSFIRST-LOG-9=OffsetAndMetadata{offset=10880800, leaderEpoch=null, metadata=''}}
mahsiaoko 2021-11-03 20:15:48
源自：1-1  导学
2493
收起

正在回答 回答被采纳积分+3

1回答

Allen 2021-11-04 14:24:34

看你截图， 你的ISR是两个节点。leader节点一个是正常的，这个存疑的点我有点没get到。

至于你说的节点经常掉线最好有错误日志， 光给我配置不好判断呢。 有排除过防火墙或者网络问题么

0 回复 有任何疑惑可以回复我~
收起回答
  • 提问者 mahsiaoko #1 
    是这样的，
1. isr经常由两个变为一个，也就是说有一个掉线了。
2.对于leader节点，感觉这个leader节点全都是同一个，因为我这里节点一个是16，一个是8，我觉得比较合理的是leader节点既有16又有8；
3.防火墙和网络问题都已经排除了；
4：掉线的时候经常是上面我粘贴的INFO，错误日志主要是下面的：
    回复 有任何疑惑可以回复我~ 2021-11-09 18:27:39
  • 提问者 mahsiaoko #2 
    老师，您好！因为错误日志比较长，我重新编辑了一下问题，并把错误日志粘贴了一下，谢谢老师!
    回复 有任何疑惑可以回复我~ 2021-11-09 18:33:16
  • 提问者 mahsiaoko #3 
    这里说Timeout of 60000ms expired before successfully committing offsets，我跟踪了一下发现好像是因为节点经常掉线，然后导致找不到节点，从而提交超时，但是掉线的原因目前找不到。
还有运行broker的虚拟机经常特别卡，不知道这个和节点掉线有没有关系。
    回复 有任何疑惑可以回复我~ 2021-11-09 18:37:28
点开查看后面1条评论
取消 回复

相似问题

关于维护isr的疑问
693 0 3
请教一个关于redis集群的问题
763 3 2
redis集群再启动的问题
819 0 8
关于PXC节点数量的问题
800 0 4
关于kafka集群和zookeeper集群
794 0 2

登录后可查看更多问答，登录/注册

问题已解决，确定采纳
还有疑问，暂不采纳
Kafka多维度系统精讲，从入门到实战开发
  • 参与学习       878    人
  • 提交作业       75    份
  • 解答问题       222    个

系统讲解Kafka，实战结合，让你成为使用Kafka的高手

了解课程

本课精华内容

问答 作业

关于提问范围的问题

1.1k 2

自定义partition调用异步阻塞这样的方式

940 13

offset回滚后无法重复消费数据

1.1k 10

无法创建topic

2.1k 10

关于经典模式的疑问

2.0k 8

查看更多本课问答
意见反馈 帮助中心 APP下载
官方微信