官方:http://kafka.apache.org/21/documentation.html#monitoring

使用Yammer Metrics来上报broker端的Metrics。Java客户端使用Kafka Metrics上报,这是一个内置的Metrics注册表,它最小化了客户端应用程序的依赖关系。两者都可以通过JMX方式获取,并且是可插拨的连接到你的监控系统。

添加依赖

   <dependency>
      <groupId>io.micrometer</groupId>
      <artifactId>micrometer-core</artifactId>
      <!-- 版本自己选择,核心包 -->
      <version>1.9.4</version>
    </dependency>
    <dependency>
      <groupId>org.apache.kafka</groupId>
      <artifactId>kafka-clients</artifactId>
    </dependency>

Producer

// 配置producer
Properties props = new Properties();
props.put("bootstrap.servers", "localhost:9092");
props.put("acks", "all");
props.put("retries", 0);
props.put("linger.ms", 1);
props.put("key.serializer", "org.apache.kafka.common.serialization.StringSerializer");
props.put("value.serializer", "org.apache.kafka.common.serialization.StringSerializer");
Producer<String, String> producer = new KafkaProducer<>(props);
// 发送数据到 aaa topic
for (int i = 0; i < 100; i++) {
    producer.send(new ProducerRecord<String, String>("aaa", Integer.toString(i), Integer.toString(i)));
}
// metrics
new KafkaClientMetrics(producer).bindTo(new LoggingMeterRegistry(new LoggingRegistryConfig() {
    @Override
    public String get(String key) {
        return null;
    }
    @Override
    public Duration step() {
        return Duration.ofSeconds(10);
    }
}, Clock.SYSTEM));
// 关闭
producer.close();

Consumer

// 配置consumer
Properties props = new Properties();
props.setProperty("bootstrap.servers", "localhost:9092");
props.setProperty("group.id", "a1");
props.setProperty("enable.auto.commit", "false");
props.setProperty("auto.offset.reset", "earliest");
props.setProperty("max.poll.records", "15");
props.setProperty("key.deserializer", "org.apache.kafka.common.serialization.StringDeserializer");
props.setProperty("value.deserializer", "org.apache.kafka.common.serialization.StringDeserializer");
KafkaConsumer<String, String> consumer = new KafkaConsumer<>(props);
// 订阅 aaa topic
consumer.subscribe(Arrays.asList("aaa"));
// 绑定 metrics
new KafkaClientMetrics(consumer).bindTo(new LoggingMeterRegistry(new LoggingRegistryConfig() {
    @Override
    public String get(String key) {
        return null;
    }
    @Override
    public Duration step() {
        return Duration.ofSeconds(10);
    }
}, Clock.SYSTEM));
// 轮休获取msg
while (true) {
    ConsumerRecords<String, String> records = consumer.poll(Duration.ofMillis(100));
    for (ConsumerRecord<String, String> record : records) {
        System.out.println(record);
        try {
            TimeUnit.MILLISECONDS.sleep(300);
        } catch (InterruptedException e) {
            e.printStackTrace();
        }
        consumer.commitSync();
    }
}

指标

公共

以下是公共指标生产者和消费者一样。

  • kafka.producer.connection.close.total
  • kafka.consumer.connection.close.total
  • connection-close-rate 每秒被关闭连接数
  • connection-close-total 从客户端本次启动截止当前被关闭连接总数
  • connection-creation-rate 每次创建新连接数
  • connection-creation-total 从客户端本次启动截止当前新创建连接总数
  • connection-count 当前活跃连接数
  • network-io-rate 每秒网络读写次数
  • network-io-total 从客户端本次启动截止当前网络读写总次数
  • outgoing-byte-rate 每秒输出字节
  • outgoing-byte-total 从客户端本次启动截止当前输出总字节
  • request-rate 每秒请求次数
  • request-total 从客户端本次启动截止当前请求总次数
  • request-size-avg 平均请求大小,单位:字节
  • request-size-max 最大请求大小,单位:字节
  • incoming-byte-rate 每秒输入字节
  • incoming-byte-total 从客户端本次启动截止当前输入总字节
  • response-rate 每秒响应次数
  • response-total 从客户端本次启动截止当前响应总次数
  • io-wait-ratio IO线程等待时间
  • io-ratio IO线程执行时间

Broker Node

示例

  • kafka.producer.node.outgoing.byte.rate{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} value=NaN
  • kafka.producer.node.outgoing.byte.rate{client.id=producer-1,kafka.version=3.1.2,node.id=node–1} value=NaN
  • outgoing-byte-rate 每秒输出字节
  • outgoing-byte-total 从客户端本次启动截止当前输出总字节
  • incoming-byte-rate 每秒输入字节
  • incoming-byte-total 从客户端本次启动截止当前输入总字节
  • request-rate 每秒请求次数
  • request-total 从客户端本次启动截止当前请求总次数
  • request-size-avg 平均请求大小,单位:字节
  • request-size-max 最大请求大小,单位:字节
  • response-rate 每秒响应次数
  • response-total 从客户端本次启动截止当前响应总次数
  • request-latency-avg 平均请求延迟 ,单位:毫秒
  • request-latency-max 最大请求延迟,单位:毫秒

生产者

record

kafka.producer.record.size.avg{client.id=producer-1,kafka.version=3.1.2} value=89
kafka.producer.record.size.max{client.id=producer-1,kafka.version=3.1.2} value=89

  • record-size-avg 平均记录大小,单位:字节
  • record-size-max 最大记录大小,单位:字节
topic

kafka.producer.topic.record.error.rate{client.id=producer-1,kafka.version=3.1.2,topic=aaa} value=0
kafka.producer.topic.record.retry.rate{client.id=producer-1,kafka.version=3.1.2,topic=aaa} value=0
kafka.producer.topic.record.send.rate{client.id=producer-1,kafka.version=3.1.2,topic=aaa} value=1.992588

  • byte-rate topic每秒生产字节
  • byte-total 从客户端本次启动截止当前topic生产总字节
  • record-error-rate topic每秒错误记录数
  • record-error-total 从客户端本次启动截止当前topic生产错误记录总数
  • record-retry-rate topic每秒生产重试记录数
  • record-retry-total 从客户端本次启动截止当前topic生产重试记录总数
  • record-send-rate topic每秒生产记录数
  • record-send-total 从客户端本次启动截止当前topic生产记录总数

消费者

coordinator
指标名称指标描述
commit-latency-avg平均请求延迟,单位:毫秒
commit-latency-max最大请求延迟,单位:毫秒
commit-rate每秒提交次数
commit-total提交总次数
fetch manager

kafka.consumer.fetch.manager.fetch.latency.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=13
kafka.consumer.fetch.manager.fetch.latency.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=13
kafka.consumer.fetch.manager.fetch.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=0.020722

  • bytes-consumed-rate 每秒消费字节
  • bytes-consumed-total 消费总字节
  • records-consumed-rate 每秒消费记录
  • records-consumed-total 消费总记录
  • fetch-latency-avg 平均抓取延迟,单位:毫秒
  • fetch-latency-max 最大抓取请求延迟,单位:毫秒
  • fetch-size-avg 平均抓取请求大小,单位:字节
  • fetch-size-max 最大抓取请求大小,单位:字节
  • fetch-rate 每秒抓取请求数
  • fetch-total 抓取请求总数
topic

kafka.consumer.fetch.manager.records.consumed.rate{client.id=consumer-a1-1,kafka.version=3.1.2,topic=aaa} value=0
kafka.consumer.fetch.manager.records.lag{client.id=consumer-a1-1,kafka.version=3.1.2,partition=0,topic=aaa} value=0
kafka.consumer.fetch.manager.records.lag{client.id=consumer-a1-1,kafka.version=3.1.2,partition=1,topic=aaa} value=0

  • bytes-consumed-rate topic每秒消费字节
  • bytes-consumed-total topic消费总字节
  • records-consumed-rate topic每秒消费记录
  • records-consumed-total topic消费总记录
  • fetch-size-avg 平均抓取请求大小,单位:字节
  • fetch-size-max 最大抓取请求大小,单位:字节
partition

kafka.consumer.fetch.manager.records.lag{client.id=consumer-a1-1,kafka.version=3.1.2,partition=0,topic=aaa} value=0
kafka.consumer.fetch.manager.records.lag{client.id=consumer-a1-1,kafka.version=3.1.2,partition=1,topic=aaa} value=0

指标名称指标描述
records-lag分区当前消费延迟记录
records-lag-avg分区平均消费延迟记录
records-lag-max分区最大消费延迟记录

示例

Producer
kafka.producer.connection.close.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.connection.count{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.connection.creation.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.failed.authentication.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.failed.reauthentication.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.flush.time.ns.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.incoming.byte.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.io.time.ns.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.io.wait.time.ns.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.io.waittime.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.iotime.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.network.io.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.node.incoming.byte.total{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} throughput=NaN/s
kafka.producer.node.incoming.byte.total{client.id=producer-1,kafka.version=3.1.2,node.id=node--1} throughput=NaN/s
kafka.producer.node.outgoing.byte.total{client.id=producer-1,kafka.version=3.1.2,node.id=node--1} throughput=NaN/s
kafka.producer.node.outgoing.byte.total{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} throughput=NaN/s
kafka.producer.node.request.total{client.id=producer-1,kafka.version=3.1.2,node.id=node--1} throughput=NaN/s
kafka.producer.node.request.total{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} throughput=NaN/s
kafka.producer.node.response.total{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} throughput=NaN/s
kafka.producer.node.response.total{client.id=producer-1,kafka.version=3.1.2,node.id=node--1} throughput=NaN/s
kafka.producer.outgoing.byte.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.request.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.response.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.select.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.successful.authentication.no.reauth.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.successful.authentication.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.successful.reauthentication.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.txn.abort.time.ns.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.txn.begin.time.ns.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.txn.commit.time.ns.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.txn.init.time.ns.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.producer.txn.send.offsets.time.ns.total{client.id=producer-1,kafka.version=3.1.2} throughput=NaN/s
kafka.app.info.start.time.ms{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.batch.size.avg{client.id=producer-1,kafka.version=3.1.2} value=601
kafka.producer.batch.size.max{client.id=producer-1,kafka.version=3.1.2} value=614
kafka.producer.batch.split.rate{client.id=producer-1,kafka.version=3.1.2} value=0
kafka.producer.buffer.available.bytes{client.id=producer-1,kafka.version=3.1.2} value=33554432
kafka.producer.buffer.exhausted.rate{client.id=producer-1,kafka.version=3.1.2} value=0
kafka.producer.buffer.total.bytes{client.id=producer-1,kafka.version=3.1.2} value=33554432
kafka.producer.bufferpool.wait.ratio{client.id=producer-1,kafka.version=3.1.2} value=0
kafka.producer.compression.rate.avg{client.id=producer-1,kafka.version=3.1.2} value=1
kafka.producer.connection.close.rate{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.connection.creation.rate{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.failed.authentication.rate{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.failed.reauthentication.rate{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.incoming.byte.rate{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.io.ratio{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.io.time.ns.avg{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.io.wait.ratio{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.io.wait.time.ns.avg{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.metadata.age{client.id=producer-1,kafka.version=3.1.2} value=20.211
kafka.producer.network.io.rate{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.node.incoming.byte.rate{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} value=NaN
kafka.producer.node.incoming.byte.rate{client.id=producer-1,kafka.version=3.1.2,node.id=node--1} value=NaN
kafka.producer.node.outgoing.byte.rate{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} value=NaN
kafka.producer.node.outgoing.byte.rate{client.id=producer-1,kafka.version=3.1.2,node.id=node--1} value=NaN
kafka.producer.node.request.latency.avg{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} value=NaN
kafka.producer.node.request.latency.avg{client.id=producer-1,kafka.version=3.1.2,node.id=node--1} value=NaN
kafka.producer.node.request.latency.max{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} value=NaN
kafka.producer.node.request.latency.max{client.id=producer-1,kafka.version=3.1.2,node.id=node--1} value=NaN
kafka.producer.node.request.rate{client.id=producer-1,kafka.version=3.1.2,node.id=node--1} value=NaN
kafka.producer.node.request.rate{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} value=NaN
kafka.producer.node.request.size.avg{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} value=NaN
kafka.producer.node.request.size.avg{client.id=producer-1,kafka.version=3.1.2,node.id=node--1} value=NaN
kafka.producer.node.request.size.max{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} value=NaN
kafka.producer.node.request.size.max{client.id=producer-1,kafka.version=3.1.2,node.id=node--1} value=NaN
kafka.producer.node.response.rate{client.id=producer-1,kafka.version=3.1.2,node.id=node--1} value=NaN
kafka.producer.node.response.rate{client.id=producer-1,kafka.version=3.1.2,node.id=node-0} value=NaN
kafka.producer.outgoing.byte.rate{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.produce.throttle.time.avg{client.id=producer-1,kafka.version=3.1.2} value=0
kafka.producer.produce.throttle.time.max{client.id=producer-1,kafka.version=3.1.2} value=0
kafka.producer.reauthentication.latency.avg{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.reauthentication.latency.max{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.record.error.rate{client.id=producer-1,kafka.version=3.1.2} value=0
kafka.producer.record.queue.time.avg{client.id=producer-1,kafka.version=3.1.2} value=7.5
kafka.producer.record.queue.time.max{client.id=producer-1,kafka.version=3.1.2} value=10
kafka.producer.record.retry.rate{client.id=producer-1,kafka.version=3.1.2} value=0
kafka.producer.record.send.rate{client.id=producer-1,kafka.version=3.1.2} value=1.992588
kafka.producer.record.size.avg{client.id=producer-1,kafka.version=3.1.2} value=89
kafka.producer.record.size.max{client.id=producer-1,kafka.version=3.1.2} value=89
kafka.producer.records.per.request.avg{client.id=producer-1,kafka.version=3.1.2} value=100
kafka.producer.request.latency.avg{client.id=producer-1,kafka.version=3.1.2} value=12
kafka.producer.request.latency.max{client.id=producer-1,kafka.version=3.1.2} value=12
kafka.producer.request.rate{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.request.size.avg{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.request.size.max{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.requests.in.flight{client.id=producer-1,kafka.version=3.1.2} value=0
kafka.producer.response.rate{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.select.rate{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.successful.authentication.rate{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.successful.reauthentication.rate{client.id=producer-1,kafka.version=3.1.2} value=NaN
kafka.producer.topic.byte.rate{client.id=producer-1,kafka.version=3.1.2,topic=aaa} value=23.950903
kafka.producer.topic.compression.rate{client.id=producer-1,kafka.version=3.1.2,topic=aaa} value=1
kafka.producer.topic.record.error.rate{client.id=producer-1,kafka.version=3.1.2,topic=aaa} value=0
kafka.producer.topic.record.retry.rate{client.id=producer-1,kafka.version=3.1.2,topic=aaa} value=0
kafka.producer.topic.record.send.rate{client.id=producer-1,kafka.version=3.1.2,topic=aaa} value=1.992588
kafka.producer.waiting.threads{client.id=producer-1,kafka.version=3.1.2} value=0
Consumer

kafka.consumer.coordinator.heartbeat.total{client.id=consumer-a1-1,kafka.version=3.1.2} throughput=0.4/s
kafka.consumer.fetch.manager.fetch.total{client.id=consumer-a1-1,kafka.version=3.1.2} throughput=2/s
kafka.consumer.incoming.byte.total{client.id=consumer-a1-1,kafka.version=3.1.2} throughput=49.6/s
kafka.consumer.io.time.ns.total{client.id=consumer-a1-1,kafka.version=3.1.2} throughput=368160.6/s
kafka.consumer.io.wait.time.ns.total{client.id=consumer-a1-1,kafka.version=3.1.2} throughput=998079960.7/s
kafka.consumer.io.waittime.total{client.id=consumer-a1-1,kafka.version=3.1.2} throughput=998079960.7/s
kafka.consumer.iotime.total{client.id=consumer-a1-1,kafka.version=3.1.2} throughput=368160.6/s
kafka.consumer.network.io.total{client.id=consumer-a1-1,kafka.version=3.1.2} throughput=4.8/s
kafka.consumer.node.incoming.byte.total{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-2147483647} throughput=5.6/s
kafka.consumer.node.incoming.byte.total{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-0} throughput=44/s
kafka.consumer.node.outgoing.byte.total{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-2147483647} throughput=34.8/s
kafka.consumer.node.outgoing.byte.total{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-0} throughput=120/s
kafka.consumer.node.request.total{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-2147483647} throughput=0.4/s
kafka.consumer.node.request.total{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-0} throughput=2/s
kafka.consumer.node.response.total{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-2147483647} throughput=0.4/s
kafka.consumer.node.response.total{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-0} throughput=2/s
kafka.consumer.outgoing.byte.total{client.id=consumer-a1-1,kafka.version=3.1.2} throughput=154.8/s
kafka.consumer.request.total{client.id=consumer-a1-1,kafka.version=3.1.2} throughput=2.4/s
kafka.consumer.response.total{client.id=consumer-a1-1,kafka.version=3.1.2} throughput=2.4/s
kafka.consumer.select.total{client.id=consumer-a1-1,kafka.version=3.1.2} throughput=25.1/s
kafka.app.info.start.time.ms{client.id=consumer-a1-1,kafka.version=3.1.2} value=1665563136653
kafka.consumer.connection.close.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.connection.creation.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.coordinator.assigned.partitions{client.id=consumer-a1-1,kafka.version=3.1.2} value=2
kafka.consumer.coordinator.commit.latency.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.commit.latency.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.commit.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.coordinator.failed.rebalance.rate.per.hour{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.coordinator.heartbeat.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=0.350436
kafka.consumer.coordinator.heartbeat.response.time.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=3
kafka.consumer.coordinator.join.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.coordinator.join.time.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.join.time.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.last.heartbeat.seconds.ago{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.coordinator.last.rebalance.seconds.ago{client.id=consumer-a1-1,kafka.version=3.1.2} value=2162
kafka.consumer.coordinator.partition.assigned.latency.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.partition.assigned.latency.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.partition.lost.latency.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.partition.lost.latency.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.partition.revoked.latency.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.partition.revoked.latency.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.rebalance.latency.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.rebalance.latency.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.rebalance.rate.per.hour{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.coordinator.sync.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.coordinator.sync.time.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.coordinator.sync.time.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.failed.authentication.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.failed.reauthentication.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.fetch.manager.bytes.consumed.rate{client.id=consumer-a1-1,kafka.version=3.1.2,topic=aaa} value=0
kafka.consumer.fetch.manager.fetch.latency.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=501.939655
kafka.consumer.fetch.manager.fetch.latency.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=504
kafka.consumer.fetch.manager.fetch.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=1.997452
kafka.consumer.fetch.manager.fetch.size.avg{client.id=consumer-a1-1,kafka.version=3.1.2,topic=aaa} value=NaN
kafka.consumer.fetch.manager.fetch.size.max{client.id=consumer-a1-1,kafka.version=3.1.2,topic=aaa} value=NaN
kafka.consumer.fetch.manager.fetch.throttle.time.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.fetch.manager.fetch.throttle.time.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.fetch.manager.preferred.read.replica{client.id=consumer-a1-1,kafka.version=3.1.2,partition=0,topic=aaa} value=-1
kafka.consumer.fetch.manager.preferred.read.replica{client.id=consumer-a1-1,kafka.version=3.1.2,partition=1,topic=aaa} value=-1
kafka.consumer.fetch.manager.records.consumed.rate{client.id=consumer-a1-1,kafka.version=3.1.2,topic=aaa} value=0
kafka.consumer.fetch.manager.records.lag{client.id=consumer-a1-1,kafka.version=3.1.2,partition=0,topic=aaa} value=0
kafka.consumer.fetch.manager.records.lag{client.id=consumer-a1-1,kafka.version=3.1.2,partition=1,topic=aaa} value=0
kafka.consumer.fetch.manager.records.lag.avg{client.id=consumer-a1-1,kafka.version=3.1.2,partition=0,topic=aaa} value=NaN
kafka.consumer.fetch.manager.records.lag.avg{client.id=consumer-a1-1,kafka.version=3.1.2,partition=1,topic=aaa} value=NaN
kafka.consumer.fetch.manager.records.lag.max{client.id=consumer-a1-1,kafka.version=3.1.2,partition=1,topic=aaa} value=NaN
kafka.consumer.fetch.manager.records.lag.max{client.id=consumer-a1-1,kafka.version=3.1.2,partition=0,topic=aaa} value=NaN
kafka.consumer.fetch.manager.records.lead{client.id=consumer-a1-1,kafka.version=3.1.2,partition=1,topic=aaa} value=1617
kafka.consumer.fetch.manager.records.lead{client.id=consumer-a1-1,kafka.version=3.1.2,partition=0,topic=aaa} value=1668
kafka.consumer.fetch.manager.records.lead.avg{client.id=consumer-a1-1,kafka.version=3.1.2,partition=0,topic=aaa} value=NaN
kafka.consumer.fetch.manager.records.lead.avg{client.id=consumer-a1-1,kafka.version=3.1.2,partition=1,topic=aaa} value=NaN
kafka.consumer.fetch.manager.records.lead.min{client.id=consumer-a1-1,kafka.version=3.1.2,partition=1,topic=aaa} value=NaN
kafka.consumer.fetch.manager.records.lead.min{client.id=consumer-a1-1,kafka.version=3.1.2,partition=0,topic=aaa} value=NaN
kafka.consumer.fetch.manager.records.per.request.avg{client.id=consumer-a1-1,kafka.version=3.1.2,topic=aaa} value=NaN
kafka.consumer.incoming.byte.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=48.827874
kafka.consumer.io.ratio{client.id=consumer-a1-1,kafka.version=3.1.2} value=0.000333
kafka.consumer.io.time.ns.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=13893.021127
kafka.consumer.io.wait.ratio{client.id=consumer-a1-1,kafka.version=3.1.2} value=0.999298
kafka.consumer.io.wait.time.ns.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=41636640.301408
kafka.consumer.last.poll.seconds.ago{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.network.io.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=4.692168
kafka.consumer.node.incoming.byte.rate{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-2147483647} value=4.878138
kafka.consumer.node.incoming.byte.rate{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node--1} value=0
kafka.consumer.node.incoming.byte.rate{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-0} value=43.943934
kafka.consumer.node.outgoing.byte.rate{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-0} value=119.844305
kafka.consumer.node.outgoing.byte.rate{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-2147483647} value=30.313033
kafka.consumer.node.outgoing.byte.rate{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node--1} value=0
kafka.consumer.node.request.latency.avg{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node--1} value=NaN
kafka.consumer.node.request.latency.avg{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-2147483647} value=NaN
kafka.consumer.node.request.latency.avg{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-0} value=NaN
kafka.consumer.node.request.latency.max{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-0} value=NaN
kafka.consumer.node.request.latency.max{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node--1} value=NaN
kafka.consumer.node.request.latency.max{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-2147483647} value=NaN
kafka.consumer.node.request.rate{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node--1} value=0
kafka.consumer.node.request.rate{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-0} value=1.997405
kafka.consumer.node.request.rate{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-2147483647} value=0.348426
kafka.consumer.node.request.size.avg{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-0} value=60
kafka.consumer.node.request.size.avg{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-2147483647} value=87
kafka.consumer.node.request.size.avg{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node--1} value=NaN
kafka.consumer.node.request.size.max{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-0} value=60
kafka.consumer.node.request.size.max{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node--1} value=NaN
kafka.consumer.node.request.size.max{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-2147483647} value=87
kafka.consumer.node.response.rate{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-2147483647} value=0.348438
kafka.consumer.node.response.rate{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node--1} value=0
kafka.consumer.node.response.rate{client.id=consumer-a1-1,kafka.version=3.1.2,node.id=node-0} value=1.997452
kafka.consumer.outgoing.byte.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=150.167708
kafka.consumer.poll.idle.ratio.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=0.499983
kafka.consumer.reauthentication.latency.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.reauthentication.latency.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=NaN
kafka.consumer.request.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=2.346084
kafka.consumer.request.size.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=64.007812
kafka.consumer.request.size.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=87
kafka.consumer.response.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=2.346084
kafka.consumer.select.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=23.979523
kafka.consumer.successful.authentication.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.successful.reauthentication.rate{client.id=consumer-a1-1,kafka.version=3.1.2} value=0
kafka.consumer.time.between.poll.avg{client.id=consumer-a1-1,kafka.version=3.1.2} value=108.474766
kafka.consumer.time.between.poll.max{client.id=consumer-a1-1,kafka.version=3.1.2} value=115
Logo

Kafka开源项目指南提供详尽教程,助开发者掌握其架构、配置和使用,实现高效数据流管理和实时处理。它高性能、可扩展,适合日志收集和实时数据处理,通过持久化保障数据安全,是企业大数据生态系统的核心。

更多推荐