1.先启动kafka集群

 

kafka-server-start.sh /home/hadoop/apps/kafka_2.11-1.1.0/config/server.properties

2.添加maven依赖,可在创建项目的时候勾选

 

<dependency>
    <groupId>org.springframework.kafka</groupId>
    <artifactId>spring-kafka</artifactId>
</dependency>

项目结构如下

配置信息:

application.yml

 

spring:
  kafka:
    bootstrap-servers: master:9092
    producer:
      key-serializer: org.apache.kafka.common.serialization.StringSerializer
      value-serializer: org.apache.kafka.common.serialization.StringSerializer
    consumer:
      group-id: test
      enable-auto-commit: true
      auto-commit-interval: 1000
      key-deserializer: org.apache.kafka.common.serialization.StringDeserializer
      value-deserializer: org.apache.kafka.common.serialization.StringDeserializer

要注意对齐,否则读不到配置信息会报错

 

生产者:

 

package com.example.testkafkacspring.demo.web;
​
import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.kafka.core.KafkaTemplate;
import org.springframework.web.bind.annotation.RequestMapping;
import org.springframework.web.bind.annotation.RestController;
​
/**
 * 测试kafka生产者
 */
@RestController
@RequestMapping("kafka")
public class TestKafkaProducerController {
    @Autowired
    private KafkaTemplate<String, String> kafkaTemplate;
    @RequestMapping("send")
    public String send(String msg){
        kafkaTemplate.send("test_topic", msg);
        return "success add ";
    }
}

消费者:

 

package com.example.testkafkacspring.demo.kafka;
​
import org.apache.kafka.clients.consumer.ConsumerRecord;
import org.springframework.kafka.annotation.KafkaListener;
import org.springframework.stereotype.Component;
​
/**
 * kafka消费者测试
 */
@Component
public class TestConsumer {
    @KafkaListener(topics = "test_topic")
    public void listen (ConsumerRecord<?, ?> record) throws Exception {
        //控制台打印send进来的信息
        System.out.printf("topic = %s, offset = %d, value = %s \n", record.topic(), record.offset(), record.value());
    }
}

启动类:

 

package com.example.testkafkacspring.demo;
​
import org.springframework.boot.SpringApplication;
import org.springframework.boot.autoconfigure.SpringBootApplication;
​
@SpringBootApplication
public class DemoApplication {
    public static void main(String[] args) {
        SpringApplication.run(DemoApplication.class, args);
    }
}

运行项目:

可能会报错。遇到本地8080端口被占用,kafka服务器的server.properties配置信息错误,修改即可

在浏览器访问:http://localhost:8080/kafka/send?msg=hello

控制台输出:

 

topic = test_topic, offset = 0, value = hello

为了体现消费者不止执行一次就结束,再调用一次接口:http://localhost:8080/kafka/send?msg=kafka

 

topic = test_topic, offset = 1, value = kafka 

可以不停的向topic里send信息

Logo

Kafka开源项目指南提供详尽教程,助开发者掌握其架构、配置和使用,实现高效数据流管理和实时处理。它高性能、可扩展,适合日志收集和实时数据处理,通过持久化保障数据安全,是企业大数据生态系统的核心。

更多推荐