官方最新下载filebeat  

https://www.elastic.co/products/beats


tar -zxvf  filebeat-5.5.2-linux-x86_64.tar.gz


cd  filebeat-5.5.2-linux-x86_64


filebeat主要是对配置文件filebeat.yml  进行修改

#================================  input  =====================================


filebeat.prospectors:


# Each - is a prospector. Most options can be set at the prospector level, so
# you can use different prospectors for various configurations.
# Below are the prospector specific configurations.


- input_type: log


  # Paths that should be crawled and fetched. Glob based paths.
  paths:
    #- /var/log/*.log
    #- c:\programdata\elasticsearch\logs\*
    - /home/luffy/aaa.log


#================================ Kafka output =====================================
output.kafka:
  enabled: true
  hosts: ["192.1.1.208:9092"]
  topic: luffy_test09

注释:filebeat对格式要求严格,空格不可多不可少。而且。topic如果不存在,则会自己创建

Logo

Kafka开源项目指南提供详尽教程,助开发者掌握其架构、配置和使用,实现高效数据流管理和实时处理。它高性能、可扩展,适合日志收集和实时数据处理,通过持久化保障数据安全,是企业大数据生态系统的核心。

更多推荐