安装filebeat

linux安装filebeat采集consul日志，并发送到kafka

1. 创建安装目录

mkdir -p /opt/server

mkdir -p /data/logs

2. 下载安装包并解压

tar -zxvf filebeat-6.3.1-linux-x86_64.tar.gz

3. 重命名文件夹为filebeat

mv filebeat-6.3.1-linux-x86_64 filebeat
 

4. 修改配置文件filebeat.yml

cd filebeat

vim filebeat.yml

logging.level: info
logging.to_files: true
logging.files:
  path: /var/log/filebeat
  name: filebeat
  keepfiles: 7
  permissions: 0644

filebeat.inputs:
- type: log
  enabled: true
  fields:
    log-type: consul
  paths:
    - /data/logs/*.log

output.kafka:
  hosts: ["kafka1:9092", "kafka2:9092", "kafka3:9092"]

  topic: 'logs'
  partition.hash:
    reachable_only: false

  required_acks: 1
  compression: gzip
  max_message_bytes: 1000000

5. 配置kafka服务器host

172.16.10.213  kafka1

172.16.10.214  kafka2

172.16.10.218  kafka3

6. 启动filebeat

nohup ./filebeat -c filebeat.yml >> /dev/null 2>&1 &