[Fluentd] 1. 설치

Before Installation

Increase the Maximum Number of File Descriptors

# 확인
$ ulimit -n
65535

# 서버마다 다른지 모르겠지만, CentOS는 1024가 default
# 아래 파일 내용 추가
$ vi /etc/security/limits.conf

root soft nofile 65536
root hard nofile 65536
* soft nofile 65536
* hard nofile 65536

systemd 서비스 사용중인 os는 
'LimitNOFILE=65536'
추가, 이외 os 는 default 로 set 되어 있음

Optimize the Network Kernel Parameters

$ vi /etc/sysctl.conf

net.core.somaxconn = 1024
net.core.netdev_max_backlog = 5000
net.core.rmem_max = 16777216
net.core.wmem_max = 16777216
net.ipv4.tcp_wmem = 4096 12582912 16777216
net.ipv4.tcp_rmem = 4096 12582912 16777216
net.ipv4.tcp_max_syn_backlog = 8096
net.ipv4.tcp_slow_start_after_idle = 0
net.ipv4.tcp_tw_reuse = 1
net.ipv4.ip_local_port_range = 10240 65535

$ sysctl -p

Install

Install by RPM Package (Red Hat Linux)

td-agent v4 버전 사용

Executing this script will automatically install td-agent on your machine. 
This shell script registers a new rpm repository at /etc/yum.repos.d/td.repo and installs td-agent.

$ curl -L https://toolbelt.treasuredata.com/sh/install-redhat-td-agent4.sh | sh

Lanuch

$ systemctl start td-agent
$ systemctl status td-agent

Sample Test Log via HTTP

$ curl -X POST -d 'json={"json":"message"}' http://localhost:8888/debug.test

$ cat /var/log/td-agent/td-agent.log

Configuration

# 설정파일
/etc/td-agent/td-agent.conf

# 로그파일
/var/log/td-agent/td-agent.log