Fluentd is an open source data collector for unified logging layer.
Works for Logs, Metrics & Traces
Fluent Bit is an open source and multi-platform Log Processor and Forwarder
fluent-bit memory management
Copy $ docker pull fluent/fluent-bit download mosquitto(MQTT client) for test
Copy $ docker run -ti fluent/fluent-bit /fluent-bit/bin/fluent-bit -i mqtt -t data stdout -m '*' cpu -o stdout -f 1
// run with MQTT & port 1883
$ docker run -p 1883:1883 -ti fluent/fluent-bit /fluent-bit/bin/fluent-bit -i mqtt -t data stdout -m '*' cpu -o stdout -f 1 run with MQTT & Elasticsearch
Copy $ docker run -p 1883:1883 -ti \
--net=mynet \
fluent/fluent-bit /fluent-bit/bin/fluent-bit \
-i mqtt \
$ docker run -p 1883:1883 -ti \
fluent/fluent-bit /fluent-bit/bin/fluent-bit \
-i mqtt \
-o es://192.167.0.4:9200/test_index/test_type \
-o stdout -m '*'
Copy "-i mqtt",
"-p Host=one-framework-3rd-party-elasticsearch",
"-p Port=9200",
"-p Index=test_index",
"-p Type=test_type"
Copy docker exec -it ${CONTAINER_ID} /fluent-bit/bin
Copy $ mosquitto_pub -m '{"key1": 123, "key2": 456}' -t some/topic Centralized Container Logging with Fluent Bit (
AWS Open Source Blog )
