I have used fluentd with s3 and fluentd with graylod this is excellent toll. Fluentd agentd pushes logs to s3 and after used athena service to query over on those logs.
Fluentd provides tones of plugins to collect data from different sources and store in different sinks.
You can collect data from log files, databases, and even Kafka streams.
You can process log contents with Fluentd and store with JSON format schema in files or even NoSQL.
Fluentd is part of the Cloud Native Computing Foundation (CNCF).
You can use Fluentd to collect Kubernetes and Docker logs and store in different cloud storage.
The community is active. You can find help from Fluentd Slack workspace.
If you're interested in collecting data from IoT devices, you can give fluent-bit [1] a try.
[1] https://fluentbit.io/
With over 2.5 million reviews, we can provide the specific details that help you make an informed software buying decision for your business. Finding the right product is important, let us help.
or continue with
LinkedIn
Google
Google (Business)
Gmail.com addresses not permitted. A business domain using Google is allowed.