Fluentd

Fluentd Install

Fluentd is used to parse logs generated by applications.

Installation

Prerequisites

• The following utilities/tools must be present on the user's machine.

  • kubectl, istioctl, helm, jq, curl, wget, git, bash, envsubst.

• Keycloak for Authentication and Sign-in to UI

Fluentd Installation

• Clone the https://github.com/openg2p/openg2p-deployment repo and navigate to kubernetes/logging directory.

• On Rancher UI, navigate to Apps (or Apps & Marketplace) -> Charts

• Search and install Logging from the list, with default values.

Rancher Fluentd configuration

• Run this to create ClusterOutput (This is responsible for redirecting all logs to OpenSearch.)

  kubectl apply -f clusteroutput-opensearch.yaml

• Run this to create a ClusterFlow (This is responsible for filtering OpenG2P service logs, from the logs of all pods.)

  kubectl apply -f clusterflow-all.yaml

Filters

Note the filters applied in clusterflow-all.yaml. You may update the same for your install if required, and rerun the apply command.