OpenSearch

OpenSearch Deployment

Logs captured by Fluentd from different components are pushed to OpenSearch for search, display, and reports.

It is recommended to install one instance of OpenSearch in each of your namespaces (NS). The following guide installs OpenSearch on a dev NS. Change it accordingly when installing on different NS.

Prerequisites

• The following utilities/tools must be present on the user's machine.

  • kubectl, istioctl, helm, jq, curl, wget, git, bash, envsubst.

• Keycloak for Authentication and Sign-in to UI

Installation

Clone the https://github.com/openg2p/openg2p-deployment repo and navigate to kubernetes/logging directory.

Install OpenSearch (and related components)

• Run this to install OpenSearch and related components.

  OPENSEARCH_HOSTNAME="opnesearch.dev.your.org" \
  OPENSEARCH_CLIENT_ID="openg2p-opensearch-dev" \
  OPENSEARCH_CLIENT_SECRET="" \
  KEYCLOAK_ISSUER_URL="https://keycloak.your.org/realms/master" \
  NS="dev" \
      ./opensearch-install.sh

• After successful installation, OpenSearch dashboards can be accessed using the hostname given above.

Add Index State Policy on OpenSearch

• Run this to add ISM Policy (This is responsible for automatically deleting logstash indices after 3 days. Configure the minimum age to delete indices, in the same script below.)

  NS="dev" \
      ./opensearch-ism-script.sh

Dashboards

TBD

Access control on dashboards:

TBD

TraceId

TBD