System Logging

System logs generated across all components can be monitored via the logging pipeline shown below. The logs can be searched, sliced and diced for analytics. Fluentd and OpenSearch are used to collect, parse, display and search logs.

Logging pipeline

Logging Pipeline

Log files

This is a simple method where the Python logging module is used to write system event logs in JSON or other format in log files directly. These log files are shunted to OpenSearch for indexing, searching and querying. See System Logs under Monitoring and Reporting for further details on this data pipeline.

Dashboards

Several dashboards can be created using OpenSearch Dashboards. Some default dashboards are provided by OpenG2P and may be customized.

Installation

Refer to Deployment->Fluentd & Opensearch.

Last updated

Logo

Copyright © OpenG2P. This work is licensed under Creative Common Attribution (CC-BY-4.0) International license unless otherwise noted.