Kubernetes Centralised Log Management with Grafana-Loki

In this video you will learn how to have a centralised log management system - Grafana Loki integrated with Kubernetes cluster.

Every enterprise need a centralised log management and query capabilities. Grafana Loki fits into it.

Loki, an open-source log aggregation system inspired by Prometheus that collects, stores, and analyzes logs. It is designed to be cost-effective and easy to operate by indexing only metadata like labels, rather than the entire log content, which lowers storage and operational costs.

Loki is built around the idea of only indexing metadata about your logs’ labels (just like Prometheus labels). Log data itself is then compressed and stored in chunks in object stores such as Amazon Simple Storage Service (S3) or Google Cloud Storage (GCS), or even locally on the filesystem.

A typical Loki-based logging stack consists of 3 components:

Agent - An agent or client, for example Grafana Alloy, or Promtail, which is distributed with Loki. The agent scrapes logs, turns the logs into streams by adding labels, and pushes the streams to Loki through an HTTP API.

Loki - The main server, responsible for ingesting and storing logs and processing queries. It can be deployed in three different configurations, for more information see deployment modes.

Grafana for querying and displaying log data. You can also query logs from the command line, using LogCLI or using the Loki API directly.

Video Timeline
00:00 - 05:20 - Introduction to Loki
05:21 - 12:22 - Installing Grafana-loki with helm
12:23 - 15:10 - Accessing Grafana Dashboard
15:11 - 24:55 - Using Loki Queries to filter/search logs

Git Repo - https://github.com/networknuts/kubernetes/blob/master/ch-10-high-value-extra/loki-with-kubernetes-for-logs.txt

Видео Kubernetes Centralised Log Management with Grafana-Loki канала networknutsdotnet