INV: Multi-node logging and monitoring in the new framework

[cpelley]

Logging and monitoring in the new framework is key to managing real-time resources as well as gaining insights into what is happening in real-time within the executing graph.

We require a solution that will not only work across multiple processes but also over different nodes too.

Issues

• https://github.com/MetOffice/improver_suite/issues/2079
• Logging support: added TCP socket handler with sqlitedb too #15

---

Background

A TCP (Transmission Control Protocol) socket is an endpoint for communication between two computers using the TCP network protocol. TCP is one of the main protocols in the Internet protocol suite and provides reliable, ordered, and error-checked delivery of a stream of bytes between applications running on hosts communicating via an IP network.

In programming, a socket is a software structure that provides a system interface for network programming. It allows applications to send and receive data over a network, and in the case of a TCP socket, it ensures that the data is delivered in order and without errors.

Reference

• stackoverflow: how-should-i-log-while-using-multiprocessing-in-python
• python official logging cookbook: sending-and-receiving-logging-events-across-a-network

[cpelley]

Going to say this is complete.