Logstash information:

Please include the following information:

1. Logstash version: 8.5
2. Logstash installation source: deb

OS version: ubuntu 20.04

Description of the problem including expected versus actual behavior:

When getting pipeline information from the node stats API, I was looking to obtain the values of pipeline.workers & pipeline.batch_size for a pipeline called "performance". However, the API only showed the general (default) values (e.g. those defined in logstash.yml).

While node_stats is likely not the place where to show configuration, it may be helpful to have.

Example

curl -XGET 'localhost:9600/_node/stats/pipelines?pretty'

Current Behavior
The API currently shows the information as such. The pipeline.workers and pipeline.batch_size in logstash.yml are default. However, the pipeline.workers and pipeline.batch_size for the pipeline called performance have been changed, and the API is not showing that information.

{
  "host" : "file-1",
 [...]
  "pipeline" : {
    "workers" : 1,
    "batch_size" : 125,
    "batch_delay" : 50
  },
 [...]
  "pipelines" : {
    "performance" : {
      "events" : {
        [...]
      },
      "flow" : {
       [..]
      }
 [...]

Potential Solution 1 - Add pipeline information in node_stats API
What I would expect if we are already showing "pipeline" information in "node_stats":

{
  "host" : "file-1",
 [...]
  "pipeline" : {
    "workers" : 1,
    "batch_size" : 125,
    "batch_delay" : 50
  },
 [...]
  "pipelines" : {
    "performance" : {
      "pipeline" : {
          "workers": 2,
          "batch_size": 500,
          "batch_delay": 50,
      }
      "events" : {
        [...]
      },
      "flow" : {
       [..]
      }
 [...]

Potential Solution 2 - Remove 'pipelines' and 'monitoring' from node_stats API

This solution may require us to remove the pipelines and monitoring information from node_stats API. This could introduce breakage in Stack Monitoring and would mean it is no longer backwards compatible.