[DOCS] Clarify AI Assistant will spawn ML nodes

[lucabelluccini]

Clarify AI Assistant will spawn ML nodes

To the doc writers:

• please change wording
• backport to all versions back to AI Assistant pages got created
• add an additional paragraph if the use of AI Assistant / Knowledge Base implies ML Nodes will no more be scaled down back to 0

[github-actions]

A documentation preview will be available soon:

• 📚 HTML diff
• 📙 Observability Guide

[dedemorton]

Thanks for updating the docs. Just some minor changes to follow Elastic style and avoid what grammarians call an unclear antecedent.

[dedemorton]

@lucabelluccini Do we want to port this change to the serverless docs, too?

[lucabelluccini]

Hello @dedemorton - thanks for the review.

I think we need some inputs from engineering as:

• It would be valuable to also mention the fact enabling AI Assistant / KB will not scale down ML nodes (I am not certain)
• I think in serverless the autoscaling of ML doesn't work in the same way

[dedemorton]

@dgieselaar Can you respond to Lucas' comments here so we can finalize these changes? Thanks! (My apologies if I'm pinging the wrong person here. I'm still trying to figure out who knows what on the team.)

[CoenWarmer]

Hello @dedemorton - thanks for the review.

I think we need some inputs from engineering as:

• It would be valuable to also mention the fact enabling AI Assistant / KB will not scale down ML nodes (I am not certain)

I assume you meant to say 'disabling AI Assistant / KB' ? The AI Assistant will not explicitly scale down ML nodes if it is disabled.

• I think in serverless the autoscaling of ML doesn't work in the same way

I'm unfamiliar with how autoscaling works in ML, but happy to ask around:

https://elastic.slack.com/archives/C2AJLJHMM/p1711029351315459

[dedemorton]

@CoenWarmer Can you help me interpret the response to the question about autoscaling? The response includes a link to a document that "could be out of date" and the code for autoscaling, so I'm still not sure what, if anything, I need to say in the serverless docs.

[bmorelli25]

@emma-raffenne can you help us move this forward?

[dgieselaar]

@bmorelli25 Emma is on PTO & Coen is on leave, I will pick it up tomorrow, and apologies for the delay.

[emma-raffenne]

@bmorelli25 Please let us know if after Dario's comment you need more input from our side.

[bmorelli25]

@dedemorton do you have everything you need for this PR?

[dgieselaar]

As discussed on Slack, I would suggest to remove wording around disabling the AI Assistant as there are several ways to do this and there's no impact on the ML nodes. Other than that it looks good

[bmorelli25]

Only some backports were created successfully. This will be fixed in #4109.

@dedemorton we'll need to remove the labels for the failing backports and re-add them after 4109 is merged.