Link to private LW post

[FraserLee]

Link [2] in the following screenshot seems to be unavailable. I'm not aware - is this something we're checking for when we re-process the ARD?

[ccstan99]

I suspect we'll start having lots of issues like this as we start doing more testing. This particular example probably won't be a problem with the new ARD but it exposes a certain class of problems. The ARD ensures urls are well-formed but it's possible for links to get deleted after they've been scraped and embedded, which is likely what happened here, so this might require a separate check later.

To keep things consolidated, I've created a form https://bit.ly/stampy-chat-issues which tracks problematic outputs on our stampy-chat-test gsheet problems_reported tab and also added this examples to benchmark questions to monitor.

Ideally, we'd like to have a thumbs down or flag button for people to mark, automatically log and leave a quick comment of the problem/expected output. Until that's in place, this keeps us from losing important feedback.