Track metrics for time to persist files

[hiltontj]

Problem statement

There are several places where we persist files to object store, and we have no way of tracking how much time is spent doing so.

Proposed solution

Add metrics to track time to persist files in the following places:

• Catalog persistence (see here)
• Snapshot persistence (see here)
• Parquet persistence (see here)
• WAL file persistence (see here)

Note that some of these are done in a loop, so the time to persist should track from when the loop starts to when the file was successfully persisted.

Alternatives considered

N/A

Additional context

The metric crate in core provides the means to track times like these via a DurationHistogram metric.