Hi! I am interested in helping out with this, but I am slightly confused as to what is expected. Should we be implementing these metrics again anew or using the Baal implementations in this project?

Hi @oaimtiaz, idea is to implement ECE and MulticlassECE from scratch and using our formalism of metric's implementation : https://pytorch.org/ignite/metrics.html#how-to-create-a-custom-metric
Implementation in Baal can be a sort of reference and shouldn't be reused.
Do not hesitate to ask other question if need other details.

Thanks! I'll get started on this right away!

@oaimtiaz any updates on this ?

@vfdev-5 , can I work on this issue?

@Zekrom-7780 Yes, go ahead

Hey 👋, I've just created a thread for this issue on PyTorch-Ignite Discord where you can quickly talk to the community on the topic.

^{🤖 This comment was automatically posted by Discuss on Discord}