Training Log 2022-06-18

[zh-zheng]

CPM-Live Training Log (June, 18)

Time: June, 18 2022 16:00

Recorder: @zh-zheng

Loss

• Begin: 2.49
• End: 2.50

Completed Data

• $\approx$ 195.25GB

Average Grad Norm

• 0.75

Progress

• 20.97%

Comment

The training is still quite stable today. Recently, a Google engineer reported that a chatting model LaMDA was sentient. Maybe later we could talk to CPM-Ant and find out some interesting results!