Floating-point formats for training and an ablation study

Compare the floating-point formats used to train and run models (FP32, FP16, BF16, FP8 and others): range, precision, speed and when each is a good choice. How would you detect that a model is losing accuracy because of low precision? Then design an ablation study to show which change in a training setup actually matters.