Viewing a single comment thread. View all comments

bimtuckboo t1_j02jss1 wrote

Easiest way to find out is to make some calibration plots with your validation set. From there, depending on what the plots look like, there are some things you can do to improve the calibration post training. Look into temperature scaling and Platt scaling.

19

alkaway OP t1_j02phdn wrote

Thanks so much for your response! Does temperature scaling change the relative ordering of the probabilities?

1

bimtuckboo t1_j02qida wrote

No it does not. It simply scales the probabilities to either all be closer to 0.5 or all be further from 0.5

1