brier_loss

probly.metrics.brier_loss(y_prob: object, y_true: object) → object[source]

Compute the mean Brier loss of the predictions, the average of brier_loss_per_instance().

Parameters:
  • y_prob – Predicted class probabilities of shape (..., K), or a categorical distribution.

  • y_true – Integer class labels of shape (...), or target probabilities of shape (..., K).

Returns:

The mean Brier loss in [0, 2].

Raises:
  • ValueError – If y_true has neither shape or its labels are not integers.

  • TypeError – If y_prob is a sample of predictions.