probly.evaluation.ood

Unified OOD evaluation API for probly.

Functions

evaluate_ood

Unified OOD evaluation API.

out_of_distribution_detection_aupr

Perform out-of-distribution detection using AUPR.

out_of_distribution_detection_auroc

Perform out-of-distribution detection using prediction functionals.

out_of_distribution_detection_fnr_at_x_tpr

Perform out-of-distribution detection using false negative rate at a given true positive rate.

out_of_distribution_detection_fpr_at_x_tpr

Perform out-of-distribution detection using false positive rate at a given true positive rate.

parse_dynamic_metric

Parse dynamic metric specification.

visualize_ood

Generate visualization plots from OOD scores.