Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
You are viewing the development documentation (main). Switch to the stable release docs.
probly 0.9.2.dev75+g7043be991 documentation
Light Logo Dark Logo

Table of Contents

  • Getting Started
  • Installation
  • User Guide
    • 1. Uncertainty
      • 1.1. Why One Number Is Not Enough
      • 1.2. Where Uncertainty Arises
      • 1.3. Representing Uncertainty
      • 1.4. Quantifying Uncertainty
      • 1.5. Evaluating Uncertainty
    • 2. Core Pillars of Probly
    • 3. Uncertainty Methods
      • 3.1. Second-Order Distributions
      • 3.2. Credal Sets
      • 3.3. Conformal Prediction
      • 3.4. Calibration
  • Examples and Tutorials
    • Examples
      • Active Learning
        • Active Learning with sklearn - Margin vs Random
        • Active Learning with PyTorch - BADGE Selection
      • Conformal Prediction
        • Regression Conformal Prediction — sklearn
        • Classification Conformal Prediction — sklearn
        • Quantile Regression Conformal Prediction — sklearn
        • Classification Conformal Prediction — PyTorch
        • Regression Conformal Prediction — PyTorch
        • Adaptive Conformal Intervals on Heteroscedastic Data
        • A Gentle Introduction to Conformal Prediction
        • Conformalized Credal Set Prediction — PyTorch.
        • How Conformal Sets Change with the Score and with Alpha
        • Quantile Regression Conformal Prediction — PyTorch
      • Integrations
        • Uncertainty for Hugging Face vision transformers
        • Depth estimation uncertainty with transformers
        • Mixing torch-uncertainty and probly
        • Uncertainty for Hugging Face transformers
        • Forecast uncertainty with transformers
        • LoRA adapter ensembles with peft
        • Cyclone forecast uncertainty with WeatherNext
      • Method
        • SWAG on Two Moons
        • DARE on Two Moons
        • Laplace Approximation on Two Moons
        • Het-Net on Two Moons
        • Generative Variational Bayesian Last Layers on Two Moons
        • Mahalanobis OOD on Two Moons
        • Variational Bayesian Last Layers on Two Moons
        • DUQ on Two Moons
        • DDU on Two Moons
        • Credal Net Visualization
        • Evidential on Two Moons
        • Student-t Variational Bayesian Last Layers on Two Moons
        • Credal Wrapper Output Visualization
        • Credal Ensembling Visualization
        • Heteroscedastic Variational Bayesian Last Layers on Two Moons
        • Credal BNN Visualization
        • Credal DRO Output Visualization
        • Efficient Credal Prediction Visualization
        • DARE on MNIST
        • SNGP Distance Awareness on 2D Toys
        • Laplace on MNIST
        • Het-Net on MNIST
        • G-VBLL on MNIST
        • Credal BNN on MNIST
        • VBLL on MNIST
        • SWAG on MNIST
        • Student-t VBLL on MNIST
        • Heteroscedastic VBLL on MNIST
        • Credal Wrapper on MNIST
        • Credal Ensembling on MNIST
        • Prior Network on Two Moons
        • Credal Net on MNIST
        • Efficient Credal Prediction on MNIST
        • SNGP on MNIST
        • Mahalanobis OOD on MNIST
        • DUQ on MNIST
        • DDU on MNIST
        • Credal Relative Likelihood Visualization
        • Prior Network on MNIST
        • Evidential Regression on a 1D Example
        • Evidential on MNIST
        • Credal Relative Likelihood on MNIST
        • DEUP on Two Moons
        • DEUP on MNIST
      • Plot
        • Visualising OOD detection results
        • Plotting binary credal sets on an interval
        • Plotting credal sets on the simplex
        • Plotting credal sets on a spider (radar) chart
      • Pytraverse
        • A Brief Introduction to PyTraverse
      • Quantification
        • Uncertainty Quantification
        • Ensemble Regression Uncertainty
        • Ensemble Ordinal Classification Uncertainty
      • Release Highlights
      • Representation
        • Singleton credal set
        • Distance-based credal set
        • Convex credal set
        • Discrete credal set
        • Probability-intervals credal set
        • Working with samples
        • Sets of outcomes
        • Point predictions and first-order distributions
        • Second order: a parameterized Dirichlet
        • Second order: a sample of distributions
      • Streaming
        • Streaming uncertainty with ARFRegressor
        • Streaming uncertainty with ARFClassifier
        • MC-Dropout uncertainty on a 2-D stream
      • Transformation
        • DropConnect on Two Moons
        • Deep Ensemble on Two Moons
        • MC Dropout on Two Moons
        • Masksembles on Two Moons
        • Natural Posterior Network on Two Moons
        • Posterior Network on Two Moons
        • Bayesian Neural Network on Two Moons
        • Sub-Ensemble on Two Moons
        • Bayesian Ensemble on Two Moons
        • BatchEnsemble on Two Moons
        • MC Dropout on MNIST
        • DropConnect on MNIST
        • Deep Ensemble on MNIST
        • Bayesian Neural Network on MNIST
        • Natural Posterior Network on MNIST
        • Bayesian Ensemble on MNIST
        • Posterior Network on MNIST
        • Sub-Ensemble on MNIST
        • BatchEnsemble on MNIST
        • Masksembles on MNIST
        • Dirichlet Calibration on MNIST
        • Platt Scaling on MNIST (Odd vs. Even)
        • Vector Scaling on MNIST
        • Temperature Scaling on MNIST
        • Isotonic Regression on MNIST (Odd vs. Even)
  • API Reference
    • probly
      • calibrator
        • Calibrator
        • calibrate
      • conformal_scores
        • absolute_error
          • absolute_error.jax
          • absolute_error.torch
            • torch_compute_absolute_error_score
            • torch_compute_absolute_error_score_sample
          • absolute_error_score
        • aps
          • aps.jax
          • aps.torch
            • torch_compute_aps_score
          • APSScore
          • aps_score
        • cqr
          • cqr.jax
          • cqr.torch
            • torch_compute_cqr_score
          • cqr_score
        • cqr_r
          • cqr_r.jax
          • cqr_r.torch
            • torch_compute_cqr_r_score
          • cqr_r_score
        • dirichlet_relative_likelihood
          • dirichlet_relative_likelihood.jax
            • jax_compute_dirichlet_rl_score
            • jax_compute_dirichlet_rl_score_dirichlet
          • dirichlet_relative_likelihood.torch
            • torch_compute_dirichlet_rl_score
            • torch_compute_dirichlet_rl_score_dirichlet
          • DirichletRLScore
          • dirichlet_rl_score
          • dirichlet_rl_score_func
        • inner_product
          • inner_product.jax
            • jax_compute_inner_product_score
          • inner_product.torch
            • torch_compute_inner_product_score
          • InnerProductScore
          • inner_product_score
          • inner_product_score_func
        • kullback_leibler
          • kullback_leibler.jax
            • jax_compute_kl_divergence_score
          • kullback_leibler.torch
            • torch_compute_kl_divergence_score
          • KLDivergenceScore
          • kl_divergence_score
          • kl_divergence_score_func
        • lac
          • lac.jax
            • jax_compute_lac_score
          • lac.torch
            • torch_compute_lac_score
            • torch_compute_lac_score_categorical
            • torch_compute_lac_score_sample
          • lac_score
        • raps
          • raps.jax
          • raps.torch
            • torch_compute_raps_score
          • RAPSScore
          • raps_score
        • saps
          • saps.jax
          • saps.torch
            • torch_compute_saps_score
          • SAPSScore
          • saps_score
        • total_variation
          • total_variation.jax
            • jax_compute_tv_score
          • total_variation.torch
            • torch_compute_tv_score
          • TVScore
          • tv_score
          • tv_score_func
        • uacqr
          • uacqr.jax
          • uacqr.torch
            • torch_compute_uacqr_score_func
          • uacqr_score
        • wasserstein_distance
          • wasserstein_distance.jax
            • jax_compute_wasserstein_distance_score
          • wasserstein_distance.torch
            • torch_compute_wasserstein_distance_score
          • WassersteinDistanceScore
          • wasserstein_distance_score
          • wasserstein_distance_score_func
        • NonConformityScore
        • absolute_error_score
        • aps_score
        • cqr_r_score
        • cqr_score
        • dirichlet_rl_score
        • dirichlet_rl_score_func
        • inner_product_score
        • inner_product_score_func
        • kl_divergence_score
        • kl_divergence_score_func
        • lac_score
        • raps_score
        • saps_score
        • tv_score
        • tv_score_func
        • uacqr_score
        • wasserstein_distance_score
        • wasserstein_distance_score_func
      • datasets
        • torch
          • Benthic
          • CIFAR100C
          • CIFAR10C
          • CIFAR10H
          • CIFAR10HDCIC
          • DCICDataset
          • ImageNetReaL
          • MedMNISTC
          • MiceBone
          • Pig
          • Plankton
          • QualityMRI
          • Synthetic
          • TinyImageNet
          • Treeversity1
          • Treeversity6
          • Turkey
      • decider
        • categorical_distribution
          • categorical_distribution.numpy
          • categorical_distribution.torch
          • categorical_from_maximin
          • categorical_from_mean
          • mean_field_categorical
        • Decider
        • categorical_from_maximin
        • categorical_from_mean
        • mean_field_categorical
      • evaluation
        • active_learning
          • active_learning.loop
            • ALState
            • active_learning_steps
          • active_learning.metrics
            • compute_nauc
          • active_learning.pool
            • active_learning.pool.numpy
              • NumpyActiveLearningPool
            • active_learning.pool.torch
              • TorchActiveLearningPool
            • ActiveLearningPool
            • from_dataset
            • query
          • active_learning.strategies
            • active_learning.strategies.numpy
            • active_learning.strategies.torch
            • BadgeEstimator
            • BADGEQuery
            • EntropySampling
            • Estimator
            • LeastConfidentSampling
            • MarginSampling
            • QueryStrategy
            • RandomQuery
            • UncertaintyEstimator
            • UncertaintyQuery
            • badge_embed
            • badge_select
            • entropy_score
            • least_confident_score
            • margin_score
            • random_select
            • topk_select
          • active_learning.torch_metrics
          • active_learning_steps
          • compute_accuracy
          • compute_ece
          • compute_nauc
          • from_dataset
        • ood
          • evaluate_ood
          • out_of_distribution_detection_aupr
          • out_of_distribution_detection_auroc
          • out_of_distribution_detection_fnr_at_x_tpr
          • out_of_distribution_detection_fpr_at_x_tpr
          • parse_dynamic_metric
        • selective_prediction
          • selective_prediction.jax
            • jax_selective_prediction
          • selective_prediction.numpy
            • numpy_selective_prediction
          • selective_prediction.torch
            • torch_selective_prediction
          • selective_prediction
      • integrations
        • peft
        • torch_uncertainty
          • TorchUncertaintyCalibratedLogitRepresenter
          • TorchUncertaintyConformalRepresenter
          • TorchUncertaintySampleRepresenter
        • transformers
          • extract_predictions
        • weathernext
          • WeatherNextPredictor
          • WeatherNextRepresenter
      • layers
        • flax
          • BatchEnsembleConv
          • BatchEnsembleLinear
          • DropConnectLinear
        • numpy
          • CovarianceEstimator
          • NumpyMahalanobisHead
        • torch
          • BatchEnsembleConv2d
          • BatchEnsembleLinear
          • BayesConv2d
          • BayesLinear
          • DropConnectLinear
          • GaussianMixtureHead
          • GVBLLLayer
          • HeteroscedasticLayer
          • HetVBLLLayer
          • IntBatchNorm1d
          • IntBatchNorm2d
          • IntConv2d
          • IntLinear
          • IntSoftmax
          • IRDHead
          • MahalanobisHead
          • Masksembles2D
          • MasksemblesLinear
          • NatPNClassHead
          • NatPNRegHead
          • NormalInverseGammaLinear
          • RadialNormalizingFlow
          • RadialNormalizingFlowStack
          • RegressionHead
          • SharedMaskDropout
          • SNCoeffParametrization
          • SNGPLayer
          • TVBLLLayer
          • VBLLLayer
          • apply_spectral_norm_to_encoder
          • pack_interval
          • unpack_interval
      • lazy_types
      • losses
        • torch
          • cvar_ce_loss
          • der_loss
          • disc_vbll_loss
          • elbo_loss
          • evidential_ce_loss
          • evidential_kl_divergence
          • evidential_log_loss
          • evidential_mse_loss
          • evidential_nignll_loss
          • evidential_regression_regularization
          • focal_loss
          • g_vbll_loss
          • het_vbll_loss
          • intersection_probability_ce_loss
          • ird_loss
          • label_relaxation_loss
          • lop_gpn_loss
          • lp_fn
          • make_in_domain_target_alpha
          • make_ood_target_alpha
          • mixture_uce_loss
          • natpn_loss
          • normal_wishart_log_prob
          • pn_loss
          • postnet_loss
          • regularization_fn
          • rpn_distillation_loss
          • rpn_loss
          • rpn_ng_kl
          • rpn_prior
          • t_vbll_loss
        • vbll_loss
      • method
        • batchensemble
        • bayesian
        • calibration
          • CalibrationPredictor
          • dirichlet_calibration
          • flax_identity_logit_model
          • isotonic_regression
          • platt_scaling
          • sklearn_identity_logit_estimator
          • temperature_scaling
          • torch_identity_logit_model
          • vector_scaling
        • cast
        • conformal
          • AbsoluteErrorConformalSetPredictor
          • APSConformalSetPredictor
          • ClassificationConformalSetPredictor
          • ConformalSetPredictor
          • CQRConformalSetPredictor
          • CQRrConformalSetPredictor
          • LACConformalSetPredictor
          • RAPSConformalSetPredictor
          • RegressionConformalSetPredictor
          • SAPSConformalSetPredictor
          • UACQRConformalSetPredictor
          • conformal_absolute_error
          • conformal_aps
          • conformal_cqr
          • conformal_cqr_r
          • conformal_lac
          • conformal_raps
          • conformal_saps
          • conformal_uacqr
        • conformal_credal_set
          • ConformalCredalSetPredictor
          • DirichletConformalCredalSetPredictor
          • conformal_credal_set_generator
          • conformal_dirichlet_relative_likelihood
          • conformal_inner_product
          • conformal_kullback_leibler
          • conformal_total_variation
          • conformal_wasserstein_distance
        • credal_bnn
        • credal_dro
        • credal_ensembling
        • credal_net
        • credal_relative_likelihood
        • credal_wrapper
        • dare
        • ddu
        • deup
          • deup.torch
            • ErrorPredictionHead
            • LogDUEVariance
            • LogGMMDensity
            • LogMAFDensity
            • LogMCDropoutVariance
            • StationarizingFeatureProvider
            • TorchDEUPPredictor
            • TorchDEUPRepresentation
          • DEUPDecomposition
          • DEUPPredictor
          • DEUPRepresentation
          • create_deup_representation
          • deup
          • deup_generator
        • dropconnect
        • dropout
        • duq
        • efficient_credal_prediction
        • ensemble
        • evidential
          • evidential.classification
            • EvidentialClassificationDecomposition
            • EvidentialClassificationPredictor
            • EvidentialClassificationRepresentation
            • EvidentialClassificationRepresenter
            • evidential_classification
            • register
          • evidential.regression
            • evidential_regression
            • evidential_regression_traverser
            • register
          • evidential_classification
          • evidential_regression
        • g_vbll
        • graph_posterior_network
        • het_net
        • laplace
          • laplace.torch
            • LaplaceRepresenter
        • mahalanobis
        • masksembles
        • natural_posterior_network
          • NaturalPosteriorDecomposition
          • NaturalPosteriorNetworkPredictor
          • NaturalPosteriorNetworkRepresentation
          • NaturalPosteriorNetworkRepresenter
          • natural_posterior_network
        • posterior_network
          • PosteriorNetworkDecomposition
          • PosteriorNetworkPredictor
          • PosteriorNetworkRepresentation
          • PosteriorNetworkRepresenter
          • posterior_network
        • prior_network
          • PriorNetworkPredictor
          • prior_network
        • sngp
        • subensemble
        • swag
        • vbll
        • batchensemble
        • bayesian
        • cast
        • conformal_dirichlet_relative_likelihood
        • conformal_inner_product
        • conformal_kullback_leibler
        • conformal_total_variation
        • conformal_wasserstein_distance
        • credal_bnn
        • credal_dro
        • credal_ensembling
        • credal_net
        • credal_relative_likelihood
        • credal_wrapper
        • cuq_graph_neural_network
        • dare
        • ddu
        • dropconnect
        • dropout
        • duq
        • efficient_credal_prediction
        • ensemble
        • evidential_classification
        • evidential_regression
        • g_vbll
        • graph_posterior_network
        • het_net
        • lop_graph_posterior_network
        • mahalanobis
        • masksembles
        • sngp
        • subensemble
        • swag
        • vbll
      • metrics
        • jax
          • jax_categorical_log_loss_per_instance
          • jax_classwise_ece
          • jax_expected_calibration_error
          • jax_log_loss_per_instance
          • jax_log_probabilities
          • jax_one_hot_argmax
          • jax_precision_recall_curve
          • jax_probabilities
          • jax_probability_categorical_log_loss_per_instance
          • jax_roc_curve
        • numpy
          • numpy_categorical_classwise_ece
          • numpy_categorical_expected_calibration_error
          • numpy_classwise_ece
          • numpy_expected_calibration_error
          • numpy_log_probabilities
          • numpy_one_hot_argmax
          • numpy_precision_recall_curve
          • numpy_probabilities
          • numpy_roc_curve
        • torch
          • torch_categorical_log_loss_per_instance
          • torch_classwise_ece
          • torch_expected_calibration_error
          • torch_log_loss_per_instance
          • torch_log_probabilities
          • torch_one_hot_argmax
          • torch_precision_recall_curve
          • torch_probabilities
          • torch_probability_categorical_log_loss_per_instance
          • torch_roc_curve
        • accuracy
        • auc
        • average_interval_width
        • average_precision_score
        • brier_loss
        • brier_loss_per_instance
        • classwise_ece
        • convex_hull_coverage
        • coverage
        • efficiency
        • expected_calibration_error
        • false_negative_rate
        • false_positive_rate
        • log_loss
        • log_loss_per_instance
        • precision_recall_curve
        • roc_auc_score
        • roc_curve
        • spherical_loss
        • spherical_loss_per_instance
        • zero_one_loss
        • zero_one_loss_per_instance
      • plot
        • config
          • PlotConfig
          • use_probly_style
        • credal
          • credal.plot
            • plot_credal_set
          • plot_credal_set
        • ood
          • plot_histogram
          • plot_pr_curve
          • plot_roc_curve
        • utils
        • PlotFunction
        • plot_credal_set
        • plot_histogram
        • plot_pr_curve
        • plot_roc_curve
        • use_probly_style
      • predictor
        • laplace
        • sklearn
          • sklearn_predict_raw
        • BernoulliDistributionPredictor
        • BernoulliLogitDistributionPredictor
        • BinaryLogitClassifier
        • BinaryProbabilisticClassifier
        • CategoricalDistributionPredictor
        • CredalPredictor
        • DirichletDistributionPredictor
        • DirichletMixtureDistributionPredictor
        • DistributionPredictor
        • EvidentialPredictor
        • GaussianDistributionPredictor
        • IterablePredictor
        • LogitClassifier
        • LogitDistributionPredictor
        • Predictor
        • ProbabilisticClassifier
        • RandomPredictor
        • RandomRepresentationPredictor
        • RepresentationPredictor
        • predict
        • predict_raw
        • predictor_registry
      • quantification
        • decomposition
          • decomposition.decomposition
            • AdditiveDecomposition
            • AleatoricDecomposition
            • AleatoricEpistemicDecomposition
            • AleatoricEpistemicTotalDecomposition
            • AleatoricTotalDecomposition
            • CachingDecomposition
            • ConstantTotalDecomposition
            • Decomposer
            • Decomposition
            • EpistemicDecomposition
            • EpistemicTotalDecomposition
            • TotalDecomposition
          • decomposition.entropy
            • CredalSetEntropyDecomposition
            • LabelNoiseEntropyDecomposition
            • SecondOrderEntropyDecomposition
          • decomposition.ordinal
            • CategoricalVarianceDecomposition
            • LabelwiseBinaryEntropyDecomposition
            • LabelwiseBinaryVarianceDecomposition
            • OrdinalEntropyDecomposition
            • OrdinalVarianceDecomposition
            • categorical_variance_aleatoric
            • categorical_variance_total
            • expected_conditional_variance
            • labelwise_conditional_entropy
            • labelwise_entropy_of_expected_predictive_distribution
            • labelwise_expected_conditional_variance
            • labelwise_variance_of_expected_predictive_distribution
            • ordinal_conditional_entropy
            • ordinal_entropy_of_expected_predictive_distribution
            • ordinal_expected_conditional_variance
            • ordinal_variance_of_expected_predictive_distribution
            • variance_of_conditional_mean
          • decomposition.scoring_rule
            • SecondOrderScoringRuleDecomposition
          • decomposition.spectral
            • SpectralDecomposition
          • decomposition.variance
            • SecondOrderVarianceDecomposition
          • decomposition.wasserstein
            • SecondOrderWassersteinDecomposition
          • decomposition.zero_one
            • SecondOrderZeroOneDecomposition
        • measure
        • notion
          • AleatoricUncertainty
          • EpistemicUncertainty
          • Notion
          • TotalUncertainty
        • QuantificationResult
        • Quantifier
        • conditional_entropy
        • conditional_spectral_entropy
        • conformal_set_size
        • decompose
        • dempster_shafer_uncertainty
        • entropy
        • entropy_of_expected_predictive_distribution
        • expected_max_probability_complement
        • max_disagreement
        • max_probability_complement_of_expected
        • mean_squared_distance_to_scaled_one_hot
        • measure
        • measure_atomic
        • min_expected_total_variation
        • mutual_information
        • notion_registry
        • quantify
        • sample_variance
        • spectral_entropy
        • total_logit_sample_variance
        • vacuity
      • representation
        • conformal_set
          • conformal_set.jax
            • JaxIntervalConformalSet
            • JaxOneHotConformalSet
          • conformal_set.numpy
            • NumpyIntervalConformalSet
            • NumpyOneHotConformalSet
          • conformal_set.torch
            • TorchIntervalConformalSet
            • TorchOneHotConformalSet
          • ConformalSet
          • IntervalConformalSet
          • OneHotConformalSet
          • create_interval_conformal_set
          • create_onehot_conformal_set
        • credal_set
          • credal_set.jax
            • JaxCategoricalCredalSet
            • JaxConvexCredalSet
            • JaxDirichletLevelSetCredalSet
            • JaxDistanceBasedCredalSet
            • JaxProbabilityIntervalsCredalSet
          • credal_set.numpy
            • NumpyCategoricalCredalSet
            • NumpyConvexCredalSet
            • NumpyDiscreteCredalSet
            • NumpyDistanceBasedCredalSet
            • NumpyProbabilityIntervalsCredalSet
            • NumpySingletonCredalSet
          • credal_set.numpy_functions
          • credal_set.torch
            • TorchCategoricalCredalSet
            • TorchConvexCredalSet
            • TorchDirichletLevelSetCredalSet
            • TorchDistanceBasedCredalSet
            • TorchProbabilityIntervalsCredalSet
          • CategoricalCredalSet
          • ConvexCredalSet
          • CredalSet
          • DirichletLevelSetCredalSet
          • DiscreteCredalSet
          • DistanceBasedCredalSet
          • ProbabilityIntervalsCredalSet
          • SingletonCredalSet
          • create_convex_credal_set
          • create_dirichlet_level_set_credal_set
          • create_discrete_credal_set
          • create_distance_based_credal_set
          • create_distance_based_credal_set_from_center_and_radius
          • create_probability_intervals
          • create_probability_intervals_from_bounds
          • create_probability_intervals_from_lower_upper_array
          • create_singleton_credal_set
        • distribution
          • distribution.jax_bernoulli
            • JaxBernoulliDistribution
            • JaxBernoulliDistributionSample
            • JaxLogitBernoulliDistribution
            • JaxProbabilityBernoulliDistribution
          • distribution.jax_categorical
            • JaxCategoricalDistribution
            • JaxCategoricalDistributionSample
            • JaxLogitCategoricalDistribution
            • JaxProbabilityCategoricalDistribution
          • distribution.jax_dirichlet
            • JaxDirichletDistribution
          • distribution.jax_gaussian
            • JaxGaussianDistribution
            • JaxGaussianDistributionSample
          • distribution.numpy_bernoulli
            • NumpyBernoulliDistribution
            • NumpyBernoulliDistributionSample
            • NumpyLogitBernoulliDistribution
            • NumpyProbabilityBernoulliDistribution
          • distribution.numpy_categorical
            • NumpyCategoricalDistribution
            • NumpyCategoricalDistributionSample
            • NumpyLogitCategoricalDistribution
            • NumpyProbabilityCategoricalDistribution
          • distribution.numpy_dirichlet
            • NumpyDirichletDistribution
          • distribution.numpy_gaussian
            • NumpyGaussianDistribution
            • NumpyGaussianDistributionSample
          • distribution.torch_bernoulli
            • TorchBernoulliDistribution
            • TorchBernoulliDistributionSample
            • TorchLogitBernoulliDistribution
            • TorchProbabilityBernoulliDistribution
          • distribution.torch_categorical
            • TorchCategoricalDistribution
            • TorchCategoricalDistributionSample
            • TorchLogitCategoricalDistribution
            • TorchProbabilityCategoricalDistribution
          • distribution.torch_dirichlet
            • TorchDirichletDistribution
          • distribution.torch_gaussian
            • TorchGaussianDistribution
            • TorchGaussianDistributionSample
          • distribution.torch_mixture
            • TorchDirichletMixtureDistribution
            • TorchMixtureDistribution
          • distribution.torch_sparse_log_categorical
            • TorchSparseLogCategoricalDistribution
            • TorchSparseLogCategoricalDistributionSample
          • BernoulliDistribution
          • BernoulliDistributionSample
          • CategoricalDistribution
          • CategoricalDistributionSample
          • DirichletDistribution
          • DirichletMixtureDistribution
          • Distribution
          • DistributionSample
          • GaussianDistribution
          • GaussianDistributionSample
          • MixtureDistribution
          • SecondOrderDistribution
          • create_bernoulli_distribution
          • create_bernoulli_distribution_from_logits
          • create_categorical_distribution
          • create_categorical_distribution_from_logits
          • create_dirichlet_distribution_from_alphas
          • create_dirichlet_mixture_distribution_from_alphas_and_weights
          • create_gaussian_distribution
        • embedding
          • embedding.torch
            • TorchEmbedding
            • TorchEmbeddingSample
            • TorchEmbeddingSampleSample
          • Embedding
          • EmbeddingSample
          • EmbeddingSampleSample
          • create_embedding
        • representation
          • Representation
        • sample
          • sample.axis_tracking
            • ArrayIndex
            • AxisTrackingResult
            • track_axis
          • sample.jax
            • JaxSample
          • sample.jax_axis_tracking
          • sample.jax_functions
            • JaxSampleCreator
            • JaxSampleInternals
            • jax_concatenate_function
            • jax_conj_function
            • jax_copy_function
            • jax_elementwise_function
            • jax_expand_dims_function
            • jax_function_override
            • jax_internals_override
            • jax_matrix_transpose_function
            • jax_moveaxis_function
            • jax_reduction_function
            • jax_reshape_function
            • jax_sample_internals
            • jax_squeeze_function
            • jax_stack_function
            • jax_swapaxes_function
            • jax_take_along_axis_function
            • jax_transpose_function
          • sample.numpy
            • NumpySample
          • sample.numpy_functions
            • NumpySampleCreator
            • NumpySampleInternals
            • numpy_apply_along_axis_function
            • numpy_concatenate_function
            • numpy_copy_function
            • numpy_expand_dims_function
            • numpy_function_override
            • numpy_internals_override
            • numpy_matrix_transpose
            • numpy_reduction_function
            • numpy_reshape_function
            • numpy_sample_axis_preserving_function
            • numpy_sample_internals
            • numpy_squeeze_function
            • numpy_stack_function
            • numpy_swapaxes_function
            • numpy_transpose
            • track_sample_axis_after_reduction
          • sample.torch
            • TorchSample
          • sample.torch_axis_tracking
          • sample.torch_functions
            • TorchSampleCreator
            • TorchSampleInternals
            • torch_adjoint_function
            • torch_cat_function
            • torch_elementwise_function
            • torch_function_override
            • torch_internals_override
            • torch_movedim_function
            • torch_permute_function
            • torch_reduction_function
            • torch_sample_internals
            • torch_stack_function
            • torch_transpose_function
            • track_sample_dim_after_reduction
          • ListSample
          • RepresentationSample
          • Sample
          • SampleFactory
          • create_sample
        • text_generation
          • text_generation.torch
            • TorchTextGeneration
            • TorchTextGenerationSample
            • TorchTextGenerationSampleSample
            • TorchTokenGeneration
      • representer
        • clarifier
          • clarifier.huggingface
            • HFQuestionClarifier
        • credal_set
          • ConvexCredalSetRepresenter
          • ProbabilityIntervalsRepresenter
          • RepresentativeConvexCredalSetRepresenter
          • SampleMeanConvexCredalSetRepresenter
        • embedder
          • embedder.huggingface
            • HFTextEmbedder
            • SentenceTransformerLike
        • sampler
          • sampler.flax
            • register_forced_train_mode
          • sampler.huggingface
            • HFTextGenerationSampler
            • load_model
          • sampler.sklearn
            • register_forced_fitted_already_mode
          • sampler.torch
            • register_forced_train_mode
          • IterableSampler
          • Sampler
        • semantic_clustering
          • semantic_clustering.huggingface
            • HFGreedySemanticClusterer
            • HFSemanticClusterer
        • torch_credal_set
          • torch_compute_representative_sample
        • DummyRepresenter
        • Representer
        • compute_representative_sample
        • representer
      • train
      • transformation
        • batchensemble
        • bayesian
        • bayesian_ensemble
        • calibration
          • calibration.flax
            • FlaxAffineLogitCalibrationPredictor
            • FlaxDirichletCalibrationPredictor
            • FlaxIdentityLogitModel
            • FlaxIsotonicCalibrationPredictor
            • flax_calibration_generator
          • calibration.sklearn
            • SklearnIdentityLogitEstimator
            • SklearnVectorScalingPredictor
            • sklearn_calibrated_classifier_cv_calibrate
            • sklearn_calibration_generator
          • calibration.torch
            • TorchAffineLogitCalibrationPredictor
            • TorchDirichletCalibrationPredictor
            • TorchIdentityLogitModel
            • TorchIsotonicCalibrationPredictor
            • torch_calibration_generator
          • dirichlet_calibration
          • flax_identity_logit_model
          • isotonic_regression
          • platt_scaling
          • sklearn_identity_logit_estimator
          • temperature_scaling
          • torch_identity_logit_model
          • vector_scaling
        • cast
        • class_bias_ensemble
        • conformal
          • conformal.flax
            • FlaxConformalSetPredictor
          • conformal.sklearn
            • SklearnConformalSetPredictor
          • conformal.torch
            • TorchConformalSetPredictor
          • conformal_absolute_error
          • conformal_aps
          • conformal_cqr
          • conformal_cqr_r
          • conformal_lac
          • conformal_raps
          • conformal_saps
          • conformal_uacqr
        • conformal_credal_set
          • conformal_credal_set.torch
            • TorchConformalCredalSetPredictor
          • conformal_credal_set_generator
          • conformal_dirichlet_relative_likelihood
          • conformal_inner_product
          • conformal_kullback_leibler
          • conformal_total_variation
          • conformal_wasserstein_distance
        • dirichlet_clipped_exp_one_activation
        • dirichlet_exp_activation
        • dirichlet_softplus_activation
        • dropconnect
        • dropout
        • ensemble
        • interval_classifier
        • masksembles
        • natural_posterior_network
          • natural_posterior_network.torch
            • TorchNaturalPosteriorNetwork
          • natural_posterior_network
        • normal_inverse_gamma_head
        • posterior_network
        • subensemble
        • transformation
          • PredictorTransformation
          • PredictorTransformationDecorator
          • predictor_transformation
        • batchensemble
        • bayesian
        • bayesian_ensemble
        • cast
        • class_bias_ensemble
        • conformal_dirichlet_relative_likelihood
        • conformal_inner_product
        • conformal_kullback_leibler
        • conformal_total_variation
        • conformal_wasserstein_distance
        • dirichlet_clipped_exp_one_activation
        • dirichlet_exp_activation
        • dirichlet_softplus_activation
        • dropconnect
        • dropout
        • ensemble
        • interval_classifier
        • masksembles
        • normal_inverse_gamma_head
        • posterior_network
        • subensemble
      • traverse_nn
        • flax
        • reset_traverser
        • torch
        • torch_utils
        • utils
          • find_layer
          • find_layers
          • get_output_dim
          • layer_finder
        • find_layer
        • find_layers
        • is_first_layer
        • LAYER_COUNT
        • layer_count_traverser
        • nn_compose
        • nn_traverser
        • reset_traverser
      • utils
        • iterable
          • first_element
        • jax
          • jax_entropy
          • jax_fresh_prng_key
          • jax_intersection_probability
        • quantile
          • quantile.jax
          • quantile.torch
        • torch
          • torch_entropy
          • torch_head_dimension
          • torch_intersection_probability
          • torch_temperature_softmax
        • entropy
        • intersection_probability
  • Contributing
    • Contributing Guidelines
    • Adding a New Method
    • Why the Stages Compose
    • JAX Representations
  • References and Further Reading
  • FAQ and Troubleshooting
Back to top

Quantification¶

Examples concerning the probly.quantification module.

Uncertainty Quantification

Uncertainty Quantification

Ensemble Regression Uncertainty

Ensemble Regression Uncertainty

Ensemble Ordinal Classification Uncertainty

Ensemble Ordinal Classification Uncertainty
Next
Uncertainty Quantification
Previous
A Brief Introduction to PyTraverse
Copyright © 2026, probly team
Made with Sphinx and @pradyunsg's Furo