Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
You are viewing the development documentation (main). Switch to the stable release docs.
probly 0.9.2.dev75+g7043be991 documentation
Light Logo Dark Logo

Table of Contents

  • Getting Started
  • Installation
  • User Guide
    • 1. Uncertainty
      • 1.1. Why One Number Is Not Enough
      • 1.2. Where Uncertainty Arises
      • 1.3. Representing Uncertainty
      • 1.4. Quantifying Uncertainty
      • 1.5. Evaluating Uncertainty
    • 2. Core Pillars of Probly
    • 3. Uncertainty Methods
      • 3.1. Second-Order Distributions
      • 3.2. Credal Sets
      • 3.3. Conformal Prediction
      • 3.4. Calibration
  • Examples and Tutorials
    • Examples
      • Active Learning
        • Active Learning with sklearn - Margin vs Random
        • Active Learning with PyTorch - BADGE Selection
      • Conformal Prediction
        • Regression Conformal Prediction — sklearn
        • Classification Conformal Prediction — sklearn
        • Quantile Regression Conformal Prediction — sklearn
        • Classification Conformal Prediction — PyTorch
        • Regression Conformal Prediction — PyTorch
        • Adaptive Conformal Intervals on Heteroscedastic Data
        • A Gentle Introduction to Conformal Prediction
        • Conformalized Credal Set Prediction — PyTorch.
        • How Conformal Sets Change with the Score and with Alpha
        • Quantile Regression Conformal Prediction — PyTorch
      • Integrations
        • Uncertainty for Hugging Face vision transformers
        • Depth estimation uncertainty with transformers
        • Mixing torch-uncertainty and probly
        • Uncertainty for Hugging Face transformers
        • Forecast uncertainty with transformers
        • LoRA adapter ensembles with peft
        • Cyclone forecast uncertainty with WeatherNext
      • Method
        • SWAG on Two Moons
        • DARE on Two Moons
        • Laplace Approximation on Two Moons
        • Het-Net on Two Moons
        • Generative Variational Bayesian Last Layers on Two Moons
        • Mahalanobis OOD on Two Moons
        • Variational Bayesian Last Layers on Two Moons
        • DUQ on Two Moons
        • DDU on Two Moons
        • Credal Net Visualization
        • Evidential on Two Moons
        • Student-t Variational Bayesian Last Layers on Two Moons
        • Credal Wrapper Output Visualization
        • Credal Ensembling Visualization
        • Heteroscedastic Variational Bayesian Last Layers on Two Moons
        • Credal BNN Visualization
        • Credal DRO Output Visualization
        • Efficient Credal Prediction Visualization
        • DARE on MNIST
        • SNGP Distance Awareness on 2D Toys
        • Laplace on MNIST
        • Het-Net on MNIST
        • G-VBLL on MNIST
        • Credal BNN on MNIST
        • VBLL on MNIST
        • SWAG on MNIST
        • Student-t VBLL on MNIST
        • Heteroscedastic VBLL on MNIST
        • Credal Wrapper on MNIST
        • Credal Ensembling on MNIST
        • Prior Network on Two Moons
        • Credal Net on MNIST
        • Efficient Credal Prediction on MNIST
        • SNGP on MNIST
        • Mahalanobis OOD on MNIST
        • DUQ on MNIST
        • DDU on MNIST
        • Credal Relative Likelihood Visualization
        • Prior Network on MNIST
        • Evidential Regression on a 1D Example
        • Evidential on MNIST
        • Credal Relative Likelihood on MNIST
        • DEUP on Two Moons
        • DEUP on MNIST
      • Plot
        • Visualising OOD detection results
        • Plotting binary credal sets on an interval
        • Plotting credal sets on the simplex
        • Plotting credal sets on a spider (radar) chart
      • Pytraverse
        • A Brief Introduction to PyTraverse
      • Quantification
        • Uncertainty Quantification
        • Ensemble Regression Uncertainty
        • Ensemble Ordinal Classification Uncertainty
      • Release Highlights
      • Representation
        • Singleton credal set
        • Distance-based credal set
        • Convex credal set
        • Discrete credal set
        • Probability-intervals credal set
        • Working with samples
        • Sets of outcomes
        • Point predictions and first-order distributions
        • Second order: a parameterized Dirichlet
        • Second order: a sample of distributions
      • Streaming
        • Streaming uncertainty with ARFRegressor
        • Streaming uncertainty with ARFClassifier
        • MC-Dropout uncertainty on a 2-D stream
      • Transformation
        • DropConnect on Two Moons
        • Deep Ensemble on Two Moons
        • MC Dropout on Two Moons
        • Masksembles on Two Moons
        • Natural Posterior Network on Two Moons
        • Posterior Network on Two Moons
        • Bayesian Neural Network on Two Moons
        • Sub-Ensemble on Two Moons
        • Bayesian Ensemble on Two Moons
        • BatchEnsemble on Two Moons
        • MC Dropout on MNIST
        • DropConnect on MNIST
        • Deep Ensemble on MNIST
        • Bayesian Neural Network on MNIST
        • Natural Posterior Network on MNIST
        • Bayesian Ensemble on MNIST
        • Posterior Network on MNIST
        • Sub-Ensemble on MNIST
        • BatchEnsemble on MNIST
        • Masksembles on MNIST
        • Dirichlet Calibration on MNIST
        • Platt Scaling on MNIST (Odd vs. Even)
        • Vector Scaling on MNIST
        • Temperature Scaling on MNIST
        • Isotonic Regression on MNIST (Odd vs. Even)
  • API Reference
    • probly
      • calibrator
        • Calibrator
        • calibrate
      • conformal_scores
        • absolute_error
          • absolute_error.jax
          • absolute_error.torch
            • torch_compute_absolute_error_score
            • torch_compute_absolute_error_score_sample
          • absolute_error_score
        • aps
          • aps.jax
          • aps.torch
            • torch_compute_aps_score
          • APSScore
          • aps_score
        • cqr
          • cqr.jax
          • cqr.torch
            • torch_compute_cqr_score
          • cqr_score
        • cqr_r
          • cqr_r.jax
          • cqr_r.torch
            • torch_compute_cqr_r_score
          • cqr_r_score
        • dirichlet_relative_likelihood
          • dirichlet_relative_likelihood.jax
            • jax_compute_dirichlet_rl_score
            • jax_compute_dirichlet_rl_score_dirichlet
          • dirichlet_relative_likelihood.torch
            • torch_compute_dirichlet_rl_score
            • torch_compute_dirichlet_rl_score_dirichlet
          • DirichletRLScore
          • dirichlet_rl_score
          • dirichlet_rl_score_func
        • inner_product
          • inner_product.jax
            • jax_compute_inner_product_score
          • inner_product.torch
            • torch_compute_inner_product_score
          • InnerProductScore
          • inner_product_score
          • inner_product_score_func
        • kullback_leibler
          • kullback_leibler.jax
            • jax_compute_kl_divergence_score
          • kullback_leibler.torch
            • torch_compute_kl_divergence_score
          • KLDivergenceScore
          • kl_divergence_score
          • kl_divergence_score_func
        • lac
          • lac.jax
            • jax_compute_lac_score
          • lac.torch
            • torch_compute_lac_score
            • torch_compute_lac_score_categorical
            • torch_compute_lac_score_sample
          • lac_score
        • raps
          • raps.jax
          • raps.torch
            • torch_compute_raps_score
          • RAPSScore
          • raps_score
        • saps
          • saps.jax
          • saps.torch
            • torch_compute_saps_score
          • SAPSScore
          • saps_score
        • total_variation
          • total_variation.jax
            • jax_compute_tv_score
          • total_variation.torch
            • torch_compute_tv_score
          • TVScore
          • tv_score
          • tv_score_func
        • uacqr
          • uacqr.jax
          • uacqr.torch
            • torch_compute_uacqr_score_func
          • uacqr_score
        • wasserstein_distance
          • wasserstein_distance.jax
            • jax_compute_wasserstein_distance_score
          • wasserstein_distance.torch
            • torch_compute_wasserstein_distance_score
          • WassersteinDistanceScore
          • wasserstein_distance_score
          • wasserstein_distance_score_func
        • NonConformityScore
        • absolute_error_score
        • aps_score
        • cqr_r_score
        • cqr_score
        • dirichlet_rl_score
        • dirichlet_rl_score_func
        • inner_product_score
        • inner_product_score_func
        • kl_divergence_score
        • kl_divergence_score_func
        • lac_score
        • raps_score
        • saps_score
        • tv_score
        • tv_score_func
        • uacqr_score
        • wasserstein_distance_score
        • wasserstein_distance_score_func
      • datasets
        • torch
          • Benthic
          • CIFAR100C
          • CIFAR10C
          • CIFAR10H
          • CIFAR10HDCIC
          • DCICDataset
          • ImageNetReaL
          • MedMNISTC
          • MiceBone
          • Pig
          • Plankton
          • QualityMRI
          • Synthetic
          • TinyImageNet
          • Treeversity1
          • Treeversity6
          • Turkey
      • decider
        • categorical_distribution
          • categorical_distribution.numpy
          • categorical_distribution.torch
          • categorical_from_maximin
          • categorical_from_mean
          • mean_field_categorical
        • Decider
        • categorical_from_maximin
        • categorical_from_mean
        • mean_field_categorical
      • evaluation
        • active_learning
          • active_learning.loop
            • ALState
            • active_learning_steps
          • active_learning.metrics
            • compute_nauc
          • active_learning.pool
            • active_learning.pool.numpy
              • NumpyActiveLearningPool
            • active_learning.pool.torch
              • TorchActiveLearningPool
            • ActiveLearningPool
            • from_dataset
            • query
          • active_learning.strategies
            • active_learning.strategies.numpy
            • active_learning.strategies.torch
            • BadgeEstimator
            • BADGEQuery
            • EntropySampling
            • Estimator
            • LeastConfidentSampling
            • MarginSampling
            • QueryStrategy
            • RandomQuery
            • UncertaintyEstimator
            • UncertaintyQuery
            • badge_embed
            • badge_select
            • entropy_score
            • least_confident_score
            • margin_score
            • random_select
            • topk_select
          • active_learning.torch_metrics
          • active_learning_steps
          • compute_accuracy
          • compute_ece
          • compute_nauc
          • from_dataset
        • ood
          • evaluate_ood
          • out_of_distribution_detection_aupr
          • out_of_distribution_detection_auroc
          • out_of_distribution_detection_fnr_at_x_tpr
          • out_of_distribution_detection_fpr_at_x_tpr
          • parse_dynamic_metric
        • selective_prediction
          • selective_prediction.jax
            • jax_selective_prediction
          • selective_prediction.numpy
            • numpy_selective_prediction
          • selective_prediction.torch
            • torch_selective_prediction
          • selective_prediction
      • integrations
        • peft
        • torch_uncertainty
          • TorchUncertaintyCalibratedLogitRepresenter
          • TorchUncertaintyConformalRepresenter
          • TorchUncertaintySampleRepresenter
        • transformers
          • extract_predictions
        • weathernext
          • WeatherNextPredictor
          • WeatherNextRepresenter
      • layers
        • flax
          • BatchEnsembleConv
          • BatchEnsembleLinear
          • DropConnectLinear
        • numpy
          • CovarianceEstimator
          • NumpyMahalanobisHead
        • torch
          • BatchEnsembleConv2d
          • BatchEnsembleLinear
          • BayesConv2d
          • BayesLinear
          • DropConnectLinear
          • GaussianMixtureHead
          • GVBLLLayer
          • HeteroscedasticLayer
          • HetVBLLLayer
          • IntBatchNorm1d
          • IntBatchNorm2d
          • IntConv2d
          • IntLinear
          • IntSoftmax
          • IRDHead
          • MahalanobisHead
          • Masksembles2D
          • MasksemblesLinear
          • NatPNClassHead
          • NatPNRegHead
          • NormalInverseGammaLinear
          • RadialNormalizingFlow
          • RadialNormalizingFlowStack
          • RegressionHead
          • SharedMaskDropout
          • SNCoeffParametrization
          • SNGPLayer
          • TVBLLLayer
          • VBLLLayer
          • apply_spectral_norm_to_encoder
          • pack_interval
          • unpack_interval
      • lazy_types
      • losses
        • torch
          • cvar_ce_loss
          • der_loss
          • disc_vbll_loss
          • elbo_loss
          • evidential_ce_loss
          • evidential_kl_divergence
          • evidential_log_loss
          • evidential_mse_loss
          • evidential_nignll_loss
          • evidential_regression_regularization
          • focal_loss
          • g_vbll_loss
          • het_vbll_loss
          • intersection_probability_ce_loss
          • ird_loss
          • label_relaxation_loss
          • lop_gpn_loss
          • lp_fn
          • make_in_domain_target_alpha
          • make_ood_target_alpha
          • mixture_uce_loss
          • natpn_loss
          • normal_wishart_log_prob
          • pn_loss
          • postnet_loss
          • regularization_fn
          • rpn_distillation_loss
          • rpn_loss
          • rpn_ng_kl
          • rpn_prior
          • t_vbll_loss
        • vbll_loss
      • method
        • batchensemble
        • bayesian
        • calibration
          • CalibrationPredictor
          • dirichlet_calibration
          • flax_identity_logit_model
          • isotonic_regression
          • platt_scaling
          • sklearn_identity_logit_estimator
          • temperature_scaling
          • torch_identity_logit_model
          • vector_scaling
        • cast
        • conformal
          • AbsoluteErrorConformalSetPredictor
          • APSConformalSetPredictor
          • ClassificationConformalSetPredictor
          • ConformalSetPredictor
          • CQRConformalSetPredictor
          • CQRrConformalSetPredictor
          • LACConformalSetPredictor
          • RAPSConformalSetPredictor
          • RegressionConformalSetPredictor
          • SAPSConformalSetPredictor
          • UACQRConformalSetPredictor
          • conformal_absolute_error
          • conformal_aps
          • conformal_cqr
          • conformal_cqr_r
          • conformal_lac
          • conformal_raps
          • conformal_saps
          • conformal_uacqr
        • conformal_credal_set
          • ConformalCredalSetPredictor
          • DirichletConformalCredalSetPredictor
          • conformal_credal_set_generator
          • conformal_dirichlet_relative_likelihood
          • conformal_inner_product
          • conformal_kullback_leibler
          • conformal_total_variation
          • conformal_wasserstein_distance
        • credal_bnn
        • credal_dro
        • credal_ensembling
        • credal_net
        • credal_relative_likelihood
        • credal_wrapper
        • dare
        • ddu
        • deup
          • deup.torch
            • ErrorPredictionHead
            • LogDUEVariance
            • LogGMMDensity
            • LogMAFDensity
            • LogMCDropoutVariance
            • StationarizingFeatureProvider
            • TorchDEUPPredictor
            • TorchDEUPRepresentation
          • DEUPDecomposition
          • DEUPPredictor
          • DEUPRepresentation
          • create_deup_representation
          • deup
          • deup_generator
        • dropconnect
        • dropout
        • duq
        • efficient_credal_prediction
        • ensemble
        • evidential
          • evidential.classification
            • EvidentialClassificationDecomposition
            • EvidentialClassificationPredictor
            • EvidentialClassificationRepresentation
            • EvidentialClassificationRepresenter
            • evidential_classification
            • register
          • evidential.regression
            • evidential_regression
            • evidential_regression_traverser
            • register
          • evidential_classification
          • evidential_regression
        • g_vbll
        • graph_posterior_network
        • het_net
        • laplace
          • laplace.torch
            • LaplaceRepresenter
        • mahalanobis
        • masksembles
        • natural_posterior_network
          • NaturalPosteriorDecomposition
          • NaturalPosteriorNetworkPredictor
          • NaturalPosteriorNetworkRepresentation
          • NaturalPosteriorNetworkRepresenter
          • natural_posterior_network
        • posterior_network
          • PosteriorNetworkDecomposition
          • PosteriorNetworkPredictor
          • PosteriorNetworkRepresentation
          • PosteriorNetworkRepresenter
          • posterior_network
        • prior_network
          • PriorNetworkPredictor
          • prior_network
        • sngp
        • subensemble
        • swag
        • vbll
        • batchensemble
        • bayesian
        • cast
        • conformal_dirichlet_relative_likelihood
        • conformal_inner_product
        • conformal_kullback_leibler
        • conformal_total_variation
        • conformal_wasserstein_distance
        • credal_bnn
        • credal_dro
        • credal_ensembling
        • credal_net
        • credal_relative_likelihood
        • credal_wrapper
        • cuq_graph_neural_network
        • dare
        • ddu
        • dropconnect
        • dropout
        • duq
        • efficient_credal_prediction
        • ensemble
        • evidential_classification
        • evidential_regression
        • g_vbll
        • graph_posterior_network
        • het_net
        • lop_graph_posterior_network
        • mahalanobis
        • masksembles
        • sngp
        • subensemble
        • swag
        • vbll
      • metrics
        • jax
          • jax_categorical_log_loss_per_instance
          • jax_classwise_ece
          • jax_expected_calibration_error
          • jax_log_loss_per_instance
          • jax_log_probabilities
          • jax_one_hot_argmax
          • jax_precision_recall_curve
          • jax_probabilities
          • jax_probability_categorical_log_loss_per_instance
          • jax_roc_curve
        • numpy
          • numpy_categorical_classwise_ece
          • numpy_categorical_expected_calibration_error
          • numpy_classwise_ece
          • numpy_expected_calibration_error
          • numpy_log_probabilities
          • numpy_one_hot_argmax
          • numpy_precision_recall_curve
          • numpy_probabilities
          • numpy_roc_curve
        • torch
          • torch_categorical_log_loss_per_instance
          • torch_classwise_ece
          • torch_expected_calibration_error
          • torch_log_loss_per_instance
          • torch_log_probabilities
          • torch_one_hot_argmax
          • torch_precision_recall_curve
          • torch_probabilities
          • torch_probability_categorical_log_loss_per_instance
          • torch_roc_curve
        • accuracy
        • auc
        • average_interval_width
        • average_precision_score
        • brier_loss
        • brier_loss_per_instance
        • classwise_ece
        • convex_hull_coverage
        • coverage
        • efficiency
        • expected_calibration_error
        • false_negative_rate
        • false_positive_rate
        • log_loss
        • log_loss_per_instance
        • precision_recall_curve
        • roc_auc_score
        • roc_curve
        • spherical_loss
        • spherical_loss_per_instance
        • zero_one_loss
        • zero_one_loss_per_instance
      • plot
        • config
          • PlotConfig
          • use_probly_style
        • credal
          • credal.plot
            • plot_credal_set
          • plot_credal_set
        • ood
          • plot_histogram
          • plot_pr_curve
          • plot_roc_curve
        • utils
        • PlotFunction
        • plot_credal_set
        • plot_histogram
        • plot_pr_curve
        • plot_roc_curve
        • use_probly_style
      • predictor
        • laplace
        • sklearn
          • sklearn_predict_raw
        • BernoulliDistributionPredictor
        • BernoulliLogitDistributionPredictor
        • BinaryLogitClassifier
        • BinaryProbabilisticClassifier
        • CategoricalDistributionPredictor
        • CredalPredictor
        • DirichletDistributionPredictor
        • DirichletMixtureDistributionPredictor
        • DistributionPredictor
        • EvidentialPredictor
        • GaussianDistributionPredictor
        • IterablePredictor
        • LogitClassifier
        • LogitDistributionPredictor
        • Predictor
        • ProbabilisticClassifier
        • RandomPredictor
        • RandomRepresentationPredictor
        • RepresentationPredictor
        • predict
        • predict_raw
        • predictor_registry
      • quantification
        • decomposition
          • decomposition.decomposition
            • AdditiveDecomposition
            • AleatoricDecomposition
            • AleatoricEpistemicDecomposition
            • AleatoricEpistemicTotalDecomposition
            • AleatoricTotalDecomposition
            • CachingDecomposition
            • ConstantTotalDecomposition
            • Decomposer
            • Decomposition
            • EpistemicDecomposition
            • EpistemicTotalDecomposition
            • TotalDecomposition
          • decomposition.entropy
            • CredalSetEntropyDecomposition
            • LabelNoiseEntropyDecomposition
            • SecondOrderEntropyDecomposition
          • decomposition.ordinal
            • CategoricalVarianceDecomposition
            • LabelwiseBinaryEntropyDecomposition
            • LabelwiseBinaryVarianceDecomposition
            • OrdinalEntropyDecomposition
            • OrdinalVarianceDecomposition
            • categorical_variance_aleatoric
            • categorical_variance_total
            • expected_conditional_variance
            • labelwise_conditional_entropy
            • labelwise_entropy_of_expected_predictive_distribution
            • labelwise_expected_conditional_variance
            • labelwise_variance_of_expected_predictive_distribution
            • ordinal_conditional_entropy
            • ordinal_entropy_of_expected_predictive_distribution
            • ordinal_expected_conditional_variance
            • ordinal_variance_of_expected_predictive_distribution
            • variance_of_conditional_mean
          • decomposition.scoring_rule
            • SecondOrderScoringRuleDecomposition
          • decomposition.spectral
            • SpectralDecomposition
          • decomposition.variance
            • SecondOrderVarianceDecomposition
          • decomposition.wasserstein
            • SecondOrderWassersteinDecomposition
          • decomposition.zero_one
            • SecondOrderZeroOneDecomposition
        • measure
        • notion
          • AleatoricUncertainty
          • EpistemicUncertainty
          • Notion
          • TotalUncertainty
        • QuantificationResult
        • Quantifier
        • conditional_entropy
        • conditional_spectral_entropy
        • conformal_set_size
        • decompose
        • dempster_shafer_uncertainty
        • entropy
        • entropy_of_expected_predictive_distribution
        • expected_max_probability_complement
        • max_disagreement
        • max_probability_complement_of_expected
        • mean_squared_distance_to_scaled_one_hot
        • measure
        • measure_atomic
        • min_expected_total_variation
        • mutual_information
        • notion_registry
        • quantify
        • sample_variance
        • spectral_entropy
        • total_logit_sample_variance
        • vacuity
      • representation
        • conformal_set
          • conformal_set.jax
            • JaxIntervalConformalSet
            • JaxOneHotConformalSet
          • conformal_set.numpy
            • NumpyIntervalConformalSet
            • NumpyOneHotConformalSet
          • conformal_set.torch
            • TorchIntervalConformalSet
            • TorchOneHotConformalSet
          • ConformalSet
          • IntervalConformalSet
          • OneHotConformalSet
          • create_interval_conformal_set
          • create_onehot_conformal_set
        • credal_set
          • credal_set.jax
            • JaxCategoricalCredalSet
            • JaxConvexCredalSet
            • JaxDirichletLevelSetCredalSet
            • JaxDistanceBasedCredalSet
            • JaxProbabilityIntervalsCredalSet
          • credal_set.numpy
            • NumpyCategoricalCredalSet
            • NumpyConvexCredalSet
            • NumpyDiscreteCredalSet
            • NumpyDistanceBasedCredalSet
            • NumpyProbabilityIntervalsCredalSet
            • NumpySingletonCredalSet
          • credal_set.numpy_functions
          • credal_set.torch
            • TorchCategoricalCredalSet
            • TorchConvexCredalSet
            • TorchDirichletLevelSetCredalSet
            • TorchDistanceBasedCredalSet
            • TorchProbabilityIntervalsCredalSet
          • CategoricalCredalSet
          • ConvexCredalSet
          • CredalSet
          • DirichletLevelSetCredalSet
          • DiscreteCredalSet
          • DistanceBasedCredalSet
          • ProbabilityIntervalsCredalSet
          • SingletonCredalSet
          • create_convex_credal_set
          • create_dirichlet_level_set_credal_set
          • create_discrete_credal_set
          • create_distance_based_credal_set
          • create_distance_based_credal_set_from_center_and_radius
          • create_probability_intervals
          • create_probability_intervals_from_bounds
          • create_probability_intervals_from_lower_upper_array
          • create_singleton_credal_set
        • distribution
          • distribution.jax_bernoulli
            • JaxBernoulliDistribution
            • JaxBernoulliDistributionSample
            • JaxLogitBernoulliDistribution
            • JaxProbabilityBernoulliDistribution
          • distribution.jax_categorical
            • JaxCategoricalDistribution
            • JaxCategoricalDistributionSample
            • JaxLogitCategoricalDistribution
            • JaxProbabilityCategoricalDistribution
          • distribution.jax_dirichlet
            • JaxDirichletDistribution
          • distribution.jax_gaussian
            • JaxGaussianDistribution
            • JaxGaussianDistributionSample
          • distribution.numpy_bernoulli
            • NumpyBernoulliDistribution
            • NumpyBernoulliDistributionSample
            • NumpyLogitBernoulliDistribution
            • NumpyProbabilityBernoulliDistribution
          • distribution.numpy_categorical
            • NumpyCategoricalDistribution
            • NumpyCategoricalDistributionSample
            • NumpyLogitCategoricalDistribution
            • NumpyProbabilityCategoricalDistribution
          • distribution.numpy_dirichlet
            • NumpyDirichletDistribution
          • distribution.numpy_gaussian
            • NumpyGaussianDistribution
            • NumpyGaussianDistributionSample
          • distribution.torch_bernoulli
            • TorchBernoulliDistribution
            • TorchBernoulliDistributionSample
            • TorchLogitBernoulliDistribution
            • TorchProbabilityBernoulliDistribution
          • distribution.torch_categorical
            • TorchCategoricalDistribution
            • TorchCategoricalDistributionSample
            • TorchLogitCategoricalDistribution
            • TorchProbabilityCategoricalDistribution
          • distribution.torch_dirichlet
            • TorchDirichletDistribution
          • distribution.torch_gaussian
            • TorchGaussianDistribution
            • TorchGaussianDistributionSample
          • distribution.torch_mixture
            • TorchDirichletMixtureDistribution
            • TorchMixtureDistribution
          • distribution.torch_sparse_log_categorical
            • TorchSparseLogCategoricalDistribution
            • TorchSparseLogCategoricalDistributionSample
          • BernoulliDistribution
          • BernoulliDistributionSample
          • CategoricalDistribution
          • CategoricalDistributionSample
          • DirichletDistribution
          • DirichletMixtureDistribution
          • Distribution
          • DistributionSample
          • GaussianDistribution
          • GaussianDistributionSample
          • MixtureDistribution
          • SecondOrderDistribution
          • create_bernoulli_distribution
          • create_bernoulli_distribution_from_logits
          • create_categorical_distribution
          • create_categorical_distribution_from_logits
          • create_dirichlet_distribution_from_alphas
          • create_dirichlet_mixture_distribution_from_alphas_and_weights
          • create_gaussian_distribution
        • embedding
          • embedding.torch
            • TorchEmbedding
            • TorchEmbeddingSample
            • TorchEmbeddingSampleSample
          • Embedding
          • EmbeddingSample
          • EmbeddingSampleSample
          • create_embedding
        • representation
          • Representation
        • sample
          • sample.axis_tracking
            • ArrayIndex
            • AxisTrackingResult
            • track_axis
          • sample.jax
            • JaxSample
          • sample.jax_axis_tracking
          • sample.jax_functions
            • JaxSampleCreator
            • JaxSampleInternals
            • jax_concatenate_function
            • jax_conj_function
            • jax_copy_function
            • jax_elementwise_function
            • jax_expand_dims_function
            • jax_function_override
            • jax_internals_override
            • jax_matrix_transpose_function
            • jax_moveaxis_function
            • jax_reduction_function
            • jax_reshape_function
            • jax_sample_internals
            • jax_squeeze_function
            • jax_stack_function
            • jax_swapaxes_function
            • jax_take_along_axis_function
            • jax_transpose_function
          • sample.numpy
            • NumpySample
          • sample.numpy_functions
            • NumpySampleCreator
            • NumpySampleInternals
            • numpy_apply_along_axis_function
            • numpy_concatenate_function
            • numpy_copy_function
            • numpy_expand_dims_function
            • numpy_function_override
            • numpy_internals_override
            • numpy_matrix_transpose
            • numpy_reduction_function
            • numpy_reshape_function
            • numpy_sample_axis_preserving_function
            • numpy_sample_internals
            • numpy_squeeze_function
            • numpy_stack_function
            • numpy_swapaxes_function
            • numpy_transpose
            • track_sample_axis_after_reduction
          • sample.torch
            • TorchSample
          • sample.torch_axis_tracking
          • sample.torch_functions
            • TorchSampleCreator
            • TorchSampleInternals
            • torch_adjoint_function
            • torch_cat_function
            • torch_elementwise_function
            • torch_function_override
            • torch_internals_override
            • torch_movedim_function
            • torch_permute_function
            • torch_reduction_function
            • torch_sample_internals
            • torch_stack_function
            • torch_transpose_function
            • track_sample_dim_after_reduction
          • ListSample
          • RepresentationSample
          • Sample
          • SampleFactory
          • create_sample
        • text_generation
          • text_generation.torch
            • TorchTextGeneration
            • TorchTextGenerationSample
            • TorchTextGenerationSampleSample
            • TorchTokenGeneration
      • representer
        • clarifier
          • clarifier.huggingface
            • HFQuestionClarifier
        • credal_set
          • ConvexCredalSetRepresenter
          • ProbabilityIntervalsRepresenter
          • RepresentativeConvexCredalSetRepresenter
          • SampleMeanConvexCredalSetRepresenter
        • embedder
          • embedder.huggingface
            • HFTextEmbedder
            • SentenceTransformerLike
        • sampler
          • sampler.flax
            • register_forced_train_mode
          • sampler.huggingface
            • HFTextGenerationSampler
            • load_model
          • sampler.sklearn
            • register_forced_fitted_already_mode
          • sampler.torch
            • register_forced_train_mode
          • IterableSampler
          • Sampler
        • semantic_clustering
          • semantic_clustering.huggingface
            • HFGreedySemanticClusterer
            • HFSemanticClusterer
        • torch_credal_set
          • torch_compute_representative_sample
        • DummyRepresenter
        • Representer
        • compute_representative_sample
        • representer
      • train
      • transformation
        • batchensemble
        • bayesian
        • bayesian_ensemble
        • calibration
          • calibration.flax
            • FlaxAffineLogitCalibrationPredictor
            • FlaxDirichletCalibrationPredictor
            • FlaxIdentityLogitModel
            • FlaxIsotonicCalibrationPredictor
            • flax_calibration_generator
          • calibration.sklearn
            • SklearnIdentityLogitEstimator
            • SklearnVectorScalingPredictor
            • sklearn_calibrated_classifier_cv_calibrate
            • sklearn_calibration_generator
          • calibration.torch
            • TorchAffineLogitCalibrationPredictor
            • TorchDirichletCalibrationPredictor
            • TorchIdentityLogitModel
            • TorchIsotonicCalibrationPredictor
            • torch_calibration_generator
          • dirichlet_calibration
          • flax_identity_logit_model
          • isotonic_regression
          • platt_scaling
          • sklearn_identity_logit_estimator
          • temperature_scaling
          • torch_identity_logit_model
          • vector_scaling
        • cast
        • class_bias_ensemble
        • conformal
          • conformal.flax
            • FlaxConformalSetPredictor
          • conformal.sklearn
            • SklearnConformalSetPredictor
          • conformal.torch
            • TorchConformalSetPredictor
          • conformal_absolute_error
          • conformal_aps
          • conformal_cqr
          • conformal_cqr_r
          • conformal_lac
          • conformal_raps
          • conformal_saps
          • conformal_uacqr
        • conformal_credal_set
          • conformal_credal_set.torch
            • TorchConformalCredalSetPredictor
          • conformal_credal_set_generator
          • conformal_dirichlet_relative_likelihood
          • conformal_inner_product
          • conformal_kullback_leibler
          • conformal_total_variation
          • conformal_wasserstein_distance
        • dirichlet_clipped_exp_one_activation
        • dirichlet_exp_activation
        • dirichlet_softplus_activation
        • dropconnect
        • dropout
        • ensemble
        • interval_classifier
        • masksembles
        • natural_posterior_network
          • natural_posterior_network.torch
            • TorchNaturalPosteriorNetwork
          • natural_posterior_network
        • normal_inverse_gamma_head
        • posterior_network
        • subensemble
        • transformation
          • PredictorTransformation
          • PredictorTransformationDecorator
          • predictor_transformation
        • batchensemble
        • bayesian
        • bayesian_ensemble
        • cast
        • class_bias_ensemble
        • conformal_dirichlet_relative_likelihood
        • conformal_inner_product
        • conformal_kullback_leibler
        • conformal_total_variation
        • conformal_wasserstein_distance
        • dirichlet_clipped_exp_one_activation
        • dirichlet_exp_activation
        • dirichlet_softplus_activation
        • dropconnect
        • dropout
        • ensemble
        • interval_classifier
        • masksembles
        • normal_inverse_gamma_head
        • posterior_network
        • subensemble
      • traverse_nn
        • flax
        • reset_traverser
        • torch
        • torch_utils
        • utils
          • find_layer
          • find_layers
          • get_output_dim
          • layer_finder
        • find_layer
        • find_layers
        • is_first_layer
        • LAYER_COUNT
        • layer_count_traverser
        • nn_compose
        • nn_traverser
        • reset_traverser
      • utils
        • iterable
          • first_element
        • jax
          • jax_entropy
          • jax_fresh_prng_key
          • jax_intersection_probability
        • quantile
          • quantile.jax
          • quantile.torch
        • torch
          • torch_entropy
          • torch_head_dimension
          • torch_intersection_probability
          • torch_temperature_softmax
        • entropy
        • intersection_probability
  • Contributing
    • Contributing Guidelines
    • Adding a New Method
    • Why the Stages Compose
    • JAX Representations
  • References and Further Reading
  • FAQ and Troubleshooting
Back to top

sklearn_calibrated_classifier_cv_calibrate¶

probly.transformation.calibration.sklearn.sklearn_calibrated_classifier_cv_calibrate(predictor: CalibratedClassifierCV, y_calib: object, *calib_args: object, **calib_kwargs: object) → CalibratedClassifierCV[source]¶

Delegate generic calibrate(…) calls to sklearn’s fit(X, y).

Next
sklearn_calibration_generator
Previous
SklearnVectorScalingPredictor
Copyright © 2026, probly team
Made with Sphinx and @pradyunsg's Furo
On this page
  • sklearn_calibrated_classifier_cv_calibrate
    • sklearn_calibrated_classifier_cv_calibrate()