probly.data_generation.base_generator

Data generation base interfaces.

This file defines the abstract BaseDataGenerator interface used to run a model over a dataset, collect statistics, and persist results.

Classes

BaseDataGenerator(model, dataset[, ...])

Base class for data generators.
class probly.data_generation.base_generator.BaseDataGenerator(model, dataset, batch_size=32, device=None)[source]

Bases: ABC, Generic

Base class for data generators.

Parameters:

  • model (M)

  • dataset (D)

  • batch_size (int)

  • device (Dev | None)

abstractmethod generate()[source]

Run the model on the dataset and collect stats.

Return type:

dict[str, Any]

get_info()[source]

Return a summary of the generator configs.

Return type:

dict[str, Any]

load(path)[source]

Load results from a file.

Parameters:

path (str)

Return type:

dict[str, Any]

save(path)[source]

Save generated results to a file.

Parameters:

path (str)

Return type:

None