sampler.huggingface

Text-generation samplers for Hugging Face transformers models.

Classes

HFTextGenerationSampler

Sample decoded text generations from a transformers generation model.

Functions

load_model

Load a Hugging Face causal language model and tokenizer for sampling.