Skip to main content

Questions tagged [text-generation]

The tag has no usage guidance.

1 question with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
0 votes
0 answers
154 views

block_size in transformers: does it dictate effective context length in LLMs?

I would like to understand how the block_size parameter in the huggingface transformers library works, particularly in comparison with model_max_length. I am interested in models being able to attend ...
Nucular's user avatar
  • 453