Skip to main content

Questions tagged [text-generation]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
6 votes
1 answer
1k views

Are text generation models generative or discriminative?

I've recently been studying generative and discriminative models, and I had a question regarding text generation. I'm aware that generative models model $P(X, Y)$ and discriminative models model $P(Y |...
Sean's user avatar
  • 4,087
6 votes
1 answer
1k views

How to compare the semantic similarity of text generated by large language models (GPT-3, BLOOM etc) to reference text?

Large language models, such as GPT-3, BLOOM etc, can generate open-ended text. Say I want to prompt these models to answer a question. How can I compare the semantic similarity of the answer it ...
curious-bert's user avatar
2 votes
0 answers
34 views

ML generated word choice to create distinct "speakers" [closed]

How hard a project would it be to use ML to assist a single author/script writer in writing dialog where each "speaker" sounds like a distinct person? Is that something that a professional ...
BCS's user avatar
  • 121
0 votes
0 answers
212 views

block_size in transformers: does it dictate effective context length in LLMs?

I would like to understand how the block_size parameter in the huggingface transformers library works, particularly in comparison with model_max_length. I am interested in models being able to attend ...
Nucular's user avatar
  • 453