Hi @oskrmiguel it depends on the Model. I did find this forum question that may help you find some insight into your question. Generation Probabilities: How to compute probabilities of output scores for GPT2 - #22 by Aktsvigun
anwarika
2
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Can we use GPT to assign a probability for a sentence given the previous sentences? | 0 | 325 | November 25, 2020 | |
| How to get probability of a sentence using GPT-2 model? | 1 | 3215 | January 8, 2023 | |
| Calculate the probability of a given sequence for a seq2seq model | 0 | 1008 | April 22, 2022 | |
| Get probability of LLM outputting token sequence | 1 | 3304 | November 28, 2023 | |
| How to get probability of the first generated token? | 2 | 1717 | July 18, 2020 |