Modify generation params for a model in the Model hub

Beginners
1

Hello, I would like to increase the max_length param on my model nouamanetazi/cover-letter-t5-base · Hugging Face but I can’t seem to find how to do it in docs. Should I edit the config.json file? Can anyone provide an example please.

2

Hey there! You can change the inference parameters as documented here.

In short, you can do something like this in the metadata of the model card (README.md file)

inference:
  parameters:
    temperature: 0.7