Add option to customize *decoding parameters* in the Chat-UI submodule #2
Description
Feature request
Currently, the Chat-UI submodule does not provide an option to customize the decoding parameters.
The decoding parameters that could be customizable include temperature, top_k, top_p, etc..
The customization could be implemented as additional input fields in the Chat-UI, which would then be passed to the generate function in the client code
Motivation
This feature would be beneficial for users who want to experiment with different decoding strategies or fine-tune the model's output (aligning with the project's goal of improving usability for research)
Your contribution
Will review, and implement if no one else has time.