Honor model eos_token_id and bound local generation (v0.3.20)#317

codelion merged 1 commit into

mainalgorithmicsuperintelligence/optillm:mainfrom

fix/eos-generation-configalgorithmicsuperintelligence/optillm:fix/eos-generation-configCopy head branch name to clipboard