Red Hat AI's FP8 weight and activation quantized Muse Glimmer 30B (text and image input) for vLLM.
Resource · Local & open models· ♥ 12
1 build · page 1 of 1
Entries matching “fp8”
Red Hat AI's FP8 weight and activation quantized Muse Glimmer 30B (text and image input) for vLLM.
Resource · Local & open models· ♥ 12
1 build · page 1 of 1