QLoRA adapter that teaches Muse Glimmer 30B to return click points on web screenshots from instructions, trained on the MolmoWeb dataset.

Resource · Local & open models· ♥ 6
5 builds · page 1 of 1
QLoRA adapter that teaches Muse Glimmer 30B to return click points on web screenshots from instructions, trained on the MolmoWeb dataset.

Resource · Local & open models· ♥ 6
A deliberately overengineered parody that 'gives you the Zuck', with a deterministic Oracle edition, a prompted Muse Glimmer edition and an MLX QLoRA fine-tune of Muse Glimmer 30B for Apple Silicon.
GitHub · Content & creative
merve
@mervenoyann
I shipped a fine-tuning tutorial for Muse Glimmer 30B on AI2's MolmoWeb dataset with TRL github.com/merveenoyan/sm… > but merve, this model is sota on ScreenSpot-Pro? yes, but it doesn't work well with ambiguous prompts of MolmoWeb that are close to how you interact with computer,

X post · Local & open models· ♥ 109
An unofficial parody MLX-VLM QLoRA adapter for Muse Glimmer 30B on Apple Silicon.

Resource · Local & open models· ♥ 1
Your product
Sponsored
Put your logo, a line of copy and an image right here, between the builds Muse developers come to read. Same size as a post.
Shown every 12 builds · on every catalog page
Demo of a QLoRA adapter for Muse Glimmer 30B that points at UI elements in web screenshots, returning a click point from an instruction like "filter by MATEIN brand".

Site · Local & open models· ♥ 3