№ 0375X post
merve showed Muse Glimmer's bundled DFlash drafter speeding generation 2-4x in llama.cpp's web UI, with support in llama.cpp and transformers.
merve
@mervenoyann
merve showed Muse Glimmer's bundled DFlash drafter speeding generation 2-4x in llama.cpp's web UI, with support in llama.cpp and transformers.
Took your custom-connector idea to the physical world: the "service with an API" was my robot. Muse wrote the connector for my rover's API, then installed PyTorch & Depth Anything V2 in the VM because the camera is 2D, drove to the black ball and stopped a few inches short.
@hrhraj
X post
Local & open models
A vLLM-XPU and DFlash recipe for Muse Glimmer 30B on a single Intel Arc Pro B70, reporting 278 aggregate tok/s across eight clients and an 840.8 tok/s burst peak at concurrency 96.
@mgaruccio
GitHub
Local & open models
My fun weekend project was to try to make the new Muse Glimmer 30B work with a longer context, deciding to go for 512k first. I had expected the usual YaRN shenanigans and maybe a LoRA. I couldn't have been wrong more. Upon closer look, Glimmer turned out to be rather unusual architecturally. The thing that make long-context adaptations painful in other models, full attention layers with token position encoding, it simply not there. Instead, only 2048 tokens-wide SWA layers have RoPE, and full GQA attention layers have no position encoding at all. It appears the model is trained to work with long-distance token relationships inferred from the context and SWA layers. It's a rather bold architecture bet, but it seems Meta managed to pull it off. As a result, the model architecture appears to be uniquely suited for context extension by simple mechanical means. To change model context length from stock 128k to, say, 512k, you need only to change “max_position_embeddings” config setting from 131072 to 524288. What confuses other models, like Qwen3.5 family, Glimmer just takes into its stride. I spent close to 70h of compute on DGX Spark to test stock model with extended context on a
u/mr_il
Reddit post
Local & open models
Using @AIatMeta's Muse Glimmer all locally to process personal monthly credit card statements. Your data belongs to you! Try different agent tasks using your favorite apps / harnesses with Ollama.
@ollama
X post
Local & open models
Agentic checkout with Shop Pay ✅ Shop Pay is now available as a wallet in @Muse
@Shopify
X post
Business & commerce
MUSE FEATURE ALERT: y'all have been asking for this one. your @muse is getting its own email address. add it to a thread or forward it stuff and it’ll handle it for you. muse mail!
@alexandr_wang
X post
Agents & automation
gave my Muse $100 and a kalshi account, let's see how frontier this thing is
@kevinroose
X post
Agents & automation
My water heater is dying. I texted Muse the model number at lunch. It compared prices across three shops, emailed two installers for quotes, booked the Thursday job. I worked the counter all day. Came home to two quotes back and an install date. $1,450 beat $2,300.
@PipeBladex
X post
Errands & personal agent
MUSE FEATURE ALERT: y'all have been asking for this one. your @muse is getting its own email address. add it to a thread or forward it stuff and it’ll handle it for you. muse mail!
@alexandr_wang
X post
Agents & automation
gave my Muse $100 and a kalshi account, let's see how frontier this thing is
@kevinroose
X post
Agents & automation
Got Muse logged in to my medical provider’s portal, he pulled the itemized bills, and questioned every line. So far he’s found several times I’d been double billed, asked for some discounts and has saved me over $4,000. If your moat is bureaucracy, you’re cooked.
@Ryan_Holdaway
X post
Errands & personal agent
GitHub 🤝 @Muse A new way to connect your GitHub account to review PRs, catch up on issues and notifications, and leave comments without switching tabs.
@github
X post
Connectors & MCP