Entries matching “gateway”

We've been curious how far local models have actually come for agentic coding tasks, so we ran an experiment. Setup: • Model: Muse Glimmer (30B), packaged as a single llamafile • Agent: Hermes coding agent (connected via llamafile's local server mode, zero API keys needed) • Target: Mozilla AI's Otari gateway The Issue: We pointed Hermes at a real, reported bug in Otari (#183) where the gateway returned a vague 502 error on image requests instead of passing through the actual provider error. What the Agent Did: Hermes read the issue, navigated the repo, isolated the bug, created a branch, ran existing tests, wrote a new regression test, and opened a draft PR (#727). All of it ran locally and offline, with zero code written by hand. It's still draft PR territory rather than a merged fix, but it's a solid signal that ~30B local models are getting genuinely capable for real dev workflows, not just toy demos. Video walkthrough of the run: https://youtu.be/5GAgbT-XgHU?si=vJqEDGm9hssCO5-M Happy to answer questions about the setup, model performance, or how Hermes handled tool calling!

@MrShitFox

@MrShitFox

A localhost compatibility gateway that lets the native Muse Code harness run on OpenRouter's muse-spark-1.2-contributor, rewriting only the model name and never falling back silently to another model.

@evangit2

@evangit2

A guide and tooling for pointing Muse Code's meta provider at any OpenAI-compatible gateway with API-key auth and no Meta login, including workarounds for 1.0.1's bearer-withholding change.

@rafaelnovaes22

@rafaelnovaes22

A hybrid FastAPI gateway where a 1-bit BitNet layer on CPU filters routine traffic and Muse Spark 1.3 is called only for sales, urgency, money or low-confidence cases; the author estimates the local filter handles about 60-70% of volume.

@dangkhoa2016

@dangkhoa2016

A self-hosted llama.cpp serving stack that runs Muse-Glimmer-30B GGUF with DFlash2 speculative decoding on Kaggle's NVIDIA T4 x2, exposed through an authenticated OpenAI-compatible gateway.

@Srimi1

@Srimi1

An experimental macOS gateway that keeps the stock Muse Code CLI in charge of the UI, sessions and tools but swaps the model connection for OpenAI or Z.ai models via a loopback gateway.

Vercel added Muse Spark 1.3 (meta/muse-spark-1.3) to AI Gateway on launch day, with 1M-token context, text/image/PDF input, and both standard and contributor pricing tiers.

@Telep-IO

@Telep-IO

Next.js catalog site (muse.telep.io) and API gateway (api.muse.telep.io) that hosts Telep IO's independent Muse connectors as separate modules behind one deploy.

@tejakummarikuntla

@tejakummarikuntla

Demo that turns an ops REST API into eight MCP tools for Muse Code through Kong AI Gateway 2.0, with per-identity tool ACLs so an investigator can diagnose but only an operator can roll back.

@NeedsChloesure

@NeedsChloesure

Muse Proxy is a Cloudflare Worker gateway that stores CalDAV/CardDAV credentials once and issues scoped API keys, so the Muse agent can reach self-hosted calendars without holding passwords.

@emonibnmustafa

@emonibnmustafa

A local translation gateway and profile manager that plugs Meta Muse Spark (or DeepSeek, Groq, Ollama) into OpenAI Codex and ChatGPT Desktop, translating tool calls and SSE streams, with a one-command switch between providers.