№ 0475X post
AI at Meta previewed WildArtifactBench, an internal eval that scores agents on real-world deliverables using win rates and Elo from human and agent judges.
AI at Meta
@AIatMeta
AI at Meta previewed WildArtifactBench, an internal eval that scores agents on real-world deliverables using win rates and Elo from human and agent judges.
$META just went from 3.5% to 45.4% token share on OpenCode in just over two weeks Muse Spark 1.3 being good + free is enough to become the default for most users Default gets you usage → usage gets you data → data makes the next model better Anthropic and OpenAI can’t afford
@thetomcollins
X post
Benchmarks & research
Meta's engineering write-up on Muse security: isolated VMs, a separate Sentinel permission authority, credential surrogation and layered prompt-injection defenses, with bug bounties up to $300,000.
research.meta.ai
Resource
Benchmarks & research
DataCamp's Josep Ferrer ran Muse Spark 1.3 on three real coding tasks. Two used 23–32% fewer completion tokens, but a refactor used 70% more, for a net 12% cost increase.
datacamp.com
Resource
Benchmarks & research
Compared diarization models on 15 mock doctor-patient consultations (~2.4 h): Meta Muse Voice Transcribe scored 13.04% DER at ~92 s per request via API, behind Pyannote (2.89%) and Nemotron 3 (4.80%).
u/MajesticAd2862
Reddit post
Benchmarks & research
Agentic checkout with Shop Pay ✅ Shop Pay is now available as a wallet in @Muse
@Shopify
X post
Business & commerce
MUSE FEATURE ALERT: y'all have been asking for this one. your @muse is getting its own email address. add it to a thread or forward it stuff and it’ll handle it for you. muse mail!
@alexandr_wang
X post
Agents & automation
gave my Muse $100 and a kalshi account, let's see how frontier this thing is
@kevinroose
X post
Agents & automation
My water heater is dying. I texted Muse the model number at lunch. It compared prices across three shops, emailed two installers for quotes, booked the Thursday job. I worked the counter all day. Came home to two quotes back and an install date. $1,450 beat $2,300.
@PipeBladex
X post
Errands & personal agent
Got Muse logged in to my medical provider’s portal, he pulled the itemized bills, and questioned every line. So far he’s found several times I’d been double billed, asked for some discounts and has saved me over $4,000. If your moat is bureaucracy, you’re cooked.
@Ryan_Holdaway
X post
Errands & personal agent
We are excited to announce we are partnering deeply with Muse to enable agentic checkout with Shop Pay on all Shopify stores, offering people an easy and delightful way to shop and check out with Muse.
@tobi
X post
Business & commerce
Muse built me a private library for the e-books and articles in my Google Drive. Everything is organized by topic, and each section opens onto its own subcategorized shelves. Each book opens like a real book and is readable in-app
@chiasmus_cap
X post
Apps & websites
I still can’t believe I can run my plumbing company with an agent so easily. I send this message to my Muse agent while in bed at 6am. And it: updates my job board, texts customer, updates office manager who arrives at 8am in slack Notifies technician
@HouseHackerJon
X post
Agents & automation
ChatForm
Tgmlabs