Open-Source AI Projects Brief, Oct 17

01Week in brief

Attention moved to the layer around the model this week, and star counts are only dated leads

Between Oct 17 and Oct 23, 2026 the news was one stable serving release, a handful of model drops, a draft export rule and a large community debate. Every fact is judged against Oct 24, 2026; items dated before Oct 17 are marked pre-window.

Five conclusions

Attention went to the layer around the model, and star counts are only leads

According to CoddyKit snapshots, the terminal coding agent opencode stands at 219,400 stars, the code knowledge graph Graphify at 129,751 and the skills catalogue agentic-awesome-skills at 48,052. The Graphify and catalogue counts are from Oct 20 (inferred); opencode's snapshot date is not stated. No source gives two snapshots of one repository, so weekly growth cannot be computed. vLLM has fewer stars than Graphify but a fork ratio of 25.1% against 9.6%. The window's one dated launch was Omnara, an open-source durable-agent runtime, on Oct 21.

opencode · 219,400 stars · date not stated · reportedGraphify · 129,751 · Oct 20 (inferred)agentic-awesome-skills · 48,052 · Oct 20 (inferred)

Module 02, trending projects →

The big open weights landed just before the window, and every benchmark is vendor-run

Meta published Muse Spark Open (816B total, 42B active) on Oct 15 and Reflection AI's Beam (501B, Apache 2.0) was reported on Oct 16, so both are pre-window. In the window, NVIDIA released Nemotron 3.5 Parse on Oct 17 and Bolt E4B on Oct 23 under OpenMDW-1.1. No Hugging Face dataset release dated Oct 17 to 23 appears in the material.

Muse Spark Open · Oct 15 · pre-windowBeam · Oct 16 · reportedParse · Oct 17 · windowBolt E4B · Oct 23 · window

Module 03, new open models →

The serving layer produced one GA release and one narrow code drop

llm-d 1.0 reached general availability on Oct 20 with a stable v1 API, and its latency and throughput figures are all self-reported by Google, IBM, AWS and Red Hat. DeepSeek open-sourced DeepInfer, dated Oct 20 by secondary sources, under Apache 2.0, but it serves one model, runs offline only and was never benchmarked head-to-head against vLLM on the same hardware.

llm-d 1.0 · Oct 20 · GA · figures self-reportedDeepInfer · Oct 20 (secondary) · one model, offline only

Module 04, serving and tools →

Licence terms and export rules, not weights, set who can use these models

The Muse Model License requires a separate agreement above $20M of gross revenue in 12 months for model-as-a-service sellers, about $1.7M a month ($20M / 12). China's Announcement No. 48 of Oct 16 proposes 40 technologies for its export catalogue; it is a draft with comments to Nov 15, while registration of listed exports has been in effect since Oct 16.

Muse Model License · Oct 15 · in effectAnnouncement No. 48 · Oct 16 · draftRegistration · from Oct 16 · in effect

Module 05, licences and compliance →

The community argued about a reference engine and about maintainer load

A Hacker News snapshot of the DeepInfer thread shows 2,330 points and 887 comments, crawl date not stated, and the engine needs SM100 or Ascend 950 hardware with weights of about 510 GB. The Linux Foundation survey of Oct 20 reports respondent estimates that 25% of incoming pull requests are “AI slop” (31% at large projects), and only 35% of projects have a formal policy permitting GenAI use.

HN thread · 2,330 points · crawl date not statedLinux Foundation · Oct 20 · respondent estimates

Module 06, community →

Projects at a glance

Project	Type	What changed	Licence (as stated)	Status (Oct 24)	Source
opencode (anomalyco)	Terminal coding agent	219,400 stars; snapshot date not stated	Not stated	ReportedDesktop app in beta	CoddyKit
Graphify (Graphify-Labs)	Code knowledge graph	129,751 stars on Oct 20 (inferred)	Listed only as “Open Source”	Reported	CoddyKit
Omnara	Durable-agent runtime	Open-source launch, Oct 21	Not stated	Launched	Show HN; Emergent
Nemotron 3.5 Parse (NVIDIA)	Document-parsing model	Released Oct 17; ParseBench mean 75.20 (NVIDIA-run)	OpenMDW-1.1; tokenizer MIT	Weights on HF	NVIDIA card
Nemotron 3.5 Bolt E4B (NVIDIA)	Small language model	Released Oct 23; 8B total, about 4B effective	OpenMDW-1.1	Weights on HFSecondary source	explainx
Muse Spark Open (Meta)	Open-weight model	Published Oct 15 (pre-window); 816B / 42B active	Muse Model License; $20M trigger	Weights, gated	miraflow; ibl
llm-d 1.0 (Red Hat, IBM, Google)	Inference orchestration layer	First stable release, Oct 20	Apache 2.0	GA	MarkTechPost; AICoder
DeepInfer (DeepSeek)	Inference engine	Open-sourced, dated Oct 20 by secondary sources	Apache 2.0	ShippingOne model, offline only	Thaki Cloud; Developers Digest

How to read the status labels

Window eventGADated Oct 17 to Oct 23 (or generally available) and judged against Oct 24, 2026.

Pre-windowSnapshotPre-window items are dated before Oct 17. A snapshot is a count taken on a stated date, or on an unstated one.

ReportedSelf-reportedReported means a press or aggregator claim. Self-reported means a vendor, project or adopter measured it.

DraftEstimateUnverifiedDrafts are not final; estimates come from survey respondents; unverified means second-hand.

02Trending projects

Stars show attention and forks show use, and no source gives a weekly gain

Every star count comes from a trending-list blog, so it is discovery data (“according to X”), a dated snapshot and not a weekly gain. Counts from different pages are never compared; read each row against its own source only.

Star snapshots at a glance

Item (maintainer, type)	Key figure	Snapshot date	Status	Source
anomalyco/opencode, terminal coding agent	219,400 stars; 29,300 forks	Not stated	ReportedDesktop app in beta	CoddyKit
Graphify-Labs/graphify, code knowledge graph	129,751 stars; 12,494 forks	Oct 20 (inferred)	Reported	CoddyKit
vllm-project/vllm, inference engine	94,304 stars; 23,649 forks	Oct 20 (inferred)	Reported	CoddyKit
sickn33/agentic-awesome-skills, skills catalogue	48,052 stars; 7,012 forks; 2,715+ skills	Oct 20 (inferred)	Reported	CoddyKit
wshobson/agents, plugin marketplace	41,320 stars; 4,396 forks	Not stated (after Oct 20)	Reported	CoddyKit
OpenClaw (MIT) / Hermes Agent, Nous Research (MIT)	392,126 / 254,122 stars	Oct 16 (GitHub API read), before the window	Reported	Glukhov
n8n / Dify / LangGraph, workflow and agent frameworks	208,240 / 159,167 / 43,675 stars	Not stated (article dated Oct 22)	Reported	Activepieces, citing GitHub
Omnara (omnara-ai), durable agent runtime	Open-source launch; licence not stated	Oct 21	Launched	Founder's Show HN; Emergent

No weekly growth: no source here gives two snapshots of the same repository, so no weekly star growth can be computed (Glukhov makes the same point: a delta needs two snapshots of your own). CoddyKit lists Graphify's licence only as “Open Source”; licence and latest release are not given for opencode, vLLM or wshobson/agents.

Fork ratio, CoddyKit's Oct 20 page

Forks ÷ stars (inferred snapshot): vLLM has fewer stars than Graphify but a fork ratio 2.6 times higher (25.1% ÷ 9.6%). This is our reading, since forks also include bookmarking. Even so, it is a reason not to rank projects by stars alone.

Two skills lists disagree

Repository	HackerNoon (Oct 21; as of 2026-10-17, approx.)	KDnuggets (Oct 21; count date not stated)
Superpowers	301k	285.5K
Matt Pocock's skills	295k	260.1K
ECC	283k	256.7K
Addy Osmani's Agent Skills	108k	93.6K

5% to 13% lower: for example (295 − 260.1) ÷ 295 ≈ 12%. A fall of that size is implausible within days, so the two lists probably use different methods or dates. We follow HackerNoon's dated list for the big four, as approximate, and recommend checking GitHub directly. HackerNoon's smaller entries match CoddyKit: 48k for agentic-awesome-skills and 41k for wshobson/agents.

The projects behind the numbers

opencode Reported

A terminal coding agent with a read-only “plan” agent and a full-access “build” agent, installable through npm, Homebrew, pacman, mise or Nix. Its README is in 24 languages and it has 20,677 commits. LLM Daily (Oct 20) says it gained over 1,300 stars in a single day: one newsletter's claim, not a GitHub figure.

Graphify Self-reported claims

Builds a queryable graph of a codebase by deterministic tree-sitter parsing across 40+ languages; it runs locally and installs hooks in Claude Code and Gemini CLI. The page quotes an 80% cut in agent token spend and, on the LOCOMO benchmark (n=300), recall@10 of 0.497 against 0.048 for mem0. It does not say who ran either test, so both are unverified project-side claims.

vLLM Reported

Returned to the list with disaggregated prefill/decode and 200+ model architectures. Licence and latest release are not given on the list page. Its role in the serving layer and its download counts are in module 04.

Judgement: the week's attention is in the layer around the model: harnesses, skills, memory and runtimes. The engine in the list, vLLM, is the one that people clearly build on. Pick by licence and fork activity, and treat any number here as a lead to check on GitHub.

Omnara, the window's one dated launch Launched Oct 21

Kartik of Omnara wrote that it is an open-source API for running durable agents. One API call creates an agent, which gets sandboxes, secrets, permissions and RBAC. State lives in Postgres, so agents survive restarts and “cost nothing while idle”. He positions it as a self-hosted counterpart to Anthropic's Claude Managed Agents and the OpenAI Agents API. Emergent dates the launch to Oct 21, 2026 (secondary).

What is missing Not run by reviewers

Activepieces (Oct 22) notes that the blog gives no price, speed figure or licence text, that the repository shows 282 branches and 162 tags, and that its authors had not run it. It advises pinning a tag. Directory sites list rivals: Paperclip (MIT), Multica, NemoClaw and Omnigent, and starnet, an MIT desktop runtime last verified Oct 23. Module 06 captures no discussion of it.

Techninjaah counted these on Oct 18 and says all were created after mid-August 2026. Counts are page snapshots from one list.

Repo	Type	Stars (Oct 18)	Licence
browser-use/jev-ultrafast	Browser agent	23.2k	MIT
wheresryan22/anatomy	Claude Code skill	15.5k	MIT
yetone/magpie	Model gateway for coding agents	15.4k	MIT
jub0t/Concat	Video editor with MCP server (beta)	8.6k	AGPL-3.0
CopilotKit/OpenBot	Self-hosted agent template (alpha)	6.6k	MIT
Louis-CFM/coucou	Agent monitor	5.5k	MIT
tigerless-labs/agent-memory	Markdown memory (v0.1)	4.2k	MIT

OpenBot also needs a CopilotKit Intelligence licence (a free plan exists). Licences are as stated by the projects.

Coding-agent bundles Reported

wshobson/agents bundles 94 plugins, 202 agents and 185 skills from one Markdown source for seven coding agents (41,320 stars, date not stated, after Oct 20). KDnuggets describes ECC as 292 skills, 68 agents and 94 command shims, installed with a versioned package; the release date is not stated.

General frameworks and personal agents Reported

Activepieces (Oct 22) cites GitHub for n8n at 208,240 stars, Dify at 159,167 and LangGraph at 43,675 (snapshot date not stated). Hermes Agent and OpenClaw are the personal-agent leaders at 254,122 and 392,126 on Oct 16. Firecrawl (AGPL-3.0) is at 191,908 and AutoGPT at 187,598, whose mixed MIT and Polyform Shield licence is covered in module 05.

03New open models

NVIDIA shipped a ladder, Meta shipped the biggest weights, and every benchmark is vendor-run

The weights that developers can actually download came mostly from two vendors, NVIDIA and Meta, with Reflection AI and KRAFTON adding smaller entries. Parse (Oct 17) and Bolt E4B (Oct 23) are window events; the Oct 15 and 16 releases are pre-window but drove the week's coverage.

The week's open-weight releases

Item	Key figure	Date	Status	Source
NVIDIA Nemotron 3.5 Super VL	120B total / 12B active, 1M context; OpenMDW-1.1	Oct 15 (date per Shattered)	Pre-windowWeights on HF	NVIDIA card; Shattered
NVIDIA Nemotron 3.5 Bolt 74B-A9B	74B / 9B active, 256K, 24 GB 2-bit build	Oct 15	Pre-windowWeights on HF	NVIDIA card
NVIDIA Nemotron 3.5 Bolt E4B	8B total, about 4B effective, Q4_K_M	Oct 23	WindowWeights on HF (secondary)	explainx
NVIDIA Dory1.0-4B	4B, 256K, 1 / 2 / 4 loops	Oct 16	Pre-windowWeights on HF	NVIDIA card
NVIDIA Nemotron 3.5 Parse	ParseBench mean 75.20 (NVIDIA-run)	Oct 17	WindowWeights on HF	NVIDIA card
Meta Muse Spark Open	816B / 42B active, 1M, Muse Model License	Oct 15	Pre-windowWeights (gated)	miraflow
Reflection AI Beam	501B / 23B active, Apache 2.0	Oct 16	Pre-windowReported	Shattered
KRAFTON Raon-1 mini preview	28.8B / 4.3B active, Apache 2.0	Not stated	Preview	KRAFTON card

The ladder: NVIDIA shipped five Nemotron 3.5-family open-weight releases between October 15 and 23, all under the OpenMDW License Agreement 1.1, while Meta released the largest weights of the week (816B) at a size few teams can host. Every benchmark here is vendor-run.

Dory1.0-4B: SWE-bench Verified by loop count

NVIDIA-run: the step from 1 to 2 loops adds 9.2 points, 80% of the 11.5-point total (9.2 / 11.5), so 2 loops is the practical setting. Knowledge is the cost: AA-Omniscience stays near 10 at every loop count, versus 15 to 21 for the rivals. vLLM and llama.cpp support was still an open pull request on the card. According to LLM Explorer, the BF16 repo had 3,062 downloads (snapshot date not stated; page “Updated 2026-10-21”).

NVIDIA, model by model

Super VL (120B / 12B active)

Up to 1M tokens; needs 4x H100 or 2x GB200. In NVIDIA's own table it trails DeepSeek-V4-Flash0731 on all four rows compared: GPQA-Diamond 89.52 vs 89.6, SWE-bench Verified 71.10 vs 75.4, BrowseComp 78 vs 84.2 and GDPval-AA v2 1211 vs 1382.

Bolt 74B-A9B

The local-agent model, compressed from Super VL with NVIDIA's Star Elastic method. The BF16 build beats Qwen3.6-35B-A3B on Terminal-Bench 2.1 (53.93 vs 44.38) and BrowseComp (70.00 vs 48.74). On MCP-Atlas NVIDIA measured 51.2 for Qwen against a published 62.8, and Bolt scores 55.60, so treat that row as setup-dependent. At 2 bits, 74B would take 74 x 2 / 8 = 18.5 GB, but only routed-expert weights are 2-bit, so 24 GB is a budget.

Bolt E4B and Parse

Bolt E4B (Oct 23) is a post-train of Gemma 4 E4B-it, labelled “4GB” although its Q4_K_M file is about 6.2 GB (explainx); Tau2-Bench 52.32 vs 38.72 for the Gemma base, but RULER 64K of 85.76 vs 95.37 for Qwen3.5 4B. Parse (Oct 17) scores a 75.20 ParseBench mean on 2,078 pages, with a tokenizer under MIT.

Meta, Reflection, KRAFTON and the community

What Meta published Pre-windowGated

Published Oct 15: 816B total, 42B active, 1M-token context, BF16 and NVFP4 weights. Meta calls it the most capable US open-weight model, per miraflow. The licence is the Muse Model License, which is not Apache 2.0 and carries a $20M revenue trigger for model-as-a-service businesses (terms in module 05).

Benchmarks are Meta's Self-reported

The Artificial Analysis index figure of 39 is Meta-reported and VentureBeat found no independent listing at launch, against 45 for GLM 5.3 and 44 for Kimi K3. Meta leads on MCP-Atlas (89.2) and trails Kimi K3 on Terminal-Bench 2.1 (76.4 vs 85.0). Simplismart's “#1 US open model” headline rests on that same vendor-reported table, and Simplismart sells inference for it.

Hardware

The NVFP4 checkpoint is about 530 GB, and two 512 GB Mac Studios give 2 x 512 = 1,024 GB. Add a 1M-token KV cache of 64 GiB (about 69 GB) and the total is roughly 600 GB, which fits. Another source gives 266 GB, which equals 248 GiB, the full-attention figure; we follow 64 GiB. Neither is first-party. The BF16 checkpoint is about 1.5 to 1.65 TB.

Hosted price (checked Oct 18)

$1.25 input and $4.25 output per million tokens on OpenRouter and Together AI, with cached input at $0.15. A call of 20,000 input and 2,000 output tokens costs 0.025 + 0.0085 = $0.0335, about 30 calls per dollar. Simplismart cites an open-weight median of $0.43 / $1.59, so Muse is about 2.9x and 2.7x higher (1.25 / 0.43; 4.25 / 1.59).

What was reported Reported

According to Shattered, quoting the company, weights went live Oct 16 under Apache 2.0, with 501B total and 23B active parameters (23 / 501 = 4.6%), BF16, FP8 and NVFP4 formats and 40+ launch partners.

Why it stays “reported”

This is the only source in the material, an aggregator, and it has no benchmarks. Reflection says Beam's weights are “available across platforms, with open weights under the Apache 2.0 license” (via Shattered).

KRAFTON Raon-1 mini preview Preview

A 28.8B-total, 4.3B-active MoE with 262,144-token context under Apache 2.0, labelled a preview whose specs may change. Access is on request, the release date is not stated, and KRAFTON ran the benchmarks, including an internal Korean test that is not public.

DeepSeek-V4.1-Flash Not a window release

MIT licence; its release date is not stated in the material. Its size differs by source, 552B per Thaki Cloud and 763B on the Hugging Face card as quoted by DEV Community; we follow the card. Its engine, DeepInfer, is covered in module 04.

Chinese community highlights Anecdotal

The zh-ai-community October collection lists 11 entries, among them Qwen-Image-2.1-Turbo, MiniCPM-V 4.7, Step-5-Preview and Ling-3.1-flash, but gives no dates, sizes or licences. A newsletter anecdotally reports r/StableDiffusion users pairing Qwen Image 2.1 with Minimax H3 on 2026-10-19.

Datasets are the evidence gap

No Hugging Face dataset release dated 17 to 23 October appears in the material. The nearest items are ModelFit's CC BY 4.0 compatibility dataset (156 models, updated 2026-10-13, before the window), a daily Kaggle snapshot of Hub statistics, and NVIDIA's claim that Nemotron ships open data and recipes, with no dataset named.

04Serving and tools

llm-d 1.0 is the one GA release, and DeepInfer is a reference design, not a drop-in vLLM

In the window (Oct 17 to Oct 23, 2026) the serving layer produced one stable release, one narrow code drop and a run of vendor benchmarks, and none of the benchmarks was independent.

The week at a glance

Item	Key figure	Date	Status	Source
llm-d 1.0 (Red Hat, IBM, Google; Apache 2.0)	First stable release, v1 API	Oct 20	GAWindow event	MarkTechPost; AICoder
DeepInfer (DeepSeek; Apache 2.0)	One model, offline only	Oct 20	ShippingWindow event	Thaki Cloud; Developers Digest
vLLM and SGLang on TPU (Google, with Inferact and RadixArk)	Lowest cost 2.01 cents per million tokens	Oct 20	PreviewPreview customers	Google Developers Blog
AMD megakernel inference paths (MI355X)	1.9x to 3.3x faster single-request decode	Oct 20	ShippingGPT-OSS-120B is preview	AMD ROCm Blogs
MiniMax-M3.1 on MI350	Day-0 support, vLLM and ATOM	Oct 22	Shipping	AMD
Nunchux on MI355X (AMD-supported proof of concept)	23.2x faster finished 15 s video than SGLang	Oct 19	Proof of concept	AMD
LangChain, LangGraph, Microsoft Agent Framework	Latest releases Oct 13 to 16	Before window	ShippingNo window release found	Developers Digest

What sits behind each release

llm-d released version 1.0 at PyTorch Conference North America on Oct 20, 2026. It is a Kubernetes-native layer that sits above vLLM or SGLang and turns many model servers into one pool; it is not itself a model server. Red Hat, IBM and Google Cloud lead maintenance. The project has over 500 contributors from more than 25 organizations, joined the CNCF Sandbox on March 12, 2026, and is Apache 2.0 licensed (according to MarkTechPost).

What 1.0 adds: production operation

Priority- and fairness-aware flow control, so bursty agents cannot starve interactive users.
Router high availability with a hot standby, plus DisaggregatedSet, which rolls prefill and decode pools together.
A stable v1 configuration API.
Session-aware routing and Responses API state for agents.

Cache-aware routing, KV-cache offload and prefill/decode disaggregation already existed. The GitHub v1.0.0 notes admit that not every tracked goal shipped.

Numbers, all self-reported

>85%median TTFT down (Google, Ironwood TPU)

2.4xthroughput (Google)

~5.5agents per GPU: 3,000 ÷ 544 (IBM setup)

6.6Moutput tokens a minute, GLM 5.2 peak (Red Hat)

Claim (all self-reported)	Setup	Reported by
Median TTFT down more than 85%, throughput 2.4x	Agentic coding, Ironwood TPU, prefix routing plus host offload vs a plain Kubernetes Service	Google
Prefix-cache hit rate 35% to 70% (2.0x); TTFT down more than 35%	Gemini platform on GKE Inference Gateway	Google
Throughput 2.9x across 3 clusters, 99.9% success	17,000-node GKE benchmark	Google
Up to 3,000 concurrent agents on 544 H100s; ~98% prefix hits; ~$0.11 per million tokens; 11.5x cheaper than proprietary	IBM Research, open models	IBM
Up to 70% more tokens per second than standard vLLM	SageMaker HyperPod, with prefill/decode disaggregation	AWS

All figures come from the project and its adopters. MarkTechPost states that all figures are self-reported and AICoder adds that none is independent. Zenteiq's 4x claim checks out: 5.97 ÷ 1.47 ≈ 4.06. The Red Hat release adds that GLM 5.2 (about 753B parameters) was 5 to 10 times cheaper per token than commercial APIs at cloud rental rates (vendor-reported).

What it is Oct 20, secondary

DeepSeek open-sourced DeepInfer on Oct 20, 2026 (Thaki Cloud; the repository's release date is not stated in the material) under Apache 2.0, calling it the framework that powers its production services. It was built primarily on vLLM, with inspiration from SGLang and TensorRT-LLM. vLLM publicly thanked DeepSeek and said it will draw on DeepInfer's ideas (according to daily.dev). The name is easy to mix up: DeepInfra is a separate hosted-API company, and an unrelated medical-imaging project shares the name; one source mistakenly folds in its version 1.2, which we ignore.

Narrow by design

One modelonly DeepSeek-V4.1-Flash

SM100 / Ascend 950Hopper is dropped

Offline onlybatch mode, no HTTP server

No KV-cache systemalso no prefill/decode disaggregation or replica load balancing

Benchmark claims Vendor-reported

DeepSeek's own charts were measured on 4 SM100 GPUs for prefill and 64 for decode in one scale-up domain; the README's accuracy table (99.9% AIME 2026, 93.4% GPQA Diamond, 42.6% HLE-Full) is vendor-reported and “indicative rather than exact”. The charts include no run of vLLM or SGLang on the same hardware, so the DEV Community comparison says outright that it is not a benchmark. Trending Topics reports no concrete performance figures and no Ascend benchmarks. The one cost figure, about $38 revenue per GPU-hour (off-peak pricing) and 155 trillion tokens per day per cluster, comes from a paywalled Substack citing a DeepSeek Q&A; treat it as reported and unverified.

A reference design, not a replacement. For general serving, vLLM still offers an API server and a wide model list, and its Ascend guide for V4.1-Flash needs an upstream revision from Sept 11, 2026 or later.

All of AMD's window results are vendor-run or vendor-supported, and each compares against a baseline of the vendor's choosing. On Oct 20 AMD open-sourced optimized paths for Qwen3.8-27B, Qwen3.8-Flash-Next and GPT-OSS-120B on one MI355X, measured at batch 1 on GSM8K with speculative decoding. Throughput figures are for a single request, not a loaded server.

Model	Tokens/s	Speedup and baseline
Qwen3.8-27B	~1,100	2.0x ATOM regular path
Qwen3.8-Flash-Next	~750	3.3x ATOM regular path
GPT-OSS-120B (preview)	~1,470	1.9x fastest stock vLLM tested; 1.6x with the same drafter

AMD ROCm Blogs. The implied GPT-OSS baseline is 1,470 ÷ 1.9 ≈ 770 tokens/s.

AMD, Oct 19 to 22 Vendor-supported

AMD also gave Day-0 MiniMax-M3.1 support on MI350 on Oct 22, with “mono decode” cutting per-token latency 3.2x at one request but only 1.5x at sixteen versus the same server with it off. The gain shrinks as concurrency rises. Nunchux's 15-second video went from 150.5 s to 6.49 s (150.5 ÷ 6.49 ≈ 23.2x), and it reported 18.5% to 19.4% lower generation latency than NVIDIA's separately published B300 results, with MP4 encoding excluded.

Google TPU, Oct 20 Preview

Google launched PyTorch-native vLLM and SGLang backends on TPU via TorchTPU, developed with Inferact and RadixArk; both run at preview customers, and Meta says SGLang-TorchTPU runs in production. Google reports 2.01 cents per million tokens for Qwen 3.5 on Ironwood, submitted to SemiAnalysis InferenceX, but gives no baseline or setup in the material.

Engine comparisons Reported

According to Modern DataTools (as of Oct 19), vLLM, SGLang and TensorRT-LLM are all Apache-2.0. Weekly PyPI downloads were 423.8k for vLLM and 199.2k for SGLang; TensorRT-LLM's 2.7k is not comparable because it ships differently. Modular's claim of 5.5x over vLLM on Kimi K2.5 dates from May 18 and has no published harness. An Oct 18 SEO post repeating a 2024 paper's 3 to 4x SGLang TTFT win adds nothing new.

Agent frameworks No window release

The material shows no in-window release. As of Oct 18, LangChain Python 1.4.6 (Oct 14) and TypeScript 1.5.18 (Oct 16), LangGraph 1.2.16 (Oct 16) and Microsoft Agent Framework Python 1.22.0 (Oct 15) were current, all MIT. A CrewAI “past version 1.15” claim has no date.

!llm-d 1.0 is the week's one GA infrastructure release: a stable API and day-2 features for self-hosted agent serving. Its numbers are all vendor or adopter measurements.

05Licences and compliance

Terms and export rules, not weights, decide who can use these models

Most licence events fall on Oct 15 to 17, so each row carries its own date. Licences are shown as stated by the projects, and a licence name does not settle openness. This is a description, not legal advice.

Licence terms in the week's releases

Item	Key figure (licence as stated)	Date	Status	Source
Meta Muse Spark Open, Muse Model License	$20M revenue trigger for model-as-a-service; attribution	Oct 15 (before window)	In effect	ibl; Zentor
Reflection Beam	Apache 2.0; 501B total / 23B active	Oct 16 (before window)	In effectReported	Shattered, quoting Reflection
NVIDIA Nemotron 3.5 Parse	OpenMDW-1.1; tokenizer MIT	Oct 17 (window)	In effect	Hugging Face card
DeepSeek DeepInfer	Apache 2.0	Oct 20 (window)	In effect	Thaki Cloud
AutoGPT	MIT, plus Polyform Shield in autogpt_platform	Snapshot Oct 16; split date not stated	In effect	Glukhov
China Announcement No. 48	40 technologies, 23 in AI	Oct 16 (before window)	DraftRegistration in effect	CellCog; Mean CEO

The terms and rules in detail

Three terms matter In effect, Oct 15

Licensees must display “Built with Muse Spark Open”.
If a licensee or affiliate sells third parties access to AI models and aggregate gross revenue “exceeds twenty (20) million US dollars” in any consecutive 12 months, it must notify Meta and sign a separate agreement.
A usage policy bars illegal activity, malware and military or weapons use.

Zentor adds that internal use and non-model-as-a-service products are excluded; ibl's headline paraphrases the trigger more loosely (“an AI-model product”), and we follow the narrower body text.

The arithmetic

$20Mgross revenue in any consecutive 12 months

~$1.7Ma month ($20M ÷ 12)

700 millionmonthly active users: the different trigger of Llama 3.3

The clause bites hosts and API resellers, not application builders. Either way, the grant is conditional.

Permissive releases

Reflection says Beam's weights are “available across platforms, with open weights under the Apache 2.0 license” (via Shattered, an aggregator). NVIDIA's cards state OpenMDW-1.1. DeepSeek's DeepInfer engine is Apache 2.0, released Oct 20, according to Thaki Cloud. A licence name does not settle openness: the OSI's Open Source AI Definition (published Oct 28, 2024) also asks for training code and data information.

Landscape and relicensing

According to GEO Toolbox, verified Sep 7 and so not re-checked in the window, GLM-5.3 ships under a custom licence while GLM-5.2 was MIT (only GLM-5.3-Flash stayed MIT) and Kimi K3 uses a custom Kimi K3 License. The date of the GLM switch is not stated. For venture-funded relicensing, the only case is AutoGPT: MIT outside autogpt_platform, Polyform Shield inside, which “permits use but reserves the code's commercial value to the producer” (blog snapshot Oct 16). No relicensing event dated Oct 17 to 23 appears in the material.

On Oct 16 China's Ministry of Commerce (MOFCOM) and Ministry of Science and Technology (MOST) published Announcement No. 48, one day before the window. We have it only through secondary coverage, not the official text.

40 technologies Draft

AI 23 + solar 12 + biomedicine 5

= 40 proposed for the export catalogue

14 banned, 26 restricted Reported

14 + 26 = 40

split of the proposed technologies

Comments close Nov 15 Upcoming

22 days

after Oct 24. Registration of listed exports has been in effect since Oct 16

Thresholds Reported, CellCog

A large model's core technology (weights, checkpoints, code, training methods) is restricted if it meets any one test: 10^26 training FLOPs, 2 trillion parameters, or a global top-10 rank. Agents have separate tests: chains of 20 or more steps, 60 or more agents, or 200 or more tools at 90% success. Other outlets confirm the model tests. The announcement names no models. AP (via Mean CEO) and Bloomberg (via theCUBE) both cite Kimi K3 and Qwen3.8-Max as examples. GEO Toolbox puts K3 at 2.8T parameters, so 2.8 ÷ 2 = 1.4x the line.

Using versus moving a model

The draft separates using a Chinese model from moving it: already-public weights, APIs, apps, SaaS and on-device use are outside, while overseas deployment of a restricted model is an export and future open-sourcing needs a filing. MOFCOM's Q&A says open-sourcing qualifies for automatic licensing, “report and export immediately”. Dean W. Ball, quoted by The Decoder (via Developers Digest), calls this “the optionality to shut down future open-weight models at will”. Because the top-10 test is judged at export time, theCUBE argues, it tightens as models improve; that is commentary, not draft text.

Exposure, September traffic Reported

Per Vercel's AI Gateway index (via Mean CEO): open-weight models carried 71.5% of tokens and about 23% of spend. DeepSeek, Z.ai and Moonshot held 58%, 7.2% and 3.6% of tokens, so 58 + 7.2 + 3.6 = 68.8%. Their spend shares (6.6 + 4.5 + 13.2 = 24.3%) exceed the 23% total, so treat the spend figures as approximate.

EU position: nothing changed in the window

Regulation (EU) 2026/1744 (the Digital Omnibus on AI) was adopted Jul 8, published Jul 24 and in force Jul 27, 2026. General-purpose AI duties have applied since Aug 2, 2025, and Article 50 transparency duties since Aug 2, 2026, including for open source. Upcoming Dec 2, 2026 (39 days away) brings two new bans and marking for earlier systems, then Dec 2, 2027 for Annex III high-risk systems and Aug 2, 2028 for Annex I products. A client alert dated Oct 19 cites the one open-source carve-out: Article 25(4) contracts exempt certain free and open-source inputs. Fines reach EUR 35M or 7% of turnover for prohibited practices and EUR 15M or 3% for other breaches.

Enterprise positions Reported, not binding

Microsoft told customers on Oct 19 to treat AI agents as potential “insider threats” (TechCrunch, via LLM Daily). Anthropic's Guillaume Princen said on Oct 14, before the window, that open models carry “more risk” by definition, though Anthropic does not seek a ban (via Shattered, citing Bloomberg).

For builders, nothing running today breaks. The risk is supply: licence terms like Muse's can reprice a business, and Beijing's draft can delay the next Chinese frontier release.

06Community

The loudest thread was about a reference engine, and the best data was about maintainer load

Everything below is anecdotal or self-reported unless marked otherwise. Counts are page snapshots, and a snapshot taken at one time is not comparable with one taken at another. The material contains no Reddit thread.

Discussion map

Item	Key figure	Date	Status	Source
Hacker News thread “DeepInfer: High-performance inference framework for DeepSeek models”	2,330 points, 887 comments	Snapshot shown as “2 days ago”; crawl date not stated	ReportedPage snapshot	Hacker News
Same thread, other snapshots	686 points / 239 comments; over 2,100 / 800; over 2,200 points	First undated; last two Oct 21	ReportedNot comparable with each other	PromptZone; Developers Digest; DEV Community
Google Trends, “deepinfer” vs “vllm” vs “sglang”	23 vs 13 vs 4 (index)	Oct 21	ReportedOne blogger's reading	Developers Digest
Quoted DeepSeek serving economics	155 trillion tokens/day per cluster; $38 per card-hour (off-peak)	Date not stated	UnverifiedSecond-hand	HN comment; Wukong Substack
Linux Foundation Research maintainer survey	25% of incoming PRs “AI slop”; 31% at large projects	Oct 20	EstimateRespondent estimates	Linux Foundation
Same survey, contribution volume	59% of maintainers report growth; 69% at large projects	Oct 20	EstimateRespondent estimates	Linux Foundation
Same survey, policy	35% of projects have a formal policy permitting GenAI use; 32% have none and no plan	Oct 20	EstimateRespondent estimates	Linux Foundation
Single-developer llama.cpp tuning	2.24x faster generation (Qwen3.5-4B); about 59 tokens/s (Gemma 4 E2B)	Date not stated	Author's own runOne GTX 1650 Ti	Towards AI

Linux Foundation survey, Oct 20 (respondent estimates)

Share of respondents' estimate, %: the survey gives no sample size or field dates (Superpower Daily), and the figures are not timed tests. Large projects report more contributions and more noise.

The cost sits with reviewers

The 52% saving on writing code sits beside a 25% noise rate on reviewing it. Writing time is cheap and reviewing time is not, so maintainers carry the cost.

52%less time on code authoring (estimate)

19%less time on proposal discussions (estimate)

21%say high-complexity tasks took longer (estimate)

25%of incoming pull requests are low-quality (estimate)

What people argued about

The loudest thread was Hacker News's reaction to DeepSeek's DeepInfer release, dated Oct 20 by Thaki Cloud and by a DEV Community post. Module 04 owns the engine facts; this tab covers what people argued about.

Argument one: game changer or vLLM fork?

DeepSeek's README says the engine was built mainly on vLLM, with ideas from SGLang and TensorRT-LLM. Commenter Tepix asked why a vLLM-based project deserves the label. Commenter cmrdporcupine replied that vLLM and SGLang can already serve V4.1 Flash on broader hardware, “less efficiently, I'm sure”. A DEV Community comparison reached a similar view without running a benchmark: DeepInfer is offline-only, supports one model and lacks a KV cache system, so it is “not a drop-in replacement”. Nobody in the material ran a same-hardware head-to-head.

Argument two: what the economics prove

One top comment quoted a Zhihu post: 155 trillion tokens/day per cluster and $38 revenue per card-hour. Replies split. One said it undercuts the claim that inference loses money; another noted that inference had long looked profitable because 20+ providers sell DeepSeek or GLM on OpenRouter. A Substack author repeats the figures as DeepSeek's “official” Q&A, but we found no primary page, so they stay unverified. One commenter put B200 rental at “~$6-14/hour”: over the 64-GPU decode setup that is 64 x $6 = $384 to 64 x $14 = $896 per hour. We do not set this against the $38 figure, because the card types are not stated.

Model comparisons stayed anecdotal Anecdotal

A sub-thread compared DeepSeek V4.1 Flash with Claude Haiku 5.5. One user said Flash cannot be trusted unsupervised as an agent. Another cited Artificial Analysis for similar intelligence scores but faster time-to-first-token for Flash, and added “on one set of private benchmarks” as a caveat. Developers Digest also reported a hardware question that nobody answered: what an Ascend 950 costs.

The takeaway: the week's largest thread was not about a benchmark, because none was published. It was about whether a model team's own serving stack is a reference to study or a product to run.

The primary-source data Respondent estimates

LF Research published Navigating Open Source Software Development in the Generative AI Era on Oct 20, 2026, sponsored by Red Hat and presented at All Things Open (Oct 19–20). All figures are respondent estimates: 71% agree GenAI lowers barriers to entry, yet 53% disagree that it improved community trust.

Governance

35%of projects have a policy permitting GenAI use

32%have none and no plans

61%of contributors fully review and test AI code before submitting

71% / 53%barriers lower / trust not improved

Two cautions

The release says “up to 50%” in its summary but gives 52% for code authoring in the body, and we follow the body. Superpower Daily notes the announcement gives no sample size or field dates, and that the figures are not timed tests. The PR Newswire copy is identical to the LF release.

A maintainer's voice Date not stated

According to tech-insider, curl maintainer Daniel Stenberg said maintainers feel “strained, overloaded and brought to the brink”; the quote's date is not stated. The survey's own recommendation is written contribution policies and contributor-side testing and disclosure.

Most readers cannot run DeepInfer Single author

A DEV Community author wrote that it needs SM100 (datacenter Blackwell) or Ascend 950, and the weights are about 510 GB. An RTX 5090 reports SM120. The realistic local route is a quantized build in llama.cpp, Ollama or LM Studio. An unofficial SM80 port (HalfVulpes/Deepinfer-SM80) appeared in the thread but is untested and does not shrink the weights.

A 4 GB laptop GPU Author's own run

One author measured a GTX 1650 Ti (4 GB) with llama.cpp. Placing all layers on the GPU made Qwen3.5-4B 2.24x and Qwen3-4B 2.07x faster, and Gemma 4 E2B reached about 59 tokens/s. This is a single machine and a single author.

A VRAM rule of thumb Guide undated

A hardware guide gives about 0.6 GB of VRAM per billion parameters at 4-bit. For a 70B model that is 70 x 0.6 = 42 GB, close to the guide's “about 40 GB” and above a single 24 GB RTX 4090.

No single best model Verified May 2026

StationX's October guide declines to name a best local model and advises matching the model to the task. Its benchmark map was last verified in May 2026.

For a solo developer the practical lesson from the DeepInfer thread was negative: the release changed what can be studied, not what can be run at home. Start from VRAM and a quantized model rather than from the week's headline engine.

07Getting started

Read the licence, check the hardware, then trust a benchmark

A try-list by use case, a reader-by-reader view of what changed and what to do, and a dated watch-list. It uses only facts from earlier modules and is not legal advice.

Try-list by use case

Use case	Option	Licence (as stated)	Caveat
Serve agents on Kubernetes	llm-d 1.0, GA Oct 20	Apache 2.0	All latency and throughput figures are self-reported by Google, IBM, AWS or Red Hat
Study a production serving stack	DeepInfer, dated Oct 20	Apache 2.0	One model (DeepSeek-V4.1-Flash), offline only, SM100 or Ascend 950; no same-hardware vLLM comparison
Run models at home	A quantized build in llama.cpp, Ollama or LM Studio	Per model	About 0.6 GB of VRAM per billion parameters at 4-bit, so 70B needs about 42 GB (70 x 0.6); guide undated
Agents	Omnara (launched Oct 21); LangGraph 1.2.16 (Oct 16)	Omnara not stated; LangGraph MIT	Activepieces had not run Omnara and advises pinning a tag
Models	Nemotron 3.5 Bolt 74B-A9B; Dory1.0-4B	OpenMDW-1.1	The 24 GB build is a budget, not 74 x 2 / 8 = 18.5 GB; Dory's vLLM and llama.cpp support was an open pull request; benchmarks are NVIDIA-run
Models at scale	Muse Spark Open (816B / 42B active)	Muse Model License	$20M revenue trigger for model-as-a-service; NVFP4 checkpoint about 530 GB
Datasets	None dated Oct 17 to 23 in the material	CC BY 4.0 for ModelFit's compatibility dataset	ModelFit's dataset (156 models) was updated Oct 13, before the window

LF Research · Oct 20 · respondent estimates

!This week's releases changed what can be studied, licensed and governed more than what can be run at home: the biggest weights need hundreds of gigabytes, the biggest engine serves one model, and every performance number came from its own vendor.

Key dates

Dates already past on Oct 24, 2026 are marked “In effect”; later dates are “Upcoming”.

Date	Event	State on Oct 24, 2026	Source
Jul 27, 2026	EU Regulation 2026/1744 (Digital Omnibus on AI) in force	In effect	Vanderburgh
Aug 2, 2026	EU Article 50 transparency duties apply, including for open source	In effect	RAGSuite
Oct 15, 2026	Muse Spark Open and Nemotron 3.5 Super VL and Bolt 74B published	In effect	ibl; NVIDIA
Oct 16, 2026	China Announcement No. 48 published; registration of listed exports starts	In effectCatalogue is a draft	Mean CEO
Oct 17, 2026	Nemotron 3.5 Parse released	In effect	NVIDIA
Oct 20, 2026	llm-d 1.0 GA; DeepInfer open-sourced; LF Research survey published	In effect	AICoder; Thaki Cloud; Linux Foundation
Oct 21, 2026	Omnara open-source launch	In effect	Emergent
Oct 23, 2026	Nemotron 3.5 Bolt E4B released	In effect	explainx
Nov 15, 2026	Comments on Announcement No. 48 close (22 days away)	Upcoming	Mean CEO
Dec 2, 2026	EU two new bans and marking for earlier systems (39 days away)	Upcoming	Vanderburgh
Dec 2, 2027	EU Annex III high-risk rules	Upcoming	Vanderburgh
Aug 2, 2028	EU Annex I product rules	Upcoming	Vanderburgh

The practical order for a team: read the licence, check whether the hardware fits, and only then trust a benchmark. EU duties for earlier systems arrive on Dec 2, 2026, 39 days from Oct 24, so teams that ship to Europe should plan marking and transparency work now.