Saltar al contenido

[Presentación] IA de código abierto · Cubre del 2026-10-17 al 2026-10-2313 diapositivas · English

Open-Source AI Projects Weekly Brief · Oct 17–23, 2026

Generated with Divrite · Terminado el 23 de octubre de 2026

Instrucción original
Write the "Open-Source AI Projects" hot-topic report covering 2026-10-17 to 2026-10-23. Unit of coverage: the project — open-source models, inference frameworks, agent frameworks and datasets on GitHub and Hugging Face that grew fastest or had a major release this week, with star growth, licence and use case. Sections: 1. Trending projects of the week 2. New open models 3. Framework and tool updates 4. Licence and compliance changes 5. Community discussion hot spots 6. Getting started. Length: 10–12 slides. Key sources: GitHub Trending, Hugging Face, project release notes, Hacker News, Reddit. Cite every key number; leave out anything without a reliable source. Answer in English.

Este trabajo está en inglés. Pulsa «Hacer uno igual» y pregunta en tu idioma: Divrite volverá a investigar y escribir en el idioma en que preguntes.

Las 13 diapositivas

Portada de «Open-Source AI Projects Weekly Brief · Oct 17–23, 2026»
  1. Diapositiva 1

    Open-Source AI Projects Weekly Brief|Oct 17–23, 2026

    Notas del orador

    Welcome to the Open-Source AI Projects weekly brief from Divrite Research, covering October 17 to 23, 2026. This issue asks what actually changed in open-source AI this week, which claims hold up, and what a team should do about it. First, the contents.

    Texto de la diapositiva

    Open-Source AI Projects Weekly Brief

    Divrite Research · Hot Topics · Issue for Oct 17–23, 2026

    PUBLISHED BY

    Divrite Research

    DATE

    October 2026

  2. Diapositiva 2

    Contents

    Notas del orador

    The brief has five parts: the overview, projects and models, serving, licences and export, and community and dates. It moves from what happened to what you can act on. First, the overview.

    Texto de la diapositiva

    / 13

    Overview

    Attention moved around the model; benchmarks are vendor-run

    Projects and models

    Star leads, NVIDIA ladder and Muse

    Serving

    llm-d 1.0 and a narrow DeepInfer

    Licences and export

    Muse trigger, EU dates and a draft catalogue

    Community and dates

    Maintainer load and the dated watch-list

  3. Diapositiva 3

    Overview|Treat stars as leads and benchmarks as claims

    Notas del orador

    The main message is simple: treat stars as leads and benchmarks as claims. Attention went to the layer around the model. Star counts are snapshots, not growth; opencode shows 219,400 stars, reported by CoddyKit. The big Muse Spark Open weights, 816B total and 42B active, were published October 15, before the window, and every benchmark is vendor-run. llm-d 1.0 reached general availability on October 20, while licences and a draft export rule decide who can use these models. So verify stars on GitHub, read the licence first, and next we look at those star counts.

    Texto de la diapositiva

    Overview Treat stars as leads and benchmarks as claims

    Source: CoddyKit; MarkTechPost; AICoder; ibl.ai; Mean CEO; Linux Foundation; Hacker News

    What the week showed

    Stars are snapshots, not growth. Attention went to the layer around the model.

    Open weights landed before the window. Muse Spark Open, 816B total and 42B active, was published Oct 15; every benchmark is vendor-run.

    Serving gave one GA and one narrow drop. llm-d 1.0 reached GA on Oct 20; DeepInfer is a narrow code drop.

    Rules decide who can use the models. The Muse Model License has a $20M trigger, about $1.7M a month; Announcement No. 48 lists 40 technologies, with comments to Nov 15.

    The community argued about an engine and about load. A Hacker News thread hit 2,330 points; a Linux Foundation survey puts "AI slop" at 25% of pull requests (respondent estimates).

    Star counts

    219,400

    opencode stars (reported, CoddyKit)

    Graphify 129,751

    agentic-awesome-skills 48,052

    Consequence

    The week changed what can be studied, licensed and governed more than what can be run at home, and no performance number was independent.

    Next step

    Verify star counts on GitHub, read the licence first, and treat every benchmark as a vendor claim.

    De dónde salen las cifras
    【本页依据】 ① opencode 219,400 stars, Graphify 129,751 and agentic-awesome-skills 48,052 (reported, CoddyKit) —— GitHub Trending October 2026: From a 219K-Star Open Source Coding Agent to a 163K-Star AI Agency — 2 Repos That Prove the Agent Era Is Now an Industry · coddykit.com · https://www.coddykit.com/pages/blog-detail?id=5129998&slug=github-… Trending October 2026: From a 130K-Star Knowledge Graph to a 48K-Star Skills Catalog — 3 Repos That Prove AI Agents Need Memory Structures, Not Just Prompts · coddykit.com · https://www.coddykit.com/pages/blog-detail?id=5129996&slug=github-… ② Muse Spark Open, 816B total and 42B active, was published Oct 15, before the window —— Meta Muse Spark Open Explained: 816B Open-Weight MoE Benchmarks, Hardware Math and License (2026) · miraflow.ai · https://miraflow.ai/blog/meta-muse-spark-open-explained-benchmarks-har… ③ llm-d 1.0 reached GA on Oct 20; DeepInfer is a narrow code drop —— llm-d 1.0 ships: the Kubernetes-native open-source distributed inference stack led by Red Hat, IBM and Google hits production readiness, with vendors reporting 3,000 self-hosted coding agents at 5-10x lower cost than commercial APIs — AICoder · aicoder.com · https://aicoder.com/news/news-20261020-llm-d-1-0-kubernetes-native-dis… Opens Its In-House Inference Engine: DeepInfer and the ‘Model-Specialized Kernels + Ascend’ Strategy - Thaki Cloud Tech Blog ThakiCloud 다키클라우드 기술 블로그 · thakicloud.com · https://thakicloud.com/tech-blog/en/llmops/deepseek-deepinfer-open-sou… What DeepSeek Open-Sourced and What You Can Run · developersdigest.tech · https://www.developersdigest.tech/blog/deepinfer-deepseek-inference-fr… ④ Muse Model License has a $20M trigger, about $1.7M a month —— Meta's Muse Spark Open Is Open-Weight, Not Open Source. · ibl.ai · https://ibl.ai/blog/meta-muse-spark-open-weight-licence-self-host-real… ⑤ Announcement No. 48 lists 40 technologies, with comments to Nov 15 —— China AI Export Controls: 2T Models and Agents Listed | CellCog · cellcog.ai · https://cellcog.ai/blog/china-ai-export-controls;China AI Export Controls Draft (Announcement No. 48): 2 Trillion Parameter Models, Open-Source Exemption, API Access and What It Means for European Founders Using Kimi, Qwen and DeepSeek · mean.ceo · https://mean.ceo/tpost/china-ai-export-controls ⑥ A Hacker News thread hit 2,330 points; a Linux Foundation survey puts AI slop at 25% of pull requests (respondent estimates) —— DeepInfer: High-performance inference framework for DeepSeek models | Hacker News · news.ycombinator.com · https://news.ycombinator.com/item?id=50163277;New LF Research Survey Shows Generative AI Cuts Open Source Coding Time in Half, but 25% of Incoming Pull Requests are Considered AI Slop · linuxfoundation.org · https://www.linuxfoundation.org/press/new-lf-research-survey-shows-gen…
  4. Diapositiva 4

    Trending · Stars|Check forks: vLLM 25.1% against Graphify 9.6%

    Notas del orador

    Stars show attention, while forks show use, so ranking projects by stars alone misleads. In CoddyKit's October 20 snapshot, vLLM has fewer stars than Graphify, but its fork ratio is 25.1% against 9.6%, which is 2.6 times higher. Every count here is a dated snapshot from a trending-list blog, and no source gives two snapshots of one repository, so weekly growth cannot be computed. Two skills lists also disagree, with KDnuggets 5% to 13% lower than HackerNoon. The practical step is to pick by licence and fork activity, and check any count on GitHub. Now to the models, starting with NVIDIA.

    Texto de la diapositiva

    Trending · Stars Check forks: vLLM 25.1% against Graphify 9.6%

    Source: CoddyKit; HackerNoon; KDnuggets; Show HN; Emergent; Techninjaah

    Fork ratio: forks ÷ stars, CoddyKit Oct 20

    Read: vLLM has fewer stars than Graphify but a fork ratio 2.6 times higher (23,649 ÷ 94,304 against 12,494 ÷ 129,751)

    So: stars show attention and forks show use, so ranking projects by stars alone misleads

    What the counts say

    Dated snapshots: every star count comes from a trending-list blog; no source gives two snapshots of one repository, so weekly growth cannot be computed

    Lists disagree: HackerNoon (as of Oct 17) has Superpowers 301k and ECC 283k; KDnuggets has 285.5K and 256.7K, 5% to 13% lower

    One dated launch: Omnara, an open-source durable-agent runtime, on Oct 21 (secondary date)

    Small repos, Oct 18: led by jev-ultrafast at 23.2k stars

    Next step

    Pick by licence and fork activity, and check any count on GitHub before citing it

    De dónde salen las cifras
    【本页依据】 ① Fork ratio: Graphify 9.6%, agentic-awesome-skills 14.6%, vLLM 25.1% (CoddyKit, Oct 20) —— GitHub Trending October 2026: From a 130K-Star Knowledge Graph to a 48K-Star Skills Catalog — 3 Repos That Prove AI Agents Need Memory Structures, Not Just Prompts · coddykit.com · https://www.coddykit.com/pages/blog-detail?id=5129996&slug=github-… ② vLLM has fewer stars than Graphify but a fork ratio 2.6 times higher (23,649 / 94,304 against 12,494 / 129,751) —— Same as ① ③ No source gives two snapshots of one repository, so weekly growth cannot be computed —— Trending Open Source AI Projects on GitHub, October 2026 - Rost Glukhov | AI Systems & Infrastructure · glukhov.org · https://www.glukhov.org/developer-tools/comparisons/trending-open-sour… ④ HackerNoon (as of Oct 17) has Superpowers 301k and ECC 283k; KDnuggets has 285.5K and 256.7K, 5% to 13% lower —— Awesome Agent Skills: 49 Skills for Better AI-Assisted Coding · hackernoon.com · https://hackernoon.com/awesome-agent-skills-49-skills-for-better-ai-as… Best GitHub Repositories for AI Agent Skills - KDnuggets · kdnuggets.com · https://www.kdnuggets.com/5-best-github-repositories-for-ai-agent-skills ⑤ Omnara, an open-source durable-agent runtime, launched Oct 21 (secondary date) —— Show HN: Omnara – Open-Source Alternative to Claude Managed Agents | Hacker News · news.ycombinator.com · https://news.ycombinator.com/item?id=50183892;Omnara Launches Open-Source Alternative to Claude Agents · emergent.sh · https://emergent.sh/news/omnara-launches-open-source-alternative ⑥ Small repos on Oct 18 led by jev-ultrafast at 23.2k stars —— 8 Trending GitHub Repos for AI Developers (October 2026) · techninjaah.substack.com · https://techninjaah.substack.com/p/8-trending-github-repos-for-ai-deve…
  5. Diapositiva 5

    Models · NVIDIA|Run Dory at 2 loops; NVIDIA scores are claims

    Notas del orador

    NVIDIA shipped five Nemotron 3.5-family open-weight releases between October 15 and October 23, all under OpenMDW-1.1, and every benchmark table is NVIDIA-run. The one to try is Dory1.0-4B. On SWE-bench Verified it scores 50.3, 59.5 and 61.8 at one, two and four loops, against 54.7 for Qwen3.5-4B. The step from one to two loops adds 9.2 of the 11.5 points, so two loops is the practical setting. The cost is knowledge, since AA-Omniscience stays near 10 against 15 to 21 for rivals. Test it on your own tasks, then ask for independent runs. Next is Meta, where the issue is price.

    Texto de la diapositiva

    Models · NVIDIA Run Dory at 2 loops; NVIDIA scores are claims

    Source: NVIDIA card; explainx.ai; shattered.io; LLM Explorer

    What NVIDIA shipped

    Five releases: Nemotron 3.5-family open weights, Oct 15 to Oct 23, all under OpenMDW-1.1

    Window events: Parse (Oct 17, ParseBench mean 75.20) and Bolt E4B (Oct 23)

    Dory1.0-4B (Oct 16) reuses one block 1, 2 or 4 times

    What the tables claim (all NVIDIA-run)

    Dory: AA-Omniscience stays near 10, against 15 to 21 for rivals

    Bolt 74B-A9B: Terminal-Bench 2.1 53.93 against 44.38; its 24 GB build is a budget, not 74 x 2 / 8 = 18.5 GB

    What it costs

    Two loops capture most of Dory's gain, and the cost is knowledge; vLLM and llama.cpp support was still an open pull request

    SWE-bench Verified, NVIDIA-run

    Read: 2 loops (59.5) beat Qwen3.5-4B (54.7); only 4 loops (61.8) pass Qwen3.5-9B (61.0)

    80 %

    of Dory's 11.5-point gain comes from the step from 1 to 2 loops (9.2 points)

    Next step

    Test Dory at 2 loops on your own tasks and ask for independent runs before relying on the tables

    De dónde salen las cifras
    【本页依据】 ① NVIDIA shipped five Nemotron 3.5-family open-weight releases, Oct 15 to Oct 23, all under OpenMDW-1.1 —— nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 · Hugging Face · huggingface.co · https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-B… · Hugging Face · huggingface.co · https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16;Ne… 3.5 Bolt E4B: 4GB Open Model vs Qwen3.5 4B | explainx.ai Blog | explainx.ai · explainx.ai · https://explainx.ai/blog/nemotron-3-5-bolt-e4b-4gb-open-edge-model-gem… ② Window events: Nemotron 3.5 Parse (Oct 17, ParseBench mean 75.20) and Bolt E4B (Oct 23) —— nvidia/Nemotron-3.5-Parse · Hugging Face · huggingface.co · https://huggingface.co/nvidia/Nemotron-3.5-Parse;Nemotron 3.5 Bolt E4B: 4GB Open Model vs Qwen3.5 4B | explainx.ai Blog | explainx.ai · explainx.ai · https://explainx.ai/blog/nemotron-3-5-bolt-e4b-4gb-open-edge-model-gem… ③ Dory1.0-4B (Oct 16) reuses one block 1, 2 or 4 times; SWE-bench Verified 50.3, 59.5, 61.8 against 54.7 for Qwen3.5-4B and 61.0 for Qwen3.5-9B —— nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-GGUF · Hugging Face · huggingface.co · https://huggingface.co/nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-GGUF ④ The step from 1 to 2 loops adds 9.2 of Dory's 11.5-point gain (80%) —— Same as ③ ⑤ AA-Omniscience stays near 10 against 15 to 21 for rivals; vLLM and llama.cpp support was still an open pull request —— nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-GGUF · Hugging Face · huggingface.co · https://huggingface.co/nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-GGUF;nvi… · Hugging Face · huggingface.co · https://huggingface.co/nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16 ⑥ Bolt 74B-A9B: Terminal-Bench 2.1 53.93 against 44.38; its 24 GB build is a budget, not 74 x 2 / 8 = 18.5 GB —— nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 · Hugging Face · huggingface.co · https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16
  6. Diapositiva 6

    Models · Meta|Check cost: Muse input is 2.9x the median

    Notas del orador

    Check the cost before you commit to Muse Spark Open. Meta published it on October 15, two days before the window, with 816B total and 42B active parameters. The hosted price on October 18 was $1.25 input and $4.25 output per million tokens, against an open-weight median of $0.43 and $1.59, so about 2.9 times and 2.7 times higher. The NVFP4 checkpoint is about 530 GB, and the Artificial Analysis index of 39 is Meta-reported, with no independent listing. Reflection AI's Beam stays reported until a second source appears. Next we move from models to serving, with llm-d.

    Texto de la diapositiva

    Models · Meta Check cost: Muse input is 2.9x the median

    Source: miraflow.ai; OpenTools; TechPilot; Simplismart; VentureBeat; shattered.io; KRAFTON

    CONSEQUENCE

    The largest US open weights are priced above the open-weight median and sit beyond home hardware, and the benchmark case rests on the vendor

    2.9 x

    input price

    2.7 x

    output price

    Hosted price, $ per million tokens, Oct 18

    Read: Muse is above the open-weight median on both input and output

    What sits behind the price

    Too big to host: published Oct 15, two days before the window; 816B total, 42B active, 1M-token context; NVFP4 about 530 GB, BF16 about 1.5 to 1.65 TB

    Vendor-run scores: Artificial Analysis index 39 ( Meta-reported ) against 45 for GLM 5.3 and 44 for Kimi K3; no independent listing

    Reported only: Reflection AI's Beam, 501B total, 23B active, Apache 2.0, Oct 16, from one secondary source; Raon-1 mini preview, 28.8B total, 4.3B active

    Next step

    Price a hosted Muse workload against the median before committing, and keep Beam as reported until a second source appears

    De dónde salen las cifras
    【本页依据】 ① Muse Spark Open published Oct 15: 816B total, 42B active, 1M-token context —— Meta Muse Spark Open Explained: 816B Open-Weight MoE Benchmarks, Hardware Math and License (2026) · miraflow.ai · https://miraflow.ai/blog/meta-muse-spark-open-explained-benchmarks-har… Spark Open: Benchmarks, Architecture & Deployment · simplismart.ai · https://simplismart.ai/blog/meta-muse-spark-open ② NVFP4 checkpoint about 530 GB, BF16 about 1.5 to 1.65 TB —— Meta Muse Spark Open Explained: 816B Open-Weight MoE Benchmarks, Hardware Math and License (2026) · miraflow.ai · https://miraflow.ai/blog/meta-muse-spark-open-explained-benchmarks-har… 816B Muse model reaches desktops — with a hundreds-of-gigabytes catch | OpenTools · opentools.ai · https://opentools.ai/news/meta-muse-spark-open-desktop-memory-requirem… ③ Hosted price $1.25 input and $4.25 output per million tokens on Oct 18 —— Muse Spark Open: Meta’s Open Model & Pricing | TechPilot.ai · techpilot.ai · https://techpilot.ai/tools/muse-spark-open ④ Open-weight median $0.43 input and $1.59 output, so Muse is about 2.9x and 2.7x higher —— Muse Spark Open: Benchmarks, Architecture & Deployment · simplismart.ai · https://simplismart.ai/blog/meta-muse-spark-open;Muse Spark Open: Meta’s Open Model & Pricing | TechPilot.ai · techpilot.ai · https://techpilot.ai/tools/muse-spark-open ⑤ Artificial Analysis index 39 (Meta-reported) against 45 for GLM 5.3 and 44 for Kimi K3; no independent listing —— Meta Muse Spark Open Explained: 816B Open-Weight MoE Benchmarks, Hardware Math and License (2026) · miraflow.ai · https://miraflow.ai/blog/meta-muse-spark-open-explained-benchmarks-har… ⑥ Reflection AI Beam 501B total, 23B active, Apache 2.0, Oct 16 (single secondary source); Raon-1 mini preview 28.8B total, 4.3B active —— Reflection Beam Open Weights: Apache 2.0 License [2026] · shattered.io · https://shattered.io/reflection-beam-open-source-apache-2-0-40-partner… · Hugging Face · huggingface.co · https://huggingface.co/KRAFTON/Raon-1-mini-preview
  7. Diapositiva 7

    Serving · llm-d|Pilot llm-d 1.0 and test its gains yourself

    Notas del orador

    llm-d 1.0 reached general availability on Oct 20, and the advice is to pilot it and test its gains yourself. It is a Kubernetes-native layer above vLLM or SGLang, not a model server, and 1.0 adds flow control, router high availability, a stable v1 configuration API and session-aware routing. It is Apache 2.0, with over 500 contributors from more than 25 organizations. The performance figures are self-reported: Google cites 2.4x throughput on Ironwood, and IBM cites 11.5x cheaper. No published gain is independent, and the v1.0.0 notes admit not every tracked goal shipped. Next, a different serving engine, DeepInfer.

    Texto de la diapositiva

    Serving · llm-d

    Pilot llm-d 1.0 and test its gains yourself

    Source: MarkTechPost; AICoder; llm-d project blog

    A stable API, but no published gain is independent

    GA on Oct 20: Kubernetes-native, above vLLM or SGLang, not a model server

    2.4 x

    Google Ironwood throughput, self-reported

    Median TTFT down more than 85%

    What 1.0 adds

    Flow control so bursty agents cannot starve interactive users

    Router high availability

    Stable v1 configuration API

    Session-aware routing

    Over 500 contributors from more than 25 organizations; CNCF Sandbox on Mar 12, 2026; Apache 2.0

    Self-reported results

    Google: Gemini prefix-cache hit rate 35% to 70%; 17,000-node GKE benchmark 2.9x across 3 clusters

    IBM: up to 3,000 agents on 544 H100s, about 5.5 per GPU, 11.5x cheaper

    GLM 5.2: 6.6 million output tokens per minute, 5 to 10 times cheaper (vendor-reported)

    What it means

    A stable API makes llm-d fit for production operation

    The GitHub v1.0.0 notes admit not every tracked goal shipped

    Next step

    Pilot llm-d on your own workload and compare against your current routing before adopting the vendor numbers

    De dónde salen las cifras
    【本页依据】 ① llm-d 1.0 reached GA on Oct 20: Kubernetes-native, above vLLM or SGLang, not a model server —— llm-d 1.0 ships: the Kubernetes-native open-source distributed inference stack led by Red Hat, IBM and Google hits production readiness, with vendors reporting 3,000 self-hosted coding agents at 5-10x lower cost than commercial APIs — AICoder · aicoder.com · https://aicoder.com/news/news-20261020-llm-d-1-0-kubernetes-native-dis… 1.0 makes distributed AI inference production-ready - Techzine Global · techzine.eu · https://www.techzine.eu/news/infrastructure/145141/llm-d-1-0-makes-dis… ② 1.0 adds flow control, router high availability, a stable v1 configuration API and session-aware routing —— llm-d v1.0: State-of-the-art inference, ready for Day 2 | llm-d · llm-d.ai · https://llm-d.ai/blog/llm-d-v1.0-state-of-the-art-inference-ready-for-… 1.0 makes distributed AI inference production-ready - Techzine Global · techzine.eu · https://www.techzine.eu/news/infrastructure/145141/llm-d-1-0-makes-dis… ③ Over 500 contributors from more than 25 organizations; CNCF Sandbox on Mar 12, 2026; Apache 2.0 —— Google Cloud Ships llm-d 1.0 With Cache-Aware Routing for TPU and GPU Fleets - MarkTechPost · marktechpost.com · https://www.marktechpost.com/2026/10/20/llm-d-1-0-open-source-distribu… ④ Google: Ironwood median TTFT down more than 85% and throughput 2.4x; Gemini prefix-cache hit rate 35% to 70%; 17,000-node GKE benchmark 2.9x across 3 clusters —— Google Cloud Ships llm-d 1.0 With Cache-Aware Routing for TPU and GPU Fleets - MarkTechPost · marktechpost.com · https://www.marktechpost.com/2026/10/20/llm-d-1-0-open-source-distribu… v1.0: State-of-the-art inference, ready for Day 2 | llm-d · llm-d.ai · https://llm-d.ai/blog/llm-d-v1.0-state-of-the-art-inference-ready-for-… ⑤ IBM: up to 3,000 agents on 544 H100s, about 5.5 per GPU, 11.5x cheaper —— llm-d v1.0: State-of-the-art inference, ready for Day 2 | llm-d · llm-d.ai · https://llm-d.ai/blog/llm-d-v1.0-state-of-the-art-inference-ready-for-… ⑥ GLM 5.2 reached 6.6 million output tokens per minute, 5 to 10 times cheaper (vendor-reported); GitHub v1.0.0 notes admit not every tracked goal shipped —— llm-d 1.0 ships: the Kubernetes-native open-source distributed inference stack led by Red Hat, IBM and Google hits production readiness, with vendors reporting 3,000 self-hosted coding agents at 5-10x lower cost than commercial APIs — AICoder · aicoder.com · https://aicoder.com/news/news-20261020-llm-d-1-0-kubernetes-native-dis…
  8. Diapositiva 8

    Serving · Engine|Study DeepInfer; do not swap vLLM for it

    Notas del orador

    DeepInfer is a design reference, so study it but do not swap vLLM for it. DeepSeek open-sourced it under Apache 2.0, dated Oct 20 by secondary sources. It serves only DeepSeek-V4.1-Flash, on NVIDIA SM100 and Huawei Ascend 950, runs offline only, and leaves out a KV-cache system, prefill/decode disaggregation and load balancing. The accuracy figures, 99.9% on AIME 2026, 93.4% on GPQA Diamond and 42.6% on HLE-Full, are vendor-reported, and no source ran a same-hardware comparison with vLLM. Keep vLLM for general serving and ask for same-hardware runs. Next, the licence terms behind Meta's Muse.

    Texto de la diapositiva

    Serving · Engine

    Study DeepInfer; do not swap vLLM for it

    Source: Thaki Cloud; Developers Digest; DEV Community; Wukong Substack; AMD ROCm Blogs; Google Developers Blog; Modern DataTools

    A narrow reference engine

    Narrow by design

    Apache 2.0, dated Oct 20 by secondary sources

    Serves only DeepSeek-V4.1-Flash , on NVIDIA SM100 and Huawei Ascend 950

    Offline only ; leaves out a KV-cache system, prefill/decode disaggregation and load balancing

    Claims with no rival run

    Charts use 4 SM100 GPUs for prefill and 64 for decode; no same-hardware comparison with vLLM

    About $38 revenue per GPU-hour (reported, unverified)

    Accuracy, vendor-reported: 99.9% AIME 2026, 93.4% GPQA Diamond, 42.6% HLE-Full

    Next step

    Read DeepInfer as a design reference, keep vLLM for general serving, and ask for same-hardware runs

    Single-request decode speedup

    Read: AMD-run gains of 1.9x to 3.3x, each against a baseline AMD chose

    What it means

    DeepInfer changes what can be studied rather than what can be served.

    423.8k

    vLLM weekly PyPI downloads

    199.2k

    SGLang weekly PyPI downloads

    2.01 cents

    per million tokens, Google TPU (preview)

    De dónde salen las cifras
    【本页依据】 ① DeepSeek open-sourced DeepInfer under Apache 2.0, dated Oct 20 by secondary sources. —— DeepSeek Opens Its In-House Inference Engine: DeepInfer and the ‘Model-Specialized Kernels + Ascend’ Strategy - Thaki Cloud Tech Blog ThakiCloud 다키클라우드 기술 블로그 · thakicloud.com · https://thakicloud.com/tech-blog/en/llmops/deepseek-deepinfer-open-sou… the U.S. Ban, DeepSeek Open-Sources Its Inference Engine | Trending Topics · trendingtopics.eu · https://www.trendingtopics.eu/deepseek-deepinfer-open-source-inference… ② It serves only DeepSeek-V4.1-Flash on NVIDIA SM100 and Huawei Ascend 950, offline only, with no KV-cache system, prefill/decode disaggregation or load balancing. —— DeepInfer vs vLLM: DeepSeek's New Engine Is Not a Drop-In Replacement - DEV Community · dev.to · https://dev.to/jamilxt/deepinfer-vs-vllm-deepseeks-new-engine-is-not-a… What DeepSeek Open-Sourced and What You Can Run · developersdigest.tech · https://www.developersdigest.tech/blog/deepinfer-deepseek-inference-fr… Opens Its In-House Inference Engine: DeepInfer and the ‘Model-Specialized Kernels + Ascend’ Strategy - Thaki Cloud Tech Blog ThakiCloud 다키클라우드 기술 블로그 · thakicloud.com · https://thakicloud.com/tech-blog/en/llmops/deepseek-deepinfer-open-sou… ③ Charts use 4 SM100 GPUs for prefill and 64 for decode; accuracy 99.9% AIME 2026, 93.4% GPQA Diamond, 42.6% HLE-Full (vendor-reported). —— DeepInfer: What DeepSeek Open-Sourced and What You Can Run · developersdigest.tech · https://www.developersdigest.tech/blog/deepinfer-deepseek-inference-fr… ④ No same-hardware comparison with vLLM was published. —— DeepInfer vs vLLM: DeepSeek's New Engine Is Not a Drop-In Replacement - DEV Community · dev.to · https://dev.to/jamilxt/deepinfer-vs-vllm-deepseeks-new-engine-is-not-a… What DeepSeek Open-Sourced and What You Can Run · developersdigest.tech · https://www.developersdigest.tech/blog/deepinfer-deepseek-inference-fr… ⑤ About $38 revenue per GPU-hour and 155 trillion tokens per day (reported, unverified). —— Reflections on DeepSeek Open-Sourcing Its Inference Engine, DeepInfer · wukong123.substack.com · https://wukong123.substack.com/p/reflections-on-deepseek-open-sourcing ⑥ AMD MI355X batch-1 decode speedups of 2.0x, 3.3x and 1.9x on Oct 20, each against an AMD-chosen baseline; Google TPU 2.01 cents per million tokens (preview); weekly PyPI downloads vLLM 423.8k, SGLang 199.2k. —— Bringing Ultra-Fast, Interactive LLM Inference to AMD Instinct™ MI355X GPUs — ROCm Blogs · rocm.blogs.amd.com · https://rocm.blogs.amd.com/software-tools-optimization/megakernel-intr… New vLLM and SGLang Inference Engines on TPU - Google Developers Blog · developers.googleblog.com · https://developers.googleblog.com/announcing-new-vllm-and-sglang-infer… vs TensorRT-LLM vs vLLM Compared | Modern DataTools · modern-datatools.com · https://www.modern-datatools.com/compare/sglang-vs-tensorrt-llm-vs-vllm
  9. Diapositiva 9

    Licence · Terms|Read Muse's $20M trigger before you host it

    Notas del orador

    Read Muse's $20M trigger before you host it. The Muse Model License, in effect since Oct 15, requires a separate agreement from sellers of model access above $20M gross revenue in any consecutive 12 months, about $1.7M a month. Every licensee must also credit "Built with Muse Spark Open". The clause bites hosts and API resellers, not application builders. Llama 3.3 uses a different trigger, 700 million monthly active users. In Europe, no rule changed inside the window, but Dec 2, 2026, 39 days away, brings two new bans and marking for earlier systems. Next, China's draft export catalogue.

    Texto de la diapositiva

    Licence · Terms

    Read Muse's $20M trigger before you host it

    Source: ibl.ai; Zentor; bettersorted; Glukhov; Vanderburgh; FisherBroyles

    Muse Model License, in effect since Oct 15

    Revenue trigger

    $20M

    Gross revenue in any consecutive 12 months, about $1.7M a month ($20M / 12)

    Sellers of model access above the trigger need a separate agreement

    Every licensee must credit "Built with Muse Spark Open"

    The clause bites hosts and API resellers , not application builders

    Internal use and non-model-as-a-service products are excluded

    A usage policy bars illegal activity, malware and military or weapons use

    Llama 3.3 uses a different trigger: 700 million monthly active users

    What it means: a licence can reprice a hosted business, and the next EU date arrives in 39 days

    Other licences

    NVIDIA, Reflection, DeepSeek: OpenMDW-1.1 or Apache 2.0

    AutoGPT: MIT mixed with Polyform Shield

    No relicensing event dated Oct 17–23 appears

    EU: no change in the window

    Regulation (EU) 2026/1744 in force Jul 27, 2026

    Dec 2, 2026 (39 days away): two new bans and marking for earlier systems

    Fines: €35M or 7% of turnover; €15M or 3%

    Next step

    Check your revenue against the Muse trigger, and start marking and transparency work now if you ship to Europe

    De dónde salen las cifras
    【本页依据】 ① Muse Model License, in effect since Oct 15: separate agreement above $20M gross revenue in any consecutive 12 months, and credit "Built with Muse Spark Open". —— Meta's Muse Spark Open Is Open-Weight, Not Open Source. · ibl.ai · https://ibl.ai/blog/meta-muse-spark-open-weight-licence-self-host-real… ② $20M / 12 is about $1.7M a month, so the clause bites hosts and API resellers, not application builders; internal use and non-model-as-a-service products are excluded. —— Meta's Muse Spark Open Is Open-Weight, Not Open Source. · ibl.ai · https://ibl.ai/blog/meta-muse-spark-open-weight-licence-self-host-real… Muse Spark Open: An Open-Weight Agent Model You Can Run on a Desktop | Zentor Blog · zentor.ai · https://zentor.ai/blog/meta-muse-spark-open-desktop-agent ③ Llama 3.3 uses a different trigger: 700 million monthly active users. —— AI Model Licenses: Open Weight Explained · bettersorted.de · https://www.bettersorted.de/en/posts/open-weight-or-open-source ④ NVIDIA, Reflection and DeepSeek released under OpenMDW-1.1 or Apache 2.0; AutoGPT mixes MIT with Polyform Shield. —— nvidia/Nemotron-3.5-Parse · Hugging Face · huggingface.co · https://huggingface.co/nvidia/Nemotron-3.5-Parse;Reflection Beam Open Weights: Apache 2.0 License [2026] · shattered.io · https://shattered.io/reflection-beam-open-source-apache-2-0-40-partner… Opens Its In-House Inference Engine: DeepInfer and the ‘Model-Specialized Kernels + Ascend’ Strategy - Thaki Cloud Tech Blog ThakiCloud 다키클라우드 기술 블로그 · thakicloud.com · https://thakicloud.com/tech-blog/en/llmops/deepseek-deepinfer-open-sou… ⑤ Regulation (EU) 2026/1744 in force Jul 27, 2026; Dec 2, 2026 brings two new bans and marking for earlier systems. —— EU AI Act 2026 Amendments: What Changed and When | Vanderburgh.it · vanderburgh.it · https://www.vanderburgh.it/guides/eu-ai-act-2026-amendments;Client Alert - As AI moves ahead, European and Global dealmakers need to keep pace. - FisherBroyles · fisherbroyles.com · https://fisherbroyles.com/news/client-alert-as-ai-moves-ahead-european… ⑥ EU fines of EUR 35M or 7% of turnover, and EUR 15M or 3%. —— Client Alert - As AI moves ahead, European and Global dealmakers need to keep pace. - FisherBroyles · fisherbroyles.com · https://fisherbroyles.com/news/client-alert-as-ai-moves-ahead-european…
  10. Diapositiva 10

    China · Export|Register exports now; the catalogue is a draft

    Notas del orador

    Register exports now, because registration is live while the catalogue is only a draft. MOFCOM and MOST published Announcement No. 48 on Oct 16, and the report has it only through secondary coverage. Since Oct 16, exporters must register transfers of listed technologies. The draft lists 40 technologies, 14 banned and 26 restricted, and comments close Nov 15, 22 days away. Per CellCog, model tests include 10 to the 26 training FLOPs, 2 trillion parameters or a global top-10 rank. Already-public weights, APIs, apps, SaaS and on-device use are outside. Next, what the community says about the load.

    Texto de la diapositiva

    China · Export

    Register exports now; the catalogue is a draft

    Source: CellCog; Mean CEO; theCUBE; The Decoder; Developers Digest

    Registration is live; the list is not

    Draft: Announcement No. 48 from MOFCOM and MOST, Oct 16; comments close Nov 15 (22 days). We have it only through secondary coverage.

    In effect: since Oct 16, exporters must register transfers of listed technologies. Already-public weights, APIs, apps, SaaS and on-device use are outside.

    Model tests (CellCog): 10 26 training FLOPs, 2 trillion parameters or a global top-10 rank

    Agent tests: 20 or more steps, 60 or more agents or 200 or more tools at 90% success

    Consequence: registration already gates technology exports, and the top-10 test tightens as models improve, so the next Chinese frontier release can be delayed

    Next step: register exports that may be listed and file comments by Nov 15 if you are affected

    Draft catalogue by sector

    Unit: technologies in the draft catalogue

    Reading: 40 technologies in all, AI 23 + solar 12 + biomedicine 5; 14 banned and 26 restricted

    Exposure: share of tokens

    Open-weight models

    71.5 %

    DeepSeek

    58 %

    Z.ai

    7.2 %

    Moonshot

    3.6 %

    Vercel AI Gateway index, via Mean CEO, September traffic

    De dónde salen las cifras
    【本页依据】 ① MOFCOM and MOST published Announcement No. 48 on Oct 16; the report has it only through secondary coverage. —— China’s AI export control announcement raises more questions than it answers (Ctrl+AI+Reg - 19 October 2026) · techieray.substack.com · https://techieray.substack.com/p/chinas-ai-export-control-announcement… AI Export Controls Draft (Announcement No. 48): 2 Trillion Parameter Models, Open-Source Exemption, API Access and What It Means for European Founders Using Kimi, Qwen and DeepSeek · mean.ceo · https://mean.ceo/tpost/china-ai-export-controls ② 40 technologies: AI 23 + solar 12 + biomedicine 5, of which 14 banned and 26 restricted. —— China AI Export Controls: 2T Models and Agents Listed | CellCog · cellcog.ai · https://cellcog.ai/blog/china-ai-export-controls;China AI Export Controls Draft (Announcement No. 48): 2 Trillion Parameter Models, Open-Source Exemption, API Access and What It Means for European Founders Using Kimi, Qwen and DeepSeek · mean.ceo · https://mean.ceo/tpost/china-ai-export-controls ③ Catalogue is a draft with comments closing Nov 15 (22 days); registration of listed technology exports in effect since Oct 16. —— China’s AI export control announcement raises more questions than it answers (Ctrl+AI+Reg - 19 October 2026) · techieray.substack.com · https://techieray.substack.com/p/chinas-ai-export-control-announcement… AI Export Controls Draft (Announcement No. 48): 2 Trillion Parameter Models, Open-Source Exemption, API Access and What It Means for European Founders Using Kimi, Qwen and DeepSeek · mean.ceo · https://mean.ceo/tpost/china-ai-export-controls;China AI Export Controls: What They Mean for Open-Weight Models · developersdigest.tech · https://www.developersdigest.tech/blog/china-ai-export-controls-open-w… ④ Model tests of 10^26 training FLOPs, 2 trillion parameters or a global top-10 rank; agent tests of 20 or more steps, 60 or more agents or 200 or more tools at 90% success. —— China AI Export Controls: 2T Models and Agents Listed | CellCog · cellcog.ai · https://cellcog.ai/blog/china-ai-export-controls ⑤ Already-public weights, APIs, apps, SaaS and on-device use are outside the draft. —— Report has no matching statement ⑥ Vercel: open-weight models carried 71.5% of tokens, DeepSeek 58%, Z.ai 7.2% and Moonshot 3.6%. —— China AI Export Controls Draft (Announcement No. 48): 2 Trillion Parameter Models, Open-Source Exemption, API Access and What It Means for European Founders Using Kimi, Qwen and DeepSeek · mean.ceo · https://mean.ceo/tpost/china-ai-export-controls
  11. Diapositiva 11

    Community · Load|Write a policy: 25% of pull requests are slop

    Notas del orador

    Write a contribution policy, because maintainers are carrying the review load. The Linux Foundation maintainer survey of Oct 20 is the window's only primary community data, and all figures are respondent estimates; sample size and field dates are not disclosed. It reports that 25% of incoming pull requests are AI slop, 31% at large projects, yet only 35% of projects have a policy permitting GenAI use. Writing time is cheap and review time is not. The biggest debate was the Hacker News thread on DeepInfer, 2,330 points and 887 comments, a snapshot. Last, the dates still ahead.

    Texto de la diapositiva

    Community · Load

    Write a policy: 25% of pull requests are slop

    Source: Linux Foundation; Superpower Daily; Hacker News; DEV Community; Towards AI; PromptQuorum

    Maintainer survey, Oct 20

    Linux Foundation, the window's only primary community data · unit: % of respondents, estimates; sample size and field dates not disclosed

    Reading: 25% of incoming pull requests are AI slop (31% at large projects), yet only 35% of projects have a policy permitting GenAI use

    Review is the bottleneck

    Consequence: writing time is cheap and review time is not, so maintainers carry the cost of AI-generated contributions

    Biggest debate: the Hacker News thread on DeepInfer, 2,330 points and 887 comments (snapshot): reference engine or vLLM fork

    At home: DeepInfer weights are about 510 GB; a 70B model at 4-bit needs about 42 GB (70 x 0.6)

    One blog run: llama.cpp on a GTX 1650 Ti reached 2.24x

    Next step: Write a contribution policy with contributor-side testing and disclosure, and size local models from VRAM first

    De dónde salen las cifras
    【本页依据】 ① Linux Foundation maintainer survey of Oct 20: 25% of incoming pull requests are AI slop (31% at large projects); all figures are respondent estimates. —— New LF Research Survey Shows Generative AI Cuts Open Source Coding Time in Half, but 25% of Incoming Pull Requests are Considered AI Slop · linuxfoundation.org · https://www.linuxfoundation.org/press/new-lf-research-survey-shows-gen… ② 59% of maintainers report more contributions; 52% less time on code authoring; 61% of contributors fully review and test AI code. —— Same as ① ③ 35% of projects have a policy permitting GenAI use; 32% have none and no plan. —— Same as ① ④ Sample size and field dates are not disclosed. —— Linux Foundation survey finds faster AI coding alongside low-quality contributions | Superpower Daily · superpowerdaily.com · https://superpowerdaily.com/posts/linux-foundation-survey-finds-faster… ⑤ The Hacker News thread on DeepInfer drew 2,330 points and 887 comments (snapshot). —— DeepInfer: High-performance inference framework for DeepSeek models | Hacker News · news.ycombinator.com · https://news.ycombinator.com/item?id=50163277 ⑥ DeepInfer weights are about 510 GB; llama.cpp on a GTX 1650 Ti reached 2.24x; a 70B model at 4-bit needs about 42 GB (70 x 0.6). —— DeepSeek DeepInfer Won't Run on Your RTX 5090. Here's What to Run Instead - DEV Community · dev.to · https://dev.to/alanwest/deepseek-deepinfer-wont-run-on-your-rtx-5090-h… I Made Local LLMs Up to 2.24× Faster on a 4GB NVIDIA GPU · pub.towardsai.net · https://pub.towardsai.net/how-i-made-local-llms-up-to-2-24-faster-on-a… materielle LLM local : de 8 Go a 70B par VRAM · promptquorum.com · https://www.promptquorum.com/local-llms/local-llm-hardware-guide
  12. Diapositiva 12

    Outlook · Dates|Plan for Nov 15 comments and the Dec 2 EU date

    Notas del orador

    Everything dated in the window is already in effect, from Muse Spark Open on Oct 15 to llm-d 1.0 on Oct 20. Two dates are still ahead: China's comments close on Nov 15, 22 days away, and the EU's bans and marking arrive on Dec 2, 2026, 39 days away. A missed comment date cannot be recovered, while EU dates leave weeks to months to prepare. On the try-list, llm-d 1.0 on Kubernetes comes with self-reported figures, and at home a 70B model needs about 42 GB. Read the licence, check the hardware fits, then trust a benchmark. That closes this week's brief.

    Texto de la diapositiva

    Outlook · Dates

    Plan for Nov 15 comments and the Dec 2 EU date

    Source: Vanderburgh; Mean CEO; AICoder; Thaki Cloud; Linux Foundation; Emergent; explainx.ai

    Everything dated so far is in effect

    Oct 15

    Muse Spark Open published

    In effect

    Oct 16

    Announcement No. 48; registration starts

    In effect

    Oct 17

    Nemotron 3.5 Parse released

    In effect

    Oct 20

    llm-d 1.0 GA, DeepInfer and the survey

    In effect

    Oct 21

    Omnara open-source launch

    In effect

    Oct 23

    Nemotron 3.5 Bolt E4B released

    In effect

    Nov 15

    China comments close (22 days away)

    Upcoming

    Dec 2, 2026

    EU bans and marking (39 days away)

    Upcoming

    Dec 2, 2027

    EU Annex III high-risk rules

    Upcoming

    Aug 2, 2028

    EU Annex I product rules

    Upcoming

    Consequence: a missed comment date cannot be recovered, while EU dates leave weeks to months to prepare

    Dates still ahead

    22 days

    Nov 15: China comments close

    39 days

    Dec 2: EU bans and marking

    Try-list, with its caveat

    llm-d 1.0 on Kubernetes: all latency and throughput figures are self-reported

    At home: quantized builds in llama.cpp, Ollama or LM Studio; a 70B model needs about 42 GB

    Next step: Read the licence, check the hardware fits, then trust a benchmark, and file by Nov 15 and plan to Dec 2

    De dónde salen las cifras
    【本页依据】 ① Oct 15 Muse Spark Open published; Oct 16 Announcement No. 48 and registration start. —— Meta's Muse Spark Open Is Open-Weight, Not Open Source. · ibl.ai · https://ibl.ai/blog/meta-muse-spark-open-weight-licence-self-host-real… AI Export Controls Draft (Announcement No. 48): 2 Trillion Parameter Models, Open-Source Exemption, API Access and What It Means for European Founders Using Kimi, Qwen and DeepSeek · mean.ceo · https://mean.ceo/tpost/china-ai-export-controls ② Oct 17 Nemotron 3.5 Parse released; Oct 23 Nemotron 3.5 Bolt E4B released. —— nvidia/Nemotron-3.5-Parse · Hugging Face · huggingface.co · https://huggingface.co/nvidia/Nemotron-3.5-Parse;Nemotron 3.5 Bolt E4B: 4GB Open Model vs Qwen3.5 4B | explainx.ai Blog | explainx.ai · explainx.ai · https://explainx.ai/blog/nemotron-3-5-bolt-e4b-4gb-open-edge-model-gem… ③ Oct 20 llm-d 1.0 GA, DeepInfer open-sourced and the LF survey published; Oct 21 Omnara open-source launch. —— llm-d 1.0 ships: the Kubernetes-native open-source distributed inference stack led by Red Hat, IBM and Google hits production readiness, with vendors reporting 3,000 self-hosted coding agents at 5-10x lower cost than commercial APIs — AICoder · aicoder.com · https://aicoder.com/news/news-20261020-llm-d-1-0-kubernetes-native-dis… Opens Its In-House Inference Engine: DeepInfer and the ‘Model-Specialized Kernels + Ascend’ Strategy - Thaki Cloud Tech Blog ThakiCloud 다키클라우드 기술 블로그 · thakicloud.com · https://thakicloud.com/tech-blog/en/llmops/deepseek-deepinfer-open-sou… LF Research Survey Shows Generative AI Cuts Open Source Coding Time in Half, but 25% of Incoming Pull Requests are Considered AI Slop · linuxfoundation.org · https://www.linuxfoundation.org/press/new-lf-research-survey-shows-gen… ④ Nov 15 China comments close (22 days away). —— China AI Export Controls Draft (Announcement No. 48): 2 Trillion Parameter Models, Open-Source Exemption, API Access and What It Means for European Founders Using Kimi, Qwen and DeepSeek · mean.ceo · https://mean.ceo/tpost/china-ai-export-controls ⑤ Dec 2, 2026 EU bans and marking (39 days away); Dec 2, 2027 Annex III; Aug 2, 2028 Annex I. —— EU AI Act 2026 Amendments: What Changed and When | Vanderburgh.it · vanderburgh.it · https://www.vanderburgh.it/guides/eu-ai-act-2026-amendments ⑥ Try-list: llm-d 1.0 on Kubernetes (self-reported figures); at home quantized builds in llama.cpp, Ollama or LM Studio, a 70B model needing about 42 GB. —— llm-d 1.0 ships: the Kubernetes-native open-source distributed inference stack led by Red Hat, IBM and Google hits production readiness, with vendors reporting 3,000 self-hosted coding agents at 5-10x lower cost than commercial APIs — AICoder · aicoder.com · https://aicoder.com/news/news-20261020-llm-d-1-0-kubernetes-native-dis… DeepInfer Won't Run on Your RTX 5090. Here's What to Run Instead - DEV Community · dev.to · https://dev.to/alanwest/deepseek-deepinfer-wont-run-on-your-rtx-5090-h… materielle LLM local : de 8 Go a 70B par VRAM · promptquorum.com · https://www.promptquorum.com/local-llms/local-llm-hardware-guide
  13. Diapositiva 13

    Licence first, benchmark last

    Notas del orador

    To close: licence first, benchmark last. Treat stars as leads and scores as vendor claims, then read the licence, check the hardware fits, and test the model yourself. Thank you.

    Texto de la diapositiva

    Closing

    Treat stars as leads and scores as vendor claims;

    read the licence, check the hardware, then test it yourself.

    Thank you

    2026-10-24 · Open-Source AI Projects Weekly Brief · Oct 17–23, 2026

Fuentes (121)

Los enlaces llevan a las páginas originales que Divrite encontró y citó durante la investigación.

  1. 01GitHub Trending October 2026: From a 130K-Star Knowledge Graph to a 48K-Star Skills Catalog — 3 Repos That Prove AI Agents Need Memory Structures, Not Just Promptscoddykit.com
  2. 02Trending Open Source AI Projects on GitHub, October 2026 - Rost Glukhov | AI Systems & Infrastructureglukhov.org
  3. 03GitHub Trending October 2026: From a 113K-Star Postgres Platform to a 103K-Star Python Framework — 5 Repos That Prove Foundational Infrastructure Still Winscoddykit.com
  4. 048 Trending GitHub Repos for AI Developers (October 2026)techninjaah.substack.com
  5. 05Top 5 Trending Dev Tools & Tutorials: October 2026 Edition - DEV Communitydev.to
  6. 065 Best GitHub Repositories for AI Agent Skills - KDnuggetskdnuggets.com
  7. 07GitHub Trending October 2026: From a 219K-Star Open Source Coding Agent to a 163K-Star AI Agency — 2 Repos That Prove the Agent Era Is Now an Industrycoddykit.com
  8. 08sondera-ai/sondera-coding-agent-hooks — GitHub trending stats & insights | Trendshifttrendshift.io
  9. 09kunwarVivek/mcp-github-project-manager — GitHub trending stats & insights | Trendshifttrendshift.io
  10. 10AI Agents - Rost Glukhov | AI Systems & Infrastructureglukhov.org
  11. 11GitHub Trending October 2026: From a 41K-Star Universal Plugin Marketplace to the Death of Discovery — When 14 Out of 15 Trending Repos Have Already Been Coveredcoddykit.com
  12. 12Awesome Agent Skills: 49 Skills for Better AI-Assisted Codinghackernoon.com
Mostrar 109 fuentes más
  1. 13The Death of Discovery: What 48 Posts and 100+ Repositories Reveal About the AI Agent Ecosystem in Late 2026coddykit.com
  2. 14Automation skills for Claude Code · Skillselionskillselion.com
  3. 15Omnara: Open-Source Claude Managed Agents Alternativeactivepieces.com
  4. 16Omnara: Open-Source Alternative to Claude Agents - PromptZonepromptzone.com
  5. 17Show HN: Omnara – Open-Source Alternative to Claude Managed Agents | Hacker Newsnews.ycombinator.com
  6. 185 Best Open Source Claude Managed Agents Alternatives in 2026openalternative.co
  7. 19starnet: Open Source Alternative to Claude Managed Agentsopensourcealternatives.to
  8. 20Omnara Launches Open-Source Alternative to Claude Agentsemergent.sh
  9. 21jorshali/developers-guide-to-ai — GitHub trending stats & insights | Trendshifttrendshift.io
  10. 22nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 · Hugging Facehuggingface.co
  11. 23nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-GGUF · Hugging Facehuggingface.co
  12. 24nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 · Hugging Facehuggingface.co
  13. 25nvidia/Nemotron-3.5-Parse · Hugging Facehuggingface.co
  14. 26Nvidia Nemotron 3.5: 120B Open Model Hits PCs [2026]shattered.io
  15. 27NVIDIA Open Models Advance Europe’s Sovereign Intelligence Across Industries | NVIDIA Blogblogs.nvidia.com
  16. 282026 October 🌰 China Open Source Highlights - a zh-ai-community Collectionhuggingface.co
  17. 29LLM Daily: October 20, 2026 • Buttondownbuttondown.com
  18. 30Frontier AI Models: Live Top 10 Rankings, Evidence and Pricing (October 2026) | BenchLM.aibenchlm.ai
  19. 31Proceedings of the 8th Workshop on Clinical Natural Language Processing (Clinical NLP) @ LREC 2026 - ACL Anthologyaclanthology.org
  20. 32The Discursive Ripples of Human-AI Interaction: A Three-Case Observation Based on Social Distance Theory - Mengjiao Yin, Wei Wang, Wei Xu, 2026journals.sagepub.com
  21. 33Local LLM Compatibility Dataset (2026) | ModelFitmodelfit.io
  22. 34🤗 Hugging face models trendingkaggle.com
  23. 35Hugging Face vs Wasabi: Pricing & Pros (2026)getdeploying.com
  24. 36nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16 · Hugging Facehuggingface.co
  25. 37Hugging Face - 2026 Company Profile, Team, Funding & Competitors - Tracxntracxn.com
  26. 38KRAFTON/Raon-1-mini-preview · Hugging Facehuggingface.co
  27. 39NVIDIA Dory1.0-4B: Open-Weight Looped LLM Releasedtechjacksolutions.com
  28. 40NVIDIA Nemotron Labs Dory1.0 4B BF16 by nvidia — VRAM 8GB, 256K context | LLM Explorerllm-explorer.com
  29. 41Nemotron Labs Dory - a nvidia Collectionhuggingface.co
  30. 42NVIDIA Dory1.0-4B Benchmarks: Looping vs Qwen3.5 and Gemma 4 | MindStudiomindstudio.ai
  31. 43Nemotron 3.5 Bolt E4B: 4GB Open Model vs Qwen3.5 4B | explainx.ai Blog | explainx.aiexplainx.ai
  32. 44Muse Spark Open: Meta’s Open Model & Pricing | TechPilot.aitechpilot.ai
  33. 45Meta Muse Spark Open Explained: 816B Open-Weight MoE Benchmarks, Hardware Math and License (2026)miraflow.ai
  34. 46Meta’s 816B Muse model reaches desktops — with a hundreds-of-gigabytes catch | OpenToolsopentools.ai
  35. 47Meta Muse Spark Open: what you get, what it costs, who should run it | eesel AIeesel.ai
  36. 48Meta's Muse Spark Open Is Open-Weight, Not Open Source.ibl.ai
  37. 49Muse Spark Open: Benchmarks, Architecture & Deploymentsimplismart.ai
  38. 50llm-d 1.0, an open source stack for distributed inferencedaily.dev
  39. 51Google Cloud Ships llm-d 1.0 With Cache-Aware Routing for TPU and GPU Fleets - MarkTechPostmarktechpost.com
  40. 52llm-d 1.0 released for distributed AI inference deploymentinvesting.com
  41. 53llm-d 1.0 ships: the Kubernetes-native open-source distributed inference stack led by Red Hat, IBM and Google hits production readiness, with vendors reporting 3,000 self-hosted coding agents at 5-10x lower cost than commercial APIs — AICoderaicoder.com
  42. 54llm-d v1.0: State-of-the-art inference, ready for Day 2 | llm-dllm-d.ai
  43. 55llm-d 1.0 makes distributed AI inference production-ready - Techzine Globaltechzine.eu
  44. 56DeepInfer vs vLLM: DeepSeek's New Engine Is Not a Drop-In Replacement - DEV Communitydev.to
  45. 57DeepSeek open-sources DeepInfer, its in-house inference...daily.dev
  46. 58DeepSeek Opens Its In-House Inference Engine: DeepInfer and the ‘Model-Specialized Kernels + Ascend’ Strategy - Thaki Cloud Tech Blog ThakiCloud 다키클라우드 기술 블로그thakicloud.com
  47. 59Reflections on DeepSeek Open-Sourcing Its Inference Engine, DeepInferwukong123.substack.com
  48. 60What Is DeepInfer? DeepSeek's Open-Source Engineactivepieces.com
  49. 61Despite the U.S. Ban, DeepSeek Open-Sources Its Inference Engine | Trending Topicstrendingtopics.eu
  50. 62vLLM vs SGLang Production Benchmarks 2026 & KV Guide | Blogwise-hustlers.com
  51. 63Modular MAX vs vLLM: 5.5x Faster on Kimi K2.5 [2026]shattered.io
  52. 64Bringing Ultra-Fast, Interactive LLM Inference to AMD Instinct™ MI355X GPUs — ROCm Blogsrocm.blogs.amd.com
  53. 65SGLang vs TensorRT-LLM vs vLLM Compared | Modern DataToolsmodern-datatools.com
  54. 66Announcing New vLLM and SGLang Inference Engines on TPU - Google Developers Blogdevelopers.googleblog.com
  55. 67MiniMax-M3.1 on AMD Instinct GPUsamd.com
  56. 68ROCm für KIamd.com
  57. 69RTX 5090 vs RX 7900 XTX for Local AI: 32GB Wins [2026]shattered.io
  58. 70From Prompt to Playback: Nunchux Turns AMD Instinct™ GPU Performance into Responsive Video AIamd.com
  59. 71LangGraph vs CrewAI: Which Agent Framework to Use in 2026?techiehub.blog
  60. 72LangChain (agents): features, install and latest version (Oct 2026)developersdigest.tech
  61. 7314 Best AI Agent Builder Platforms 2026 (Ranked, Tested)taskade.com
  62. 74Microsoft Agent Framework vs LangGraph: features, install and latest version (Oct 2026)developersdigest.tech
  63. 75Top AI Frameworks Reddit Experts Recommend in 2026ifourtechnolab.com
  64. 76LangGraph — Agent Frameworks for AI Agentsagenticskills.io
  65. 77Reflection Beam Open Weights: Apache 2.0 License [2026]shattered.io
  66. 78Google Open Source Blog: 2026opensource.googleblog.com
  67. 79AI Cuts Coding Time 52%, Floods Open Source With Sloptech-insider.org
  68. 80The 10 Best Open-Source LLMs in September 2026 (Ranked)geotoolbox.ai
  69. 81Open Weights vs Open Source: The Real Difference (2026)geotoolbox.ai
  70. 82Meta Muse Spark Open: An Open-Weight Agent Model You Can Run on a Desktop | Zentor Blogzentor.ai
  71. 83AI Model Licenses: Open Weight Explainedbettersorted.de
  72. 84Freeport Resources buys back Yandera's 1.5% royalty | FEERF Stock Newsstocktitan.net
  73. 85Juniper Licensing User Guidejuniper.net
  74. 86Contracts in Scope for CIPchicago.gov
  75. 87DGX Spark User Guidedocs.nvidia.com
  76. 88Best State to Form an LLC in 2026: The Honest Answerrho.co
  77. 89China’s AI export control announcement raises more questions than it answers (Ctrl+AI+Reg - 19 October 2026)techieray.substack.com
  78. 90China AI Export Controls: 2T Models and Agents Listed | CellCogcellcog.ai
  79. 91China AI Export Controls Draft (Announcement No. 48): 2 Trillion Parameter Models, Open-Source Exemption, API Access and What It Means for European Founders Using Kimi, Qwen and DeepSeekmean.ceo
  80. 92Beijing Just Copied Washington's Homework. Your Open Weights Now Need a Permission Slip - theCUBE Researchthecuberesearch.com
  81. 93China AI Export Controls: What They Mean for Open-Weight Modelsdevelopersdigest.tech
  82. 94How China's proposed AI export controls could affect open-weight ecosystem | Tech News - Business Standardbusiness-standard.com
  83. 95EU AI Act Summary: Deadlines and Duties in 2026ragsuite.de
  84. 96AI governance: GDPR and EU AI Act compliance | JustRelatejustrelate.com
  85. 97Anthropic Exec Warns Open-Source AI Safety Risk [2026]shattered.io
  86. 987 Best AI Governance Solutions for Enterprises in 2026 | Superblockssuperblocks.com
  87. 99EU AI Act 2026 Amendments: What Changed and When | Vanderburgh.itvanderburgh.it
  88. 100Client Alert - As AI moves ahead, European and Global dealmakers need to keep pace. - FisherBroylesfisherbroyles.com
  89. 101DeepInfer: DeepSeek Open-Sources Inference Engine - PromptZonepromptzone.com
  90. 102DeepInfer: High-performance inference framework for DeepSeek models | Hacker Newsnews.ycombinator.com
  91. 103Probably because it’s a discussion about DeepSeek and you didn’t include that in... | Hacker Newsnews.ycombinator.com
  92. 104DeepInfer: What DeepSeek Open-Sourced and What You Can Rundevelopersdigest.tech
  93. 105DeepSeek open-sources the inference engine behind its API. And Huawei gets equal billing with Nvidia. - The New Stackthenewstack.io
  94. 106DeepSeek DeepInfer Won't Run on Your RTX 5090. Here's What to Run Instead - DEV Communitydev.to
  95. 107Best Local LLM in October 2026 (Updated Monthly Methodology)app.stationx.net
  96. 108Protect enterprise coding agents with Cisco DefenseClaw and NVIDIA OpenShell - Cisco Blogsblogs.cisco.com
  97. 109GitHub Universe 2026: What AI Coding Agents Need Beyond Better Models – Zima Store Onlineshop.zimaspace.com
  98. 110Chrome DevTools 154: AI Agent Controls Explained [2026]shattered.io
  99. 1117 Best Enterprise ADEs for Secure Multi-Agent Coding (2026)gitkraken.com
  100. 112The Customer Is the Builder: How AI Coding Agents Are Rewriting the Economics of Softwarearxiv.org
  101. 113AI Cuts Coding Time 52%, Slop Hits 25% of PRsshattered.io
  102. 114Linux Foundation Newsletter: October 2026linuxfoundation.org
  103. 115New LF Research Survey Shows Generative AI Cuts Open Source Coding Time in Half, but 25% of Incoming Pull Requests are Considered AI Slopprnewswire.com
  104. 116New LF Research Survey Shows Generative AI Cuts Open Source Coding Time in Half, but 25% of Incoming Pull Requests are Considered AI Sloplinuxfoundation.org
  105. 117Linux Foundation survey finds faster AI coding alongside low-quality contributions | Superpower Dailysuperpowerdaily.com
  106. 118Configuration materielle LLM local : de 8 Go a 70B par VRAMpromptquorum.com
  107. 119vLLM Quickstart: High-Performance LLM Serving - in 2026 - Rost Glukhov | AI Systems & Infrastructureglukhov.org
  108. 120Private AI Workflow Automation: A 2026 Guide | Activepiecesactivepieces.com
  109. 121How I Made Local LLMs Up to 2.24× Faster on a 4GB NVIDIA GPUpub.towardsai.net
Índice
  1. 011. Key takeaways from the week
  2. 022. Trending projects of the week
  3. 033. New open models and datasets
  4. 044. Framework and tool updates
  5. 055. Licence and compliance changes
  6. 066. Community discussion hot spots
  7. 077. Getting started
  8. 088. References

1. Key takeaways from the week

Between Oct 17 and Oct 23, 2026, the open-source AI news was a mix of one stable serving release, a handful of model drops, a draft export rule and a large community debate. Five conclusions explain the week; each is supported in the chapter named in brackets, with every fact judged against Oct 24.

1. Attention went to the layer around the model, and star counts are only leads. According to CoddyKit snapshots, the terminal coding agent opencode stands at 219,400 stars, the code knowledge graph Graphify at 129,751 and the skills catalogue agentic-awesome-skills at 48,052; the Graphify and catalogue counts are from Oct 20 (inferred), while opencode's snapshot date is not stated. No source gives two snapshots of one repository, so weekly growth cannot be computed. vLLM has fewer stars than Graphify but a fork ratio of 25.1% against 9.6%. The window's one dated launch was Omnara, an open-source durable-agent runtime, on Oct 21. [Chapter 2]

2. The big open weights landed just before the window, and every benchmark is vendor-run. Meta published Muse Spark Open (816B total, 42B active) on Oct 15 and Reflection AI's Beam (501B, Apache 2.0) was reported on Oct 16, so both are pre-window. In the window, NVIDIA released Nemotron 3.5 Parse on Oct 17 and Bolt E4B on Oct 23 under OpenMDW-1.1. No Hugging Face dataset release dated Oct 17 to 23 appears in the material. [Chapter 3]

3. The serving layer produced one GA release and one narrow code drop. llm-d 1.0 reached general availability on Oct 20 with a stable v1 API, and its latency and throughput figures are all self-reported by Google, IBM, AWS and Red Hat. DeepSeek open-sourced DeepInfer, dated Oct 20 by secondary sources, under Apache 2.0, but it serves one model, runs offline only and was never benchmarked head-to-head against vLLM on the same hardware. [Chapter 4]

4. Licence terms and export rules, not weights, set who can use these models. The Muse Model License requires a separate agreement above $20M of gross revenue in 12 months for model-as-a-service sellers, about $1.7M a month ($20M / 12). China's Announcement No. 48 of Oct 16 proposes 40 technologies for its export catalogue; it is a draft with comments to Nov 15, while registration of listed exports has been in effect since Oct 16. [Chapter 5]

5. The community argued about a reference engine and about maintainer load. A Hacker News snapshot of the DeepInfer thread shows 2,330 points and 887 comments, but crawl date not stated, and the engine needs SM100 or Ascend 950 hardware with weights of about 510 GB. The Linux Foundation survey of Oct 20 reports respondent estimates that 25% of incoming pull requests are "AI slop" (31% at large projects), and only 35% of projects have a formal policy permitting GenAI use. [Chapter 6]

1.1 Projects at a glance

Project Type What changed Licence Status (Oct 24) Source
opencode (anomalyco) Terminal coding agent 219,400 stars; snapshot date not stated Not stated Reported; desktop app in beta CoddyKit
Graphify (Graphify-Labs) Code knowledge graph 129,751 stars on Oct 20 (inferred) Listed only as "Open Source" Reported CoddyKit
Omnara Durable-agent runtime Open-source launch, Oct 21 Not stated Launched Show HN; Emergent
Nemotron 3.5 Parse (NVIDIA) Document-parsing model Released Oct 17; ParseBench mean 75.20 OpenMDW-1.1; tokenizer MIT Weights on HF NVIDIA card
Nemotron 3.5 Bolt E4B (NVIDIA) Small language model Released Oct 23; 8B total, about 4B effective OpenMDW-1.1 Weights on HF (secondary) explainx.ai
Muse Spark Open (Meta) Open-weight model Published Oct 15 (pre-window); 816B / 42B active Muse Model License; $20M trigger Weights, gated miraflow.ai; ibl.ai
llm-d 1.0 (Red Hat, IBM, Google) Inference orchestration layer First stable release, Oct 20 Apache 2.0 GA MarkTechPost; AICoder
DeepInfer (DeepSeek) Inference engine Open-sourced, dated Oct 20 by secondary sources Apache 2.0 Shipping; one model, offline only Thaki Cloud; Developers Digest

2. Trending projects of the week

Chapter 1 gives the week's conclusions; this chapter supplies the project numbers behind them. Every star count comes from a trending-list blog, so it is discovery data ("according to X"), a dated snapshot and not a weekly gain. Counts from different pages are never compared.

2.1 Star snapshots at a glance

Item (maintainer, type) Key figure Snapshot date Status Source
anomalyco/opencode, terminal coding agent 219,400 stars; 29,300 forks Not stated Reported; desktop app in beta CoddyKit
Graphify-Labs/graphify, code knowledge graph 129,751 stars; 12,494 forks Oct 20 (inferred from) Reported CoddyKit
vllm-project/vllm, inference engine 94,304 stars; 23,649 forks Oct 20 (inferred) Reported CoddyKit
sickn33/agentic-awesome-skills, skills catalogue 48,052 stars; 7,012 forks; 2,715+ skills Oct 20 (inferred) Reported CoddyKit
wshobson/agents, plugin marketplace 41,320 stars; 4,396 forks Not stated (after Oct 20) Reported CoddyKit
OpenClaw (MIT) / Hermes Agent, Nous Research (MIT) 392,126 / 254,122 stars Oct 16 (GitHub API read), before the window Reported Glukhov
n8n / Dify / LangGraph, workflow and agent frameworks 208,240 / 159,167 / 43,675 stars Not stated (article dated Oct 22) Reported Activepieces, citing GitHub
Omnara (omnara-ai), durable agent runtime Open-source launch; licence not stated Oct 21 Launched (window event) Founder's Show HN; Emergent

Read each row against its own source only. CoddyKit's Oct 20 rows share one snapshot; OpenClaw and Hermes come from an earlier one. Licence and latest release are not given for opencode, Graphify, vLLM or wshobson/agents: CoddyKit lists Graphify's licence only as "Open Source". No source here gives two snapshots of the same repository, so no weekly star growth can be computed (Glukhov makes the same point: a delta needs two snapshots of your own).

2.2 The 100K-star tier: coding agents, context tools and an engine

opencode is a terminal coding agent with a read-only "plan" agent and a full-access "build" agent, installable through npm, Homebrew, pacman, mise or Nix; its README is in 24 languages and it has 20,677 commits. LLM Daily (Oct 20) says it gained over 1,300 stars in a single day. That is one newsletter's claim, not a GitHub figure.

Graphify builds a queryable graph of a codebase by deterministic tree-sitter parsing, across 40+ languages. It runs locally, and it installs hooks in Claude Code and Gemini CLI. The page quotes an 80% cut in agent token spend and, on the LOCOMO benchmark (n=300), recall@10 of 0.497 against 0.048 for mem0. It does not say who ran either test, so we treat both as unverified project-side claims.

vLLM returned to the list with disaggregated prefill/decode and 200+ model architectures. Its role in the serving layer and its download counts are in Chapter 4.

The one comparison the data allows is the fork ratio within CoddyKit's single Oct 20 page:

Repository Forks ÷ stars Ratio
Graphify 12,494 ÷ 129,751 9.6%
agentic-awesome-skills 7,012 ÷ 48,052 14.6%
vLLM 23,649 ÷ 94,304 25.1%

Stars show attention and forks show use: in CoddyKit's Oct 20 snapshot, vLLM has fewer stars than Graphify but a fork ratio 2.6 times higher (25.1% ÷ 9.6%).

This is our reading, since forks also include bookmarking. Even so, it is a reason not to rank projects by stars alone.

2.3 Skills catalogues, frameworks and the new entrants

Two skills lists disagree. HackerNoon (Oct 21) gives approximate counts "as of 2026-10-17": Superpowers 301k, Matt Pocock's skills 295k, ECC 283k, Addy Osmani's Agent Skills 108k. KDnuggets (Oct 21, count date not stated) gives 285.5K, 260.1K, 256.7K and 93.6K for the same four. The KDnuggets figures are 5% to 13% lower, for example (295 − 260.1) ÷ 295 ≈ 12%. A fall of that size is implausible within days, so the two lists probably use different methods or dates. We follow HackerNoon's dated list for the big four, as approximate, and we recommend checking GitHub directly. HackerNoon's smaller entries match CoddyKit: 48k for agentic-awesome-skills and 41k for wshobson/agents. KDnuggets describes ECC as 292 skills, 68 agents and 94 command shims, installed with [email protected]; the release date is not stated.

Agent frameworks. wshobson/agents bundles 94 plugins, 202 agents and 185 skills from one Markdown source for seven coding agents. For general frameworks, Activepieces (Oct 22) cites GitHub for n8n at 208,240 stars, Dify at 159,167 and LangGraph at 43,675. Hermes Agent and OpenClaw are the personal-agent leaders at 254,122 and 392,126 on Oct 16. Firecrawl (AGPL-3.0) is at 191,908 and AutoGPT at 187,598, whose mixed MIT and Polyform Shield licence is covered in Chapter 5.

Omnara, the window's one dated launch. Kartik of Omnara wrote that it is an open-source API for running durable agents. One API call creates an agent, which gets sandboxes, secrets, permissions and RBAC. State lives in Postgres, so agents survive restarts and "cost nothing while idle". He positions it as a self-hosted counterpart to Anthropic's Claude Managed Agents and the OpenAI Agents API. Emergent dates the launch to Oct 21, 2026 (secondary). Activepieces (Oct 22) notes that the blog gives no price, speed figure or licence text, that the repository shows 282 branches and 162 tags, and that its authors had not run it. It advises pinning a tag. Directory sites list rivals: Paperclip (MIT), Multica, NemoClaw and Omnigent, and starnet, an MIT desktop runtime last verified Oct 23. Chapter 6 captures no discussion of it.

Small repos from one list. Techninjaah counted these on Oct 18 and says all were created after mid-August 2026:

Repo Type Stars (Oct 18) Licence
browser-use/jev-ultrafast Browser agent 23.2k MIT
wheresryan22/anatomy Claude Code skill 15.5k MIT
yetone/magpie Model gateway for coding agents 15.4k MIT
jub0t/Concat Video editor with MCP server (beta) 8.6k AGPL-3.0
CopilotKit/OpenBot Self-hosted agent template (alpha) 6.6k MIT
Louis-CFM/coucou Agent monitor 5.5k MIT
tigerless-labs/agent-memory Markdown memory (v0.1) 4.2k MIT

OpenBot also needs a CopilotKit Intelligence licence (a free plan exists).

Judgement. The week's attention is in the layer around the model: harnesses, skills, memory and runtimes. The engine in the list, vLLM, is the one that people clearly build on. For a team, pick by licence and fork activity, and treat any number here as a lead to check on GitHub.

3. New open models and datasets

Chapter 2 showed which repositories drew attention this week; the weights that developers can actually download came mostly from two vendors, NVIDIA and Meta, with Reflection AI and KRAFTON adding smaller entries.

3.1 The week's open-weight releases

Item Key figure Date Status Source
NVIDIA Nemotron 3.5 Super VL 120B total / 12B active, 1M context, OpenMDW-1.1 Oct 15 Weights on HF NVIDIA card; date per shattered.io
NVIDIA Nemotron 3.5 Bolt 74B-A9B 74B / 9B, 256K, 24 GB 2-bit build Oct 15 Weights on HF NVIDIA card
NVIDIA Nemotron 3.5 Bolt E4B 8B total, ~4B effective, Q4_K_M Oct 23 Weights on HF explainx.ai
NVIDIA Dory1.0-4B 4B, 256K, 1/2/4 loops Oct 16 Weights on HF NVIDIA card
NVIDIA Nemotron 3.5 Parse ParseBench mean 75.20 Oct 17 Weights on HF NVIDIA card
Meta Muse Spark Open 816B / 42B, 1M, Muse Model License Oct 15 Weights (gated) miraflow.ai
Reflection AI Beam 501B / 23B, Apache 2.0 Oct 16 Reported shattered.io
KRAFTON Raon-1 mini preview 28.8B / 4.3B, Apache 2.0 Not stated Preview KRAFTON card

NVIDIA shipped five Nemotron 3.5-family open-weight releases between October 15 and 23, all under the OpenMDW License Agreement 1.1, while Meta released the largest weights of the week (816B) at a size few teams can host. Every benchmark below is vendor-run.

The window is Oct 17 to 23. Parse (Oct 17) and Bolt E4B (Oct 23) are window events; the Oct 15 and 16 releases are pre-window but drove the week's coverage.

3.2 NVIDIA: a ladder from 4 GB to 120B

NVIDIA's blog of October 21 presents Nemotron 3.5 Super VL and Bolt as part of a wider open-model push across language, retrieval, robotics and biology. Super VL (120B total, 12B active, up to 1M tokens, needs 4x H100 or 2x GB200) is the flagship. In NVIDIA's own table it trails DeepSeek-V4-Flash0731 on all four rows I compared: GPQA-Diamond 89.52 vs 89.6 (0.08 points), SWE-bench Verified 71.10 vs 75.4 (4.3 points), BrowseComp 78 vs 84.2 (6.2 points) and GDPval-AA v2 1211 vs 1382. Bolt 74B-A9B is the local-agent model, compressed from Super VL with NVIDIA's Star Elastic method. At 2 bits per weight, 74B would take 74 x 2 / 8 = 18.5 GB, but only routed-expert weights are 2-bit, so 24 GB is a budget. NVIDIA's table puts the BF16 build ahead of Qwen3.6-35B-A3B on Terminal-Bench 2.1 (53.93 vs 44.38, +21.5%) and BrowseComp (70.00 vs 48.74). Qwen's published MCP-Atlas score is 62.8, but NVIDIA measured 51.2 on the 500 public tasks, and Bolt scores 55.60. Against the published 62.8 Bolt would be 7.2 points behind, so treat that row as setup-dependent.

Bolt E4B followed on October 23: a post-train of Gemma 4 E4B-it, under OpenMDW-1.1, labelled "4GB" although its Q4_K_M file is about 6.2 GB, according to explainx.ai. NVIDIA's table (via explainx.ai) shows Tau2-Bench 52.32 vs 38.72 for the Gemma base, but RULER 64K of 85.76 vs 95.37 for Qwen3.5 4B.

Dory1.0-4B (released October 16, Q5_K_M GGUF, OpenMDW-1.1) is the most original release: a looped model that reuses one block 1, 2 or 4 times. NVIDIA's card gives SWE-bench Verified of 50.3, 59.5 and 61.8 at 1, 2 and 4 loops, against 54.7 for Qwen3.5-4B and 61.0 for Qwen3.5-9B. The step from 1 to 2 loops adds 9.2 points, 80% of the 11.5-point total (9.2 / 11.5), so 2 loops is the practical setting. Knowledge is the cost: AA-Omniscience stays near 10 at every loop count, versus 15 to 21 for the rivals. For deployment, vLLM and llama.cpp support was still an open pull request on the card. According to LLM Explorer, the BF16 repo had 3,062 downloads (snapshot date not stated; page "Updated 2026-10-21").

Nemotron 3.5 Parse, released October 17 on HF, is a document parser scoring a 75.20 ParseBench mean on 2,078 pages, with a tokenizer under MIT.

3.3 Meta, Reflection, KRAFTON and the Chinese community

Muse Spark Open was published October 15 by Meta: 816B total, 42B active, 1M-token context, BF16 and NVFP4 weights. Meta calls it the most capable US open-weight model, per miraflow.ai. The licence is the Muse Model License, which is not Apache 2.0 and carries a $20M revenue trigger for model-as-a-service businesses (terms in Chapter 5).

The hardware arithmetic shows the catch. The NVFP4 checkpoint is about 530 GB, and two 512 GB Mac Studios give 2 x 512 = 1,024 GB. Add a 1M-token KV cache of 64 GiB (about 69 GB) and the total is roughly 600 GB, which fits. Another source gives 266 GB, which equals 248 GiB, the full-attention figure in; I follow 64 GiB. Neither is first-party. The BF16 checkpoint is about 1.5 to 1.65 TB.

Hosted prices checked October 18 were $1.25 input and $4.25 output per million tokens on OpenRouter and Together AI, with cached input at $0.15. A call of 20,000 input and 2,000 output tokens costs 0.025 + 0.0085 = $0.0335, about 30 calls per dollar. Simplismart cites an open-weight median of $0.43 / $1.59, so Muse is about 2.9x and 2.7x higher (1.25 / 0.43; 4.25 / 1.59).

Benchmarks are Meta's. The Artificial Analysis index figure of 39 is Meta-reported and VentureBeat found no independent listing at launch, against 45 for GLM 5.3 and 44 for Kimi K3. Meta leads on MCP-Atlas (89.2) and trails Kimi K3 on Terminal-Bench 2.1 (76.4 vs 85.0). Simplismart's "#1 US open model" headline rests on that same vendor-reported table, and Simplismart sells inference for it. Reflection AI Beam: according to shattered.io, quoting the company, weights went live October 16 under Apache 2.0, with 501B total and 23B active parameters (23 / 501 = 4.6%), BF16, FP8 and NVFP4 formats and 40+ launch partners. This is the only source in the material, and it has no benchmarks, so Beam stays "reported".

Raon-1 mini preview from KRAFTON is a 28.8B-total, 4.3B-active MoE with 262,144-token context under Apache 2.0, labelled a preview whose specs may change. Access is on request, the release date is not stated, and KRAFTON ran the benchmarks, including an internal Korean test that is not public.

Chinese community highlights. The zh-ai-community October collection lists 11 entries, among them Qwen-Image-2.1-Turbo, MiniCPM-V 4.7, Step-5-Preview and Ling-3.1-flash, but gives no dates, sizes or licences. A newsletter anecdotally reports r/StableDiffusion users pairing Qwen Image 2.1 with Minimax H3 on 2026-10-19. DeepSeek-V4.1-Flash (MIT licence) is not a window release in the material; its release date is not stated. Its size differs by source, 552B per Thaki Cloud and 763B on the Hugging Face card as quoted by DEV Community; we follow the card. Its engine, DeepInfer, is covered in Chapter 4.

Datasets are the evidence gap. No Hugging Face dataset release dated 17 to 23 October appears in the material. The nearest items are ModelFit's CC BY 4.0 compatibility dataset (156 models, updated 2026-10-13, before the window), a daily Kaggle snapshot of Hub statistics, and NVIDIA's claim that Nemotron ships open data and recipes, with no dataset named.

4. Framework and tool updates

Chapters 2 and 3 covered the projects and models people were starring and downloading; this chapter covers the software that serves them. In the window (Oct 17–23, 2026) the serving layer produced one stable release, one narrow code drop and a run of vendor benchmarks, and none of the benchmarks was independent.

4.1 The week at a glance

Item Key figure Date Status Source
llm-d 1.0 (Red Hat, IBM, Google; Apache 2.0) First stable release, v1 API Oct 20 GA, window event MarkTechPost; AICoder
DeepInfer (DeepSeek; Apache 2.0) One model, offline only Oct 20 Shipping, window event Thaki Cloud; Developers Digest
vLLM and SGLang on TPU (Google, with Inferact and RadixArk) Lowest cost 2.01 cents per million tokens Oct 20 Preview customers Google Developers Blog
AMD megakernel inference paths (MI355X) 1.9x to 3.3x faster single-request decode Oct 20 Shipping; GPT-OSS-120B is preview AMD ROCm Blogs
MiniMax-M3.1 on MI350 Day-0 support, vLLM and ATOM Oct 22 Shipping AMD
Nunchux on MI355X (AMD-supported proof of concept) 23.2x faster finished 15 s video than SGLang Oct 19 Proof of concept AMD
LangChain, LangGraph, Microsoft Agent Framework Latest releases Oct 13–16 Before window Shipping, no window release found Developers Digest

4.2 llm-d 1.0: cache-aware routing reaches a stable API

llm-d released version 1.0 at PyTorch Conference North America on Oct 20, 2026. It is a Kubernetes-native layer that sits above vLLM or SGLang and turns many model servers into one pool; it is not itself a model server. Red Hat, IBM and Google Cloud lead maintenance. The project has over 500 contributors from more than 25 organizations, joined the CNCF Sandbox on March 12, 2026, and is Apache 2.0 licensed (according to MarkTechPost). Cache-aware routing, KV-cache offload and prefill/decode disaggregation already existed. What 1.0 adds is production operation:

  • priority- and fairness-aware flow control, so bursty agents cannot starve interactive users;
  • router high availability with a hot standby, plus DisaggregatedSet, which rolls prefill and decode pools together;
  • a stable v1 configuration API;
  • session-aware routing and Responses API state for agents.

The router tracks which replica holds each cached prefix, weighs load and predicted latency, and sends each agent step to the replica that already holds its context. The results below come from the project and its adopters. MarkTechPost states that all figures are self-reported, and AICoder adds that none is independent.

Claim (all self-reported) Setup Who reported
Median TTFT down more than 85%, throughput 2.4x Agentic coding, Ironwood TPU, prefix routing plus host offload vs a plain Kubernetes Service Google
Prefix-cache hit rate 35% to 70% (2.0x); TTFT down more than 35% Gemini platform on GKE Inference Gateway Google
Throughput 2.9x across 3 clusters, 99.9% success 17,000-node GKE benchmark Google
Up to 3,000 concurrent agents on 544 H100s; ~98% prefix hits; ~$0.11 per million tokens; 11.5x cheaper than proprietary IBM Research, open models IBM
Up to 70% more tokens per second than standard vLLM SageMaker HyperPod, with prefill/decode disaggregation AWS

IBM's setup works out to 3,000 ÷ 544 ≈ 5.5 agents per GPU. Zenteiq's 4x claim checks out: 5.97 ÷ 1.47 ≈ 4.06. The Red Hat release adds that GLM 5.2 (about 753B parameters) peaked at 6.6 million output tokens per minute and was 5 to 10 times cheaper per token than commercial APIs at cloud rental rates (vendor-reported). The GitHub v1.0.0 notes admit that not every tracked goal shipped.

llm-d 1.0 is the week's one GA infrastructure release: a stable API and day-2 features for self-hosted agent serving. Its numbers are all vendor or adopter measurements.

4.3 DeepInfer: a reference engine, not a drop-in vLLM

DeepSeek open-sourced DeepInfer on Oct 20, 2026 (Thaki Cloud; the repository's release date is not stated in the material) under Apache 2.0, calling it the framework that powers its production services. Per the README it is narrow:

  • Model: only DeepSeek-V4.1-Flash.
  • Hardware: NVIDIA SM100 and Huawei Ascend 950; Hopper is dropped.
  • Mode: offline batch only, with no HTTP server.
  • Left out: a KV-cache system, prefill/decode disaggregation and replica load balancing.

It was built primarily on vLLM, with inspiration from SGLang and TensorRT-LLM. vLLM publicly thanked DeepSeek and said it will draw on DeepInfer's ideas (according to daily.dev). The name is easy to mix up. DeepInfra is a separate hosted-API company, and deepinfer.org is an unrelated medical-imaging project whose "version 1.2" one source mistakenly folds in; we ignore that item.

Benchmark claims. DeepSeek's own charts were measured on 4 SM100 GPUs for prefill and 64 for decode in one scale-up domain; the README's accuracy table (99.9% AIME 2026, 93.4% GPQA Diamond, 42.6% HLE-Full) is vendor-reported and "indicative rather than exact". The charts include no run of vLLM or SGLang on the same hardware, so the DEV Community comparison says outright that it is not a benchmark. Trending Topics reports no concrete performance figures and no Ascend benchmarks. We follow the README, which does contain SM100 charts, and agree there is no head-to-head result. The one cost figure, about $38 revenue per GPU-hour (off-peak pricing) and 155 trillion tokens per day per cluster, comes from a paywalled Substack citing a DeepSeek Q&A; treat it as reported and unverified.

This is a reference design, not a replacement. For general serving, vLLM still offers an API server and a wide model list, and its Ascend guide for V4.1-Flash needs an upstream revision from Sept 11, 2026 or later.

4.4 Accelerator results and agent frameworks

All of AMD's window results are vendor-run or vendor-supported, and each compares against a baseline of the vendor's choosing.

AMD megakernels (Oct 20). AMD open-sourced optimized paths for Qwen3.8-27B, Qwen3.8-Flash-Next and GPT-OSS-120B on one MI355X, measured at batch 1 on GSM8K with speculative decoding. Throughput figures are for a single request, not a loaded server:

Model Tokens/s Speedup and baseline
Qwen3.8-27B ~1,100 2.0x ATOM regular path
Qwen3.8-Flash-Next ~750 3.3x ATOM regular path
GPT-OSS-120B (preview) ~1,470 1.9x fastest stock vLLM tested; 1.6x with the same drafter

All rows: AMD ROCm Blogs. The implied GPT-OSS baseline is 1,470 ÷ 1.9 ≈ 770 tokens/s. AMD also gave Day-0 MiniMax-M3.1 support on MI350 on Oct 22, with "mono decode" cutting per-token latency 3.2x at one request but only 1.5x at sixteen versus the same server with it off. The gain shrinks as concurrency rises. Nunchux's 15-second video went from 150.5 s to 6.49 s, and 150.5 ÷ 6.49 ≈ 23.2x. It also reported 18.5% to 19.4% lower generation latency than NVIDIA's separately published B300 results, with MP4 encoding excluded from that comparison.

Google TPU (Oct 20). Google launched PyTorch-native vLLM and SGLang backends on TPU via TorchTPU, developed with Inferact and RadixArk; both run at preview customers, and Meta says SGLang-TorchTPU runs in production. Google reports 2.01 cents per million tokens for Qwen 3.5 on Ironwood, submitted to SemiAnalysis InferenceX, but gives no baseline or setup in the material.

Engine comparisons. According to Modern DataTools (as of Oct 19), vLLM, SGLang and TensorRT-LLM are all Apache-2.0. Weekly PyPI downloads were 423.8k for vLLM and 199.2k for SGLang, and TensorRT-LLM's 2.7k is not comparable because it ships differently. Modular's claim of 5.5x over vLLM on Kimi K2.5 dates from May 18 and has no published harness. An Oct 18 SEO post repeating a 2024 paper's 3 to 4x SGLang TTFT win adds nothing new.

Agent frameworks. The material shows no in-window release. As of Oct 18, LangChain Python 1.4.6 (Oct 14) and TypeScript 1.5.18 (Oct 16), LangGraph 1.2.16 (Oct 16) and Microsoft Agent Framework Python 1.22.0 (Oct 15) were current, all MIT. A CrewAI "past version 1.15" claim has no date.

5. Licence and compliance changes

Chapter 4 covered the engines that run open models; this chapter covers the terms those models ship under and the rules that decide whether they can cross borders. Most licence events fall on Oct 15–17, so each carries its own date.

5.1 Licence terms in the week's releases

Item Key figure Date Status Source
Meta Muse Spark Open, Muse Model License $20M revenue trigger for model-as-a-service; attribution Oct 15 (before window) In effect ibl.ai; Zentor
Reflection Beam Apache 2.0; 501B total / 23B active Oct 16 (before window) In effect shattered.io, quoting Reflection
NVIDIA Nemotron 3.5 Parse OpenMDW-1.1; tokenizer MIT Oct 17 (window) In effect Hugging Face card
DeepSeek DeepInfer Apache 2.0 Oct 20 (window) In effect Thaki Cloud
AutoGPT MIT, plus Polyform Shield in autogpt_platform Snapshot Oct 16; split date not stated In effect Glukhov
China Announcement No. 48 40 technologies, 23 in AI Oct 16 Draft; registration in effect CellCog; Mean CEO

Muse Model License. Meta published Muse Spark Open (816B total, 42B active) on Oct 15, two days before the window. Three terms matter. Licensees must display "Built with Muse Spark Open". If a licensee or affiliate sells third parties access to AI models and aggregate gross revenue "exceeds twenty (20) million US dollars" in any consecutive 12 months, it must notify Meta and sign a separate agreement. A usage policy bars illegal activity, malware and military or weapons use. Zentor adds that internal use and non-model-as-a-service products are excluded; ibl.ai's headline paraphrases the trigger more loosely ("an AI-model product"), and we follow the narrower body text. The arithmetic: $20M ÷ 12 ≈ $1.7M of gross revenue a month, so the clause bites hosts and API resellers, not application builders. Llama 3.3 uses a different trigger, 700 million monthly active users. Either way, the grant is conditional.

Permissive releases. Reflection says Beam's weights are "available across platforms, with open weights under the Apache 2.0 license" (via shattered.io, an aggregator). NVIDIA's cards state OpenMDW-1.1. DeepSeek's DeepInfer engine is Apache 2.0, released Oct 20, according to Thaki Cloud. A licence name does not settle openness: the OSI's Open Source AI Definition (published Oct 28, 2024) also asks for training code and data information.

Licence landscape and relicensing. According to GEO Toolbox, verified Sep 7 and so not re-checked in the window, GLM-5.3 ships under a custom licence while GLM-5.2 was MIT (only GLM-5.3-Flash stayed MIT) and Kimi K3 uses a custom Kimi K3 License. The date of the GLM switch is not stated. For venture-funded relicensing, the only case is AutoGPT: MIT outside autogpt_platform, Polyform Shield inside, which "permits use but reserves the code's commercial value to the producer" (blog snapshot Oct 16). No relicensing event dated Oct 17–23 appears in the material.

5.2 China's draft export catalogue

On Oct 16 China's Ministry of Commerce (MOFCOM) and Ministry of Science and Technology (MOST) published Announcement No. 48, one day before the window. We have it only through secondary coverage, not the official text. It proposes 40 technologies for the export catalogue: AI 23 + solar 12 + biomedicine 5 = 40, of which 14 banned and 26 restricted (14 + 26 = 40). Status: draft, comments close Nov 15, 22 days after Oct 24. One part is in effect: from Oct 16, exporters must register transfers of listed technologies.

According to CellCog, a large model's core technology (weights, checkpoints, code, training methods) is restricted if it meets any one test: 10^26 training FLOPs, 2 trillion parameters, or a global top-10 rank. Agents have separate tests: chains of 20 or more steps, 60 or more agents, or 200 or more tools at 90% success. Other outlets confirm the model tests. The announcement names no models. AP (via Mean CEO) and Bloomberg (via theCUBE) both cite Kimi K3 and Qwen3.8-Max as examples. GEO Toolbox puts K3 at 2.8T parameters, so 2.8 ÷ 2 = 1.4× the line.

The draft separates using a Chinese model from moving it: already-public weights, APIs, apps, SaaS and on-device use are outside, while overseas deployment of a restricted model is an export and future open-sourcing needs a filing.

MOFCOM's Q&A says open-sourcing qualifies for automatic licensing, "report and export immediately". Dean W. Ball, quoted by The Decoder (via Developers Digest), calls this "the optionality to shut down future open-weight models at will". Because the top-10 test is judged at export time, theCUBE argues, it tightens as models improve; that is commentary, not draft text.

Exposure, per Vercel's AI Gateway index (via Mean CEO, September traffic): open-weight models carried 71.5% of tokens and about 23% of spend. DeepSeek, Z.ai and Moonshot held 58%, 7.2% and 3.6% of tokens, so 58 + 7.2 + 3.6 = 68.8%. Their spend shares (6.6 + 4.5 + 13.2 = 24.3%) exceed the 23% total, so treat the spend figures as approximate.

5.3 EU rules and enterprise policy

The EU changed no rule inside the window in this material, so the current state is: Regulation (EU) 2026/1744 (the Digital Omnibus on AI) was adopted Jul 8, published Jul 24 and in force Jul 27, 2026. General-purpose AI duties have applied since Aug 2, 2025, and Article 50 transparency duties since Aug 2, 2026, including for open source. Upcoming: Dec 2, 2026 (39 days away) brings two new bans and marking for earlier systems, then Dec 2, 2027 for Annex III high-risk systems and Aug 2, 2028 for Annex I products. A client alert dated Oct 19 cites the one open-source carve-out: Article 25(4) contracts exempt certain free and open-source inputs. Fines reach €35M or 7% of turnover for prohibited practices and €15M or 3% for other breaches.

Enterprise positions were reported, not binding. Microsoft told customers on Oct 19 to treat AI agents as potential "insider threats" (TechCrunch, via LLM Daily). Anthropic's Guillaume Princen said on Oct 14, before the window, that open models carry "more risk" by definition, though Anthropic does not seek a ban (via shattered.io, citing Bloomberg).

For builders, nothing running today breaks. The risk is supply: licence terms like Muse's can reprice a business, and Beijing's draft can delay the next Chinese frontier release.

6. Community discussion hot spots

Chapter 5 covered the licence terms that bind open-weight releases. This chapter covers what developers and maintainers said about those releases in the window. Everything below is anecdotal or self-reported unless marked otherwise. Counts are page snapshots, and a snapshot taken at one time is not comparable with one taken at another.

6.1 Discussion map

Item Key figure Date Status Source
Hacker News thread "DeepInfer: High-performance inference framework for DeepSeek models" 2,330 points, 887 comments Snapshot shown as "2 days ago"; crawl date not stated Reported (page snapshot) Hacker News
Same thread, other snapshots 686 points / 239 comments; over 2,100 / 800; over 2,200 points First undated; last two Oct 21 Reported (not comparable with each other) PromptZone; Developers Digest; DEV Community
Google Trends, "deepinfer" vs "vllm" vs "sglang" 23 vs 13 vs 4 (index) Oct 21 Reported (one blogger's reading) Developers Digest
Quoted DeepSeek serving economics 155 trillion tokens/day per cluster; $38 per card-hour (off-peak) Date not stated Unverified, second-hand HN comment; Wukong Substack
Linux Foundation Research maintainer survey 25% of incoming PRs "AI slop"; 31% at large projects Oct 20 Published; respondent estimates Linux Foundation
Same survey, contribution volume 59% of maintainers report growth; 69% at large projects Oct 20 Published; respondent estimates Linux Foundation
Same survey, policy 35% of projects have a formal policy permitting GenAI use; 32% have none and no plan Oct 20 Published; respondent estimates Linux Foundation
Single-developer llama.cpp tuning 2.24× faster generation (Qwen3.5-4B); about 59 tokens/s (Gemma 4 E2B) Date not stated Author's own run, one GTX 1650 Ti Towards AI

6.2 DeepInfer versus vLLM: the thread's two arguments

The loudest thread was Hacker News's reaction to DeepSeek's DeepInfer release, dated Oct 20 by Thaki Cloud and by a DEV Community post. Chapter 4 owns the engine facts. This section covers what people argued about.

Argument one: is it a "game changer" or a vLLM fork? DeepSeek's README says the engine was built mainly on vLLM, with ideas from SGLang and TensorRT-LLM. Commenter Tepix asked why a vLLM-based project deserves the label. Commenter cmrdporcupine replied that vLLM and SGLang can already serve V4.1 Flash on broader hardware, "less efficiently, I'm sure". A DEV Community comparison reached a similar view without running a benchmark: DeepInfer is offline-only, supports one model and lacks a KV cache system, so it is "not a drop-in replacement". According to daily.dev, the vLLM project thanked DeepSeek and said it would draw on DeepInfer's ideas. Nobody in the material ran a same-hardware head-to-head, and the README charts use 4 GPUs for prefill and 64 for decode.

Argument two: what the economics prove. One top comment quoted a Zhihu post: 155 trillion tokens/day per cluster and $38 revenue per card-hour. Replies split. One said it undercuts the claim that inference loses money. Another noted that inference had long looked profitable because 20+ providers sell DeepSeek or GLM on OpenRouter. A substack author repeats the two figures as coming from DeepSeek's "official" Q&A, but we found no primary page, so they stay unverified. One commenter put B200 rental at "~$6-14/hour". Over the 64-GPU decode setup that gives 64 × $6 = $384 to 64 × $14 = $896 per hour. We do not set this against the $38 figure, because the card types are not stated.

Model comparisons stayed anecdotal. A sub-thread compared DeepSeek V4.1 Flash with Claude Haiku 5.5. One user said Flash cannot be trusted unsupervised as an agent. Another cited Artificial Analysis for similar intelligence scores but faster time-to-first-token for Flash, and added "on one set of private benchmarks" as a caveat. Developers Digest also reported a hardware question that nobody answered: what an Ascend 950 costs.

The week's largest thread was not about a benchmark, because none was published. It was about whether a model team's own serving stack is a reference to study or a product to run.

6.3 Maintainers: the "AI slop" numbers

The only primary-source community data in the window came from the Linux Foundation. LF Research published Navigating Open Source Software Development in the Generative AI Era on Oct 20, 2026, sponsored by Red Hat and presented at All Things Open (Oct 19–20). All figures are respondent estimates.

  • Volume: 59% of maintainers report more contributions since GenAI spread, rising to 69% at large projects.
  • Quality: 25% of incoming pull requests are estimated to be low-quality "AI slop", 31% at large projects.
  • Trust: 71% agree GenAI lowers barriers to entry, yet 53% disagree that it improved community trust.
  • Time: respondents estimate 52% less time on code authoring and 19% less on proposal discussions, while 21% say high-complexity tasks took longer.
  • Governance: only 35% of projects have a policy permitting GenAI use, 32% have none and no plans, and 61% of contributors fully review and test AI-generated code before submitting.

Two cautions apply. The release says "up to 50%" in its summary but gives 52% for code authoring in the body, and we follow the body. Superpower Daily notes the announcement gives no sample size or field dates, and that the figures are not timed tests. The PR Newswire copy is identical to the LF release. According to tech-insider.org, curl maintainer Daniel Stenberg said maintainers feel "strained, overloaded and brought to the brink"; the quote's date is not stated.

The 52% saving on writing code sits beside a 25% noise rate on reviewing it. Writing time is cheap and reviewing time is not, so maintainers carry the cost. The survey's own recommendation is written contribution policies and contributor-side testing and disclosure.

6.4 Local models: what hobbyists actually ran

The material has no Reddit thread, so the local-model picture comes from developer blogs, which are single-author and mostly undated.

  • A DEV Community author wrote that most readers cannot run DeepInfer. It needs SM100 (datacenter Blackwell) or Ascend 950, and the weights are about 510 GB. An RTX 5090 reports SM120. The realistic local route is a quantized build in llama.cpp, Ollama or LM Studio. The same post says an unofficial SM80 port (HalfVulpes/Deepinfer-SM80) appeared in the thread but is untested and does not shrink the weights.
  • One author measured a GTX 1650 Ti (4 GB) with llama.cpp. Placing all layers on the GPU made Qwen3.5-4B 2.24× and Qwen3-4B 2.07× faster, and Gemma 4 E2B reached about 59 tokens/s. This is a single machine and a single author.
  • A hardware guide gives a rule of thumb of about 0.6 GB of VRAM per billion parameters at 4-bit. For a 70B model that is 70 × 0.6 = 42 GB, close to the guide's "about 40 GB" and above a single 24 GB RTX 4090. Its date is not stated.
  • StationX's October guide declines to name a best local model and advises matching the model to the task. Its benchmark map was last verified in May 2026.

For a solo developer the practical lesson from the DeepInfer thread was negative: the release changed what can be studied, not what can be run at home. Anyone choosing a local stack should start from VRAM and a quantized model rather than from the week's headline engine.

7. Getting started

Chapters 2–6 covered trending projects, new weights, serving software, licences and community debate. This chapter turns them into a try-list by use case, a reader-by-reader table of what changed and what to do, and a dated watch-list. It uses only facts from earlier chapters and is not legal advice.

7.1 Try-list by use case

Use case Option Licence Caveat Evidence
Serve agents on Kubernetes llm-d 1.0, GA Oct 20 Apache 2.0 All latency and throughput figures are self-reported by Google, IBM, AWS or Red Hat —
Study a production serving stack DeepInfer, dated Oct 20 Apache 2.0 One model (DeepSeek-V4.1-Flash), offline only, SM100 or Ascend 950; no same-hardware vLLM comparison —
Run models at home A quantized build in llama.cpp, Ollama or LM Studio Per model About 0.6 GB of VRAM per billion parameters at 4-bit, so 70B needs about 42 GB (70 x 0.6); guide undated —
Agents Omnara (launched Oct 21); LangGraph 1.2.16 (Oct 16) Omnara not stated; LangGraph MIT Activepieces had not run Omnara and advises pinning a tag —
Models Nemotron 3.5 Bolt 74B-A9B; Dory1.0-4B OpenMDW-1.1 The 24 GB build is a budget, not 74 x 2 / 8 = 18.5 GB; Dory's vLLM and llama.cpp support was an open pull request; benchmarks are NVIDIA-run —
Models at scale Muse Spark Open (816B / 42B active) Muse Model License $20M revenue trigger for model-as-a-service; NVFP4 checkpoint about 530 GB —
Datasets None dated Oct 17 to 23 in the material CC BY 4.0 for ModelFit's compatibility dataset ModelFit's dataset (156 models) was updated Oct 13, before the window —

7.2 What changed, and what it means by reader

Reader What changed Implication Evidence
Application developers Attention moved to harnesses, skills, memory and runtimes; star counts conflict between lists (KDnuggets 5% to 13% lower than HackerNoon for the same four skills repos) Choose by licence and fork activity, and verify counts on GitHub —
Platform and infrastructure teams llm-d 1.0 made cache-aware routing a stable v1 API; AMD and Google results are vendor-run Pilot llm-d on your own workload and treat published gains as claims —
Companies hosting or reselling models Muse's clause bites at about $1.7M of gross revenue a month ($20M / 12); China's draft catalogue lists 40 technologies Read the licence before building a hosted product and track the Nov 15 comment deadline —
Researchers Dory's step from 1 to 2 loops adds 9.2 of 11.5 SWE-bench Verified points (80%); no dataset appeared in the window Study DeepInfer and Dory as designs; ask for independent runs —
Maintainers The LF survey estimates 25% of incoming pull requests are low-quality (31% at large projects) Write a contribution policy; only 35% of projects have one permitting GenAI use —

This week's releases changed what can be studied, licensed and governed more than what can be run at home: the biggest weights need hundreds of gigabytes, the biggest engine serves one model, and every performance number came from its own vendor.

The practical order for a team is therefore: read the licence, check whether the hardware fits, and only then trust a benchmark. EU duties for earlier systems arrive on Dec 2, 2026, 39 days from Oct 24, so teams that ship to Europe should plan marking and transparency work now.

7.3 Key dates

Dates already past on Oct 24, 2026 are marked "In effect"; later dates are "Upcoming".

Date Event State on Oct 24, 2026 Source
Jul 27, 2026 EU Regulation 2026/1744 (Digital Omnibus on AI) in force In effect Vanderburgh
Aug 2, 2026 EU Article 50 transparency duties apply, including for open source In effect RAGSuite
Oct 15, 2026 Muse Spark Open and Nemotron 3.5 Super VL and Bolt 74B published In effect ibl.ai; NVIDIA
Oct 16, 2026 China Announcement No. 48 published; registration of listed exports starts In effect (catalogue is a draft) Mean CEO
Oct 17, 2026 Nemotron 3.5 Parse released In effect NVIDIA
Oct 20, 2026 llm-d 1.0 GA; DeepInfer open-sourced; LF Research survey published In effect AICoder; Thaki Cloud; Linux Foundation
Oct 21, 2026 Omnara open-source launch In effect Emergent
Oct 23, 2026 Nemotron 3.5 Bolt E4B released In effect explainx.ai
Nov 15, 2026 Comments on Announcement No. 48 close (22 days away) Upcoming Mean CEO
Dec 2, 2026 EU two new bans and marking for earlier systems (39 days away) Upcoming Vanderburgh
Dec 2, 2027 EU Annex III high-risk rules Upcoming Vanderburgh
Aug 2, 2028 EU Annex I product rules Upcoming Vanderburgh

8. References

This document draws on the following 77 sources, listed in the order they are first cited.

  1. GitHub Trending October 2026: From a 219K-Star Open Source Coding Agent to a 163K-Star AI Agency — 2 Repos That Prove the Agent Era Is Now an Industry — coddykit.com
  2. GitHub Trending October 2026: From a 130K-Star Knowledge Graph to a 48K-Star Skills Catalog — 3 Repos That Prove AI Agents Need Memory Structures, Not Just Prompts — coddykit.com
  3. Show HN: Omnara – Open-Source Alternative to Claude Managed Agents | Hacker News — news.ycombinator.com
  4. Omnara Launches Open-Source Alternative to Claude Agents — emergent.sh
  5. Meta Muse Spark Open Explained: 816B Open-Weight MoE Benchmarks, Hardware Math and License (2026) — miraflow.ai
  6. Reflection Beam Open Weights: Apache 2.0 License 2026 — shattered.io
  7. nvidia/Nemotron-3.5-Parse · Hugging Face — huggingface.co
  8. Nemotron 3.5 Bolt E4B: 4GB Open Model vs Qwen3.5 4B | explainx.ai Blog | explainx.ai — explainx.ai
  9. llm-d 1.0 ships: the Kubernetes-native open-source distributed inference stack led by Red Hat, IBM and Google hits production readiness, with vendors reporting 3,000 self-hosted coding agents at 5-10x lower cost than commercial APIs — AICoder — aicoder.com
  10. Google Cloud Ships llm-d 1.0 With Cache-Aware Routing for TPU and GPU Fleets - MarkTechPost — marktechpost.com
  11. llm-d v1.0: State-of-the-art inference, ready for Day 2 | llm-d — llm-d.ai
  12. DeepSeek Opens Its In-House Inference Engine: DeepInfer and the ‘Model-Specialized Kernels + Ascend’ Strategy - Thaki Cloud Tech Blog ThakiCloud 다키클라우드 기술 블로그 — thakicloud.com
  13. DeepInfer: What DeepSeek Open-Sourced and What You Can Run — developersdigest.tech
  14. DeepInfer vs vLLM: DeepSeek's New Engine Is Not a Drop-In Replacement - DEV Community — dev.to
  15. Meta's Muse Spark Open Is Open-Weight, Not Open Source. — ibl.ai
  16. China AI Export Controls: 2T Models and Agents Listed | CellCog — cellcog.ai
  17. China AI Export Controls Draft (Announcement No. 48): 2 Trillion Parameter Models, Open-Source Exemption, API Access and What It Means for European Founders Using Kimi, Qwen and DeepSeek — mean.ceo
  18. DeepInfer: High-performance inference framework for DeepSeek models | Hacker News — news.ycombinator.com
  19. DeepSeek DeepInfer Won't Run on Your RTX 5090. Here's What to Run Instead - DEV Community — dev.to
  20. New LF Research Survey Shows Generative AI Cuts Open Source Coding Time in Half, but 25% of Incoming Pull Requests are Considered AI Slop — linuxfoundation.org
  21. GitHub Trending October 2026: From a 41K-Star Universal Plugin Marketplace to the Death of Discovery — When 14 Out of 15 Trending Repos Have Already Been Covered — coddykit.com
  22. Trending Open Source AI Projects on GitHub, October 2026 - Rost Glukhov | AI Systems & Infrastructure — glukhov.org
  23. Omnara: Open-Source Claude Managed Agents Alternative — activepieces.com
  24. LLM Daily: October 20, 2026 • Buttondown — buttondown.com
  25. Awesome Agent Skills: 49 Skills for Better AI-Assisted Coding — hackernoon.com
  26. 5 Best GitHub Repositories for AI Agent Skills - KDnuggets — kdnuggets.com
  27. 5 Best Open Source Claude Managed Agents Alternatives in 2026 — openalternative.co
  28. starnet: Open Source Alternative to Claude Managed Agents — opensourcealternatives.to
  29. 8 Trending GitHub Repos for AI Developers (October 2026) — techninjaah.substack.com
  30. nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 · Hugging Face — huggingface.co
  31. Nvidia Nemotron 3.5: 120B Open Model Hits PCs 2026 — shattered.io
  32. nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-BF16 · Hugging Face — huggingface.co
  33. nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-GGUF · Hugging Face — huggingface.co
  34. KRAFTON/Raon-1-mini-preview · Hugging Face — huggingface.co
  35. NVIDIA Open Models Advance Europe’s Sovereign Intelligence Across Industries | NVIDIA Blog — blogs.nvidia.com
  36. nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16 · Hugging Face — huggingface.co
  37. NVIDIA Nemotron Labs Dory1.0 4B BF16 by nvidia — VRAM 8GB, 256K context | LLM Explorer — llm-explorer.com
  38. Muse Spark Open: Benchmarks, Architecture & Deployment — simplismart.ai
  39. Meta’s 816B Muse model reaches desktops — with a hundreds-of-gigabytes catch | OpenTools — opentools.ai
  40. Muse Spark Open: Meta’s Open Model & Pricing | TechPilot.ai — techpilot.ai
  41. 2026 October 🌰 China Open Source Highlights - a zh-ai-community Collection — huggingface.co
  42. Local LLM Compatibility Dataset (2026) | ModelFit — modelfit.io
  43. 🤗 Hugging face models trending — kaggle.com
  44. Announcing New vLLM and SGLang Inference Engines on TPU - Google Developers Blog — developers.googleblog.com
  45. Bringing Ultra-Fast, Interactive LLM Inference to AMD Instinct™ MI355X GPUs — ROCm Blogs — rocm.blogs.amd.com
  46. MiniMax-M3.1 on AMD Instinct GPUs — amd.com
  47. From Prompt to Playback: Nunchux Turns AMD Instinct™ GPU Performance into Responsive Video AI — amd.com
  48. LangChain (agents): features, install and latest version (Oct 2026) — developersdigest.tech
  49. Microsoft Agent Framework vs LangGraph: features, install and latest version (Oct 2026) — developersdigest.tech
  50. llm-d 1.0 makes distributed AI inference production-ready - Techzine Global — techzine.eu
  51. Despite the U.S. Ban, DeepSeek Open-Sources Its Inference Engine | Trending Topics — trendingtopics.eu
  52. DeepSeek open-sources DeepInfer, its in-house inference... — daily.dev
  53. What Is DeepInfer? DeepSeek's Open-Source Engine — activepieces.com
  54. Reflections on DeepSeek Open-Sourcing Its Inference Engine, DeepInfer — wukong123.substack.com
  55. SGLang vs TensorRT-LLM vs vLLM Compared | Modern DataTools — modern-datatools.com
  56. Modular MAX vs vLLM: 5.5x Faster on Kimi K2.5 2026 — shattered.io
  57. vLLM vs SGLang Production Benchmarks 2026 & KV Guide | Blog — wise-hustlers.com
  58. LangGraph vs CrewAI: Which Agent Framework to Use in 2026? — techiehub.blog
  59. Meta Muse Spark Open: An Open-Weight Agent Model You Can Run on a Desktop | Zentor Blog — zentor.ai
  60. AI Model Licenses: Open Weight Explained — bettersorted.de
  61. Open Weights vs Open Source: The Real Difference (2026) — geotoolbox.ai
  62. The 10 Best Open-Source LLMs in September 2026 (Ranked) — geotoolbox.ai
  63. China’s AI export control announcement raises more questions than it answers (Ctrl+AI+Reg - 19 October 2026) — techieray.substack.com
  64. China AI Export Controls: What They Mean for Open-Weight Models — developersdigest.tech
  65. Beijing Just Copied Washington's Homework. Your Open Weights Now Need a Permission Slip - theCUBE Research — thecuberesearch.com
  66. EU AI Act 2026 Amendments: What Changed and When | Vanderburgh.it — vanderburgh.it
  67. EU AI Act Summary: Deadlines and Duties in 2026 — ragsuite.de
  68. Client Alert - As AI moves ahead, European and Global dealmakers need to keep pace. - FisherBroyles — fisherbroyles.com
  69. Anthropic Exec Warns Open-Source AI Safety Risk 2026 — shattered.io
  70. DeepInfer: DeepSeek Open-Sources Inference Engine - PromptZone — promptzone.com
  71. How I Made Local LLMs Up to 2.24× Faster on a 4GB NVIDIA GPU — pub.towardsai.net
  72. Probably because it’s a discussion about DeepSeek and you didn’t include that in... | Hacker News — news.ycombinator.com
  73. Linux Foundation survey finds faster AI coding alongside low-quality contributions | Superpower Daily — superpowerdaily.com
  74. New LF Research Survey Shows Generative AI Cuts Open Source Coding Time in Half, but 25% of Incoming Pull Requests are Considered AI Slop — prnewswire.com
  75. AI Cuts Coding Time 52%, Floods Open Source With Slop — tech-insider.org
  76. Configuration materielle LLM local : de 8 Go a 70B par VRAM — promptquorum.com
  77. Best Local LLM in October 2026 (Updated Monthly Methodology) — app.stationx.net
Página web interactiva · desplázate dentro del marco Abrir la página completa ↗

Generated with Divrite — este trabajo lo ha producido una IA a partir de la instrucción de arriba y puede contener errores. Comprueba las fuentes citadas antes de basarte en él.

Funciones relacionadas

Haz tu propia pregunta

Divrite la investiga a fondo, contrasta las cifras clave con sus fuentes y la convierte en una presentación, un informe o una página web.