Files
ietf-draft-analyzer/data/reports/blog-series/data/deep-analysis-round2.md
Christian Nennemann d6beb9c0a0 v0.3.0: Gap-to-Draft pipeline, Living Standards Observatory, blog series
Gap-to-Draft Pipeline (ietf pipeline):
- Context builder assembles ideas, RFC foundations, similar drafts, ecosystem vision
- Generator produces outlines + sections using rich context with Claude
- Quality gates: novelty (embedding similarity), references, format, self-rating
- Family coordinator generates 5-draft ecosystem (AEM/ATD/HITL/AEPB/APAE)
- I-D formatter with proper headers, references, 72-char wrapping

Living Standards Observatory (ietf observatory):
- Source abstraction with IETF + W3C fetchers
- 7-step update pipeline: snapshot, fetch, analyze, embed, ideas, gaps, record
- Static GitHub Pages dashboard (explorer, gap tracker, timeline)
- Weekly CI/CD automation via GitHub Actions

Also includes:
- 361 drafts (expanded from 260 with 6 new keywords), 403 authors, 1,262 ideas, 12 gaps
- Blog series (8 posts planned), reports, arXiv paper figures
- Agent team infrastructure (CLAUDE.md, scripts, dev journal)
- 5 new DB tables, schema migration, ~15 new query methods

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-04 00:48:57 +01:00

8.0 KiB

Deep Analysis Round 2 — Tasks #23-28

Task #23: Draft Revision Velocity

Key finding: 55% of drafts are still at revision 00 — first submission, never iterated.

Overall Stats

Metric Value
Total drafts 361
At rev-00 (never iterated) 198 (54.8%)
At rev-03+ (actively evolving) 64 (17.7%)
Average revision 2.21

Iteration vs Fire-and-Forget by Org

Org Drafts % at rev-00 Avg Rev Pattern
Ericsson 9 11.1% 4.8 Iterators — almost everything gets revised
Sandelman Software 7 14.3% 14.3 Deep iterators — fewer drafts, heavy revision
Nokia 5 20.0% 3.2 Iterators
Siemens 5 0.0% 17.2 Deepest iterators — zero fire-and-forget
Boeing R&T 6 0.0% 28.2 Extreme iterators (mature, long-running drafts)
ZTE Corporation 10 40.0% 1.3 Mixed
Telefonica 13 46.2% 1.8 Mixed
Google 10 50.0% 1.7 Mixed
China Unicom 22 54.5% 0.9 Mostly fire-and-forget
China Telecom 23 60.9% 1.0 Mostly fire-and-forget
Tsinghua 16 62.5% 0.4 Fire-and-forget
Huawei 57 64.9% 0.6 Fire-and-forget — 37 of 57 never revised
Huawei Technologies 19 68.4% 0.7 Fire-and-forget
Five9 10 90.0% 0.1 All new (recent entrant)
Pengcheng Lab 10 90.0% 0.1 All new

Narrative insight: Western companies (Ericsson, Sandelman, Siemens, Boeing, Nokia) have dramatically lower fire-and-forget rates. They submit fewer drafts but iterate heavily. Chinese orgs submit more but ~60-65% are never revised. This is the "volume vs commitment" story — submitting a draft is cheap, iterating it signals genuine investment.

Best quotable stat: "65% of Huawei's 57 drafts have never been revised beyond their first submission."


Task #24: Safety Ratio Trend Over Time

Key finding: The safety ratio is NOT improving. It fluctuates wildly but the structural deficit persists.

Month Safety Capability-only Total Ratio
2025-07 2 3 5 1.5:1
2025-09 4 13 17 3.3:1
2025-10 5 62 67 12.4:1
2025-11 7 54 61 7.7:1
2025-12 3 13 16 4.3:1
2026-01 8 46 54 5.8:1
2026-02 13 73 86 5.6:1
2026-03 1 21 22 21:1

The ratio spiked to 12.4:1 during the Oct 2025 surge (IETF 121 pre-meeting rush — nearly all capability drafts). Feb 2026 shows some improvement (5.6:1) with 13 safety drafts — the best absolute month for safety. But the overall pattern is clear: safety submissions grow linearly while capability submissions grow exponentially. The gap widens during surges.

For Post 4 (THE CLIMAX): The ratio data tells a story of structural neglect, not intentional choice. Nobody is anti-safety; the incentive structure just rewards capability work. Each org's submission campaign prioritizes its core protocol proposals, and safety is nobody's core.


Task #25: RFC Foundation Divergence by Bloc

Key finding: Chinese and Western blocs build on DIFFERENT foundations.

Chinese Bloc — Top RFCs

RFC Cited By Subject
RFC 2119 114 Key words
RFC 8174 86 Key words update
RFC 8259 11 JSON
RFC 6749 11 OAuth 2.0
RFC 6241 10 NETCONF
RFC 8446 8 TLS 1.3
RFC 8641 6 YANG Push
RFC 8639 6 Subscription to YANG Notifications
RFC 7950 5 YANG
RFC 7575 5 Autonomic networking

Western Bloc — Top RFCs

RFC Cited By Subject
RFC 2119 73 Key words
RFC 8174 70 Key words update
RFC 8446 18 TLS 1.3
RFC 5280 12 X.509 PKI
RFC 9528 11 EDHOC
RFC 9110 11 HTTP Semantics
RFC 9052 11 COSE
RFC 8949 9 CBOR
RFC 8613 9 OSCORE
RFC 8392 9 CWT
RFC 6749 7 OAuth 2.0
RFC 7252 7 CoAP

The Divergence

Foundation Chinese Western
Network management (YANG/NETCONF) Strong (6241, 8639, 8641, 7950) Absent
PKI/Certificates (X.509) Absent Strong (5280)
IoT security (COSE/CBOR/OSCORE/CoAP) Absent Strong (9052, 8949, 8613, 7252)
Lightweight auth (EDHOC, CWT) Absent Strong (9528, 8392)
Web APIs (HTTP) Weak Strong (9110)
OAuth 2.0 Present (11) Present (7)
TLS 1.3 Moderate (8) Strong (18)
Autonomic networking Present (7575) Absent

Narrative insight: The Chinese bloc is building agent infrastructure on YANG/NETCONF — network management protocols for autonomous netops. The Western bloc is building on IoT security (COSE/CBOR/CoAP) and web infrastructure (HTTP/TLS/PKI). These are fundamentally different technology stacks. The ONLY shared foundation is OAuth 2.0, which both blocs cite at similar rates.

For Post 2: This means fragmentation goes deeper than protocol design — the two blocs are building on different technological DNA. Even if they agree on agent communication patterns, the underlying plumbing is incompatible.


Task #27: Category Co-Occurrence Matrix

Key finding: Safety IS structurally isolated from core protocol work.

Safety Co-Occurrence

Safety co-occurs with Drafts
Policy/governance 26
Agent identity/auth 25
A2A protocols 12
Data formats/interop 7
Human-agent interaction 5
Autonomous netops 4
ML traffic mgmt 3

Safety co-occurs most with governance and identity — "paper" concerns. It co-occurs with A2A protocols only 12 times out of 136 A2A drafts (8.8%). Safety is essentially disconnected from the core protocol design work.

Strongest Co-Occurrences (Top 10)

Category Pair Co-occurrences
A2A + Data formats 55
A2A + Agent discovery 40
Identity + Policy 38
A2A + Identity 35
A2A + Autonomous netops 34
Discovery + Data formats 34
Identity + Data formats 33
Autonomous netops + ML traffic 28
Safety + Policy 26
Safety + Identity 25

For Post 4: Safety's strongest links are to governance and identity — abstract/policy-level work. Its weakest links are to A2A (12), ML traffic (3), and autonomous netops (4) — the categories where agents actually DO things. Safety is being thought about in the abstract, not integrated into protocol design. This is the structural version of the "highways before traffic lights" metaphor.


Task #28: IETF Meeting Timing Effect

Key finding: 51.5% of all drafts were submitted in the 4-week windows before IETF 121 and 122.

Window Drafts % of Total
Pre-IETF 119 (Feb-Mar 2024) 1 0.3%
Pre-IETF 120 (Jun-Jul 2024) 0 0.0%
Pre-IETF 121 (Oct-Nov 2025) 107 29.6%
Pre-IETF 122 (Feb-Mar 2026) 79 21.9%
All other periods 174 48.2%

Huawei's IETF 121 Campaign

Period Huawei Drafts
Pre-IETF 121 (4-week window) 43
All other periods combined 26

62% of all Huawei drafts (43 of 69 across all entities) were submitted in the 4 weeks before IETF 121 Dublin. This is not organic growth — this is a coordinated submission campaign timed for maximum standards-body impact.

For comparison, the entire corpus had 107 drafts in that same window. Huawei alone accounted for 40% of all pre-IETF 121 submissions.

For Post 1: The growth curve isn't just organic interest — it's heavily driven by strategic submission campaigns timed to IETF meetings. The Oct-Nov 2025 spike (128 drafts in 2 months) is largely one company's coordinated push.

For Post 2: This is the strongest evidence of Huawei's strategic standards campaign. 43 drafts in 4 weeks from one organization is unprecedented in this dataset.