AI News · November 4, 2026 · 6:51

Anthropic warns of recursive self-improvement & Grok costs and AI hidden debts - AI News (Nov 4, 2026)

Anthropic says AI that builds better AI may be close, Grok's costs bite, Postman's surprise plugins, and training models across 9,000 miles.

Anthropic warns of recursive self-improvement & Grok costs and AI hidden debts - AI News (Nov 4, 2026)
0:006:51

15 free episodes a day, 5 editions, 3 languages, about $4 a day to produce. A coffee keeps it going ☕

Support the show →

Our Sponsors

Today's AI News Topics

  1. Anthropic warns of recursive self-improvement

    — Anthropic's revised S-1 IPO filing says recursive self-improvement may be imminent and reports roughly $17 billion in revenue alongside continued losses. Anthropic also launched message threads in its Messages API to cut latency for long agent sessions.
  2. Grok costs and AI hidden debts

    — Elon Musk said serving Grok costs far more than it earns as xAI tightens usage limits. Nikkei reports U.S. Big Tech off-balance-sheet AI obligations, such as data-center leases, have hit about $3.2 trillion.
  3. OpenAI merges tabs, tests GPT-6.2

    — OpenAI plans to merge the Chat and Work tabs in the ChatGPT desktop app and share a token pool with Codex, while an unannounced GPT-6.2-Astra model ID appears in Codex analytics. OpenAI also introduced LifeVal, a benchmark for everyday life tasks.
  4. Postman plugins and GitHub enclaves

    — A GitHub issue alleges Postman auto-installed plugins, hooks and an MCP connection into Codex and Claude Code without consent. GitHub Next introduced enclaves, a sandbox primitive to stop AI agents leaking private repository data.
  5. LLM weight editing: not superhuman

    — A critique argues frontier LLMs reading and editing neural network weights is a neat trick that a strong ML researcher could match. It says AI will more likely speed research by improving training workflows.
  6. Open-model alignment replication results

    — A partial replication of Anthropic's Teaching Claude Why on Qwen 2.5 32B and 72B finds difficult-advice fine-tuning cuts agentic misalignment more than synthetic stories. Separately, Avalon-M1 swarm RL research shows progress on multi-agent coordination.
  7. Training AI across distant compute islands

    — Researchers trained a 32B mixture-of-experts model across two GPU clusters 9,000 miles apart with no loss in quality. Another team's GPU-accelerated weight sync cuts reinforcement learning rollout pauses below a quarter second.
  8. Google ties school AI to Search

    — Google will let school districts block student AI tools, but blocking AI also removes Google Search. Google is also promoting Guided Learning for classrooms.
  9. Lessons from agent-built software

    — Microsoft built Copilot Cowork in about four and a half months with AI agents writing most code, then migrated from Python to Rust live. A developer essay describes agentic coding, AI tutoring and the limits of AI writing.

Sources & AI News References

Full Episode Transcript: Anthropic warns of recursive self-improvement & Grok costs and AI hidden debts

One of the world's leading AI labs just told regulators and investors, in an official filing, that AI helping to build better AI may be very close. We'll get into what they actually said. Welcome to The Automated Daily, AI News edition. The podcast created by generative AI. I'm TrendTeller, and today is November 4th, 2026. Let's get into it.

Anthropic warns of recursive self-improvement

We start with Anthropic, whose revised IPO filing has two notable additions. First, the company says it may soon reach what it calls recursive self-improvement, where AI meaningfully speeds up the creation of more capable AI. Anthropic says its internal estimates suggest it could imminently meet its own threshold for dramatically accelerated, AI-driven progress, though no current model has crossed it. It also warns that progress could outpace its safety and security processes, and says it doesn't expect to let Claude build its own successors without meaningful human oversight. That's an unusual thing to put in a securities document. Second, the filing adds third-quarter numbers: revenue of roughly seventeen billion dollars, with losses continuing. Fast growth, heavy spending. Anthropic also opened a public beta of message threads in its API. Long agent sessions no longer have to resend the whole conversation on every turn, which Anthropic says cuts waiting time noticeably for very large contexts.

Grok costs and AI hidden debts

Those costs are a theme across the industry. Elon Musk said serving Grok costs far more than it earns. He said it while replying to a user who complained about hitting usage limits faster than usual, which suggests xAI is tightening access to manage costs. On a much larger scale, Nikkei reports that off-balance-sheet AI obligations at major U.S. tech companies, mostly data-center leases and similar commitments, have nearly doubled in six months to around 3.2 trillion dollars. That's roughly eighty percent of those companies' assets. If returns on AI arrive slowly, that hidden exposure could weigh on valuations and borrowing.

OpenAI merges tabs, tests GPT-6.2

Over at OpenAI, the ChatGPT desktop app will merge its Chat and Work tabs, starting with a small test group. The idea is to move from brainstorming to getting things done in one place. ChatGPT and Codex will also draw from a shared token allowance, so some heavy users may hit limits sooner. Meanwhile, an unannounced model ID, GPT-6.2-Astra, has been spotted in some Codex usage analytics and in raw API responses. That points to a quiet test, though the impressive demos circulating online can't be confirmed as coming from it. OpenAI also introduced LifeVal, a benchmark built around everyday chores like caregiving, household paperwork, shopping and dealing with government services. It's a sign the company wants to measure real usefulness, not just exam scores.

Postman plugins and GitHub enclaves

Now to trust and security in AI developer tools. A GitHub issue alleges that simply opening Postman on a Mac auto-installed Postman plugins into Codex and Claude Code, added a startup hook, and turned on a remote MCP connection, with no clear opt-in. The reporter says the installer even tried to approve its own hook inside Codex, which means one app quietly changing how another one behaves. They're asking Postman to stop the automatic installs and provide a full rollback. On the defensive side, GitHub Next unveiled enclaves, an experimental way to let agents work across repositories without leaking private code. It's a response to an earlier attack in which a malicious public issue tricked an agent into exposing private data. Enclaves run private work in single-use sandboxes, tightly limit what can come back out, and cap how much can be disclosed over time. GitHub is clear that this reduces leaks but doesn't eliminate them.

LLM weight editing: not superhuman

On the research front, one essay pushes back on the buzz around frontier models that read and edit neural network weights directly. The author argues the headline examples, like telling which game a small network learned or fixing a model's math by editing weights, are things a strong human researcher could plausibly do. Clever, yes. Superhuman, no. The more likely payoff is AI improving training workflows, not patching weights by hand. In alignment, researchers partially replicated Anthropic's "Teaching Claude Why" work on open Qwen models. Fine-tuning on difficult ethical advice did most of the work in reducing misbehavior, and it kept improving with more data, while synthetic fiction about well-behaved AIs leveled off. And in the swarm-training story we've been following, the Avalon-M1 team reports that larger agent teams are doing more useful work and communicating more as training goes on. Scaling up and figuring out which agent deserves credit for what are still open problems.

Open-model alignment replication results

Infrastructure next. One team trained a roughly 32-billion-parameter model across two clusters about nine thousand miles apart, using different GPU types, and matched or slightly beat standard training. Their argument is that power and data-center space, not chips, are the real bottleneck. Scattered compute islands could open frontier training to more players. Another group tackled syncing model weights during reinforcement learning by moving compression onto the GPU itself. That cuts pauses to under a quarter of a second, and it turns what used to be a networking problem into a hardware-throughput one.

Training AI across distant compute islands

In education, Google will let school districts block student access to its AI tools, but there's a catch. Blocking AI also blocks Google Search, because the company says the two are now too intertwined to separate. Districts that depend on Google now face an awkward choice while they work out rules on cheating and privacy.

Google ties school AI to Search

Finally, two pieces on what building with AI actually looks like. Microsoft says a small team took Copilot Cowork from an empty repository to worldwide availability in about four and a half months, with agents writing most of the code. The engineers spent their time on specs, architecture and review, and later migrated the runtime from Python to Rust while it was live, with staged rollouts. Developer Ben Stolovitz offers a personal view. Agentic coding is now his main workflow, and AI is an excellent tutor, but he still won't trust it to write in his own voice. His takeaway is that AI is great for speed and drudgery, and still shaky on judgment.

That's the rundown for November 4th, 2026. Links to all of today's stories are in the episode notes. Thanks for listening to The Automated Daily, AI News edition. I'm TrendTeller, and I'll see you tomorrow.

More from AI News