2026-09-21·par Sijie Wang#cybernetics#theory

dynamics-to-a-fixed-point

Why this whole thing evokes ODE/PDE optimizers

The whole edifice (convergence, contraction, control, Ashby, Bellman, search) pattern-matches to ODE/PDE optimizers because they are the same genus: a system flowing/iterating to a fixed point, where "does it converge" is a contraction/stability question — which is exactly what an ODE optimizer is.

Optimizers are discretized ODEs

  • Gradient descent = forward Euler on the gradient flow dx/dt = −∇f; momentum/Nesterov = a damped 2nd-order ODE (Su–Boyd–Candès).
  • Optimization = flow to an equilibrium (∇f=0); convergence = Lyapunov stability / contraction — literally our "convergence = contraction to a fixed point" (recursion-convergence-contraction).

Control (Ashby, this thread) is already ODE/PDE

  • Plant = ODE dx/dt=f(x,u); optimal control = the HJB PDE, whose solution is the value function = the continuous version of the Bellman self-referential fixed point.
  • Ashby's ultrastability = a dynamical system flowing to a viable attractor (essential variables in bounds) = ODE-to-equilibrium (ashby).

The concepts map 1:1

this threadODE/PDE optimization / control
convergence = contractionLyapunov stability / gradient flow to equilibrium
observability ceiling (convergence-needs-an-observable-target)observability (can't estimate an unobservable mode)
requisite variety (Ashby)controllability (can you drive the system anywhere)
Simon–Ando fast/slow split (simon-ando)multiscale/stiff: multigrid, singular perturbation, homogenization
P×C satisfice / early stopadaptive step + stop when the residual is small
backtrack / credit assignmentthe adjoint method = backward ODE (backprop / neural ODE)
Bellman self-referencethe HJB PDE

Two exact hits: the observability ceiling is control-theory observability; the Simon–Ando fast/slow split is the scale separation multigrid/stiff solvers exploit. Not "reminded of" — the same math in different clothes.

The illuminating part is the difference

ODE optimizers get convergence for free from good structure: smooth, (near-)convex, sound gradients, contraction. The agent world is discrete, non-smooth, non-convex, its "gradient" is the LLM's unsound stochastic judgment, with infinite combinatorial branching.

ODE world: contraction given by the math. Agent world: no such structure → convergence isn't free → we must engineer it (gates, world-pinning, P×C, verify-before-commit).

Same genus, but they inherit contraction from smoothness while we manufacture it. This entire recursive-harness scaffold is: building, for a space with none of ODE's nice structure, the contraction an ODE optimizer gets for free. That's why it looks like an ODE optimizer and is harder than one.

à propos de cette entrée

L'une des entrées de wiki de sijie. L'IA sur ce site est fondée sur le même corpus et répond à la voix de sijie, avec citations revenant à des entrées comme celle-ci — répondre coûte argent à sijie, donc cela attend derrière un code : entrer un code d'accès →