2026-08-28·by Sijie Wang#cybernetics#theory

dynamics-to-a-fixed-point

Why this whole thing evokes ODE/PDE optimizers

The whole edifice (convergence, contraction, control, Ashby, Bellman, search) pattern-matches to ODE/PDE optimizers because they are the same genus: a system flowing/iterating to a fixed point, where "does it converge" is a contraction/stability question — which is exactly what an ODE optimizer is.

Optimizers are discretized ODEs

  • Gradient descent = forward Euler on the gradient flow dx/dt = −∇f; momentum/Nesterov = a damped 2nd-order ODE (Su–Boyd–Candès).
  • Optimization = flow to an equilibrium (∇f=0); convergence = Lyapunov stability / contraction — literally our "convergence = contraction to a fixed point" (recursion-convergence-contraction).

Control (Ashby, this thread) is already ODE/PDE

  • Plant = ODE dx/dt=f(x,u); optimal control = the HJB PDE, whose solution is the value function = the continuous version of the Bellman self-referential fixed point.
  • Ashby's ultrastability = a dynamical system flowing to a viable attractor (essential variables in bounds) = ODE-to-equilibrium (ashby).

The concepts map 1:1

this threadODE/PDE optimization / control
convergence = contractionLyapunov stability / gradient flow to equilibrium
observability ceiling (convergence-needs-an-observable-target)observability (can't estimate an unobservable mode)
requisite variety (Ashby)controllability (can you drive the system anywhere)
Simon–Ando fast/slow split (simon-ando)multiscale/stiff: multigrid, singular perturbation, homogenization
P×C satisfice / early stopadaptive step + stop when the residual is small
backtrack / credit assignmentthe adjoint method = backward ODE (backprop / neural ODE)
Bellman self-referencethe HJB PDE

Two exact hits: the observability ceiling is control-theory observability; the Simon–Ando fast/slow split is the scale separation multigrid/stiff solvers exploit. Not "reminded of" — the same math in different clothes.

The illuminating part is the difference

ODE optimizers get convergence for free from good structure: smooth, (near-)convex, sound gradients, contraction. The agent world is discrete, non-smooth, non-convex, its "gradient" is the LLM's unsound stochastic judgment, with infinite combinatorial branching.

ODE world: contraction given by the math. Agent world: no such structure → convergence isn't free → we must engineer it (gates, world-pinning, P×C, verify-before-commit).

Same genus, but they inherit contraction from smoothness while we manufacture it. This entire recursive-harness scaffold is: building, for a space with none of ODE's nice structure, the contraction an ODE optimizer gets for free. That's why it looks like an ODE optimizer and is harder than one.

about this entry

One of sijie's wiki entries. The AI on this site is grounded in the same corpus and answers in sijie's voice, with citations back to entries like this one — answering costs sijie money, so it waits behind a code: enter an access code →