Friday, November 20, 2026

A spatiotemporal theory of coupled map lattices

An overview
MediaSpace.GaTech.edu/media/A+spatiotemporal+theory+of+coupled+map+lattices/1_a9gcyq4w
over the current draft of

A spatiotemporal theory of coupled map lattices
Domenico Lippolis                            domenico.lippolis@riken.jp
Brandon Choi                                    Department of Physics, Yale University
Predrag Cvitanović                            predrag.cvitanovic@physics.gatech.edu.

Abstract: We investigate a spatiotemporally chaotic, coupled map lattice discretization of a reaction-diffusion PDE in the Euclidean spacetime field theory formulation. The deterministic field theory predictions are given in terms of weighted sums over system’s unstable multi-periodic solutions.
The focus of this study is on
(i) the evaluation of their spatiotemporal stability exponents, and
(ii) their bifurcations, as function of the strength of system’s diffusion coefficient.
Our analysis reveals rich bifurcation structures already at the level of the simplest sptiotemporally recurrent patterns, such as the time-synchronized states of time period three or lower, time-steady states of equally short spatial periods, and the simplest spacetime bi-periodic states. The results offer a glimpse into complex and at times counter-intuitive scenarios of orbit-orbit interactions and bifurcations occurring already at weak neighbor coupling strengths.

Very detailed. Recommended for coauthors of the Tigers and Coupled papers, as well as anyone who would like to apply the spatiotemporal theory of Navier-Stokes turbulence, and is able to (or understands what that means) compute numerically exact coherent structures of a given system.

ZOOM AI : Quick recap

The meeting focused on Predrag reviewing a draft paper with Domenico about computing stability exponents for spatiotemporal solutions in a reaction-diffusion system. Predrag explained that their approach finds numerically exact space-time solutions on an infinite space-time rather than discretizing on a box and taking a limit. They discussed the structure of the introduction, emphasizing the use of a diagonal term and a term talking to neighbors in the orbit Jacobian, and how this relates to loop expansions and field theory. They compared different types of solutions, such as steady states, synchronized states, and non-synchronized states, and discussed the stability of a checkerboard-like state. Predrag also explained a method for computing the determinant of the orbit Jacobian using a loop expansion based on walks on the lattice, which avoids the need for matrix diagonalization. The conversation touched on the difference between first-order and second-order equations in time and space and how this affects the possible walks on the lattice.

Next steps

Domenico

  • Try to compute the stability exponent for the generic "brick" (spatiotemporal state [3x2]_1 with period 3 in space, 2 in time, and slant 1) using the loop expansion/walks method.

Predrag

  • Remove "pompous bullshit" like "21st century" from the introduction and censor/edit the text as needed.
  • Define the Bravais cell notation, Brillouin zone, Bloch's theorem, and mosaics (symbolic dynamics in space-time) in the paper, either in the main text or appendices.
  • Standardize the notation in the paper, including changing "T" and "t" where they were inverted and using standard notation for the orbit Jacobian and shifts.
  • Add the "formula (38)" equivalent from CL18 to the paper, showig that in the anti-integrable limit, only the local potential terms dominate.
  • Include the brick wall figures for the [2x1]_0 and [2x1]_1 states to clarify the difference between synchronized and non-synchronized steady states.
  • Use official notation throughout (e.g., L, T, S) for different types of states instead of "synchronized, non-synchronized, tilted/checkerboard, ..." descriptive terms.

Summary

Field Theory Numerical Calculations Planning

Predrag discussed plans for a paper about numerical calculations in field theory, explaining their approach of finding exact space-time solutions rather than discretizing on a box. He outlined the paper's structure, which would cover the commonalities between field theory calculations and reaction-diffusion systems, including the use of separable forms with diagonal and neighbor-coupling terms. Predrag explained their motivation for using Chebyshev polynomials, connecting to previous work by Beck and Dettmann, and noted the need to include definitions of Bravais lattices, reciprocal lattices, and mosaics in the paper's appendices.

Periodic Orbits Matrix Representation

Brandon's calculation of time periodic orbits synchronized in space with arbitrary time periods, focused on a matrix representation where spatial dimensions are local and temporal dimensions form blocks based on the period. The anti-integrable limit where local potential terms dominate is also in CL18 and stability.tex of blogCats.tex.

Lattice Systems Steady States Discussion

Predrag discussed different types of steady states in lattice systems, claiming that he word "synchronization" is not useful in chaotic setting: there are cases where states are synchronized in space and time, periodic in space but steady in time, and non-synchronized steady states with periodicity in time. Predrag explained the concept of primitive cells and the Hermite convention, which helps define unique Bravais lattices by ensuring one primitive vector is horizontal.

Spatial Periodicity in Brick Patterns

Predrag explained the concept of spatial and temporal periodicity in brick patterns, using the [3x2]_1 brick example to illustrate how different patterns form when bricks are shifted horizontally. He discussed how the appendix applies to computing eigenvalues for spatially periodic systems, particularly for second-order difference equations. The discussion focused on deriving formulas for synchronized states and periodic systems, with Predrag noting that while volume 6 eigenvalues can only be computed numerically and need to be computed, the [3x2]_1 example provides a good generic case for understanding the broader pattern formation.

Steady States and Bifurcations Analysis

Predrag and Domenico discussed the analysis of different steady states and their stability in a system, focusing on comparing figures and understanding bifurcations. They clarified the distinction between the anti-integrable limit (A=0) and full coupling (A=1), and discussed the importance of checkerboard patterns in fluid dynamics. Predrag again encouraged Domenico to work on the generic brick [3x2]_1 case. Domenico demurred again.

Spatial Coupling and Stability Analysis

Predrag explained the concept of coupling in spatial and temporal dimensions, discussing how parameter A measures the strength of coupling between spatial neighbors. He described how in their specific parameterization, spatial neighbor interactions lead to bifurcations, and explained the mathematical approach for computing stability exponents using trace logarithm methods and lattice walks. The discussion focused on understanding how different walks on the lattice contribute to the final stability calculations, particularly in one-dimensional cases where spatial diffusion is considered without time components.

Lattice Walks Determinant Computation Method

Predrag explained a method for computing determinants using lattice walks, demonstrating how to apply it to periodic systems by analyzing walks on a [3x2]_0 and [3x2]_1 periodic cells. He showed that the approach involves counting finite walks that explore the lattice and using these to construct expressions for the determinant in terms of lattice site values. The discussion included blogCats.tex subfile stability.tex  examples of first and second-order time dependencies and how to handle different orders of spatial and temporal perturbations. Predrag emphasized that while the calculations can be complex, they can be easily implemented using Mathematica, and simpler, as he had done 50 years ago.  The method ultimately connects to Brillouin zone calculations in the continuum limit.


Attendees: Predrag Cvitanović, Domenico Lippolis
Escapees: Matt Gold, Francesco Fedele 

Friday, November 06, 2026

Matt Golden : The Curse of Dimensionality

Matt Golden
Fighting the Curse of Dimensionality in kinetic simulations

     MediaSpace.GaTech.edu/media/Matt+Golden+%3A+The+Curse+of+Dimensionality/1_ifvr5zun

A version of the talk Matt gave back in October to plasma and MML crowd. This time it's for friends. Solving Vlasov-Maxwell equations while waiting for the next Carrington Event.

Tuesday, November 03, 2026

Michiganders

It might not be well known that I'm a Michigander. This interview with Abdul El-Sayed grandparents

       https://youtu.be/iW72PNa0DDY?t=473 
       (start it at 7 min 53 secs, if it does not start there automatically)

reminded me of what must be a Michigander thing:

When I first moved into a Hillsdale College dorm, in the fall of 1965, my adopted American father Don, the president of Hillsdale College (was he a presbyterian?) called me in for a man to man talk,
explained to me how it's done in America 🕺:

You start the day by taking a shower, followed by a few deodorant puffs
(He might have told me to take an obligatory 2nd, evening shower as well, not sure any more)
Every day you change the undershirt (you remember those white things?) 
Every 2nd day you change underpants, socks, and shirt.

So I spent the first semester lugging my barely dirty laundry to the President's house, where my adoptive mother Elizabeth (or her house helper?) washed it.

Dorm showers were communal.
The whole semester I never, ever saw anybody taking a morning shower, except me.
An evening shower, some. But on Saturdays early evenings showers got very busy.

Friday, October 02, 2026

Invariant Solutions Salon : The Battle of Taylor-Couette II

our totally informal, free-for-all tricontinental “morning” chat:

The Battle of Taylor-Couette II

Back in 2007 Jonathan Halcrow, John Gibson and collaborators were proud to be able to show that in a  minimal cell state space truncated to 61,506 dimensions,  turbulent  plane Couette flow at Re=400 fits neatly into the Starship Enterprise (click here).


Recently, Jonathan pointed Fable at his PhD thesis and redid it in about 15 min. Here he tells us about how that went.

Video of the Zoom meetup

Zoom IE + Predrag recap, including hyperlinks to source materials

Jonathan's used Claude AI to reproduce and extend his PhD thesis on plane Couette flow. Now he discovered 131 relative periodic orbits using a JAX-based solver that achieved approximately 30x speed improvement over existing C++ implementations. Jonathan verified his results against previous literature and developed a symbolic dynamics approach using a 4-letter alphabet based on different flow phases (streaky, roll-like, wave-like, and high-dissipation states). Predrag discussed the limitations of forward-in-time versus space-time approaches for symbolic dynamics in spatiotemporal systems. The conversation evolved into a broader discussion about computational methods, with Predrag explaining the advantages of spatiotemporal optimization approaches using space-time solutions rather than traditional time-stepping methods.

Next steps

  • Try the Gauss-Newton method with adjoint of the Jacobian (as suggested by Matt Golden) to improve convergence of the solver.
  • Share the JAX solver code with John for further analysis and understanding the speed of the new time-stepping algorithm.
  • Consider running the solver internally at Google to leverage more computational resources for finding longer periodic orbits.
  • Investigate further the relationship between equilibria in the smaller box and periodic orbits in the wider box.
  • Refine the symbolic dynamics and the set of symbols used for partitioning the state space.
  • Explore the possibility of pushing the solver to larger spatial domains and consider a space-time approach for finding solutions.

Summary

Plane Couette Flow Research Update

Jonathan presented his work on revisiting his 18-year-old thesis on plane Couette flow, which studied equilibrium solutions and periodic orbits in minimal turbulent cells. He used Claude to implement a new solver in Python and JAX, which was much faster than his, Gibson and Schreiber previous Fortran and c++ implementations. While his current work is preliminary and 100% verified, he is still catching up on recent literature and welcomes feedback on potential duplicates. 

JAX Implementation Results Presentation

Jonathan presented results from his implementation using JAX, which showed significant speed improvements over ChannelFlow, particularly when using GPU and batching. He successfully reproduced solutions from previous papers and his thesis, achieving agreement down to three decimal points on dissipation and leading eigenvalues. Jonathan also explored periodic orbits in a wider box geometries, finding that equilibria from the smaller box fold before reaching the wider box, with relative periodic orbits becoming dominant instead.

Periodic Orbits Discovery Presentation

Jonathan presented his work on finding periodic orbits, discussing the discovery of 131 orbits total, with most having time periods below T=120. He explained his methodology of finding orbits through long trajectories and recurrence searching, with some recent attempts at symbolic dynamics. Predrag clarified that the orbits are primarily relative periodic rather than periodic, and Jonathan confirmed that RPO21 matches an orbit previously found by Kawahara and Kita.

Turbulence Analysis and Orbits

Jonathan presented his analysis of turbulence in the plane Coutte, focusing on periodic orbits and their role in determining escape rates from turbulent states. He identified that most orbits are dominated by a single RPO21 orbit and found that the neighborhood of PO2 serves as a key gate controlling whether turbulence persists or the flow relaminarizes. Jonathan developed a symbolic dynamics approach using letters to represent different flow states, though noted it requires remembering multiple symbols for accurate predictions.

JAX 2DMHD Solver Approaches

Matt Golden shared insights about using JAX to implement Gauss-Newton instead of Newton GMRes for 2DMHD solvers, noting it offers a larger basin of convergence and is computationally efficient. Dmitriy mentioned Stokes preconditioning as another approach for speedup, though clarified it only applies to traveling waves, not periodic orbits. The discussion then shifted to Jonathan's work on partitioning state space, where he explained using maximum visited points across orbits to define letter classifications, with Chris confirming this was done using L2 distance and asking about the use of a library of solutions, to which Jonathan responded that a nearest visitations approach worked better than using periodic orbits directly.

Turbulence Prediction Methods Discussion

Chris and Jonathan discussed the effectiveness of using proximity to solutions for predicting dynamics in turbulence. Jonathan acknowledged that while the chosen points in state space showed some correlation with known turbulence patterns, a more careful analysis using periodic orbits might yield better results. 

Predrag explained that forward-in-time, one-dimensional sequence symbolic dynamics approaches are not suitable for problems with spatial translational invariance, and recommended using instead spatiotemporal symbol arrays, as demonstrated in previous work on the Kuramoto-Sivashinsky equation by Matt Gudorf and others.

Spatiotemporal Solutions and Periodic Domains

Predrag and Chris discussed spatiotemporal solutions and periodic domains in three dimensions, with Predrag explaining how solutions can be treated as building blocks or "Lego blocks" that can be combined and optimized. Predrag outlined a method involving spatiotemporal periodic domains, Bravais cells, and primitive cells to systematically find solutions. 

The conversation ended with Predrag confessing that ever since his student Freddy Christiansen outperformed him in their computations, his life has been a struggle to catch up in computational work.

Code Performance Improvement Discussion

The group discussed the performance improvements in Jonathan's code implementation, with Jonathan explaining that a factor of 4 speed-up came from changing the time-stepping algorithm while maintaining the same accuracy. Jonathan noted that the time step size difference was a key factor, though he couldn't fully explain the methodological differences between the implementations. The discussion also touched on the importance of examining solutions in state space and using appropriate coordinates to understand the dynamics of the system, though Jonathan mentioned that equilibrium solutions in the current geometry were less prominent and not as dynamically important as in smaller geometries.

Unstable Directions in Symmetric Systems

Jonathan and Predrag discussed the challenges of representing unstable directions in systems with translational symmetry. Predrag explained techniques like Poincare sectioning and slicing to simplify the analysis by removing translational invariance, suggesting these methods could help find a better representation than Jonathan's initial attempt using the unstable manifold of RPO21. They also discussed how to handle multiple trajectories in spatiotemporal cases, including the concept of tori shadowing each other in space-time.

Space-Time Optimization in Dynamical Systems

Predrag and Jonathan discussed the challenges and benefits of using space-time optimization methods in dynamical systems, particularly for the 1D Kuramoto-Sivashinsky system. Predrag explained that while forward-in-time solutions face exponential instabilities, space-time approaches using optimization algorithms can successfully find stable solutions in larger domains. Jonathan expressed interest in exploring larger spatial cells and potentially using tiling of solutions found in smaller boxes to extend their work to larger spaces.

Spatio-Temporal Problem Solving Approach

Predrag discussed the approach to solving spatio-temporal problems by considering solutions in state space rather than plumber's image boxes, and proposed using a Lagrangian approach instead of Newton's method. He explained how to identify periodic solutions and build a library of space-time tiles that can be used to extend solutions beyond a given window. Chris asked about extending solutions in temporal direction, and Predrag clarified that the approach considers solutions in multiple directions, not just forward in time.

Space-Time vs Dynamical Systems Discussion

Predrag and Chris discussed the concept of thinking in space-time versus traditional dynamical systems approaches, with Predrag explaining how periodic orbits can be viewed as solutions in space-time and how observables are evaluated on these solutions.

The Salon concluded with a discussion of Messi's retirement and Argentine World Cup show, with Predrag expressing what in Argentina is a minority opinion about the team's performance.

Links to earlier Salons and other matters of importance

We did NOT opine on criminal dimensions of claims concerning the Millennium Problem. We have some serious plumbing to focus on, so don't speak now 😉, forever hold your peace.

Alex Blumenthal Math colloquium, Sept 15, 2026

The best explanation of the mathematics behind the formulation of the problem that Predrag has heard so far is
Alex Blumenthal: Blowup for Navier-Stokes: Context, Relevance and History

I liked
Ching-Yao Lai: 
Solution discovery in fluids with high precision using neural networks talk about finding (many!) finite time singular solutions of Burgers and 2D Euler equations. The talk is not recorded, but there are some references in the abstract.

Two cleaned-up very informal Salon discussion,
both to be expanded upon in later salons:

Invariant Solutions Salon Sept 4, 2026

Unedited raw 1 hour recording of Jonathan, Francesco and Predrag's discussion. Share sparingly - some of us take years, nay, decades to actually publish our conceptual breakthroughs.

Jonathan Halcrow:
I pointed Fable at my thesis and some of our papers and asked it to try to produce a more complete catalog of periodic orbits. It speedran my thesis in about 15 min and built a new DNS, equilibrium and RPO search code from scratch in Jax. It hooked this up to my GPU and it now runs about 1000x faster than some of our primitive human stuff did back in the day. It's reproduced most of the equlibiria we had before and seems to have found a number of RPOs (18 in the HKW box at Re=400, in the last few hours). I wanted to compare against the ones in the Channelflow database to see how many are new but it doesn't seem to exist anymore. Do you have a copy saved anywhere?

      Predrag:
I cannot find it in the 2018 version
And let us praise Ashley - he started the Salon way back then 🙂

Day's Salon is a continuation of March 27, 2025 Invariant Solutions Salon:


The Battle of Taylor-Couette I


Clearly the "physical", "inertial manifold", "latent space", ...,  dimension should be much smaller than 100,000 dimensions. Predrag could think of no argument that would bring it to much below 100 dimensions. Typical Mittel-Europa defeatism.  Today we present:

In the left corner we have John Gibson. He does it by (re)thinking. Today he can do it in 19 dimensions.

In the right corner we have Alec Linot. He does it by (ML)thinking. He can do it in 18 dimensions.


Francesco Fedele contributed April 2, 2025 email "4D Waleffe Model, Yann Lecun, AI-learned physical Features in Channel Turbulence...." which you can ask him to resend it to you.


Wednesday, September 30, 2026

Goldenfeld Rutgers seminar "Emergence and Generalization in Machine Learning"

These days the zone is flooded with Super Idiocy ("some call it SI") slop. Fuhgeddaboudit. But. The good papers are now also coming our way at inhuman pace, this is the the 3rd "must study" work of the day 🙁 .

For me, Nigel Goldenfeld's "Emergence and Generalization in Machine Learning",  
arXiv.org:2607.04135, is an inspiring talk: a strong recommend. For me, also deeply related to the deterministic spatiotemporal field theory, so what follows is my discussion of these connections, not Nigel's work.
 
Li and Goldenfeld show that the machine learning takes place in the ergodic, 


or what we call anti-integrable or hyperbolic, corner of the spatiotemporal field theory. Makes sense - this anti-integrable, weakly coupled corner accommodates a huge number of configurations, exponential in the state-space volume (# of labels). Then they descend to the relatively low dimensional latent space (what physicists clumsily call "inertial manifold", perhaps) in the fictitious (learning) time by a stochastic Langevin.

For the free field theories there is a phase transition, at the massless, diffusion value of \mu=0, where real \mu is the Klein-Gordon mass, with \mu > 0 the ergodic AKA chaotic phase,  and the \mu --> \infty limit the anti-integrable limit. For nonlinear field theories, the value of critical \mu is a calculation.

As, I think, always, the ergodic phase is separated from the oscillatory phase by a singularity.

In contrast, the imaginary \mu = I k, k < 1 oscillatory phase was the setting for the original 1990 Esther Levin, Naftali Tishby, and Sara A. Solla "A Statistical Approach to Learning and Generalization in Layered Neural Networks" Gibbs theory of learning, in the noisy data polynomial fitting, or elliptic, "oscillatory" corner.

Sara explains the theory in, for example, this 2022 Les Houches lecture. As any stat mech paper looks like any other stat mech paper, here is what I believe is an important step that you might miss: the normalization constant z of eqs. (5) and (21c) leads to averaging different from the ensemble average over the Gibbs measure.

The right half of the Li & Goldenfeld plot is our home, where friends and I have since  6 AM PST, January 24, 2017 (Nigel was there) worked on recasting high-dimensional ergodicity as the spatiotemporal chaotic field theory. The left and the right phases in the plot are related to each other as is harmonic oscillator to the `temporal cat', Hooke’s wild, ‘anti-harmonic’ sister, see Appendix A. Historical context here (and search for `harmonic' throughout the text).

In stochastic setting, it's backbone is the deterministic field theory, the set of all solutions of the constraints of the theory. I believe the Li & Goldenfeld is essentially the same theory as Parisi & Wu stochastic quantization, the difference being that in ML a simple action of physics is replaced by the many parameter trained neural network of machine learning. Lippolis is working on showing how they are determined and weighted in the stochastic Langevin approach, arXiv:2510.12532. Each solution breaks translation invariance, as ergodicity should. The totality yields expectation values of observables in terms of solution-weighted averages over values of observables.

For me, another physics of ML inspiring Rutger's seminar was Mézard's "How diffusion theory is used to produce fake data",  Marc Mézard, Giulio Biroli et al arXiv.org:260?.????. I believe that Lippolis & Cvitanovic "optimal partition hypothesis" is a dynamical calculation of Mézard & Biroli "memorization–generalization transition" as a function of the noise strength in the Fokker-Planck equation.


In contrast to numerical averaging of ergodic states, in spatiotemporal field theory these expectation values are computed by exploring the state space hierarchically and exhaustively, in terms of exact prime deterministic solutions. The simplest motivational example is the Riemann (actually Euler) zeta function. 



Genug. By now Nigel has already written another paper 🙂