Decoded
Feed

Improving the matrix multiplication exponent with modern optimization and AlphaEvolve

arXiv:2608.16884DSAICC17 aug 20261 min readHN ×5PDF

Gradient descent plus AI-evolved code tightens the best known bound on matrix multiplication speed.

2.371177

New upper bound on ω

Lower ω means asymptotically faster matrix multiplication is possible.

How it works

  1. A hard proof optimization

    The best bounds on ω need a non-convex optimization. Solvers only handled recursion depth 3, about 25k parameters.

  2. GPU gradient descent

    Softmax logits, Sinkhorn max-entropy and Adam in Jax scale to depth 4. AlphaEvolve then rewrites the optimizer code.

  3. Certified tighter bound

    An exact rational-arithmetic check confirms ω < 2.371177, beating the previous bound by about 1.62 × 10⁻⁴.

ℓ*=4gradientsprogramsolutioncertifiedCombinationloss problemTensorizedJax objectiveSinkhorn+ AdamAlphaEvolvecode searchRationalverificationω boundℓ*=4gradientsprogramsolutioncertifiedCombinationloss problemTensorizedJax objectiveSinkhorn+ AdamAlphaEvolvecode searchRationalverificationω bound
From the paper