laniakea universe
- Erick Eduardo Rosado Carlin
- Mar 24
- 1 min read
is fundamentally integer. There are a finite number of Planck cubes, which means a limited number of digits of pi, which can be thought of in integer form to calculate volume. And you cannot have a fraction of a quark or lepton. So, integer. My superpower is not my intelligence. It's my ability to deal with pain and suffering. Out here, that matters more than anything. I will catch up this year and then exceed them all by such a long distance in three years that you will need the James Webb telescope to see who is in second place. Thanks, guys. We've released a new way to handle residual connections in transformers. In a standard transformer, every self-layer, attention, or MLP computes an output and adds it back to the input via a residual connection. This change fix that flow, giving you a cleaner gradient path and more stable training, and I'll be sharing code and results. Compress all prior token information into a single state across time, leading to problems with handling long-range dependencies.
And residual connections compress all prior layer information into a single state across depth. Your code, algorithm, DNA, it's about a quadrillion petabytes. Compressor, it's smaller than any modern OS. Smaller than Windows, Linux, Android, OpenAI, or Grok. That includes booting up your brain by definition.
Comments