You could have invented transformers from memory (alexwang.ai)
recommended by 1 user | 2026 | 670 points by speckx | machine learning | original thread |

https://twitter.com/heyyalexwang/status/2111158818730397932

One user recommended this thread. What they said:
nico Oct 22, 2026 | on: WorldTUI: I trained a 360M model to pretend to be a terminal | context

Thank you for the link. Yes! loved that post. I had just created the cli version (https://nicobrenner.github.io/lossy-git/) and it inspired me to create the web version

Here's the HN discussion of Alex Wang's article: https://news.ycombinator.com/item?id=50122878

Also, I really appreciate the excellent detailed writeup on your project. Curious about the mistake correction capabilities, it's fascinating, did you try breaking it up in 2 models? one that generates one that repairs? Just wondering if would make any difference in results, which could be impactful given your observation that "was one of the more effective training changes"