Man, that was such an enjoyable read. I loved your story on the wild server hunt, back when it was posted on r/localllama. I think one thing that is missing from the whole AI "discussion" is this train of thought of how we go from abstract mathetmatical formulation to intuitive understanding of the underlying functionality, and you showcased it beautifully in this article. Similarly to 3blue1brown who also did an amazing series on transformers. Kudos!
I totally get it. I have the M4 Air, grabbed it for 700$ on sale. I also have a MSI Creator with Linux (wayland). Performance wise the base Air crunches through everything up until lots of things are open and gpu is roaring (encoding or streaming), and with colima, I have few incus linux containers up and running. Battery life is formidable. Nothing comes close.
My linux laptop (32GB ram / beefy gpu) barely withstand 40 min on battery, but can handle very daunting tasks, and obviously gaming.
These are 2 different use cases, but right now, for the ultra portable laptop, Air is the king, until x64 brings back the efficiency per watt. Even qcom can't compete. That being said, I am a big fan of the apple hardware and not the apple software, so whenever Asahi linux is ready enough (with good battery life), I am definitely jumping ship.