...

the_pwner224

2352

Karma

2018-12-30

Created

Recent Activity

  • Arch with KDE, it works perfectly out of the box.

    I configured/disabled RGB lighting in Windows before wiping and the settings carried over to Linux. On Arch, install & enable power-profiles-daemon and you can switch between quiet/balanced/performance fan & TDP profiles. It uses the same profiles & fan curves as the options in Asus's Windows software. KDE has native integration for this in the GUI in the battery menu. You don't need to install asus-linux or rog-control-center.

    For local AI: set VRAM size to 512 MB in the BIOS, add these kernel params:

    ttm.pages_limit=31457280 ttm.page_pool_size=31457280 amd_iommu=off

    Pages are 4 KiB each, so 120 GiB = 120 x 1024^3 / 4096 = 31457280

    To check that it worked: sudo dmesg | grep "amdgpu.*memory" will report two values. VRAM is what's set in BIOS (minimum static allocation). GTT is the maximum dynamic quota. The default is 48 GB of GTT. So if you're running small models you actually don't even need to do anything, it'll just work out of the box.

    LM Studio worked out of the box with no setup, just download the appimage and run it. For Ollama you just `pacman -S ollama-rocm` and `systemctl enable --now ollama`, then it works. I recently got ComfyUI set up to run image gen & 3d gen models and that was also very easy, took <10 minutes.

    I can't believe this machine is still going for $2,800 with 128 GB. It's an incredible value.

  • Strix Halo you can get at least 120 GB to the GPU (out of 128 GB total), I'm using this configuration.

    Setting the kernel params is a one-time initial setup thing. You have 128 GB of RAM, set it to 120 or whatever as the max VRAM. The LLM will use as much as it needs and the rest of the system will use as much it needs. Fully dynamic with real-time allocation of resources. Honestly I literally haven't even thought of it after setting those kernel args a while ago.

    So: "options ttm.pages_limit=31457280 ttm.page_pool_size=31457280", reboot, and that's literally all you have to do.

    Oh and even that is only needed because the AMD driver defaults it to something like 35-48 GB max VRAM allocation. It is fully dynamic out of the box, you're only configuring the max VRAM quota with those params. I'm not sure why they choice that number for the default.

  • > But you can unlock it without needing Google.

    Well akshually.... the bootloader is initially not unlockable. You must connect the phone to the internet. Within a few minutes a background process will reach out to Google servers to check whether it was purchased outright or with a payment plan. It will only enable the bootloader unlocking toggle after this step. Phones bought with a carrier contract won't be unlockable until paid off.

    In those initial few minutes (/ before you connect it to the interwebs), the bootloader unlock option in the developer settings & fastboot will be disabled.

  • Yep, I have a 13" gaming tablet with the 128 GB AMD Strix Halo chip (Ryzen AI Max+ 395, what a name). Asus ROG Flow Z13. It's a beast; the performance is totally disproportionate to its size & form factor.

    I'm not sure what exactly you're referring to with "Only Apple has the unique dynamic allocation though." On Strix Halo you set the fixed VRAM size to 512 MB in the BIOS, and you set a few Linux kernel params that enable dynamic allocation to whatever limit you want (I'm using 110 GB max at the moment). LLMs can use up to that much when loaded, but it's shared fully dynamically with regular RAM and is instantly available for regular system use when you unload the LLM.

HackerNews