So, we know that hardware buying issue in Dystopia, right? Cyberdecks are custom and worth a major campaign. Hours of Table Top Game play for an AI or just hardware part.
Read this:
Limited Retail Channels: Because Sixunited is an ODM, you likely won't find this at standard retailers like Amazon. Most units are obtained through niche distributors or direct B2B inquiries
So, large LLMs that are comparable to online ones need a very long time to be loaded into the RAM of a computer. I just timed 30 minutes on that office computer having 64GB for a llama3.3:70b-instruct-q4_K_M having 42GB size. That is only and pure loading time. Having no GPU answers take easily more than 10 minutes on only a office hardware CPU.
At this point large LLMs cannot be used locally except spending about 10 grand on a large GPU and computer, but still facing that loading time from hard disc to VRAM, or $2,300 to $4,000 for that very model I tried.
The motherboard there for about one thousand dollars is much faster (2x to 3x) having a much different design than the IBM compatible standard motherboards or SBCs around.
You just have trouble buying one...
#cyberpunkcoltoure
PS:
Processor Support: It features a non-socketed design (FP11 platform) that can
Memory: To match the massive bandwidth requirements of the Strix Halo's integrated
Storage & Expansion:
2x M.2 2280 PCIe 4.0 x4 slots for high-speed NVMe SSDs.
1x M.2 2230 socket for Wi-Fi and Bluetooth modules.
Target Use Cases
While individual hobbyists can use the STHT1 for extreme mini-PC builds, it is primarily marketed as a platform for OEMs to build powerful AIO systems, workstations for AI inference, and compact gaming PCs. By integrating the Ryzen AI MAX, the STHT1 offers high-performance CPU cores (Zen 5), powerful integrated graphics (RDNA 3.5), and a dedicated 50 TOPS NPU for AI tasks in a tiny footprint.
