XDA Developers on MSN

I'm running a 120B local LLM on 24GB of VRAM, and now it powers my smart home

Paired with Whisper for quick voice to text transcription, we can transcribe text, ship the transcription to our local LLM, ...
CNX Software

Rockchip RK1820/RK1828 SO-DIMM and M.2 LLM/VLM AI accelerator modules, devkits, and benchmarks

Rockchip unveiled two RK182X LLM/VLM accelerators at its developer conference last July, namely the RK1820 with 2.5GB RAM for ...