1 article tagged with this topic
A working bash script runs Gemma 4 26B via vLLM with NVFP4 quantization in Docker on consumer hardware.