Collections

Sailing in South-East Asia with Inclusive Multilingual LLMs

Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit