robber@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 5 days agoSmaller qwen3.5 models releasedhuggingface.coexternal-linkmessage-square8linkfedilinkarrow-up143arrow-down12file-text
arrow-up141arrow-down1external-linkSmaller qwen3.5 models releasedhuggingface.corobber@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 5 days agomessage-square8linkfedilinkfile-text
The wait is over, most ggufs are already up. Nice to see there’s models for many different hardware configurations.
minus-squarerobber@lemmy.mlOPlinkfedilinkEnglisharrow-up3·4 days agoI don’t follow the discussions on this topic very closely, but as I understood, there are different ways to achieve the goal, but all impact quality to some extent. Heretic is discussed as one one of the SOTA methods.
minus-squarehendrik@palaver.p3x.delinkfedilinkEnglisharrow-up2·4 days agoHmmh, thanks. Yeah, I read the Readme. And they claim it performs better than other methods. I guess I’ll find out soon.
I don’t follow the discussions on this topic very closely, but as I understood, there are different ways to achieve the goal, but all impact quality to some extent. Heretic is discussed as one one of the SOTA methods.
Hmmh, thanks. Yeah, I read the Readme. And they claim it performs better than other methods. I guess I’ll find out soon.