--- Log opened Tue Mar 18 00:00:52 2025
00:25 -!- justanotheruser [~justanoth@gateway/tor-sasl/justanotheruser] has quit [Ping timeout: 264 seconds]
01:36 -!- gl00ten2 [~gl00ten@bl5-239-125.dsl.telepac.pt] has joined #hplusroadmap
01:39 -!- gl00ten [~gl00ten@dsl-35-164.bl26.telepac.pt] has quit [Ping timeout: 252 seconds]
01:47 -!- gptpaste [~x@193.29.58.204] has quit [Excess Flood]
01:51 -!- gptpaste [~x@193.29.58.204] has joined #hplusroadmap
03:51 -!- gptpaste [~x@193.29.58.204] has quit [Excess Flood]
04:13 -!- L29Ah [~L29Ah@wikipedia/L29Ah] has joined #hplusroadmap
04:33 -!- TMM [hp@amanda.tmm.cx] has quit [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
04:33 -!- TMM [hp@amanda.tmm.cx] has joined #hplusroadmap
05:05 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has joined #hplusroadmap
05:14 -!- gptpaste [~x@193.29.58.204] has joined #hplusroadmap
06:51 -!- justanotheruser [~justanoth@gateway/tor-sasl/justanotheruser] has joined #hplusroadmap
07:05 -!- TMM [hp@amanda.tmm.cx] has quit [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
07:05 -!- TMM [hp@amanda.tmm.cx] has joined #hplusroadmap
07:56 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has quit [Quit: Avoid fossil fuels and animal products. Have no/fewer children. Protest, elect sane politicians. Invest ecologically.]
07:56 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has joined #hplusroadmap
08:24 -!- L29Ah [~L29Ah@wikipedia/L29Ah] has quit [Ping timeout: 248 seconds]
08:46 -!- L29Ah [~L29Ah@wikipedia/L29Ah] has joined #hplusroadmap
11:11 -!- Gooberpatrol66 [~Gooberpat@user/gooberpatrol66] has quit [Quit: Konversation terminated!]
11:11 -!- Gooberpatrol66 [~Gooberpat@user/gooberpatrol66] has joined #hplusroadmap
11:57 -!- fenn [~fenn@user/fenn] has quit [Ping timeout: 244 seconds]
11:57 -!- fenn [~fenn@user/fenn] has joined #hplusroadmap
12:42 -!- Gooberpatrol_66 [~Gooberpat@user/gooberpatrol66] has joined #hplusroadmap
12:42 -!- Gooberpatrol66 [~Gooberpat@user/gooberpatrol66] has quit [Ping timeout: 246 seconds]
14:56 < kanzure> https://funaudiollm.github.io/cosyvoice2/
15:08 < kanzure> what is unsloth quantization
16:01 -!- helleshin [~talinck@76-230-66-1.lightspeed.cntmoh.sbcglobal.net] has quit [Read error: Connection reset by peer]
16:19 -!- helleshin [~talinck@76-230-66-1.lightspeed.cntmoh.sbcglobal.net] has joined #hplusroadmap
17:25 -!- Gooberpatrol_66 [~Gooberpat@user/gooberpatrol66] has quit [Quit: Konversation terminated!]
17:25 -!- Gooberpatrol_66 [~Gooberpat@user/gooberpatrol66] has joined #hplusroadmap
18:48 -!- yorick [~yorick@user/yorick] has quit [Ping timeout: 260 seconds]
19:02 -!- yorick [~yorick@user/yorick] has joined #hplusroadmap
19:17 -!- gl00ten2 [~gl00ten@bl5-239-125.dsl.telepac.pt] has quit [Ping timeout: 252 seconds]
19:17 < kanzure> hmph
19:19 -!- TMM [hp@amanda.tmm.cx] has quit [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
19:19 -!- TMM [hp@amanda.tmm.cx] has joined #hplusroadmap
20:07 -!- delthas [~cc0@2a01:4f9:c010:cf0b::1] has quit [K-Lined]
20:13 -!- Gooberpatrol66 [~Gooberpat@user/gooberpatrol66] has joined #hplusroadmap
20:13 -!- Gooberpatrol_66 [~Gooberpat@user/gooberpatrol66] has quit [Ping timeout: 260 seconds]
20:17 -!- Gooberpatrol66 [~Gooberpat@user/gooberpatrol66] has quit [Client Quit]
20:17 -!- Gooberpatrol66 [~Gooberpat@user/gooberpatrol66] has joined #hplusroadmap
20:43 -!- Jenda [~jenda@coralmyn.hrach.eu] has quit [Ping timeout: 244 seconds]
20:45 -!- Jenda [~jenda@coralmyn.hrach.eu] has joined #hplusroadmap
21:02 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has quit [Ping timeout: 252 seconds]
23:32 < fenn> unsloth is a startup that does optimizations to training code to speed up fine tuning. they also make a lot of random bug fixes in open source LLM stuff. one thing they figured out is which specific layers matter the most in a LLM and then leave those in the original resolution, while heavily quantizing the rest for speed and memory contraints in inference. they also use the NF4 nonlinear
23:32 < fenn> quantization type which uses quantiles to decide where the symbol boundaries go, resulting in less quantization error for a given number of bits
--- Log closed Wed Mar 19 00:00:55 2025