--- Log opened Tue Jan 21 00:00:54 2025
01:36 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has joined #hplusroadmap
02:27 < L29Ah> fenn: 685B params
02:29 < fenn> no, they distilled that model into a variety of smaller models, which also have amazing reasoning performance, although the really small models are lacking in knowledge
02:30 < fenn> https://i.redd.it/0ypa0a6vh5ee1.png
02:31 < L29Ah> ok i missed the top row
02:31 < fenn> so the 7B gets 49.1 vs 49.9 on GPQA but i'd consider that within the noise
02:32  * L29Ah goes to download 32b_q2_k_l
03:07 -!- gl00ten [~gl00ten@bl5-237-194.dsl.telepac.pt] has quit [Ping timeout: 265 seconds]
03:37 -!- TMM [hp@amanda.tmm.cx] has quit [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
03:38 -!- TMM [hp@amanda.tmm.cx] has joined #hplusroadmap
05:00 -!- justanot1 [~justanoth@gateway/tor-sasl/justanotheruser] has quit [Ping timeout: 264 seconds]
05:01 -!- justanotheruser [~justanoth@gateway/tor-sasl/justanotheruser] has joined #hplusroadmap
05:02 -!- gl00ten [~gl00ten@194.117.18.100] has joined #hplusroadmap
05:06 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has quit [Remote host closed the connection]
05:06 -!- gl00ten [~gl00ten@194.117.18.100] has quit [Ping timeout: 244 seconds]
05:07 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has joined #hplusroadmap
05:59 < L29Ah> checked it out, apparently it does the trick by double-checking itself
06:01 < L29Ah> insanely verbose
06:02 < L29Ah> the brothers problem: https://0x0.st/8HE1.txt
06:35 < kanzure> can't believe i'm saying it but maybe he's convincing me that STL isn't so bad https://x.com/yacineMTB/status/1880988060432969919
06:36 < kanzure> The memory requirements of triangulated meshes increases dramatically faster than the memory requirements for nurbs representation of curved surfaces.
06:36 < kanzure> Triangle enthusiasts will of course say that you could just transmit the definition of the model, such as transmitting source code, and then have the destination render or tessellate the final model. However, this is problematic because not all destinations are able to process a few hundred gigs of triangles.
06:38 < kanzure> actually that sounds dumb, why did i write that? the obvious solution is to not buy ancient cnc equipment.
06:38 < kanzure> why does computational capacity increase for every other piece of equipment except machine tools
06:39 < kanzure> why aren't models modeled as tool path sweeps instead of as shape results?
06:50 < L29Ah> fenn: https://0x0.st/8HEG.txt
06:51 -!- andytoshi [~apoelstra@user/andytoshi] has quit [Quit: Lost terminal]
07:06 -!- Malvolio [~Malvolio@idlerpg/player/Malvolio] has quit [Quit: 3536 Look around you. Which part is natural? What isn't manufactured? point something out! Plants? 2025-01-21 15:06:54:611]
07:12 -!- andytoshi [~apoelstra@user/andytoshi] has joined #hplusroadmap
07:14 -!- Malvolio [~Malvolio@idlerpg/player/Malvolio] has joined #hplusroadmap
07:26 -!- TMM [hp@amanda.tmm.cx] has quit [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
07:26 -!- TMM [hp@amanda.tmm.cx] has joined #hplusroadmap
08:27 -!- millefy1 [~Millefeui@91-160-78-132.subs.proxad.net] has joined #hplusroadmap
08:29 -!- millefy [~Millefeui@91-160-78-132.subs.proxad.net] has quit [Ping timeout: 248 seconds]
08:29 -!- millefy1 is now known as millefy
08:36 -!- millefy [~Millefeui@91-160-78-132.subs.proxad.net] has quit [Quit: Under maintenance, I'll be back...]
09:45 -!- balrog [znc@user/balrog] has quit [Ping timeout: 252 seconds]
09:50 -!- dartmout- [~blackunsp@li761-35.members.linode.com] has quit [Quit: ZNC 1.8.2 - https://znc.in]
09:50 -!- redlegion_ [redlegion@omghax.redlegion.org] has joined #hplusroadmap
09:51 -!- redlegion [redlegion@omghax.redlegion.org] has quit [Ping timeout: 252 seconds]
09:51 -!- dartmouthed [~blackunsp@li761-35.members.linode.com] has joined #hplusroadmap
09:51 -!- saxo [~saxo@zug.infomesh.net] has quit [Read error: Connection reset by peer]
09:51 -!- etc-vi3 [~etc-vi@user/meow/girlchunks] has quit [Ping timeout: 248 seconds]
09:51 -!- sivoais [~zaki@199.19.225.239] has quit [Ping timeout: 248 seconds]
09:51 -!- fenn [~fenn@user/fenn] has quit [Ping timeout: 272 seconds]
09:51 -!- saxo [~saxo@zug.infomesh.net] has joined #hplusroadmap
09:51 -!- _flood [flooded@gateway/vpn/protonvpn/flood/x-43489060] has quit [Ping timeout: 248 seconds]
09:52 -!- etc-vi3 [~etc-vi@user/meow/girlchunks] has joined #hplusroadmap
09:52 -!- balrog [znc@user/balrog] has joined #hplusroadmap
09:52 -!- fenn [~fenn@user/fenn] has joined #hplusroadmap
09:52 -!- sivoais [~zaki@199.19.225.239] has joined #hplusroadmap
09:53 -!- redlegion_ is now known as redlegion
09:58 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has quit [Remote host closed the connection]
09:59 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has joined #hplusroadmap
10:12 -!- balrog [znc@user/balrog] has quit [Quit: Bye]
10:14 -!- balrog [znc@user/balrog] has joined #hplusroadmap
10:54 -!- _flood [flooded@gateway/vpn/protonvpn/flood/x-43489060] has joined #hplusroadmap
15:21 < hprmbridge> kanzure> where was the image of transformer architecture implemented in a single page of source code?
15:49 < fenn> i wanted a cad software that described parts in terms of manufacturing operations instead of geometry, but it turns out there wasn't really a taxonomy of manufacturing operations, so in campbell's lab i was supposed to be cataloging them
15:52 < fenn> "transformer in a single page of source code" sounds like something karpathy would do. was it this? i wouldn't call it one page https://github.com/CalvinXKY/transformer_one_page/blob/main/transformer.py
15:59 < hprmbridge> kanzure> https://github.com/bdunagan/bdunaganGPT/blob/main/bdunaganGPT.ipynb
15:59 < hprmbridge> kanzure> no i've seen smaller
16:03 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has quit [Ping timeout: 248 seconds]
16:14 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has joined #hplusroadmap
16:17 -!- L29Ah [~L29Ah@wikipedia/L29Ah] has left #hplusroadmap []
16:18 -!- L29Ah [~L29Ah@wikipedia/L29Ah] has joined #hplusroadmap