--- Log opened Fri Apr 11 00:00:14 2025
00:15 < hprmbridge> nmz787> kanzure did you setup the local whisper for aider to use? using this? https://github.com/ailocal/openai-proxy/
00:16 < hprmbridge> nmz787> i got whisper.cpp compiled on windows and it works on the CLI... but I am not sure how to setup that openai-proxy to my local whisper and then anything else to remote-openrouter
00:30 < hprmbridge> nmz787> oh, I see there's an example... hrmm https://github.com/ailocal/openai-proxy/blob/master/config/haproxy/conf.d/openai-proxy.cfg-example
02:54 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has joined #hplusroadmap
02:55 < hprmbridge> nmz787> whee I got it to work 2.5 hours later https://github.com/ailocal/openai-proxy/issues
02:56 < hprmbridge> nmz787> ENV var changed, and the URL path changed (or the proxy wasn't clear that I might be need to change some whisper.cpp settings to change that URL it's checking in the whisper-server process)
02:57 < fenn> "When scaled to 9,216 (TPU v7) chips per pod for a total of 42.5 Exaflops, Ironwood supports more than 24x the compute power of the world’s largest supercomputer – El Capitan"
03:01 < hprmbridge> nmz787> i'm totally over here vibe coding
03:02 < fenn> i'm cheering for humanity but hoping Google gets broken up as a monopoly
03:04 < fenn> nmz787: what is 'ailocal'?
03:05 < hprmbridge> nmz787> i didn't review the whole codebase, but the mermaid diagram they have in their docs basically shows it acting as a local proxy, since aider doesn't support sending the voice requests to a custom endpoint (i.e. via a config setting)
03:06 < hprmbridge> nmz787> so I have whisper.cpp running locally, the openai-proxy basically is just a repo that houses a config file for `haproxy` (apt-get installed that) and some instructions for how to set things up
03:06 < fenn> it's a fork to run whisper locally to feed into aider?
03:06 < hprmbridge> nmz787> the ailocal thing is really just an example haproxy conf file and README to go along
03:07 < hprmbridge> nmz787> https://en.wikipedia.org/wiki/HAProxy
03:10 < hprmbridge> nmz787> so you start whisper-server, tell haproxy to re-route `/v1/audio/transcription` requests to your whisper server, re-route `v1/chat/completions` to openrouter, and then point aider to the local proxy via ENV var `OPENAI_API_BASE=http://localhost:2020/v1`
03:12 < fenn> it's needed because everything is on the same port? why can't you point aider at the whisper server directly?
03:12 < hprmbridge> nmz787> not from the docs I read
03:12 < hprmbridge> nmz787> it seems aider wants to send all requests to the same endpoint
03:12 < hprmbridge> nmz787> and the devs didn't want to support splitting it up
03:13 < hprmbridge> nmz787> https://github.com/Aider-AI/aider/issues/758#issuecomment-2200332456
03:14 < hprmbridge> nmz787> https://github.com/Aider-AI/aider/issues/2647
03:14 < fenn> seems stupid to specify functionality by the company that first implemented it
03:14 < fenn> like why not WHISPER_API=
03:16 < hprmbridge> nmz787> it seems like one of those issue submitters did that, but then realized the patch was too big to be easily accepted
03:16 < hprmbridge> nmz787> and found the haproxy thing worked with some "simple" config
03:21 < hprmbridge> nmz787> now I just need to also code a whisper-powered aider interface... and I can code totally handsfree
03:28 < hprmbridge> nmz787> eh, this vibe coding vibe website is lacking the vibes, probably because I'm tired
03:29 < hprmbridge> nmz787> https://frinkiac.com/meme/S07E07/652167.jpg?b64lines=IFdIRVchIEFMTCBUSElTIENPTVBVVEVSCiBIQUNLSU5HIElTIE1BS0lORyBNRQogVEhJUlNUWS4gSSBUSElOSyBJJ0xMCiBPUkRFUiBBIFRBQi4=
03:31 < fenn> press the <TAB> key
03:32 < fenn> obligatory callback to https://fennetic.net/irc/discord_logscrape/gallery/1741962188_image0.png
03:36 < hprmbridge> nmz787> I am trying to organize a visit to the locally advertised "5000 monkeys, next exit" attraction https://www.ohsu.edu/onprc/tours
03:37  * L29Ah orders 500g of synthetic caffeine
03:37 < L29Ah> any psychedelic drum and bass advice?
03:47 < fenn> when you think about it, 5000 is a small monkey town, not much in the grand scheme of things
03:47 < fenn> i bet those monkeys are dying to go see the world, strike it rich, become an actor in LA or something
03:48 < fenn> L29Ah: i haven't been exposed to new music in 13 years, sorry
03:49 < L29Ah> >:O
03:49 < TMA> fenn: you are very lucky
03:49 < L29Ah> fenn: then i must recommend you https://igorrr.bandcamp.com/track/opus-brain
03:51 < fenn> hmm not a fan of klingon opera
03:52 < L29Ah> fenn: then https://music.torley.com/music
03:57 < fenn> found this in a dusty drawer no idea where it came from https://soundcloud.com/xlr8r/download-snasen-vaapen-vessels-remix
03:58 < fenn> may skip to 1:20
04:17 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has quit [Quit: Avoid fossil fuels and animal products. Have no/fewer children. Protest, elect sane politicians. Invest ecologically.]
04:18 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has joined #hplusroadmap
05:12 < hprmbridge> kanzure> @nmz787 personally I swapped out voice.py to use groq whisper since it's so much cheaper
05:13 < hprmbridge> kanzure> switching to groq whisper was like a 5 minute change for me? granted, I have to keep applying my patch every time aider upgrades.....
06:11 -!- delthas [16abab341f@2a01:4f9:c010:cf0b::1] has quit [Ping timeout: 260 seconds]
06:12 -!- delthas_ [16abab341f@2a01:4f9:c010:cf0b::1] has joined #hplusroadmap
06:21 -!- Gooberpatrol_66 [~Gooberpat@user/gooberpatrol66] has quit [Quit: Konversation terminated!]
06:21 -!- Gooberpatrol_66 [~Gooberpat@user/gooberpatrol66] has joined #hplusroadmap
06:34 -!- Gooberpatrol_66 [~Gooberpat@user/gooberpatrol66] has quit [Read error: Connection reset by peer]
06:34 -!- Gooberpatrol_66 [~Gooberpat@user/gooberpatrol66] has joined #hplusroadmap
06:45 -!- L29Ah [~L29Ah@wikipedia/L29Ah] has left #hplusroadmap []
06:46 -!- L29Ah [~L29Ah@wikipedia/L29Ah] has joined #hplusroadmap
07:23 < hprmbridge> kanzure> https://androidarts.com/spaceships/spaceship_design.htm
09:02 < hprmbridge> nmz787> So you're not running whisper locally?
09:03 < hprmbridge> nmz787> Whatever model it downloaded was like 120MB (I think) and it runs very fast on my laptop
09:17 -!- flyback [~flyback@2601:540:c701:900:1ac:70eb:7310:411] has quit [Read error: Connection reset by peer]
09:24 -!- flyback [~flyback@2601:540:c701:900:2c7d:e062:a955:1401] has joined #hplusroadmap
09:41 < kanzure> just groq whisper. it's fast and cheap- up to 8 hours of audio per day.
09:41 < kanzure> (unless you pay)
10:43 -!- L29Ah [~L29Ah@wikipedia/L29Ah] has left #hplusroadmap []
10:43 -!- L29Ah [~L29Ah@wikipedia/L29Ah] has joined #hplusroadmap
11:04 -!- TMM [hp@amanda.tmm.cx] has quit [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
11:04 -!- TMM [hp@amanda.tmm.cx] has joined #hplusroadmap
11:39 -!- L29Ah [~L29Ah@wikipedia/L29Ah] has left #hplusroadmap []
11:40 -!- L29Ah [~L29Ah@wikipedia/L29Ah] has joined #hplusroadmap
11:45 -!- L29Ah [~L29Ah@wikipedia/L29Ah] has left #hplusroadmap []
13:07 < hprmbridge> kanzure> https://docs.google.com/document/d/1SXnh7JJUlj6IyZTAEnjMBE_OZvgvc-UjHR4V2265he8/edit?tab=t.0
13:35 -!- gl00ten [~gl00ten@129.45.29.69] has joined #hplusroadmap
13:42 < hprmbridge> alonzoc> I've got a local 7b deepseek on my 3060 and it's almost realtime in response even with it's COT.
13:42 < hprmbridge> alonzoc> It's fairly smart for running basic tool commands as well
13:44 < hprmbridge> alonzoc> TTS done via https://huggingface.co/spaces/hexgrad/Kokoro-TTS which is really lightweight esp compared to LLMs
13:46 < hprmbridge> kanzure> https://news.convex.dev/meet-chef/ Not sure I get Chef? I am able to get Claude to build multiplayer things no problem. Backend isn't an issue at all.
15:49 -!- darsie [~darsie@84-113-82-174.cable.dynamic.surfer.at] has quit [Ping timeout: 276 seconds]
16:06 < hprmbridge> nmz787> https://archive.is/38Wqi
16:06 < hprmbridge> nmz787> Nutrition Science’s Most Preposterous Result
16:06 < hprmbridge> nmz787> Studies show a mysterious health benefit to ice cream. Scientists don’t want to talk about it.
16:06 < hprmbridge> nmz787> By David Merritt Johns
17:50 < jrayhawk> fewer clickbait bullshit articles please
18:18 < hprmbridge> Eli> He Jiankui liked my video I made about him
18:30 -!- TMM [hp@amanda.tmm.cx] has quit [Quit: https://quassel-irc.org - Chat comfortably. Anywhere.]
18:30 -!- TMM [hp@amanda.tmm.cx] has joined #hplusroadmap
19:24 < fenn> i linked the ice cream article recently. it does show a lack of, er, epistemological rigor in the nutrition science community
19:26 < fenn> the best nutrition studies are in farm animal feed studies :(
19:26 < fenn> s/in//
--- Log closed Sat Apr 12 00:00:14 2025