--- Log opened Sat Sep 01 00:00:57 2018 00:02 -!- SopaXorzTaker [~SopaXorzT@unaffiliated/sopaxorztaker] has joined #bitcoin-core-dev 00:07 -!- sipa [~pw@gateway/tor-sasl/sipa1024] has joined #bitcoin-core-dev 00:18 -!- Victorsueca [~Victorsue@unaffiliated/victorsueca] has quit [Read error: Connection reset by peer] 00:20 -!- Victorsueca [~Victorsue@unaffiliated/victorsueca] has joined #bitcoin-core-dev 00:34 -!- Krellan [~Krellan@2601:640:4000:9258:1d29:95e7:5385:8867] has quit [Read error: Connection reset by peer] 00:35 -!- Krellan [~Krellan@2601:640:4000:9258:1d29:95e7:5385:8867] has joined #bitcoin-core-dev 00:58 -!- promag [~promag@bl22-247-244.dsl.telepac.pt] has joined #bitcoin-core-dev 01:08 -!- luke-jr [~luke-jr@unaffiliated/luke-jr] has quit [Ping timeout: 252 seconds] 01:08 -!- luke-jr [~luke-jr@unaffiliated/luke-jr] has joined #bitcoin-core-dev 01:18 -!- luke-jr [~luke-jr@unaffiliated/luke-jr] has quit [Ping timeout: 252 seconds] 01:19 -!- luke-jr [~luke-jr@unaffiliated/luke-jr] has joined #bitcoin-core-dev 01:44 -!- lukedashjr [~luke-jr@unaffiliated/luke-jr] has joined #bitcoin-core-dev 01:46 -!- SopaXorzTaker [~SopaXorzT@unaffiliated/sopaxorztaker] has quit [Ping timeout: 244 seconds] 01:47 -!- luke-jr [~luke-jr@unaffiliated/luke-jr] has quit [Ping timeout: 252 seconds] 01:49 -!- lukedashjr is now known as luke-jr 01:52 -!- d9b4bef9 [~d9b4bef9@web501.webfaction.com] has quit [Remote host closed the connection] 01:53 -!- profmac [~ProfMac@2001:470:1f0f:226:e8ce:3184:795e:ed67] has quit [Ping timeout: 240 seconds] 01:53 -!- d9b4bef9 [~d9b4bef9@web501.webfaction.com] has joined #bitcoin-core-dev 01:55 -!- promag [~promag@bl22-247-244.dsl.telepac.pt] has quit [Remote host closed the connection] 02:14 -!- Victorsueca [~Victorsue@unaffiliated/victorsueca] has quit [Read error: Connection reset by peer] 02:15 -!- Victorsueca [~Victorsue@unaffiliated/victorsueca] has joined #bitcoin-core-dev 02:55 -!- profmac [~ProfMac@2001:470:1f0f:226:e8ce:3184:795e:ed67] has joined #bitcoin-core-dev 03:04 -!- savil [savilmatri@gateway/shell/matrix.org/x-parloisasuwmlasn] has quit [Remote host closed the connection] 03:05 -!- promag [~promag@bl22-247-244.dsl.telepac.pt] has joined #bitcoin-core-dev 03:09 -!- savil [savilmatri@gateway/shell/matrix.org/x-dqxgjhwawsypxnes] has joined #bitcoin-core-dev 03:14 -!- promag [~promag@bl22-247-244.dsl.telepac.pt] has quit [Remote host closed the connection] 03:15 -!- profmac [~ProfMac@2001:470:1f0f:226:e8ce:3184:795e:ed67] has quit [Ping timeout: 260 seconds] 03:33 -!- profmac [~ProfMac@72-48-98-98.dyn.grandenetworks.net] has joined #bitcoin-core-dev 03:49 -!- lukedashjr [~luke-jr@unaffiliated/luke-jr] has joined #bitcoin-core-dev 03:50 -!- luke-jr [~luke-jr@unaffiliated/luke-jr] has quit [Ping timeout: 245 seconds] 03:50 -!- Krellan [~Krellan@2601:640:4000:9258:1d29:95e7:5385:8867] has quit [Ping timeout: 250 seconds] 03:53 -!- lukedashjr is now known as luke-jr 03:56 -!- hebasto [~hebasto@195.60.70.234] has joined #bitcoin-core-dev 04:05 -!- lnostdal [~lnostdal@77.70.119.51] has quit [Ping timeout: 245 seconds] 04:17 -!- lnostdal [~lnostdal@85.118.80.170] has joined #bitcoin-core-dev 04:24 -!- lnostdal [~lnostdal@85.118.80.170] has quit [Ping timeout: 252 seconds] 04:36 -!- lnostdal [~lnostdal@85.118.80.170] has joined #bitcoin-core-dev 04:41 -!- lnostdal [~lnostdal@85.118.80.170] has quit [Ping timeout: 252 seconds] 04:41 -!- lnostdal [~lnostdal@85.118.80.170] has joined #bitcoin-core-dev 04:47 -!- Guyver2 [AdiIRC@guyver2.xs4all.nl] has joined #bitcoin-core-dev 04:49 -!- lnostdal [~lnostdal@85.118.80.170] has quit [Ping timeout: 252 seconds] 04:53 -!- opdenkamp [~opdenkamp@kodi/staff/dushmaniac] has quit [Ping timeout: 244 seconds] 05:00 -!- lnostdal [~lnostdal@85.118.80.170] has joined #bitcoin-core-dev 05:12 -!- itaseski [~itaseski@213.135.176.252] has joined #bitcoin-core-dev 05:16 -!- owowo [~ovovo@unaffiliated/ovovo] has joined #bitcoin-core-dev 05:39 -!- hebasto [~hebasto@195.60.70.234] has quit [Remote host closed the connection] 06:14 -!- opdenkamp [~opdenkamp@kodi/staff/dushmaniac] has joined #bitcoin-core-dev 06:23 -!- Chris_Stewart_5 [~chris@unaffiliated/chris-stewart-5/x-3612383] has joined #bitcoin-core-dev 06:52 -!- lnostdal [~lnostdal@85.118.80.170] has quit [Ping timeout: 245 seconds] 06:58 -!- g687 [~quassel@host109-150-89-92.range109-150.btcentralplus.com] has joined #bitcoin-core-dev 07:05 -!- lnostdal [~lnostdal@77.70.119.51] has joined #bitcoin-core-dev 07:09 -!- Chris_Stewart_5 [~chris@unaffiliated/chris-stewart-5/x-3612383] has quit [Ping timeout: 246 seconds] 07:16 -!- Chris_Stewart_5 [~chris@unaffiliated/chris-stewart-5/x-3612383] has joined #bitcoin-core-dev 07:22 -!- ken2812221 [~ken281222@180.217.161.139] has quit [Quit: Leaving] 07:57 -!- g687 [~quassel@host109-150-89-92.range109-150.btcentralplus.com] has quit [Read error: Connection reset by peer] 08:04 -!- ken2812221 [~ken281222@180.217.161.139] has joined #bitcoin-core-dev 08:35 -!- opdenkamp [~opdenkamp@kodi/staff/dushmaniac] has quit [Ping timeout: 272 seconds] 08:40 -!- opdenkamp [~opdenkamp@kodi/staff/dushmaniac] has joined #bitcoin-core-dev 08:40 -!- jarthur [~jarthur@2605:6000:1019:41ab:cdcd:97cd:6df7:b659] has joined #bitcoin-core-dev 09:01 -!- Krellan [~Krellan@2601:640:4000:9258:1d29:95e7:5385:8867] has joined #bitcoin-core-dev 09:21 -!- jarthur [~jarthur@2605:6000:1019:41ab:cdcd:97cd:6df7:b659] has quit [] 09:43 -!- owowo [~ovovo@unaffiliated/ovovo] has quit [Ping timeout: 245 seconds] 09:45 -!- Victorsueca [~Victorsue@unaffiliated/victorsueca] has quit [Read error: Connection reset by peer] 09:46 -!- Victorsueca [~Victorsue@unaffiliated/victorsueca] has joined #bitcoin-core-dev 09:48 -!- jhfrontz [~Adium@cpe-184-57-118-36.columbus.res.rr.com] has joined #bitcoin-core-dev 09:48 -!- owowo [~ovovo@unaffiliated/ovovo] has joined #bitcoin-core-dev 10:02 < jimpo> hmm, seems the whole block tree db could be moved to flat files since it's all read into memory on startup anyway 10:43 -!- g687 [~quassel@host109-150-89-92.range109-150.btcentralplus.com] has joined #bitcoin-core-dev 10:56 -!- Netsplit *.net <-> *.split quits: stevenroose, Jbaczuk, cncr04s 10:56 -!- Netsplit *.net <-> *.split quits: epic, bad_duck, bosma, mturquette, exit70 10:57 -!- Netsplit over, joins: bad_duck 11:01 -!- stevenroose [~steven@vps.weuste.club] has joined #bitcoin-core-dev 11:01 -!- cncr04s [~cncr04s@unaffiliated/cncr04s] has joined #bitcoin-core-dev 11:01 -!- Jbaczuk [~Jbaczuk@ec2-18-237-204-133.us-west-2.compute.amazonaws.com] has joined #bitcoin-core-dev 11:04 -!- promag [~promag@bl22-247-244.dsl.telepac.pt] has joined #bitcoin-core-dev 11:05 -!- promag [~promag@bl22-247-244.dsl.telepac.pt] has quit [Remote host closed the connection] 11:06 -!- promag [~promag@bl22-247-244.dsl.telepac.pt] has joined #bitcoin-core-dev 11:06 -!- rafalcpp [~racalcppp@84-10-11-234.static.chello.pl] has quit [Ping timeout: 244 seconds] 11:07 -!- profmac [~ProfMac@72-48-98-98.dyn.grandenetworks.net] has quit [Read error: Connection reset by peer] 11:08 -!- Krellan [~Krellan@2601:640:4000:9258:1d29:95e7:5385:8867] has quit [Read error: Connection reset by peer] 11:10 -!- promag [~promag@bl22-247-244.dsl.telepac.pt] has quit [Ping timeout: 252 seconds] 11:19 -!- rafalcpp [~racalcppp@84-10-11-234.static.chello.pl] has joined #bitcoin-core-dev 11:23 -!- promag [~promag@bl22-247-244.dsl.telepac.pt] has joined #bitcoin-core-dev 11:24 -!- profmac [~ProfMac@2001:470:1f0f:226:14e:a751:339f:93d2] has joined #bitcoin-core-dev 11:27 -!- ExtraCrispy [~ExtraCris@67.215.11.12] has quit [Remote host closed the connection] 11:27 -!- promag [~promag@bl22-247-244.dsl.telepac.pt] has quit [Ping timeout: 245 seconds] 11:35 < sipa> jimpo: i guess! 11:37 -!- opdenkamp [~opdenkamp@kodi/staff/dushmaniac] has quit [Ping timeout: 245 seconds] 12:07 -!- Guyver2 [AdiIRC@guyver2.xs4all.nl] has quit [Quit: Going offline, see ya! (www.adiirc.com)] 12:07 -!- Krellan [~Krellan@2601:640:4000:9258:1d29:95e7:5385:8867] has joined #bitcoin-core-dev 12:18 -!- savil [savilmatri@gateway/shell/matrix.org/x-dqxgjhwawsypxnes] has quit [Remote host closed the connection] 12:24 -!- savil [savilmatri@gateway/shell/matrix.org/x-mlarlyhlcadridtc] has joined #bitcoin-core-dev 12:25 -!- savil [savilmatri@gateway/shell/matrix.org/x-mlarlyhlcadridtc] has quit [Remote host closed the connection] 12:32 -!- savil [savilmatri@gateway/shell/matrix.org/x-vzbdtpmrzhezttjh] has joined #bitcoin-core-dev 12:33 -!- rafalcpp [~racalcppp@84-10-11-234.static.chello.pl] has quit [Read error: Connection reset by peer] 12:34 -!- rafalcpp [~racalcppp@84-10-11-234.static.chello.pl] has joined #bitcoin-core-dev 12:46 -!- vexbuy [~vexbuy@147.red-83-47-212.dynamicip.rima-tde.net] has joined #bitcoin-core-dev 12:46 -!- Victorsueca [~Victorsue@unaffiliated/victorsueca] has quit [Read error: Connection reset by peer] 12:47 -!- Victorsueca [~Victorsue@unaffiliated/victorsueca] has joined #bitcoin-core-dev 12:50 -!- hebasto [~hebasto@195.60.70.234] has joined #bitcoin-core-dev 13:00 -!- g687 [~quassel@host109-150-89-92.range109-150.btcentralplus.com] has quit [Ping timeout: 245 seconds] 13:01 -!- vexbuy [~vexbuy@147.red-83-47-212.dynamicip.rima-tde.net] has quit [] 13:15 -!- Chris_Stewart_5 [~chris@unaffiliated/chris-stewart-5/x-3612383] has quit [Ping timeout: 240 seconds] 13:22 -!- hebasto [~hebasto@195.60.70.234] has quit [Remote host closed the connection] 13:38 -!- intcat [~zshlyk@gateway/tor-sasl/intcat] has quit [Ping timeout: 250 seconds] 13:41 -!- intcat [~zshlyk@gateway/tor-sasl/intcat] has joined #bitcoin-core-dev 13:44 < wumpus> I think the idea is to not read it all into memory at some point 13:44 < wumpus> just like with the wallet, FWIW 13:45 < wumpus> for the block index, the pointers could be handles that prompt fetching some more specific data only on demand 13:46 < wumpus> ken2812221: yes, that is funny 13:46 < wumpus> ken2812221: the argument handling code is pretty weird in some regards, now 13:47 < wumpus> I tried to document it, but I guess I failed 13:48 < wumpus> I guess I'm going to untag #14105 and #14100 from 0.17.0 13:48 < gribble> https://github.com/bitcoin/bitcoin/issues/14105 | util: Report parse errors in configuration file by laanwj · Pull Request #14105 · bitcoin/bitcoin · GitHubAsset 1Asset 1 13:48 < gribble> https://github.com/bitcoin/bitcoin/issues/14100 | doc: Change documentation for =0 for non-boolean options by laanwj · Pull Request #14100 · bitcoin/bitcoin · GitHub 13:49 < wumpus> we're never going to do a release if we try to solve this first 13:53 < luke-jr> wumpus: aren't block indexes so small that it wouldn't be worth doing fetch-on-demand handles? (as opposed to fetch-on-demand map) 13:56 < wumpus> luke-jr: there is certainly some minimum state that would make no sense to fetch on deman 13:56 < wumpus> luke-jr: on the other hand, the structure per block is growing every release, I'm sure there are also things that don't make sense to read and store persistently 13:58 < wumpus> luke-jr: I just meant I don't want to commit to a flat file because of that; also for updates, that would be much harder to manage 13:59 < wumpus> having a block index database makes sense, no matter how exactly it's managed now 14:02 < luke-jr> sure 14:04 < wumpus> what is wrong with travis on master: https://travis-ci.org/bitcoin/bitcoin/builds/423430634?utm_source=email&utm_medium=notification 14:04 < wumpus> the linting stage is failing but there are no errors 14:11 < wumpus> of course it all passes perfectly locally 14:14 -!- Krellan [~Krellan@2601:640:4000:9258:1d29:95e7:5385:8867] has quit [Read error: Connection reset by peer] 14:14 -!- Krellan [~Krellan@2601:640:4000:9258:1d29:95e7:5385:8867] has joined #bitcoin-core-dev 14:15 -!- maitra [~voltron@59.153.120.164] has joined #bitcoin-core-dev 14:29 < gmaxwell> luke-jr: so sizeof(CBlockIndex) is 144 bytes, so thats 78MB (and slowly growing) of memory used for little particular purpose, excluding malloc overheads (which I guess are probably at least another 16 bytes per header). The fact that we also keep so many of them in memory means a longer start time, and constant pressure to not add things to those objects with a result of reducing 14:29 < gmaxwell> functionality. 14:29 < gmaxwell> so I think it would make sense to eventually not keep them in memory. 14:31 < gmaxwell> there should be no particular reason that someone couldn't run a fully functional bitcoin node using a few tens of MB of ram... though obviously not one with the lowest possible latency. 14:31 < luke-jr> gmaxwell: sure, I'm just saying, a handle wouldn't be a big improvement 14:32 < luke-jr> seems to make more sense to just create the indexx object itself on demand 14:32 < luke-jr> and not store anything in memory per-block 14:33 < gmaxwell> ah, I think I agree with that. 14:34 < gmaxwell> Well really the access to the block index could be intermediated through a caching layer, so that the policy of what is in memory vs not is hidden from the rest of the code. 14:34 < luke-jr> sure 14:35 -!- commavir [vir@2604:180::502b:135a] has quit [Quit: leaving] 14:39 -!- commavir [vir@2604:180::502b:135a] has joined #bitcoin-core-dev 14:40 -!- JackH [~laptop@host86-182-8-23.range86-182.btcentralplus.com] has quit [Ping timeout: 240 seconds] 14:47 < wumpus> "so I think it would make sense to eventually not keep them in memory" exactly 14:48 < wumpus> I just meant we shouldn't be making any code changes in the direction of making that more difficult 14:49 < wumpus> not so much 'we should be doing that now' 14:49 < wumpus> I'd agree it's certainly not the biggest memory sink at the moent 14:52 < gmaxwell> maybe one of the least useful ones, however. 14:55 < wumpus> true 15:00 -!- d9b4bef9 [~d9b4bef9@web501.webfaction.com] has quit [Remote host closed the connection] 15:08 -!- michaelsdunn1 [~michaelsd@unaffiliated/michaelsdunn1] has joined #bitcoin-core-dev 15:33 -!- grubles [~grubles@gateway/tor-sasl/grubles] has quit [Remote host closed the connection] 15:34 -!- grubles [~grubles@gateway/tor-sasl/grubles] has joined #bitcoin-core-dev 15:44 -!- maitra [~voltron@59.153.120.164] has quit [Quit: WeeChat 1.9.1] 15:54 -!- spinza [~spin@155.93.246.187] has quit [Quit: Coyote finally caught up with me...] 15:54 -!- polydin [~delphi@2601:204:d603:a09:f8e4:44a0:df23:e9a7] has joined #bitcoin-core-dev 15:56 -!- polydin [~delphi@2601:204:d603:a09:f8e4:44a0:df23:e9a7] has quit [Quit: Leaving] 15:57 -!- polydin [~delphi@2601:204:d603:a09:f8e4:44a0:df23:e9a7] has joined #bitcoin-core-dev 16:02 -!- no_input_found [no_input_f@gateway/vpn/privateinternetaccess/noinputfound/x-24977668] has quit [Remote host closed the connection] 16:02 -!- no_input_found [no_input_f@gateway/vpn/privateinternetaccess/noinputfound/x-24977668] has joined #bitcoin-core-dev 16:04 -!- spinza [~spin@155.93.246.187] has joined #bitcoin-core-dev 16:17 -!- promag [~promag@bl22-247-244.dsl.telepac.pt] has joined #bitcoin-core-dev 16:40 -!- plankers [~plank@c-98-238-141-78.hsd1.ca.comcast.net] has joined #bitcoin-core-dev 16:41 -!- promag [~promag@bl22-247-244.dsl.telepac.pt] has quit [Remote host closed the connection] 16:53 -!- michaelsdunn1 [~michaelsd@unaffiliated/michaelsdunn1] has quit [Read error: Connection reset by peer] 16:57 -!- dendisuhubdy [~dendisuhu@mtrlpq0721w-76-68-198-91.dsl.bell.ca] has joined #bitcoin-core-dev 17:09 -!- dqx [~dqx@unaffiliated/dqx] has joined #bitcoin-core-dev 17:11 < echeveria> is there any reason the p2p messages have checksums at all? 17:12 < echeveria> all of the data in messages ends up being hashed regardless somewhere down the line. 17:19 -!- dendisuhubdy [~dendisuhu@mtrlpq0721w-76-68-198-91.dsl.bell.ca] has quit [] 17:23 < sipa> echeveria: there as a bug once in the message deserializer, and someone thought it was a good idea to be able to detect future things like that by adding a checksum 17:24 < sipa> this was in 0.2.x days 17:24 < sipa> early 2010 maybe 17:32 -!- Chris_Stewart_5 [~chris@unaffiliated/chris-stewart-5/x-3612383] has joined #bitcoin-core-dev 17:36 < echeveria> kind of annoying to keep them in memory to hash them though. 17:47 -!- itaseski [~itaseski@213.135.176.252] has quit [Ping timeout: 252 seconds] 17:47 -!- dqx_ [~dqx@unaffiliated/dqx] has joined #bitcoin-core-dev 17:50 -!- dqx [~dqx@unaffiliated/dqx] has quit [Ping timeout: 245 seconds] 18:16 -!- d9b4bef9 [~d9b4bef9@web501.webfaction.com] has joined #bitcoin-core-dev 18:26 < gmaxwell> echeveria: you don't have to, you can compute the hash incrementally. 18:26 < gmaxwell> (in fact, bitcoin core computes the hash incrementaly) 18:27 < gmaxwell> The proposed encrypted transport eliminates the checksum, but introduces a mac... but at least that does something useful (protects traffic from tampering) 18:29 < gmaxwell> (and before anyone things "but bitcoin traffic doesn't really need to be tamper protected" -- it's important to authenticate encrypted data or you can use targeted tampering to extract small amounts of data from encrypted links by tampering and observing what happens) 18:31 -!- Krellan [~Krellan@2601:640:4000:9258:1d29:95e7:5385:8867] has quit [Read error: Connection reset by peer] 18:32 -!- Krellan [~Krellan@2601:640:4000:9258:1d29:95e7:5385:8867] has joined #bitcoin-core-dev 18:36 -!- fanquake [~fanquake@unaffiliated/fanquake] has joined #bitcoin-core-dev 18:38 < fanquake> jonasschnelli Did/do you have an Xcode setup for Core dev/debugging? 19:21 -!- plankers [~plank@c-98-238-141-78.hsd1.ca.comcast.net] has quit [Quit: Leaving.] 20:13 -!- Chris_Stewart_5 [~chris@unaffiliated/chris-stewart-5/x-3612383] has quit [Ping timeout: 246 seconds] 20:13 -!- Chris_Stewart_5 [~chris@unaffiliated/chris-stewart-5/x-3612383] has joined #bitcoin-core-dev 20:33 -!- Chris_Stewart_5 [~chris@unaffiliated/chris-stewart-5/x-3612383] has quit [Ping timeout: 240 seconds] 21:21 -!- Victorsueca [~Victorsue@unaffiliated/victorsueca] has quit [Read error: Connection reset by peer] 21:22 -!- Victorsueca [~Victorsue@unaffiliated/victorsueca] has joined #bitcoin-core-dev 21:45 -!- Sinclair6 [~sinclair6@108-75-18-87.lightspeed.clmboh.sbcglobal.net] has quit [Ping timeout: 252 seconds] 22:17 -!- d9b4bef9 [~d9b4bef9@web501.webfaction.com] has quit [Remote host closed the connection] 22:18 -!- d9b4bef9 [~d9b4bef9@web501.webfaction.com] has joined #bitcoin-core-dev 22:51 -!- TheHoliestRoger [~TheHolies@unaffiliated/theholiestroger] has quit [Quit: Find me in #TheHolyRoger or https://theholyroger.com] 22:53 -!- TheHoliestRoger [~TheHolies@unaffiliated/theholiestroger] has joined #bitcoin-core-dev 22:59 -!- TheHoliestRoger [~TheHolies@unaffiliated/theholiestroger] has quit [Quit: Find me in #TheHolyRoger or https://theholyroger.com] 23:02 -!- TheHoliestRoger [~TheHolies@unaffiliated/theholiestroger] has joined #bitcoin-core-dev 23:24 -!- jhfrontz [~Adium@cpe-184-57-118-36.columbus.res.rr.com] has quit [Quit: Leaving.] 23:27 -!- profmac [~ProfMac@2001:470:1f0f:226:14e:a751:339f:93d2] has quit [Ping timeout: 250 seconds] 23:35 < jonasschnelli> fanquake: yes. I have one. 23:35 < jonasschnelli> though I mostly use my QtCreator setup... 23:35 < jonasschnelli> Debugger integration with QT object inspection is great. 23:59 -!- profmac [~ProfMac@2001:470:1f0f:226:14e:a751:339f:93d2] has joined #bitcoin-core-dev --- Log closed Sun Sep 02 00:00:57 2018