--- Log opened Fri Jul 10 00:00:14 2020
01:58 -!- rafalcpp [~racalcppp@ip-178-214.ists.pl] has joined #utreexo
04:25 < kcalvinalvin> hmmm I think I may know why btcd is taking forever with scriptval... With a dual core cpu that supports 2 threads per cpu, it's creating 12 goroutines *per tx*. I haven't looked at actual btcd code yet but the way csn calls scriptValidate now, each script is taking 60% of the time waiting for the scheduler
04:25 < kcalvinalvin> I suspect it'll be similar for actual btcd code
04:39 < kcalvinalvin> I guess this sorta explains the gc situation as well. Go allocates new stacks on the heap so a block has 1000~2000 txs so that must be one of the reasons why gc takes so long
04:39 < kcalvinalvin> *new stacks for each goroutine when it needs more than the default of 4096 bytes
07:13 -!- rafalcpp [~racalcppp@ip-178-214.ists.pl] has quit [Ping timeout: 240 seconds]
07:17 -!- rafalcpp [~racalcppp@185.3.112.131] has joined #utreexo
07:25 -!- rafalcpp [~racalcppp@185.3.112.131] has quit [Ping timeout: 256 seconds]
07:25 -!- rafalcpp_ [~racalcppp@ip-178-214.ists.pl] has joined #utreexo
09:45 < kcalvinalvin> hmmm odd looks like decred has the same problem
09:46 < kcalvinalvin> ah decred has like 10 txs per block so this shouldn't be a problem for them
10:34 < rjected> kcalvinalvin: in my profiling I've seen a massive amount of basically useless allocs in treap, which I think probably contributes more to the GC pressure that bogs down sync. Do you see the same thing?
10:35 < rjected> I have a theory that the database package is the problem, which would mean that utreexo might help a lot
14:03 -!- ThomasV [~thomasv@unaffiliated/thomasv] has joined #utreexo
14:26 -!- rafalcpp_ [~racalcppp@ip-178-214.ists.pl] has quit [Ping timeout: 264 seconds]
15:26 -!- ThomasV [~thomasv@unaffiliated/thomasv] has quit [Ping timeout: 265 seconds]
20:26 < kcalvinalvin> I haven't profiled btcd in depth yet so not sure. But csn is a lot faster with proper concurrency in scriptval.go
22:12 -!- ThomasV [~thomasv@unaffiliated/thomasv] has joined #utreexo
22:59 -!- valwal_ [sid334773@gateway/web/irccloud.com/x-luuxrqxzkssfsrcv] has quit [Ping timeout: 256 seconds]
23:00 -!- valwal_ [sid334773@gateway/web/irccloud.com/x-abwsebbkiydvjbvo] has joined #utreexo
--- Log closed Sat Jul 11 00:00:15 2020