--- Day changed Fri Jun 10 2016
00:45 < adlai> hello
00:49 < afreak__> hylo \o
00:50  * adlai has been out of the loop due to forced hospitalization
00:55 < waxwing> adlai: nice to have you back :)
00:55 < waxwing> for all, pls read and consider testing: https://github.com/JoinMarket-Org/joinmarket/pull/568#issuecomment-225116786
00:56 < adlai> you don't yet, i'm only "out" for a couple hours
00:56 < waxwing> ah ok. well, all is a shambles here pretty much as usual :)
00:56 < adlai> they want me back before sundown, this is just a test to see if i freak out from seeing the real world or somesuch
00:57  * adlai has a court hearing on thursday to determine whether the hospitalization continues
00:59 < waxwing> DOSer is doing better now
00:59 < waxwing> collecting more utxos from me
01:01 < adlai> looks like my JM box died while i was away. RIP.
01:02 < adlai> magic number failures on every superblock >_<
01:12 < adlai> waxwing: my guess is that I won't be back to full operating capacities for another couple weeks.
01:15 -!- mkarrer [~mkarrer@3.red-83-55-151.dynamicip.rima-tde.net] has joined #joinmarket
02:07 < belcher_> raedah: i saw it, that is basically a pro-monero hit piece from my reading
02:07 < belcher_> adlai: hope everything goes well for you
02:08 < belcher_> anyway the monero people will have a nice day when we have to warn people about using joinmarket because of #156
02:51 -!- p15x [~p15x@84.201.12.50] has joined #joinmarket
02:52 -!- mkarrer [~mkarrer@3.red-83-55-151.dynamicip.rima-tde.net] has quit []
04:09 < fluffypony> belcher_: nobody in the community warns people not to use JoinMarket, it's widely encouraged
04:10 < fluffypony> obviously with the preface that there's a Sybil risk involved, but that's just pragmatism - we're even worse when discussing Monero's risks :-P
04:10 < fluffypony> oh wait you said "we", I thought you meant the Monero community would be the ones doing the warning
04:24 < waxwing> belcher_: is it worth me re-creating #328 or whatever it was? there seems to be a ton of discussion that needs to happen before we settle on something.
04:24 < waxwing> i guess i can just take a quick look at the podle module and review it to at least make sure it's correct.
04:25 < waxwing> i remember i made a note about coin age, i might look again and see how feasible that is via blockchaininterface. probably looked at it before but it was > 6 months ago.
04:29 < waxwing> rpc gettxout['confirmations'] seems ok i guess.
04:33 -!- p15x [~p15x@84.201.12.50] has quit [Ping timeout: 276 seconds]
04:41 -!- moli [~molly@unaffiliated/molly] has joined #joinmarket
05:07 -!- molz [~molly@unaffiliated/molly] has joined #joinmarket
05:10 -!- moli [~molly@unaffiliated/molly] has quit [Ping timeout: 240 seconds]
06:37 < belcher_> waxwing: if you like, yes
06:37 < belcher_> it would be done as a new order type im guessing
06:44 < belcher_> maybe its better to skip all the other 'nice to have' ideas for now, and just make it easier to add new order types and implement the same order type as now but with the anti-156 
06:45 < belcher_> also, the new order type can combine relorder and absorder, the fee can be A*amount + B, and the new order type advertises A and B
06:47 -!- veqtrus [~veqtrus@cpe-366758.ip.primehome.com] has joined #joinmarket
06:56 < waxwing> ah new order type, yes. that can apply here as well.
06:56 < waxwing> i just went out for a walk and it occurred to me what a lot of hassle it'll be to try to make it easy to for users to get a utxo to use for commitment.
06:57 < waxwing> if you have an existing JM wallet it shouldn't be *that* hard to code it to find one to use, but .. not sure. Grabbing one from outside is not that hard in principle, but then we need to have people know what the conditions are - e.g. coin age and amount.
06:58 -!- veqtrus [~veqtrus@cpe-366758.ip.primehome.com] has quit [Ping timeout: 272 seconds]
06:58 -!- Giszmo [~leo@pc-122-14-46-190.cm.vtr.net] has joined #joinmarket
07:59 -!- mec [~mec@209.95.50.103] has joined #joinmarket
08:00 < mec> What is the cause of all the "txn-mempool-conflict" when trying to push txns in the past weeks?
08:00 < mec> Is it malicious makers?
08:46 -!- puddinpop [~puddinpop@unaffiliated/puddinpop] has quit [Ping timeout: 250 seconds]
08:47 < OverlordQ> omg :|
08:47 < OverlordQ> I've had to restart wallet-tool like 8 times because it keeps complaining about not enough addresses lol
08:47 < OverlordQ> that guy that never completes txns really stuffed it up
08:55 < OverlordQ> oh, actually it seems to be broken
08:55 < OverlordQ> since shouldn't the number of addresses listed when running getaddressesbyaccount increase?
08:56 -!- coins123 [~coins123@unaffiliated/coins123] has quit []
09:12 < OverlordQ> any ideas?
09:18 < waxwing> OverlordQ: can you get it to run?
09:19 < waxwing> if not i suggest changing addr_req_count in blockchaininterface.py.
09:19 < OverlordQ> define run? Keeps giving me the not enough addresses error
09:20 < OverlordQ> Doing a bitcoind rescan for shitsngiggles, but I'll try that next
09:20 < waxwing> yeah, i meant run as complete properly
09:20 < waxwing> rescan won't be needed if it's not a wallet recovery on a new bitcoind, iirc
09:20 < OverlordQ> I wonder if the spam jacked up the gaplimit
09:26 < waxwing> now i look again, i can't quite figure out why just increasing the gap limit wouldn't be right. when i restarted yesterday, for some reason i found increasing addr_req_count was required but increasing gap limit didn't help. not sure.
09:27 < waxwing> addr_req_count shouldn't be needed as import_address is called on each get_new_address in the wallet, and the index cache is also updated in CoinJoinOrder constructor.
09:29 < waxwing> back when this happened first time, this was the fix that I came up with: https://www.reddit.com/r/joinmarket/comments/3te8lm/too_few_addresses_in_3_1_4_0/cx5frsx
09:29 < waxwing> but, the code has changed since then
09:30 < OverlordQ> I'll give that a shot next
09:30 < OverlordQ> once the rescan gets the bitcoind back up
09:31 < OverlordQ> then I'll edit in something to block that guy
09:32 < waxwing> won't help unless they're using a fixed hostmask
09:33 < OverlordQ> nah, the amount they want to fill is always the same
09:34 -!- puddinpop [~puddinpop@unaffiliated/puddinpop] has joined #joinmarket
09:39 < OverlordQ> well the rescan is actually spitting out AddToWallet msgs but I'm unsure if that means it's txns it missed, or just all txns involving addresses
09:44 -!- mkarrer [~mkarrer@3.red-83-55-151.dynamicip.rima-tde.net] has joined #joinmarket
09:53 < OverlordQ> probably shouldn't have set it to x30 from x3, taking a while lol
09:54 < OverlordQ> yay, finally back up
09:58 -!- dorkbot [~dorkbot@104.238.194.236] has quit [Quit: Leaving]
10:01 < waxwing> x30 from x3?
10:06 < OverlordQ> yeah
10:12 < OverlordQ> wow, still giving too few error
10:16 < waxwing> x30 from x3 refers to what?
10:16 < OverlordQ> the for _ in range(addr_req_count * 3)] line
10:17 -!- puddinpop [~puddinpop@unaffiliated/puddinpop] has quit [Remote host closed the connection]
10:17 < waxwing> OverlordQ: it happens in two places, can't remember, but i'd suggest just resetting the definition of addr_req_count to 200 say from 20
10:18 < waxwing> and you still need to run it twice
10:18 < waxwing> but i'm trying to work on something else, i'd need to dive back into that code in case that still doesn't work
10:19 < OverlordQ> yeah still nogo, wont even let me dumpseed
10:20 < OverlordQ> oh wait, there we go
10:25 < waxwing> did it work?
10:25 < OverlordQ> doing a rescan again after a recovery :)
10:26 < waxwing> what happened? could you run wallet-tool?
10:27 < OverlordQ> yeah, still complaining about too few, so I cleared out my bitcoind wallet file and recovered from seed
10:28 < waxwing> so after changing to 200 from 20, it still complained about too few? i'm not saying i find it surprising, i just want to be clear what happened.
10:28 < OverlordQ> yeah
10:32 < OverlordQ> Set it to 200, recovered from seed. Ran wallet-tool, imported 2000 addresses, running rescan now
10:34 < waxwing> i think this way you are going to need big gap limits.
10:34 < waxwing> although, it's hard to say, depends on specifics
10:35 < waxwing> spammer requests 100 transactions, then you get a real one: you'd have a 100 gap. etc.
10:35 < OverlordQ> meh
10:36 < OverlordQ> Yeah, once I can get access to the coins again, I'll probably move them to a brand new wallet
10:36 < belcher_> yg records the current index in wallet.json
10:37 < belcher_> you only need to do all this gap limit business if you're recovering from seed and nothing else
10:37 < waxwing> right, which is why i said that :)
10:37 < waxwing> because he decided to go that route. i *think* otherwise, you just need to import more to get it work.
10:38 < OverlordQ> Still have both wallets
10:38 < OverlordQ> even though they're the same seed
10:39 < OverlordQ> the 'broken' one has: "index_cache": [[27, 1938], [14, 1985], [11, 83], [3, 56], [1, 42]]
10:39 < waxwing> i had a bot running for several days against the spammer, i found that a bump of addr_req_count was enough.
10:40 < OverlordQ> well it imported 2k and doing the rescan, so I'll play with the gaplimit once it's done
10:41 < waxwing> well that's 2000 overall. so it's 200 per branch for 5 mixdepths
10:41 < OverlordQ> ah 
10:42 < waxwing> funny i was just thinking yesterday, oh no, here come all the questions about why the wallet won't load :( 
10:45 < OverlordQ> so will I have to rescan after it imports each chunk?
10:46 < waxwing> you should only need to rescan once for recovery (but i don't think you needed to rescan/recover at all)
10:46 < OverlordQ> well I cleared out my bitcoind dir so :)
10:47 < waxwing> i'm remembering this conversation belcher_ : https://www.reddit.com/r/joinmarket/comments/3te8lm/too_few_addresses_in_3_1_4_0/cx5kv5i
10:48 < belcher_> yeah
10:48 < belcher_> one line edit... plus testing
10:49 < waxwing> cool if so. but i'm not clear at all about it. i always find that bit of code (sync_addresses) really twisty to understand.
10:49 < OverlordQ> weee blockr is slow
10:49 < waxwing> well, not to exaggerate .. i kind of get it after looking at it for a bit.
10:50 < belcher_> i agree, its a bit weird yes
10:50 < belcher_> maybe it would be better to have it as "while True:" and then a few if statements that break
10:52 < waxwing> i think it's the logic that's difficult, rather than the code. the index and the index_cache and how the wallet interacts with the blockchaininterface (imports) etc etc
10:55 -!- coins123 [~coins123@unaffiliated/coins123] has joined #joinmarket
10:56 -!- puddinpop [~puddinpop@unaffiliated/puddinpop] has joined #joinmarket
10:59 -!- coins123 [~coins123@unaffiliated/coins123] has quit [Excess Flood]
11:00 < OverlordQ> so once the rescan finishes, what'd my next step be
11:00 < belcher_> run wallet-tool to see if the coins appeared
11:00 < OverlordQ> if it wants to import more addresses would I need to rescan again?
11:01 < belcher_> hmm
11:01 -!- coins123 [~coins123@unaffiliated/coins123] has joined #joinmarket
11:01 < belcher_> it would only import like 20 then wouldnt it ? seems like not enough
11:01 < belcher_> maybe increase that number in the source? alternatively delete wallet.dat and start from importing but this time 4000 addresses
11:02 < OverlordQ> would I still need to play with gaplimit to find any valid txns stuck in the middle of the wasteland of used addresses?
11:03 < belcher_> yes but rescanning isnt required
11:04 -!- moli [~molly@unaffiliated/molly] has joined #joinmarket
11:05 < OverlordQ> Still aggrivating a single user can stuff things up this much
11:05 < waxwing> so basically you need to rescan *after* you've imported all the correct addresses, right?
11:06 < belcher_> yeah
11:06 < belcher_> agreed OverlordQ the current system is a mess :|
11:06 -!- molz [~molly@unaffiliated/molly] has quit [Ping timeout: 240 seconds]
11:09 < OverlordQ> did the scep256k stuff get re-added?
11:09 < pigeons> https://www.oftc.net/Tor/
11:10 < waxwing> OverlordQ: yes. it's optional but highly recommended. install instructions are on readme
11:15 < waxwing> (in this situation it's pretty important since it drastically speeds up scanning the BIP32 branches)
11:15 < waxwing> pigeons: interesting, thanks
11:15 < OverlordQ> yeah, just wasn't sure if it got merged back into develop or if it was still in it's own branch
11:15 < waxwing> it's in master now, i think it was the last release (0.1.4)
11:24 -!- coins123 [~coins123@unaffiliated/coins123] has quit [Remote host closed the connection]
11:34 < OverlordQ> welp  imported 6k, rescanning again
11:57 -!- imposter [uid57046@gateway/web/irccloud.com/x-aqqgtdjhrddysnzt] has joined #joinmarket
11:58 < OverlordQ> wish it didn't take 30+ minutes :|
11:58 < imposter> herro
12:09 -!- molz [~molly@unaffiliated/molly] has joined #joinmarket
12:11 -!- moli [~molly@unaffiliated/molly] has quit [Ping timeout: 250 seconds]
12:14 < OverlordQ> welp, that failed
12:14 < OverlordQ> still wasn't enough
12:15 < waxwing> OverlordQ: you don't need to rescan each time. you should try restart without rescan at each point. having said that, 600 per branch not enough sounds suprising to say the least.
12:16 < OverlordQ> *shrug*
12:16 < waxwing> belcher_ may correct me but you want to get it to not say "not enough in ..." first.
12:16 < waxwing> for myself i've never rescanned once in the ~12 months i've been using this wallet.
12:17 < waxwing> well, after start up i mean
12:18 < OverlordQ> well i get a balance but nowhere what should be in there
12:18 < pigeons> i've never had to rescan, but sometimes need to run wallet-tool a few times
12:18 < waxwing> ah, so you do get a balance? well that's better than i thought. then you may well need to do a big gap limit as we discussed above.
12:19 < waxwing> because you recovered, it doesn't have the index cache to work from.
12:20 < OverlordQ> If I use the wallet file with the index cache I get the 'not enough in' error
12:20 < OverlordQ> if I use the wallet file w/o the index cache I get the partial balance
12:21 < waxwing> yes. again, increase the gap limit. it's almost certainly just quitting the search too early due to a gap.
12:22 < waxwing> you can probably use the old index cache as a clue: look at the latest indices displayed and see if they're smaller than those cached indices.
12:22 < OverlordQ> very much so, new wallet is in the 20's, index cache is like 1800
12:23 < waxwing> yes unfortunately that doesn't tell you how big to set it, but i'd set it fairly big.
12:23 < waxwing> if you're using secp256k1 it won't take long
12:23 < OverlordQ> should be, but still taking a bit
12:24 < OverlordQ> just a lot to go through :)
12:25 -!- nanasho [~nanasha25@ipbcc12eb9.dynamic.kabel-deutschland.de] has joined #joinmarket
12:26 < OverlordQ> Yeah: "index_cache": [[27, 1938], [14, 1985]
12:27 < OverlordQ> May just generate all the priv for all branches up to like 2k and sweep outside of CJ
12:30 -!- veqtrus [~veqtrus@cpe-366758.ip.primehome.com] has joined #joinmarket
12:43 < OverlordQ> still running lol
12:56 < OverlordQ> Yeah, bumping the gaplimit just wanted it to import 300k addresses
12:56 < OverlordQ> which will take forever
12:56 < OverlordQ> So i'm just going to call these coins lost (again)
13:02 < OverlordQ> does JM use hardened keys or regular?
13:08 < OverlordQ> well i'm an idiot. I was using -m instead of -g
13:09 < OverlordQ> Yes, let me generate 2000 mix levels with 300 addresses :|
13:12 < waxwing> lol
13:24 < OverlordQ> hurm, still short coins
13:25 < OverlordQ> doing another import than rescan
14:49 -!- coins123 [~coins123@unaffiliated/coins123] has joined #joinmarket
15:34 -!- raedah [~x@172.58.41.91] has quit [Quit: WeeChat 1.5]
15:52 -!- veqtrus [~veqtrus@cpe-366758.ip.primehome.com] has quit [Ping timeout: 272 seconds]
15:57 -!- raedah [~x@172.58.41.91] has joined #joinmarket
16:35 -!- nanasho [~nanasha25@ipbcc12eb9.dynamic.kabel-deutschland.de] has quit [Remote host closed the connection]
21:34 -!- Cory [~C@unaffiliated/cory] has quit [Ping timeout: 252 seconds]
21:38 -!- Cory [~C@unaffiliated/cory] has joined #joinmarket
21:54 -!- ghtdak [~ghtdak@unaffiliated/ghtdak] has quit [Ping timeout: 240 seconds]
21:54 -!- ghtdak [~ghtdak@unaffiliated/ghtdak] has joined #joinmarket
23:48 -!- Giszmo [~leo@pc-122-14-46-190.cm.vtr.net] has quit [Quit: Leaving.]