--- Day changed Fri Mar 22 2019 00:04 -!- libertyprime [~libertypr@203.86.194.68] has joined #lnd 00:17 -!- libertyprime [~libertypr@203.86.194.68] has quit [Quit: leaving] 00:19 -!- ccdle12 [~ccdle12@cpc139350-aztw33-2-0-cust310.18-1.cable.virginm.net] has joined #lnd 00:33 -!- ccdle12 [~ccdle12@cpc139350-aztw33-2-0-cust310.18-1.cable.virginm.net] has quit [Ping timeout: 245 seconds] 00:42 -!- ccdle12 [~ccdle12@cpc139350-aztw33-2-0-cust310.18-1.cable.virginm.net] has joined #lnd 02:06 -!- ccdle12 [~ccdle12@cpc139350-aztw33-2-0-cust310.18-1.cable.virginm.net] has quit [Remote host closed the connection] 03:03 -!- ccdle12 [~ccdle12@cpc139350-aztw33-2-0-cust310.18-1.cable.virginm.net] has joined #lnd 03:50 -!- ccdle12 [~ccdle12@cpc139350-aztw33-2-0-cust310.18-1.cable.virginm.net] has quit [Remote host closed the connection] 03:59 -!- mp [sid298319@gateway/web/irccloud.com/x-xhrzeaztvmlbipyu] has quit [Ping timeout: 252 seconds] 04:00 -!- hsmiths_ [uid95325@gateway/web/irccloud.com/x-pqrcoovrvvyronjm] has joined #lnd 04:00 -!- hsmiths [uid95325@gateway/web/irccloud.com/x-maglpbdelwcvqixx] has quit [Ping timeout: 252 seconds] 04:00 -!- hsmiths_ is now known as hsmiths 04:00 -!- mp [sid298319@gateway/web/irccloud.com/x-pokhcztgacdgvwhh] has joined #lnd 05:06 -!- valwal_ [sid334773@gateway/web/irccloud.com/x-dctnsleffvfuxsal] has joined #lnd 05:07 -!- s7r_ [~s7r@openvpn/user/s7r] has joined #lnd 05:09 -!- hop3y [1000@valtio.org] has joined #lnd 05:13 -!- tynes_ [~tynes@c-69-181-195-219.hsd1.ca.comcast.net] has joined #lnd 05:14 -!- Netsplit *.net <-> *.split quits: lnostdal, valwal, tynes, hop3y_, s7r 05:14 -!- s7r_ is now known as s7r 05:18 -!- cryptodechange [cryptodech@host217-42-122-149.range217-42.btcentralplus.com] has quit [Ping timeout: 246 seconds] 05:19 -!- _Sam-- [~greybits@unaffiliated/greybits] has joined #lnd 05:20 -!- cryptodechange [~cryptodec@host217-42-122-149.range217-42.btcentralplus.com] has joined #lnd 05:21 -!- lnostdal [~lnostdal@77.70.119.51] has joined #lnd 06:05 < molz> pendarsoheil, do you have a question? 06:06 -!- spaced0ut [~spaced0ut@unaffiliated/spaced0ut] has joined #lnd 06:27 -!- ghost43 [~daer@gateway/tor-sasl/daer] has quit [Remote host closed the connection] 06:28 -!- ghost43 [~daer@gateway/tor-sasl/daer] has joined #lnd 06:42 < pendarsoheil> molz, Sort of but it is a little off-topic. Do you know of any other active channels for lightning development? 06:51 < molz> pendarsoheil, "lightning developement' is vague, do you have interest in a specific implementation? 07:03 -!- eugene_nickname [ad4462ba@gateway/web/freenode/ip.173.68.98.186] has joined #lnd 07:23 -!- spaced0ut [~spaced0ut@unaffiliated/spaced0ut] has quit [Ping timeout: 244 seconds] 07:34 -!- ccdle12 [~ccdle12@37.205.56.231] has joined #lnd 07:59 < Sentineo> there are more ln clients at developement, it is much more colorful then bitcoind for example. As there is no need for consensus basically. pendarsoheil 07:59 < Sentineo> by colourful I mean more teams can develop independently without asking permission (in order to not break things) 08:37 < pendarsoheil> Sorry for the late reply. Well, I am looking at something to possibly help distribute the lightning network to areas that it may not be able to reach 08:37 < pendarsoheil> Tl;dr: I have an idea around using piconets 08:38 < pendarsoheil> to help some places that I don't want to talk about publicly 08:53 < molz> pendarsoheil, here's LN protocol specs: https://github.com/lightningnetwork/lightning-rfc/blob/master/00-introduction.md 08:54 < pendarsoheil> Thanks, molz. I have ready them before. 09:09 -!- eugene_nickname [ad4462ba@gateway/web/freenode/ip.173.68.98.186] has quit [Quit: Page closed] 09:11 -!- thomasan_ [~thomasand@cpe-172-116-160-42.socal.res.rr.com] has joined #lnd 09:16 -!- thomasan_ [~thomasand@cpe-172-116-160-42.socal.res.rr.com] has quit [Ping timeout: 246 seconds] 09:21 -!- michaelfolkson [~textual@146.185.56.214] has joined #lnd 09:25 -!- pioklo [~Pioklo@118-40.echostar.pl] has joined #lnd 09:27 -!- ccdle12 [~ccdle12@37.205.56.231] has quit [Remote host closed the connection] 09:50 -!- Talkless [~Talkless@hst-227-49.splius.lt] has joined #lnd 09:50 -!- thomasan_ [~thomasand@cpe-172-116-160-42.socal.res.rr.com] has joined #lnd 09:52 -!- ghost43 [~daer@gateway/tor-sasl/daer] has quit [Remote host closed the connection] 09:52 -!- ghost43 [~daer@gateway/tor-sasl/daer] has joined #lnd 09:53 -!- michaelfolkson [~textual@146.185.56.214] has quit [Quit: Sleep mode] 09:54 -!- thomasan_ [~thomasand@cpe-172-116-160-42.socal.res.rr.com] has quit [Ping timeout: 246 seconds] 09:55 -!- michaelfolkson [~textual@146.185.56.214] has joined #lnd 10:04 -!- michaelfolkson [~textual@146.185.56.214] has quit [Quit: Sleep mode] 10:07 -!- michaelfolkson [~textual@146.185.56.214] has joined #lnd 10:17 -!- michaelfolkson [~textual@146.185.56.214] has quit [Quit: Sleep mode] 10:23 -!- thomasan_ [~thomasand@cpe-172-116-160-42.socal.res.rr.com] has joined #lnd 10:27 -!- thomasan_ [~thomasand@cpe-172-116-160-42.socal.res.rr.com] has quit [Ping timeout: 246 seconds] 10:30 -!- eugene_nickname [ad4462ba@gateway/web/freenode/ip.173.68.98.186] has joined #lnd 10:31 < eugene_nickname> So this is in bolt 8: "In order to make traffic analysis more difficult, the length prefix for all encrypted Lightning messages is also encrypted." 10:33 < eugene_nickname> But can't you just subtract 34 (two 16-byte MACs and the 2-byte encrypted message length) and get the length of the message 10:39 < eugene_nickname> It's using a stream cipher so the mapping should be 1-1 I think 10:40 -!- thomasan_ [~thomasand@cpe-172-116-160-42.socal.res.rr.com] has joined #lnd 10:50 < Talkless> I've noticed that in recent days, my node's HDD was reaching 100% ofter, and for a long periods 10:50 < Talkless> iostat shows nearly 100% util, and iotop shows that it's jdb2 10:50 < molz> reaching what? 10:51 < Talkless> though after stopping lnd, disk utilization dropped to nearly zero now, only bitcoind runninbg 10:51 < Talkless> molz: 100% disk utliziation 10:51 < Talkless> it's almost always writing 10:52 < Talkless> look how ulitization dropped after stopping lnd: https://imgur.com/a/ClGTMXN 10:52 -!- Dean_Guss [~dean@gateway/tor-sasl/deanguss] has quit [Ping timeout: 256 seconds] 10:54 < molz> Talkless, im wondering if you can do netstat and see if you have one or two spammers 10:55 < Talkless> I have about ~20 lnd threads working with hdd... 10:55 < Talkless> in iotop view 10:55 < Talkless> molz: how would I recongnize a spammer? 10:56 < Talkless> their IP is known? 10:57 < Talkless> molz: https://paste.debian.net/1074265/ 11:00 < Talkless> after starting LND, I have around ~500KB/s writes (total ~1MB probably because of paranoid data=journal mode) 11:05 < Talkless> these disk usage "spikes" started to appear around ~3 weeks ago https://i.imgur.com/CfcYyHQ.png 11:21 -!- thomasan_ [~thomasand@cpe-172-116-160-42.socal.res.rr.com] has quit [Remote host closed the connection] 11:28 -!- thomasan_ [~thomasand@cpe-172-116-160-42.socal.res.rr.com] has joined #lnd 11:44 -!- gkrizek [~gkrizek@ip98-164-15-79.ks.ks.cox.net] has quit [Ping timeout: 246 seconds] 11:44 -!- thomasan_ [~thomasand@cpe-172-116-160-42.socal.res.rr.com] has quit [Remote host closed the connection] 11:55 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has quit [Ping timeout: 268 seconds] 12:07 -!- AFIP [~AFIP@unaffiliated/masterl1nk] has joined #lnd 12:32 < Talkless> I've got my Tux from lightning.pictures ! https://i.imgur.com/CFyfqhp.jpg 12:32 -!- eugene_nickname_ [ad4462ba@gateway/web/freenode/ip.173.68.98.186] has joined #lnd 12:33 -!- gkrizek [~gkrizek@ec2-54-149-179-115.us-west-2.compute.amazonaws.com] has joined #lnd 12:34 -!- eugene_nickname [ad4462ba@gateway/web/freenode/ip.173.68.98.186] has quit [Ping timeout: 256 seconds] 12:35 -!- gkrizek [~gkrizek@ec2-54-149-179-115.us-west-2.compute.amazonaws.com] has quit [Client Quit] 12:37 < lndbot> awesome, but wy does he look so sad! 12:38 -!- gkrizek [~gkrizek@ec2-54-149-179-115.us-west-2.compute.amazonaws.com] has joined #lnd 12:38 -!- eugene_nickname_ [ad4462ba@gateway/web/freenode/ip.173.68.98.186] has quit [Ping timeout: 256 seconds] 12:44 < Talkless> moli It doesn't look sad to me, kinda shy-cute 12:50 -!- ccdle12 [~ccdle12@88.128.80.154] has joined #lnd 12:59 <@roasbeef> Talkless: do you hhave a long running rescan happening? anything funky in the logs? 13:04 < Talkless> https://github.com/lightningnetwork/lnd/issues/2809#issuecomment-475761841 13:04 < Talkless> roasbeef: no rescans, latest update solved these 13:04 < Talkless> roasbeef: I don't see lot's of anything in logs, actually 13:04 < Talkless> it's rather quiet 13:04 <@roasbeef> cool 13:06 < Talkless> roasbeef: I've noticed only that I've got bunch of new channels during few weeks, I've never had >20 channels.. 13:06 < Talkless> 9 ar active, 17 not currently. 13:06 < Talkless> are* 13:11 < Talkless> roasbeef: maybe I could/should reduce incomming channel count, peer count, etc.? 13:12 < Talkless> roasbeef: maybe it's possible to store some non-critical lnd data in tmpfs? :D 13:12 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has joined #lnd 13:15 < Talkless> Hm, I get [lncli] rpc error: code = Unknown desc = checksum failed. Expected 786rqj, got gpt9wx. for invoice from https://lnsh.pw/ 13:16 < Talkless> oh, missed to copy two chars wrapped to lower line... 13:19 < Talkless> roasbeef: with this load, I can't even pay 42 satoshis :/ 13:20 -!- ccdle12 [~ccdle12@88.128.80.154] has quit [Remote host closed the connection] 13:20 <@roasbeef> thought you said it was resolved? 13:20 <@roasbeef> well the invoice seems invalid in that case 13:20 < Talkless> payinvoice just hangs after typing "yes" 13:20 <@roasbeef> check your logs for peers that seem to be spammy and ban them 13:20 < Talkless> roasbeef: long rescanning was resolved 13:20 < Talkless> like, rescan from genesis after restart or smth.. 13:21 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has quit [Ping timeout: 250 seconds] 13:21 < Talkless> this is "new" issue, hdd is topped for last 2-3 weeks 13:21 < Talkless> roasbeef: how do I detect spammy nodes..? 13:21 < molz> long rescanning? for what? how long did it take? 13:22 < molz> look in netstat if one same ip has a lot of 'SYNC_SENT" 13:24 < Talkless> molz: before some lnd update, after restarting lnd it wook maybe 2 days to rescan whole history. 13:25 < Talkless> now it rescans just some blocks. 13:25 < Talkless> molz: all connections are ESTAB'lished 13:25 <@roasbeef> you had a very old channel be closed likely 13:25 <@roasbeef> it needs to erscan to find where it happened 13:25 <@roasbeef> bitcoind rescan is slow 13:27 < pendarsoheil> How is lightning these days? Are people actively using it? 13:28 < pendarsoheil> For purchases and stuff 13:28 < lndbot> Yeah it’s pretty good 13:28 < pendarsoheil> Anything noteworthy besides loop from initial launch? 13:28 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has joined #lnd 13:29 < lndbot> You can do some kind of messages in space thing but I never tried that myself 13:30 < pendarsoheil> Really? Sounds interesting. Got a link? 13:30 < lndbot> https://blockstream.com/2019/01/16/satellite_api_beta_live/ 13:31 < pendarsoheil> Ah I see. 13:31 < Talkless> also molz, why should SYNC's involve into lot's of disk writes? 13:35 < Talkless> "payment_error": "UnknownPaymentHash(amt=42000 mSAT)", never seen that before :) 13:36 < Talkless> probably timeouted? receiver no longer waiting for payment? (payinvoice took forever...) 13:36 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has quit [Ping timeout: 246 seconds] 13:37 < molz> Talkless, frankly im not sure but it seems to me if a node keeps doing that and your node can't ACK it seems suspicious 13:38 < molz> also look at the numbers in Recv-Q Send-Q if they're unusually higher than the rest of the other IPs, they're requesting your resources, i think 13:44 < Talkless> molz: I don't see anything suspicious, almost all of them increases slightly together https://paste.debian.net/1074278/ 13:49 < Talkless> molz: listpeers shows two nodes that sent me ~30MB of data (since start?) 13:49 < Talkless> compared to ~3 megs for others 13:55 < molz> Talkless, 'disk writes' as in physical disk? maybe you got a worm or trojan... :D 13:56 < Talkless> lol, the only "worm" I got is lnd :))) . Stopping it makes it all breezy. 13:58 < molz> cool! lmao 13:59 < molz> what's the increase in size of your disk when you run lnd? 14:00 < Talkless> not the size, the workload 14:00 < Talkless> utiliztion 14:00 < Talkless> always busy, like 96-100% 14:19 -!- thomasan_ [~thomasand@cpe-172-116-160-42.socal.res.rr.com] has joined #lnd 14:21 -!- thomasan_ [~thomasand@cpe-172-116-160-42.socal.res.rr.com] has quit [Remote host closed the connection] 14:31 < lndbot> Ping @roasbeef or someone else, is my interpretation of that BOLT comment I made above correct 14:38 < molz> Talkless, run top and take screenshot of lnd 14:41 < Talkless> molz: what do you want to see there? 14:42 < Talkless> 13-25% CPU, 265M RSS... 14:42 < Talkless> nothing interesting kinda 14:42 < Talkless> htop for some reason shows 0 reads/writes 14:48 < molz> Talkless, normally that's what people submit to the devs 14:49 -!- hsmiths [uid95325@gateway/web/irccloud.com/x-pqrcoovrvvyronjm] has quit [Quit: Connection closed for inactivity] 14:49 < Talkless> molz: I've pasted the core data - io statistics 14:50 < molz> so htop shows nothing? 14:50 < Talkless> shows 13-25% cpu, 265M rss.. 14:50 < Talkless> iotop shows more interesting things 14:51 < Talkless> int his case 14:51 < Talkless> in* 14:51 < Talkless> molz: https://github.com/lightningnetwork/lnd/issues/2809#issuecomment-475761841 14:51 < Talkless> and iostat 14:52 < Talkless> all I see is that writes goes nuts with lnd. 14:52 < Talkless> vmstat does not show swapping in/out 15:00 < molz> Talkless, i just now saw your pastebin 15:00 < molz> checking ips of nodes connecting to you it seems half of them are from lnbig 15:04 < Talkless> molz: yeah I remember it opened quite a few channels with me 15:24 -!- Talkless [~Talkless@hst-227-49.splius.lt] has quit [Quit: Konversation terminated!] 15:32 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has joined #lnd 15:38 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has quit [Ping timeout: 250 seconds] 15:50 -!- Dean_Guss [~dean@gateway/tor-sasl/deanguss] has joined #lnd 16:11 -!- pioklo [~Pioklo@118-40.echostar.pl] has quit [Ping timeout: 250 seconds] 16:33 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has joined #lnd 16:39 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has quit [Ping timeout: 250 seconds] 17:09 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has joined #lnd 17:23 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has quit [Ping timeout: 250 seconds] 17:48 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has joined #lnd 17:54 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has quit [Ping timeout: 246 seconds] 18:04 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has joined #lnd 18:10 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has quit [Ping timeout: 246 seconds] 18:27 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has joined #lnd 18:31 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has quit [Ping timeout: 250 seconds] 18:35 -!- fdas [59ee962b@gateway/web/freenode/ip.89.238.150.43] has quit [Ping timeout: 256 seconds] 18:51 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has joined #lnd 18:58 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has quit [Ping timeout: 250 seconds] 19:05 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has joined #lnd 19:13 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has quit [Ping timeout: 250 seconds] 19:25 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has joined #lnd 19:31 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has quit [Ping timeout: 250 seconds] 19:41 -!- jchia_ [~jchia@58.32.32.5] has quit [Quit: Leaving.] 19:42 -!- jchia_ [~jchia@45.32.62.73] has joined #lnd 19:43 -!- jchia_ [~jchia@45.32.62.73] has quit [Remote host closed the connection] 19:44 -!- jchia_ [~jchia@58.32.32.5] has joined #lnd 20:29 -!- marina27 [c6477762@gateway/web/freenode/ip.198.71.119.98] has joined #lnd 20:38 -!- marina27 [c6477762@gateway/web/freenode/ip.198.71.119.98] has quit [Ping timeout: 256 seconds] 22:13 -!- ctrlbreak_MAD [~ctrlbreak@142.162.20.53] has joined #lnd 22:15 -!- ctrlbreak [~ctrlbreak@142.162.20.53] has quit [Ping timeout: 245 seconds] 23:04 -!- JackH [~laptop@92.118.153.193] has quit [Ping timeout: 255 seconds] 23:32 -!- pendarsoheil [~pendarsoh@unaffiliated/pendarsoheil] has quit [Quit: Leaving] 23:55 -!- sh_smith [~sh_smith@cpe-76-174-26-91.socal.res.rr.com] has joined #lnd