2014-04-05.log

--- Log opened Sat Apr 05 00:00:27 2014
-!- justanot1eruser [~andrew@72.12.216.198] has joined ##hplusroadmap00:03
-!- justanot1eruser [~andrew@72.12.216.198] has quit [Ping timeout: 255 seconds]00:21
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has quit [Remote host closed the connection]00:51
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has joined ##hplusroadmap00:52
-!- ckagent [~ckagent@195.74.88.13] has joined ##hplusroadmap00:56
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has quit [Ping timeout: 255 seconds]00:56
-!- ckagent [~ckagent@195.74.88.13] has quit [Remote host closed the connection]01:02
-!- justanot1eruser [~andrew@72.12.216.198] has joined ##hplusroadmap01:05
-!- mikinform [~mikinform@62.122.79.56] has joined ##hplusroadmap01:10
-!- justanot1eruser [~andrew@72.12.216.198] has quit [Ping timeout: 240 seconds]01:11
-!- HEx1 [~HEx@hexwab.plus.com] has quit [Ping timeout: 240 seconds]01:13
-!- HEx1 [~HEx@hexwab.plus.com] has joined ##hplusroadmap01:14
-!- justanot1eruser [~andrew@72.12.216.198] has joined ##hplusroadmap01:23
-!- mikinform [~mikinform@62.122.79.56] has quit [Ping timeout: 255 seconds]01:25
-!- justanot1eruser [~andrew@72.12.216.198] has quit [Ping timeout: 240 seconds]01:27
-!- EnLilaSko [EnLilaSko@unaffiliated/enlilasko] has joined ##hplusroadmap02:03
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has joined ##hplusroadmap02:06
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has quit [Ping timeout: 255 seconds]02:11
-!- ThomasEgi [~thomas@panda3d/ThomasEgi] has joined ##hplusroadmap02:31
-!- entelechios [~elysium@181.194.136.230] has quit [Ping timeout: 240 seconds]02:34
-!- yorick [~yorick@oftn/member/yorick] has joined ##hplusroadmap02:43
-!- chris_99 [~chris_99@unaffiliated/chris-99/x-3062929] has joined ##hplusroadmap02:59
-!- voodster [~je@95.129.166.182] has joined ##hplusroadmap03:37
-!- SquirrelVenom [~tpi@c-107-4-148-59.hsd1.va.comcast.net] has quit [Ping timeout: 268 seconds]03:46
-!- justanot1eruser [~andrew@72.12.216.198] has joined ##hplusroadmap03:54
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has joined ##hplusroadmap03:54
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has quit [Ping timeout: 268 seconds]04:00
-!- justanot1eruser [~andrew@72.12.216.198] has quit [Ping timeout: 240 seconds]04:03
-!- yorick [~yorick@oftn/member/yorick] has quit [Remote host closed the connection]04:05
-!- chris_99 [~chris_99@unaffiliated/chris-99/x-3062929] has quit [Remote host closed the connection]04:26
-!- justanot1eruser [~andrew@72.12.216.198] has joined ##hplusroadmap04:27
-!- justanot1eruser [~andrew@72.12.216.198] has quit [Ping timeout: 240 seconds]04:31
-!- justanot1eruser [~andrew@72.12.216.198] has joined ##hplusroadmap05:07
-!- justanot1eruser [~andrew@72.12.216.198] has quit [Ping timeout: 255 seconds]05:42
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has joined ##hplusroadmap05:43
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has quit [Ping timeout: 268 seconds]05:48
-!- Viper168 [~Viper@unaffiliated/viper168] has quit [Ping timeout: 240 seconds]06:01
-!- justanot1eruser [~andrew@72.12.216.198] has joined ##hplusroadmap06:06
-!- justanot1eruser [~andrew@72.12.216.198] has quit [Ping timeout: 268 seconds]06:11
-!- Viper168 [~Viper@unaffiliated/viper168] has joined ##hplusroadmap06:48
-!- Qfwfq [~Qfwfq@cm113.kappa36.maxonline.com.sg] has joined ##hplusroadmap06:48
-!- Qfwfq [~Qfwfq@cm113.kappa36.maxonline.com.sg] has quit [Changing host]06:48
-!- Qfwfq [~Qfwfq@unaffiliated/washirving] has joined ##hplusroadmap06:48
-!- FourFire [~fourfire@102-153-15.connect.netcom.no] has joined ##hplusroadmap07:07
-!- pussycrusteddick [~tpi@c-107-4-148-59.hsd1.va.comcast.net] has joined ##hplusroadmap07:13
-!- justanot1eruser [~andrew@72.12.216.198] has joined ##hplusroadmap07:19
-!- justanot1eruser [~andrew@72.12.216.198] has quit [Ping timeout: 240 seconds]07:23
kanzuredingo: i was mostly joking, nobody in their right mind would want to do that07:29
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has joined ##hplusroadmap07:31
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has quit [Ping timeout: 268 seconds]07:37
FourFirekanzure, do what, exactly?07:45
kanzurexml07:45
FourFireeXtensive Markup Language?07:47
FourFireyeah I don't know it, besides bastardizing other files to make horrid combo files to do things07:48
kanzuregood thing i didn't ask you07:48
kanzuredingo and juri_ have been known to do humiliating acts of xml, that's why i specifically mentioned them07:48
-!- yorick [~yorick@oftn/member/yorick] has joined ##hplusroadmap08:04
streetyI was at a talk just last week at which the presenter thought it would be a good idea to live code xml parsing08:13
streetyhorrifying but you just can't look away08:13
-!- fireprfHydra [~fireprfHy@ool-4356bfd0.dyn.optonline.net] has joined ##hplusroadmap08:18
-!- chris_99 [~chris_99@unaffiliated/chris-99/x-3062929] has joined ##hplusroadmap08:35
-!- justanot1eruser [~andrew@72.12.216.49] has joined ##hplusroadmap08:45
-!- justanot1eruser [~andrew@72.12.216.49] has quit [Ping timeout: 268 seconds]08:58
-!- fireprfHydra [~fireprfHy@ool-4356bfd0.dyn.optonline.net] has quit [Ping timeout: 268 seconds]09:01
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has joined ##hplusroadmap09:19
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has quit [Ping timeout: 268 seconds]09:24
-!- fireprfHydra [~fireprfHy@pool-173-70-216-225.nwrknj.fios.verizon.net] has joined ##hplusroadmap09:30
-!- BCB [~BCB@unaffiliated/bcb] has left ##hplusroadmap ["Leaving"]09:51
-!- justanot1eruser [~andrew@72.12.216.198] has joined ##hplusroadmap09:51
-!- fireprfHydra [~fireprfHy@pool-173-70-216-225.nwrknj.fios.verizon.net] has quit [Ping timeout: 255 seconds]09:53
-!- justanot1eruser [~andrew@72.12.216.198] has quit [Ping timeout: 240 seconds]10:03
-!- justanot1eruser [~andrew@72.12.216.49] has joined ##hplusroadmap10:05
-!- justanot1eruser [~andrew@72.12.216.49] has quit [Ping timeout: 255 seconds]10:11
-!- justanot1eruser [~andrew@72.12.216.198] has joined ##hplusroadmap10:16
-!- justanot1eruser [~andrew@72.12.216.198] has quit [Ping timeout: 255 seconds]10:27
-!- kyknos_ [~kyknos@2001:67c:2190:c0de:94e6:6f18:e8e0:992f] has joined ##hplusroadmap10:28
-!- justanot1eruser [~andrew@72.12.216.49] has joined ##hplusroadmap10:40
-!- ptoyr [~hrouhan@24.60.79.55] has joined ##hplusroadmap10:40
-!- justanot1eruser [~andrew@72.12.216.49] has quit [Ping timeout: 240 seconds]10:45
-!- justanot1eruser [~andrew@72.12.216.49] has joined ##hplusroadmap10:46
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has joined ##hplusroadmap10:47
-!- fireprfHydra [~fireprfHy@pool-173-70-216-225.nwrknj.fios.verizon.net] has joined ##hplusroadmap10:53
-!- treneva [~treneva@91.213.220.176] has joined ##hplusroadmap11:00
-!- justanot1eruser [~andrew@72.12.216.49] has quit [Ping timeout: 255 seconds]11:00
-!- justanot1eruser [~andrew@72.12.216.198] has joined ##hplusroadmap11:01
-!- Qfwfq [~Qfwfq@unaffiliated/washirving] has quit [Ping timeout: 255 seconds]11:34
-!- Qfwfq [~Qfwfq@cm113.kappa36.maxonline.com.sg] has joined ##hplusroadmap11:39
-!- Qfwfq [~Qfwfq@cm113.kappa36.maxonline.com.sg] has quit [Changing host]11:39
-!- Qfwfq [~Qfwfq@unaffiliated/washirving] has joined ##hplusroadmap11:39
-!- treneva [~treneva@91.213.220.176] has quit [Remote host closed the connection]11:43
-!- justanot1eruser [~andrew@72.12.216.198] has quit [Ping timeout: 240 seconds]11:51
kanzure"Restoration of eidetic imagery via hypnotic age regression: More evidence."12:04
-!- fireprfHydra [~fireprfHy@pool-173-70-216-225.nwrknj.fios.verizon.net] has quit [Ping timeout: 240 seconds]12:08
kanzure"Eidetic children apparently blink to erase their persisting visual images (Leask, Haber, & Haber, 1969)."12:14
kanzurefrom http://www.amsciepub.com/doi/pdf/10.2466/pms.1975.41.2.40312:17
-!- ElixirVitae [~Shehrazad@unaffiliated/shehrazad] has joined ##hplusroadmap12:32
-!- voodster [~je@95.129.166.182] has quit [Quit: leaving]12:34
-!- drewbot [~cinch@ec2-54-224-198-26.compute-1.amazonaws.com] has quit [Remote host closed the connection]12:52
-!- drewbot [~cinch@ec2-75-101-221-78.compute-1.amazonaws.com] has joined ##hplusroadmap12:52
-!- Proteus [~Proteus@unaffiliated/proteus] has quit [Read error: Connection reset by peer]13:03
-!- justanot1eruser [~andrew@asp-gw.wintek.com] has joined ##hplusroadmap13:07
-!- Proteus [~Proteus@unaffiliated/proteus] has joined ##hplusroadmap13:07
drazakanyone in here used patser for dna motifs?13:15
-!- ParahSailin [~parahsail@unaffiliated/parahsailin] has quit [Ping timeout: 240 seconds]13:18
-!- ParahSailin [~parahsail@unaffiliated/parahsailin] has joined ##hplusroadmap13:19
kanzureyou should bug ParahSailin about that13:24
drazakParahSailin: yo13:25
-!- ParahSailin [~parahsail@unaffiliated/parahsailin] has quit [Ping timeout: 240 seconds]13:37
-!- ParahSailin [~parahsail@unaffiliated/parahsailin] has joined ##hplusroadmap13:38
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has quit [Remote host closed the connection]14:08
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has joined ##hplusroadmap14:08
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has quit [Ping timeout: 252 seconds]14:13
-!- augur [~augur@216-164-48-148.c3-0.slvr-ubr1.lnh-slvr.md.cable.rcn.com] has quit [Remote host closed the connection]14:31
kanzure"In 2009, two Japanese individuals were arrested trying to smuggle $134 billion in US bonds into Switzerland from Italy. In 2012, Italian authorities seized $6 trillion in allegedly fake US bonds from safe-deposit boxes in Zurich (which were purportedly to be used to buy plutonium from Nigerian sources). And now, in 2014, The BBC reports, Italian police have arrested two men who were allegedly trying to deposit trillions of euros in fake ...14:35
kanzure... bonds in the Vatican bank."14:35
cluckjkanzure, http://backstoryradio.org/shows/on-the-money-2/14:37
cluckjtangentally about bitcoin14:38
kanzureeww it's audio only14:39
kanzurewell that's inconvenient14:40
cluckjI guess :P14:40
cluckjthey're excellent historians with good radio voices14:41
cluckjthere's a transcript14:45
kanzureoh i didn't see it14:47
cluckjI'm only 25 minutes in, so no spoilers from master roshi's school of speed reading14:49
kanzure"the trick is to make shit up"14:50
-!- Viper168 [~Viper@unaffiliated/viper168] has quit [Ping timeout: 240 seconds]14:51
-!- Viper168 [~Viper@unaffiliated/viper168] has joined ##hplusroadmap14:59
cluckjhah15:19
-!- ElixirVitae [~Shehrazad@unaffiliated/shehrazad] has quit [Read error: Connection reset by peer]15:20
-!- ElixirVitae [~Shehrazad@unaffiliated/shehrazad] has joined ##hplusroadmap15:22
-!- chris_99 [~chris_99@unaffiliated/chris-99/x-3062929] has quit [Quit: Leaving]15:34
-!- EnLilaSko [EnLilaSko@unaffiliated/enlilasko] has quit [Remote host closed the connection]15:35
-!- Qfwfq [~Qfwfq@unaffiliated/washirving] has quit [Ping timeout: 268 seconds]15:47
-!- Qfwfq [~Qfwfq@unaffiliated/washirving] has joined ##hplusroadmap15:48
-!- heath [quassel@unaffiliated/ybit] has quit [Quit: No Ping reply in 180 seconds.]15:49
-!- heath [quassel@unaffiliated/ybit] has joined ##hplusroadmap15:50
-!- FourFire [~fourfire@102-153-15.connect.netcom.no] has quit [Read error: Connection reset by peer]15:51
-!- FourFire [~fourfire@102-153-15.connect.netcom.no] has joined ##hplusroadmap15:52
kanzureXMLSyntaxError: internal error: Huge input lookup, line 9913877, column 24415:58
kanzurewelp time to find a pull parser15:58
dingolol line 9.9 million16:04
kanzurewhat's the right way to parse a large xml file? lxml.etree.iterparse looks like it ends up loading the entire lxml file at the end16:05
dingowell i think with iterparse, what you do16:07
dingois delete the nodes as you're done with them :-)16:07
dingoIt also allows to .clear() or modify the content of an Element to save memory. So if you parse a large tree and you want to keep memory usage small, you should clean up parts of the tree that you no longer need:16:07
kanzureoh okay, so the final node (if you have deleted all of the children along the way) will be mostly empty16:07
dingoa few pages into http://lxml.de/tutorial.html#incremental-parsing16:08
kanzureshould i prefer sax?16:08
dingoperhaps, it depends, with sax you have to save state sometimes to understand the context that your callback was called under, and if you begin tracking too many state variables, you should probobly try something else16:09
dingoif you're just looking for a few easily identiable leaf nodes, or text, sax is pretty good16:09
dingobut if those leaf nodes can only be identified by their relative position, their parent's attributes, etc., you end up with some hairy code16:10
kanzurei think this is up to 9 children deep and i want to split up the file into multiple files based on the 3rd level elements or something16:10
kanzurei'll go for iterparse for now. not interested in writing a state machine.16:11
kanzureheh an xml state machine16:11
dingoyup16:11
kanzure"jstor is 90% xsltproc running in a loop"16:11
dingothe simplest one is just for each node, append() to a list the name, and pop() them on exit node16:11
dingothen do something like if '/'.join(nodes) == 'a/b/c/d/e'16:12
dingopoor man's xpath :-)16:12
kanzure(memory poor)16:12
-!- yashgaroth [~ffffff@cpe-76-167-105-53.san.res.rr.com] has joined ##hplusroadmap16:12
dingojstor actually puts almost everything into oracle using batch xml processing16:13
dingosince the xml is too fucking slow to parse live16:13
dingoand solr16:13
kanzurenative xml column type in oracle?16:14
dingono, not at all, plain string, int types, etc.16:14
dingotables gets joined with business data/publisher data, metrics/analytics16:14
kanzure(postgresql "recently" got a json column type)16:14
dingoportico.org, a branch of jstor, does use an xml database, documentum16:15
-!- justanot1eruser [~andrew@asp-gw.wintek.com] has quit [Ping timeout: 255 seconds]16:17
-!- Vutral [ss@mirbsd/special/Vutral] has quit [Ping timeout: 246 seconds]16:19
-!- Vutral [~ss@mirbsd/special/Vutral] has joined ##hplusroadmap16:22
-!- justanot1eruser [~andrew@72.12.216.49] has joined ##hplusroadmap16:24
-!- Qfwfq [~Qfwfq@unaffiliated/washirving] has quit [Ping timeout: 255 seconds]16:35
-!- Qfwfq [~Qfwfq@unaffiliated/washirving] has joined ##hplusroadmap16:41
kanzuredingo: tree.xpath("//\{http:\/\/www.mediawiki.org\/xml\/export-0.6\/\}page")16:44
kanzuredingo: what's the right way to make //{http://www.mediawiki.org/xml/export-0.6/}page a valid xpath?16:45
kanzurethe element's tag is apparently {http://www.mediawiki.org/xml/export-0.6/}page and not just page16:45
kanzureoh.. nevermind. ugh.16:48
kanzurelxml.etree.XMLSyntaxError: None16:51
kanzurenice16:51
-!- entelechios [~elysium@181.194.136.230] has joined ##hplusroadmap16:52
-!- yorick [~yorick@oftn/member/yorick] has quit [Remote host closed the connection]16:57
kanzurei wonder if it's safe to assume that mediawiki uses revision ids in monotonic increasing order17:05
-!- justanot1eruser [~andrew@72.12.216.49] has quit [Ping timeout: 255 seconds]17:05
-!- Viper168 [~Viper@unaffiliated/viper168] has quit [Ping timeout: 252 seconds]17:27
-!- FourFire [~fourfire@102-153-15.connect.netcom.no] has quit [Quit: Leaving]18:07
-!- Viper168 [~Viper@unaffiliated/viper168] has joined ##hplusroadmap18:08
-!- snuffeluffegus [~John@cpe-071-077-227-151.ec.res.rr.com] has joined ##hplusroadmap18:21
-!- Qfwfq [~Qfwfq@unaffiliated/washirving] has quit [Ping timeout: 268 seconds]18:59
-!- justanot1eruser [~andrew@72.12.216.49] has joined ##hplusroadmap19:07
-!- Qfwfq [~Qfwfq@unaffiliated/washirving] has joined ##hplusroadmap19:10
-!- ThomasEgi [~thomas@panda3d/ThomasEgi] has quit [Remote host closed the connection]19:12
-!- Qfwfq [~Qfwfq@unaffiliated/washirving] has quit [Client Quit]19:13
-!- justanot1eruser [~andrew@72.12.216.49] has quit [Ping timeout: 255 seconds]19:15
-!- HEx1 [~HEx@hexwab.plus.com] has quit [Remote host closed the connection]19:16
kanzuremeh http://rs.io/2014/04/05/anki-10000-cards-later.html19:24
-!- justanot1eruser [~andrew@72.12.216.198] has joined ##hplusroadmap19:44
-!- justanot1eruser [~andrew@72.12.216.198] has quit [Ping timeout: 240 seconds]19:49
-!- eudoxia [~eudoxia@r179-24-4-135.dialup.adsl.anteldata.net.uy] has joined ##hplusroadmap19:49
eudoxiai would use anki if it stored cards like in YAML files in directories19:50
eudoxia(not the XML import isn't good enough because i don't want to constantly import things)19:50
eudoxiathat way i could programatically generate cards from other stuff19:50
eudoxiathe same complaint applies to mnemosyne19:51
kanzureafter a few hundred thousand cards the whole system gets to become unuseful19:52
eudoxiaare you speaking from experience, or is that a projection?19:54
-!- Proteus [~Proteus@unaffiliated/proteus] has quit [Read error: Connection reset by peer]19:54
kanzureexperience with supermemo19:54
kanzurei spent the entirety of 2003-2005 wasting my time on supermemo cards19:55
-!- justanot1eruser [~andrew@72.12.216.49] has joined ##hplusroadmap19:55
-!- kyknos_ [~kyknos@2001:67c:2190:c0de:94e6:6f18:e8e0:992f] has quit [Ping timeout: 245 seconds]19:55
eudoxiaso, do you just read stuff now to learn it or did you come up with something new20:01
-!- justanot1eruser [~andrew@72.12.216.49] has quit [Ping timeout: 268 seconds]20:02
kanzureyes i just yell at my friends and peers until they give me the right answers?20:04
kanzurehttp://gcbias.org/2013/11/11/how-does-your-number-of-genetic-ancestors-grow-back-over-time/20:10
-!- justanot1eruser [~andrew@72.12.216.49] has joined ##hplusroadmap20:15
-!- eudoxia [~eudoxia@r179-24-4-135.dialup.adsl.anteldata.net.uy] has quit [Quit: leaving]20:20
-!- delinquentme [~asdfasdf@74.61.157.78] has joined ##hplusroadmap20:22
delinquentmethought this was cool: http://www.calhounvision.com/intl/20:22
-!- justanot1eruser [~andrew@72.12.216.49] has quit [Ping timeout: 255 seconds]20:22
delinquentmeultraviolet laser-tunable eye lenses20:22
delinquentmein clinical use outside of the US for the last 6 years20:22
-!- ruthie [~ruthie@c-98-225-143-81.hsd1.pa.comcast.net] has joined ##hplusroadmap20:26
-!- justanot1eruser [~andrew@72.12.216.49] has joined ##hplusroadmap20:45
-!- justanot1eruser [~andrew@72.12.216.49] has quit [Ping timeout: 255 seconds]20:50
-!- justanot1eruser [~andrew@72.12.216.49] has joined ##hplusroadmap20:50
-!- justanot1eruser [~andrew@72.12.216.49] has quit [Remote host closed the connection]21:01
-!- HEx1 [~HEx@hexwab.plus.com] has joined ##hplusroadmap21:26
-!- entelechios [~elysium@181.194.136.230] has quit [Ping timeout: 252 seconds]21:27
-!- entelechios [~elysium@181.194.136.230] has joined ##hplusroadmap21:30
-!- yashgaroth [~ffffff@cpe-76-167-105-53.san.res.rr.com] has quit [Quit: Leaving]21:34
-!- delinquentme [~asdfasdf@74.61.157.78] has quit [Quit: Leaving]22:03
-!- ptoyr [~hrouhan@24.60.79.55] has left ##hplusroadmap []22:28
-!- Vutral [~ss@mirbsd/special/Vutral] has quit [Ping timeout: 246 seconds]22:28
-!- Vutral [ss@mirbsd/special/Vutral] has joined ##hplusroadmap22:40
-!- kyknos_ [~kyknos@89.233.130.143] has joined ##hplusroadmap22:40
-!- HEx1 [~HEx@hexwab.plus.com] has quit [Quit: Leaving.]23:15
-!- HEx1 [~HEx@hexwab.plus.com] has joined ##hplusroadmap23:16
-!- Vutral [ss@mirbsd/special/Vutral] has quit [Ping timeout: 246 seconds]23:28
-!- Vutral [~ss@mirbsd/special/Vutral] has joined ##hplusroadmap23:33
--- Log closed Sun Apr 06 00:00:28 2014

Generated by irclog2html.py 2.15.0.dev0 by Marius Gedminas - find it at mg.pov.lt!