--- Log opened Wed Mar 11 00:00:21 2020 00:01 -!- shawwwn [uid6132@gateway/web/irccloud.com/x-gvsktlkjndqnspfu] has joined ##hplusroadmap 01:23 < fenn> .title http://vimeo.com/87368134 01:23 < saxo> Vimeo / 403 Forbidden 01:24 < fenn> a hot video showing off 2013 FLIR thermal camera tech 01:28 < fenn> FLIR SC8200 03:05 < facefaceface> me agian... 03:05 < facefaceface> I'm doing a project to download PDFs from journal sites 03:05 < facefaceface> Just a toy experiment. 03:05 < facefaceface> Any tools ready made to help me do it? 03:10 < TMA> facefaceface: curl, wget 03:11 < facefaceface> TMA right 03:13 < facefaceface> curl https://www.nature.com/articles/s41588-020-0581-x.pdf 03:13 < facefaceface> 03:13 < facefaceface> 303 See Other 03:13 < facefaceface> 03:13 < facefaceface>

303 See Other

03:13 < facefaceface>
openresty
03:14 < facefaceface> 03:14 < facefaceface> 03:18 < TMA> facefaceface: there's more to it than just running it and expecting it to be done; (a) most websites are broken without javascript magic (b) journal publishers in particular are actively hostile to users 03:19 < facefaceface> TMA that's why I came in to ask for tools before trying to figure it all out 03:19 < facefaceface> wget seems to follow redirects, curl not 03:20 < TMA> facefaceface: there's no easy way, I am afraid 03:20 < facefaceface> I'm sure there are ready made tools, just not easy to find 03:20 < facefaceface> e.g. banking APIs written using HTML scrappers... they exist 03:24 < facefaceface> I had the idea that those aggregating papers e.g. to read the abstracts, would have written tools that those within 'blessed' IP ranges could run. 03:34 < TMA> facefaceface: Oh I misunderstood. I thought you were after some fun tackling a project "to download" not just "to have downloaded"; that you want to write the tools that you are searching for as opposed to just using them -- but still do not want to start by writing your operating system, compiler, HTTP client and such "low-level stuff" 03:36 < facefaceface> I don't really enjoy doing things that others have done, so I try to avoid it if possible, asking experts usually helps. 03:41 < fenn> zotero 03:41 * fenn is not really here 05:23 < nmz787> facefaceface: you should just use sci-hub 05:25 < nmz787> this feels good enough to be a meme "< kanzure> learn you a biology" 05:25 < facefaceface> nmz787: right, just wondered what might be missing there 05:26 < facefaceface> I have university access for 3 more days and wanted to perform some tests 05:27 < nmz787> likely something about javascript or oauth or cookies 06:19 -!- darsie [~kvirc@84-114-73-160.cable.dynamic.surfer.at] has joined ##hplusroadmap 06:19 < facefaceface> my curl issue? 06:31 -!- shawwwn [uid6132@gateway/web/irccloud.com/x-gvsktlkjndqnspfu] has quit [Quit: Connection closed for inactivity] 07:18 -!- CRM114 [~urchin@unaffiliated/urchin] has joined ##hplusroadmap 07:20 -!- Urchin [~urchin@unaffiliated/urchin] has quit [Ping timeout: 255 seconds] 07:57 -!- yashgaroth [~ffffffff@172.58.19.145] has joined ##hplusroadmap 08:00 < kanzure> facefaceface: you forgot to set --user-agent 08:00 < kanzure> facefaceface: zotero-translation-server.git has some tools for doing this behind the scenes 08:57 < facefaceface> thanks 08:57 < facefaceface> I don't think the user agent was the issue, I guess curl doens't follow redirects by default 09:33 < facefaceface> kanzure: can you give me an example of a webpage where the server returns the pdfurl field? 09:33 < facefaceface> None of the examples I'm trying actually give that field 09:33 < facefaceface> e.g. https://www.nature.com/articles/s41588-019-0575-8 09:33 -!- mauz555 [~mauz555@2a01:e0a:56d:9090:9d56:3455:9ea7:65f7] has joined ##hplusroadmap 09:37 < facefaceface> or https://www.ncbi.nlm.nih.gov/pubmed/29285965 09:37 < facefaceface> I haven't drilled into the code, but I would expect either of those examples to return the PDF URL field 09:41 < kanzure> not sure what you're talking about 09:41 < kanzure> the meta element you want is "citation_pdf_url" 09:46 < facefaceface> (3)(+0000000): Translate: resolved to https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5381037/pdf/12859_2017_Article_1613.pdf 09:46 < facefaceface> kanzure: I'm not sure either... I'll keep poking 09:54 < kanzure> before solving a problem you must first know what the problem is 09:54 < kanzure> it's like driving a car: figure out where your destination is before you start driving 09:55 < facefaceface> I've never driven like that 09:55 < facefaceface> Problem formulation, get all PDFs from all journals 09:55 < facefaceface> Refinement, get all PDFs from Nature Genetics 09:56 < facefaceface> Problem, wget --recursive isn't working for me 09:56 < facefaceface> Perhaps it IS the --user-agent as you suggested originally 09:56 < facefaceface> I can wget a specific PDF 09:57 < facefaceface> so I figured the user-agent wasn't the issue 09:58 < kanzure> meeting time #bitcoin-core-pr-reviews 10:08 < nmz787> kanzure: driving without know where you're going is called "cruising"... there are laws against that, even 10:09 < superkuh> Surely not in the USA. 10:09 < nmz787> superkuh: surely in the USA 10:09 < nmz787> Portland OR, for example 10:09 < superkuh> Cruisin' USA is/was the national pastime. 10:09 < nmz787> haha 10:11 < nmz787> superkuh: https://www.flickr.com/photos/major_clanger/181724332/ 10:12 < superkuh> Cities, what a bunch of assholes. 10:14 -!- hehelleshin [~talinck@98.29.27.253] has joined ##hplusroadmap 10:18 -!- helleshin [~talinck@98.29.27.253] has quit [Ping timeout: 265 seconds] 10:30 -!- nsh [~lol@wikipedia/nsh] has quit [Max SendQ exceeded] 10:41 -!- nsh [~lol@wikipedia/nsh] has joined ##hplusroadmap 10:47 -!- spaceangel [~spaceange@ip-89-177-23-46.net.upcbroadband.cz] has joined ##hplusroadmap 11:06 -!- Human_G33k [~HumanG33k@62.147.242.8] has quit [Remote host closed the connection] 11:09 -!- Human_G33k [~HumanG33k@62.147.242.8] has joined ##hplusroadmap 11:11 -!- Human_G33k [~HumanG33k@62.147.242.8] has quit [Max SendQ exceeded] 11:13 -!- Human_G33k [~HumanG33k@62.147.242.8] has joined ##hplusroadmap 11:53 < lsneff> My university just went online for three weeks starting Monday. 12:16 -!- CRM114 is now known as Urchin 12:17 -!- justan0theruser is now known as justanotheruser 12:25 < kanzure> lsneff: party time 12:27 < lsneff> It's possible that I'll have a lot more free time. 14:24 < kanzure> .tw https://www.youtube.com/watch?v=h6ftvCMdtg0 14:24 < saxo> Och, A cannae finde nae tweet 14:24 < kanzure> .title https://www.youtube.com/watch?v=h6ftvCMdtg0 14:24 < saxo> New version of DIY gene therapy - YouTube 14:33 < maaku> .tw 1237795434694717440 14:33 < saxo> With 0.000001% of the funds, several grad students, and a month I think I can develop: / 1 Diagnostics for the virus that is faster and cheaper than any current / 2 Antidote that is resistant to virus mutation / 3 Vaccine that is more efficient than any current / https://www.bloomberg.com/graphics/2020-coronavirus-pandemic-global-economic-risk/ (@nanoassembly) 14:33 < maaku> 0.000001% of funds = $2.7m 14:46 < kanzure> shrug, let's see what his plan is 15:31 -!- rodarmor [sid210835@gateway/web/irccloud.com/x-wkfvjktacgyvjtgn] has quit [Remote host closed the connection] 15:31 -!- s0ph1a [sid246387@gateway/web/irccloud.com/x-cskqnvdlczxwgccw] has quit [Remote host closed the connection] 15:31 -!- EnabrinTain [sid11525@gateway/web/irccloud.com/x-bxequggfbvyiuyaz] has quit [Remote host closed the connection] 15:32 -!- EnabrinTain [sid11525@gateway/web/irccloud.com/x-fxhueuugtignhjok] has joined ##hplusroadmap 15:34 -!- rodarmor [sid210835@gateway/web/irccloud.com/x-uzntgrefkdfhngsx] has joined ##hplusroadmap 15:36 -!- arisum [sid283163@gateway/web/irccloud.com/x-akvmnczwhugcfoff] has quit [Read error: Connection reset by peer] 15:36 -!- lsneff [sid265665@gateway/web/irccloud.com/x-ptepgdhaohumfyam] has quit [Remote host closed the connection] 15:36 -!- potatope [sid139423@gateway/web/irccloud.com/x-lakqaxypmjzabsno] has quit [Remote host closed the connection] 15:39 -!- s0ph1a [sid246387@gateway/web/irccloud.com/x-yekiwjfddlkjgcbw] has joined ##hplusroadmap 15:40 -!- potatope [sid139423@gateway/web/irccloud.com/x-qxhyyjcqlvztlxsq] has joined ##hplusroadmap 15:41 -!- arisum [sid283163@gateway/web/irccloud.com/x-weosmmclcsfskipa] has joined ##hplusroadmap 15:43 -!- lsneff [sid265665@gateway/web/irccloud.com/x-gbohaiwzdandktzx] has joined ##hplusroadmap 15:56 -!- Solgriffin [sid282649@gateway/web/irccloud.com/x-asymprgkcwiewysb] has quit [Remote host closed the connection] 15:56 -!- wallet42 [sid154231@gateway/web/irccloud.com/x-tllizksysaqzfojk] has quit [Remote host closed the connection] 15:58 < maaku> he refuses to say out of IP concerns 15:58 < maaku> so.... nevermind 15:59 < maaku> he's a recent Foresight technical award winner, so I'm reasonably confident he's not a whackjob 15:59 -!- wallet42 [sid154231@gateway/web/irccloud.com/x-uwnubncmkfasnhdo] has joined ##hplusroadmap 16:00 < maaku> but he should expect some due diligence if he's asking for $2.7m in funding 16:01 -!- Solgriffin [sid282649@gateway/web/irccloud.com/x-ugwighozphixwhse] has joined ##hplusroadmap 16:27 -!- spaceangel [~spaceange@ip-89-177-23-46.net.upcbroadband.cz] has quit [Ping timeout: 260 seconds] 16:30 < lsneff> Where would you even get $2.7 million to fund him? 16:59 -!- N-time [~Mark@212.225.172.60] has joined ##hplusroadmap 17:33 < maaku> A project like that would never get funded in a lump sum. 17:34 < maaku> You'd break it down and find a minimal project that demonstrates feasibility, and leverage that to get larger funding 17:34 < maaku> A feasibility study would probably be sub-$50k 17:35 < lsneff> Ah, I see. 17:35 < maaku> But according to private DM, he seems paranoid about sharing his secret sauce 17:35 < lsneff> And then more money would likely not be hard to come by. 17:36 < maaku> Yeah, show someone (a) it works, and (b) you have the ability to execute, and money is not hard to come by 17:36 < lsneff> His thing is dna nanotech, so maybe it's some novel DNA nanomachinery that can bind to sarscov2 17:48 -!- mauz555 [~mauz555@2a01:e0a:56d:9090:9d56:3455:9ea7:65f7] has quit [Remote host closed the connection] 18:48 < jrayhawk> https://www.researchgate.net/publication/291024888_Plant_derived_antivirals_A_potential_source_of_drug_development while not as easy to {profit on, slam through regulatory approval for} as a vaccine, there are some promising chemical alternatives that have worked well on viruses using similar infection pathways (HIV, influenza, Herpes, etc.) 19:10 < kanzure> .title https://www.youtube.com/watch?time_continue=1&v=YmyXb-3br5U 19:10 < saxo> Future of Genetics | FULL DEBATE | Doha Debates - YouTube 19:29 < kanzure> .title https://www.coindesk.com/bitcoiners-are-biohacking-a-diy-coronavirus-vaccine 19:29 < saxo> Bitcoiners Are Biohacking a DIY Coronavirus Vaccine - CoinDesk 19:29 -!- N-time [~Mark@212.225.172.60] has quit [Quit: Leaving] 19:40 < kanzure> "wow, when even kanzure thinks you're taking too much risk" - gwern 19:46 -!- justanotheruser [~justanoth@unaffiliated/justanotheruser] has quit [Ping timeout: 265 seconds] 19:54 < fenn> who's taking too much risk? 20:02 < kanzure> you can get sued for anything, including poor plasmid design 20:24 -!- justanotheruser [~justanoth@unaffiliated/justanotheruser] has joined ##hplusroadmap 20:32 -!- CryptoDavid [uid14990@gateway/web/irccloud.com/x-tamqdbynwpsgvlzl] has joined ##hplusroadmap 20:42 -!- darsie [~kvirc@84-114-73-160.cable.dynamic.surfer.at] has quit [Ping timeout: 265 seconds] 21:16 -!- yashgaroth [~ffffffff@172.58.19.145] has quit [Quit: Leaving] --- Log closed Thu Mar 12 00:00:23 2020