Hi Steve,

before attempting to hack BitcoinJ to use NIO you might want to take a look at BitDroid (https://github.com/cdecker/BitDroid-Network), which is my attempt to build an easily extensible network client (no crypto stuff so far) on top of NIO and a simple publish-subscribe architecture. I build a crawler like yours with just a single class that subscribes to events published and closes and opens connections to crawl.

HTH,
Christian

On Tue, Sep 6, 2011 at 10:29 AM, Steve <shadders.del@gmail.com> wrote:


While I'm asking questions I'll add one more regarding the getaddr message.

Talking to myself here.  I just sent this message then found this brilliant set of articles in the Dev & Tech forum which answers the question very nicely: https://bitcointalk.org/index.php?topic=41722.0

Anyway just as an FYI I've been running v0.0.0.0.0.0.0.0.1 for about an hour.  It's only running 10 concurrent connections due to girlfriend complaining she couldn't watch youtube but here's some early results.

New nodes: 19319 // node address discovered but no contact attempt made yet
Contacted nodes: 754
Uncontactable nodes: 3253
Limbo nodes: 9 //not as exciting as it sounds, just nodes with connect in progress
Total nodes: 23335 // about 5000 from initial IRC discover, the rest are from getaddr

Versions: {
300=1,
31900=7,
31902=1,
32000=2,
32001=7,
32002=22,
32100=100,
32200=24,
32300=277,
32400=317,
32500=2}

Fails: {
ConnectException: Connection refused=377,
IOException: Socket is disconnected=87,
SocketException: Network is unreachable=2,
ProtocolException: Error deserializing message =1,
NoRouteToHostException: No route to host=115,
SocketException: Connection reset=149,
SocketTimeoutException: connect timed out=2521}



------------------------------------------------------------------------------
Special Offer -- Download ArcSight Logger for FREE!
Finally, a world-class log management solution at an even better
price-free! And you'll get a free "Love Thy Logs" t-shirt when you
download Logger. Secure your free ArcSight Logger TODAY!
http://p.sf.net/sfu/arcsisghtdev2dev
_______________________________________________
Bitcoin-development mailing list
Bitcoin-development@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bitcoin-development