Re: [Bitcoin-development] Building a node crawler to map network

2011-09-06 Thread Steve
Thanks for the overview Mike. I just bailed up Gavin on IRC and between that convo and what you've just written I'm starting to picture a plan in my head... This sounds right up my alley, I wish I didn't have to go to bed right now as I've got a ton of ideas buzzing around I'd like to get star

Re: [Bitcoin-development] Building a node crawler to map network

2011-09-06 Thread Mike Hearn
On Tue, Sep 6, 2011 at 4:17 PM, Steve wrote: > ** > I'm not really understanding the use case though. I believe most > bitcoind's have a default max connections of 8. Is the goal to increase > this without fundamentally altering the bitcoind concurrency model? > bitcoind already uses asynchron

Re: [Bitcoin-development] Building a node crawler to map network

2011-09-06 Thread Rick Wesson
I've got minna patches for nio based on bitcoinj. I've enumerated the network a few times and am working on a DNS seed service as well as some weather reports. Happy to start a branch when the committers are ready. -rick On Tue, Sep 6, 2011 at 12:42 AM, Steve wrote: > Hi All, > > I started me

Re: [Bitcoin-development] Building a node crawler to map network

2011-09-06 Thread Steve
Hi Mike, I expect I'll be submitting patches for bitcoinj sometime in the future but I'm not really across it yet to the point where I'd be confident submitting patches right now... This proxy sound like a good match for what I've been up to lately though so long as it wouldn't involve direc

Re: [Bitcoin-development] Building a node crawler to map network

2011-09-06 Thread Mike Hearn
> > I've looked but can't find a post like you're talking about. Can you point > me to it? > https://groups.google.com/forum/?pli=1#!topic/bitcoinj/LSlZdUWcCdk > If so then bollocks... I'm looking for something useful to do atm. > PoolServerJ is in a holding pattern atm as I've stabilisied all

Re: [Bitcoin-development] Building a node crawler to map network

2011-09-06 Thread Steve
Hi Mike, I've looked but can't find a post like you're talking about. Can you point me to it? If so then bollocks... I'm looking for something useful to do atm. PoolServerJ is in a holding pattern atm as I've stabilisied all the bugs I know about and am waiting for several pools to finish te

Re: [Bitcoin-development] Building a node crawler to map network

2011-09-06 Thread Mike Hearn
Actually Steve, take a look at the bitcoinj mailing list today. Somebody has already built this and has it running. It's accumulating data at the moment, they'll announce it more widely soon. But I think there's no need to duplicate work.

Re: [Bitcoin-development] Building a node crawler to map network

2011-09-06 Thread Christian Decker
Hi Steve, before attempting to hack BitcoinJ to use NIO you might want to take a look at BitDroid (https://github.com/cdecker/BitDroid-Network), which is my attempt to build an easily extensible network client (no crypto stuff so far) on top of NIO and a simple publish-subscribe architecture. I bu

Re: [Bitcoin-development] Building a node crawler to map network

2011-09-06 Thread Steve
While I'm asking questions I'll add one more regarding the getaddr message. Talking to myself here. I just sent this message then found this brilliant set of articles in the Dev & Tech forum which answers the question very nicely: *https://bitcointalk.org/index.php?topic=41722.0

[Bitcoin-development] Building a node crawler to map network

2011-09-06 Thread Steve
Hi All, I started messing around today with building a node crawler to try and map out the bitcoin network and hopefully provide some useful statistics. It's very basic so far using a mutilated bitcoinj to connect (due me being java developer and not having a clue with c/c++). If it's worth