> > I suspect it is something that is going to have to be dealt with in the > future (I just don't know how yet). > The web has managed to survive despite constant fast crawls being the norm for the past 10 years or so. I wouldn't worry too much about this unless you can prove that a big chunk of your nodes resources are going to answering ver queries.