[rbldnsd] rbldnsd with extremely large blacklists

[Tom Arnold]

I was wondering if anyone had experience with extremely large blacklists and
rbldnsd.  I've been playing with a 60million entry blacklist file and not
having much luck.  FreeBSD 6.1 on Opteron ( AMD64 ) with 8gigs of memory.
The disk file size is around 1.4gigs and I'm loading it using ip4set.  Each
line is of the following format :
127.0.0.1/32:2:3.0

The text record varies per IP address and the netmask also varies but is
mostly /32.

The process size is growing past 4gigs and segfaulting.  I havent yet
recompiled to get the process size over 4gigs.  I figured before I went to
the trouble I would at least ask if my goal was even feasible.  With other
blacklists we run the memory footprint seems to be around the size of the
blacklist file itself.

Thanks.

-- 
Tom Arnold
Network Architect, Systems Operations
650.989.6416 desk

www.ironport.com - The Leader in Email Security