[rbldnsd] regular expression support for rbldnsd

[Steven Champeon]

on Wed, Aug 12, 2009 at 11:58:50AM -0700, Scott Haneda wrote:
> Do you have rough performance stats, as queries per second with regex 
> enabled, and without?  I think you mentioned 40k/s, but I assume that was 
> with regex enabled. 

I mentioned 45K/s, as that's what I get from piping a list of hosts
through a C program that simply uses the same underlying library to
do the matching. Obviously, DNS overhead is going to cut down on that
a bit, but the perf is still good.

> Any idea what you get on the same test setup if you remove the regex
> from the build entirely?

OK, I took the stock 0.996b, built it out, and ran my test IPs (hosts
from which my patterns were derived, so pretty much guaranteed not to be
hosts I have blocked via iptables - e.g., none will match) against a
zone derived from my iptables blocks, and here's the dnsperf output:

DNS Performance Testing Tool

Nominum Version 1.0.0.1

[Status] Processing input data
[Status] Sending queries (to 127.0.0.1)
[Status] Testing complete

Statistics:

  Parse input file:     once
  Ended due to:         reaching end of file

  Queries sent:         172971 queries
  Queries completed:    172971 queries
  Queries lost:         0 queries

  Avg request size:     51 bytes
  Avg response size:    51 bytes

  Percentage completed: 100.00%
  Percentage lost:        0.00%

  Started at:           Wed Aug 12 16:14:53 2009
  Finished at:          Wed Aug 12 16:14:58 2009
  Ran for:              4.913960 seconds

  Queries per second:   35199.920227 qps

rbldnsd invoked with:

sudo /usr/local/bin/rbldnsd \
           -r /tmp/rbldns-test/var/lib/rbldns \
           -w /data \
           -l +/logs/query.log \
           -t 21600 \
           -c 60 \
           -s /logs/stats.log \
           -p /tmp/rbldns-test/var/run/rbldnsd.pid \
           -b 127.0.0.1/53535 \
           -u rbldns:rbldns \
           b.enemieslist.local:ip4set:/data/rbldns-black-zone

dnsperf invoked with:

dnsperf -s 127.0.0.1 -p 53535 < rbldns-test-ips.in.a

I built out a stock 0.996b with the patch (I had to modify Makefile.in
so it used /usr instead of /usr/local to find apr-1, but that's the
only difference between that and the patch I sent this morning).

Then I took my test hosts and ran them through the same setup as above,
once for A and once for TXT.

A:
DNS Performance Testing Tool

Nominum Version 1.0.0.1

[Status] Processing input data
[Status] Sending queries (to 127.0.0.1)
[Status] Testing complete

Statistics:

  Parse input file:     once
  Ended due to:         reaching end of file

  Queries sent:         172991 queries
  Queries completed:    172991 queries
  Queries lost:         0 queries

  Avg request size:     67 bytes
  Avg response size:    83 bytes

  Percentage completed: 100.00%
  Percentage lost:        0.00%

  Started at:           Wed Aug 12 16:17:58 2009
  Finished at:          Wed Aug 12 16:18:03 2009
  Ran for:              5.427625 seconds

  Queries per second:   31872.319845 qps

TXT:
DNS Performance Testing Tool

Nominum Version 1.0.0.1

[Status] Processing input data
[Status] Sending queries (to 127.0.0.1)
[Status] Testing complete

Statistics:

  Parse input file:     once
  Ended due to:         reaching end of file

  Queries sent:         172991 queries
  Queries completed:    172991 queries
  Queries lost:         0 queries

  Avg request size:     67 bytes
  Avg response size:    85 bytes

  Percentage completed: 100.00%
  Percentage lost:        0.00%

  Started at:           Wed Aug 12 16:18:03 2009
  Finished at:          Wed Aug 12 16:18:09 2009
  Ran for:              5.832387 seconds

  Queries per second:   29660.411766 qps

This is just my MacBook 2.0GHz laptop; if anyone wants a more controlled
environment for testing, let me know and I'll set it up. 

-- 
hesketh.com/inc. v: +1(919)834-2552 f: +1(919)834-2553 w: http://hesketh.com/
antispam news, solutions for sendmail, exim, postfix: http://enemieslist.com/