[Bro] 10Gbps bro + netmap + ixgbe + lb?
avz at dvo.ru
Mon Nov 27 04:58:38 PST 2017
I have a Bro cluster on a 2xE5-2660 with 64GB RAM. The traffic comes via
a 10Gbps port of an Intel 82599ES (it's not cleared from FIN_storms and
so on). I use Netmap with the Netmap ixgbe drivers and lb. lb and Bro
workers pinned to cores. The interface offloads are turned off (ethtool
-L eth0 combined 1; ... ). The basic installation (1xlb, 20 cores for
Bro) begins drops packets hard near 7Gbps (~900Kpps). It looks like the
bottleneck was the lb (100% the core usage and it shows drops). Lite lb
optimisation ( I unify the loops in sym_hash_fn) doesn't help too much.
I try the following lb pyramid:
lb -i eth0 -B10000 -p bro:2 -o 60
lb -i netmap:bro}0 -B10000 -p broa:13 -o 60
lb -i netmap:bro}1 -B10000 -p brob:13 -o 60
in node.cfg .
Now I can get up to 8Gbps (~1000Kpps) without a lot of losses.
But is it possible to get full 10Gbps on a port with netmap and lb on a
host like mine? How to offload lb?
-------------- next part --------------
A non-text attachment was scrubbed...
Size: 833 bytes
Desc: OpenPGP digital signature
Url : http://mailman.ICSI.Berkeley.EDU/pipermail/bro/attachments/20171127/05abdc8c/attachment.bin
More information about the Bro