[Bro-Dev] #1039: Merge request for Bloom filters
Bro Tracker
bro at tracker.bro.org
Mon Jul 22 13:57:13 PDT 2013
#1039: Merge request for Bloom filters
---------------------------+------------------------
Reporter: matthias | Owner:
Type: Merge Request | Status: new
Priority: Medium | Milestone: Bro2.2
Component: Bro | Version: git/master
Keywords: |
---------------------------+------------------------
The Bloom filter implementation in `topic/matthias/bloom-filter` is ready
to merge into master. Have a look at the very end of `bro.bif` for the
script-land interface.
Internally, we have a new `BloomFilterVal`, which is serializable and
mergeable and thus ready for cluster use. This `Val` contains a
polymorphic Bloom filter instance, which hides the concrete Bloom filter
type (currently only basic and counting). Moreover, this branch introduces
the notion of ''hashers'', which are parameterizable (i.e., seedable)
structures for hashing values ''k'' times. I recall that Bernhard waits
for this feature. See `Hasher.h` for the documented interface.
In the future, we need to rethink how to construct hash functions which
only depend on a seed given at script land. This will be important when
sharing Bloom filters across organizational boundaries. At this point, the
implementation relies on `CompHash` (at least for composite values, such
as records) which itself depends on the initial Bro seed generated at
startup time or when the user specifies the environment variable
`$BRO_SEED`.
--
Ticket URL: <http://tracker.bro.org/bro/ticket/1039>
Bro Tracker <http://tracker.bro.org/bro>
Bro Issue Tracker
More information about the bro-dev
mailing list