[Bro-Dev] [JIRA] (BIT-985) 'tail -f' functionality for file reading in input framework

scampbell (JIRA) jira at bro-tracker.atlassian.net
Tue Mar 17 17:40:02 PDT 2015

     [ https://bro-tracker.atlassian.net/browse/BIT-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

scampbell updated BIT-985:

Hash: SHA1

Absolutely - the key issues that I ran into with the first patch were
dealing with file rotation under the reader and leaks in the data
copying scheme.  After spending a few days on the mem leak issues
modifying the single use linear buffers (and mostly de-stabilizing
everything), I reimplemented the whole thing as a ring buffer.

My use case - reading a very rapidly moving log file - might be far
enough away from the original design pattern of small reasonably
static files that it is worth another type?  On the other hand I might
have just messed up the original work.

If this makes no sense please let me know and I will look over my
notes re the changes.

thanks for looking into this,

Version: GnuPG/MacGPG2 v2.0.22 (Darwin)
Comment: GPGTools - http://gpgtools.org


> 'tail -f' functionality for file reading in input framework
> -----------------------------------------------------------
>                 Key: BIT-985
>                 URL: https://bro-tracker.atlassian.net/browse/BIT-985
>             Project: Bro Issue Tracker
>          Issue Type: New Feature
>          Components: Bro
>    Affects Versions: git/master
>            Reporter: scampbell
>            Assignee: Johanna Amann
>            Priority: Low
>             Fix For: 2.4
>         Attachments: input.diff, PATCH
> With the current input framework, file data \-> event translation requires that the entire data file be read at bro start time.  This can be prohibitive when the file sizes become large ( > 1GB ).  
> It would be great to see a file open option that would start reading at the end of the file.

This message was sent by Atlassian JIRA

More information about the bro-dev mailing list