[Bro-Dev] [JIRA] (BIT-985) 'tail -f' functionality for file reading in input framework

scampbell (JIRA) jira at bro-tracker.atlassian.net
Tue Mar 17 17:40:02 PDT 2015


     [ https://bro-tracker.atlassian.net/browse/BIT-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

scampbell updated BIT-985:
--------------------------

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Absolutely - the key issues that I ran into with the first patch were
dealing with file rotation under the reader and leaks in the data
copying scheme.  After spending a few days on the mem leak issues
modifying the single use linear buffers (and mostly de-stabilizing
everything), I reimplemented the whole thing as a ring buffer.

My use case - reading a very rapidly moving log file - might be far
enough away from the original design pattern of small reasonably
static files that it is worth another type?  On the other hand I might
have just messed up the original work.

If this makes no sense please let me know and I will look over my
notes re the changes.

thanks for looking into this,
scott


-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.22 (Darwin)
Comment: GPGTools - http://gpgtools.org

iEYEARECAAYFAlUIyPMACgkQK2Plq8B7ZByVQwCghwbGlmgetHNMkxicrms6wl69
d2EAoIXsHbv1JWPeXJ5rpWv2rAlfWpPQ
=bKTE
-----END PGP SIGNATURE-----


> 'tail -f' functionality for file reading in input framework
> -----------------------------------------------------------
>
>                 Key: BIT-985
>                 URL: https://bro-tracker.atlassian.net/browse/BIT-985
>             Project: Bro Issue Tracker
>          Issue Type: New Feature
>          Components: Bro
>    Affects Versions: git/master
>            Reporter: scampbell
>            Assignee: Johanna Amann
>            Priority: Low
>             Fix For: 2.4
>
>         Attachments: input.diff, PATCH
>
>
> With the current input framework, file data \-> event translation requires that the entire data file be read at bro start time.  This can be prohibitive when the file sizes become large ( > 1GB ).  
> It would be great to see a file open option that would start reading at the end of the file.



--
This message was sent by Atlassian JIRA
(v6.4-OD-15-055#64014)


More information about the bro-dev mailing list