[Bro-Dev] [JIRA] (BIT-1383) memory leak

Garanews (JIRA) jira at bro-tracker.atlassian.net
Fri Apr 24 08:03:00 PDT 2015


    [ https://bro-tracker.atlassian.net/browse/BIT-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=20424#comment-20424 ] 

Garanews commented on BIT-1383:
-------------------------------

In the reporter.log I have only warnings like this:
1429884007.525166       Reporter::WARNING       Analyzer Files::ANALYZER_X509 not added successfully to file FZMat825gmR7UiqCHg.        /opt/bro/share/bro/base/frameworks/files/./main.bro, line 286


I have enabled the profiling and looks like:

1429882423.269744 Memory: total=*27988K **total_adj=4127060K malloced: 24905K
1429882423.269744 Run-time: user+sys=285.1 user=256.3 sys=28.8 real=1756.6
1429882423.269744 Conns: total=0 current=0/0 ext=0 mem=0K avg=0.0 table=0K connvals=0K
1429882423.269744 Conns: tcp=0/0 udp=0/0 icmp=0/0
1429882423.269744 TCP-States:        Inact.  Syn.    SA      Part.   Est.    Fin.    Rst.
1429882423.269744 TCP-States:Inact.
1429882423.269744 TCP-States:Syn.
1429882423.269744 TCP-States:SA
1429882423.269744 TCP-States:Part.
1429882423.269744 TCP-States:Est.
1429882423.269744 TCP-States:Fin.
1429882423.269744 TCP-States:Rst.
1429882423.269744 Connections expired due to inactivity: 0
1429882423.269744 Total reassembler data: 0K
1429882423.269744 Timers: current=71 max=72 mem=5K lag=0.00s
1429882423.269744 DNS_Mgr: requests=0 succesful=0 failed=0 pending=0 cached_hosts=0 cached_addrs=0
1429882423.269744 Triggers: total=2 pending=0
1429882423.269744         RotateTimer = 28
1429882423.269744         ScheduleTimer = 15
1429882423.269744         TableValTimer = 28
1429882423.269744 Threads: current=36

After a while:

1429887084.548535 Memory: total=*811348K *total_adj=716116K malloced: 791111K
1429887084.548535 Run-time: user+sys=875.4 user=770.1 sys=105.3 real=6417.9
1429887084.548535 Conns: total=0 current=0/0 ext=0 mem=0K avg=0.0 table=0K connvals=0K
1429887084.548535 Conns: tcp=0/0 udp=0/0 icmp=0/0
1429887084.548535 TCP-States:        Inact.  Syn.    SA      Part.   Est.    Fin.    Rst.
1429887084.548535 TCP-States:Inact.
1429887084.548535 TCP-States:Syn.
1429887084.548535 TCP-States:SA
1429887084.548535 TCP-States:Part.
1429887084.548535 TCP-States:Est.
1429887084.548535 TCP-States:Fin.
1429887084.548535 TCP-States:Rst.
1429887084.548535 Connections expired due to inactivity: 0
1429887084.548535 Total reassembler data: 0K
1429887084.548535 Timers: current=73 max=74 mem=5K lag=0.00s
1429887084.548535 DNS_Mgr: requests=0 succesful=0 failed=0 pending=0 cached_hosts=0 cached_addrs=0
1429887084.548535 Triggers: total=2 pending=0
1429887084.548535         RotateTimer = 30
1429887084.548535         ScheduleTimer = 15
1429887084.548535         TableValTimer = 28
1429887084.548535 Threads: current=37


So it seems that same threads are leaking ram during time.
But see what happened this morning: the number of threads grown up to 150...
!threads.png!

Seems related to ram leakage:
!screenshot-1.png!

regarding prof.log what do you mean with table are growing large?
I have rows pasted here and others related to single scritps like:
1429887594.568636   software/Log::WRITER_ASCII in=4564 out=197 pending=4296/0 (#queue r/w: in=268/4564 out=197/197)

Thanks


> memory leak
> -----------
>
>                 Key: BIT-1383
>                 URL: https://bro-tracker.atlassian.net/browse/BIT-1383
>             Project: Bro Issue Tracker
>          Issue Type: Problem
>          Components: Bro
>    Affects Versions: 2.3
>         Environment: Ubuntu 12.04.5 LTS
>            Reporter: Garanews
>              Labels: leak, memory
>         Attachments: screenshot-1.png, threads.png
>
>
> BRO is taking almos all resources availables (CPUs and 192GBRAM +50GB Swap) :
> top - 12:26:56 up 1 day,  1:40,  2 users,  load average: 28.10, 28.69, 27.94
> Tasks: 365 total,  16 running, 349 sleeping,   0 stopped,   0 zombie
> Cpu(s): 28.7%us, 18.4%sy,  1.4%ni, 48.3%id,  2.4%wa,  0.0%hi,  0.7%si,  0.0%st
> Mem:  198059808k total, 197549384k used,   510424k free,     1384k buffers
> Swap: 201289980k total, 50575440k used, 150714540k free,    10596k cached
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> 13551 root      20   0 1341m 880m 517m R  100  0.5 993:31.62 bro
> 13596 root      20   0 1173m 882m 517m R  100  0.5   1001:27 bro
> 13617 root      20   0 8472m 898m 517m R  100  0.5 990:51.10 bro
> 13659 root      20   0 1469m 889m 517m R  100  0.5 990:53.08 bro
> 13679 root      20   0 1390m 885m 517m R  100  0.5 981:09.51 bro
> 13681 root      20   0 2229m 1.8g 517m R  100  1.0 952:03.55 bro
> 13653 root      20   0 2953m 881m 517m R   99  0.5 988:00.31 bro
> 13685 root      20   0 1106m 888m 517m R   99  0.5 988:19.98 bro
> 13641 root      20   0 1122m 884m 517m R   64  0.5 987:33.61 bro
> 13672 root      20   0 10.1g 7.5g 517m R   56  4.0 987:49.47 bro
> 13696 root      20   0 1161m 881m 517m R   53  0.5 982:57.39 bro
> 13668 root      20   0 1149m 883m 517m S   51  0.5 989:52.19 bro
> 13691 root      20   0 1989m 884m 517m R   50  0.5   1012:40 bro
> 13692 root      20   0 1190m 885m 517m S   48  0.5 995:16.83 bro
> 13677 root      20   0 1188m 889m 517m S   44  0.5 993:21.39 bro
> 13687 root      20   0 5340m 2.7g 517m S   43  1.5 978:51.70 bro
>  8906 root      25   5  294m 111m  672 S   40  0.1 526:31.84 bro
>  6545 root      25   5 1235m 859m  624 S   29  0.4 482:23.79 bro
>  4645 root      20   0  198g 160g 1832 S   24 85.0 254:50.36 bro
>  8238 root      20   0 1755m 114m 1716 S   19  0.1 129:58.95 bro
> 15196 root      25   5  685m 539m 515m S   16  0.3 219:22.30 bro
> 15149 root      25   5  678m 535m 515m S   16  0.3 210:17.67 bro
> 15166 root      25   5  678m 544m 515m S   16  0.3 208:54.70 bro
> 15200 root      25   5  686m 543m 515m S   16  0.3 210:56.13 bro
> 15148 root      25   5  678m 546m 515m R   16  0.3 211:22.38 bro
> 15186 root      25   5  685m 537m 515m S   16  0.3 208:55.80 bro
> 15187 root      25   5  685m 545m 515m R   16  0.3 211:02.48 bro
> 15188 root      25   5  685m 536m 515m R   16  0.3 207:31.37 bro
> 15197 root      25   5  692m 536m 515m S   16  0.3 208:34.05 bro
> 15201 root      25   5  692m 547m 515m S   16  0.3 209:19.18 bro
> 15165 root      25   5  685m 543m 515m S   15  0.3 207:28.37 bro
> 15147 root      25   5  692m 536m 515m S   15  0.3 210:45.36 bro
> 15185 root      25   5  686m 544m 515m S   15  0.3 210:45.12 bro
> 15198 root      25   5  678m 546m 515m S   15  0.3 203:51.90 bro
> 15150 root      25   5  678m 537m 515m S   15  0.3 207:34.16 bro
> 15199 root      25   5  685m 537m 515m S   14  0.3 204:45.21 bro



--
This message was sent by Atlassian JIRA
(v6.5-OD-01-120#65000)


More information about the bro-dev mailing list