[Xorp-users] 211 Reply timed out error

Tue Aug 29 10:31:26 PDT 2006

> when I am trying to run XORP with more  100 vlan interfaces
> it is coming out with the following error .
> 
> Sent xrl got response 211 Reply timed out error
> 
> Is there any limit on #of interfaces . did anybody tried  more than
> 100 interfaces.
> can anybody tell what is the meaning of this error .

I presume it is working for 50 VLAN interfaces, based on the
information you sent to the list almost 2 months ago (see the thread
with Subject "Too many open files in system").

Do you get same problem if you try with smaller number of VLANs
(e.g., 60, 70, 80, 90). It would be interesting to know whether
there is an exact number of VLANs that starts triggering the problem
or whether this number varies between trials.

Also, do you get that error if you are running only the FEA. I.e.,
configure only the "interfaces" section without configuring/running
the MFEA, IGMP, FIB2MRIB and PIM-SM.

>From the log messages below it appears that the FEA has decided that
the XRL finder is down, hence the FEA exits on its own:

[ 2006/08/28 20:03:33  ERROR xorp_rtrmgr:6323 FINDER +85 finder_xrl_queue.hh
dispatch_cb ] Sent xrl got response 211 Reply timed out
[ 2006/08/28 20:03:44  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
Target "fea" does not exist or is not enabled.
[ 2006/08/28 20:03:44  ERROR xorp_fea:6324 CLI +116 xrl_cli_node.cc
finder_disconnect_event ] Finder disconnect event. Exiting immediately...

The included information is not sufficient to point the reason why
the FEA has decided that the XRL finder is down.

You could try to set the XRLTRACE environmenta variable before
running XORP. It will enable printing all XRL exchange information,
so this might help finding if something has stalled. E.g. you could
do the following in csh/tcsh (note that it doesn't matter what value
you use to set XRLTRACE, as long as it is set):

setenv XRLTRACE yes
script
./xorp_rtrmgr -b my_config.boot
<RUN XORP>
<EXIT XORP>
exit

The log file with all the output is in file "typescript".

Pavlin

> Thanks for any help in this regard.
> 
> Regards ,
> Ramu.K
> 
> Detailed error LOG
> [ 2006/08/28 20:03:00  INFO xorp_rtrmgr:6323 RTRMGR +240 master_conf_tree.cc
> execute ] Changed modules: interfaces, fea, mfea4, rib, fib2mrib, igmp,
> pimsm4
> [ 2006/08/28 20:03:01  INFO xorp_rtrmgr:6323 RTRMGR +99 module_manager.cc
> execute ] Executing module: interfaces (fea/xorp_fea)
> [ 2006/08/28 20:03:01 INFO xorp_fea MFEA ] MFEA enabled
> [ 2006/08/28 20:03:01 INFO xorp_fea MFEA ] CLI enabled
> [ 2006/08/28 20:03:01 INFO xorp_fea MFEA ] CLI started
> [ 2006/08/28 20:03:01 INFO xorp_fea MFEA ] MFEA enabled
> [ 2006/08/28 20:03:01 INFO xorp_fea MFEA ] CLI enabled
> [ 2006/08/28 20:03:01 INFO xorp_fea MFEA ] CLI started
> [ 2006/08/28 20:03:33  ERROR xorp_rtrmgr:6323 FINDER +85 finder_xrl_queue.hh
> dispatch_cb ] Sent xrl got response 211 Reply timed out
> [ 2006/08/28 20:03:33  ERROR xorp_rtrmgr:6323 FINDER +85 finder_xrl_queue.hh
> dispatch_cb ] Sent xrl got response 211 Reply timed out
> [ 2006/08/28 20:03:33  ERROR xorp_rtrmgr:6323 FINDER +85 finder_xrl_queue.hh
> dispatch_cb ] Sent xrl got response 211 Reply timed out
> [ 2006/08/28 20:03:33  ERROR xorp_rtrmgr:6323 FINDER +85 finder_xrl_queue.hh
> dispatch_cb ] Sent xrl got response 211 Reply timed out
> [ 2006/08/28 20:03:33  ERROR xorp_rtrmgr:6323 FINDER +85 finder_xrl_queue.hh
> dispatch_cb ] Sent xrl got response 211 Reply timed out
> [ 2006/08/28 20:03:33  ERROR xorp_rtrmgr:6323 FINDER +85 finder_xrl_queue.hh
> dispatch_cb ] Sent xrl got response 211 Reply timed out
> [ 2006/08/28 20:03:44  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:44  ERROR xorp_fea:6324 CLI +116 xrl_cli_node.cc
> finder_disconnect_event ] Finder disconnect event. Exiting immediately...
> [ 2006/08/28 20:03:44  ERROR xorp_fea:6324 LIBXORP +238
> selector.ccremove_ioevent_cb ] Attempting to remove fd = -1 that is
> outside range of
> file descriptors 0..73
> [ 2006/08/28 20:03:44  ERROR xorp_fea:6324 MFEA +192 xrl_mfea_node.cc
> finder_disconnect_event ] Finder disconnect event. Exiting immediately...
> [ 2006/08/28 20:03:44  ERROR xorp_fea:6324 MFEA +192 xrl_mfea_node.cc
> finder_disconnect_event ] Finder disconnect event. Exiting immediately...
> [ 2006/08/28 20:03:45  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:46  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:47  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:48  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:49  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:50  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:51  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:52  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:53  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:54  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:55  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:56  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:57  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:58  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:03:59  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:00  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:01  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:02  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:03  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:04  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:05  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:06  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:07  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:08  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:09  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:10  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:11  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:12  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:13  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:14  WARNING xorp_rtrmgr:6323 XrlFinderTarget +406
> ../xrl/targets/finder_base.cc handle_finder_0_2_resolve_xrl ] Handling
> method for finder/0.2/resolve_xrl failed: XrlCmdError 102 Command failed
> Target "fea" does not exist or is not enabled.
> [ 2006/08/28 20:04:14  ERROR xorp_rtrmgr:6323 RTRMGR +1998 task.cc task_fail
> ] Shutting down fatally wounded process (interfaces)
> [ 2006/08/28 20:04:14  INFO xorp_rtrmgr:6323 RTRMGR +174 module_manager.cc
> terminate ] Terminating module: interfaces
> [ 2006/08/28 20:04:14  INFO xorp_rtrmgr:6323 RTRMGR +197 module_manager.cc
> terminate ] Killing module: interfaces
> [ 2006/08/28 20:04:14  ERROR xorp_rtrmgr:6323 RTRMGR +671
> master_conf_tree.cc commit_pass2_done ] Commit failed: Reconfig of process
> interfaces caused process to fail.
> [ 2006/08/28 20:04:14  ERROR xorp_rtrmgr:6323 RTRMGR +252
> master_conf_tree.cc config_done ] Configuration failed: Reconfig of process
> interfaces caused process to fail.
> [ 2006/08/28 20:04:14  INFO xorp_rtrmgr:6323 RTRMGR +2228 task.cc run_task ]
> No more tasks to run
> [ 2006/08/28 20:04:14  INFO xorp_rtrmgr:6323 RTRMGR +174 module_manager.cc
> terminate ] Terminating module: interfaces
> [ 2006/08/28 20:04:14  INFO xorp_rtrmgr:6323 RTRMGR +197 module_manager.cc
> terminate ] Killing module: interfaces
> [ 2006/08/28 20:04:14  ERROR xorp_rtrmgr:6323 RTRMGR +747 module_manager.cc
> done_cb ] Command "/root/xorp-1.2/fea/xorp_fea": terminated with signal 15.
> [ 2006/08/28 20:04:14  INFO xorp_rtrmgr:6323 RTRMGR +285 module_manager.cc
> module_exited ] Module killed during shutdown: interfaces
> _______________________________________________
> Xorp-users mailing list
> Xorp-users at xorp.org
> http://mailman.ICSI.Berkeley.EDU/mailman/listinfo/xorp-users