Symptom
Recursive routes consumes grid pool2 bank3 resources, which leads to process blockage, tracebacks and traffic loss. To validate this, configure a recursive static route and observer GRID pool usage in increased for every static route.
Conditions
steady state with 50k BGP recursive routes
Workaround
Remove recursive routes from the system
Further Problem Description
Recursive routes consumes grid pool2 bank3 resources, which leads to process blockage, tracebacks and traffic loss.
RP/0/RP0/CPU0:Oct 31 08:21:46.950 UTC: fib_mgr[223]: %ROUTING-FIB-3-PLATF_UPD_FAIL : FIB platform update failed: Obj=DATA_TYPE_LDI_LW[ptr=0x30a91bc808,refc=0x2,flags=07
RP/0/RP0/CPU0:Oct 31 08:21:46.950 UTC: fib_mgr[223]: %ROUTING-FIB-3-PD_FAIL : FIB platform error: fib_leaf_ldi_lw_platform_update 704: PD action CREATE failed for lw_l
RP/0/RP0/CPU0:Oct 31 08:22:04.340 UTC: fib_mgr[223]: %ROUTING-FIB-3-PLATF_UPD_FAIL : FIB platform update failed: Obj=DATA_TYPE_LDI_LW[ptr=0x30a79efc48,refc=0x2,flags=07
0/RP0/CPU0:sf-f-R1#show processes blocked
Wed Oct 31 08:41:29.378 UTC
Jid Pid Tid ProcessName State TimeInState Blocked-on
76435 10899 10899 sh_proc_ng_blocked Reply 0000:00:00.0299 3417 procfs_server
1048 7652 7872 bgp Mutex 0000:38:58.0161 0x20efca0 7652 bgp rib_client_mutex_lock_inline:440
1048 7652 7652 bgp Reply 0000:38:58.0653 5312 ipv4_rib
/RP0/CPU0:sf-f-R1#sh proc blocked
Wed Oct 31 08:45:08.314 UTC
Jid Pid Tid ProcessName State TimeInState Blocked-on
76817 11281 11281 sh_proc_ng_blocked Reply 0000:00:00.0199 3417 procfs_server
1048 7652 7652 bgp Reply 0000:00:00.0274 5312 ipv4_rib
211 7324 7611 eth_intf_ea ZMQ_POLL 0000:00:04.0978 fia_driver
187 5416 5908 lpts_fm Reply 0000:00:02.0403 3679 lpts_pa
223 4047 5019 fib_mgr Mutex 0000:01:09.0586 0x9738c0 5020 fib_mgr fib_proto_thread_mutex_lock:85
