Description

SRX550HM FPC 0 auto power off and restarts.



Symptoms

Jul 8 13:41:47 rcv: ch_ipc_dispatch() null ipc read for args 0x1195e00 pipe 0x119ff00, fru FWDD 0 errno 0

Jul 8 13:41:47 ch_connection_shutdown: Destroying the IPC pipe

Jul 8 13:41:47 -- FWDD 0, last request 0, state Online

Jul 8 13:41:47 CHASSISD_FRU_OFFLINE_NOTICE: Taking FPC 0 offline: Error

Jul 8 13:41:47 fpc_down slot 0 reason Error cargs 0x1195e00

Jul 8 13:41:47 fpc_srxsme_disconnect slot is 0

 

Jul 8 13:41:47 CHASSISD_IFDEV_DETACH_FPC: ifdev_detach_fpc(0)

Jul 8 13:41:47 LS: PIC DELETE: Deleting IFDs(#0) on pic 0 slot 0 ls_ifdev_detach

Jul 8 13:41:47 ifd ge-0/0/0 marked as gone

Jul 8 13:41:47 ifd ge-0/0/1 marked as gone

Jul 8 13:41:47 ifd ge-0/0/2 marked as gone

Jul 8 13:41:48 ifd ge-0/0/3 marked as gone

Jul 8 13:41:48 ifd ge-0/0/4 marked as gone

Jul 8 13:41:48 ifd ge-0/0/5 marked as gone

Jul 8 13:41:48 ifd ge-0/0/6 marked as gone

Jul 8 13:41:48 ifd ge-0/0/7 marked as gone

Jul 8 13:41:48 ifd ge-0/0/8 marked as gone

Jul 8 13:41:48 ifd ge-0/0/9 marked as gone

Jul 8 13:41:48 ifd sp-0/0/0 marked as gone

Jul 8 13:41:48 ifd gr-0/0/0 marked as gone

Jul 8 13:41:48 if_pseudo_detach_cleanup: Clearing ifd present flag for gr-0/0/0 from ifd_pseudo_pim ignored. ifm_desc:83

Jul 8 13:41:48 ifd ip-0/0/0 marked as gone

Jul 8 13:41:48 if_pseudo_detach_cleanup: Clearing ifd present flag for ip-0/0/0 from ifd_pseudo_pim ignored. ifm_desc:83

Jul 8 13:41:48 ifd lsq-0/0/0 marked as gone

Jul 8 13:41:48 ifd mt-0/0/0 marked as gone

Jul 8 13:41:48 if_pseudo_detach_cleanup: Clearing ifd present flag for mt-0/0/0 from ifd_pseudo_pim ignored. ifm_desc:83

Jul 8 13:41:48 ifd lt-0/0/0 marked as gone

Jul 8 13:41:48 if_pseudo_detach_cleanup: Clearing ifd present flag for lt-0/0/0 from ifd_pseudo_pim ignored. ifm_desc:83

Jul 8 13:41:48 fpc_offline_now - slot 0, reason: Error, error OK transition state 1

Jul 8 13:41:48 CHASSISD_SNMP_TRAP3: ENTITY trap generated: entStateOperDisabled (entPhysicalIndex 7, entStateAdmin 3, entStateAlarm 0)

Jul 8 13:41:48 Power off FPC 0

Jul 8 13:41:48 CHASSISD_IPC_WRITE_ERR_NO_PIPE: FRU has no connection pipe fru_send_msg FWDD

Jul 8 13:41:48 send: fwdd, fpc 0 powered off

Jul 8 13:41:48 fpc_offline_now - slot 0, is_resync_ready cleared

Jul 8 13:41:48 mic_get_mic_slot: clp1: fpc_slot=0, pic_slot=0, i2c=0x689

 

Jul 8 13:41:48 hwdb: entry for fpc 1929 at slot 0 deleted

 

Jul 8 13:41:48 PIC (fpc 0 pic 0) message operation: change. ifd count 3, flags 0x2 in mesg

Jul 8 13:41:48 PIC (fpc 0 pic 0) message operation: change. ifd count 2, flags 0x2 in mesg

Jul 8 13:41:48 PIC (fpc 0 pic 0) message operation: change. ifd count 1, flags 0x2 in mesg

Jul 8 13:41:48 PIC (fpc 0 pic 0) message operation: change. ifd count 0, flags 0 in mesg

Jul 8 13:41:48 Time to clean up PIC FPC 0, PIC 0

Jul 8 13:41:48 PIC (fpc 0 pic 0) message operation: delete. ifd count 0, flags 0 in mesg

Jul 8 13:41:48 pic_handle_message_idl: PIC fpc 0 pic 0 got deleted

Jul 8 13:41:55 ipc pipe 0x119ff00 created

Jul 8 13:42:01 ch_pepsi_fru_from_msg: resolved for subtype 263, index=0

Jul 8 13:42:01 fwdd 0 ready, pipe 0x0x119ff00

Jul 8 13:42:01 fru_set_boolean: send: set_boolean_cmd FWDD 0 setting debugmode off

Jul 8 13:42:01 fru_set_boolean: send: set_boolean_cmd FWDD 0 setting soft-restart on

Jul 8 13:42:01 fru_set_boolean: send: set_boolean_cmd FWDD 0 setting pfeman-reconnect on

Jul 8 13:42:01 fru_set_boolean: send: set_boolean_cmd FWDD 0 setting source-route off

Jul 8 13:42:01 fru_set_integer: send: set_integer_cmd FWDD 0 setting multicast-resolve-rate 66

Jul 8 13:42:01 fru_set_integer: send: set_integer_cmd FWDD 0 setting multicast-mismatch-rate 50

Jul 8 13:42:01 fru_set_integer: send: set_integer_cmd FWDD 0 setting max-tcp-mss_value 0

Jul 8 13:42:01 fru_set_boolean: send: set_boolean_cmd FWDD 0 setting ipv4-key-hash-L3 on

Jul 8 13:42:01 fru_set_boolean: send: set_boolean_cmd FWDD 0 setting ipv6-key-hash-L3+4 on

Jul 8 13:42:01 fru_set_boolean: send: set_boolean_cmd FWDD 0 setting mpls-key-hash-2label off

Jul 8 13:42:01 fru_set_boolean: send: set_boolean_cmd FWDD 0 setting multiservice-key-hash off

Jul 8 13:42:01 fru_set_integer: send: set_integer_cmd FWDD 0 setting 7 0

Jul 8 13:42:01 set_kern_pplb_hash_seed net.rnh_pplb_hashseed from sysctlbyname: value 0

Jul 8 13:42:01 fpc_gen_wait_mask 0x0

Jul 8 13:42:01 Default IXP id 0x0000 slot 1

Jul 8 13:42:01 Slot 1 I2C 0

 

Jul 8 13:42:01 Default IXP id 0x0000 slot 1

Jul 8 13:42:01 Category A Slot 1 new chassis values 3.3V 0mA 12V 0mA 5V 0mA Power 0mW

 

Jul 8 13:42:01 Default IXP id 0x0000 slot 2

Jul 8 13:42:01 Slot 2 I2C 0

 

Jul 8 13:42:01 Default IXP id 0x0000 slot 2

Jul 8 13:42:01 Category A Slot 2 new chassis values 3.3V 0mA 12V 0mA 5V 0mA Power 0mW

 

Jul 8 13:42:01 Default IXP id 0x0701 slot 3

Jul 8 13:42:01 Slot 3 I2C 701

 

Jul 8 13:42:01 Default IXP id 0x0701 slot 3

Jul 8 13:42:01 Category A Slot 3 new chassis values 3.3V 0mA 12V 0mA 5V 0mA Power 0mW

 

Jul 8 13:42:01 Default IXP id 0x0701 slot 4

Jul 8 13:42:01 Slot 4 I2C 701

 

Jul 8 13:42:01 Default IXP id 0x0701 slot 4

Jul 8 13:42:01 Category A Slot 4 new chassis values 3.3V 0mA 12V 0mA 5V 0mA Power 0mW

 

Jul 8 13:42:01 Default IXP id 0x0701 slot 5

Jul 8 13:42:01 Slot 5 I2C 701

 

Jul 8 13:42:01 Default IXP id 0x0701 slot 5

Jul 8 13:42:01 Category A Slot 5 new chassis values 3.3V 0mA 12V 0mA 5V 0mA Power 0mW

 

Jul 8 13:42:01 Default IXP id 0x0701 slot 6

Jul 8 13:42:01 Slot 6 I2C 701

 

Jul 8 13:42:01 Default IXP id 0x0701 slot 6

Jul 8 13:42:01 Category A Slot 6 new chassis values 3.3V 0mA 12V 0mA 5V 0mA Power 0mW

 

Jul 8 13:42:01 Default IXP id 0x0701 slot 7

Jul 8 13:42:01 Slot 7 I2C 701

 

Jul 8 13:42:01 Default IXP id 0x0701 slot 7

Jul 8 13:42:01 Category A Slot 7 new chassis values 3.3V 0mA 12V 0mA 5V 0mA Power 0mW

 

Jul 8 13:42:01 Default IXP id 0x0701 slot 8

Jul 8 13:42:01 Slot 8 I2C 701

 

Jul 8 13:42:01 Default IXP id 0x0701 slot 8

Jul 8 13:42:01 Category A Slot 8 new chassis values 3.3V 0mA 12V 0mA 5V 0mA Power 0mW

 

Jul 8 13:42:01 .. power sequencer started ..

Jul 8 13:42:01 ch_fru_power_sequencer FPC 0 step 0

Jul 8 13:42:01 FPC 0 power is off

Jul 8 13:42:01 Power on FPC 0

Jul 8 13:42:01 send: fwdd, fpc 0 powered on

Jul 8 13:42:01 setup_power_on_timeout FPC 0

Jul 8 13:42:01 ... power sequencer finished ...

Jul 8 13:42:01 fwdd_pepsi_pic_attach_retry: retry sending FWDD pic attach message for the failed FPCs

Jul 8 13:42:10 Got a FPC ready from fwdd fpc 0. Reconnect flag: False

Jul 8 13:42:10 Port presence on PIC 0

 

root@test> show version detail no-forwarding

 

Hostname: test

Model: srx550m

Junos: 15.1X49-D130.6

 

root@test> show system core-dumps no-forwarding

 

/var/crash/*core*: No such file or directory

-rw-rw---- 1 root wheel 66112286 Jul 2 2020 /var/tmp/flowd_octeon_hm.core-tarball.0.tgz

-rw-rw---- 1 root wheel 64998783 Aug 19 2020 /var/tmp/flowd_octeon_hm.core-tarball.1.tgz

-rw-rw---- 1 root wheel 67124001 Oct 26 2021 /var/tmp/flowd_octeon_hm.core-tarball.2.tgz

-rw-rw---- 1 root wheel 67325631 Aug 6 2022 /var/tmp/flowd_octeon_hm.core-tarball.3.tgz

-rw-rw---- 1 root wheel 68060504 Mar 21 12:22 /var/tmp/flowd_octeon_hm.core-tarball.4.tgz

 

Line 13310: Jul 2 19:20:08 CHASSISD_FRU_OFFLINE_NOTICE: Taking FPC 0 offline: Error

Line 13687: Aug 19 21:39:54 CHASSISD_FRU_OFFLINE_NOTICE: Taking FPC 0 offline: Error

Line 14062: Oct 26 09:11:14 CHASSISD_FRU_OFFLINE_NOTICE: Taking FPC 0 offline: Error

Line 14438: Aug 6 04:40:02 CHASSISD_FRU_OFFLINE_NOTICE: Taking FPC 0 offline: Error

Line 14813: Mar 21 12:21:17 CHASSISD_FRU_OFFLINE_NOTICE: Taking FPC 0 offline: Error

 

Solution

This flowd coredump matches PR1339905.

https://prsearch.juniper.net/problemreport/PR1339905

Modification History

2024-09-20 : Article Created