Apr 19 21:11:41 hw2 systemd[1]: Starting nipa-hw-worker.service - NIPA HW worker (one-shot test runner)... Apr 19 21:11:41 hw2 python3[1222]: /srv/hw-worker/tests/860 Starting tests Apr 19 21:11:45 hw2 python3[1222]: Peer 10.88.2.1 reachable after 1s Apr 19 21:11:45 hw2 python3[1222]: Wrote /srv/hw-worker/tests/860/drivers/net/net.config Apr 19 21:11:45 hw2 python3[1222]: Wrote /srv/hw-worker/tests/860/drivers/net/hw/net.config Apr 19 21:11:45 hw2 python3[1222]: Collected device info for ens25f1np1 Apr 19 21:11:45 hw2 python3[1222]: Found 43 tests Apr 19 21:11:45 hw2 python3[1222]: Saved 3019 lines of boot dmesg Apr 19 21:11:45 hw2 python3[1222]: [1/43] Running drivers/net:gro.py Apr 19 21:17:52 hw2 python3[1222]: [1/43] Retrying drivers/net:gro.py Apr 19 21:23:53 hw2 python3[1222]: [1/43] drivers/net:gro.py: retry rc=1 Apr 19 21:23:53 hw2 python3[1222]: [1/43] drivers/net:gro.py: rc=1 (361.3s) Apr 19 21:23:53 hw2 python3[1222]: [2/43] Running drivers/net:hds.py Apr 19 21:23:53 hw2 python3[1222]: [2/43] Retrying drivers/net:hds.py Apr 19 21:23:54 hw2 python3[1222]: [2/43] drivers/net:hds.py: retry rc=1 Apr 19 21:23:54 hw2 python3[1222]: [2/43] drivers/net:hds.py: rc=1 (0.6s) Apr 19 21:23:54 hw2 python3[1222]: [3/43] Running drivers/net:macsec.py Apr 19 21:23:56 hw2 python3[1222]: [3/43] Retrying drivers/net:macsec.py Apr 19 21:23:58 hw2 python3[1222]: [3/43] drivers/net:macsec.py: retry rc=1 Apr 19 21:23:58 hw2 python3[1222]: [3/43] drivers/net:macsec.py: rc=1 (1.9s) Apr 19 21:23:58 hw2 python3[1222]: [4/43] Running drivers/net:napi_id.py Apr 19 21:24:00 hw2 python3[1222]: [4/43] drivers/net:napi_id.py: rc=0 (1.7s) Apr 19 21:24:00 hw2 python3[1222]: [5/43] Running drivers/net:napi_threaded.py Apr 19 21:24:06 hw2 python3[1222]: [5/43] drivers/net:napi_threaded.py: rc=0 (6.1s) Apr 19 21:24:06 hw2 python3[1222]: [6/43] Running drivers/net:netpoll_basic.py Apr 19 21:24:06 hw2 python3[7069]: detected unhandled Python exception in './netpoll_basic.py' Apr 19 21:24:07 hw2 python3[1222]: [6/43] Retrying drivers/net:netpoll_basic.py Apr 19 21:24:07 hw2 python3[7124]: detected unhandled Python exception in './netpoll_basic.py' Apr 19 21:24:07 hw2 python3[1222]: [6/43] drivers/net:netpoll_basic.py: retry rc=1 Apr 19 21:24:07 hw2 python3[1222]: [6/43] drivers/net:netpoll_basic.py: rc=1 (0.8s) Apr 19 21:24:07 hw2 python3[1222]: [7/43] Running drivers/net:ping.py Apr 19 21:24:40 hw2 python3[1222]: [7/43] Retrying drivers/net:ping.py Apr 19 21:25:46 hw2 python3[1222]: [7/43] drivers/net:ping.py: retry rc=1 Apr 19 21:25:46 hw2 python3[1222]: [7/43] drivers/net:ping.py: rc=1 (32.4s) Apr 19 21:25:46 hw2 python3[1222]: [8/43] Running drivers/net:psp.py Apr 19 21:25:48 hw2 python3[1222]: [8/43] drivers/net:psp.py: rc=0 (1.8s) Apr 19 21:25:48 hw2 python3[1222]: [9/43] Running drivers/net:queues.py Apr 19 21:25:51 hw2 python3[1222]: [9/43] drivers/net:queues.py: rc=0 (3.5s) Apr 19 21:25:51 hw2 python3[1222]: [10/43] Running drivers/net:ring_reconfig.py Apr 19 21:26:06 hw2 python3[1222]: [10/43] drivers/net:ring_reconfig.py: rc=0 (15.1s) Apr 19 21:26:07 hw2 python3[1222]: [11/43] Running drivers/net:shaper.py Apr 19 21:26:07 hw2 python3[1222]: [11/43] drivers/net:shaper.py: rc=0 (0.6s) Apr 19 21:26:07 hw2 python3[1222]: [12/43] Running drivers/net:stats.py Apr 19 21:26:11 hw2 python3[1222]: [12/43] drivers/net:stats.py: rc=0 (3.7s) Apr 19 21:26:11 hw2 python3[1222]: [13/43] Running drivers/net:xdp.py Apr 19 21:26:50 hw2 python3[1222]: [13/43] Retrying drivers/net:xdp.py Apr 19 21:27:33 hw2 python3[1222]: [13/43] drivers/net:xdp.py: retry rc=1 Apr 19 21:27:33 hw2 python3[1222]: [13/43] drivers/net:xdp.py: rc=1 (39.1s) Apr 19 21:27:33 hw2 python3[1222]: [14/43] Running drivers/net/hw:csum.py Apr 19 21:27:55 hw2 python3[1222]: [14/43] drivers/net/hw:csum.py: rc=0 (22.3s) Apr 19 21:27:55 hw2 python3[1222]: [15/43] Running drivers/net/hw:devlink_port_split.py Apr 19 21:27:56 hw2 python3[1222]: [15/43] drivers/net/hw:devlink_port_split.py: rc=0 (0.6s) Apr 19 21:27:56 hw2 python3[1222]: [16/43] Running drivers/net/hw:devlink_rate_tc_bw.py Apr 19 21:27:57 hw2 python3[1222]: [16/43] drivers/net/hw:devlink_rate_tc_bw.py: rc=0 (1.0s) Apr 19 21:27:57 hw2 python3[1222]: [17/43] Running drivers/net/hw:devmem.py Apr 19 21:27:58 hw2 python3[1222]: [17/43] drivers/net/hw:devmem.py: rc=0 (1.4s) Apr 19 21:27:58 hw2 python3[1222]: [18/43] Running drivers/net/hw:ethtool.sh Apr 19 21:27:59 hw2 python3[1222]: [18/43] Retrying drivers/net/hw:ethtool.sh Apr 19 21:27:59 hw2 python3[1222]: [18/43] drivers/net/hw:ethtool.sh: retry rc=1 Apr 19 21:27:59 hw2 python3[1222]: [18/43] drivers/net/hw:ethtool.sh: rc=1 (0.6s) Apr 19 21:27:59 hw2 python3[1222]: [19/43] Running drivers/net/hw:ethtool_extended_state.sh Apr 19 21:28:00 hw2 python3[1222]: [19/43] Retrying drivers/net/hw:ethtool_extended_state.sh Apr 19 21:28:01 hw2 python3[1222]: [19/43] drivers/net/hw:ethtool_extended_state.sh: retry rc=1 Apr 19 21:28:01 hw2 python3[1222]: [19/43] drivers/net/hw:ethtool_extended_state.sh: rc=1 (0.6s) Apr 19 21:28:01 hw2 python3[1222]: [20/43] Running drivers/net/hw:ethtool_mm.sh Apr 19 21:28:01 hw2 python3[1222]: [20/43] Retrying drivers/net/hw:ethtool_mm.sh Apr 19 21:28:02 hw2 python3[1222]: [20/43] drivers/net/hw:ethtool_mm.sh: retry rc=1 Apr 19 21:28:02 hw2 python3[1222]: [20/43] drivers/net/hw:ethtool_mm.sh: rc=1 (0.5s) Apr 19 21:28:02 hw2 python3[1222]: [21/43] Running drivers/net/hw:ethtool_rmon.sh Apr 19 21:28:41 hw2 python3[1222]: [21/43] drivers/net/hw:ethtool_rmon.sh: rc=0 (39.7s) Apr 19 21:28:41 hw2 python3[1222]: [22/43] Running drivers/net/hw:ethtool_std_stats.sh Apr 19 21:28:54 hw2 python3[1222]: [22/43] Retrying drivers/net/hw:ethtool_std_stats.sh Apr 19 21:29:06 hw2 python3[1222]: [22/43] drivers/net/hw:ethtool_std_stats.sh: retry rc=1 Apr 19 21:29:06 hw2 python3[1222]: [22/43] drivers/net/hw:ethtool_std_stats.sh: rc=1 (12.4s) Apr 19 21:29:06 hw2 python3[1222]: [23/43] Running drivers/net/hw:gro_hw.py Apr 19 21:29:08 hw2 python3[1222]: [23/43] Retrying drivers/net/hw:gro_hw.py Apr 19 21:29:09 hw2 python3[1222]: [23/43] drivers/net/hw:gro_hw.py: retry rc=1 Apr 19 21:29:09 hw2 python3[1222]: [23/43] drivers/net/hw:gro_hw.py: rc=1 (1.5s) Apr 19 21:29:09 hw2 python3[1222]: [24/43] Running drivers/net/hw:hw_stats_l3.sh Apr 19 21:29:10 hw2 python3[1222]: [24/43] Retrying drivers/net/hw:hw_stats_l3.sh Apr 19 21:29:10 hw2 python3[1222]: [24/43] drivers/net/hw:hw_stats_l3.sh: retry rc=1 Apr 19 21:29:10 hw2 python3[1222]: [24/43] drivers/net/hw:hw_stats_l3.sh: rc=1 (0.6s) Apr 19 21:29:10 hw2 python3[1222]: [25/43] Running drivers/net/hw:hw_stats_l3_gre.sh Apr 19 21:29:11 hw2 python3[1222]: [25/43] Retrying drivers/net/hw:hw_stats_l3_gre.sh Apr 19 21:29:11 hw2 python3[1222]: [25/43] drivers/net/hw:hw_stats_l3_gre.sh: retry rc=1 Apr 19 21:29:11 hw2 python3[1222]: [25/43] drivers/net/hw:hw_stats_l3_gre.sh: rc=1 (0.6s) Apr 19 21:29:11 hw2 python3[1222]: [26/43] Running drivers/net/hw:iou-zcrx.py Apr 19 21:29:13 hw2 python3[1222]: [26/43] Retrying drivers/net/hw:iou-zcrx.py Apr 19 21:29:14 hw2 python3[1222]: [26/43] drivers/net/hw:iou-zcrx.py: retry rc=1 Apr 19 21:29:14 hw2 python3[1222]: [26/43] drivers/net/hw:iou-zcrx.py: rc=1 (1.5s) Apr 19 21:29:14 hw2 python3[1222]: [27/43] Running drivers/net/hw:irq.py Apr 19 21:29:21 hw2 python3[1222]: [27/43] Retrying drivers/net/hw:irq.py Apr 19 21:29:28 hw2 python3[1222]: [27/43] drivers/net/hw:irq.py: retry rc=1 Apr 19 21:29:28 hw2 python3[1222]: [27/43] drivers/net/hw:irq.py: rc=1 (7.0s) Apr 19 21:29:28 hw2 python3[1222]: [28/43] Running drivers/net/hw:loopback.sh Apr 19 21:29:29 hw2 python3[1222]: [28/43] Retrying drivers/net/hw:loopback.sh Apr 19 21:29:29 hw2 python3[1222]: [28/43] drivers/net/hw:loopback.sh: retry rc=1 Apr 19 21:29:29 hw2 python3[1222]: [28/43] drivers/net/hw:loopback.sh: rc=1 (0.6s) Apr 19 21:29:29 hw2 python3[1222]: [29/43] Running drivers/net/hw:nic_timestamp.py Apr 19 21:29:30 hw2 python3[1222]: [29/43] drivers/net/hw:nic_timestamp.py: rc=0 (0.6s) Apr 19 21:29:30 hw2 python3[1222]: [30/43] Running drivers/net/hw:nk_netns.py Apr 19 21:29:32 hw2 python3[11951]: detected unhandled Python exception in './nk_netns.py' Apr 19 21:29:32 hw2 python3[1222]: [30/43] Retrying drivers/net/hw:nk_netns.py Apr 19 21:29:33 hw2 python3[12090]: detected unhandled Python exception in './nk_netns.py' Apr 19 21:29:34 hw2 python3[1222]: [30/43] drivers/net/hw:nk_netns.py: retry rc=1 Apr 19 21:29:34 hw2 python3[1222]: [30/43] drivers/net/hw:nk_netns.py: rc=1 (1.9s) Apr 19 21:29:34 hw2 python3[1222]: [31/43] Running drivers/net/hw:nk_qlease.py Apr 19 21:29:35 hw2 python3[12169]: detected unhandled Python exception in './nk_qlease.py' Apr 19 21:29:35 hw2 python3[1222]: [31/43] Retrying drivers/net/hw:nk_qlease.py Apr 19 21:29:36 hw2 python3[12248]: detected unhandled Python exception in './nk_qlease.py' Apr 19 21:29:37 hw2 python3[1222]: [31/43] drivers/net/hw:nk_qlease.py: retry rc=1 Apr 19 21:29:37 hw2 python3[1222]: [31/43] drivers/net/hw:nk_qlease.py: rc=1 (1.6s) Apr 19 21:29:37 hw2 python3[1222]: [32/43] Running drivers/net/hw:ntuple.py Apr 19 21:29:38 hw2 python3[1222]: [32/43] drivers/net/hw:ntuple.py: rc=0 (1.2s) Apr 19 21:29:38 hw2 python3[1222]: [33/43] Running drivers/net/hw:pp_alloc_fail.py Apr 19 21:29:51 hw2 python3[1222]: [33/43] Retrying drivers/net/hw:pp_alloc_fail.py Apr 19 21:29:56 hw2 python3[12498]: detected unhandled Python exception in './pp_alloc_fail.py' Apr 19 21:29:56 hw2 python3[1222]: [33/43] drivers/net/hw:pp_alloc_fail.py: retry rc=1 Apr 19 21:29:56 hw2 python3[1222]: [33/43] drivers/net/hw:pp_alloc_fail.py: rc=1 (12.7s) Apr 19 21:29:56 hw2 python3[1222]: [34/43] Running drivers/net/hw:rss_api.py Apr 19 21:30:02 hw2 python3[12548]: detected unhandled Python exception in './rss_api.py' Apr 19 21:30:02 hw2 python3[1222]: [34/43] Retrying drivers/net/hw:rss_api.py Apr 19 21:30:05 hw2 python3[1222]: [34/43] drivers/net/hw:rss_api.py: retry rc=0 Apr 19 21:30:06 hw2 python3[1222]: [34/43] drivers/net/hw:rss_api.py: rc=1 (5.5s) Apr 19 21:30:06 hw2 python3[1222]: [35/43] Running drivers/net/hw:rss_ctx.py Apr 19 21:30:43 hw2 python3[1222]: [35/43] Retrying drivers/net/hw:rss_ctx.py Apr 19 21:31:21 hw2 python3[1222]: [35/43] drivers/net/hw:rss_ctx.py: retry rc=1 Apr 19 21:31:21 hw2 python3[1222]: [35/43] drivers/net/hw:rss_ctx.py: rc=1 (37.8s) Apr 19 21:31:21 hw2 python3[1222]: [36/43] Running drivers/net/hw:rss_drv.py Apr 19 21:33:24 hw2 python3[1222]: [36/43] Retrying drivers/net/hw:rss_drv.py Apr 19 21:35:28 hw2 python3[1222]: [36/43] drivers/net/hw:rss_drv.py: retry rc=1 Apr 19 21:35:28 hw2 python3[1222]: [36/43] drivers/net/hw:rss_drv.py: rc=1 (122.9s) Apr 19 21:35:28 hw2 python3[1222]: [37/43] Running drivers/net/hw:rss_flow_label.py Apr 19 21:35:30 hw2 python3[1222]: [37/43] drivers/net/hw:rss_flow_label.py: rc=0 (1.6s) Apr 19 21:35:30 hw2 python3[1222]: [38/43] Running drivers/net/hw:rss_input_xfrm.py Apr 19 21:35:57 hw2 python3[1222]: [38/43] drivers/net/hw:rss_input_xfrm.py: rc=0 (27.4s) Apr 19 21:35:57 hw2 python3[1222]: [39/43] Running drivers/net/hw:toeplitz.py Apr 19 21:36:22 hw2 python3[1222]: [39/43] drivers/net/hw:toeplitz.py: rc=0 (24.8s) Apr 19 21:36:22 hw2 python3[1222]: [40/43] Running drivers/net/hw:tso.py Apr 19 21:36:33 hw2 python3[15700]: detected unhandled Python exception in './tso.py' Apr 19 21:36:33 hw2 python3[1222]: [40/43] Retrying drivers/net/hw:tso.py Apr 19 21:36:39 hw2 python3[15762]: detected unhandled Python exception in './tso.py' Apr 19 21:36:39 hw2 python3[1222]: [40/43] drivers/net/hw:tso.py: retry rc=1 Apr 19 21:36:39 hw2 python3[1222]: [40/43] drivers/net/hw:tso.py: rc=1 (11.5s) Apr 19 21:36:39 hw2 python3[1222]: [41/43] Skipping drivers/net/hw:uso.py: crash detected in previous test Apr 19 21:36:39 hw2 python3[1222]: [42/43] Skipping drivers/net/hw:xdp_metadata.py: crash detected in previous test Apr 19 21:36:39 hw2 python3[1222]: [43/43] Skipping drivers/net/hw:xsk_reconfig.py: crash detected in previous test Apr 19 21:36:39 hw2 python3[1222]: Completed, results in /srv/hw-worker/results/860 Apr 19 21:36:39 hw2 python3[1222]: NIPA DETECTED SYSTEM CRASH, REBOOT ME PLEASE Apr 19 21:37:09 hw2 systemd[1]: nipa-hw-worker.service: State 'stop-sigterm' timed out. Aborting. Apr 19 21:37:09 hw2 systemd[1]: nipa-hw-worker.service: Killing process 15706 (ethtool) with signal SIGABRT. Apr 19 21:37:09 hw2 systemd[1]: nipa-hw-worker.service: Killing process 15708 (ethtool) with signal SIGABRT. Apr 19 21:37:09 hw2 systemd[1]: nipa-hw-worker.service: Killing process 15763 (ip) with signal SIGABRT. Apr 19 21:37:20 hw2 systemd[1]: nipa-hw-worker.service: Failed with result 'timeout'. Apr 19 21:37:20 hw2 systemd[1]: Failed to start nipa-hw-worker.service - NIPA HW worker (one-shot test runner). Apr 19 21:37:20 hw2 systemd[1]: nipa-hw-worker.service: Consumed 18min 13.908s CPU time over 25min 34.155s wall clock time, 130.9M memory peak.