Apr 11 20:30:43 hw2 systemd[1]: Starting nipa-hw-worker.service - NIPA HW worker (one-shot test runner)... Apr 11 20:30:44 hw2 python3[1221]: /srv/hw-worker/tests/673 Starting tests Apr 11 20:30:47 hw2 python3[1221]: Peer 10.88.2.1 reachable after 1s Apr 11 20:30:47 hw2 python3[1221]: Wrote /srv/hw-worker/tests/673/drivers/net/net.config Apr 11 20:30:47 hw2 python3[1221]: Wrote /srv/hw-worker/tests/673/drivers/net/hw/net.config Apr 11 20:30:47 hw2 python3[1221]: Collected device info for ens25f1np1 Apr 11 20:30:47 hw2 python3[1221]: Found 42 tests Apr 11 20:30:47 hw2 python3[1221]: Saved 3010 lines of boot dmesg Apr 11 20:30:47 hw2 python3[1221]: [1/42] Running drivers/net:gro.py Apr 11 20:36:53 hw2 python3[1221]: [1/42] Retrying drivers/net:gro.py Apr 11 20:42:54 hw2 python3[1221]: [1/42] drivers/net:gro.py: retry rc=1 Apr 11 20:42:54 hw2 python3[1221]: [1/42] drivers/net:gro.py: rc=1 (361.4s) Apr 11 20:42:54 hw2 python3[1221]: [2/42] Running drivers/net:hds.py Apr 11 20:42:55 hw2 python3[1221]: [2/42] Retrying drivers/net:hds.py Apr 11 20:42:55 hw2 python3[1221]: [2/42] drivers/net:hds.py: retry rc=1 Apr 11 20:42:55 hw2 python3[1221]: [2/42] drivers/net:hds.py: rc=1 (0.7s) Apr 11 20:42:55 hw2 python3[1221]: [3/42] Running drivers/net:macsec.py Apr 11 20:42:57 hw2 python3[1221]: [3/42] Retrying drivers/net:macsec.py Apr 11 20:42:59 hw2 python3[1221]: [3/42] drivers/net:macsec.py: retry rc=1 Apr 11 20:42:59 hw2 python3[1221]: [3/42] drivers/net:macsec.py: rc=1 (1.9s) Apr 11 20:42:59 hw2 python3[1221]: [4/42] Running drivers/net:napi_id.py Apr 11 20:43:01 hw2 python3[1221]: [4/42] drivers/net:napi_id.py: rc=0 (1.8s) Apr 11 20:43:01 hw2 python3[1221]: [5/42] Running drivers/net:napi_threaded.py Apr 11 20:43:07 hw2 python3[1221]: [5/42] drivers/net:napi_threaded.py: rc=0 (5.8s) Apr 11 20:43:07 hw2 python3[1221]: [6/42] Running drivers/net:netpoll_basic.py Apr 11 20:43:07 hw2 python3[7081]: detected unhandled Python exception in './netpoll_basic.py' Apr 11 20:43:08 hw2 python3[1221]: [6/42] Retrying drivers/net:netpoll_basic.py Apr 11 20:43:08 hw2 python3[7142]: detected unhandled Python exception in './netpoll_basic.py' Apr 11 20:43:08 hw2 python3[1221]: [6/42] drivers/net:netpoll_basic.py: retry rc=1 Apr 11 20:43:08 hw2 python3[1221]: [6/42] drivers/net:netpoll_basic.py: rc=1 (0.8s) Apr 11 20:43:08 hw2 python3[1221]: [7/42] Running drivers/net:ping.py Apr 11 20:43:41 hw2 python3[1221]: [7/42] Retrying drivers/net:ping.py Apr 11 20:44:47 hw2 python3[1221]: [7/42] drivers/net:ping.py: retry rc=1 Apr 11 20:44:47 hw2 python3[1221]: [7/42] drivers/net:ping.py: rc=1 (32.8s) Apr 11 20:44:47 hw2 python3[1221]: [8/42] Running drivers/net:psp.py Apr 11 20:44:49 hw2 python3[1221]: [8/42] drivers/net:psp.py: rc=0 (1.6s) Apr 11 20:44:49 hw2 python3[1221]: [9/42] Running drivers/net:queues.py Apr 11 20:44:52 hw2 python3[1221]: [9/42] drivers/net:queues.py: rc=0 (3.5s) Apr 11 20:44:52 hw2 python3[1221]: [10/42] Running drivers/net:ring_reconfig.py Apr 11 20:45:08 hw2 python3[1221]: [10/42] drivers/net:ring_reconfig.py: rc=0 (15.7s) Apr 11 20:45:08 hw2 python3[1221]: [11/42] Running drivers/net:shaper.py Apr 11 20:45:09 hw2 python3[1221]: [11/42] drivers/net:shaper.py: rc=0 (0.7s) Apr 11 20:45:09 hw2 python3[1221]: [12/42] Running drivers/net:stats.py Apr 11 20:45:13 hw2 python3[1221]: [12/42] drivers/net:stats.py: rc=0 (3.7s) Apr 11 20:45:13 hw2 python3[1221]: [13/42] Running drivers/net:xdp.py Apr 11 20:45:52 hw2 python3[1221]: [13/42] Retrying drivers/net:xdp.py Apr 11 20:46:35 hw2 python3[1221]: [13/42] drivers/net:xdp.py: retry rc=1 Apr 11 20:46:35 hw2 python3[1221]: [13/42] drivers/net:xdp.py: rc=1 (39.7s) Apr 11 20:46:35 hw2 python3[1221]: [14/42] Running drivers/net/hw:csum.py Apr 11 20:47:37 hw2 python3[1221]: [14/42] Retrying drivers/net/hw:csum.py Apr 11 20:48:39 hw2 python3[1221]: [14/42] drivers/net/hw:csum.py: retry rc=1 Apr 11 20:48:39 hw2 python3[1221]: [14/42] drivers/net/hw:csum.py: rc=1 (61.9s) Apr 11 20:48:39 hw2 python3[1221]: [15/42] Running drivers/net/hw:devlink_port_split.py Apr 11 20:48:39 hw2 python3[1221]: [15/42] drivers/net/hw:devlink_port_split.py: rc=0 (0.5s) Apr 11 20:48:39 hw2 python3[1221]: [16/42] Running drivers/net/hw:devlink_rate_tc_bw.py Apr 11 20:48:40 hw2 python3[1221]: [16/42] drivers/net/hw:devlink_rate_tc_bw.py: rc=0 (1.2s) Apr 11 20:48:40 hw2 python3[1221]: [17/42] Running drivers/net/hw:devmem.py Apr 11 20:48:42 hw2 python3[1221]: [17/42] drivers/net/hw:devmem.py: rc=0 (1.5s) Apr 11 20:48:42 hw2 python3[1221]: [18/42] Running drivers/net/hw:ethtool.sh Apr 11 20:48:43 hw2 python3[1221]: [18/42] Retrying drivers/net/hw:ethtool.sh Apr 11 20:48:43 hw2 python3[1221]: [18/42] drivers/net/hw:ethtool.sh: retry rc=1 Apr 11 20:48:43 hw2 python3[1221]: [18/42] drivers/net/hw:ethtool.sh: rc=1 (0.6s) Apr 11 20:48:43 hw2 python3[1221]: [19/42] Running drivers/net/hw:ethtool_extended_state.sh Apr 11 20:48:44 hw2 python3[1221]: [19/42] Retrying drivers/net/hw:ethtool_extended_state.sh Apr 11 20:48:44 hw2 python3[1221]: [19/42] drivers/net/hw:ethtool_extended_state.sh: retry rc=1 Apr 11 20:48:44 hw2 python3[1221]: [19/42] drivers/net/hw:ethtool_extended_state.sh: rc=1 (0.6s) Apr 11 20:48:44 hw2 python3[1221]: [20/42] Running drivers/net/hw:ethtool_mm.sh Apr 11 20:48:45 hw2 python3[1221]: [20/42] Retrying drivers/net/hw:ethtool_mm.sh Apr 11 20:48:46 hw2 python3[1221]: [20/42] drivers/net/hw:ethtool_mm.sh: retry rc=1 Apr 11 20:48:46 hw2 python3[1221]: [20/42] drivers/net/hw:ethtool_mm.sh: rc=1 (0.6s) Apr 11 20:48:46 hw2 python3[1221]: [21/42] Running drivers/net/hw:ethtool_rmon.sh Apr 11 20:49:27 hw2 python3[1221]: [21/42] drivers/net/hw:ethtool_rmon.sh: rc=0 (41.6s) Apr 11 20:49:27 hw2 python3[1221]: [22/42] Running drivers/net/hw:ethtool_std_stats.sh Apr 11 20:49:40 hw2 python3[1221]: [22/42] Retrying drivers/net/hw:ethtool_std_stats.sh Apr 11 20:49:52 hw2 python3[1221]: [22/42] drivers/net/hw:ethtool_std_stats.sh: retry rc=1 Apr 11 20:49:52 hw2 python3[1221]: [22/42] drivers/net/hw:ethtool_std_stats.sh: rc=1 (12.6s) Apr 11 20:49:52 hw2 python3[1221]: [23/42] Running drivers/net/hw:gro_hw.py Apr 11 20:49:54 hw2 python3[1221]: [23/42] Retrying drivers/net/hw:gro_hw.py Apr 11 20:49:55 hw2 python3[1221]: [23/42] drivers/net/hw:gro_hw.py: retry rc=1 Apr 11 20:49:55 hw2 python3[1221]: [23/42] drivers/net/hw:gro_hw.py: rc=1 (1.4s) Apr 11 20:49:55 hw2 python3[1221]: [24/42] Running drivers/net/hw:hw_stats_l3.sh Apr 11 20:49:56 hw2 python3[1221]: [24/42] Retrying drivers/net/hw:hw_stats_l3.sh Apr 11 20:49:56 hw2 python3[1221]: [24/42] drivers/net/hw:hw_stats_l3.sh: retry rc=1 Apr 11 20:49:57 hw2 python3[1221]: [24/42] drivers/net/hw:hw_stats_l3.sh: rc=1 (0.6s) Apr 11 20:49:57 hw2 python3[1221]: [25/42] Running drivers/net/hw:hw_stats_l3_gre.sh Apr 11 20:49:57 hw2 python3[1221]: [25/42] Retrying drivers/net/hw:hw_stats_l3_gre.sh Apr 11 20:49:58 hw2 python3[1221]: [25/42] drivers/net/hw:hw_stats_l3_gre.sh: retry rc=1 Apr 11 20:49:58 hw2 python3[1221]: [25/42] drivers/net/hw:hw_stats_l3_gre.sh: rc=1 (0.6s) Apr 11 20:49:58 hw2 python3[1221]: [26/42] Running drivers/net/hw:iou-zcrx.py Apr 11 20:49:59 hw2 python3[1221]: [26/42] Retrying drivers/net/hw:iou-zcrx.py Apr 11 20:50:01 hw2 python3[1221]: [26/42] drivers/net/hw:iou-zcrx.py: retry rc=1 Apr 11 20:50:01 hw2 python3[1221]: [26/42] drivers/net/hw:iou-zcrx.py: rc=1 (1.7s) Apr 11 20:50:01 hw2 python3[1221]: [27/42] Running drivers/net/hw:irq.py Apr 11 20:50:08 hw2 python3[1221]: [27/42] Retrying drivers/net/hw:irq.py Apr 11 20:50:15 hw2 python3[1221]: [27/42] drivers/net/hw:irq.py: retry rc=1 Apr 11 20:50:15 hw2 python3[1221]: [27/42] drivers/net/hw:irq.py: rc=1 (7.1s) Apr 11 20:50:15 hw2 python3[1221]: [28/42] Running drivers/net/hw:loopback.sh Apr 11 20:50:16 hw2 python3[1221]: [28/42] Retrying drivers/net/hw:loopback.sh Apr 11 20:50:16 hw2 python3[1221]: [28/42] drivers/net/hw:loopback.sh: retry rc=1 Apr 11 20:50:16 hw2 python3[1221]: [28/42] drivers/net/hw:loopback.sh: rc=1 (0.6s) Apr 11 20:50:16 hw2 python3[1221]: [29/42] Running drivers/net/hw:nic_timestamp.py Apr 11 20:50:17 hw2 python3[1221]: [29/42] drivers/net/hw:nic_timestamp.py: rc=0 (0.6s) Apr 11 20:50:17 hw2 python3[1221]: [30/42] Running drivers/net/hw:nk_netns.py Apr 11 20:50:18 hw2 python3[15754]: detected unhandled Python exception in './nk_netns.py' Apr 11 20:50:19 hw2 python3[1221]: [30/42] Retrying drivers/net/hw:nk_netns.py Apr 11 20:50:20 hw2 python3[15852]: detected unhandled Python exception in './nk_netns.py' Apr 11 20:50:20 hw2 python3[1221]: [30/42] drivers/net/hw:nk_netns.py: retry rc=1 Apr 11 20:50:20 hw2 python3[1221]: [30/42] drivers/net/hw:nk_netns.py: rc=1 (1.8s) Apr 11 20:50:20 hw2 python3[1221]: [31/42] Running drivers/net/hw:nk_qlease.py Apr 11 20:50:23 hw2 python3[15940]: detected unhandled Python exception in './nk_qlease.py' Apr 11 20:50:24 hw2 python3[1221]: [31/42] Retrying drivers/net/hw:nk_qlease.py Apr 11 20:50:27 hw2 python3[16097]: detected unhandled Python exception in './nk_qlease.py' Apr 11 20:50:27 hw2 python3[1221]: [31/42] drivers/net/hw:nk_qlease.py: retry rc=1 Apr 11 20:50:27 hw2 python3[1221]: [31/42] drivers/net/hw:nk_qlease.py: rc=1 (3.3s) Apr 11 20:50:27 hw2 python3[1221]: [32/42] Running drivers/net/hw:ntuple.py Apr 11 20:50:28 hw2 python3[1221]: [32/42] drivers/net/hw:ntuple.py: rc=0 (1.3s) Apr 11 20:50:28 hw2 python3[1221]: [33/42] Running drivers/net/hw:pp_alloc_fail.py Apr 11 20:50:41 hw2 python3[1221]: [33/42] Retrying drivers/net/hw:pp_alloc_fail.py Apr 11 20:50:46 hw2 python3[16445]: detected unhandled Python exception in './pp_alloc_fail.py' Apr 11 20:50:46 hw2 python3[1221]: [33/42] drivers/net/hw:pp_alloc_fail.py: retry rc=1 Apr 11 20:50:46 hw2 python3[1221]: [33/42] drivers/net/hw:pp_alloc_fail.py: rc=1 (12.6s) Apr 11 20:50:46 hw2 python3[1221]: [34/42] Running drivers/net/hw:rss_api.py Apr 11 20:50:52 hw2 python3[16501]: detected unhandled Python exception in './rss_api.py' Apr 11 20:50:52 hw2 python3[1221]: [34/42] Retrying drivers/net/hw:rss_api.py Apr 11 20:50:54 hw2 python3[1221]: [34/42] drivers/net/hw:rss_api.py: retry rc=0 Apr 11 20:50:54 hw2 python3[1221]: [34/42] drivers/net/hw:rss_api.py: rc=1 (5.6s) Apr 11 20:50:54 hw2 python3[1221]: [35/42] Running drivers/net/hw:rss_ctx.py Apr 11 20:51:31 hw2 python3[1221]: [35/42] Retrying drivers/net/hw:rss_ctx.py Apr 11 20:52:09 hw2 python3[1221]: [35/42] drivers/net/hw:rss_ctx.py: retry rc=1 Apr 11 20:52:09 hw2 python3[1221]: [35/42] drivers/net/hw:rss_ctx.py: rc=1 (37.4s) Apr 11 20:52:09 hw2 python3[1221]: [36/42] Running drivers/net/hw:rss_drv.py Apr 11 20:54:10 hw2 python3[1221]: [36/42] Retrying drivers/net/hw:rss_drv.py Apr 11 20:56:13 hw2 python3[1221]: [36/42] drivers/net/hw:rss_drv.py: retry rc=1 Apr 11 20:56:13 hw2 python3[1221]: [36/42] drivers/net/hw:rss_drv.py: rc=1 (120.8s) Apr 11 20:56:13 hw2 python3[1221]: [37/42] Running drivers/net/hw:rss_flow_label.py Apr 11 20:56:14 hw2 python3[1221]: [37/42] drivers/net/hw:rss_flow_label.py: rc=0 (1.7s) Apr 11 20:56:14 hw2 python3[1221]: [38/42] Running drivers/net/hw:rss_input_xfrm.py Apr 11 20:56:42 hw2 python3[1221]: [38/42] Retrying drivers/net/hw:rss_input_xfrm.py Apr 11 20:57:10 hw2 python3[1221]: [38/42] drivers/net/hw:rss_input_xfrm.py: retry rc=0 Apr 11 20:57:10 hw2 python3[1221]: [38/42] drivers/net/hw:rss_input_xfrm.py: rc=1 (27.7s) Apr 11 20:57:10 hw2 python3[1221]: [39/42] Running drivers/net/hw:toeplitz.py Apr 11 20:57:36 hw2 python3[1221]: [39/42] Retrying drivers/net/hw:toeplitz.py Apr 11 20:58:11 hw2 python3[1221]: [39/42] drivers/net/hw:toeplitz.py: retry rc=0 Apr 11 20:58:11 hw2 python3[1221]: [39/42] drivers/net/hw:toeplitz.py: rc=1 (25.7s) Apr 11 20:58:11 hw2 python3[1221]: [40/42] Running drivers/net/hw:tso.py Apr 11 20:58:23 hw2 python3[20204]: detected unhandled Python exception in './tso.py' Apr 11 20:58:23 hw2 python3[1221]: [40/42] Retrying drivers/net/hw:tso.py Apr 11 20:58:29 hw2 python3[20282]: detected unhandled Python exception in './tso.py' Apr 11 20:58:29 hw2 python3[1221]: [40/42] drivers/net/hw:tso.py: retry rc=1 Apr 11 20:58:29 hw2 python3[1221]: [40/42] drivers/net/hw:tso.py: rc=1 (11.8s) Apr 11 20:58:29 hw2 python3[1221]: [41/42] Skipping drivers/net/hw:xdp_metadata.py: crash detected in previous test Apr 11 20:58:29 hw2 python3[1221]: [42/42] Skipping drivers/net/hw:xsk_reconfig.py: crash detected in previous test Apr 11 20:58:29 hw2 python3[1221]: Completed, results in /srv/hw-worker/results/673 Apr 11 20:58:29 hw2 python3[1221]: NIPA DETECTED SYSTEM CRASH, REBOOT ME PLEASE Apr 11 20:58:59 hw2 systemd[1]: nipa-hw-worker.service: State 'stop-sigterm' timed out. Aborting. Apr 11 20:58:59 hw2 systemd[1]: nipa-hw-worker.service: Killing process 20211 (ethtool) with signal SIGABRT. Apr 11 20:58:59 hw2 systemd[1]: nipa-hw-worker.service: Killing process 20222 (ethtool) with signal SIGABRT. Apr 11 20:58:59 hw2 systemd[1]: nipa-hw-worker.service: Killing process 20283 (ip) with signal SIGABRT. Apr 11 20:59:29 hw2 systemd[1]: nipa-hw-worker.service: State 'stop-watchdog' timed out. Killing. Apr 11 20:59:29 hw2 systemd[1]: nipa-hw-worker.service: Killing process 20211 (ethtool) with signal SIGKILL. Apr 11 20:59:29 hw2 systemd[1]: nipa-hw-worker.service: Killing process 20222 (ethtool) with signal SIGKILL. Apr 11 20:59:29 hw2 systemd[1]: nipa-hw-worker.service: Killing process 20283 (ip) with signal SIGKILL. Apr 11 20:59:59 hw2 systemd[1]: nipa-hw-worker.service: Processes still around after SIGKILL. Ignoring. Apr 11 21:00:00 hw2 systemd[1]: nipa-hw-worker.service: Failed with result 'timeout'. Apr 11 21:00:00 hw2 systemd[1]: Failed to start nipa-hw-worker.service - NIPA HW worker (one-shot test runner). Apr 11 21:00:00 hw2 systemd[1]: nipa-hw-worker.service: Consumed 19min 49.124s CPU time over 29min 12.463s wall clock time, 156.7M memory peak.