Apr 16 12:37:07 hw2 systemd[1]: Starting nipa-hw-worker.service - NIPA HW worker (one-shot test runner)...
Apr 16 12:37:08 hw2 python3[1225]: /srv/hw-worker/tests/777 Starting tests
Apr 16 12:37:11 hw2 python3[1225]: Peer 10.88.2.1 reachable after 1s
Apr 16 12:37:11 hw2 python3[1225]: Wrote /srv/hw-worker/tests/777/drivers/net/net.config
Apr 16 12:37:11 hw2 python3[1225]: Wrote /srv/hw-worker/tests/777/drivers/net/hw/net.config
Apr 16 12:37:11 hw2 python3[1225]: Collected device info for ens25f1np1
Apr 16 12:37:11 hw2 python3[1225]: Found 43 tests
Apr 16 12:37:11 hw2 python3[1225]: Saved 3017 lines of boot dmesg
Apr 16 12:37:11 hw2 python3[1225]: [1/43] Running drivers/net:gro.py
Apr 16 12:43:18 hw2 python3[1225]: [1/43] Retrying drivers/net:gro.py
Apr 16 12:49:18 hw2 python3[1225]: [1/43] drivers/net:gro.py: retry rc=1
Apr 16 12:49:18 hw2 python3[1225]: [1/43] drivers/net:gro.py: rc=1 (360.8s)
Apr 16 12:49:18 hw2 python3[1225]: [2/43] Running drivers/net:hds.py
Apr 16 12:49:19 hw2 python3[1225]: [2/43] Retrying drivers/net:hds.py
Apr 16 12:49:20 hw2 python3[1225]: [2/43] drivers/net:hds.py: retry rc=1
Apr 16 12:49:20 hw2 python3[1225]: [2/43] drivers/net:hds.py: rc=1 (0.6s)
Apr 16 12:49:20 hw2 python3[1225]: [3/43] Running drivers/net:macsec.py
Apr 16 12:49:22 hw2 python3[1225]: [3/43] Retrying drivers/net:macsec.py
Apr 16 12:49:24 hw2 python3[1225]: [3/43] drivers/net:macsec.py: retry rc=1
Apr 16 12:49:24 hw2 python3[1225]: [3/43] drivers/net:macsec.py: rc=1 (1.9s)
Apr 16 12:49:24 hw2 python3[1225]: [4/43] Running drivers/net:napi_id.py
Apr 16 12:49:25 hw2 python3[1225]: [4/43] drivers/net:napi_id.py: rc=0 (1.6s)
Apr 16 12:49:25 hw2 python3[1225]: [5/43] Running drivers/net:napi_threaded.py
Apr 16 12:49:29 hw2 python3[1225]: [5/43] drivers/net:napi_threaded.py: rc=0 (4.1s)
Apr 16 12:49:29 hw2 python3[1225]: [6/43] Running drivers/net:netpoll_basic.py
Apr 16 12:49:30 hw2 python3[6967]: detected unhandled Python exception in './netpoll_basic.py'
Apr 16 12:49:30 hw2 python3[1225]: [6/43] Retrying drivers/net:netpoll_basic.py
Apr 16 12:49:31 hw2 python3[7024]: detected unhandled Python exception in './netpoll_basic.py'
Apr 16 12:49:31 hw2 python3[1225]: [6/43] drivers/net:netpoll_basic.py: retry rc=1
Apr 16 12:49:31 hw2 python3[1225]: [6/43] drivers/net:netpoll_basic.py: rc=1 (0.9s)
Apr 16 12:49:31 hw2 python3[1225]: [7/43] Running drivers/net:ping.py
Apr 16 12:50:03 hw2 python3[1225]: [7/43] Retrying drivers/net:ping.py
Apr 16 12:51:09 hw2 python3[1225]: [7/43] drivers/net:ping.py: retry rc=1
Apr 16 12:51:09 hw2 python3[1225]: [7/43] drivers/net:ping.py: rc=1 (31.6s)
Apr 16 12:51:09 hw2 python3[1225]: [8/43] Running drivers/net:psp.py
Apr 16 12:51:10 hw2 python3[1225]: [8/43] drivers/net:psp.py: rc=0 (1.6s)
Apr 16 12:51:10 hw2 python3[1225]: [9/43] Running drivers/net:queues.py
Apr 16 12:51:14 hw2 python3[1225]: [9/43] drivers/net:queues.py: rc=0 (3.5s)
Apr 16 12:51:14 hw2 python3[1225]: [10/43] Running drivers/net:ring_reconfig.py
Apr 16 12:51:29 hw2 python3[1225]: [10/43] drivers/net:ring_reconfig.py: rc=0 (15.2s)
Apr 16 12:51:29 hw2 python3[1225]: [11/43] Running drivers/net:shaper.py
Apr 16 12:51:30 hw2 python3[1225]: [11/43] drivers/net:shaper.py: rc=0 (0.6s)
Apr 16 12:51:30 hw2 python3[1225]: [12/43] Running drivers/net:stats.py
Apr 16 12:51:34 hw2 python3[1225]: [12/43] drivers/net:stats.py: rc=0 (3.8s)
Apr 16 12:51:34 hw2 python3[1225]: [13/43] Running drivers/net:xdp.py
Apr 16 12:52:13 hw2 python3[1225]: [13/43] Retrying drivers/net:xdp.py
Apr 16 12:52:55 hw2 python3[1225]: [13/43] drivers/net:xdp.py: retry rc=1
Apr 16 12:52:55 hw2 python3[1225]: [13/43] drivers/net:xdp.py: rc=1 (39.1s)
Apr 16 12:52:55 hw2 python3[1225]: [14/43] Running drivers/net/hw:csum.py
Apr 16 12:53:18 hw2 python3[1225]: [14/43] drivers/net/hw:csum.py: rc=0 (22.4s)
Apr 16 12:53:18 hw2 python3[1225]: [15/43] Running drivers/net/hw:devlink_port_split.py
Apr 16 12:53:18 hw2 python3[1225]: [15/43] drivers/net/hw:devlink_port_split.py: rc=0 (0.5s)
Apr 16 12:53:19 hw2 python3[1225]: [16/43] Running drivers/net/hw:devlink_rate_tc_bw.py
Apr 16 12:53:20 hw2 python3[1225]: [16/43] drivers/net/hw:devlink_rate_tc_bw.py: rc=0 (1.1s)
Apr 16 12:53:20 hw2 python3[1225]: [17/43] Running drivers/net/hw:devmem.py
Apr 16 12:53:21 hw2 python3[1225]: [17/43] drivers/net/hw:devmem.py: rc=0 (1.5s)
Apr 16 12:53:21 hw2 python3[1225]: [18/43] Running drivers/net/hw:ethtool.sh
Apr 16 12:53:22 hw2 python3[1225]: [18/43] Retrying drivers/net/hw:ethtool.sh
Apr 16 12:53:22 hw2 python3[1225]: [18/43] drivers/net/hw:ethtool.sh: retry rc=1
Apr 16 12:53:22 hw2 python3[1225]: [18/43] drivers/net/hw:ethtool.sh: rc=1 (0.6s)
Apr 16 12:53:22 hw2 python3[1225]: [19/43] Running drivers/net/hw:ethtool_extended_state.sh
Apr 16 12:53:23 hw2 python3[1225]: [19/43] Retrying drivers/net/hw:ethtool_extended_state.sh
Apr 16 12:53:23 hw2 python3[1225]: [19/43] drivers/net/hw:ethtool_extended_state.sh: retry rc=1
Apr 16 12:53:23 hw2 python3[1225]: [19/43] drivers/net/hw:ethtool_extended_state.sh: rc=1 (0.5s)
Apr 16 12:53:23 hw2 python3[1225]: [20/43] Running drivers/net/hw:ethtool_mm.sh
Apr 16 12:53:24 hw2 python3[1225]: [20/43] Retrying drivers/net/hw:ethtool_mm.sh
Apr 16 12:53:25 hw2 python3[1225]: [20/43] drivers/net/hw:ethtool_mm.sh: retry rc=1
Apr 16 12:53:25 hw2 python3[1225]: [20/43] drivers/net/hw:ethtool_mm.sh: rc=1 (0.5s)
Apr 16 12:53:25 hw2 python3[1225]: [21/43] Running drivers/net/hw:ethtool_rmon.sh
Apr 16 12:54:04 hw2 python3[1225]: [21/43] drivers/net/hw:ethtool_rmon.sh: rc=0 (39.0s)
Apr 16 12:54:04 hw2 python3[1225]: [22/43] Running drivers/net/hw:ethtool_std_stats.sh
Apr 16 12:54:16 hw2 python3[1225]: [22/43] Retrying drivers/net/hw:ethtool_std_stats.sh
Apr 16 12:54:28 hw2 python3[1225]: [22/43] drivers/net/hw:ethtool_std_stats.sh: retry rc=1
Apr 16 12:54:28 hw2 python3[1225]: [22/43] drivers/net/hw:ethtool_std_stats.sh: rc=1 (12.2s)
Apr 16 12:54:28 hw2 python3[1225]: [23/43] Running drivers/net/hw:gro_hw.py
Apr 16 12:54:29 hw2 python3[1225]: [23/43] Retrying drivers/net/hw:gro_hw.py
Apr 16 12:54:31 hw2 python3[1225]: [23/43] drivers/net/hw:gro_hw.py: retry rc=1
Apr 16 12:54:31 hw2 python3[1225]: [23/43] drivers/net/hw:gro_hw.py: rc=1 (1.4s)
Apr 16 12:54:31 hw2 python3[1225]: [24/43] Running drivers/net/hw:hw_stats_l3.sh
Apr 16 12:54:32 hw2 python3[1225]: [24/43] Retrying drivers/net/hw:hw_stats_l3.sh
Apr 16 12:54:32 hw2 python3[1225]: [24/43] drivers/net/hw:hw_stats_l3.sh: retry rc=1
Apr 16 12:54:32 hw2 python3[1225]: [24/43] drivers/net/hw:hw_stats_l3.sh: rc=1 (0.6s)
Apr 16 12:54:32 hw2 python3[1225]: [25/43] Running drivers/net/hw:hw_stats_l3_gre.sh
Apr 16 12:54:33 hw2 python3[1225]: [25/43] Retrying drivers/net/hw:hw_stats_l3_gre.sh
Apr 16 12:54:33 hw2 python3[1225]: [25/43] drivers/net/hw:hw_stats_l3_gre.sh: retry rc=1
Apr 16 12:54:33 hw2 python3[1225]: [25/43] drivers/net/hw:hw_stats_l3_gre.sh: rc=1 (0.5s)
Apr 16 12:54:33 hw2 python3[1225]: [26/43] Running drivers/net/hw:iou-zcrx.py
Apr 16 12:54:35 hw2 python3[1225]: [26/43] Retrying drivers/net/hw:iou-zcrx.py
Apr 16 12:54:37 hw2 python3[1225]: [26/43] drivers/net/hw:iou-zcrx.py: retry rc=1
Apr 16 12:54:37 hw2 python3[1225]: [26/43] drivers/net/hw:iou-zcrx.py: rc=1 (1.6s)
Apr 16 12:54:37 hw2 python3[1225]: [27/43] Running drivers/net/hw:irq.py
Apr 16 12:54:43 hw2 python3[1225]: [27/43] Retrying drivers/net/hw:irq.py
Apr 16 12:54:50 hw2 python3[1225]: [27/43] drivers/net/hw:irq.py: retry rc=1
Apr 16 12:54:50 hw2 python3[1225]: [27/43] drivers/net/hw:irq.py: rc=1 (6.8s)
Apr 16 12:54:50 hw2 python3[1225]: [28/43] Running drivers/net/hw:loopback.sh
Apr 16 12:54:51 hw2 python3[1225]: [28/43] Retrying drivers/net/hw:loopback.sh
Apr 16 12:54:51 hw2 python3[1225]: [28/43] drivers/net/hw:loopback.sh: retry rc=1
Apr 16 12:54:51 hw2 python3[1225]: [28/43] drivers/net/hw:loopback.sh: rc=1 (0.6s)
Apr 16 12:54:51 hw2 python3[1225]: [29/43] Running drivers/net/hw:nic_timestamp.py
Apr 16 12:54:52 hw2 python3[1225]: [29/43] drivers/net/hw:nic_timestamp.py: rc=0 (0.7s)
Apr 16 12:54:52 hw2 python3[1225]: [30/43] Running drivers/net/hw:nk_netns.py
Apr 16 12:54:54 hw2 python3[11899]: detected unhandled Python exception in './nk_netns.py'
Apr 16 12:54:54 hw2 python3[1225]: [30/43] Retrying drivers/net/hw:nk_netns.py
Apr 16 12:54:56 hw2 python3[12031]: detected unhandled Python exception in './nk_netns.py'
Apr 16 12:54:56 hw2 python3[1225]: [30/43] drivers/net/hw:nk_netns.py: retry rc=1
Apr 16 12:54:56 hw2 python3[1225]: [30/43] drivers/net/hw:nk_netns.py: rc=1 (2.0s)
Apr 16 12:54:56 hw2 python3[1225]: [31/43] Running drivers/net/hw:nk_qlease.py
Apr 16 12:54:57 hw2 python3[12112]: detected unhandled Python exception in './nk_qlease.py'
Apr 16 12:54:57 hw2 python3[1225]: [31/43] Retrying drivers/net/hw:nk_qlease.py
Apr 16 12:54:59 hw2 python3[12199]: detected unhandled Python exception in './nk_qlease.py'
Apr 16 12:54:59 hw2 python3[1225]: [31/43] drivers/net/hw:nk_qlease.py: retry rc=1
Apr 16 12:54:59 hw2 python3[1225]: [31/43] drivers/net/hw:nk_qlease.py: rc=1 (1.6s)
Apr 16 12:54:59 hw2 python3[1225]: [32/43] Running drivers/net/hw:ntuple.py
Apr 16 12:55:00 hw2 python3[1225]: [32/43] drivers/net/hw:ntuple.py: rc=0 (1.2s)
Apr 16 12:55:00 hw2 python3[1225]: [33/43] Running drivers/net/hw:pp_alloc_fail.py
Apr 16 12:55:13 hw2 python3[1225]: [33/43] Retrying drivers/net/hw:pp_alloc_fail.py
Apr 16 12:55:18 hw2 python3[12455]: detected unhandled Python exception in './pp_alloc_fail.py'
Apr 16 12:55:18 hw2 python3[1225]: [33/43] drivers/net/hw:pp_alloc_fail.py: retry rc=1
Apr 16 12:55:18 hw2 python3[1225]: [33/43] drivers/net/hw:pp_alloc_fail.py: rc=1 (12.3s)
Apr 16 12:55:18 hw2 python3[1225]: [34/43] Running drivers/net/hw:rss_api.py
Apr 16 12:55:24 hw2 python3[12508]: detected unhandled Python exception in './rss_api.py'
Apr 16 12:55:24 hw2 python3[1225]: [34/43] Retrying drivers/net/hw:rss_api.py
Apr 16 12:55:26 hw2 python3[1225]: [34/43] drivers/net/hw:rss_api.py: retry rc=0
Apr 16 12:55:26 hw2 python3[1225]: [34/43] drivers/net/hw:rss_api.py: rc=1 (5.6s)
Apr 16 12:55:26 hw2 python3[1225]: [35/43] Running drivers/net/hw:rss_ctx.py
Apr 16 12:56:01 hw2 python3[1225]: [35/43] Retrying drivers/net/hw:rss_ctx.py
Apr 16 12:56:35 hw2 python3[1225]: [35/43] drivers/net/hw:rss_ctx.py: retry rc=1
Apr 16 12:56:35 hw2 python3[1225]: [35/43] drivers/net/hw:rss_ctx.py: rc=1 (35.4s)
Apr 16 12:56:35 hw2 python3[1225]: [36/43] Running drivers/net/hw:rss_drv.py
Apr 16 12:58:34 hw2 python3[1225]: [36/43] Retrying drivers/net/hw:rss_drv.py
Apr 16 13:00:37 hw2 python3[1225]: [36/43] drivers/net/hw:rss_drv.py: retry rc=1
Apr 16 13:00:37 hw2 python3[1225]: [36/43] drivers/net/hw:rss_drv.py: rc=1 (119.0s)
Apr 16 13:00:37 hw2 python3[1225]: [37/43] Running drivers/net/hw:rss_flow_label.py
Apr 16 13:00:38 hw2 python3[1225]: [37/43] drivers/net/hw:rss_flow_label.py: rc=0 (1.4s)
Apr 16 13:00:38 hw2 python3[1225]: [38/43] Running drivers/net/hw:rss_input_xfrm.py
Apr 16 13:01:06 hw2 python3[1225]: [38/43] drivers/net/hw:rss_input_xfrm.py: rc=0 (27.5s)
Apr 16 13:01:06 hw2 python3[1225]: [39/43] Running drivers/net/hw:toeplitz.py
Apr 16 13:01:30 hw2 python3[1225]: [39/43] drivers/net/hw:toeplitz.py: rc=0 (24.0s)
Apr 16 13:01:30 hw2 python3[1225]: [40/43] Running drivers/net/hw:tso.py
Apr 16 13:01:41 hw2 python3[15678]: detected unhandled Python exception in './tso.py'
Apr 16 13:01:42 hw2 python3[1225]: [40/43] Retrying drivers/net/hw:tso.py
Apr 16 13:01:47 hw2 python3[15742]: detected unhandled Python exception in './tso.py'
Apr 16 13:01:47 hw2 python3[1225]: [40/43] drivers/net/hw:tso.py: retry rc=1
Apr 16 13:01:47 hw2 python3[1225]: [40/43] drivers/net/hw:tso.py: rc=1 (11.5s)
Apr 16 13:01:47 hw2 python3[1225]: [41/43] Skipping drivers/net/hw:uso.py: crash detected in previous test
Apr 16 13:01:47 hw2 python3[1225]: [42/43] Skipping drivers/net/hw:xdp_metadata.py: crash detected in previous test
Apr 16 13:01:47 hw2 python3[1225]: [43/43] Skipping drivers/net/hw:xsk_reconfig.py: crash detected in previous test
Apr 16 13:01:47 hw2 python3[1225]: Completed, results in /srv/hw-worker/results/777
Apr 16 13:01:47 hw2 python3[1225]: NIPA DETECTED SYSTEM CRASH, REBOOT ME PLEASE
Apr 16 13:02:17 hw2 systemd[1]: nipa-hw-worker.service: State 'stop-sigterm' timed out. Aborting.
Apr 16 13:02:17 hw2 systemd[1]: nipa-hw-worker.service: Killing process 15684 (ethtool) with signal SIGABRT.
Apr 16 13:02:17 hw2 systemd[1]: nipa-hw-worker.service: Killing process 15686 (ethtool) with signal SIGABRT.
Apr 16 13:02:17 hw2 systemd[1]: nipa-hw-worker.service: Killing process 15743 (ip) with signal SIGABRT.
Apr 16 13:02:23 hw2 systemd[1]: nipa-hw-worker.service: Failed with result 'timeout'.
Apr 16 13:02:23 hw2 systemd[1]: Failed to start nipa-hw-worker.service - NIPA HW worker (one-shot test runner).
Apr 16 13:02:23 hw2 systemd[1]: nipa-hw-worker.service: Consumed 17min 26.806s CPU time over 25min 10.376s wall clock time, 131.4M memory peak.