[ 787.016129] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 787.019482] nipa-hw-worker: [5/43] Retrying drivers/net:napi_threaded.py
[ 787.173234] kselftest: Running tests in drivers/net
[ 989.705921] INFO: task python3:5860 blocked for more than 122 seconds.
[ 989.714121] Not tainted 7.1.0-rc1-rxju-gf1f21b098513 #1
[ 989.721702] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.731292] task:python3 state:D stack:25672 pid:5860 tgid:5860 ppid:5859 task_flags:0x400100 flags:0x00080000
[ 989.744490] Call Trace:
[ 989.748032]
[ 989.751184] __schedule+0xcba/0x1940
[ 989.756002] ? io_schedule_timeout+0x140/0x140
[ 989.761786] ? find_held_lock+0x2b/0x80
[ 989.766892] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.772776] schedule+0xd4/0x260
[ 989.777196] schedule_preempt_disabled+0x18/0x30
[ 989.783166] __mutex_lock+0x6a3/0x2000
[ 989.788170] ? threaded_store+0x132/0x220
[ 989.793470] ? ww_mutex_lock+0x160/0x160
[ 989.798670] ? selinux_inode_free_security+0x330/0x330
[ 989.805240] ? cap_capable+0x1d6/0x3e0
[ 989.810247] ? threaded_store+0x132/0x220
[ 989.815548] threaded_store+0x132/0x220
[ 989.820652] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.825951] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.831250] ? sysfs_kf_write+0x65/0x160
[ 989.836449] ? sysfs_file_ops+0x140/0x140
[ 989.841751] kernfs_fop_write_iter+0x335/0x510
[ 989.847536] ? kernfs_ops+0xf0/0xf0
[ 989.852239] new_sync_write+0x333/0x750
[ 989.857346] ? __lock_acquire+0x508/0xc10
[ 989.862642] ? new_sync_read+0x740/0x740
[ 989.867841] ? lock_acquire.part.0+0xbc/0x260
[ 989.873530] ? ksys_write+0x116/0x250
[ 989.878441] vfs_write+0x657/0x9b0
[ 989.883055] ksys_write+0x116/0x250
[ 989.887766] ? __ia32_sys_read+0xc0/0xc0
[ 989.892966] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.898548] ? rcu_is_watching+0x15/0xd0
[ 989.903754] do_syscall_64+0xf3/0x650
[ 989.908662] ? trace_hardirqs_off+0xd/0x30
[ 989.914059] ? exc_page_fault+0xda/0xf0
[ 989.919159] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.925627] RIP: 0033:0x7f1c345be22e
[ 989.930439] RSP: 002b:00007ffe45996450 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.939738] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1c345be22e
[ 989.948546] RDX: 0000000000000001 RSI: 0000556ad0c06410 RDI: 0000000000000007
[ 989.957344] RBP: 00007ffe45996460 R08: 0000000000000000 R09: 0000000000000000
[ 989.966151] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1c34436390
[ 989.974958] R13: 0000556ad0c06410 R14: 0000000000000007 R15: 0000000000000003
[ 989.983772]
[ 989.987064] INFO: task python3:5860 is blocked on a mutex likely owned by task python3:3774.
[ 989.997335] task:python3 state:D stack:25672 pid:3774 tgid:3774 ppid:3773 task_flags:0x400100 flags:0x00080802
[ 990.010536] Call Trace:
[ 990.014076]
[ 990.017224] __schedule+0xcba/0x1940
[ 990.022035] ? io_schedule_timeout+0x140/0x140
[ 990.027817] ? find_held_lock+0x2b/0x80
[ 990.032921] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.039100] schedule+0xd4/0x260
[ 990.043520] schedule_timeout+0x13f/0x290
[ 990.048819] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.055187] ? trace_contention_end+0xb3/0x1a0
[ 990.060971] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.066661] ? ww_mutex_lock+0x160/0x160
[ 990.071869] msleep+0x1b/0x30
[ 990.075994] napi_set_threaded+0x3a5/0x440
[ 990.081390] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.086885] netif_set_threaded+0x257/0x400
[ 990.092381] threaded_store+0x1b8/0x220
[ 990.097483] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.102782] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.108079] ? sysfs_kf_write+0x65/0x160
[ 990.113271] ? sysfs_file_ops+0x140/0x140
[ 990.118571] kernfs_fop_write_iter+0x335/0x510
[ 990.124355] ? kernfs_ops+0xf0/0xf0
[ 990.129067] new_sync_write+0x333/0x750
[ 990.134159] ? __lock_acquire+0x508/0xc10
[ 990.139456] ? new_sync_read+0x740/0x740
[ 990.144658] ? lock_acquire.part.0+0xbc/0x260
[ 990.150346] ? ksys_write+0x116/0x250
[ 990.155256] vfs_write+0x657/0x9b0
[ 990.159871] ksys_write+0x116/0x250
[ 990.164586] ? __ia32_sys_read+0xc0/0xc0
[ 990.169785] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.175374] ? rcu_is_watching+0x15/0xd0
[ 990.180574] do_syscall_64+0xf3/0x650
[ 990.185470] ? trace_hardirqs_off+0xd/0x30
[ 990.190866] ? exc_page_fault+0xda/0xf0
[ 990.195971] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.202438] RIP: 0033:0x7f136862f22e
[ 990.207239] RSP: 002b:00007ffee888e7e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.216530] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f136862f22e
[ 990.225338] RDX: 0000000000000001 RSI: 0000564e10d28410 RDI: 0000000000000007
[ 990.234147] RBP: 00007ffee888e7f0 R08: 0000000000000000 R09: 0000000000000000
[ 990.242954] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f13684a7390
[ 990.251764] R13: 0000564e10d28410 R14: 0000000000000007 R15: 0000000000000003
[ 990.260576]
[ 990.263835] \x0aShowing all locks held in the system:
[ 990.272372] 1 lock held by khungtaskd/184:
[ 990.277765] #0: ffffffff888fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.289238] 2 locks held by systemd-journal/808:
[ 990.295218] #0: ff1100180e5372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.305105] #1: ffffffff88b030a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.317933] 4 locks held by python3/3774:
[ 990.323230] #0: ff110017d9f113e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.333122] #1: ff1100013e219a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.344086] #2: ff11000123a1ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.355244] #3: ff11000123b19d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.365342] 4 locks held by python3/5860:
[ 990.370639] #0: ff110017d9f113e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.380530] #1: ff1100020ff54480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.391492] #2: ff11000123a1ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.402648] #3: ff11000123b19d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.412734]
[ 990.415202] =============================================\x0a
[ 1112.587142] INFO: task python3:5860 blocked for more than 245 seconds.
[ 1112.595289] Not tainted 7.1.0-rc1-rxju-gf1f21b098513 #1
[ 1112.602539] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.612129] task:python3 state:D stack:25672 pid:5860 tgid:5860 ppid:5859 task_flags:0x400100 flags:0x00080000
[ 1112.625325] Call Trace:
[ 1112.628865]
[ 1112.632012] __schedule+0xcba/0x1940
[ 1112.636826] ? io_schedule_timeout+0x140/0x140
[ 1112.642610] ? find_held_lock+0x2b/0x80
[ 1112.647703] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.653590] schedule+0xd4/0x260
[ 1112.658007] schedule_preempt_disabled+0x18/0x30
[ 1112.663986] __mutex_lock+0x6a3/0x2000
[ 1112.668990] ? threaded_store+0x132/0x220
[ 1112.674287] ? ww_mutex_lock+0x160/0x160
[ 1112.679487] ? selinux_inode_free_security+0x330/0x330
[ 1112.686057] ? cap_capable+0x1d6/0x3e0
[ 1112.691063] ? threaded_store+0x132/0x220
[ 1112.696358] threaded_store+0x132/0x220
[ 1112.701460] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.706746] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.712045] ? sysfs_kf_write+0x65/0x160
[ 1112.717236] ? sysfs_file_ops+0x140/0x140
[ 1112.722531] kernfs_fop_write_iter+0x335/0x510
[ 1112.728315] ? kernfs_ops+0xf0/0xf0
[ 1112.733024] new_sync_write+0x333/0x750
[ 1112.738126] ? __lock_acquire+0x508/0xc10
[ 1112.743420] ? new_sync_read+0x740/0x740
[ 1112.748619] ? lock_acquire.part.0+0xbc/0x260
[ 1112.754302] ? ksys_write+0x116/0x250
[ 1112.759213] vfs_write+0x657/0x9b0
[ 1112.763828] ksys_write+0x116/0x250
[ 1112.768538] ? __ia32_sys_read+0xc0/0xc0
[ 1112.773739] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.779328] ? rcu_is_watching+0x15/0xd0
[ 1112.784533] do_syscall_64+0xf3/0x650
[ 1112.789441] ? trace_hardirqs_off+0xd/0x30
[ 1112.794836] ? exc_page_fault+0xda/0xf0
[ 1112.799937] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.806406] RIP: 0033:0x7f1c345be22e
[ 1112.811216] RSP: 002b:00007ffe45996450 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.820518] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1c345be22e
[ 1112.829325] RDX: 0000000000000001 RSI: 0000556ad0c06410 RDI: 0000000000000007
[ 1112.838134] RBP: 00007ffe45996460 R08: 0000000000000000 R09: 0000000000000000
[ 1112.846943] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1c34436390
[ 1112.855754] R13: 0000556ad0c06410 R14: 0000000000000007 R15: 0000000000000003
[ 1112.864566]
[ 1112.867861] INFO: task python3:5860 is blocked on a mutex likely owned by task python3:3774.
[ 1112.878131] task:python3 state:D stack:25672 pid:3774 tgid:3774 ppid:3773 task_flags:0x400100 flags:0x00080802
[ 1112.891336] Call Trace:
[ 1112.894945]
[ 1112.898098] __schedule+0xcba/0x1940
[ 1112.902911] ? io_schedule_timeout+0x140/0x140
[ 1112.908698] ? find_held_lock+0x2b/0x80
[ 1112.913802] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.919986] schedule+0xd4/0x260
[ 1112.924405] schedule_timeout+0x13f/0x290
[ 1112.929693] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.936064] ? trace_contention_end+0xb3/0x1a0
[ 1112.941848] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.947539] ? ww_mutex_lock+0x160/0x160
[ 1112.952740] msleep+0x1b/0x30
[ 1112.956866] napi_set_threaded+0x3a5/0x440
[ 1112.962266] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.967760] netif_set_threaded+0x257/0x400
[ 1112.973254] threaded_store+0x1b8/0x220
[ 1112.978356] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.983657] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.988952] ? sysfs_kf_write+0x65/0x160
[ 1112.994155] ? sysfs_file_ops+0x140/0x140
[ 1112.994159] kernfs_fop_write_iter+0x335/0x510
[ 1112.994163] ? kernfs_ops+0xf0/0xf0
[ 1112.994166] new_sync_write+0x333/0x750
[ 1112.994170] ? __lock_acquire+0x508/0xc10
[ 1113.020361] ? new_sync_read+0x740/0x740
[ 1113.025564] ? lock_acquire.part.0+0xbc/0x260
[ 1113.031251] ? ksys_write+0x116/0x250
[ 1113.036151] vfs_write+0x657/0x9b0
[ 1113.040768] ksys_write+0x116/0x250
[ 1113.045480] ? __ia32_sys_read+0xc0/0xc0
[ 1113.050674] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.056264] ? rcu_is_watching+0x15/0xd0
[ 1113.061454] do_syscall_64+0xf3/0x650
[ 1113.066359] ? trace_hardirqs_off+0xd/0x30
[ 1113.071753] ? exc_page_fault+0xda/0xf0
[ 1113.076846] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.083315] RIP: 0033:0x7f136862f22e
[ 1113.088125] RSP: 002b:00007ffee888e7e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.097414] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f136862f22e
[ 1113.106230] RDX: 0000000000000001 RSI: 0000564e10d28410 RDI: 0000000000000007
[ 1113.115038] RBP: 00007ffee888e7f0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.123839] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f13684a7390
[ 1113.132651] R13: 0000564e10d28410 R14: 0000000000000007 R15: 0000000000000003
[ 1113.141464]
[ 1113.144727] \x0aShowing all locks held in the system:
[ 1113.153268] 1 lock held by khungtaskd/184:
[ 1113.158660] #0: ffffffff888fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.170136] 3 locks held by systemd-journal/808:
[ 1113.176118] #0: ff1100180dc372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1113.186008] #1: ffffffff88b030a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.198825] #2: ff110001a62e89c0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1113.210383] 4 locks held by python3/3774:
[ 1113.215679] #0: ff110017d9f113e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.225569] #1: ff1100013e219a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.236530] #2: ff11000123a1ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.247687] #3: ff11000123b19d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.257785] 4 locks held by python3/5860:
[ 1113.263079] #0: ff110017d9f113e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.272971] #1: ff1100020ff54480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.283931] #2: ff11000123a1ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.295079] #3: ff11000123b19d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.305159] 5 locks held by (systemd-user-)/6921:
[ 1113.311235] #0: ff110001300393e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.321124] #1: ff110001c337a080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.332087] #2: ffffffff88969c20 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1113.342757] #3: ffffffff88768970 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x6b0
[ 1113.354392] #4: ffffffff88969990 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x6b0
[ 1113.366813]
[ 1113.369279] =============================================\x0a
[ 1211.404088] kworker/u130:4 (530) used greatest stack depth: 21456 bytes left
[ 1235.467351] INFO: task python3:5860 blocked for more than 368 seconds.
[ 1235.475498] Not tainted 7.1.0-rc1-rxju-gf1f21b098513 #1
[ 1235.482749] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.492335] task:python3 state:D stack:25672 pid:5860 tgid:5860 ppid:5859 task_flags:0x400100 flags:0x00080002
[ 1235.505539] Call Trace:
[ 1235.509079]
[ 1235.512227] __schedule+0xcba/0x1940
[ 1235.517041] ? io_schedule_timeout+0x140/0x140
[ 1235.522828] ? find_held_lock+0x2b/0x80
[ 1235.527930] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.533814] schedule+0xd4/0x260
[ 1235.538230] schedule_preempt_disabled+0x18/0x30
[ 1235.544207] __mutex_lock+0x6a3/0x2000
[ 1235.549210] ? threaded_store+0x132/0x220
[ 1235.554509] ? ww_mutex_lock+0x160/0x160
[ 1235.559699] ? selinux_inode_free_security+0x330/0x330
[ 1235.566268] ? cap_capable+0x1d6/0x3e0
[ 1235.571272] ? threaded_store+0x132/0x220
[ 1235.576566] threaded_store+0x132/0x220
[ 1235.581667] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.586961] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.592260] ? sysfs_kf_write+0x65/0x160
[ 1235.597460] ? sysfs_file_ops+0x140/0x140
[ 1235.602745] kernfs_fop_write_iter+0x335/0x510
[ 1235.608527] ? kernfs_ops+0xf0/0xf0
[ 1235.613236] new_sync_write+0x333/0x750
[ 1235.618338] ? __lock_acquire+0x508/0xc10
[ 1235.623635] ? new_sync_read+0x740/0x740
[ 1235.628825] ? lock_acquire.part.0+0xbc/0x260
[ 1235.634512] ? ksys_write+0x116/0x250
[ 1235.639422] vfs_write+0x657/0x9b0
[ 1235.644035] ksys_write+0x116/0x250
[ 1235.648746] ? __ia32_sys_read+0xc0/0xc0
[ 1235.653944] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.659532] ? rcu_is_watching+0x15/0xd0
[ 1235.664735] do_syscall_64+0xf3/0x650
[ 1235.669640] ? trace_hardirqs_off+0xd/0x30
[ 1235.675032] ? exc_page_fault+0xda/0xf0
[ 1235.680136] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.686603] RIP: 0033:0x7f1c345be22e
[ 1235.691401] RSP: 002b:00007ffe45996450 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.700698] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1c345be22e
[ 1235.709504] RDX: 0000000000000001 RSI: 0000556ad0c06410 RDI: 0000000000000007
[ 1235.718310] RBP: 00007ffe45996460 R08: 0000000000000000 R09: 0000000000000000
[ 1235.727115] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1c34436390
[ 1235.735922] R13: 0000556ad0c06410 R14: 0000000000000007 R15: 0000000000000003
[ 1235.744733]
[ 1235.748011] INFO: task python3:5860 is blocked on a mutex likely owned by task python3:3774.
[ 1235.758284] task:python3 state:D stack:25672 pid:3774 tgid:3774 ppid:3773 task_flags:0x400100 flags:0x00080802
[ 1235.771486] Call Trace:
[ 1235.775022]
[ 1235.778170] __schedule+0xcba/0x1940
[ 1235.782979] ? io_schedule_timeout+0x140/0x140
[ 1235.788761] ? find_held_lock+0x2b/0x80
[ 1235.793863] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.800042] schedule+0xd4/0x260
[ 1235.804459] schedule_timeout+0x13f/0x290
[ 1235.809753] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.816122] ? trace_contention_end+0xb3/0x1a0
[ 1235.821906] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.827594] ? ww_mutex_lock+0x160/0x160
[ 1235.832792] msleep+0x1b/0x30
[ 1235.836916] napi_set_threaded+0x3a5/0x440
[ 1235.842312] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.847799] netif_set_threaded+0x257/0x400
[ 1235.853291] threaded_store+0x1b8/0x220
[ 1235.858393] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.863691] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.868984] ? sysfs_kf_write+0x65/0x160
[ 1235.874181] ? sysfs_file_ops+0x140/0x140
[ 1235.879477] kernfs_fop_write_iter+0x335/0x510
[ 1235.885257] ? kernfs_ops+0xf0/0xf0
[ 1235.889967] new_sync_write+0x333/0x750
[ 1235.895068] ? __lock_acquire+0x508/0xc10
[ 1235.900364] ? new_sync_read+0x740/0x740
[ 1235.905565] ? lock_acquire.part.0+0xbc/0x260
[ 1235.911241] ? ksys_write+0x116/0x250
[ 1235.916148] vfs_write+0x657/0x9b0
[ 1235.920762] ksys_write+0x116/0x250
[ 1235.925474] ? __ia32_sys_read+0xc0/0xc0
[ 1235.930667] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.936252] ? rcu_is_watching+0x15/0xd0
[ 1235.941451] do_syscall_64+0xf3/0x650
[ 1235.946355] ? trace_hardirqs_off+0xd/0x30
[ 1235.951748] ? exc_page_fault+0xda/0xf0
[ 1235.956849] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.963317] RIP: 0033:0x7f136862f22e
[ 1235.968115] RSP: 002b:00007ffee888e7e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.977411] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f136862f22e
[ 1235.986208] RDX: 0000000000000001 RSI: 0000564e10d28410 RDI: 0000000000000007
[ 1235.995013] RBP: 00007ffee888e7f0 R08: 0000000000000000 R09: 0000000000000000
[ 1236.003822] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f13684a7390
[ 1236.012628] R13: 0000564e10d28410 R14: 0000000000000007 R15: 0000000000000003
[ 1236.021441]
[ 1236.024701] \x0aShowing all locks held in the system:
[ 1236.033235] 1 lock held by khungtaskd/184:
[ 1236.038627] #0: ffffffff888fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.050108] 4 locks held by python3/3774:
[ 1236.055404] #0: ff110017d9f113e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.065293] #1: ff1100013e219a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.076254] #2: ff11000123a1ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.087401] #3: ff11000123b19d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.097490] 4 locks held by python3/5860:
[ 1236.102783] #0: ff110017d9f113e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.112668] #1: ff1100020ff54480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.123626] #2: ff11000123a1ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.134783] #3: ff11000123b19d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.144862]
[ 1236.147329] =============================================\x0a
[ 1358.348572] INFO: task python3:5860 blocked for more than 491 seconds.
[ 1358.356724] Not tainted 7.1.0-rc1-rxju-gf1f21b098513 #1
[ 1358.356727] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.356729] task:python3 state:D stack:25672 pid:5860 tgid:5860 ppid:5859 task_flags:0x400100 flags:0x00080002
[ 1358.386767] Call Trace:
[ 1358.390309]
[ 1358.393460] __schedule+0xcba/0x1940
[ 1358.398276] ? io_schedule_timeout+0x140/0x140
[ 1358.404061] ? find_held_lock+0x2b/0x80
[ 1358.409165] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.415052] schedule+0xd4/0x260
[ 1358.419471] schedule_preempt_disabled+0x18/0x30
[ 1358.425451] __mutex_lock+0x6a3/0x2000
[ 1358.430447] ? threaded_store+0x132/0x220
[ 1358.435747] ? ww_mutex_lock+0x160/0x160
[ 1358.440949] ? selinux_inode_free_security+0x330/0x330
[ 1358.447521] ? cap_capable+0x1d6/0x3e0
[ 1358.452530] ? threaded_store+0x132/0x220
[ 1358.457826] threaded_store+0x132/0x220
[ 1358.462931] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.468233] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.473530] ? sysfs_kf_write+0x65/0x160
[ 1358.478729] ? sysfs_file_ops+0x140/0x140
[ 1358.484027] kernfs_fop_write_iter+0x335/0x510
[ 1358.489811] ? kernfs_ops+0xf0/0xf0
[ 1358.494523] new_sync_write+0x333/0x750
[ 1358.499629] ? __lock_acquire+0x508/0xc10
[ 1358.504926] ? new_sync_read+0x740/0x740
[ 1358.510121] ? lock_acquire.part.0+0xbc/0x260
[ 1358.515807] ? ksys_write+0x116/0x250
[ 1358.520719] vfs_write+0x657/0x9b0
[ 1358.525333] ksys_write+0x116/0x250
[ 1358.530048] ? __ia32_sys_read+0xc0/0xc0
[ 1358.535247] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.540834] ? rcu_is_watching+0x15/0xd0
[ 1358.546037] do_syscall_64+0xf3/0x650
[ 1358.550944] ? trace_hardirqs_off+0xd/0x30
[ 1358.556341] ? exc_page_fault+0xda/0xf0
[ 1358.561445] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.567912] RIP: 0033:0x7f1c345be22e
[ 1358.572725] RSP: 002b:00007ffe45996450 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.582025] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1c345be22e
[ 1358.590832] RDX: 0000000000000001 RSI: 0000556ad0c06410 RDI: 0000000000000007
[ 1358.599640] RBP: 00007ffe45996460 R08: 0000000000000000 R09: 0000000000000000
[ 1358.608439] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1c34436390
[ 1358.617246] R13: 0000556ad0c06410 R14: 0000000000000007 R15: 0000000000000003
[ 1358.626061]
[ 1358.629355] INFO: task python3:5860 is blocked on a mutex likely owned by task python3:3774.
[ 1358.639628] task:python3 state:D stack:25672 pid:3774 tgid:3774 ppid:3773 task_flags:0x400100 flags:0x00080802
[ 1358.652830] Call Trace:
[ 1358.656370]
[ 1358.659522] __schedule+0xcba/0x1940
[ 1358.664332] ? io_schedule_timeout+0x140/0x140
[ 1358.670110] ? find_held_lock+0x2b/0x80
[ 1358.675216] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.681395] schedule+0xd4/0x260
[ 1358.685814] schedule_timeout+0x13f/0x290
[ 1358.691113] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.697484] ? trace_contention_end+0xb3/0x1a0
[ 1358.703267] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.708959] ? ww_mutex_lock+0x160/0x160
[ 1358.714160] msleep+0x1b/0x30
[ 1358.718287] napi_set_threaded+0x3a5/0x440
[ 1358.723674] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.729169] netif_set_threaded+0x257/0x400
[ 1358.734663] threaded_store+0x1b8/0x220
[ 1358.739766] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.745056] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.750351] ? sysfs_kf_write+0x65/0x160
[ 1358.755552] ? sysfs_file_ops+0x140/0x140
[ 1358.760841] kernfs_fop_write_iter+0x335/0x510
[ 1358.766614] ? kernfs_ops+0xf0/0xf0
[ 1358.771328] new_sync_write+0x333/0x750
[ 1358.776432] ? __lock_acquire+0x508/0xc10
[ 1358.781729] ? new_sync_read+0x740/0x740
[ 1358.786919] ? lock_acquire.part.0+0xbc/0x260
[ 1358.792607] ? ksys_write+0x116/0x250
[ 1358.797519] vfs_write+0x657/0x9b0
[ 1358.802134] ksys_write+0x116/0x250
[ 1358.806849] ? __ia32_sys_read+0xc0/0xc0
[ 1358.812047] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.817636] ? rcu_is_watching+0x15/0xd0
[ 1358.822836] do_syscall_64+0xf3/0x650
[ 1358.827742] ? trace_hardirqs_off+0xd/0x30
[ 1358.833136] ? exc_page_fault+0xda/0xf0
[ 1358.838241] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.844710] RIP: 0033:0x7f136862f22e
[ 1358.849519] RSP: 002b:00007ffee888e7e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.858810] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f136862f22e
[ 1358.867620] RDX: 0000000000000001 RSI: 0000564e10d28410 RDI: 0000000000000007
[ 1358.876429] RBP: 00007ffee888e7f0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.885236] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f13684a7390
[ 1358.894045] R13: 0000564e10d28410 R14: 0000000000000007 R15: 0000000000000003
[ 1358.902857]
[ 1358.906125] \x0aShowing all locks held in the system:
[ 1358.914665] 1 lock held by khungtaskd/184:
[ 1358.920059] #0: ffffffff888fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.931531] 2 locks held by systemd-journal/808:
[ 1358.937513] #0: ff1100180e3b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1358.947394] #1: ffffffff88b030a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.960221] 4 locks held by python3/3774:
[ 1358.965515] #0: ff110017d9f113e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.975405] #1: ff1100013e219a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.986370] #2: ff11000123a1ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.997527] #3: ff11000123b19d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.007626] 4 locks held by python3/5860:
[ 1359.012914] #0: ff110017d9f113e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.022804] #1: ff1100020ff54480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.033765] #2: ff11000123a1ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.044922] #3: ff11000123b19d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.055004] 5 locks held by (systemd-user-)/7721:
[ 1359.061071] #0: ff110001300393e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.070962] #1: ff1100014c616e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.081926] #2: ffffffff88969c20 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1359.092597] #3: ffffffff88768970 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x6b0
[ 1359.104240] #4: ffffffff88969990 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x6b0
[ 1359.116669]
[ 1359.119136] =============================================\x0a