[ 760.670723] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 760.673283] nipa-hw-worker: [4/37] Retrying drivers/net:napi_threaded.py
[ 760.807505] kselftest: Running tests in drivers/net
[ 989.731606] INFO: task python3:5058 blocked for more than 122 seconds.
[ 989.739827] Not tainted 7.0.0-rc5-cbrs-gb69a28fa4ed1 #1
[ 989.747077] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.756665] task:python3 state:D stack:25312 pid:5058 tgid:5058 ppid:5057 task_flags:0x400100 flags:0x00080000
[ 989.769861] Call Trace:
[ 989.773401]
[ 989.776552] __schedule+0xad9/0x1490
[ 989.781366] ? io_schedule_timeout+0x130/0x130
[ 989.787143] ? find_held_lock+0x2b/0x80
[ 989.792248] ? __lock_release.isra.0+0x59/0x170
[ 989.798135] schedule+0xd4/0x260
[ 989.802553] schedule_preempt_disabled+0x18/0x30
[ 989.808532] __mutex_lock+0xd76/0x1f20
[ 989.813537] ? threaded_store+0x132/0x220
[ 989.818838] ? ww_mutex_lock+0x160/0x160
[ 989.824036] ? selinux_inode_free_security+0x310/0x310
[ 989.830608] ? cap_capable+0x1ed/0x3f0
[ 989.835613] ? sysfs_file_ops+0x140/0x140
[ 989.840909] ? threaded_store+0x132/0x220
[ 989.846206] threaded_store+0x132/0x220
[ 989.851308] ? tx_maxrate_store+0x4e0/0x4e0
[ 989.856801] ? sysfs_file_ops+0x140/0x140
[ 989.862098] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.867385] ? sysfs_kf_write+0x65/0x160
[ 989.872583] kernfs_fop_write_iter+0x335/0x510
[ 989.878368] ? kernfs_ops+0xf0/0xf0
[ 989.883068] new_sync_write+0x308/0x6f0
[ 989.888171] ? new_sync_read+0x6f0/0x6f0
[ 989.893369] ? lock_acquire.part.0+0xbc/0x260
[ 989.899055] ? ksys_write+0xff/0x200
[ 989.903868] vfs_write+0x62a/0x980
[ 989.908483] ksys_write+0xff/0x200
[ 989.913086] ? __ia32_sys_read+0xc0/0xc0
[ 989.918281] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.923871] ? rcu_is_watching+0x15/0xd0
[ 989.929074] do_syscall_64+0xf3/0x5e0
[ 989.933981] ? exc_page_fault+0x9e/0xb0
[ 989.939080] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.945549] RIP: 0033:0x7f4b24720c5e
[ 989.950356] RSP: 002b:00007ffc2ac41cc0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.959654] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4b24720c5e
[ 989.968454] RDX: 0000000000000001 RSI: 000055b1a0c2f110 RDI: 0000000000000007
[ 989.977262] RBP: 00007ffc2ac41cd0 R08: 0000000000000000 R09: 0000000000000000
[ 989.986070] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4b245bbe80
[ 989.994878] R13: 000055b1a0c2f110 R14: 0000000000000007 R15: 00007f4b24e21b98
[ 990.003694]
[ 990.006971] INFO: task python3:5058 is blocked on a mutex likely owned by task python3:3107.
[ 990.017252] task:python3 state:D stack:25312 pid:3107 tgid:3107 ppid:3106 task_flags:0x400100 flags:0x00080802
[ 990.030454] Call Trace:
[ 990.033991]
[ 990.037141] __schedule+0xad9/0x1490
[ 990.041942] ? io_schedule_timeout+0x130/0x130
[ 990.047726] ? find_held_lock+0x2b/0x80
[ 990.052829] ? __try_to_del_timer_sync+0x154/0x1f0
[ 990.059006] schedule+0xd4/0x260
[ 990.063422] schedule_timeout+0x103/0x260
[ 990.068718] ? rcu_is_watching+0x15/0xd0
[ 990.073918] ? hrtimer_nanosleep_restart+0x180/0x180
[ 990.080289] ? hrtimers_cpu_dying+0x250/0x250
[ 990.085970] ? ww_mutex_lock+0x160/0x160
[ 990.091168] msleep+0x1b/0x30
[ 990.095293] napi_set_threaded+0x376/0x410
[ 990.100687] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.106183] netif_set_threaded+0x254/0x400
[ 990.111676] ? sysfs_file_ops+0x140/0x140
[ 990.116970] threaded_store+0x1bb/0x220
[ 990.122072] ? tx_maxrate_store+0x4e0/0x4e0
[ 990.127565] ? sysfs_file_ops+0x140/0x140
[ 990.132851] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.138148] ? sysfs_kf_write+0x65/0x160
[ 990.143348] kernfs_fop_write_iter+0x335/0x510
[ 990.149131] ? kernfs_ops+0xf0/0xf0
[ 990.153843] new_sync_write+0x308/0x6f0
[ 990.158947] ? new_sync_read+0x6f0/0x6f0
[ 990.164146] ? lock_acquire.part.0+0xbc/0x260
[ 990.169830] ? ksys_write+0xff/0x200
[ 990.174640] vfs_write+0x62a/0x980
[ 990.179254] ksys_write+0xff/0x200
[ 990.183865] ? __ia32_sys_read+0xc0/0xc0
[ 990.189064] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.194655] ? rcu_is_watching+0x15/0xd0
[ 990.199852] do_syscall_64+0xf3/0x5e0
[ 990.204756] ? irq_exit_rcu+0x39/0xf0
[ 990.209663] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.216128] RIP: 0033:0x7f89c39fbc5e
[ 990.220935] RSP: 002b:00007ffe73ed9080 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.230230] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f89c39fbc5e
[ 990.239038] RDX: 0000000000000001 RSI: 000055cc95afd110 RDI: 0000000000000007
[ 990.247847] RBP: 00007ffe73ed9090 R08: 0000000000000000 R09: 0000000000000000
[ 990.256656] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f89c3896e80
[ 990.265460] R13: 000055cc95afd110 R14: 0000000000000007 R15: 00007f89c3826480
[ 990.274272]
[ 990.277530] \x0aShowing all locks held in the system:
[ 990.286061] 1 lock held by khungtaskd/185:
[ 990.291455] #0: ffffffffa30ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.302940] 4 locks held by python3/3107:
[ 990.308236] #0: ff1100012decc3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.318027] #1: ff1100013dbc8888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.328981] #2: ff110001209710f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.340138] #3: ff110001209f1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.350225] 4 locks held by python3/5058:
[ 990.355521] #0: ff1100012decc3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 990.365310] #1: ff1100019d8bf488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 990.376269] #2: ff110001209710f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.387426] #3: ff110001209f1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.397518]
[ 990.399983] =============================================\x0a
[ 1112.613887] INFO: task python3:5058 blocked for more than 245 seconds.
[ 1112.622032] Not tainted 7.0.0-rc5-cbrs-gb69a28fa4ed1 #1
[ 1112.629282] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.638874] task:python3 state:D stack:25312 pid:5058 tgid:5058 ppid:5057 task_flags:0x400100 flags:0x00080000
[ 1112.652081] Call Trace:
[ 1112.655621]
[ 1112.658771] __schedule+0xad9/0x1490
[ 1112.663588] ? io_schedule_timeout+0x130/0x130
[ 1112.669375] ? find_held_lock+0x2b/0x80
[ 1112.674482] ? __lock_release.isra.0+0x59/0x170
[ 1112.680367] schedule+0xd4/0x260
[ 1112.684788] schedule_preempt_disabled+0x18/0x30
[ 1112.690769] __mutex_lock+0xd76/0x1f20
[ 1112.695777] ? threaded_store+0x132/0x220
[ 1112.701076] ? ww_mutex_lock+0x160/0x160
[ 1112.706273] ? selinux_inode_free_security+0x310/0x310
[ 1112.712834] ? cap_capable+0x1ed/0x3f0
[ 1112.717843] ? sysfs_file_ops+0x140/0x140
[ 1112.723144] ? threaded_store+0x132/0x220
[ 1112.728442] threaded_store+0x132/0x220
[ 1112.733548] ? tx_maxrate_store+0x4e0/0x4e0
[ 1112.739041] ? sysfs_file_ops+0x140/0x140
[ 1112.744330] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.749626] ? sysfs_kf_write+0x65/0x160
[ 1112.754827] kernfs_fop_write_iter+0x335/0x510
[ 1112.760614] ? kernfs_ops+0xf0/0xf0
[ 1112.765326] new_sync_write+0x308/0x6f0
[ 1112.770424] ? new_sync_read+0x6f0/0x6f0
[ 1112.775626] ? lock_acquire.part.0+0xbc/0x260
[ 1112.781312] ? ksys_write+0xff/0x200
[ 1112.786124] vfs_write+0x62a/0x980
[ 1112.790738] ksys_write+0xff/0x200
[ 1112.795350] ? __ia32_sys_read+0xc0/0xc0
[ 1112.800550] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.806132] ? rcu_is_watching+0x15/0xd0
[ 1112.811334] do_syscall_64+0xf3/0x5e0
[ 1112.816242] ? exc_page_fault+0x9e/0xb0
[ 1112.821345] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.827816] RIP: 0033:0x7f4b24720c5e
[ 1112.832626] RSP: 002b:00007ffc2ac41cc0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.841916] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4b24720c5e
[ 1112.850731] RDX: 0000000000000001 RSI: 000055b1a0c2f110 RDI: 0000000000000007
[ 1112.859541] RBP: 00007ffc2ac41cd0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.868349] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4b245bbe80
[ 1112.877159] R13: 000055b1a0c2f110 R14: 0000000000000007 R15: 00007f4b24e21b98
[ 1112.885976]
[ 1112.889238] INFO: task python3:5058 is blocked on a mutex likely owned by task python3:3107.
[ 1112.899511] task:python3 state:D stack:25312 pid:3107 tgid:3107 ppid:3106 task_flags:0x400100 flags:0x00080802
[ 1112.912716] Call Trace:
[ 1112.916257]
[ 1112.919406] __schedule+0xad9/0x1490
[ 1112.924219] ? io_schedule_timeout+0x130/0x130
[ 1112.930000] ? find_held_lock+0x2b/0x80
[ 1112.935105] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1112.941284] schedule+0xd4/0x260
[ 1112.945701] schedule_timeout+0x103/0x260
[ 1112.950998] ? rcu_is_watching+0x15/0xd0
[ 1112.956199] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1112.962571] ? hrtimers_cpu_dying+0x250/0x250
[ 1112.968262] ? ww_mutex_lock+0x160/0x160
[ 1112.973461] msleep+0x1b/0x30
[ 1112.977587] napi_set_threaded+0x376/0x410
[ 1112.982984] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.988478] netif_set_threaded+0x254/0x400
[ 1112.993971] ? sysfs_file_ops+0x140/0x140
[ 1112.999267] threaded_store+0x1bb/0x220
[ 1113.004371] ? tx_maxrate_store+0x4e0/0x4e0
[ 1113.009861] ? sysfs_file_ops+0x140/0x140
[ 1113.015158] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.020457] ? sysfs_kf_write+0x65/0x160
[ 1113.025657] kernfs_fop_write_iter+0x335/0x510
[ 1113.031436] ? kernfs_ops+0xf0/0xf0
[ 1113.036150] new_sync_write+0x308/0x6f0
[ 1113.041255] ? new_sync_read+0x6f0/0x6f0
[ 1113.046455] ? lock_acquire.part.0+0xbc/0x260
[ 1113.052141] ? ksys_write+0xff/0x200
[ 1113.056955] vfs_write+0x62a/0x980
[ 1113.061572] ksys_write+0xff/0x200
[ 1113.066188] ? __ia32_sys_read+0xc0/0xc0
[ 1113.071387] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.076978] ? rcu_is_watching+0x15/0xd0
[ 1113.082180] do_syscall_64+0xf3/0x5e0
[ 1113.087087] ? irq_exit_rcu+0x39/0xf0
[ 1113.091998] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.098467] RIP: 0033:0x7f89c39fbc5e
[ 1113.103277] RSP: 002b:00007ffe73ed9080 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.112575] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f89c39fbc5e
[ 1113.121385] RDX: 0000000000000001 RSI: 000055cc95afd110 RDI: 0000000000000007
[ 1113.130193] RBP: 00007ffe73ed9090 R08: 0000000000000000 R09: 0000000000000000
[ 1113.139003] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f89c3896e80
[ 1113.147811] R13: 000055cc95afd110 R14: 0000000000000007 R15: 00007f89c3826480
[ 1113.156618]
[ 1113.159881] \x0aShowing all locks held in the system:
[ 1113.168419] 1 lock held by khungtaskd/185:
[ 1113.173813] #0: ffffffffa30ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.185296] 4 locks held by python3/3107:
[ 1113.190591] #0: ff1100012decc3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.200383] #1: ff1100013dbc8888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.211341] #2: ff110001209710f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.222501] #3: ff110001209f1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.232592] 4 locks held by python3/5058:
[ 1113.237879] #0: ff1100012decc3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1113.247671] #1: ff1100019d8bf488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1113.258632] #2: ff110001209710f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.269791] #3: ff110001209f1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.279884]
[ 1113.282352] =============================================\x0a
[ 1235.495171] INFO: task python3:5058 blocked for more than 368 seconds.
[ 1235.503317] Not tainted 7.0.0-rc5-cbrs-gb69a28fa4ed1 #1
[ 1235.510558] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.520148] task:python3 state:D stack:25312 pid:5058 tgid:5058 ppid:5057 task_flags:0x400100 flags:0x00080002
[ 1235.533355] Call Trace:
[ 1235.536897]
[ 1235.540039] __schedule+0xad9/0x1490
[ 1235.544857] ? io_schedule_timeout+0x130/0x130
[ 1235.550644] ? find_held_lock+0x2b/0x80
[ 1235.555750] ? __lock_release.isra.0+0x59/0x170
[ 1235.561636] schedule+0xd4/0x260
[ 1235.566054] schedule_preempt_disabled+0x18/0x30
[ 1235.572036] __mutex_lock+0xd76/0x1f20
[ 1235.577045] ? threaded_store+0x132/0x220
[ 1235.582344] ? ww_mutex_lock+0x160/0x160
[ 1235.587544] ? selinux_inode_free_security+0x310/0x310
[ 1235.594114] ? cap_capable+0x1ed/0x3f0
[ 1235.599122] ? sysfs_file_ops+0x140/0x140
[ 1235.604423] ? threaded_store+0x132/0x220
[ 1235.609722] threaded_store+0x132/0x220
[ 1235.614828] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.620325] ? sysfs_file_ops+0x140/0x140
[ 1235.625624] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.630923] ? sysfs_kf_write+0x65/0x160
[ 1235.636123] kernfs_fop_write_iter+0x335/0x510
[ 1235.641900] ? kernfs_ops+0xf0/0xf0
[ 1235.646613] new_sync_write+0x308/0x6f0
[ 1235.651719] ? new_sync_read+0x6f0/0x6f0
[ 1235.656921] ? lock_acquire.part.0+0xbc/0x260
[ 1235.662606] ? ksys_write+0xff/0x200
[ 1235.667419] vfs_write+0x62a/0x980
[ 1235.672038] ksys_write+0xff/0x200
[ 1235.676651] ? __ia32_sys_read+0xc0/0xc0
[ 1235.681852] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.687443] ? rcu_is_watching+0x15/0xd0
[ 1235.692644] do_syscall_64+0xf3/0x5e0
[ 1235.697553] ? exc_page_fault+0x9e/0xb0
[ 1235.702656] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.709125] RIP: 0033:0x7f4b24720c5e
[ 1235.713935] RSP: 002b:00007ffc2ac41cc0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.723225] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4b24720c5e
[ 1235.732031] RDX: 0000000000000001 RSI: 000055b1a0c2f110 RDI: 0000000000000007
[ 1235.740841] RBP: 00007ffc2ac41cd0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.749649] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4b245bbe80
[ 1235.758458] R13: 000055b1a0c2f110 R14: 0000000000000007 R15: 00007f4b24e21b98
[ 1235.767273]
[ 1235.770541] INFO: task python3:5058 is blocked on a mutex likely owned by task python3:3107.
[ 1235.780816] task:python3 state:D stack:25312 pid:3107 tgid:3107 ppid:3106 task_flags:0x400100 flags:0x00080802
[ 1235.794019] Call Trace:
[ 1235.797557]
[ 1235.800709] __schedule+0xad9/0x1490
[ 1235.805519] ? io_schedule_timeout+0x130/0x130
[ 1235.811294] ? find_held_lock+0x2b/0x80
[ 1235.816400] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1235.822579] schedule+0xd4/0x260
[ 1235.827000] schedule_timeout+0x103/0x260
[ 1235.832300] ? rcu_is_watching+0x15/0xd0
[ 1235.837501] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1235.843873] ? hrtimers_cpu_dying+0x250/0x250
[ 1235.849563] ? ww_mutex_lock+0x160/0x160
[ 1235.854763] msleep+0x1b/0x30
[ 1235.858880] napi_set_threaded+0x376/0x410
[ 1235.864273] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.869769] netif_set_threaded+0x254/0x400
[ 1235.875263] ? sysfs_file_ops+0x140/0x140
[ 1235.880561] threaded_store+0x1bb/0x220
[ 1235.885664] ? tx_maxrate_store+0x4e0/0x4e0
[ 1235.891157] ? sysfs_file_ops+0x140/0x140
[ 1235.896453] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.901752] ? sysfs_kf_write+0x65/0x160
[ 1235.906952] kernfs_fop_write_iter+0x335/0x510
[ 1235.912727] ? kernfs_ops+0xf0/0xf0
[ 1235.917438] new_sync_write+0x308/0x6f0
[ 1235.922542] ? new_sync_read+0x6f0/0x6f0
[ 1235.927742] ? lock_acquire.part.0+0xbc/0x260
[ 1235.933421] ? ksys_write+0xff/0x200
[ 1235.938233] vfs_write+0x62a/0x980
[ 1235.942850] ksys_write+0xff/0x200
[ 1235.947465] ? __ia32_sys_read+0xc0/0xc0
[ 1235.952666] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.958257] ? rcu_is_watching+0x15/0xd0
[ 1235.963456] do_syscall_64+0xf3/0x5e0
[ 1235.968365] ? irq_exit_rcu+0x39/0xf0
[ 1235.973271] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.979742] RIP: 0033:0x7f89c39fbc5e
[ 1235.984549] RSP: 002b:00007ffe73ed9080 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.993845] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f89c39fbc5e
[ 1236.002644] RDX: 0000000000000001 RSI: 000055cc95afd110 RDI: 0000000000000007
[ 1236.011452] RBP: 00007ffe73ed9090 R08: 0000000000000000 R09: 0000000000000000
[ 1236.020262] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f89c3896e80
[ 1236.029071] R13: 000055cc95afd110 R14: 0000000000000007 R15: 00007f89c3826480
[ 1236.037888]
[ 1236.041155] \x0aShowing all locks held in the system:
[ 1236.049693] 1 lock held by khungtaskd/185:
[ 1236.055087] #0: ffffffffa30ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.066558] 3 locks held by systemd-journal/805:
[ 1236.072536] #0: ff1100180deb72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18f/0x1490
[ 1236.082425] #1: ffffffffa32c91e0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.095243] #2: ff110001a2af7780 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0xf4/0x280
[ 1236.106702] 4 locks held by python3/3107:
[ 1236.111997] #0: ff1100012decc3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.121794] #1: ff1100013dbc8888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.132746] #2: ff110001209710f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.143905] #3: ff110001209f1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.154000] 4 locks held by python3/5058:
[ 1236.159298] #0: ff1100012decc3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1236.169087] #1: ff1100019d8bf488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1236.180048] #2: ff110001209710f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.191206] #3: ff110001209f1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.201298]
[ 1236.203762] =============================================\x0a
[ 1358.376447] INFO: task python3:5058 blocked for more than 491 seconds.
[ 1358.384596] Not tainted 7.0.0-rc5-cbrs-gb69a28fa4ed1 #1
[ 1358.391846] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.401433] task:python3 state:D stack:25312 pid:5058 tgid:5058 ppid:5057 task_flags:0x400100 flags:0x00080002
[ 1358.414638] Call Trace:
[ 1358.418178]
[ 1358.421328] __schedule+0xad9/0x1490
[ 1358.426142] ? io_schedule_timeout+0x130/0x130
[ 1358.431927] ? find_held_lock+0x2b/0x80
[ 1358.437034] ? __lock_release.isra.0+0x59/0x170
[ 1358.442916] schedule+0xd4/0x260
[ 1358.447335] schedule_preempt_disabled+0x18/0x30
[ 1358.453314] __mutex_lock+0xd76/0x1f20
[ 1358.458316] ? threaded_store+0x132/0x220
[ 1358.463614] ? ww_mutex_lock+0x160/0x160
[ 1358.468812] ? selinux_inode_free_security+0x310/0x310
[ 1358.475381] ? cap_capable+0x1ed/0x3f0
[ 1358.480387] ? sysfs_file_ops+0x140/0x140
[ 1358.485686] ? threaded_store+0x132/0x220
[ 1358.490974] threaded_store+0x132/0x220
[ 1358.496077] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.501569] ? sysfs_file_ops+0x140/0x140
[ 1358.506866] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.512160] ? sysfs_kf_write+0x65/0x160
[ 1358.517361] kernfs_fop_write_iter+0x335/0x510
[ 1358.523136] ? kernfs_ops+0xf0/0xf0
[ 1358.527848] new_sync_write+0x308/0x6f0
[ 1358.532944] ? new_sync_read+0x6f0/0x6f0
[ 1358.538145] ? lock_acquire.part.0+0xbc/0x260
[ 1358.543830] ? ksys_write+0xff/0x200
[ 1358.548640] vfs_write+0x62a/0x980
[ 1358.553244] ksys_write+0xff/0x200
[ 1358.557858] ? __ia32_sys_read+0xc0/0xc0
[ 1358.563057] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.568648] ? rcu_is_watching+0x15/0xd0
[ 1358.573847] do_syscall_64+0xf3/0x5e0
[ 1358.578755] ? exc_page_fault+0x9e/0xb0
[ 1358.583856] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.590325] RIP: 0033:0x7f4b24720c5e
[ 1358.595132] RSP: 002b:00007ffc2ac41cc0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.604429] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4b24720c5e
[ 1358.613235] RDX: 0000000000000001 RSI: 000055b1a0c2f110 RDI: 0000000000000007
[ 1358.622039] RBP: 00007ffc2ac41cd0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.630844] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4b245bbe80
[ 1358.639654] R13: 000055b1a0c2f110 R14: 0000000000000007 R15: 00007f4b24e21b98
[ 1358.648465]
[ 1358.651745] INFO: task python3:5058 is blocked on a mutex likely owned by task python3:3107.
[ 1358.662017] task:python3 state:D stack:25312 pid:3107 tgid:3107 ppid:3106 task_flags:0x400100 flags:0x00080802
[ 1358.675220] Call Trace:
[ 1358.678760]
[ 1358.681909] __schedule+0xad9/0x1490
[ 1358.686719] ? io_schedule_timeout+0x130/0x130
[ 1358.692502] ? find_held_lock+0x2b/0x80
[ 1358.697602] ? __try_to_del_timer_sync+0x154/0x1f0
[ 1358.703780] schedule+0xd4/0x260
[ 1358.708197] schedule_timeout+0x103/0x260
[ 1358.713493] ? rcu_is_watching+0x15/0xd0
[ 1358.718690] ? hrtimer_nanosleep_restart+0x180/0x180
[ 1358.725060] ? hrtimers_cpu_dying+0x250/0x250
[ 1358.730742] ? ww_mutex_lock+0x160/0x160
[ 1358.735942] msleep+0x1b/0x30
[ 1358.740068] napi_set_threaded+0x376/0x410
[ 1358.745461] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.750952] netif_set_threaded+0x254/0x400
[ 1358.756446] ? sysfs_file_ops+0x140/0x140
[ 1358.761741] threaded_store+0x1bb/0x220
[ 1358.766844] ? tx_maxrate_store+0x4e0/0x4e0
[ 1358.772325] ? sysfs_file_ops+0x140/0x140
[ 1358.777618] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.782913] ? sysfs_kf_write+0x65/0x160
[ 1358.788112] kernfs_fop_write_iter+0x335/0x510
[ 1358.793896] ? kernfs_ops+0xf0/0xf0
[ 1358.798604] new_sync_write+0x308/0x6f0
[ 1358.803706] ? new_sync_read+0x6f0/0x6f0
[ 1358.808904] ? lock_acquire.part.0+0xbc/0x260
[ 1358.814590] ? ksys_write+0xff/0x200
[ 1358.819401] vfs_write+0x62a/0x980
[ 1358.824016] ksys_write+0xff/0x200
[ 1358.828628] ? __ia32_sys_read+0xc0/0xc0
[ 1358.833826] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.839414] ? rcu_is_watching+0x15/0xd0
[ 1358.844613] do_syscall_64+0xf3/0x5e0
[ 1358.849517] ? irq_exit_rcu+0x39/0xf0
[ 1358.854424] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.860889] RIP: 0033:0x7f89c39fbc5e
[ 1358.865698] RSP: 002b:00007ffe73ed9080 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.874992] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f89c39fbc5e
[ 1358.883798] RDX: 0000000000000001 RSI: 000055cc95afd110 RDI: 0000000000000007
[ 1358.892603] RBP: 00007ffe73ed9090 R08: 0000000000000000 R09: 0000000000000000
[ 1358.901410] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f89c3896e80
[ 1358.910216] R13: 000055cc95afd110 R14: 0000000000000007 R15: 00007f89c3826480
[ 1358.919028]
[ 1358.922301] \x0aShowing all locks held in the system:
[ 1358.930835] 1 lock held by khungtaskd/185:
[ 1358.936227] #0: ffffffffa30ce120 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.947706] 4 locks held by python3/3107:
[ 1358.953002] #0: ff1100012decc3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1358.962791] #1: ff1100013dbc8888 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1358.973753] #2: ff110001209710f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.984909] #3: ff110001209f1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.995001] 4 locks held by python3/5058:
[ 1359.000294] #0: ff1100012decc3f8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0xff/0x200
[ 1359.010086] #1: ff1100019d8bf488 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x247/0x510
[ 1359.021045] #2: ff110001209710f0 (kn->active#127){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.032202] #3: ff110001209f1d00 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.042298]
[ 1359.044763] =============================================\x0a