[ 764.687931] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 764.690687] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 764.819411] kselftest: Running tests in drivers/net
[ 989.717623] INFO: task python3:5413 blocked for more than 122 seconds.
[ 989.725819] Not tainted 7.1.0-rc6-ohzb-g91a26bc64654 #1
[ 989.733498] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.743085] task:python3 state:D stack:25672 pid:5413 tgid:5413 ppid:5411 task_flags:0x400100 flags:0x00080000
[ 989.756291] Call Trace:
[ 989.759828]
[ 989.762978] __schedule+0xcc3/0x19c0
[ 989.767792] ? io_schedule_timeout+0x140/0x140
[ 989.773569] ? find_held_lock+0x2b/0x80
[ 989.778672] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.784558] schedule+0xd8/0x260
[ 989.788978] schedule_preempt_disabled+0x18/0x30
[ 989.794957] __mutex_lock+0x6af/0x2010
[ 989.799963] ? threaded_store+0x132/0x220
[ 989.805264] ? ww_mutex_lock+0x160/0x160
[ 989.810467] ? selinux_inode_free_security+0x330/0x330
[ 989.817035] ? cap_capable+0x1d6/0x3e0
[ 989.822044] ? threaded_store+0x132/0x220
[ 989.827338] threaded_store+0x132/0x220
[ 989.832440] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.837737] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.843036] ? sysfs_kf_write+0x65/0x160
[ 989.848236] ? sysfs_file_ops+0x140/0x140
[ 989.853531] kernfs_fop_write_iter+0x335/0x510
[ 989.859316] ? kernfs_ops+0xf0/0xf0
[ 989.864016] new_sync_write+0x333/0x750
[ 989.869118] ? __lock_acquire+0x508/0xc10
[ 989.874413] ? new_sync_read+0x740/0x740
[ 989.879614] ? lock_acquire.part.0+0xbc/0x260
[ 989.885299] ? ksys_write+0x116/0x250
[ 989.890207] vfs_write+0x657/0x9b0
[ 989.894812] ksys_write+0x116/0x250
[ 989.899524] ? __ia32_sys_read+0xc0/0xc0
[ 989.904722] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.910312] ? rcu_is_watching+0x15/0xd0
[ 989.915514] do_syscall_64+0xf3/0x650
[ 989.920419] ? trace_hardirqs_off+0xd/0x30
[ 989.925814] ? exc_page_fault+0xda/0xf0
[ 989.930915] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.937375] RIP: 0033:0x7f9fb36f764e
[ 989.942184] RSP: 002b:00007ffe8aadfd10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.951481] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9fb36f764e
[ 989.960290] RDX: 0000000000000001 RSI: 00005613e3524420 RDI: 0000000000000007
[ 989.969097] RBP: 00007ffe8aadfd20 R08: 0000000000000000 R09: 0000000000000000
[ 989.977907] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9fb3570390
[ 989.986714] R13: 00005613e3524420 R14: 0000000000000007 R15: 00007f9fb3505120
[ 989.995536]
[ 989.998862] INFO: task python3:5413 is blocked on a mutex likely owned by task python3:3411.
[ 990.009131] task:python3 state:D stack:25672 pid:3411 tgid:3411 ppid:3410 task_flags:0x400100 flags:0x00080802
[ 990.022333] Call Trace:
[ 990.025868]
[ 990.029017] __schedule+0xcc3/0x19c0
[ 990.033829] ? io_schedule_timeout+0x140/0x140
[ 990.039603] ? find_held_lock+0x2b/0x80
[ 990.044707] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.050882] schedule+0xd8/0x260
[ 990.055298] schedule_timeout+0x13f/0x290
[ 990.060593] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.066961] ? trace_contention_end+0xb3/0x1a0
[ 990.072743] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.078432] ? ww_mutex_lock+0x160/0x160
[ 990.083632] msleep+0x1b/0x30
[ 990.087749] napi_set_threaded+0x3a5/0x440
[ 990.093141] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.098636] netif_set_threaded+0x257/0x400
[ 990.104129] threaded_store+0x1b8/0x220
[ 990.109228] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.114525] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.119819] ? sysfs_kf_write+0x65/0x160
[ 990.125016] ? sysfs_file_ops+0x140/0x140
[ 990.130312] kernfs_fop_write_iter+0x335/0x510
[ 990.136096] ? kernfs_ops+0xf0/0xf0
[ 990.140805] new_sync_write+0x333/0x750
[ 990.145907] ? __lock_acquire+0x508/0xc10
[ 990.151200] ? new_sync_read+0x740/0x740
[ 990.156398] ? lock_acquire.part.0+0xbc/0x260
[ 990.162083] ? ksys_write+0x116/0x250
[ 990.166991] vfs_write+0x657/0x9b0
[ 990.171595] ksys_write+0x116/0x250
[ 990.176307] ? __ia32_sys_read+0xc0/0xc0
[ 990.181506] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.187094] ? rcu_is_watching+0x15/0xd0
[ 990.192292] do_syscall_64+0xf3/0x650
[ 990.197199] ? irq_exit_rcu+0x1a/0x30
[ 990.202096] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.208563] RIP: 0033:0x7fd085f1e64e
[ 990.213372] RSP: 002b:00007ffee26a80f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.222666] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd085f1e64e
[ 990.231477] RDX: 0000000000000001 RSI: 000055f8d7235420 RDI: 0000000000000007
[ 990.240283] RBP: 00007ffee26a8100 R08: 0000000000000000 R09: 0000000000000000
[ 990.249090] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd085d97390
[ 990.257898] R13: 000055f8d7235420 R14: 0000000000000007 R15: 00007fd085d2d120
[ 990.266712]
[ 990.269969] \x0aShowing all locks held in the system:
[ 990.278503] 1 lock held by khungtaskd/184:
[ 990.283895] #0: ffffffff98afdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.295367] 3 locks held by systemd-journal/806:
[ 990.301344] #0: ff1100180e6b74e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.311231] #1: ffffffff98d02ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: dput.part.0+0x2fd/0x410
[ 990.323460] #2: ff110001eba9e2e0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 990.335023] 4 locks held by python3/3411:
[ 990.340318] #0: ff1100012f1393e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.350206] #1: ff110001433aa080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.361175] #2: ff11000121abcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.372342] #3: ff11000121b39d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.382452] 4 locks held by python3/5413:
[ 990.387746] #0: ff1100012f1393e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.397634] #1: ff11000187f22080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.408596] #2: ff11000121abcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.419753] #3: ff11000121b39d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.429832]
[ 990.432298] =============================================\x0a
[ 1112.598905] INFO: task python3:5413 blocked for more than 245 seconds.
[ 1112.607177] Not tainted 7.1.0-rc6-ohzb-g91a26bc64654 #1
[ 1112.614448] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.624035] task:python3 state:D stack:25672 pid:5413 tgid:5413 ppid:5411 task_flags:0x400100 flags:0x00080000
[ 1112.637240] Call Trace:
[ 1112.640780]
[ 1112.643931] __schedule+0xcc3/0x19c0
[ 1112.648745] ? io_schedule_timeout+0x140/0x140
[ 1112.654530] ? find_held_lock+0x2b/0x80
[ 1112.659633] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.665518] schedule+0xd8/0x260
[ 1112.669934] schedule_preempt_disabled+0x18/0x30
[ 1112.676012] __mutex_lock+0x6af/0x2010
[ 1112.681017] ? threaded_store+0x132/0x220
[ 1112.686318] ? ww_mutex_lock+0x160/0x160
[ 1112.691527] ? selinux_inode_free_security+0x330/0x330
[ 1112.698094] ? cap_capable+0x1d6/0x3e0
[ 1112.703103] ? threaded_store+0x132/0x220
[ 1112.708399] threaded_store+0x132/0x220
[ 1112.713498] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.718792] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.724087] ? sysfs_kf_write+0x65/0x160
[ 1112.729286] ? sysfs_file_ops+0x140/0x140
[ 1112.734579] kernfs_fop_write_iter+0x335/0x510
[ 1112.740363] ? kernfs_ops+0xf0/0xf0
[ 1112.745073] new_sync_write+0x333/0x750
[ 1112.750175] ? __lock_acquire+0x508/0xc10
[ 1112.755470] ? new_sync_read+0x740/0x740
[ 1112.760669] ? lock_acquire.part.0+0xbc/0x260
[ 1112.766353] ? ksys_write+0x116/0x250
[ 1112.771261] vfs_write+0x657/0x9b0
[ 1112.775876] ksys_write+0x116/0x250
[ 1112.780580] ? __ia32_sys_read+0xc0/0xc0
[ 1112.785767] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.791353] ? rcu_is_watching+0x15/0xd0
[ 1112.796553] do_syscall_64+0xf3/0x650
[ 1112.801456] ? trace_hardirqs_off+0xd/0x30
[ 1112.806851] ? exc_page_fault+0xda/0xf0
[ 1112.811953] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.818413] RIP: 0033:0x7f9fb36f764e
[ 1112.823223] RSP: 002b:00007ffe8aadfd10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.832512] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9fb36f764e
[ 1112.841317] RDX: 0000000000000001 RSI: 00005613e3524420 RDI: 0000000000000007
[ 1112.850124] RBP: 00007ffe8aadfd20 R08: 0000000000000000 R09: 0000000000000000
[ 1112.858930] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9fb3570390
[ 1112.867734] R13: 00005613e3524420 R14: 0000000000000007 R15: 00007f9fb3505120
[ 1112.876547]
[ 1112.879848] INFO: task python3:5413 is blocked on a mutex likely owned by task python3:3411.
[ 1112.890121] task:python3 state:D stack:25672 pid:3411 tgid:3411 ppid:3410 task_flags:0x400100 flags:0x00080802
[ 1112.903325] Call Trace:
[ 1112.906861]
[ 1112.910010] __schedule+0xcc3/0x19c0
[ 1112.914821] ? io_schedule_timeout+0x140/0x140
[ 1112.920605] ? find_held_lock+0x2b/0x80
[ 1112.925708] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.931885] schedule+0xd8/0x260
[ 1112.936302] schedule_timeout+0x13f/0x290
[ 1112.941598] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.947965] ? trace_contention_end+0xb3/0x1a0
[ 1112.953747] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.959435] ? ww_mutex_lock+0x160/0x160
[ 1112.964635] msleep+0x1b/0x30
[ 1112.968752] napi_set_threaded+0x3a5/0x440
[ 1112.974144] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.979637] netif_set_threaded+0x257/0x400
[ 1112.985131] threaded_store+0x1b8/0x220
[ 1112.990230] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.995528] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.000821] ? sysfs_kf_write+0x65/0x160
[ 1113.006021] ? sysfs_file_ops+0x140/0x140
[ 1113.011309] kernfs_fop_write_iter+0x335/0x510
[ 1113.017093] ? kernfs_ops+0xf0/0xf0
[ 1113.021804] new_sync_write+0x333/0x750
[ 1113.026903] ? __lock_acquire+0x508/0xc10
[ 1113.032198] ? new_sync_read+0x740/0x740
[ 1113.037396] ? lock_acquire.part.0+0xbc/0x260
[ 1113.043082] ? ksys_write+0x116/0x250
[ 1113.047991] vfs_write+0x657/0x9b0
[ 1113.052604] ksys_write+0x116/0x250
[ 1113.057313] ? __ia32_sys_read+0xc0/0xc0
[ 1113.062509] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.068096] ? rcu_is_watching+0x15/0xd0
[ 1113.073293] do_syscall_64+0xf3/0x650
[ 1113.078198] ? irq_exit_rcu+0x1a/0x30
[ 1113.083107] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.089562] RIP: 0033:0x7fd085f1e64e
[ 1113.094366] RSP: 002b:00007ffee26a80f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.103663] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd085f1e64e
[ 1113.112459] RDX: 0000000000000001 RSI: 000055f8d7235420 RDI: 0000000000000007
[ 1113.121265] RBP: 00007ffee26a8100 R08: 0000000000000000 R09: 0000000000000000
[ 1113.130069] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd085d97390
[ 1113.138875] R13: 000055f8d7235420 R14: 0000000000000007 R15: 00007fd085d2d120
[ 1113.147686]
[ 1113.150947] \x0aShowing all locks held in the system:
[ 1113.159483] 1 lock held by khungtaskd/184:
[ 1113.164875] #0: ffffffff98afdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.176356] 4 locks held by python3/3411:
[ 1113.181652] #0: ff1100012f1393e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.191541] #1: ff110001433aa080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.202502] #2: ff11000121abcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.213649] #3: ff11000121b39d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.223748] 4 locks held by python3/5413:
[ 1113.229042] #0: ff1100012f1393e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.238929] #1: ff11000187f22080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.249890] #2: ff11000121abcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.261048] #3: ff11000121b39d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.271135]
[ 1113.273628] =============================================\x0a
[ 1190.423860] kworker/u129:6 (283) used greatest stack depth: 21456 bytes left
[ 1235.480178] INFO: task python3:5413 blocked for more than 368 seconds.
[ 1235.488326] Not tainted 7.1.0-rc6-ohzb-g91a26bc64654 #1
[ 1235.495578] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.505166] task:python3 state:D stack:25672 pid:5413 tgid:5413 ppid:5411 task_flags:0x400100 flags:0x00080002
[ 1235.518369] Call Trace:
[ 1235.521908]
[ 1235.525056] __schedule+0xcc3/0x19c0
[ 1235.529873] ? io_schedule_timeout+0x140/0x140
[ 1235.535659] ? find_held_lock+0x2b/0x80
[ 1235.540763] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.546645] schedule+0xd8/0x260
[ 1235.551062] schedule_preempt_disabled+0x18/0x30
[ 1235.557038] __mutex_lock+0x6af/0x2010
[ 1235.562042] ? threaded_store+0x132/0x220
[ 1235.567341] ? ww_mutex_lock+0x160/0x160
[ 1235.572530] ? selinux_inode_free_security+0x330/0x330
[ 1235.579092] ? cap_capable+0x1d6/0x3e0
[ 1235.584096] ? threaded_store+0x132/0x220
[ 1235.589394] threaded_store+0x132/0x220
[ 1235.594487] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.599781] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.605082] ? sysfs_kf_write+0x65/0x160
[ 1235.610282] ? sysfs_file_ops+0x140/0x140
[ 1235.615574] kernfs_fop_write_iter+0x335/0x510
[ 1235.621359] ? kernfs_ops+0xf0/0xf0
[ 1235.626070] new_sync_write+0x333/0x750
[ 1235.631171] ? __lock_acquire+0x508/0xc10
[ 1235.636467] ? new_sync_read+0x740/0x740
[ 1235.641669] ? lock_acquire.part.0+0xbc/0x260
[ 1235.647351] ? ksys_write+0x116/0x250
[ 1235.652261] vfs_write+0x657/0x9b0
[ 1235.656874] ksys_write+0x116/0x250
[ 1235.661587] ? __ia32_sys_read+0xc0/0xc0
[ 1235.666786] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.672373] ? rcu_is_watching+0x15/0xd0
[ 1235.677572] do_syscall_64+0xf3/0x650
[ 1235.682477] ? trace_hardirqs_off+0xd/0x30
[ 1235.687872] ? exc_page_fault+0xda/0xf0
[ 1235.692976] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.699442] RIP: 0033:0x7f9fb36f764e
[ 1235.704248] RSP: 002b:00007ffe8aadfd10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.713546] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9fb36f764e
[ 1235.722353] RDX: 0000000000000001 RSI: 00005613e3524420 RDI: 0000000000000007
[ 1235.731158] RBP: 00007ffe8aadfd20 R08: 0000000000000000 R09: 0000000000000000
[ 1235.739965] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9fb3570390
[ 1235.748769] R13: 00005613e3524420 R14: 0000000000000007 R15: 00007f9fb3505120
[ 1235.757579]
[ 1235.760853] INFO: task python3:5413 is blocked on a mutex likely owned by task python3:3411.
[ 1235.771125] task:python3 state:D stack:25672 pid:3411 tgid:3411 ppid:3410 task_flags:0x400100 flags:0x00080802
[ 1235.784325] Call Trace:
[ 1235.787864]
[ 1235.791013] __schedule+0xcc3/0x19c0
[ 1235.795821] ? io_schedule_timeout+0x140/0x140
[ 1235.801603] ? find_held_lock+0x2b/0x80
[ 1235.806706] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.812883] schedule+0xd8/0x260
[ 1235.817302] schedule_timeout+0x13f/0x290
[ 1235.822595] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.828962] ? trace_contention_end+0xb3/0x1a0
[ 1235.834746] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.840434] ? ww_mutex_lock+0x160/0x160
[ 1235.845623] msleep+0x1b/0x30
[ 1235.849745] napi_set_threaded+0x3a5/0x440
[ 1235.855141] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.860715] netif_set_threaded+0x257/0x400
[ 1235.866212] threaded_store+0x1b8/0x220
[ 1235.871333] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.876632] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.881925] ? sysfs_kf_write+0x65/0x160
[ 1235.887125] ? sysfs_file_ops+0x140/0x140
[ 1235.892412] kernfs_fop_write_iter+0x335/0x510
[ 1235.898194] ? kernfs_ops+0xf0/0xf0
[ 1235.902902] new_sync_write+0x333/0x750
[ 1235.908004] ? __lock_acquire+0x508/0xc10
[ 1235.913299] ? new_sync_read+0x740/0x740
[ 1235.918496] ? lock_acquire.part.0+0xbc/0x260
[ 1235.924181] ? ksys_write+0x116/0x250
[ 1235.929092] vfs_write+0x657/0x9b0
[ 1235.933704] ksys_write+0x116/0x250
[ 1235.938413] ? __ia32_sys_read+0xc0/0xc0
[ 1235.943610] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.949200] ? rcu_is_watching+0x15/0xd0
[ 1235.954400] do_syscall_64+0xf3/0x650
[ 1235.959296] ? irq_exit_rcu+0x1a/0x30
[ 1235.964204] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.970668] RIP: 0033:0x7fd085f1e64e
[ 1235.975476] RSP: 002b:00007ffee26a80f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.984773] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd085f1e64e
[ 1235.993580] RDX: 0000000000000001 RSI: 000055f8d7235420 RDI: 0000000000000007
[ 1236.002386] RBP: 00007ffee26a8100 R08: 0000000000000000 R09: 0000000000000000
[ 1236.011192] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd085d97390
[ 1236.020000] R13: 000055f8d7235420 R14: 0000000000000007 R15: 00007fd085d2d120
[ 1236.028810]
[ 1236.032070] \x0aShowing all locks held in the system:
[ 1236.040606] 1 lock held by khungtaskd/184:
[ 1236.045997] #0: ffffffff98afdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.057468] 3 locks held by systemd-journal/806:
[ 1236.063447] #0: ff1100180e7b74e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1236.073337] #1: ffffffff98d02ce0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: dput.part.0+0x2fd/0x410
[ 1236.085565] #2: ff1100019358de60 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1236.097121] 4 locks held by python3/3411:
[ 1236.102408] #0: ff1100012f1393e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.112294] #1: ff110001433aa080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.123254] #2: ff11000121abcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.134410] #3: ff11000121b39d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.144504] 4 locks held by python3/5413:
[ 1236.149800] #0: ff1100012f1393e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.159687] #1: ff11000187f22080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.170648] #2: ff11000121abcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.181794] #3: ff11000121b39d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.191884]
[ 1236.194347] =============================================\x0a
[ 1358.361498] INFO: task python3:5413 blocked for more than 491 seconds.
[ 1358.369648] Not tainted 7.1.0-rc6-ohzb-g91a26bc64654 #1
[ 1358.376901] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.386486] task:python3 state:D stack:25672 pid:5413 tgid:5413 ppid:5411 task_flags:0x400100 flags:0x00080002
[ 1358.399693] Call Trace:
[ 1358.403234]
[ 1358.406385] __schedule+0xcc3/0x19c0
[ 1358.411204] ? io_schedule_timeout+0x140/0x140
[ 1358.416990] ? find_held_lock+0x2b/0x80
[ 1358.422098] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.427983] schedule+0xd8/0x260
[ 1358.432401] schedule_preempt_disabled+0x18/0x30
[ 1358.438383] __mutex_lock+0x6af/0x2010
[ 1358.443387] ? threaded_store+0x132/0x220
[ 1358.448678] ? ww_mutex_lock+0x160/0x160
[ 1358.453880] ? selinux_inode_free_security+0x330/0x330
[ 1358.460450] ? cap_capable+0x1d6/0x3e0
[ 1358.465460] ? threaded_store+0x132/0x220
[ 1358.470755] threaded_store+0x132/0x220
[ 1358.475856] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.481155] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.486453] ? sysfs_kf_write+0x65/0x160
[ 1358.491655] ? sysfs_file_ops+0x140/0x140
[ 1358.496952] kernfs_fop_write_iter+0x335/0x510
[ 1358.502737] ? kernfs_ops+0xf0/0xf0
[ 1358.507452] new_sync_write+0x333/0x750
[ 1358.512559] ? __lock_acquire+0x508/0xc10
[ 1358.517855] ? new_sync_read+0x740/0x740
[ 1358.523057] ? lock_acquire.part.0+0xbc/0x260
[ 1358.528745] ? ksys_write+0x116/0x250
[ 1358.533655] vfs_write+0x657/0x9b0
[ 1358.538272] ksys_write+0x116/0x250
[ 1358.542982] ? __ia32_sys_read+0xc0/0xc0
[ 1358.548180] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.553771] ? rcu_is_watching+0x15/0xd0
[ 1358.558974] do_syscall_64+0xf3/0x650
[ 1358.563879] ? trace_hardirqs_off+0xd/0x30
[ 1358.569275] ? exc_page_fault+0xda/0xf0
[ 1358.574379] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.580849] RIP: 0033:0x7f9fb36f764e
[ 1358.585661] RSP: 002b:00007ffe8aadfd10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.594959] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9fb36f764e
[ 1358.603770] RDX: 0000000000000001 RSI: 00005613e3524420 RDI: 0000000000000007
[ 1358.612579] RBP: 00007ffe8aadfd20 R08: 0000000000000000 R09: 0000000000000000
[ 1358.621389] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9fb3570390
[ 1358.630199] R13: 00005613e3524420 R14: 0000000000000007 R15: 00007f9fb3505120
[ 1358.639012]
[ 1358.642281] INFO: task python3:5413 is blocked on a mutex likely owned by task python3:3411.
[ 1358.652552] task:python3 state:D stack:25672 pid:3411 tgid:3411 ppid:3410 task_flags:0x400100 flags:0x00080802
[ 1358.665756] Call Trace:
[ 1358.669295]
[ 1358.672446] __schedule+0xcc3/0x19c0
[ 1358.677260] ? io_schedule_timeout+0x140/0x140
[ 1358.683045] ? find_held_lock+0x2b/0x80
[ 1358.688142] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.694318] schedule+0xd8/0x260
[ 1358.698739] schedule_timeout+0x13f/0x290
[ 1358.704036] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.710406] ? trace_contention_end+0xb3/0x1a0
[ 1358.716193] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.721885] ? ww_mutex_lock+0x160/0x160
[ 1358.727085] msleep+0x1b/0x30
[ 1358.731202] napi_set_threaded+0x3a5/0x440
[ 1358.736598] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.742092] netif_set_threaded+0x257/0x400
[ 1358.747586] threaded_store+0x1b8/0x220
[ 1358.752688] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.757987] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.763286] ? sysfs_kf_write+0x65/0x160
[ 1358.768487] ? sysfs_file_ops+0x140/0x140
[ 1358.773785] kernfs_fop_write_iter+0x335/0x510
[ 1358.779572] ? kernfs_ops+0xf0/0xf0
[ 1358.784283] new_sync_write+0x333/0x750
[ 1358.789384] ? __lock_acquire+0x508/0xc10
[ 1358.794680] ? new_sync_read+0x740/0x740
[ 1358.799881] ? lock_acquire.part.0+0xbc/0x260
[ 1358.805567] ? ksys_write+0x116/0x250
[ 1358.810476] vfs_write+0x657/0x9b0
[ 1358.815093] ksys_write+0x116/0x250
[ 1358.819807] ? __ia32_sys_read+0xc0/0xc0
[ 1358.825009] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.830600] ? rcu_is_watching+0x15/0xd0
[ 1358.835800] do_syscall_64+0xf3/0x650
[ 1358.840699] ? irq_exit_rcu+0x1a/0x30
[ 1358.845608] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.852076] RIP: 0033:0x7fd085f1e64e
[ 1358.856884] RSP: 002b:00007ffee26a80f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.866181] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd085f1e64e
[ 1358.874990] RDX: 0000000000000001 RSI: 000055f8d7235420 RDI: 0000000000000007
[ 1358.883800] RBP: 00007ffee26a8100 R08: 0000000000000000 R09: 0000000000000000
[ 1358.892609] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd085d97390
[ 1358.901417] R13: 000055f8d7235420 R14: 0000000000000007 R15: 00007fd085d2d120
[ 1358.910229]
[ 1358.913498] \x0aShowing all locks held in the system:
[ 1358.922036] 1 lock held by khungtaskd/184:
[ 1358.927432] #0: ffffffff98afdea0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.938914] 4 locks held by python3/3411:
[ 1358.944209] #0: ff1100012f1393e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.954100] #1: ff110001433aa080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.965059] #2: ff11000121abcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.976214] #3: ff11000121b39d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.986308] 4 locks held by python3/5413:
[ 1358.991606] #0: ff1100012f1393e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.001486] #1: ff11000187f22080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.012439] #2: ff11000121abcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.023588] #3: ff11000121b39d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.033683]
[ 1359.036149] =============================================\x0a