| 1 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] BUG: soft lockup - CPU#1 stuck for 23s! [httpd2-prefork:11914]
|
|---|
| 2 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] Modules linked in: lp parport_pc af_packet joydev st ppdev parport tcp_diag inet_diag edd dm_mod pcspkr sg e1000 sr_mod cdrom ohci_hcd ehci_hcd usbcore ssb mmc_core pcmcia pcmcia_core [last unloaded: parport_pc]
|
|---|
| 3 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] CPU 1
|
|---|
| 4 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] Modules linked in: lp parport_pc af_packet joydev st ppdev parport tcp_diag inet_diag edd dm_mod pcspkr sg e1000 sr_mod cdrom ohci_hcd ehci_hcd usbcore ssb mmc_core pcmcia pcmcia_core [last unloaded: parport_pc]
|
|---|
| 5 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059]
|
|---|
| 6 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] Pid: 11914, comm: httpd2-prefork Not tainted 3.1.10-1.16-default #1 innotek GmbH VirtualBox
|
|---|
| 7 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] RIP: 0010:[<ffffffff8154004e>] [<ffffffff8154004e>] _raw_spin_lock_bh+0x1e/0x30
|
|---|
| 8 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] RSP: 0018:ffff8800b877dc18 EFLAGS: 00000202
|
|---|
| 9 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] RAX: 0000000000000004 RBX: ffff8800bfd123c0 RCX: ffff880037c74c00
|
|---|
| 10 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] RDX: 0000000000000005 RSI: 0000000000000000 RDI: ffff8800b93d4090
|
|---|
| 11 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] RBP: ffff8800b93d4040 R08: 000000008f96e29b R09: 0000000000000000
|
|---|
| 12 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] R10: 0000000000000000 R11: 0000000000000246 R12: ffff8800b9b4a448
|
|---|
| 13 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] R13: ffff8800b8a4e088 R14: ffff8800bfd123c0 R15: ffff8800b877db78
|
|---|
| 14 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] FS: 00007fc116603700(0000) GS:ffff8800bfd00000(0000) knlGS:0000000000000000
|
|---|
| 15 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
|
|---|
| 16 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] CR2: 00000000004122dd CR3: 00000000b7fbd000 CR4: 00000000000006e0
|
|---|
| 17 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
|
|---|
| 18 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
|
|---|
| 19 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] Process httpd2-prefork (pid: 11914, threadinfo ffff8800b877c000, task ffff8800b8a4e040)
|
|---|
| 20 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] Stack:
|
|---|
| 21 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] ffff8800b93d4090 ffffffff81414dcd ffff8800b93d44cc ffff8800b86443f0
|
|---|
| 22 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] 0000000000000000 ffffffff814671a5 0000000000000282 0000000000000001
|
|---|
| 23 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] ffff8800b877dc98 ffffffff8103f6a6 00000000b8573ee0 0000000000001f40
|
|---|
| 24 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] Call Trace:
|
|---|
| 25 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff81414dcd>] release_sock+0x1d/0x70
|
|---|
| 26 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff814671a5>] tcp_recvmsg+0x385/0xb20
|
|---|
| 27 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff81489534>] inet_recvmsg+0x64/0x80
|
|---|
| 28 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff81410a79>] do_sock_read.isra.13+0xd9/0xf0
|
|---|
| 29 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff81410b14>] sock_aio_read.part.14+0x84/0xb0
|
|---|
| 30 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff8114b2d8>] do_sync_read+0xb8/0xf0
|
|---|
| 31 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff8114bc15>] vfs_read+0x165/0x180
|
|---|
| 32 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff8114bc77>] sys_read+0x47/0x90
|
|---|
| 33 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff81547d52>] system_call_fastpath+0x16/0x1b
|
|---|
| 34 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<00007fc115b4edb0>] 0x7fc115b4edaf
|
|---|
| 35 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] Code: e6 d6 ff 5b c3 0f 1f 84 00 00 00 00 00 53 48 89 fb e8 d7 81 b1 ff b8 00 00 01 00 f0 0f c1 03 0f b7 d0 c1 e8 10 39 c2 74 07 f3 90 <0f> b7 13 eb f5 5b c3 66 66 2e 0f 1f 84 00 00 00 00 00 53 48 89
|
|---|
| 36 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] Call Trace:
|
|---|
| 37 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff81414dcd>] release_sock+0x1d/0x70
|
|---|
| 38 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff814671a5>] tcp_recvmsg+0x385/0xb20
|
|---|
| 39 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff81489534>] inet_recvmsg+0x64/0x80
|
|---|
| 40 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff81410a79>] do_sock_read.isra.13+0xd9/0xf0
|
|---|
| 41 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff81410b14>] sock_aio_read.part.14+0x84/0xb0
|
|---|
| 42 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff8114b2d8>] do_sync_read+0xb8/0xf0
|
|---|
| 43 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff8114bc15>] vfs_read+0x165/0x180
|
|---|
| 44 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff8114bc77>] sys_read+0x47/0x90
|
|---|
| 45 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<ffffffff81547d52>] system_call_fastpath+0x16/0x1b
|
|---|
| 46 | Nov 25 05:30:48 xxxxxxxxxxxx kernel: [1107340.284059] [<00007fc115b4edb0>] 0x7fc115b4edaf
|
|---|
| 47 | ...
|
|---|
| 48 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338477] INFO: rcu_sched_state detected stall on CPU 1 (t=15000 jiffies)
|
|---|
| 49 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338790] sending NMI to all CPUs:
|
|---|
| 50 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] NMI backtrace for cpu 1
|
|---|
| 51 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] CPU 1
|
|---|
| 52 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] Modules linked in: lp parport_pc af_packet joydev st ppdev parport tcp_diag inet_diag edd dm_mod pcspkr sg e1000 sr_mod cdrom ohci_hcd ehci_hcd usbcore ssb mmc_core pcmcia pcmcia_core [last unloaded: parport_pc]
|
|---|
| 53 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840]
|
|---|
| 54 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] Pid: 11914, comm: httpd2-prefork Not tainted 3.1.10-1.16-default #1 innotek GmbH VirtualBox
|
|---|
| 55 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] RIP: 0010:[<ffffffff81024534>] [<ffffffff81024534>] flat_send_IPI_all+0x94/0xb0
|
|---|
| 56 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] RSP: 0018:ffff8800bfd03ed8 EFLAGS: 00010006
|
|---|
| 57 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] RAX: 0000000000000000 RBX: 0000000000000046 RCX: 0000000000003aff
|
|---|
| 58 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] RDX: 00000000000048be RSI: 0000000000000046 RDI: 0000000000000300
|
|---|
| 59 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] RBP: 0000000000000c00 R08: 0000000000000000 R09: 0000000000000000
|
|---|
| 60 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] R10: 0000000000000000 R11: 000000000000fffe R12: 0000000003000000
|
|---|
| 61 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] R13: ffff8800b93d44cc R14: 0000000000000000 R15: ffff8800b93d40b0
|
|---|
| 62 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] FS: 00007fc116603700(0000) GS:ffff8800bfd00000(0000) knlGS:0000000000000000
|
|---|
| 63 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
|
|---|
| 64 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] CR2: 00000000004122dd CR3: 00000000b7fbd000 CR4: 00000000000006e0
|
|---|
| 65 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
|
|---|
| 66 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
|
|---|
| 67 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] Process httpd2-prefork (pid: 11914, threadinfo ffff8800b877c000, task ffff8800b8a4e040)
|
|---|
| 68 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] Stack:
|
|---|
| 69 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] 0000000000002710 ffffffff81a21b00 ffffffff81a21c00 ffffffff8101f5bf
|
|---|
| 70 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] ffffffff81a21b00 ffffffff810c5c9e ffff8800bfd0dc80 ffffffff810c6431
|
|---|
| 71 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] 0000000000000001 0000000000000000 0000000000000001 ffffffff810c689f
|
|---|
| 72 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] Call Trace:
|
|---|
| 73 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8101f5bf>] arch_trigger_all_cpu_backtrace+0x4f/0x90
|
|---|
| 74 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff810c5c9e>] check_cpu_stall.isra.40+0x8e/0xf0
|
|---|
| 75 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff810c6431>] __rcu_pending+0x31/0x180
|
|---|
| 76 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff810c689f>] rcu_check_callbacks+0x5f/0x110
|
|---|
| 77 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81062cbf>] update_process_times+0x3f/0x80
|
|---|
| 78 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff810832b7>] tick_periodic+0x27/0x80
|
|---|
| 79 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81083388>] tick_handle_periodic+0x18/0x70
|
|---|
| 80 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8101e3e3>] smp_apic_timer_interrupt+0x63/0xa0
|
|---|
| 81 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8154889e>] apic_timer_interrupt+0x6e/0x80
|
|---|
| 82 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8154004e>] _raw_spin_lock_bh+0x1e/0x30
|
|---|
| 83 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81414dcd>] release_sock+0x1d/0x70
|
|---|
| 84 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff814671a5>] tcp_recvmsg+0x385/0xb20
|
|---|
| 85 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81489534>] inet_recvmsg+0x64/0x80
|
|---|
| 86 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81410a79>] do_sock_read.isra.13+0xd9/0xf0
|
|---|
| 87 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81410b14>] sock_aio_read.part.14+0x84/0xb0
|
|---|
| 88 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8114b2d8>] do_sync_read+0xb8/0xf0
|
|---|
| 89 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8114bc15>] vfs_read+0x165/0x180
|
|---|
| 90 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8114bc77>] sys_read+0x47/0x90
|
|---|
| 91 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81547d52>] system_call_fastpath+0x16/0x1b
|
|---|
| 92 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<00007fc115b4edb0>] 0x7fc115b4edaf
|
|---|
| 93 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] Code: 66 90 48 8b 05 06 65 b0 00 41 c1 e4 18 8b 68 34 ff 90 48 01 00 00 44 89 24 25 10 a3 5f ff 81 cd 00 04 00 00 89 2c 25 00 a3 5f ff
|
|---|
| 94 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] Call Trace:
|
|---|
| 95 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8101f5bf>] arch_trigger_all_cpu_backtrace+0x4f/0x90
|
|---|
| 96 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff810c5c9e>] check_cpu_stall.isra.40+0x8e/0xf0
|
|---|
| 97 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff810c6431>] __rcu_pending+0x31/0x180
|
|---|
| 98 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff810c689f>] rcu_check_callbacks+0x5f/0x110
|
|---|
| 99 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81062cbf>] update_process_times+0x3f/0x80
|
|---|
| 100 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff810832b7>] tick_periodic+0x27/0x80
|
|---|
| 101 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81083388>] tick_handle_periodic+0x18/0x70
|
|---|
| 102 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8101e3e3>] smp_apic_timer_interrupt+0x63/0xa0
|
|---|
| 103 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8154889e>] apic_timer_interrupt+0x6e/0x80
|
|---|
| 104 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8154004e>] _raw_spin_lock_bh+0x1e/0x30
|
|---|
| 105 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81414dcd>] release_sock+0x1d/0x70
|
|---|
| 106 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff814671a5>] tcp_recvmsg+0x385/0xb20
|
|---|
| 107 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81489534>] inet_recvmsg+0x64/0x80
|
|---|
| 108 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81410a79>] do_sock_read.isra.13+0xd9/0xf0
|
|---|
| 109 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81410b14>] sock_aio_read.part.14+0x84/0xb0
|
|---|
| 110 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8114b2d8>] do_sync_read+0xb8/0xf0
|
|---|
| 111 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8114bc15>] vfs_read+0x165/0x180
|
|---|
| 112 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff8114bc77>] sys_read+0x47/0x90
|
|---|
| 113 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<ffffffff81547d52>] system_call_fastpath+0x16/0x1b
|
|---|
| 114 | Nov 25 05:31:23 xxxxxxxxxxxx kernel: [1107375.338840] [<00007fc115b4edb0>] 0x7fc115b4edaf
|
|---|