[ovs-dev] Kernel Crash with VXLAN source code

Jagadish Nadimpalli jagadish.nadimpalli at oneconvergence.com
Fri Feb 15 13:05:40 UTC 2013


Justin,

Thanks for your response.

Could you please let me know what is this branch-1.10. Is this openvswitch
version? Could you please let me know what is this tip of master. Is this a
git repo?

Thanks & Regards,
Jagadish

On Fri, Feb 15, 2013 at 1:24 PM, Justin Pettit <jpettit at nicira.com> wrote:

> The VXLAN changes were upstreamed a little while ago.  Can you try either
> the tip of master or the branch "branch-1.10"?
>
> --Justin
>
>
> On Feb 14, 2013, at 11:28 PM, Jagadish Nadimpalli <
> jagadish.nadimpalli at oneconvergence.com> wrote:
>
> > Hi All,
> >
> > We are using the VXLAN changes done to the open vswitch. We have taken
> these changes from https://github.com/mestery/ovs-vxlan. I think this is
> not added to main line openvswitch source code.
> >
> > We are observing a Kernel crash issue with this code. Just wanted to
> check if this issue is already fixed. Below is the Kernel stack trace.
> >
> > [487924.571433] IPv6: ADDRCONF(NETDEV_CHANGE): tapff5e1f54-98: link
> becomes ready
> > [487937.156992] kernel tried to execute NX-protected page - exploit
> attempt? (uid: 0)
> > [487937.157057] BUG: unable to handle kernel paging request at
> ffffffffa053e650
> > [487937.157112] IP: [<ffffffffa053e650>]
> __key.35834+0xe8c/0xffffffffffffe83c [netconsole]
> > [487937.157172] PGD 1c0d067 PUD 1c11063 PMD 202557067 PTE
> 80000001ead67163
> > [487937.157229] Oops: 0011 [#1] SMP
> > [487937.157259] CPU 1
> > [487937.157275] Modules linked in:[487937.157300]  brcompat(O)
> openvswitch(O) netconsole configfs ip6table_filter ip6_tables
> iptable_filter ip_tables ebtable_nat ebtables x_tables nbd ib_iser rdma_cm
> ib_cm iw_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi
> scsi_transport_iscsi rfcomm bnep bluetooth nfsd nfs lockd fscache
> auth_rpcgss nfs_acl sunrpc snd_hda_codec_realtek gpio_ich coretemp
> kvm_intel kvm ghash_clmulni_intel cryptd snd_hda_intel snd_hda_codec
> snd_hwdep snd_pcm ppdev hid_generic snd_seq_midi snd_rawmidi
> snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer snd_seq_device
> psmouse serio_raw lpc_ich microcode usbhid hid parport_pc dm9601 usbnet snd
> i915 drm_kms_helper drm soundcore i2c_algo_bit snd_page_alloc video mei
> mac_hid lp parport e1000e [last unloaded: openvswitch]
> >
> > [487937.157952] Pid: 0, comm: swapper/1 Tainted: G           O
> 3.5.0-17-generic #28-Ubuntu                  /DH61WW
> > [487937.158025] RIP: 0010:[<ffffffffa053e650>]  [<ffffffffa053e650>]
> __key.35834+0xe8c/0xffffffffffffe83c [netconsole]
> > [487937.158096] RSP: 0018:ffff88021f283c28  EFLAGS: 00010286
> > [487937.158132] RAX: ffffffffa053e650 RBX: ffff8801b4590900 RCX:
> ffff88020fce3100
> > [487937.158179] RDX: 0000000000000000 RSI: ffff8801b4590900 RDI:
> ffff88020fce3100
> > [487937.158225] RBP: ffff88021f283c50 R08: 0000000000000003 R09:
> 0000000000000003
> > [487937.158272] R10: 0000000000000000 R11: 00000000e80a0a64 R12:
> ffff88020fce3100
> > [487937.158319] R13: 0000000000000000 R14: 0000000000000000 R15:
> 000000000000005a
> > [487937.158366] FS:  0000000000000000(0000) GS:ffff88021f280000(0000)
> knlGS:0000000000000000
> > [487937.158418] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> > [487937.158456] CR2: ffffffffa053e650 CR3: 0000000001c0b000 CR4:
> 00000000001427e0
> > [487937.158503] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> > [487937.158549] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> > [487937.158597] Process swapper/1 (pid: 0, threadinfo ffff880213926000,
> task ffff880213902e00)
> > [487937.158649] Stack:
> > [487937.158665]  ffffffff815d07f3 ffff8801b4590900 0000000000000011
> ffff88005f8f37e5
> > [487937.158725]  ffffffff81ca8c00 ffff88021f283cc0 ffffffff815d107a
> ffffffff81cdb5c0
> > [487937.158784]  ffffffff815a4a60 0000000000000008 ffff88020fce3100
> ffff88021f283d00
> > [487937.158843] Call Trace:
> > [487937.158862]  <IRQ>
> > [487937.158879]  [<ffffffff815d07f3>] ? udp_queue_rcv_skb+0x1a3/0x3c0
> > [487937.158931]  [<ffffffff815d107a>] __udp4_lib_rcv+0x1ba/0x660
> > [487937.158973]  [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
> > [487937.160780]  [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
> > [487937.162562]  [<ffffffff815d153a>] udp_rcv+0x1a/0x20
> > [487937.164342]  [<ffffffff815a4b3f>] ip_local_deliver_finish+0xdf/0x260
> > [487937.166124]  [<ffffffff815a4e57>] ip_local_deliver+0x47/0x80
> > [487937.167884]  [<ffffffff815a4769>] ip_rcv_finish+0x79/0x370
> > [487937.169627]  [<ffffffff815a50a4>] ip_rcv+0x214/0x320
> > [487937.171342]  [<ffffffff81571833>] __netif_receive_skb+0x523/0x5b0
> > [487937.173055]  [<ffffffff81571981>] process_backlog+0xc1/0x1a0
> > [487937.174758]  [<ffffffff8103fa39>] ? default_spin_lock_flags+0x9/0x10
> > [487937.176470]  [<ffffffff815724f3>] net_rx_action+0x123/0x220
> > [487937.178181]  [<ffffffff8105a7c6>] __do_softirq+0xb6/0x1d0
> > [487937.179883]  [<ffffffff81036778>] ? ack_apic_level+0x78/0x130
> > [487937.181598]  [<ffffffff8168b11c>] call_softirq+0x1c/0x30
> > [487937.183293]  [<ffffffff81015115>] do_softirq+0x75/0xb0
> > [487937.184960]  [<ffffffff8105ab95>] irq_exit+0xa5/0xb0
> > [487937.186607]  [<ffffffff8168b973>] do_IRQ+0x63/0xe0
> > [487937.188231]  [<ffffffff81681f2a>] common_interrupt+0x6a/0x6a
> > [487937.189847]  <EOI>
> > [487937.189863]  [<ffffffff813901bd>] ? intel_idle+0xed/0x150
> > [487937.193042]  [<ffffffff8139019b>] ? intel_idle+0xcb/0x150
> > [487937.194545]  [<ffffffff81527119>] cpuidle_enter+0x19/0x20
> > [487937.195984]  [<ffffffff81527749>] cpuidle_idle_call+0xa9/0x240
> > [487937.197357]  [<ffffffff8101c48f>] cpu_idle+0xaf/0x120
> > [487937.198663]  [<ffffffff8166a8bd>] start_secondary+0x1de/0x1e5
> > [487937.199924] Code: 6e 73 6f 6c 65 5f 6e 65 74 64 65 76 5f 65 76 65 6e
> 74 00 74 61 72 67 65 74 5f 6c 69 73 74 00 77 72 69 74 65 5f 6d 73 67 00 6d
> 61 <6b> 65 5f 6e 65 74 63 6f 6e 73 6f 6c 65 5f 74 61 72 67 65 74 00
> > [487937.202841] RIP  [<ffffffffa053e650>]
> __key.35834+0xe8c/0xffffffffffffe83c [netconsole]
> > [487937.204226]  RSP <ffff88021f283c28>
> > [487937.205587] CR2: ffffffffa053e650
> > [487937.225490] ---[ end trace acab759e6893e8ec ]---
> > [487937.225494] Kernel panic - not syncing: Fatal exception in interrupt
> > [487937.226889] panic occurred, switching back to text console
> > [487937.228267] ------------[ cut here ]------------
> > [487937.228272] WARNING: at
> /build/buildd/linux-3.5.0/arch/x86/kernel/smp.c:123
> native_smp_send_reschedule+0x5b/0x60()
> > [487937.228274] Hardware name:
> > [487937.228276] Modules linked in: brcompat(O) openvswitch(O) netconsole
> configfs ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat
> ebtables x_tables nbd ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core
> ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi rfcomm bnep
> bluetooth nfsd nfs lockd fscache auth_rpcgss nfs_acl sunrpc
> snd_hda_codec_realtek gpio_ich coretemp kvm_intel kvm ghash_clmulni_intel
> cryptd snd_hda_intel snd_hda_codec snd_hwdep snd_pcm ppdev hid_generic
> snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq dm_multipath scsi_dh
> snd_timer snd_seq_device psmouse serio_raw lpc_ich microcode usbhid hid
> parport_pc dm9601 usbnet snd i915 drm_kms_helper drm soundcore i2c_algo_bit
> snd_page_alloc video mei mac_hid lp parport e1000e [last unloaded:
> openvswitch]
> > [487937.228390] Pid: 0, comm: swapper/1 Tainted: G      D    O
> 3.5.0-17-generic #28-Ubuntu
> > [487937.228393] Call Trace:
> > [487937.228394]  <IRQ>  [<ffffffff81051c4f>]
> warn_slowpath_common+0x7f/0xc0
> > [487937.228403]  [<ffffffff81051caa>] warn_slowpath_null+0x1a/0x20
> > [487937.228407]  [<ffffffff8103269b>]
> native_smp_send_reschedule+0x5b/0x60
> > [487937.228412]  [<ffffffff8108fad3>] trigger_load_balance+0x183/0x220
> > [487937.228418]  [<ffffffff8108686e>] scheduler_tick+0x10e/0x140
> > [487937.228422]  [<ffffffff810640ec>] update_process_times+0x6c/0x90
> > [487937.228427]  [<ffffffff810a9576>] tick_sched_timer+0x66/0xc0
> > [487937.228431]  [<ffffffff8107a329>] __run_hrtimer+0x79/0x1d0
> > [487937.228435]  [<ffffffff810a9510>] ? tick_nohz_handler+0x110/0x110
> > [487937.228439]  [<ffffffff8107ac47>] hrtimer_interrupt+0xf7/0x230
> > [487937.228444]  [<ffffffff8168ba59>] smp_apic_timer_interrupt+0x69/0x99
> > [487937.228449]  [<ffffffff8168a7ca>] apic_timer_interrupt+0x6a/0x70
> > [487937.228454]  [<ffffffff810537a5>] ? console_unlock+0x265/0x430
> > [487937.228462]  [<ffffffffa00dc0d8>] ?
> drm_crtc_helper_set_config+0x948/0xb10 [drm_kms_helper]
> > [487937.228467]  [<ffffffff81674592>] ? panic+0x188/0x1c9
> > [487937.228471]  [<ffffffff816744f9>] ? panic+0xef/0x1c9
> > [487937.228475]  [<ffffffff81682db2>] oops_end+0xe2/0xf0
> > [487937.228479]  [<ffffffff81673f1e>] no_context+0x253/0x27e
> > [487937.228483]  [<ffffffff81674108>] __bad_area_nosemaphore+0x1bf/0x1de
> > [487937.228487]  [<ffffffff8167413a>] bad_area_nosemaphore+0x13/0x15
> > [487937.228492]  [<ffffffff8168594f>] do_page_fault+0x40f/0x4e0
> > [487937.228498]  [<ffffffffa052307d>] ? ipt_do_table+0x30d/0x5d0
> [ip_tables]
> > [487937.228503]  [<ffffffff815e80cb>] ? fib4_rule_action+0x6b/0x80
> > [487937.228508]  [<ffffffff8157962a>] ? dst_alloc+0x5a/0x180
> > [487937.228512]  [<ffffffff816821e5>] page_fault+0x25/0x30
> > [487937.228517]  [<ffffffff815d07f3>] ? udp_queue_rcv_skb+0x1a3/0x3c0
> > [487937.228521]  [<ffffffff815d107a>] __udp4_lib_rcv+0x1ba/0x660
> > [487937.228526]  [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
> > [487937.228531]  [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
> > [487937.228535]  [<ffffffff815d153a>] udp_rcv+0x1a/0x20
> > [487937.228540]  [<ffffffff815a4b3f>] ip_local_deliver_finish+0xdf/0x260
> > [487937.228544]  [<ffffffff815a4e57>] ip_local_deliver+0x47/0x80
> > [487937.228549]  [<ffffffff815a4769>] ip_rcv_finish+0x79/0x370
> > [487937.228554]  [<ffffffff815a50a4>] ip_rcv+0x214/0x320
> > [487937.228558]  [<ffffffff81571833>] __netif_receive_skb+0x523/0x5b0
> > [487937.228562]  [<ffffffff81571981>] process_backlog+0xc1/0x1a0
> > [487937.228568]  [<ffffffff8103fa39>] ? default_spin_lock_flags+0x9/0x10
> > [487937.228572]  [<ffffffff815724f3>] net_rx_action+0x123/0x220
> > [487937.228576]  [<ffffffff8105a7c6>] __do_softirq+0xb6/0x1d0
> > [487937.228580]  [<ffffffff81036778>] ? ack_apic_level+0x78/0x130
> > [487937.228584]  [<ffffffff8168b11c>] call_softirq+0x1c/0x30
> > [487937.228588]  [<ffffffff81015115>] do_softirq+0x75/0xb0
> > [487937.228592]  [<ffffffff8105ab95>] irq_exit+0xa5/0xb0
> > [487937.228596]  [<ffffffff8168b973>] do_IRQ+0x63/0xe0
> > [487937.228601]  [<ffffffff81681f2a>] common_interrupt+0x6a/0x6a
> > [487937.228603]  <EOI>  [<ffffffff813901bd>] ? intel_idle+0xed/0x150
> > [487937.228611]  [<ffffffff8139019b>] ? intel_idle+0xcb/0x150
> > [487937.228615]  [<ffffffff81527119>] cpuidle_enter+0x19/0x20
> > [487937.228618]  [<ffffffff81527749>] cpuidle_idle_call+0xa9/0x240
> > [487937.228622]  [<ffffffff8101c48f>] cpu_idle+0xaf/0x120
> > [487937.228626]  [<ffffffff8166a8bd>] start_secondary+0x1de/0x1e5
> > [487937.228630] ---[ end trace acab759e6893e8ed ]---
> >
> > Thanks & Regards,
> > Jagadish
> >
> > _______________________________________________
> > dev mailing list
> > dev at openvswitch.org
> > http://openvswitch.org/mailman/listinfo/dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.openvswitch.org/pipermail/ovs-dev/attachments/20130215/25a70485/attachment-0003.html>


More information about the dev mailing list