[ovs-dev] Kernel Crash with VXLAN source code

Lori Jakab lojakab at cisco.com
Fri Feb 15 13:15:07 UTC 2013


Hi Jagadish,

VXLAN has been accepted into the official Open vSwitch distribution, so
you should use that repository instead.  Justin referred to branch-1.10
and master from there.  To check out that repository, see

http://openvswitch.org/development/

-Lori

On 02/15/13 15:05, Jagadish Nadimpalli wrote:
> Justin,
> 
> Thanks for your response.
> 
> Could you please let me know what is this branch-1.10. Is this
> openvswitch version? Could you please let me know what is this tip of
> master. Is this a git repo?
> 
> Thanks & Regards,
> Jagadish
> 
> On Fri, Feb 15, 2013 at 1:24 PM, Justin Pettit <jpettit at nicira.com
> <mailto:jpettit at nicira.com>> wrote:
> 
>     The VXLAN changes were upstreamed a little while ago.  Can you try
>     either the tip of master or the branch "branch-1.10"?
> 
>     --Justin
> 
> 
>     On Feb 14, 2013, at 11:28 PM, Jagadish Nadimpalli
>     <jagadish.nadimpalli at oneconvergence.com
>     <mailto:jagadish.nadimpalli at oneconvergence.com>> wrote:
> 
>     > Hi All,
>     >
>     > We are using the VXLAN changes done to the open vswitch. We have
>     taken these changes from https://github.com/mestery/ovs-vxlan. I
>     think this is not added to main line openvswitch source code.
>     >
>     > We are observing a Kernel crash issue with this code. Just wanted
>     to check if this issue is already fixed. Below is the Kernel stack
>     trace.
>     >
>     > [487924.571433] IPv6: ADDRCONF(NETDEV_CHANGE): tapff5e1f54-98:
>     link becomes ready
>     > [487937.156992] kernel tried to execute NX-protected page -
>     exploit attempt? (uid: 0)
>     > [487937.157057] BUG: unable to handle kernel paging request at
>     ffffffffa053e650
>     > [487937.157112] IP: [<ffffffffa053e650>]
>     __key.35834+0xe8c/0xffffffffffffe83c [netconsole]
>     > [487937.157172] PGD 1c0d067 PUD 1c11063 PMD 202557067 PTE
>     80000001ead67163
>     > [487937.157229] Oops: 0011 [#1] SMP
>     > [487937.157259] CPU 1
>     > [487937.157275] Modules linked in:[487937.157300]  brcompat(O)
>     openvswitch(O) netconsole configfs ip6table_filter ip6_tables
>     iptable_filter ip_tables ebtable_nat ebtables x_tables nbd ib_iser
>     rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp
>     libiscsi_tcp libiscsi scsi_transport_iscsi rfcomm bnep bluetooth
>     nfsd nfs lockd fscache auth_rpcgss nfs_acl sunrpc
>     snd_hda_codec_realtek gpio_ich coretemp kvm_intel kvm
>     ghash_clmulni_intel cryptd snd_hda_intel snd_hda_codec snd_hwdep
>     snd_pcm ppdev hid_generic snd_seq_midi snd_rawmidi
>     snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer
>     snd_seq_device psmouse serio_raw lpc_ich microcode usbhid hid
>     parport_pc dm9601 usbnet snd i915 drm_kms_helper drm soundcore
>     i2c_algo_bit snd_page_alloc video mei mac_hid lp parport e1000e
>     [last unloaded: openvswitch]
>     >
>     > [487937.157952] Pid: 0, comm: swapper/1 Tainted: G           O
>     3.5.0-17-generic #28-Ubuntu                  /DH61WW
>     > [487937.158025] RIP: 0010:[<ffffffffa053e650>]
>      [<ffffffffa053e650>] __key.35834+0xe8c/0xffffffffffffe83c [netconsole]
>     > [487937.158096] RSP: 0018:ffff88021f283c28  EFLAGS: 00010286
>     > [487937.158132] RAX: ffffffffa053e650 RBX: ffff8801b4590900 RCX:
>     ffff88020fce3100
>     > [487937.158179] RDX: 0000000000000000 RSI: ffff8801b4590900 RDI:
>     ffff88020fce3100
>     > [487937.158225] RBP: ffff88021f283c50 R08: 0000000000000003 R09:
>     0000000000000003
>     > [487937.158272] R10: 0000000000000000 R11: 00000000e80a0a64 R12:
>     ffff88020fce3100
>     > [487937.158319] R13: 0000000000000000 R14: 0000000000000000 R15:
>     000000000000005a
>     > [487937.158366] FS:  0000000000000000(0000)
>     GS:ffff88021f280000(0000) knlGS:0000000000000000
>     > [487937.158418] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>     > [487937.158456] CR2: ffffffffa053e650 CR3: 0000000001c0b000 CR4:
>     00000000001427e0
>     > [487937.158503] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>     0000000000000000
>     > [487937.158549] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>     0000000000000400
>     > [487937.158597] Process swapper/1 (pid: 0, threadinfo
>     ffff880213926000, task ffff880213902e00)
>     > [487937.158649] Stack:
>     > [487937.158665]  ffffffff815d07f3 ffff8801b4590900
>     0000000000000011 ffff88005f8f37e5
>     > [487937.158725]  ffffffff81ca8c00 ffff88021f283cc0
>     ffffffff815d107a ffffffff81cdb5c0
>     > [487937.158784]  ffffffff815a4a60 0000000000000008
>     ffff88020fce3100 ffff88021f283d00
>     > [487937.158843] Call Trace:
>     > [487937.158862]  <IRQ>
>     > [487937.158879]  [<ffffffff815d07f3>] ? udp_queue_rcv_skb+0x1a3/0x3c0
>     > [487937.158931]  [<ffffffff815d107a>] __udp4_lib_rcv+0x1ba/0x660
>     > [487937.158973]  [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
>     > [487937.160780]  [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
>     > [487937.162562]  [<ffffffff815d153a>] udp_rcv+0x1a/0x20
>     > [487937.164342]  [<ffffffff815a4b3f>]
>     ip_local_deliver_finish+0xdf/0x260
>     > [487937.166124]  [<ffffffff815a4e57>] ip_local_deliver+0x47/0x80
>     > [487937.167884]  [<ffffffff815a4769>] ip_rcv_finish+0x79/0x370
>     > [487937.169627]  [<ffffffff815a50a4>] ip_rcv+0x214/0x320
>     > [487937.171342]  [<ffffffff81571833>] __netif_receive_skb+0x523/0x5b0
>     > [487937.173055]  [<ffffffff81571981>] process_backlog+0xc1/0x1a0
>     > [487937.174758]  [<ffffffff8103fa39>] ?
>     default_spin_lock_flags+0x9/0x10
>     > [487937.176470]  [<ffffffff815724f3>] net_rx_action+0x123/0x220
>     > [487937.178181]  [<ffffffff8105a7c6>] __do_softirq+0xb6/0x1d0
>     > [487937.179883]  [<ffffffff81036778>] ? ack_apic_level+0x78/0x130
>     > [487937.181598]  [<ffffffff8168b11c>] call_softirq+0x1c/0x30
>     > [487937.183293]  [<ffffffff81015115>] do_softirq+0x75/0xb0
>     > [487937.184960]  [<ffffffff8105ab95>] irq_exit+0xa5/0xb0
>     > [487937.186607]  [<ffffffff8168b973>] do_IRQ+0x63/0xe0
>     > [487937.188231]  [<ffffffff81681f2a>] common_interrupt+0x6a/0x6a
>     > [487937.189847]  <EOI>
>     > [487937.189863]  [<ffffffff813901bd>] ? intel_idle+0xed/0x150
>     > [487937.193042]  [<ffffffff8139019b>] ? intel_idle+0xcb/0x150
>     > [487937.194545]  [<ffffffff81527119>] cpuidle_enter+0x19/0x20
>     > [487937.195984]  [<ffffffff81527749>] cpuidle_idle_call+0xa9/0x240
>     > [487937.197357]  [<ffffffff8101c48f>] cpu_idle+0xaf/0x120
>     > [487937.198663]  [<ffffffff8166a8bd>] start_secondary+0x1de/0x1e5
>     > [487937.199924] Code: 6e 73 6f 6c 65 5f 6e 65 74 64 65 76 5f 65 76
>     65 6e 74 00 74 61 72 67 65 74 5f 6c 69 73 74 00 77 72 69 74 65 5f 6d
>     73 67 00 6d 61 <6b> 65 5f 6e 65 74 63 6f 6e 73 6f 6c 65 5f 74 61 72
>     67 65 74 00
>     > [487937.202841] RIP  [<ffffffffa053e650>]
>     __key.35834+0xe8c/0xffffffffffffe83c [netconsole]
>     > [487937.204226]  RSP <ffff88021f283c28>
>     > [487937.205587] CR2: ffffffffa053e650
>     > [487937.225490] ---[ end trace acab759e6893e8ec ]---
>     > [487937.225494] Kernel panic - not syncing: Fatal exception in
>     interrupt
>     > [487937.226889] panic occurred, switching back to text console
>     > [487937.228267] ------------[ cut here ]------------
>     > [487937.228272] WARNING: at
>     /build/buildd/linux-3.5.0/arch/x86/kernel/smp.c:123
>     native_smp_send_reschedule+0x5b/0x60()
>     > [487937.228274] Hardware name:
>     > [487937.228276] Modules linked in: brcompat(O) openvswitch(O)
>     netconsole configfs ip6table_filter ip6_tables iptable_filter
>     ip_tables ebtable_nat ebtables x_tables nbd ib_iser rdma_cm ib_cm
>     iw_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi
>     scsi_transport_iscsi rfcomm bnep bluetooth nfsd nfs lockd fscache
>     auth_rpcgss nfs_acl sunrpc snd_hda_codec_realtek gpio_ich coretemp
>     kvm_intel kvm ghash_clmulni_intel cryptd snd_hda_intel snd_hda_codec
>     snd_hwdep snd_pcm ppdev hid_generic snd_seq_midi snd_rawmidi
>     snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer
>     snd_seq_device psmouse serio_raw lpc_ich microcode usbhid hid
>     parport_pc dm9601 usbnet snd i915 drm_kms_helper drm soundcore
>     i2c_algo_bit snd_page_alloc video mei mac_hid lp parport e1000e
>     [last unloaded: openvswitch]
>     > [487937.228390] Pid: 0, comm: swapper/1 Tainted: G      D    O
>     3.5.0-17-generic #28-Ubuntu
>     > [487937.228393] Call Trace:
>     > [487937.228394]  <IRQ>  [<ffffffff81051c4f>]
>     warn_slowpath_common+0x7f/0xc0
>     > [487937.228403]  [<ffffffff81051caa>] warn_slowpath_null+0x1a/0x20
>     > [487937.228407]  [<ffffffff8103269b>]
>     native_smp_send_reschedule+0x5b/0x60
>     > [487937.228412]  [<ffffffff8108fad3>] trigger_load_balance+0x183/0x220
>     > [487937.228418]  [<ffffffff8108686e>] scheduler_tick+0x10e/0x140
>     > [487937.228422]  [<ffffffff810640ec>] update_process_times+0x6c/0x90
>     > [487937.228427]  [<ffffffff810a9576>] tick_sched_timer+0x66/0xc0
>     > [487937.228431]  [<ffffffff8107a329>] __run_hrtimer+0x79/0x1d0
>     > [487937.228435]  [<ffffffff810a9510>] ? tick_nohz_handler+0x110/0x110
>     > [487937.228439]  [<ffffffff8107ac47>] hrtimer_interrupt+0xf7/0x230
>     > [487937.228444]  [<ffffffff8168ba59>]
>     smp_apic_timer_interrupt+0x69/0x99
>     > [487937.228449]  [<ffffffff8168a7ca>] apic_timer_interrupt+0x6a/0x70
>     > [487937.228454]  [<ffffffff810537a5>] ? console_unlock+0x265/0x430
>     > [487937.228462]  [<ffffffffa00dc0d8>] ?
>     drm_crtc_helper_set_config+0x948/0xb10 [drm_kms_helper]
>     > [487937.228467]  [<ffffffff81674592>] ? panic+0x188/0x1c9
>     > [487937.228471]  [<ffffffff816744f9>] ? panic+0xef/0x1c9
>     > [487937.228475]  [<ffffffff81682db2>] oops_end+0xe2/0xf0
>     > [487937.228479]  [<ffffffff81673f1e>] no_context+0x253/0x27e
>     > [487937.228483]  [<ffffffff81674108>]
>     __bad_area_nosemaphore+0x1bf/0x1de
>     > [487937.228487]  [<ffffffff8167413a>] bad_area_nosemaphore+0x13/0x15
>     > [487937.228492]  [<ffffffff8168594f>] do_page_fault+0x40f/0x4e0
>     > [487937.228498]  [<ffffffffa052307d>] ? ipt_do_table+0x30d/0x5d0
>     [ip_tables]
>     > [487937.228503]  [<ffffffff815e80cb>] ? fib4_rule_action+0x6b/0x80
>     > [487937.228508]  [<ffffffff8157962a>] ? dst_alloc+0x5a/0x180
>     > [487937.228512]  [<ffffffff816821e5>] page_fault+0x25/0x30
>     > [487937.228517]  [<ffffffff815d07f3>] ? udp_queue_rcv_skb+0x1a3/0x3c0
>     > [487937.228521]  [<ffffffff815d107a>] __udp4_lib_rcv+0x1ba/0x660
>     > [487937.228526]  [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
>     > [487937.228531]  [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
>     > [487937.228535]  [<ffffffff815d153a>] udp_rcv+0x1a/0x20
>     > [487937.228540]  [<ffffffff815a4b3f>]
>     ip_local_deliver_finish+0xdf/0x260
>     > [487937.228544]  [<ffffffff815a4e57>] ip_local_deliver+0x47/0x80
>     > [487937.228549]  [<ffffffff815a4769>] ip_rcv_finish+0x79/0x370
>     > [487937.228554]  [<ffffffff815a50a4>] ip_rcv+0x214/0x320
>     > [487937.228558]  [<ffffffff81571833>] __netif_receive_skb+0x523/0x5b0
>     > [487937.228562]  [<ffffffff81571981>] process_backlog+0xc1/0x1a0
>     > [487937.228568]  [<ffffffff8103fa39>] ?
>     default_spin_lock_flags+0x9/0x10
>     > [487937.228572]  [<ffffffff815724f3>] net_rx_action+0x123/0x220
>     > [487937.228576]  [<ffffffff8105a7c6>] __do_softirq+0xb6/0x1d0
>     > [487937.228580]  [<ffffffff81036778>] ? ack_apic_level+0x78/0x130
>     > [487937.228584]  [<ffffffff8168b11c>] call_softirq+0x1c/0x30
>     > [487937.228588]  [<ffffffff81015115>] do_softirq+0x75/0xb0
>     > [487937.228592]  [<ffffffff8105ab95>] irq_exit+0xa5/0xb0
>     > [487937.228596]  [<ffffffff8168b973>] do_IRQ+0x63/0xe0
>     > [487937.228601]  [<ffffffff81681f2a>] common_interrupt+0x6a/0x6a
>     > [487937.228603]  <EOI>  [<ffffffff813901bd>] ? intel_idle+0xed/0x150
>     > [487937.228611]  [<ffffffff8139019b>] ? intel_idle+0xcb/0x150
>     > [487937.228615]  [<ffffffff81527119>] cpuidle_enter+0x19/0x20
>     > [487937.228618]  [<ffffffff81527749>] cpuidle_idle_call+0xa9/0x240
>     > [487937.228622]  [<ffffffff8101c48f>] cpu_idle+0xaf/0x120
>     > [487937.228626]  [<ffffffff8166a8bd>] start_secondary+0x1de/0x1e5
>     > [487937.228630] ---[ end trace acab759e6893e8ed ]---
>     >
>     > Thanks & Regards,
>     > Jagadish
>     >
>     > _______________________________________________
>     > dev mailing list
>     > dev at openvswitch.org <mailto:dev at openvswitch.org>
>     > http://openvswitch.org/mailman/listinfo/dev
> 
> 
> 
> 
> _______________________________________________
> dev mailing list
> dev at openvswitch.org
> http://openvswitch.org/mailman/listinfo/dev
> 



More information about the dev mailing list