[ovs-dev] Kernel Crash with VXLAN source code
Kyle Mestery (kmestery)
kmestery at cisco.com
Sat Feb 16 18:19:45 UTC 2013
VXLAN is currently in a state of flux upstream due to the flow-based tunneling changes. I would
wait another few weeks for things to settle down.
Alternatively, you could move to the below commit. I've tested things fairly well at this commit
and it works for what I was using it for:
commit 3b6f2889400fd340b851c2d36356457559ae6e81
Author: Kyle Mestery <kmestery at cisco.com>
Date: Wed Jan 9 14:47:41 2013 -0500
datapath: Fix a kernel crash when adding a 2nd VXLAN port with existing UDP port
When creating a second VXLAN tunnel port with the same UDP
port as an existing VXLAN tunnel port, make sure to set
*vxport before returning. Fixes a kernel crash.
Reported-by: Todd Ruch <Todd.Ruch at wwtas.com>
Signed-off-by: Kyle Mestery <kmestery at cisco.com>
Signed-off-by: Jesse Gross <jesse at nicira.com>
Thanks,
Kyle
On Feb 16, 2013, at 1:28 AM, Jagadish Nadimpalli <jagadish.nadimpalli at oneconvergence.com> wrote:
> Hi All,
>
> I downloaded it and tried it for VXLAN. I am seeing the error "cannot register vxlan protocol handler" and the tunnels doesn't get created. Looks like the vxlan_socket_init() function is failing to create vxlan socket.
>
> Any ideas on what is the issue?
>
> Thanks & Regards,
> Jagadish
>
> On Fri, Feb 15, 2013 at 7:22 PM, Jagadish Nadimpalli <jagadish.nadimpalli at oneconvergence.com> wrote:
> Thanks Lori. I downloaded it from the git repo of openvswitch.
>
>
> On Fri, Feb 15, 2013 at 6:45 PM, Lori Jakab <lojakab at cisco.com> wrote:
> Hi Jagadish,
>
> VXLAN has been accepted into the official Open vSwitch distribution, so
> you should use that repository instead. Justin referred to branch-1.10
> and master from there. To check out that repository, see
>
> http://openvswitch.org/development/
>
> -Lori
>
> On 02/15/13 15:05, Jagadish Nadimpalli wrote:
> > Justin,
> >
> > Thanks for your response.
> >
> > Could you please let me know what is this branch-1.10. Is this
> > openvswitch version? Could you please let me know what is this tip of
> > master. Is this a git repo?
> >
> > Thanks & Regards,
> > Jagadish
> >
> > On Fri, Feb 15, 2013 at 1:24 PM, Justin Pettit <jpettit at nicira.com
> > <mailto:jpettit at nicira.com>> wrote:
> >
> > The VXLAN changes were upstreamed a little while ago. Can you try
> > either the tip of master or the branch "branch-1.10"?
> >
> > --Justin
> >
> >
> > On Feb 14, 2013, at 11:28 PM, Jagadish Nadimpalli
> > <jagadish.nadimpalli at oneconvergence.com
> > <mailto:jagadish.nadimpalli at oneconvergence.com>> wrote:
> >
> > > Hi All,
> > >
> > > We are using the VXLAN changes done to the open vswitch. We have
> > taken these changes from https://github.com/mestery/ovs-vxlan. I
> > think this is not added to main line openvswitch source code.
> > >
> > > We are observing a Kernel crash issue with this code. Just wanted
> > to check if this issue is already fixed. Below is the Kernel stack
> > trace.
> > >
> > > [487924.571433] IPv6: ADDRCONF(NETDEV_CHANGE): tapff5e1f54-98:
> > link becomes ready
> > > [487937.156992] kernel tried to execute NX-protected page -
> > exploit attempt? (uid: 0)
> > > [487937.157057] BUG: unable to handle kernel paging request at
> > ffffffffa053e650
> > > [487937.157112] IP: [<ffffffffa053e650>]
> > __key.35834+0xe8c/0xffffffffffffe83c [netconsole]
> > > [487937.157172] PGD 1c0d067 PUD 1c11063 PMD 202557067 PTE
> > 80000001ead67163
> > > [487937.157229] Oops: 0011 [#1] SMP
> > > [487937.157259] CPU 1
> > > [487937.157275] Modules linked in:[487937.157300] brcompat(O)
> > openvswitch(O) netconsole configfs ip6table_filter ip6_tables
> > iptable_filter ip_tables ebtable_nat ebtables x_tables nbd ib_iser
> > rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp
> > libiscsi_tcp libiscsi scsi_transport_iscsi rfcomm bnep bluetooth
> > nfsd nfs lockd fscache auth_rpcgss nfs_acl sunrpc
> > snd_hda_codec_realtek gpio_ich coretemp kvm_intel kvm
> > ghash_clmulni_intel cryptd snd_hda_intel snd_hda_codec snd_hwdep
> > snd_pcm ppdev hid_generic snd_seq_midi snd_rawmidi
> > snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer
> > snd_seq_device psmouse serio_raw lpc_ich microcode usbhid hid
> > parport_pc dm9601 usbnet snd i915 drm_kms_helper drm soundcore
> > i2c_algo_bit snd_page_alloc video mei mac_hid lp parport e1000e
> > [last unloaded: openvswitch]
> > >
> > > [487937.157952] Pid: 0, comm: swapper/1 Tainted: G O
> > 3.5.0-17-generic #28-Ubuntu /DH61WW
> > > [487937.158025] RIP: 0010:[<ffffffffa053e650>]
> > [<ffffffffa053e650>] __key.35834+0xe8c/0xffffffffffffe83c [netconsole]
> > > [487937.158096] RSP: 0018:ffff88021f283c28 EFLAGS: 00010286
> > > [487937.158132] RAX: ffffffffa053e650 RBX: ffff8801b4590900 RCX:
> > ffff88020fce3100
> > > [487937.158179] RDX: 0000000000000000 RSI: ffff8801b4590900 RDI:
> > ffff88020fce3100
> > > [487937.158225] RBP: ffff88021f283c50 R08: 0000000000000003 R09:
> > 0000000000000003
> > > [487937.158272] R10: 0000000000000000 R11: 00000000e80a0a64 R12:
> > ffff88020fce3100
> > > [487937.158319] R13: 0000000000000000 R14: 0000000000000000 R15:
> > 000000000000005a
> > > [487937.158366] FS: 0000000000000000(0000)
> > GS:ffff88021f280000(0000) knlGS:0000000000000000
> > > [487937.158418] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> > > [487937.158456] CR2: ffffffffa053e650 CR3: 0000000001c0b000 CR4:
> > 00000000001427e0
> > > [487937.158503] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> > 0000000000000000
> > > [487937.158549] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> > 0000000000000400
> > > [487937.158597] Process swapper/1 (pid: 0, threadinfo
> > ffff880213926000, task ffff880213902e00)
> > > [487937.158649] Stack:
> > > [487937.158665] ffffffff815d07f3 ffff8801b4590900
> > 0000000000000011 ffff88005f8f37e5
> > > [487937.158725] ffffffff81ca8c00 ffff88021f283cc0
> > ffffffff815d107a ffffffff81cdb5c0
> > > [487937.158784] ffffffff815a4a60 0000000000000008
> > ffff88020fce3100 ffff88021f283d00
> > > [487937.158843] Call Trace:
> > > [487937.158862] <IRQ>
> > > [487937.158879] [<ffffffff815d07f3>] ? udp_queue_rcv_skb+0x1a3/0x3c0
> > > [487937.158931] [<ffffffff815d107a>] __udp4_lib_rcv+0x1ba/0x660
> > > [487937.158973] [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
> > > [487937.160780] [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
> > > [487937.162562] [<ffffffff815d153a>] udp_rcv+0x1a/0x20
> > > [487937.164342] [<ffffffff815a4b3f>]
> > ip_local_deliver_finish+0xdf/0x260
> > > [487937.166124] [<ffffffff815a4e57>] ip_local_deliver+0x47/0x80
> > > [487937.167884] [<ffffffff815a4769>] ip_rcv_finish+0x79/0x370
> > > [487937.169627] [<ffffffff815a50a4>] ip_rcv+0x214/0x320
> > > [487937.171342] [<ffffffff81571833>] __netif_receive_skb+0x523/0x5b0
> > > [487937.173055] [<ffffffff81571981>] process_backlog+0xc1/0x1a0
> > > [487937.174758] [<ffffffff8103fa39>] ?
> > default_spin_lock_flags+0x9/0x10
> > > [487937.176470] [<ffffffff815724f3>] net_rx_action+0x123/0x220
> > > [487937.178181] [<ffffffff8105a7c6>] __do_softirq+0xb6/0x1d0
> > > [487937.179883] [<ffffffff81036778>] ? ack_apic_level+0x78/0x130
> > > [487937.181598] [<ffffffff8168b11c>] call_softirq+0x1c/0x30
> > > [487937.183293] [<ffffffff81015115>] do_softirq+0x75/0xb0
> > > [487937.184960] [<ffffffff8105ab95>] irq_exit+0xa5/0xb0
> > > [487937.186607] [<ffffffff8168b973>] do_IRQ+0x63/0xe0
> > > [487937.188231] [<ffffffff81681f2a>] common_interrupt+0x6a/0x6a
> > > [487937.189847] <EOI>
> > > [487937.189863] [<ffffffff813901bd>] ? intel_idle+0xed/0x150
> > > [487937.193042] [<ffffffff8139019b>] ? intel_idle+0xcb/0x150
> > > [487937.194545] [<ffffffff81527119>] cpuidle_enter+0x19/0x20
> > > [487937.195984] [<ffffffff81527749>] cpuidle_idle_call+0xa9/0x240
> > > [487937.197357] [<ffffffff8101c48f>] cpu_idle+0xaf/0x120
> > > [487937.198663] [<ffffffff8166a8bd>] start_secondary+0x1de/0x1e5
> > > [487937.199924] Code: 6e 73 6f 6c 65 5f 6e 65 74 64 65 76 5f 65 76
> > 65 6e 74 00 74 61 72 67 65 74 5f 6c 69 73 74 00 77 72 69 74 65 5f 6d
> > 73 67 00 6d 61 <6b> 65 5f 6e 65 74 63 6f 6e 73 6f 6c 65 5f 74 61 72
> > 67 65 74 00
> > > [487937.202841] RIP [<ffffffffa053e650>]
> > __key.35834+0xe8c/0xffffffffffffe83c [netconsole]
> > > [487937.204226] RSP <ffff88021f283c28>
> > > [487937.205587] CR2: ffffffffa053e650
> > > [487937.225490] ---[ end trace acab759e6893e8ec ]---
> > > [487937.225494] Kernel panic - not syncing: Fatal exception in
> > interrupt
> > > [487937.226889] panic occurred, switching back to text console
> > > [487937.228267] ------------[ cut here ]------------
> > > [487937.228272] WARNING: at
> > /build/buildd/linux-3.5.0/arch/x86/kernel/smp.c:123
> > native_smp_send_reschedule+0x5b/0x60()
> > > [487937.228274] Hardware name:
> > > [487937.228276] Modules linked in: brcompat(O) openvswitch(O)
> > netconsole configfs ip6table_filter ip6_tables iptable_filter
> > ip_tables ebtable_nat ebtables x_tables nbd ib_iser rdma_cm ib_cm
> > iw_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi
> > scsi_transport_iscsi rfcomm bnep bluetooth nfsd nfs lockd fscache
> > auth_rpcgss nfs_acl sunrpc snd_hda_codec_realtek gpio_ich coretemp
> > kvm_intel kvm ghash_clmulni_intel cryptd snd_hda_intel snd_hda_codec
> > snd_hwdep snd_pcm ppdev hid_generic snd_seq_midi snd_rawmidi
> > snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer
> > snd_seq_device psmouse serio_raw lpc_ich microcode usbhid hid
> > parport_pc dm9601 usbnet snd i915 drm_kms_helper drm soundcore
> > i2c_algo_bit snd_page_alloc video mei mac_hid lp parport e1000e
> > [last unloaded: openvswitch]
> > > [487937.228390] Pid: 0, comm: swapper/1 Tainted: G D O
> > 3.5.0-17-generic #28-Ubuntu
> > > [487937.228393] Call Trace:
> > > [487937.228394] <IRQ> [<ffffffff81051c4f>]
> > warn_slowpath_common+0x7f/0xc0
> > > [487937.228403] [<ffffffff81051caa>] warn_slowpath_null+0x1a/0x20
> > > [487937.228407] [<ffffffff8103269b>]
> > native_smp_send_reschedule+0x5b/0x60
> > > [487937.228412] [<ffffffff8108fad3>] trigger_load_balance+0x183/0x220
> > > [487937.228418] [<ffffffff8108686e>] scheduler_tick+0x10e/0x140
> > > [487937.228422] [<ffffffff810640ec>] update_process_times+0x6c/0x90
> > > [487937.228427] [<ffffffff810a9576>] tick_sched_timer+0x66/0xc0
> > > [487937.228431] [<ffffffff8107a329>] __run_hrtimer+0x79/0x1d0
> > > [487937.228435] [<ffffffff810a9510>] ? tick_nohz_handler+0x110/0x110
> > > [487937.228439] [<ffffffff8107ac47>] hrtimer_interrupt+0xf7/0x230
> > > [487937.228444] [<ffffffff8168ba59>]
> > smp_apic_timer_interrupt+0x69/0x99
> > > [487937.228449] [<ffffffff8168a7ca>] apic_timer_interrupt+0x6a/0x70
> > > [487937.228454] [<ffffffff810537a5>] ? console_unlock+0x265/0x430
> > > [487937.228462] [<ffffffffa00dc0d8>] ?
> > drm_crtc_helper_set_config+0x948/0xb10 [drm_kms_helper]
> > > [487937.228467] [<ffffffff81674592>] ? panic+0x188/0x1c9
> > > [487937.228471] [<ffffffff816744f9>] ? panic+0xef/0x1c9
> > > [487937.228475] [<ffffffff81682db2>] oops_end+0xe2/0xf0
> > > [487937.228479] [<ffffffff81673f1e>] no_context+0x253/0x27e
> > > [487937.228483] [<ffffffff81674108>]
> > __bad_area_nosemaphore+0x1bf/0x1de
> > > [487937.228487] [<ffffffff8167413a>] bad_area_nosemaphore+0x13/0x15
> > > [487937.228492] [<ffffffff8168594f>] do_page_fault+0x40f/0x4e0
> > > [487937.228498] [<ffffffffa052307d>] ? ipt_do_table+0x30d/0x5d0
> > [ip_tables]
> > > [487937.228503] [<ffffffff815e80cb>] ? fib4_rule_action+0x6b/0x80
> > > [487937.228508] [<ffffffff8157962a>] ? dst_alloc+0x5a/0x180
> > > [487937.228512] [<ffffffff816821e5>] page_fault+0x25/0x30
> > > [487937.228517] [<ffffffff815d07f3>] ? udp_queue_rcv_skb+0x1a3/0x3c0
> > > [487937.228521] [<ffffffff815d107a>] __udp4_lib_rcv+0x1ba/0x660
> > > [487937.228526] [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
> > > [487937.228531] [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
> > > [487937.228535] [<ffffffff815d153a>] udp_rcv+0x1a/0x20
> > > [487937.228540] [<ffffffff815a4b3f>]
> > ip_local_deliver_finish+0xdf/0x260
> > > [487937.228544] [<ffffffff815a4e57>] ip_local_deliver+0x47/0x80
> > > [487937.228549] [<ffffffff815a4769>] ip_rcv_finish+0x79/0x370
> > > [487937.228554] [<ffffffff815a50a4>] ip_rcv+0x214/0x320
> > > [487937.228558] [<ffffffff81571833>] __netif_receive_skb+0x523/0x5b0
> > > [487937.228562] [<ffffffff81571981>] process_backlog+0xc1/0x1a0
> > > [487937.228568] [<ffffffff8103fa39>] ?
> > default_spin_lock_flags+0x9/0x10
> > > [487937.228572] [<ffffffff815724f3>] net_rx_action+0x123/0x220
> > > [487937.228576] [<ffffffff8105a7c6>] __do_softirq+0xb6/0x1d0
> > > [487937.228580] [<ffffffff81036778>] ? ack_apic_level+0x78/0x130
> > > [487937.228584] [<ffffffff8168b11c>] call_softirq+0x1c/0x30
> > > [487937.228588] [<ffffffff81015115>] do_softirq+0x75/0xb0
> > > [487937.228592] [<ffffffff8105ab95>] irq_exit+0xa5/0xb0
> > > [487937.228596] [<ffffffff8168b973>] do_IRQ+0x63/0xe0
> > > [487937.228601] [<ffffffff81681f2a>] common_interrupt+0x6a/0x6a
> > > [487937.228603] <EOI> [<ffffffff813901bd>] ? intel_idle+0xed/0x150
> > > [487937.228611] [<ffffffff8139019b>] ? intel_idle+0xcb/0x150
> > > [487937.228615] [<ffffffff81527119>] cpuidle_enter+0x19/0x20
> > > [487937.228618] [<ffffffff81527749>] cpuidle_idle_call+0xa9/0x240
> > > [487937.228622] [<ffffffff8101c48f>] cpu_idle+0xaf/0x120
> > > [487937.228626] [<ffffffff8166a8bd>] start_secondary+0x1de/0x1e5
> > > [487937.228630] ---[ end trace acab759e6893e8ed ]---
> > >
> > > Thanks & Regards,
> > > Jagadish
> > >
> > > _______________________________________________
> > > dev mailing list
> > > dev at openvswitch.org <mailto:dev at openvswitch.org>
> > > http://openvswitch.org/mailman/listinfo/dev
> >
> >
> >
> >
> > _______________________________________________
> > dev mailing list
> > dev at openvswitch.org
> > http://openvswitch.org/mailman/listinfo/dev
> >
>
>
> _______________________________________________
> dev mailing list
> dev at openvswitch.org
> http://openvswitch.org/mailman/listinfo/dev
More information about the dev
mailing list