[ovs-dev] Kernel Crash with VXLAN source code

Jagadish Nadimpalli jagadish.nadimpalli at oneconvergence.com
Mon Mar 11 17:13:06 UTC 2013


Hi All,

There is an un-closed socket as I was experimenting without restarting the
machine. So, this issue got resolved after I restart the machine. Now, the
VXLAN code works without any crashes. I have taken the master git.

Thanks a lot for all of your help.

Thanks & Regards,
Jagadish

On Sat, Feb 16, 2013 at 12:58 PM, Jagadish Nadimpalli <
jagadish.nadimpalli at oneconvergence.com> wrote:

> Hi All,
>
> I downloaded it and tried it for VXLAN. I am seeing the error "cannot
> register vxlan protocol handler" and the tunnels doesn't get created. Looks
> like the vxlan_socket_init() function is failing to create vxlan socket.
>
> Any ideas on what is the issue?
>
> Thanks & Regards,
> Jagadish
>
>
> On Fri, Feb 15, 2013 at 7:22 PM, Jagadish Nadimpalli <
> jagadish.nadimpalli at oneconvergence.com> wrote:
>
>> Thanks Lori. I downloaded it from the git repo of openvswitch.
>>
>>
>> On Fri, Feb 15, 2013 at 6:45 PM, Lori Jakab <lojakab at cisco.com> wrote:
>>
>>> Hi Jagadish,
>>>
>>> VXLAN has been accepted into the official Open vSwitch distribution, so
>>> you should use that repository instead.  Justin referred to branch-1.10
>>> and master from there.  To check out that repository, see
>>>
>>> http://openvswitch.org/development/
>>>
>>> -Lori
>>>
>>> On 02/15/13 15:05, Jagadish Nadimpalli wrote:
>>> > Justin,
>>> >
>>> > Thanks for your response.
>>> >
>>> > Could you please let me know what is this branch-1.10. Is this
>>> > openvswitch version? Could you please let me know what is this tip of
>>> > master. Is this a git repo?
>>> >
>>> > Thanks & Regards,
>>> > Jagadish
>>> >
>>> > On Fri, Feb 15, 2013 at 1:24 PM, Justin Pettit <jpettit at nicira.com
>>> > <mailto:jpettit at nicira.com>> wrote:
>>> >
>>> >     The VXLAN changes were upstreamed a little while ago.  Can you try
>>> >     either the tip of master or the branch "branch-1.10"?
>>> >
>>> >     --Justin
>>> >
>>> >
>>> >     On Feb 14, 2013, at 11:28 PM, Jagadish Nadimpalli
>>> >     <jagadish.nadimpalli at oneconvergence.com
>>> >     <mailto:jagadish.nadimpalli at oneconvergence.com>> wrote:
>>> >
>>> >     > Hi All,
>>> >     >
>>> >     > We are using the VXLAN changes done to the open vswitch. We have
>>> >     taken these changes from https://github.com/mestery/ovs-vxlan. I
>>> >     think this is not added to main line openvswitch source code.
>>> >     >
>>> >     > We are observing a Kernel crash issue with this code. Just wanted
>>> >     to check if this issue is already fixed. Below is the Kernel stack
>>> >     trace.
>>> >     >
>>> >     > [487924.571433] IPv6: ADDRCONF(NETDEV_CHANGE): tapff5e1f54-98:
>>> >     link becomes ready
>>> >     > [487937.156992] kernel tried to execute NX-protected page -
>>> >     exploit attempt? (uid: 0)
>>> >     > [487937.157057] BUG: unable to handle kernel paging request at
>>> >     ffffffffa053e650
>>> >     > [487937.157112] IP: [<ffffffffa053e650>]
>>> >     __key.35834+0xe8c/0xffffffffffffe83c [netconsole]
>>> >     > [487937.157172] PGD 1c0d067 PUD 1c11063 PMD 202557067 PTE
>>> >     80000001ead67163
>>> >     > [487937.157229] Oops: 0011 [#1] SMP
>>> >     > [487937.157259] CPU 1
>>> >     > [487937.157275] Modules linked in:[487937.157300]  brcompat(O)
>>> >     openvswitch(O) netconsole configfs ip6table_filter ip6_tables
>>> >     iptable_filter ip_tables ebtable_nat ebtables x_tables nbd ib_iser
>>> >     rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp
>>> >     libiscsi_tcp libiscsi scsi_transport_iscsi rfcomm bnep bluetooth
>>> >     nfsd nfs lockd fscache auth_rpcgss nfs_acl sunrpc
>>> >     snd_hda_codec_realtek gpio_ich coretemp kvm_intel kvm
>>> >     ghash_clmulni_intel cryptd snd_hda_intel snd_hda_codec snd_hwdep
>>> >     snd_pcm ppdev hid_generic snd_seq_midi snd_rawmidi
>>> >     snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer
>>> >     snd_seq_device psmouse serio_raw lpc_ich microcode usbhid hid
>>> >     parport_pc dm9601 usbnet snd i915 drm_kms_helper drm soundcore
>>> >     i2c_algo_bit snd_page_alloc video mei mac_hid lp parport e1000e
>>> >     [last unloaded: openvswitch]
>>> >     >
>>> >     > [487937.157952] Pid: 0, comm: swapper/1 Tainted: G           O
>>> >     3.5.0-17-generic #28-Ubuntu                  /DH61WW
>>> >     > [487937.158025] RIP: 0010:[<ffffffffa053e650>]
>>> >      [<ffffffffa053e650>] __key.35834+0xe8c/0xffffffffffffe83c
>>> [netconsole]
>>> >     > [487937.158096] RSP: 0018:ffff88021f283c28  EFLAGS: 00010286
>>> >     > [487937.158132] RAX: ffffffffa053e650 RBX: ffff8801b4590900 RCX:
>>> >     ffff88020fce3100
>>> >     > [487937.158179] RDX: 0000000000000000 RSI: ffff8801b4590900 RDI:
>>> >     ffff88020fce3100
>>> >     > [487937.158225] RBP: ffff88021f283c50 R08: 0000000000000003 R09:
>>> >     0000000000000003
>>> >     > [487937.158272] R10: 0000000000000000 R11: 00000000e80a0a64 R12:
>>> >     ffff88020fce3100
>>> >     > [487937.158319] R13: 0000000000000000 R14: 0000000000000000 R15:
>>> >     000000000000005a
>>> >     > [487937.158366] FS:  0000000000000000(0000)
>>> >     GS:ffff88021f280000(0000) knlGS:0000000000000000
>>> >     > [487937.158418] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>> >     > [487937.158456] CR2: ffffffffa053e650 CR3: 0000000001c0b000 CR4:
>>> >     00000000001427e0
>>> >     > [487937.158503] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>>> >     0000000000000000
>>> >     > [487937.158549] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>>> >     0000000000000400
>>> >     > [487937.158597] Process swapper/1 (pid: 0, threadinfo
>>> >     ffff880213926000, task ffff880213902e00)
>>> >     > [487937.158649] Stack:
>>> >     > [487937.158665]  ffffffff815d07f3 ffff8801b4590900
>>> >     0000000000000011 ffff88005f8f37e5
>>> >     > [487937.158725]  ffffffff81ca8c00 ffff88021f283cc0
>>> >     ffffffff815d107a ffffffff81cdb5c0
>>> >     > [487937.158784]  ffffffff815a4a60 0000000000000008
>>> >     ffff88020fce3100 ffff88021f283d00
>>> >     > [487937.158843] Call Trace:
>>> >     > [487937.158862]  <IRQ>
>>> >     > [487937.158879]  [<ffffffff815d07f3>] ?
>>> udp_queue_rcv_skb+0x1a3/0x3c0
>>> >     > [487937.158931]  [<ffffffff815d107a>] __udp4_lib_rcv+0x1ba/0x660
>>> >     > [487937.158973]  [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
>>> >     > [487937.160780]  [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
>>> >     > [487937.162562]  [<ffffffff815d153a>] udp_rcv+0x1a/0x20
>>> >     > [487937.164342]  [<ffffffff815a4b3f>]
>>> >     ip_local_deliver_finish+0xdf/0x260
>>> >     > [487937.166124]  [<ffffffff815a4e57>] ip_local_deliver+0x47/0x80
>>> >     > [487937.167884]  [<ffffffff815a4769>] ip_rcv_finish+0x79/0x370
>>> >     > [487937.169627]  [<ffffffff815a50a4>] ip_rcv+0x214/0x320
>>> >     > [487937.171342]  [<ffffffff81571833>]
>>> __netif_receive_skb+0x523/0x5b0
>>> >     > [487937.173055]  [<ffffffff81571981>] process_backlog+0xc1/0x1a0
>>> >     > [487937.174758]  [<ffffffff8103fa39>] ?
>>> >     default_spin_lock_flags+0x9/0x10
>>> >     > [487937.176470]  [<ffffffff815724f3>] net_rx_action+0x123/0x220
>>> >     > [487937.178181]  [<ffffffff8105a7c6>] __do_softirq+0xb6/0x1d0
>>> >     > [487937.179883]  [<ffffffff81036778>] ? ack_apic_level+0x78/0x130
>>> >     > [487937.181598]  [<ffffffff8168b11c>] call_softirq+0x1c/0x30
>>> >     > [487937.183293]  [<ffffffff81015115>] do_softirq+0x75/0xb0
>>> >     > [487937.184960]  [<ffffffff8105ab95>] irq_exit+0xa5/0xb0
>>> >     > [487937.186607]  [<ffffffff8168b973>] do_IRQ+0x63/0xe0
>>> >     > [487937.188231]  [<ffffffff81681f2a>] common_interrupt+0x6a/0x6a
>>> >     > [487937.189847]  <EOI>
>>> >     > [487937.189863]  [<ffffffff813901bd>] ? intel_idle+0xed/0x150
>>> >     > [487937.193042]  [<ffffffff8139019b>] ? intel_idle+0xcb/0x150
>>> >     > [487937.194545]  [<ffffffff81527119>] cpuidle_enter+0x19/0x20
>>> >     > [487937.195984]  [<ffffffff81527749>]
>>> cpuidle_idle_call+0xa9/0x240
>>> >     > [487937.197357]  [<ffffffff8101c48f>] cpu_idle+0xaf/0x120
>>> >     > [487937.198663]  [<ffffffff8166a8bd>] start_secondary+0x1de/0x1e5
>>> >     > [487937.199924] Code: 6e 73 6f 6c 65 5f 6e 65 74 64 65 76 5f 65
>>> 76
>>> >     65 6e 74 00 74 61 72 67 65 74 5f 6c 69 73 74 00 77 72 69 74 65 5f
>>> 6d
>>> >     73 67 00 6d 61 <6b> 65 5f 6e 65 74 63 6f 6e 73 6f 6c 65 5f 74 61 72
>>> >     67 65 74 00
>>> >     > [487937.202841] RIP  [<ffffffffa053e650>]
>>> >     __key.35834+0xe8c/0xffffffffffffe83c [netconsole]
>>> >     > [487937.204226]  RSP <ffff88021f283c28>
>>> >     > [487937.205587] CR2: ffffffffa053e650
>>> >     > [487937.225490] ---[ end trace acab759e6893e8ec ]---
>>> >     > [487937.225494] Kernel panic - not syncing: Fatal exception in
>>> >     interrupt
>>> >     > [487937.226889] panic occurred, switching back to text console
>>> >     > [487937.228267] ------------[ cut here ]------------
>>> >     > [487937.228272] WARNING: at
>>> >     /build/buildd/linux-3.5.0/arch/x86/kernel/smp.c:123
>>> >     native_smp_send_reschedule+0x5b/0x60()
>>> >     > [487937.228274] Hardware name:
>>> >     > [487937.228276] Modules linked in: brcompat(O) openvswitch(O)
>>> >     netconsole configfs ip6table_filter ip6_tables iptable_filter
>>> >     ip_tables ebtable_nat ebtables x_tables nbd ib_iser rdma_cm ib_cm
>>> >     iw_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi
>>> >     scsi_transport_iscsi rfcomm bnep bluetooth nfsd nfs lockd fscache
>>> >     auth_rpcgss nfs_acl sunrpc snd_hda_codec_realtek gpio_ich coretemp
>>> >     kvm_intel kvm ghash_clmulni_intel cryptd snd_hda_intel
>>> snd_hda_codec
>>> >     snd_hwdep snd_pcm ppdev hid_generic snd_seq_midi snd_rawmidi
>>> >     snd_seq_midi_event snd_seq dm_multipath scsi_dh snd_timer
>>> >     snd_seq_device psmouse serio_raw lpc_ich microcode usbhid hid
>>> >     parport_pc dm9601 usbnet snd i915 drm_kms_helper drm soundcore
>>> >     i2c_algo_bit snd_page_alloc video mei mac_hid lp parport e1000e
>>> >     [last unloaded: openvswitch]
>>> >     > [487937.228390] Pid: 0, comm: swapper/1 Tainted: G      D    O
>>> >     3.5.0-17-generic #28-Ubuntu
>>> >     > [487937.228393] Call Trace:
>>> >     > [487937.228394]  <IRQ>  [<ffffffff81051c4f>]
>>> >     warn_slowpath_common+0x7f/0xc0
>>> >     > [487937.228403]  [<ffffffff81051caa>]
>>> warn_slowpath_null+0x1a/0x20
>>> >     > [487937.228407]  [<ffffffff8103269b>]
>>> >     native_smp_send_reschedule+0x5b/0x60
>>> >     > [487937.228412]  [<ffffffff8108fad3>]
>>> trigger_load_balance+0x183/0x220
>>> >     > [487937.228418]  [<ffffffff8108686e>] scheduler_tick+0x10e/0x140
>>> >     > [487937.228422]  [<ffffffff810640ec>]
>>> update_process_times+0x6c/0x90
>>> >     > [487937.228427]  [<ffffffff810a9576>] tick_sched_timer+0x66/0xc0
>>> >     > [487937.228431]  [<ffffffff8107a329>] __run_hrtimer+0x79/0x1d0
>>> >     > [487937.228435]  [<ffffffff810a9510>] ?
>>> tick_nohz_handler+0x110/0x110
>>> >     > [487937.228439]  [<ffffffff8107ac47>]
>>> hrtimer_interrupt+0xf7/0x230
>>> >     > [487937.228444]  [<ffffffff8168ba59>]
>>> >     smp_apic_timer_interrupt+0x69/0x99
>>> >     > [487937.228449]  [<ffffffff8168a7ca>]
>>> apic_timer_interrupt+0x6a/0x70
>>> >     > [487937.228454]  [<ffffffff810537a5>] ?
>>> console_unlock+0x265/0x430
>>> >     > [487937.228462]  [<ffffffffa00dc0d8>] ?
>>> >     drm_crtc_helper_set_config+0x948/0xb10 [drm_kms_helper]
>>> >     > [487937.228467]  [<ffffffff81674592>] ? panic+0x188/0x1c9
>>> >     > [487937.228471]  [<ffffffff816744f9>] ? panic+0xef/0x1c9
>>> >     > [487937.228475]  [<ffffffff81682db2>] oops_end+0xe2/0xf0
>>> >     > [487937.228479]  [<ffffffff81673f1e>] no_context+0x253/0x27e
>>> >     > [487937.228483]  [<ffffffff81674108>]
>>> >     __bad_area_nosemaphore+0x1bf/0x1de
>>> >     > [487937.228487]  [<ffffffff8167413a>]
>>> bad_area_nosemaphore+0x13/0x15
>>> >     > [487937.228492]  [<ffffffff8168594f>] do_page_fault+0x40f/0x4e0
>>> >     > [487937.228498]  [<ffffffffa052307d>] ? ipt_do_table+0x30d/0x5d0
>>> >     [ip_tables]
>>> >     > [487937.228503]  [<ffffffff815e80cb>] ?
>>> fib4_rule_action+0x6b/0x80
>>> >     > [487937.228508]  [<ffffffff8157962a>] ? dst_alloc+0x5a/0x180
>>> >     > [487937.228512]  [<ffffffff816821e5>] page_fault+0x25/0x30
>>> >     > [487937.228517]  [<ffffffff815d07f3>] ?
>>> udp_queue_rcv_skb+0x1a3/0x3c0
>>> >     > [487937.228521]  [<ffffffff815d107a>] __udp4_lib_rcv+0x1ba/0x660
>>> >     > [487937.228526]  [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
>>> >     > [487937.228531]  [<ffffffff815a4a60>] ? ip_rcv_finish+0x370/0x370
>>> >     > [487937.228535]  [<ffffffff815d153a>] udp_rcv+0x1a/0x20
>>> >     > [487937.228540]  [<ffffffff815a4b3f>]
>>> >     ip_local_deliver_finish+0xdf/0x260
>>> >     > [487937.228544]  [<ffffffff815a4e57>] ip_local_deliver+0x47/0x80
>>> >     > [487937.228549]  [<ffffffff815a4769>] ip_rcv_finish+0x79/0x370
>>> >     > [487937.228554]  [<ffffffff815a50a4>] ip_rcv+0x214/0x320
>>> >     > [487937.228558]  [<ffffffff81571833>]
>>> __netif_receive_skb+0x523/0x5b0
>>> >     > [487937.228562]  [<ffffffff81571981>] process_backlog+0xc1/0x1a0
>>> >     > [487937.228568]  [<ffffffff8103fa39>] ?
>>> >     default_spin_lock_flags+0x9/0x10
>>> >     > [487937.228572]  [<ffffffff815724f3>] net_rx_action+0x123/0x220
>>> >     > [487937.228576]  [<ffffffff8105a7c6>] __do_softirq+0xb6/0x1d0
>>> >     > [487937.228580]  [<ffffffff81036778>] ? ack_apic_level+0x78/0x130
>>> >     > [487937.228584]  [<ffffffff8168b11c>] call_softirq+0x1c/0x30
>>> >     > [487937.228588]  [<ffffffff81015115>] do_softirq+0x75/0xb0
>>> >     > [487937.228592]  [<ffffffff8105ab95>] irq_exit+0xa5/0xb0
>>> >     > [487937.228596]  [<ffffffff8168b973>] do_IRQ+0x63/0xe0
>>> >     > [487937.228601]  [<ffffffff81681f2a>] common_interrupt+0x6a/0x6a
>>> >     > [487937.228603]  <EOI>  [<ffffffff813901bd>] ?
>>> intel_idle+0xed/0x150
>>> >     > [487937.228611]  [<ffffffff8139019b>] ? intel_idle+0xcb/0x150
>>> >     > [487937.228615]  [<ffffffff81527119>] cpuidle_enter+0x19/0x20
>>> >     > [487937.228618]  [<ffffffff81527749>]
>>> cpuidle_idle_call+0xa9/0x240
>>> >     > [487937.228622]  [<ffffffff8101c48f>] cpu_idle+0xaf/0x120
>>> >     > [487937.228626]  [<ffffffff8166a8bd>] start_secondary+0x1de/0x1e5
>>> >     > [487937.228630] ---[ end trace acab759e6893e8ed ]---
>>> >     >
>>> >     > Thanks & Regards,
>>> >     > Jagadish
>>> >     >
>>> >     > _______________________________________________
>>> >     > dev mailing list
>>> >     > dev at openvswitch.org <mailto:dev at openvswitch.org>
>>> >     > http://openvswitch.org/mailman/listinfo/dev
>>> >
>>> >
>>> >
>>> >
>>> > _______________________________________________
>>> > dev mailing list
>>> > dev at openvswitch.org
>>> > http://openvswitch.org/mailman/listinfo/dev
>>> >
>>>
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.openvswitch.org/pipermail/ovs-dev/attachments/20130311/167815bd/attachment-0003.html>


More information about the dev mailing list