[ovs-discuss] Fw:assert failure for recirc_id_node_unref
汪翰林
hanlin_wang at 163.com
Thu Dec 20 03:07:09 UTC 2018
Anyone met this case or give some suggestions, many thanks!
-------- Forwarding messages --------
From: "汪翰林" <hanlin_wang at 163.com>
Date: 2018-12-15 15:35:40
To: "bugs at openvswitch.org" <bugs at openvswitch.org>
Subject: assert failure for recirc_id_node_unref
hi，we got assert failure when running openvswitch for a long time, maybe some weeks or some months. Openvswitch ran in kernel datapath and with version 2.8.2, and used CT also.
error stack information：
(gdb) bt
#0 0x00007f6e9c66efff in raise () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f6e9c67042a in abort () from /lib/x86_64-linux-gnu/libc.so.6
#2 0x00007f6e9d45732e in ovs_abort_valist (err_no=err_no at entry=0, format=format at entry=0x7f6e9d4c7750 "%s: assertion %s failed in %s()",
args=args at entry=0x7f6e9a534b50) at lib/util.c:343
#3 0x00007f6e9d45f080 in vlog_abort_valist (module_=<optimized out>, message=0x7f6e9d4c7750 "%s: assertion %s failed in %s()", args=args at entry=0x7f6e9a534b50)
at lib/vlog.c:1209
#4 0x00007f6e9d45f114 in vlog_abort (module=module at entry=0x7f6e9d754720 <this_module>, message=message at entry=0x7f6e9d4c7750 "%s: assertion %s failed in %s()")
at lib/vlog.c:1223
#5 0x00007f6e9d45707c in ovs_assert_failure (where=where at entry=0x7f6e9d9cecb2 "./lib/ovs-atomic.h:522",
function=function at entry=0x7f6e9d9cefd0 <__func__.15116> "ovs_refcount_unref", condition=condition at entry=0x7f6e9d9ca677 "old_refcount > 0") at lib/util.c:80
#6 0x00007f6e9d9b1cea in ovs_refcount_unref (refcount=0x7f6e7022d508) at ./lib/ovs-atomic.h:522
#7 recirc_id_node_unref (node_=0x7f6e7022d4e0) at ofproto/ofproto-dpif-rid.c:308
#8 0x00007f6e9d9b8515 in ukey_delete__ (ukey=0x7f6e34608de0) at ofproto/ofproto-dpif-upcall.c:1874
#9 0x00007f6e9d422bc6 in ovsrcu_call_postponed () at lib/ovs-rcu.c:293
#10 0x00007f6e9d422de4 in ovsrcu_postpone_thread (arg=<optimized out>) at lib/ovs-rcu.c:308
#11 0x00007f6e9d4241d7 in ovsthread_wrapper (aux_=<optimized out>) at lib/ovs-thread.c:348
#12 0x00007f6e9ceee494 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#13 0x00007f6e9c724acf in clone () from /lib/x86_64-linux-gnu/libc.so.6
about some key variables：
(gdb) p *node_
$2 = {exp_node = {prev = 0x7f6dc8158ac0, next = 0x7f6e002058e0}, id_node = {next = {p = 0x7f6d6c23ab60}}, metadata_node = {next = {p = 0x0}}, id = 272772051,
hash = 1030066437, refcount = {count = 4294967295}, state = {table_id = 151 '\227', ofproto_uuid = {parts = {369391943, 132794840, 2170543616, 1588084633}},
metadata = {tunnel = {ip_dst = 1773191690, ipv6_dst = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {
0, 0, 0, 0}}}, ip_src = 2216018442, ipv6_src = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0},
__u6_addr32 = {0, 0, 0, 0}}}, tun_id = 11102217506398404608, flags = 12, ip_tos = 0 '\000', ip_ttl = 63 '?', tp_src = 31661, tp_dst = 46354, gbp_id = 0,
gbp_flags = 0 '\000', pad1 = "\000\000\000\000", metadata = {present = {map = 0, len = 0 '\000'}, tab = 0x558e9665df70, opts = {
u8 = '\000' <repeats 255 times>, gnv = {{opt_class = 0, type = 0 '\000', length = 0 '\000', r3 = 0 '\000', r2 = 0 '\000',
r1 = 0 '\000'} <repeats 63 times>}}}}, metadata = 64, regs = {8204788198332746544, 1501172204913692874, 0, 0, 0, 0, 77309411328, 5018}, in_port = 0},
stack = 0x0, stack_size = 0, mirrors = 0, conntracked = true, xport_uuid = {parts = {3224418024, 2139049594, 3033757766, 157758048}}, ofpacts = 0x0,
ofpacts_len = 0, action_set = 0x0, action_set_len = 0}}
(gdb) up
#8 0x00007f6e9d9b8515 in ukey_delete__ (ukey=0x7f6e34608de0) at ofproto/ofproto-dpif-upcall.c:1874
1874 ofproto/ofproto-dpif-upcall.c: No such file or directory.
(gdb) p *ukey
$3 = {cmap_node = {next = {p = 0x0}}, key = 0x7f6e34608eb0, key_len = 160, mask = 0x7f6e34609130, mask_len = 192, ufid = {u32 = {1219306161, 4266412036, 2182729822,
3747433939}, u64 = {lo = 18324100167100080817, hi = 16095106214108188766}}, ufid_present = true, hash = 3170407046, pmd_id = 2147483647, mutex = {lock = {
__data = {__lock = 0, __count = 0, __owner = 0, __nusers = 0, __kind = 2, __spins = 0, __elision = 0, __list = {__prev = 0x0, __next = 0x0}},
__size = '\000' <repeats 16 times>, "\002", '\000' <repeats 22 times>, __align = 0}, where = 0x7f6e9d4a5520 "<unlocked>"}, stats = {n_packets = 0, n_bytes = 0,
used = 0, tcp_flags = 0}, created = 5178254656, dump_seq = 71341130042, reval_seq = 71340990402, state = UKEY_DELETED, state_thread = 169,
state_where = 0x7f6e9d9cf7c8 "ofproto/ofproto-dpif-upcall.c:1892", actions = {p = 0x7f6e342346a0}, xcache = 0x0, keybuf = {buf = {keybuf = {1310728, 272772051,
1245192, 0, 131080, 65538, 196616, 10, 983048, 0, 1441800, 34, 1507334, 23, 1572872, 0, 1638420, 0, 0, 0, 0, 1703956, 2498998538, 4209094922, 2421238944,
4294941446, 262160, 2201884410, 4294897406, 4294967295, 393222, 8, 458768, 2498998538, 4209094922, 4194310, 589832, 2421238944, 1179654, 6144, 4294941446,
262160, 2, 385482752, 4009657150, 393222, 8, 458768, 689751050, 2498998538, 3932166, 589832, 3838893335, 1179654, 4608, 8, 458768, 1861202186, 756859914,
4194310, 589832, 1108906189, 1179654, 512, 1310728, 0, 1245192, 0, 131080, 0, 1048636, 12, 0, 2584936448, 65544, 4011311626, 131080, 1773191690, 262149, 63,
393220, 589830, 17386, 655366, 46354, 196616, 2, 983048, 0, 1441800, 0, 1507334, 0, 1572872, 0, 1638420, 0, 0, 0, 0, 262160, 2, 385482752, 4009657150, 393222,
8, 458768, 689751050, 2498998538, 3932166, 589832, 4006468887, 1179654, 4608, 4194310, 589832, 2370959593, 1179654, 4096, 2421244083, 4294941446, 262160, 2,
0, 0, 393222, 8, 458768, 1412608266, 3252990218, 4194310, 589832, 2421244083, 1179654, 6144, 349518890, 0, 0, 0, 0, 0, 0, 0, 0, 0, 15, 5018, 0, 0, 0, 0, 0, 0,
0, 0, 1, 3224418024, 2139049594, 3033757766, 157758048}}, nla = {nla_len = 8, nla_type = 20}}, maskbuf = {buf = {keybuf = {131080, 0, 1048608, 12, 4294967295,
4294967295, 131080, 4294967295, 262149, 0, 983048, 0, 1441800, 1, 1507334, 0, 1572872, 0, 1638420, 0, 0, 0, 4278190080, 1703956, 0, 0, 0, 2306997760, 1310728,
4294967295, 1245192, 0, 196616, 4294967295, 1835016, 4294967295, 262160, 4294967295, 4294967295, 4294967295, 393222, 65535, 458768, 0, 4294967295, 4278190848,
589832, 0, 458768, 0, 0, 4278190080, 589832, 0, 1245192, 0, 196616, 4294967295, 1835016, 4294967295, 262160, 4294967295, 4294967295, 4294967295, 393222,
65535, 458768, 4294967295, 4294967295, 4278191103, 589832, 4294967295, 131080, 4294967295, 196613, 255, 262149, 0, 327684, 393220, 983048, 0, 1441800, 0,
1507334, 0, 1572872, 0, 1638420, 0, 0, 0, 0, 1310728, 4294967295, 1245192, 0, 196616, 4294967295, 1835016, 4294967295, 262160, 4294967295, 4294967295,
4294967295, 393222, 65535, 458768, 4294967295, 4294967295, 4278190335, 589832, 4294967295, 0, 0, 4278190080, 589832, 0, 196616, 4294967295, 1835016,
4294967295, 262160, 4294967295, 4294967295, 4294967295, 393222, 65535, 458768, 0, 0, 4278190080, 589832, 0, 1868983881, 875901219, 892417332, 909520945,
824390706, 926168633, 1762212144, 1919251566, 1701011814, 1868771632, 1701719661, 1935762804, 1634217573, 1868657769, 1667457326, 1953396079, 1919251246,
1701013878, 1667449134, 1953396079, 1987208531, 157639529, 1935635305, 1819307361, 1634076005, 207975276}}, nla = {nla_len = 8, nla_type = 2}},
key_recirc_id = 272772051, recircs = {n_recircs = 0, {recirc = {0, 0}, recircs = 0x0}}}
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.openvswitch.org/pipermail/ovs-discuss/attachments/20181220/68f0a39c/attachment-0001.html>
More information about the discuss
mailing list