[ovs-discuss] raft ovsdb clustering

aginwala aginwala at asu.edu
Tue Mar 13 01:41:26 UTC 2018


Hi Ben/Noman:

I am trying to setup 3 node southbound db cluster  using raft10
<https://patchwork.ozlabs.org/patch/854298/> in review.

# Node 1 create-cluster
ovsdb-tool create-cluster /etc/openvswitch/ovnsb_db.db
/root/ovs-reviews/ovn/ovn-sb.ovsschema tcp:10.99.152.148:6642

# Node 2
ovsdb-tool join-cluster /etc/openvswitch/ovnsb_db.db OVN_Southbound tcp:
10.99.152.138:6642 tcp:10.99.152.148:6642 --cid
5dfcb678-bb1d-4377-b02d-a380edec2982

#Node 3
ovsdb-tool join-cluster /etc/openvswitch/ovnsb_db.db OVN_Southbound tcp:
10.99.152.101:6642 tcp:10.99.152.138:6642 tcp:10.99.152.148:6642 --cid
5dfcb678-bb1d-4377-b02d-a380edec2982

# ovn remote is set to all 3 nodes
external_ids:ovn-remote="tcp:10.99.152.148:6642, tcp:10.99.152.138:6642,
tcp:10.99.152.101:6642"

# Starting sb db on node 1 using below command on node 1:

ovsdb-server --detach --monitor -vconsole:off -vraft -vjsonrpc
--log-file=/var/log/openvswitch/ovsdb-server-sb.log
--pidfile=/var/run/openvswitch/ovnsb_db.pid
--remote=db:OVN_Southbound,SB_Global,connections --unixctl=ovnsb_db.ctl
--private-key=db:OVN_Southbound,SSL,private_key
--certificate=db:OVN_Southbound,SSL,certificate
--ca-cert=db:OVN_Southbound,SSL,ca_cert
--ssl-protocols=db:OVN_Southbound,SSL,ssl_protocols
--ssl-ciphers=db:OVN_Southbound,SSL,ssl_ciphers
--remote=punix:/var/run/openvswitch/ovnsb_db.sock
/etc/openvswitch/ovnsb_db.db

# check-cluster is returning nothing
ovsdb-tool check-cluster /etc/openvswitch/ovnsb_db.db

# ovsdb-server-sb.log below shows the leader is elected with only one
server and there are rbac related debug logs with rpc replies and empty
params with no errors

2018-03-13T01:12:02Z|00002|raft|DBG|server 63d1 added to configuration
2018-03-13T01:12:02Z|00003|raft|INFO|term 6: starting election
2018-03-13T01:12:02Z|00004|raft|INFO|term 6: elected leader by 1+ of 1
servers


Now Starting the ovsdb-server on the other clusters fails saying
ovsdb-server: ovsdb error: /etc/openvswitch/ovnsb_db.db: cannot identify
file type


Also noticed that man ovsdb-tool is missing cluster details. Might want to
address it in the same patch or different.


Please advise to what is missing here for running ovn-sbctl show as this
command hangs.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.openvswitch.org/pipermail/ovs-discuss/attachments/20180312/3de74652/attachment.html>


More information about the discuss mailing list