<div dir="ltr">Hi Ben/Noman:<div><br></div><div>I am trying to setup 3 node southbound db cluster  using <a href="https://patchwork.ozlabs.org/patch/854298/">raft10</a> in review. </div><div><div><br></div><div># Node 1 create-cluster</div><div>ovsdb-tool create-cluster /etc/openvswitch/ovnsb_db.db /root/ovs-reviews/ovn/ovn-sb.ovsschema tcp:<a href="http://10.99.152.148:6642">10.99.152.148:6642</a><br></div></div><div><br></div><div># Node 2 </div><div>ovsdb-tool join-cluster /etc/openvswitch/ovnsb_db.db OVN_Southbound tcp:<a href="http://10.99.152.138:6642">10.99.152.138:6642</a> tcp:<a href="http://10.99.152.148:6642">10.99.152.148:6642</a> --cid 5dfcb678-bb1d-4377-b02d-a380edec2982<br></div><div><br></div><div>#Node 3 </div><div>ovsdb-tool join-cluster /etc/openvswitch/ovnsb_db.db OVN_Southbound tcp:<a href="http://10.99.152.101:6642">10.99.152.101:6642</a> tcp:<a href="http://10.99.152.138:6642">10.99.152.138:6642</a> tcp:<a href="http://10.99.152.148:6642">10.99.152.148:6642</a> --cid 5dfcb678-bb1d-4377-b02d-a380edec2982<br></div><div><br></div><div># ovn remote is set to all 3 nodes</div><div>external_ids:ovn-remote=&quot;tcp:<a href="http://10.99.152.148:6642">10.99.152.148:6642</a>, tcp:<a href="http://10.99.152.138:6642">10.99.152.138:6642</a>, tcp:<a href="http://10.99.152.101:6642">10.99.152.101:6642</a>&quot;<br></div><div><br></div><div># Starting sb db on node 1 using below command on node 1:</div><div><br></div><div>ovsdb-server --detach --monitor -vconsole:off -vraft -vjsonrpc --log-file=/var/log/openvswitch/ovsdb-server-sb.log --pidfile=/var/run/openvswitch/ovnsb_db.pid --remote=db:OVN_Southbound,SB_Global,connections --unixctl=ovnsb_db.ctl --private-key=db:OVN_Southbound,SSL,private_key --certificate=db:OVN_Southbound,SSL,certificate --ca-cert=db:OVN_Southbound,SSL,ca_cert --ssl-protocols=db:OVN_Southbound,SSL,ssl_protocols --ssl-ciphers=db:OVN_Southbound,SSL,ssl_ciphers --remote=punix:/var/run/openvswitch/ovnsb_db.sock /etc/openvswitch/ovnsb_db.db<br></div><div><br></div><div># check-cluster is returning nothing <div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">ovsdb-tool check-cluster /etc/openvswitch/ovnsb_db.db</div></div><div><br></div><div># ovsdb-server-sb.log below shows the leader is elected with only one server and there are rbac related debug logs with rpc replies and empty params with no errors</div><div><br></div><div><div>2018-03-13T01:12:02Z|00002|raft|DBG|server 63d1 added to configuration</div><div>2018-03-13T01:12:02Z|00003|raft|INFO|term 6: starting election</div><div>2018-03-13T01:12:02Z|00004|raft|INFO|term 6: elected leader by 1+ of 1 servers</div></div><div><br></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial">Now Starting the ovsdb-server on the other clusters fails saying </div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial">ovsdb-server: ovsdb error: /etc/openvswitch/ovnsb_db.db: cannot identify file type</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial">Also noticed that man ovsdb-tool is missing cluster details. Might want to address it in the same patch or different. </div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br class="gmail-Apple-interchange-newline">Please advise to what is missing here for running ovn-sbctl show as this command hangs.</span><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><br class="gmail-Apple-interchange-newline"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"> </div><br></div></div>