<div dir="ltr"><br clear="all"><div><p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-family:Calibri,sans-serif"><font color="#000000"><span style="font-size:16px">Hi,</span></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-family:Calibri,sans-serif"><font color="#000000"><span style="font-size:16px"><br></span></font></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-family:Calibri,sans-serif"><span style="color:black;font-size:12pt">I am facing trouble in graceful removal of node in a 3 Node RAFT setup.</span><br></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="color:black;font-size:12pt"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">Node1 :</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">$ovn-ctl
--db-nb-addr=10.8.49.184 --db-nb-port=6641 --db-nb-create-insecure-remote=yes
--db-nb-cluster-local-proto=tcp --db-nb-cluster-local-port=6643
--db-nb-cluster-local-addr=10.8.49.184 start_nb_ovsdb</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">$ovn-ctl
--db-sb-addr=10.8.49.184 --db-sb-port=6642 --db-sb-create-insecure-remote=yes
--db-sb-cluster-local-proto=tcp --db-sb-cluster-local-port=6644
--db-sb-cluster-local-addr=10.8.49.184 start_sb_ovsdb</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">$ovn-ctl
start_northd --ovn-manage-ovsdb=no
--ovn-northd-nb-db=&quot;tcp:<a href="http://10.8.49.184:6641">10.8.49.184:6641</a>,tcp:<a href="http://10.8.49.181:6641">10.8.49.181:6641</a>,tcp:<a href="http://10.8.49.173:6641">10.8.49.173:6641</a>&quot;
--ovn-northd-sb-db=&quot;tcp:<a href="http://10.8.49.184:6642">10.8.49.184:6642</a>,tcp:<a href="http://10.8.49.181:6642">10.8.49.181:6642</a>
tcp:<a href="http://10.8.49.173:6642">10.8.49.173:6642</a>&quot;</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">Node 2:</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">$ovn-ctl
--db-nb-addr=10.8.49.181 --db-nb-port=6641 --db-nb-create-insecure-remote=yes
--db-nb-cluster-local-proto=tcp --db-nb-cluster-local-port=6643
--db-nb-cluster-local-addr=10.8.49.181 --db-nb-cluster-remote-addr=10.8.49.184
start_nb_ovsdb</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">$ovn-ctl
--db-sb-addr=10.8.49.181 --db-sb-port=6642 --db-sb-create-insecure-remote=yes
--db-sb-cluster-local-proto=tcp --db-sb-cluster-local-port=6644
--db-sb-cluster-local-addr=10.8.49.181 --db-sb-cluster-remote-addr=10.8.49.184
start_sb_ovsdb</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">Node 3:</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">$ovn-ctl
--db-nb-addr=10.8.49.173 --db-nb-port=6641 --db-nb-create-insecure-remote=yes
--db-nb-cluster-local-proto=tcp --db-nb-cluster-local-port=6643
--db-nb-cluster-local-addr=10.8.49.173 --db-nb-cluster-remote-addr=10.8.49.184
start_nb_ovsdb</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">$ovn-ctl
--db-sb-addr=10.8.49.173 --db-sb-port=6642 --db-sb-create-insecure-remote=yes
--db-sb-cluster-local-proto=tcp --db-sb-cluster-local-port=6644 --db-sb-cluster-local-addr=10.8.49.173
--db-sb-cluster-remote-addr=10.8.49.184 start_sb_ovsdb</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">Now I forcefully
stopped northd on Node 1 (Either by doing ovn-central stop service or forcefully closing the vm in which node1 is running).</span></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> Now Node 3 was elected as leader from remaining
nodes(verified by running</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">$ovs-appctl -t
/var/run/openvswitch/ovnnb_db.ctl cluster/status OVN_Northbound )</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">$ovs-appctl -t
/var/run/openvswitch/ovnsb_db.ctl cluster/status OVN_Southbound )</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">Now i tried to
remove node using unixctl on the non-leader node.</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">$ovs-appctl -t
/var/run/openvswitch/ovnsb_db.ctl cluster/kick OVN_Southbound &lt;Node1&gt;</span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">Ideally it should
remove node1 but this removed node 2 itself from the cluster and making the
cluster unavailable.  </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"> </span></p>

<p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black">Could you please let us know, how to do a graceful node removal from cluster if the node becomes unavailable?</span></p><p class="MsoNormal" style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;color:black"><br></span></p></div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div style="font-size:small">Thanks,</div><div style="font-size:small">Ramteja</div></div></div></div></div></div>