<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <br>
    OK, thanks, I'll give it a try<br>
    <br>
    <br>
    <div class="moz-cite-prefix">On 29/06/2020 15:21, Numan Siddique
      wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:CAH=CPzqCYgm55Agdj_=jqH-ni8ef1ABrvR1nZU6goza5aiAnfg@mail.gmail.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <div dir="ltr">
        <div dir="ltr"><br>
        </div>
        <br>
        <div class="gmail_quote">
          <div dir="ltr" class="gmail_attr">On Mon, Jun 29, 2020 at 7:42
            PM Brendan Doyle <<a
              href="mailto:brendan.doyle@oracle.com"
              moz-do-not-send="true">brendan.doyle@oracle.com</a>>
            wrote:<br>
          </div>
          <blockquote class="gmail_quote" style="margin:0px 0px 0px
            0.8ex;border-left:1px solid
            rgb(204,204,204);padding-left:1ex">Hi,<br>
            <br>
            I've a question about running OVN "central" in a cluster. So
            I have (I <br>
            think) successfully<br>
            created a cluster on nodes ca-rain01 (leader) , ca-rain03
            and ca-rain03<br>
            (See cluster status dumps) below.<br>
            <br>
            But It seems I can only run ovn-nbctl/ovn-sbctl on the
            leader node?<br>
            Is this how it is supposed to work, what's the point of the
            cluster if so?<br>
          </blockquote>
          <div><br>
          </div>
          <div>Either you can run as:</div>
          <div>  - ovn-nbctl --no-leader-only <command></div>
          <div> or</div>
          <div>  - ovn-nbctl
            --db="tcp:CLUSTER_IP1:6641,tcp:CLUSTER_IP2:6641,tcp:CLUSTER_IP3:6641"
            <command></div>
          <div><br>
          </div>
          <div><br>
          </div>
          <blockquote class="gmail_quote" style="margin:0px 0px 0px
            0.8ex;border-left:1px solid
            rgb(204,204,204);padding-left:1ex">
            <br>
            Also assuming the cluster is up and running, what way should
            the<br>
            ovn_controller external_ids be set on ovn chassis:<br>
            <br>
            <br>
            Stand alone<br>
            ------------------<br>
            ovn-ctl stop_controller<br>
            ovs-vsctl set open . external-ids:ovn-bridge=br-int<br>
            ovs-vsctl set open . external_ids:ovn-remote="tcp:<ovn
            central IP>:6642"<br>
            ovs-vsctl set open .
            external_ids:ovn-nb="tcp:<ovn_central_IP>:6641"<br>
            ovs-vsctl set open .
            external_ids:ovn-encap-ip=<ovn_central_IP><br>
            ovs-vsctl set open . external_ids:ovn-encap-type=geneve<br>
            ovn-ctl start_controller<br>
            <br>
            <br>
            Clustered ???<br>
            ------------------<br>
            ovn-ctl stop_controller<br>
            ovs-vsctl set open . external-ids:ovn-bridge=br-int<br>
            ovs-vsctl set open . external_ids:ovn-remote="tcp:<ovn
            central-1 <br>
            IP>:6642,tcp:<ovn central-2 IP>:6642,tcp:<ovn
            central-3 IP>:6642"<br>
            ovs-vsctl set open .
            external_ids:ovn-nb="tcp:<ovn_central-1 IP>:6641,  <br>
            tcp:<ovn_central-2 IP>:6641,tcp:<ovn_central-3
            IP>:6641 "<br>
            ovs-vsctl set open .
            external_ids:ovn-encap-ip="<ovn_central-1 IP, <br>
            ovn_central-2 IP, ovn_central-3 IP>"<br>
            ovs-vsctl set open . external_ids:ovn-encap-type=geneve<br>
            ovn-ctl start_controller<br>
            <br>
            <br>
            OR is it intended that the Clustered OVN be fronted by a
            floating IP/VIP <br>
            and the ovn controllers pointed to that?<br>
          </blockquote>
          <div><br>
          </div>
          <div>What you're doing here is correct - i.e pass all the IPs
            in the remote.</div>
          <div><br>
          </div>
          <div><br>
          </div>
          <div>Thanks</div>
          <div>Numan</div>
          <div> </div>
          <blockquote class="gmail_quote" style="margin:0px 0px 0px
            0.8ex;border-left:1px solid
            rgb(204,204,204);padding-left:1ex">
            <br>
            <br>
            ca-rain01 (leader)<br>
            -----------------------<br>
            ovs-appctl -t /usr/var/run/ovn/ovnnb_db.ctl cluster/status
            OVN_Northbound<br>
            c5cb<br>
            Name: OVN_Northbound<br>
            Cluster ID: 3124 (312468f5-b4a6-432e-9a7f-25c84cdeb8a6)<br>
            Server ID: c5cb (c5cbcb32-bc25-4744-b394-383f23a6e42b)<br>
            Address: tcp:<a href="http://253.255.0.33:6643"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.33:6643</a><br>
            Status: cluster member<br>
            Role: leader<br>
            Term: 1<br>
            Leader: self<br>
            Vote: self<br>
            <br>
            Election timer: 1000<br>
            Log: [2, 5]<br>
            Entries not yet committed: 0<br>
            Entries not yet applied: 0<br>
            Connections: <-a03a ->a03a <-1111 ->1111<br>
            Servers:<br>
                 c5cb (c5cb at tcp:<a href="http://253.255.0.33:6643"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.33:6643</a>) (self)
            next_index=2 match_index=4<br>
                 1111 (1111 at tcp:<a href="http://253.255.0.34:6643"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.34:6643</a>) next_index=5
            match_index=4<br>
                 a03a (a03a at tcp:<a href="http://253.255.0.35:6643"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.35:6643</a>) next_index=5
            match_index=4<br>
            <br>
            #ovs-appctl -t /usr/var/run/ovn/ovnsb_db.ctl cluster/status
            OVN_Southbound<br>
            6bc8<br>
            Name: OVN_Southbound<br>
            Cluster ID: a548 (a548b761-aa92-476a-b992-80a7e0c86859)<br>
            Server ID: 6bc8 (6bc80fbf-4c0f-42e2-af77-23a47291779b)<br>
            Address: tcp:<a href="http://253.255.0.33:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.33:6644</a><br>
            Status: cluster member<br>
            Role: leader<br>
            Term: 1<br>
            Leader: self<br>
            Vote: self<br>
            <br>
            Election timer: 1000<br>
            Log: [2, 6]<br>
            Entries not yet committed: 0<br>
            Entries not yet applied: 0<br>
            Connections: ->de6e <-49e0 ->49e0 <-c91b<br>
            Servers:<br>
                 c91b (c91b at tcp:<a href="http://253.255.0.34:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.34:6644</a>) next_index=6
            match_index=5<br>
                 de6e (de6e at tcp:<a href="http://253.255.0.34:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.34:6644</a>) next_index=6
            match_index=4<br>
                 49e0 (49e0 at tcp:<a href="http://253.255.0.35:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.35:6644</a>) next_index=6
            match_index=5<br>
                 6bc8 (6bc8 at tcp:<a href="http://253.255.0.33:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.33:6644</a>) (self)
            next_index=2 match_index=5<br>
            <br>
            ca-rain02 (follower)<br>
            --------------------------<br>
            ovs-appctl -t /usr/var/run/ovn/ovnnb_db.ctl cluster/status
            OVN_Northbound<br>
            1111<br>
            Name: OVN_Northbound<br>
            Cluster ID: 3124 (312468f5-b4a6-432e-9a7f-25c84cdeb8a6)<br>
            Server ID: 1111 (1111cdaf-554c-44eb-aad2-b5868e4f02a9)<br>
            Address: tcp:<a href="http://253.255.0.34:6643"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.34:6643</a><br>
            Status: cluster member<br>
            Role: follower<br>
            Term: 1<br>
            Leader: c5cb<br>
            Vote: unknown<br>
            <br>
            Election timer: 1000<br>
            Log: [2, 5]<br>
            Entries not yet committed: 0<br>
            Entries not yet applied: 0<br>
            Connections: ->0000 ->a03a <-c5cb <-a03a<br>
            Servers:<br>
                 c5cb (c5cb at tcp:<a href="http://253.255.0.33:6643"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.33:6643</a>)<br>
                 1111 (1111 at tcp:<a href="http://253.255.0.34:6643"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.34:6643</a>) (self)<br>
                 a03a (a03a at tcp:<a href="http://253.255.0.35:6643"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.35:6643</a>)<br>
            <br>
            ovs-appctl -t /usr/var/run/ovn/ovnsb_db.ctl cluster/status
            OVN_Southbound<br>
            c91b<br>
            Name: OVN_Southbound<br>
            Cluster ID: a548 (a548b761-aa92-476a-b992-80a7e0c86859)<br>
            Server ID: c91b (c91b0e2e-76a7-4b16-8af2-aafcaecd1d4f)<br>
            Address: tcp:<a href="http://253.255.0.34:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.34:6644</a><br>
            Status: cluster member<br>
            Role: follower<br>
            Term: 1<br>
            Leader: 6bc8<br>
            Vote: unknown<br>
            <br>
            Election timer: 1000<br>
            Log: [2, 6]<br>
            Entries not yet committed: 0<br>
            Entries not yet applied: 0<br>
            Connections: ->0000 ->49e0 <-0000 <-0000<br>
            Servers:<br>
                 c91b (c91b at tcp:<a href="http://253.255.0.34:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.34:6644</a>) (self)<br>
                 de6e (de6e at tcp:<a href="http://253.255.0.34:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.34:6644</a>)<br>
                 49e0 (49e0 at tcp:<a href="http://253.255.0.35:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.35:6644</a>)<br>
                 6bc8 (6bc8 at tcp:<a href="http://253.255.0.33:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.33:6644</a>)<br>
            <br>
            <br>
            ca-rain03 (follower)<br>
            --------------------------<br>
            #ovs-appctl -t /usr/var/run/ovn/ovnnb_db.ctl cluster/status
            OVN_Northbound<br>
            a03a<br>
            Name: OVN_Northbound<br>
            Cluster ID: 3124 (312468f5-b4a6-432e-9a7f-25c84cdeb8a6)<br>
            Server ID: a03a (a03a8a83-b9d7-4538-a340-9ad8eba440c6)<br>
            Address: tcp:<a href="http://253.255.0.35:6643"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.35:6643</a><br>
            Status: cluster member<br>
            Role: follower<br>
            Term: 1<br>
            Leader: c5cb<br>
            Vote: unknown<br>
            <br>
            Election timer: 1000<br>
            Log: [2, 5]<br>
            Entries not yet committed: 0<br>
            Entries not yet applied: 0<br>
            Connections: ->0000 <-c5cb <-1111 ->1111<br>
            Servers:<br>
                 c5cb (c5cb at tcp:<a href="http://253.255.0.33:6643"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.33:6643</a>)<br>
                 1111 (1111 at tcp:<a href="http://253.255.0.34:6643"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.34:6643</a>)<br>
                 a03a (a03a at tcp:<a href="http://253.255.0.35:6643"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.35:6643</a>) (self)<br>
            <br>
            #ovs-appctl -t /usr/var/run/ovn/ovnsb_db.ctl cluster/status
            OVN_Southbound<br>
            49e0<br>
            Name: OVN_Southbound<br>
            Cluster ID: a548 (a548b761-aa92-476a-b992-80a7e0c86859)<br>
            Server ID: 49e0 (49e02f6f-4aa0-46af-8a74-90e30f121e58)<br>
            Address: tcp:<a href="http://253.255.0.35:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.35:6644</a><br>
            Status: cluster member<br>
            Role: follower<br>
            Term: 1<br>
            Leader: 6bc8<br>
            Vote: unknown<br>
            <br>
            Election timer: 1000<br>
            Log: [2, 6]<br>
            Entries not yet committed: 0<br>
            Entries not yet applied: 0<br>
            Connections: ->0000 ->de6e <-6bc8 <-c91b<br>
            Servers:<br>
                 c91b (c91b at tcp:<a href="http://253.255.0.34:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.34:6644</a>)<br>
                 de6e (de6e at tcp:<a href="http://253.255.0.34:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.34:6644</a>)<br>
                 49e0 (49e0 at tcp:<a href="http://253.255.0.35:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.35:6644</a>) (self)<br>
                 6bc8 (6bc8 at tcp:<a href="http://253.255.0.33:6644"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">253.255.0.33:6644</a>)<br>
            <br>
            <br>
            Thanks<br>
            <br>
            Brendan<br>
            <br>
            <br>
            <br>
            <br>
            <br>
            <br>
            <br>
            <br>
            <br>
            _______________________________________________<br>
            discuss mailing list<br>
            <a href="mailto:discuss@openvswitch.org" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">discuss@openvswitch.org</a><br>
            <a
              href="https://mail.openvswitch.org/mailman/listinfo/ovs-discuss"
              rel="noreferrer" target="_blank"
              class="md-opjjpmhoiojifppkkcdabiobhakljdgm_doc"
              moz-do-not-send="true">https://mail.openvswitch.org/mailman/listinfo/ovs-discuss</a><br>
          </blockquote>
        </div>
      </div>
    </blockquote>
    <br>
  </body>
</html>