[ovs-discuss] question about OVN Clustered DB Model

Numan Siddique numans at ovn.org
Mon Jun 29 14:21:19 UTC 2020


On Mon, Jun 29, 2020 at 7:42 PM Brendan Doyle <brendan.doyle at oracle.com>
wrote:

> Hi,
>
> I've a question about running OVN "central" in a cluster. So I have (I
> think) successfully
> created a cluster on nodes ca-rain01 (leader) , ca-rain03 and ca-rain03
> (See cluster status dumps) below.
>
> But It seems I can only run ovn-nbctl/ovn-sbctl on the leader node?
> Is this how it is supposed to work, what's the point of the cluster if so?
>

Either you can run as:
  - ovn-nbctl --no-leader-only <command>
 or
  - ovn-nbctl
--db="tcp:CLUSTER_IP1:6641,tcp:CLUSTER_IP2:6641,tcp:CLUSTER_IP3:6641"
<command>



> Also assuming the cluster is up and running, what way should the
> ovn_controller external_ids be set on ovn chassis:
>
>
> Stand alone
> ------------------
> ovn-ctl stop_controller
> ovs-vsctl set open . external-ids:ovn-bridge=br-int
> ovs-vsctl set open . external_ids:ovn-remote="tcp:<ovn central IP>:6642"
> ovs-vsctl set open . external_ids:ovn-nb="tcp:<ovn_central_IP>:6641"
> ovs-vsctl set open . external_ids:ovn-encap-ip=<ovn_central_IP>
> ovs-vsctl set open . external_ids:ovn-encap-type=geneve
> ovn-ctl start_controller
>
>
> Clustered ???
> ------------------
> ovn-ctl stop_controller
> ovs-vsctl set open . external-ids:ovn-bridge=br-int
> ovs-vsctl set open . external_ids:ovn-remote="tcp:<ovn central-1
> IP>:6642,tcp:<ovn central-2 IP>:6642,tcp:<ovn central-3 IP>:6642"
> ovs-vsctl set open . external_ids:ovn-nb="tcp:<ovn_central-1 IP>:6641,
> tcp:<ovn_central-2 IP>:6641,tcp:<ovn_central-3 IP>:6641 "
> ovs-vsctl set open . external_ids:ovn-encap-ip="<ovn_central-1 IP,
> ovn_central-2 IP, ovn_central-3 IP>"
> ovs-vsctl set open . external_ids:ovn-encap-type=geneve
> ovn-ctl start_controller
>
>
> OR is it intended that the Clustered OVN be fronted by a floating IP/VIP
> and the ovn controllers pointed to that?
>

What you're doing here is correct - i.e pass all the IPs in the remote.


Thanks
Numan


>
>
> ca-rain01 (leader)
> -----------------------
> ovs-appctl -t /usr/var/run/ovn/ovnnb_db.ctl cluster/status OVN_Northbound
> c5cb
> Name: OVN_Northbound
> Cluster ID: 3124 (312468f5-b4a6-432e-9a7f-25c84cdeb8a6)
> Server ID: c5cb (c5cbcb32-bc25-4744-b394-383f23a6e42b)
> Address: tcp:253.255.0.33:6643
> Status: cluster member
> Role: leader
> Term: 1
> Leader: self
> Vote: self
>
> Election timer: 1000
> Log: [2, 5]
> Entries not yet committed: 0
> Entries not yet applied: 0
> Connections: <-a03a ->a03a <-1111 ->1111
> Servers:
>      c5cb (c5cb at tcp:253.255.0.33:6643) (self) next_index=2
> match_index=4
>      1111 (1111 at tcp:253.255.0.34:6643) next_index=5 match_index=4
>      a03a (a03a at tcp:253.255.0.35:6643) next_index=5 match_index=4
>
> #ovs-appctl -t /usr/var/run/ovn/ovnsb_db.ctl cluster/status OVN_Southbound
> 6bc8
> Name: OVN_Southbound
> Cluster ID: a548 (a548b761-aa92-476a-b992-80a7e0c86859)
> Server ID: 6bc8 (6bc80fbf-4c0f-42e2-af77-23a47291779b)
> Address: tcp:253.255.0.33:6644
> Status: cluster member
> Role: leader
> Term: 1
> Leader: self
> Vote: self
>
> Election timer: 1000
> Log: [2, 6]
> Entries not yet committed: 0
> Entries not yet applied: 0
> Connections: ->de6e <-49e0 ->49e0 <-c91b
> Servers:
>      c91b (c91b at tcp:253.255.0.34:6644) next_index=6 match_index=5
>      de6e (de6e at tcp:253.255.0.34:6644) next_index=6 match_index=4
>      49e0 (49e0 at tcp:253.255.0.35:6644) next_index=6 match_index=5
>      6bc8 (6bc8 at tcp:253.255.0.33:6644) (self) next_index=2
> match_index=5
>
> ca-rain02 (follower)
> --------------------------
> ovs-appctl -t /usr/var/run/ovn/ovnnb_db.ctl cluster/status OVN_Northbound
> 1111
> Name: OVN_Northbound
> Cluster ID: 3124 (312468f5-b4a6-432e-9a7f-25c84cdeb8a6)
> Server ID: 1111 (1111cdaf-554c-44eb-aad2-b5868e4f02a9)
> Address: tcp:253.255.0.34:6643
> Status: cluster member
> Role: follower
> Term: 1
> Leader: c5cb
> Vote: unknown
>
> Election timer: 1000
> Log: [2, 5]
> Entries not yet committed: 0
> Entries not yet applied: 0
> Connections: ->0000 ->a03a <-c5cb <-a03a
> Servers:
>      c5cb (c5cb at tcp:253.255.0.33:6643)
>      1111 (1111 at tcp:253.255.0.34:6643) (self)
>      a03a (a03a at tcp:253.255.0.35:6643)
>
> ovs-appctl -t /usr/var/run/ovn/ovnsb_db.ctl cluster/status OVN_Southbound
> c91b
> Name: OVN_Southbound
> Cluster ID: a548 (a548b761-aa92-476a-b992-80a7e0c86859)
> Server ID: c91b (c91b0e2e-76a7-4b16-8af2-aafcaecd1d4f)
> Address: tcp:253.255.0.34:6644
> Status: cluster member
> Role: follower
> Term: 1
> Leader: 6bc8
> Vote: unknown
>
> Election timer: 1000
> Log: [2, 6]
> Entries not yet committed: 0
> Entries not yet applied: 0
> Connections: ->0000 ->49e0 <-0000 <-0000
> Servers:
>      c91b (c91b at tcp:253.255.0.34:6644) (self)
>      de6e (de6e at tcp:253.255.0.34:6644)
>      49e0 (49e0 at tcp:253.255.0.35:6644)
>      6bc8 (6bc8 at tcp:253.255.0.33:6644)
>
>
> ca-rain03 (follower)
> --------------------------
> #ovs-appctl -t /usr/var/run/ovn/ovnnb_db.ctl cluster/status OVN_Northbound
> a03a
> Name: OVN_Northbound
> Cluster ID: 3124 (312468f5-b4a6-432e-9a7f-25c84cdeb8a6)
> Server ID: a03a (a03a8a83-b9d7-4538-a340-9ad8eba440c6)
> Address: tcp:253.255.0.35:6643
> Status: cluster member
> Role: follower
> Term: 1
> Leader: c5cb
> Vote: unknown
>
> Election timer: 1000
> Log: [2, 5]
> Entries not yet committed: 0
> Entries not yet applied: 0
> Connections: ->0000 <-c5cb <-1111 ->1111
> Servers:
>      c5cb (c5cb at tcp:253.255.0.33:6643)
>      1111 (1111 at tcp:253.255.0.34:6643)
>      a03a (a03a at tcp:253.255.0.35:6643) (self)
>
> #ovs-appctl -t /usr/var/run/ovn/ovnsb_db.ctl cluster/status OVN_Southbound
> 49e0
> Name: OVN_Southbound
> Cluster ID: a548 (a548b761-aa92-476a-b992-80a7e0c86859)
> Server ID: 49e0 (49e02f6f-4aa0-46af-8a74-90e30f121e58)
> Address: tcp:253.255.0.35:6644
> Status: cluster member
> Role: follower
> Term: 1
> Leader: 6bc8
> Vote: unknown
>
> Election timer: 1000
> Log: [2, 6]
> Entries not yet committed: 0
> Entries not yet applied: 0
> Connections: ->0000 ->de6e <-6bc8 <-c91b
> Servers:
>      c91b (c91b at tcp:253.255.0.34:6644)
>      de6e (de6e at tcp:253.255.0.34:6644)
>      49e0 (49e0 at tcp:253.255.0.35:6644) (self)
>      6bc8 (6bc8 at tcp:253.255.0.33:6644)
>
>
> Thanks
>
> Brendan
>
>
>
>
>
>
>
>
>
> _______________________________________________
> discuss mailing list
> discuss at openvswitch.org
> https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.openvswitch.org/pipermail/ovs-discuss/attachments/20200629/4892d73f/attachment-0001.html>


More information about the discuss mailing list