[ovs-discuss] question about OVN Clustered DB Model

Brendan Doyle brendan.doyle at oracle.com
Mon Jun 29 14:10:14 UTC 2020


Hi,

I've a question about running OVN "central" in a cluster. So I have (I 
think) successfully
created a cluster on nodes ca-rain01 (leader) , ca-rain03 and ca-rain03
(See cluster status dumps) below.

But It seems I can only run ovn-nbctl/ovn-sbctl on the leader node?
Is this how it is supposed to work, what's the point of the cluster if so?

Also assuming the cluster is up and running, what way should the
ovn_controller external_ids be set on ovn chassis:


Stand alone
------------------
ovn-ctl stop_controller
ovs-vsctl set open . external-ids:ovn-bridge=br-int
ovs-vsctl set open . external_ids:ovn-remote="tcp:<ovn central IP>:6642"
ovs-vsctl set open . external_ids:ovn-nb="tcp:<ovn_central_IP>:6641"
ovs-vsctl set open . external_ids:ovn-encap-ip=<ovn_central_IP>
ovs-vsctl set open . external_ids:ovn-encap-type=geneve
ovn-ctl start_controller


Clustered ???
------------------
ovn-ctl stop_controller
ovs-vsctl set open . external-ids:ovn-bridge=br-int
ovs-vsctl set open . external_ids:ovn-remote="tcp:<ovn central-1 
IP>:6642,tcp:<ovn central-2 IP>:6642,tcp:<ovn central-3 IP>:6642"
ovs-vsctl set open . external_ids:ovn-nb="tcp:<ovn_central-1 IP>:6641,  
tcp:<ovn_central-2 IP>:6641,tcp:<ovn_central-3 IP>:6641 "
ovs-vsctl set open . external_ids:ovn-encap-ip="<ovn_central-1 IP, 
ovn_central-2 IP, ovn_central-3 IP>"
ovs-vsctl set open . external_ids:ovn-encap-type=geneve
ovn-ctl start_controller


OR is it intended that the Clustered OVN be fronted by a floating IP/VIP 
and the ovn controllers pointed to that?


ca-rain01 (leader)
-----------------------
ovs-appctl -t /usr/var/run/ovn/ovnnb_db.ctl cluster/status OVN_Northbound
c5cb
Name: OVN_Northbound
Cluster ID: 3124 (312468f5-b4a6-432e-9a7f-25c84cdeb8a6)
Server ID: c5cb (c5cbcb32-bc25-4744-b394-383f23a6e42b)
Address: tcp:253.255.0.33:6643
Status: cluster member
Role: leader
Term: 1
Leader: self
Vote: self

Election timer: 1000
Log: [2, 5]
Entries not yet committed: 0
Entries not yet applied: 0
Connections: <-a03a ->a03a <-1111 ->1111
Servers:
     c5cb (c5cb at tcp:253.255.0.33:6643) (self) next_index=2 match_index=4
     1111 (1111 at tcp:253.255.0.34:6643) next_index=5 match_index=4
     a03a (a03a at tcp:253.255.0.35:6643) next_index=5 match_index=4

#ovs-appctl -t /usr/var/run/ovn/ovnsb_db.ctl cluster/status OVN_Southbound
6bc8
Name: OVN_Southbound
Cluster ID: a548 (a548b761-aa92-476a-b992-80a7e0c86859)
Server ID: 6bc8 (6bc80fbf-4c0f-42e2-af77-23a47291779b)
Address: tcp:253.255.0.33:6644
Status: cluster member
Role: leader
Term: 1
Leader: self
Vote: self

Election timer: 1000
Log: [2, 6]
Entries not yet committed: 0
Entries not yet applied: 0
Connections: ->de6e <-49e0 ->49e0 <-c91b
Servers:
     c91b (c91b at tcp:253.255.0.34:6644) next_index=6 match_index=5
     de6e (de6e at tcp:253.255.0.34:6644) next_index=6 match_index=4
     49e0 (49e0 at tcp:253.255.0.35:6644) next_index=6 match_index=5
     6bc8 (6bc8 at tcp:253.255.0.33:6644) (self) next_index=2 match_index=5

ca-rain02 (follower)
--------------------------
ovs-appctl -t /usr/var/run/ovn/ovnnb_db.ctl cluster/status OVN_Northbound
1111
Name: OVN_Northbound
Cluster ID: 3124 (312468f5-b4a6-432e-9a7f-25c84cdeb8a6)
Server ID: 1111 (1111cdaf-554c-44eb-aad2-b5868e4f02a9)
Address: tcp:253.255.0.34:6643
Status: cluster member
Role: follower
Term: 1
Leader: c5cb
Vote: unknown

Election timer: 1000
Log: [2, 5]
Entries not yet committed: 0
Entries not yet applied: 0
Connections: ->0000 ->a03a <-c5cb <-a03a
Servers:
     c5cb (c5cb at tcp:253.255.0.33:6643)
     1111 (1111 at tcp:253.255.0.34:6643) (self)
     a03a (a03a at tcp:253.255.0.35:6643)

ovs-appctl -t /usr/var/run/ovn/ovnsb_db.ctl cluster/status OVN_Southbound
c91b
Name: OVN_Southbound
Cluster ID: a548 (a548b761-aa92-476a-b992-80a7e0c86859)
Server ID: c91b (c91b0e2e-76a7-4b16-8af2-aafcaecd1d4f)
Address: tcp:253.255.0.34:6644
Status: cluster member
Role: follower
Term: 1
Leader: 6bc8
Vote: unknown

Election timer: 1000
Log: [2, 6]
Entries not yet committed: 0
Entries not yet applied: 0
Connections: ->0000 ->49e0 <-0000 <-0000
Servers:
     c91b (c91b at tcp:253.255.0.34:6644) (self)
     de6e (de6e at tcp:253.255.0.34:6644)
     49e0 (49e0 at tcp:253.255.0.35:6644)
     6bc8 (6bc8 at tcp:253.255.0.33:6644)


ca-rain03 (follower)
--------------------------
#ovs-appctl -t /usr/var/run/ovn/ovnnb_db.ctl cluster/status OVN_Northbound
a03a
Name: OVN_Northbound
Cluster ID: 3124 (312468f5-b4a6-432e-9a7f-25c84cdeb8a6)
Server ID: a03a (a03a8a83-b9d7-4538-a340-9ad8eba440c6)
Address: tcp:253.255.0.35:6643
Status: cluster member
Role: follower
Term: 1
Leader: c5cb
Vote: unknown

Election timer: 1000
Log: [2, 5]
Entries not yet committed: 0
Entries not yet applied: 0
Connections: ->0000 <-c5cb <-1111 ->1111
Servers:
     c5cb (c5cb at tcp:253.255.0.33:6643)
     1111 (1111 at tcp:253.255.0.34:6643)
     a03a (a03a at tcp:253.255.0.35:6643) (self)

#ovs-appctl -t /usr/var/run/ovn/ovnsb_db.ctl cluster/status OVN_Southbound
49e0
Name: OVN_Southbound
Cluster ID: a548 (a548b761-aa92-476a-b992-80a7e0c86859)
Server ID: 49e0 (49e02f6f-4aa0-46af-8a74-90e30f121e58)
Address: tcp:253.255.0.35:6644
Status: cluster member
Role: follower
Term: 1
Leader: 6bc8
Vote: unknown

Election timer: 1000
Log: [2, 6]
Entries not yet committed: 0
Entries not yet applied: 0
Connections: ->0000 ->de6e <-6bc8 <-c91b
Servers:
     c91b (c91b at tcp:253.255.0.34:6644)
     de6e (de6e at tcp:253.255.0.34:6644)
     49e0 (49e0 at tcp:253.255.0.35:6644) (self)
     6bc8 (6bc8 at tcp:253.255.0.33:6644)


Thanks

Brendan











More information about the discuss mailing list