<div dir="ltr"><div>Hi Numan,</div><div><br></div><div>Sorry for double reply (because not cc to ovs-discuss)<br></div><div><br></div><div>I trying to build a cluster with documentation provided in ovn-ctl manual page. But the ovn-nbctl output nothing. The port is listening in 6641, 6642, 6643, and 6644.</div><div>Below the logs:</div><div><br></div><div>[root@zu-ovn-controller0 ~]# /usr/share/openvswitch/scripts/ovn-ctl start_northd $OVN_NORTHD_OPTS --db-nb-addr=10.101.101.100 --db-nb-create-insecure-remote=yes --db-sb-addr=10.101.101.100 --db-sb-create-insecure-remote=yes --db-nb-cluster-local-addr=10.101.101.100 --db-sb-cluster-local-addr=10.101.101.100 --ovn-northd-nb-db=tcp:<a href="http://10.101.101.100:6641" target="_blank">10.101.101.100:6641</a>,tcp:<a href="http://10.101.101.101:6641" target="_blank">10.101.101.101:6641</a>,tcp:<a href="http://10.101.101.102:6641" target="_blank">10.101.101.102:6641</a> --ovn-northd-sb-db=tcp:<a href="http://10.101.101.100:6642" target="_blank">10.101.101.100:6642</a>,tcp:<a href="http://10.101.101.101:6642" target="_blank">10.101.101.101:6642</a>,tcp:<a href="http://10.101.101.102:6642" target="_blank">10.101.101.102:6642</a><br>Creating cluster database /etc/openvswitch/ovnnb_db.db     [  OK  ]<br>Waiting for OVN_Northbound to come up 2019-08-28T11:28:50Z|00001|reconnect|INFO|unix:/var/run/openvswitch/ovnnb_db.sock: connecting...<br>2019-08-28T11:28:50Z|00002|reconnect|INFO|unix:/var/run/openvswitch/ovnnb_db.sock: connected<br>                                                           [  OK  ]<br>Creating cluster database /etc/openvswitch/ovnsb_db.db     [  OK  ]<br>Waiting for OVN_Southbound to come up 2019-08-28T11:28:51Z|00001|reconnect|INFO|unix:/var/run/openvswitch/ovnsb_db.sock: connecting...<br>2019-08-28T11:28:51Z|00002|reconnect|INFO|unix:/var/run/openvswitch/ovnsb_db.sock: connected<br>                                                           [  OK  ]<br>Starting ovn-northd                                        [  OK  ]<span class="gmail-im"><br>[root@zu-ovn-controller0 ~]# ovn-nbctl --db=tcp:<a href="http://10.101.101.100:6641" target="_blank">10.101.101.100:6641</a>,tcp:<a href="http://10.101.101.101:6641" target="_blank">10.101.101.101:6641</a>,tcp:<a href="http://10.101.101.102:6641" target="_blank">10.101.101.102:6641</a> show<br>[root@zu-ovn-controller0 ~]# ovn-sbctl --db=tcp:<a href="http://10.101.101.100:6642" target="_blank">10.101.101.100:6642</a>,tcp:<a href="http://10.101.101.101:6642" target="_blank">10.101.101.101:6642</a>,tcp:<a href="http://10.101.101.102:6642" target="_blank">10.101.101.102:6642</a> show<br>Chassis &quot;a5b59592-f511-4a7a-b37d-93f933c35ea5&quot;<br>    hostname: &quot;zu-ovn-compute1&quot;<br>    Encap geneve<br>        ip: &quot;10.101.101.104&quot;<br>        options: {csum=&quot;true&quot;}<br>Chassis &quot;cd1a2535-522a-4571-8eac-8394681846a3&quot;<br>    hostname: &quot;zu-ovn-compute2&quot;<br>    Encap geneve<br>        ip: &quot;10.101.101.105&quot;<br>        options: {csum=&quot;true&quot;}<br>Chassis &quot;1ee48dd1-d520-476d-82d3-3d4651132f47&quot;<br>    hostname: &quot;zu-ovn-compute0&quot;<br>    Encap geneve<br>        ip: &quot;10.101.101.103&quot;<br>        options: {csum=&quot;true&quot;}</span></div><div><br></div><div>[root@zu-ovn-controller1 ~]# /usr/share/openvswitch/scripts/ovn-ctl start_northd $OVN_NORTHD_OPTS --db-nb-addr=10.101.101.101 --db-nb-create-insecure-remote=yes --db-sb-addr=10.101.101.101 --db-sb-create-insecure-remote=yes --db-nb-cluster-local-addr=10.101.101.101 --db-sb-cluster-local-addr=10.101.101.101 --db-nb-cluster-remote-addr=10.101.101.100 --db-sb-cluster-remote-addr=10.101.101.100 --ovn-northd-nb-db=tcp:<a href="http://10.101.101.100:6641" target="_blank">10.101.101.100:6641</a>,tcp:<a href="http://10.101.101.101:6641" target="_blank">10.101.101.101:6641</a>,tcp:<a href="http://10.101.101.102:6641" target="_blank">10.101.101.102:6641</a> --ovn-northd-sb-db=tcp:<a href="http://10.101.101.100:6642" target="_blank">10.101.101.100:6642</a>,tcp:<a href="http://10.101.101.101:6642" target="_blank">10.101.101.101:6642</a>,tcp:<a href="http://10.101.101.102:6642" target="_blank">10.101.101.102:6642</a><br>Waiting for OVN_Northbound to come up 2019-08-28T11:29:03Z|00001|reconnect|INFO|unix:/var/run/openvswitch/ovnnb_db.sock: connecting...<br>2019-08-28T11:29:03Z|00002|reconnect|INFO|unix:/var/run/openvswitch/ovnnb_db.sock: connected<br>                                                           [  OK  ]<br>Waiting for OVN_Southbound to come up 2019-08-28T11:29:03Z|00001|reconnect|INFO|unix:/var/run/openvswitch/ovnsb_db.sock: connecting...<br>2019-08-28T11:29:03Z|00002|reconnect|INFO|unix:/var/run/openvswitch/ovnsb_db.sock: connected<br>                                                           [  OK  ]<br>Starting ovn-northd                                        [  OK  ]</div><div><br></div><div>[root@zu-ovn-controller2 ~]# /usr/share/openvswitch/scripts/ovn-ctl start_northd $OVN_NORTHD_OPTS --db-nb-addr=10.101.101.102 --db-nb-create-insecure-remote=yes --db-nb-cluster-local-addr=10.101.101.102 --db-sb-addr=10.101.101.102 --db-sb-create-insecure-remote=yes --db-sb-cluster-local-addr=10.101.101.102 --db-nb-cluster-remote-addr=10.101.101.100 --db-sb-cluster-remote-addr=10.101.101.100 --ovn-northd-nb-db=tcp:<a href="http://10.101.101.100:6641" target="_blank">10.101.101.100:6641</a>,tcp:<a href="http://10.101.101.101:6641" target="_blank">10.101.101.101:6641</a>,tcp:<a href="http://10.101.101.102:6641" target="_blank">10.101.101.102:6641</a> --ovn-northd-sb-db=tcp:<a href="http://10.101.101.100:6642" target="_blank">10.101.101.100:6642</a>,tcp:<a href="http://10.101.101.101:6642" target="_blank">10.101.101.101:6642</a>,tcp:<a href="http://10.101.101.102:6642" target="_blank">10.101.101.102:6642</a><br>Waiting for OVN_Northbound to come up 2019-08-28T11:29:13Z|00001|reconnect|INFO|unix:/var/run/openvswitch/ovnnb_db.sock: connecting...<br>2019-08-28T11:29:13Z|00002|reconnect|INFO|unix:/var/run/openvswitch/ovnnb_db.sock: connected<br>                                                           [  OK  ]<br>Waiting for OVN_Southbound to come up 2019-08-28T11:29:14Z|00001|reconnect|INFO|unix:/var/run/openvswitch/ovnsb_db.sock: connecting...<br>2019-08-28T11:29:14Z|00002|reconnect|INFO|unix:/var/run/openvswitch/ovnsb_db.sock: connected<br>                                                           [  OK  ]<br>Starting ovn-northd                                        [  OK  ]</div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Aug 28, 2019 at 6:14 PM Zufar Dhiyaulhaq &lt;<a href="mailto:zufar@onf-ambassador.org">zufar@onf-ambassador.org</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi Numan,</div><div><br></div><div>I have tried the command but output nothing.</div><div><br></div><div>[root@zu-ovn-controller0 ~]# ovn-nbctl --db=tcp:<a href="http://10.101.101.100:6641" target="_blank">10.101.101.100:6641</a>,tcp:<a href="http://10.101.101.101:6641" target="_blank">10.101.101.101:6641</a>,tcp:<a href="http://10.101.101.102:6641" target="_blank">10.101.101.102:6641</a> show<br>[root@zu-ovn-controller0 ~]# ovn-sbctl --db=tcp:<a href="http://10.101.101.100:6642" target="_blank">10.101.101.100:6642</a>,tcp:<a href="http://10.101.101.101:6642" target="_blank">10.101.101.101:6642</a>,tcp:<a href="http://10.101.101.102:6642" target="_blank">10.101.101.102:6642</a> show    <br>Chassis &quot;1ee48dd1-d520-476d-82d3-3d4651132f47&quot;<br>    hostname: &quot;zu-ovn-compute0&quot;<br>    Encap geneve<br>        ip: &quot;10.101.101.103&quot;<br>        options: {csum=&quot;true&quot;}<br>Chassis &quot;cd1a2535-522a-4571-8eac-8394681846a3&quot;<br>    hostname: &quot;zu-ovn-compute2&quot;<br>    Encap geneve<br>        ip: &quot;10.101.101.105&quot;<br>        options: {csum=&quot;true&quot;}<br>Chassis &quot;a5b59592-f511-4a7a-b37d-93f933c35ea5&quot;<br>    hostname: &quot;zu-ovn-compute1&quot;<br>    Encap geneve<br>        ip: &quot;10.101.101.104&quot;<br>        options: {csum=&quot;true&quot;} <br>[root@zu-ovn-controller0 ~]# tail -f /var/log/openvswitch/ovsdb-server-nb.log <br>2019-08-28T09:12:31.190Z|00031|reconnect|INFO|tcp:<a href="http://10.101.101.102:6643" target="_blank">10.101.101.102:6643</a>: connection attempt failed (No route to host)<br>2019-08-28T09:12:31.190Z|00032|reconnect|INFO|tcp:<a href="http://10.101.101.102:6643" target="_blank">10.101.101.102:6643</a>: waiting 2 seconds before reconnect<br>2019-08-28T09:12:33.191Z|00033|reconnect|INFO|tcp:<a href="http://10.101.101.102:6643" target="_blank">10.101.101.102:6643</a>: connecting...<br>2019-08-28T09:12:33.192Z|00034|reconnect|INFO|tcp:<a href="http://10.101.101.102:6643" target="_blank">10.101.101.102:6643</a>: connection attempt failed (No route to host)<br>2019-08-28T09:12:33.192Z|00035|reconnect|INFO|tcp:<a href="http://10.101.101.102:6643" target="_blank">10.101.101.102:6643</a>: waiting 4 seconds before reconnect<br>2019-08-28T09:12:37.192Z|00036|reconnect|INFO|tcp:<a href="http://10.101.101.102:6643" target="_blank">10.101.101.102:6643</a>: connecting...<br>2019-08-28T09:12:37.192Z|00037|reconnect|INFO|tcp:<a href="http://10.101.101.102:6643" target="_blank">10.101.101.102:6643</a>: connection attempt failed (No route to host)<br>2019-08-28T09:12:37.192Z|00038|reconnect|INFO|tcp:<a href="http://10.101.101.102:6643" target="_blank">10.101.101.102:6643</a>: continuing to reconnect in the background but suppressing further logging<br>2019-08-28T09:22:52.597Z|00039|reconnect|INFO|tcp:<a href="http://10.101.101.101:6643" target="_blank">10.101.101.101:6643</a>: connected                                                                                        <br>2019-08-28T09:23:01.279Z|00040|reconnect|INFO|tcp:<a href="http://10.101.101.102:6643" target="_blank">10.101.101.102:6643</a>: connected</div><div><div><div dir="ltr" class="gmail-m_-3480401440891509728gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>I have tried with ovn-ctl to create the clustered-databases, but the problem is same, stuck when creating neutron resources. I think it because the ovn-northd run in 3 nodes, but neutron only run on a single controller.</span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>this is the step: <a href="http://paste.openstack.org/show/766470/" target="_blank">http://paste.openstack.org/show/766470/</a></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>should I try the step first? but check with passing the remote URL to command?</span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Aug 28, 2019 at 6:06 PM Numan Siddique &lt;<a href="mailto:nusiddiq@redhat.com" target="_blank">nusiddiq@redhat.com</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Aug 28, 2019 at 4:04 PM Zufar Dhiyaulhaq &lt;<a href="mailto:zufar@onf-ambassador.org" target="_blank">zufar@onf-ambassador.org</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">[ovn][clustered] Confusing to create ovsdb-server clustered databases<br><br>Hi Everyone, I have successfully created OpenStack with OVN enabled. But the problem comes when I try to cluster the ovsdb-server. My scenario is trying to cluster the ovsdb-server databases but only using single ovn-northd.<br><br>My cluster:<br>- controller0 : 10.100.100.100 / 10.101.101.100 (ovn-northd, ovsdb-server, neutron server)<br>- controller1 : 10.100.100.101 / 10.101.101.101 (ovsdb-server)<br>- controller2 : 10.100.100.102 / 10.101.101.102 (ovsdb-server)<br>- compute1 : 10.100.100.103 / 10.101.101.103<br>- compute2 : 10.100.100.104 / 10.101.101.104<br>- compute3 : 10.100.100.105 / 10.101.101.105<br><br><a href="http://10.100.100.0/24" target="_blank">10.100.100.0/24</a> : Management Network<br><a href="http://10.101.101.0/24" target="_blank">10.101.101.0/24</a> : Data Network<br><br>I have installed the OpenStack using the manual method. Below is the step to create ovsdb-server and neutron services.<br>- step 1: bootstrapping ovsdb-server cluster : <a href="http://paste.openstack.org/show/766463/" target="_blank">http://paste.openstack.org/show/766463/</a><br>- step 2: creating neutron service in controller : <a href="http://paste.openstack.org/show/766464/" target="_blank">http://paste.openstack.org/show/766464/</a><br>- step 3: creating neutron service in compute : <a href="http://paste.openstack.org/show/766465/" target="_blank">http://paste.openstack.org/show/766465/</a><br><br>But when I try to create neutron resource, Its always hang (only neutron resource).<br><br>This is the full logs of all nodes, contain: <a href="http://paste.openstack.org/show/766461/" target="_blank">http://paste.openstack.org/show/766461/</a><br>- all openvswitch logs<br>- port (via netstat)<br>- step bootstraping ovsdb-server<br><br>Neutron logs in controller0: <a href="http://paste.openstack.org/show/766462/" target="_blank">paste.openstack.org/show/766462/</a><br><br>Anyone know why stuck? Are my step is wrong?<br><br></div></blockquote><div><br></div><div>Hi Zufar,</div><div><br></div><div>Have you tried connecting to the clustered dbs using ovn-nbctl ?</div><div>Does it work fine when you pass the remotes i.e</div><div>$ovn-nbctl --db=tcp:<a href="http://10.101.101.100:6641" target="_blank">10.101.101.100:6641</a>,tcp:<a href="http://10.101.101.101:6641" target="_blank">10.101.101.101:6641</a>,tcp:<a href="http://10.101.101.102:6641" target="_blank">10.101.101.102:6641</a> show</div><div><br class="gmail-m_-3480401440891509728gmail-m_-7368179459283820708gmail-Apple-interchange-newline">If so, then it seems to me you have configured the clustered db properly.<br></div><div><br></div><div>Also please take a look at - &quot;man ovn-ctl&quot; and grep for &quot;Creating a clustered db on 3 nodes&quot;.</div><div><br></div><div>May be the python IDL code or the ovsdbapp which networking-ovn uses doesn&#39;t support connecting</div><div>with multiple remotes ?</div><div><br></div><div>I remember adding the support in the python IDL to accept multiple remotes [1], but not sure</div><div>what&#39;s the status now. </div><div><br></div><div>@Daniel - Do you have any comments/pointers ?</div><div><br></div><div>[1] - <a href="https://github.com/openvswitch/ovs/commit/31e434fc985c682708f5d92bde2ceae452bdaa4f" target="_blank">https://github.com/openvswitch/ovs/commit/31e434fc985c682708f5d92bde2ceae452bdaa4f</a></div><div>       <a href="https://github.com/openvswitch/ovs/commit/257edb1ae07c150023575dfb38ea8e539ad713de" target="_blank">https://github.com/openvswitch/ovs/commit/257edb1ae07c150023575dfb38ea8e539ad713de</a></div><div><br></div><div>Thanks</div><div>Numan</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Thank you.<br><div><div dir="ltr" class="gmail-m_-3480401440891509728gmail-m_-7368179459283820708gmail-m_-761102324609897563gmail_signature"><div dir="ltr"><span><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span><br></span></span></span></div><div><span style="font-family:arial,helvetica,sans-serif"><span lang="en"><span>Best Regards,<br></span></span></span></div><span lang="en"><span><span style="font-family:arial,helvetica,sans-serif">Zufar Dhiyaulhaq</span></span></span></span></div></div></div></div>
_______________________________________________<br>
discuss mailing list<br>
<a href="mailto:discuss@openvswitch.org" target="_blank">discuss@openvswitch.org</a><br>
<a href="https://mail.openvswitch.org/mailman/listinfo/ovs-discuss" rel="noreferrer" target="_blank">https://mail.openvswitch.org/mailman/listinfo/ovs-discuss</a><br>
</blockquote></div></div>
</blockquote></div>
</blockquote></div>