<div dir="ltr"><div dir="ltr">Hi Greg,<div><br></div><div>Please find the answers inline below.</div><br><div class="gmail_quote"><div dir="ltr">On Tue, Nov 27, 2018 at 1:35 PM Gregory Rose &lt;<a href="mailto:gvrose8192@gmail.com">gvrose8192@gmail.com</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
  
    
  
  <div bgcolor="#FFFFFF">
    <p>Siva,</p>
    <p>You have a routing issue.</p>
    See interalia<br>
    <a class="gmail-m_-8070919725180450531moz-txt-link-freetext" href="https://github.com/OpenNebula/one/issues/2161" target="_blank">https://github.com/OpenNebula/one/issues/2161</a><br>
<a class="gmail-m_-8070919725180450531moz-txt-link-freetext" href="http://wwwaem.brocade.com/content/html/en/brocade-validated-design/brocade-vcs-fabric-ip-storage-bvd/GUID-CB5BFC4D-B2BE-4E9C-BA91-7E7E9BD35FCC.html" target="_blank">http://wwwaem.brocade.com/content/html/en/brocade-validated-design/brocade-vcs-fabric-ip-storage-bvd/GUID-CB5BFC4D-B2BE-4E9C-BA91-7E7E9BD35FCC.html</a><br>
<a class="gmail-m_-8070919725180450531moz-txt-link-freetext" href="http://blog.arunsriraman.com/2017/02/how-to-setting-up-gre-or-vxlan-tunnel.html" target="_blank">http://blog.arunsriraman.com/2017/02/how-to-setting-up-gre-or-vxlan-tunnel.html</a><br>
    <br>
    For this to work you must be able to ping from the local IP to the
    remote IP *through* the remote IP address.As we have seen that
    doesn&#39;t work.<br></div></blockquote><div><br></div><div>Did you mean to be able to ping using remote interface? I am able to get this to work when I connect the two bridges using a veth pair.</div><div><br></div><div>[root@vm1 ~]# ping 30.30.0.193 -I eth2</div><div>PING 30.30.0.193 (30.30.0.193) from 20.20.0.183 eth2: 56(84) bytes of data.</div><div>64 bytes from <a href="http://30.30.0.193">30.30.0.193</a>: icmp_seq=1 ttl=64 time=0.655 ms</div><div>64 bytes from <a href="http://30.30.0.193">30.30.0.193</a>: icmp_seq=2 ttl=64 time=0.574 ms</div><div>64 bytes from <a href="http://30.30.0.193">30.30.0.193</a>: icmp_seq=3 ttl=64 time=0.600 ms</div><div>64 bytes from <a href="http://30.30.0.193">30.30.0.193</a>: icmp_seq=4 ttl=64 time=0.604 ms</div><div>64 bytes from <a href="http://30.30.0.193">30.30.0.193</a>: icmp_seq=5 ttl=64 time=0.607 ms</div><div>64 bytes from <a href="http://30.30.0.193">30.30.0.193</a>: icmp_seq=6 ttl=64 time=0.620 ms</div><div>64 bytes from <a href="http://30.30.0.193">30.30.0.193</a>: icmp_seq=7 ttl=64 time=0.466 ms</div><div>64 bytes from <a href="http://30.30.0.193">30.30.0.193</a>: icmp_seq=8 ttl=64 time=0.623 ms</div><div>^C</div><div>--- 30.30.0.193 ping statistics ---</div><div>8 packets transmitted, 8 received, 0% packet loss, time 7000ms</div><div>rtt min/avg/max/mdev = 0.466/0.593/0.655/0.059 ms</div><div> </div><div>Even with this routing setup, the local_ip option with vxlan tunnels does not seem to work and GRE tunnels work.</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div bgcolor="#FFFFFF">
    As an aside, why do you have two bridges to the same VMs?  Your
    configuration makes it impossible to<br>
    set a route because  you have two sets of IP addresses and routes
    all on two bridges going into the same<br>
    VMs.  In that configuration the local ip option makes  no sense. 
    You don&#39;t need it - you&#39;re already bridged.<br></div></blockquote><div><br></div><div>I was to trying to mimic a use case with two hypervisors and each hypervisor is connected to two different underlay networks. So, used linux bridges when imitated the topology with VMs. Please advice if this is not the right approach.</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div bgcolor="#FFFFFF">
    I understand that you have seen the gre configuration work and I&#39;m
    not sure why because it has the same<br>
    requirements for the local ip to be routable through the remote ip. 
    And again, there is no point to the<br>
    local ip option because the ip addresses do not need to be routed to
    reach each other.<br>
    <br>
    In any case, I&#39;m going to set up a valid configuration and then make
    sure that the local ip option does work<br>
    or not.  I&#39;ll report back when I&#39;m done.<br>
    <br></div></blockquote><div><br></div><div>I will look out for your conclusions.</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div bgcolor="#FFFFFF">
    Thanks,<br>
    <br>
    - Greg<br>
    <br>
    <div class="gmail-m_-8070919725180450531moz-cite-prefix">On 11/20/2018 10:13 AM, Gregory Rose
      wrote:<br>
    </div>
    <blockquote type="cite">
      
      <br>
      <div class="gmail-m_-8070919725180450531moz-cite-prefix">On 11/20/2018 10:03 AM, Siva Teja
        ARETI wrote:<br>
      </div>
      <blockquote type="cite">
        
        <div dir="ltr">
          <div dir="ltr">
            <div dir="ltr"><br>
              <br>
              <div class="gmail_quote">
                <div dir="ltr">On Tue, Nov 20, 2018 at 12:59 PM Gregory
                  Rose &lt;<a href="mailto:gvrose8192@gmail.com" target="_blank">gvrose8192@gmail.com</a>&gt;
                  wrote:<br>
                </div>
                <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
                  <div bgcolor="#FFFFFF"> On 11/19/2018 6:30 PM, Siva
                    Teja ARETI wrote:<br>
                    <blockquote type="cite">
                      <div dir="ltr"><br>
                        <div class="gmail_quote">[user@hyp-1] ip route
                          <div>
                            <div>default via A.B.C.D dev enp5s0  proto
                              static  metric 100</div>
                            <div><a href="http://10.10.0.0/24" target="_blank">10.10.0.0/24</a>
                              dev testbr0  proto kernel  scope link  src
                              10.10.0.1 linkdown</div>
                            <div><a href="http://20.20.0.0/24" target="_blank">20.20.0.0/24</a>
                              dev testbr1  proto kernel  scope link  src
                              20.20.0.1</div>
                            <div><a href="http://30.30.0.0/24" target="_blank">30.30.0.0/24</a>
                              dev testbr2  proto kernel  scope link  src
                              30.30.0.1</div>
                            <br>
                          </div>
                        </div>
                      </div>
                    </blockquote>
                    Hi Siva,<br>
                    <br>
                    I&#39;m curious about these bridges.  Are they Linux
                    bridges or OVS bridges?<br>
                    <br>
                    If they are Linux bridges please provide the output
                    of &#39;brctl show&#39;.<br>
                    If they are OVS bridges then please provide the
                    output of &#39;ovs-vsctl show&#39;.<br>
                    <br>
                    Thanks!<br>
                    <br>
                    - Greg<br>
                  </div>
                </blockquote>
                <div><br>
                </div>
                <div>Hi Greg,</div>
                <div><br>
                </div>
                <div>These are linux bridges.</div>
                <div><br>
                </div>
                <div>[user@hyp1 ] brctl show</div>
                <div>bridge name<span style="white-space:pre-wrap">        </span>bridge
                  id<span style="white-space:pre-wrap">                </span>STP enabled<span style="white-space:pre-wrap">        </span>interfaces</div>
                <div>docker0<span style="white-space:pre-wrap">                </span>8000.02428928dba5<span style="white-space:pre-wrap">        </span>no<span style="white-space:pre-wrap">                </span>veth6079ee7</div>
                <div>testbr0<span style="white-space:pre-wrap">                </span>8000.000000000000<span style="white-space:pre-wrap">        </span>yes<span style="white-space:pre-wrap">                </span></div>
                <div>testbr1<span style="white-space:pre-wrap">                </span>8000.fe540005937c<span style="white-space:pre-wrap">        </span>yes<span style="white-space:pre-wrap">                </span>vnet2</div>
                <div><span style="white-space:pre-wrap">                                                        </span>vnet5</div>
                <div>testbr2<span style="white-space:pre-wrap">                </span>8000.fe540079ef92<span style="white-space:pre-wrap">        </span>yes<span style="white-space:pre-wrap">                </span>vnet1</div>
                <div><span style="white-space:pre-wrap">                                                        </span>vnet4</div>
                <div>virbr0<span style="white-space:pre-wrap">                </span>8000.fe54000ad370<span style="white-space:pre-wrap">        </span>yes<span style="white-space:pre-wrap">                </span>vnet0</div>
                <div><span style="white-space:pre-wrap">                                                        </span>vnet3</div>
                <div><br>
                </div>
                <div> Siva Teja.</div>
              </div>
            </div>
          </div>
        </div>
      </blockquote>
      <br>
      Thanks Siva!  I&#39;ll follow up when I have more questions and/or
      results.<br>
      <br>
      - Greg<br>
    </blockquote>
    <br>
  </div>

</blockquote></div></div></div>