[ovs-dev] [PATCH] CONTRIBUTING: Strengthen testing guidelines

[Justin Pettit]

> On Feb 8, 2016, at 5:38 PM, Russell Bryant <russell at ovn.org> wrote:
> 
> On 02/08/2016 06:18 PM, Justin Pettit wrote:
>> 
>> The "shame" comment was meant tongue-in-cheek, but I didn't want to
>> overwhelm the message with smiley faces.  Sorry that didn't come
>> through.
> 
> Ah, well I'm sorry too.  You had indeed already met your smiley limit of
> 1, what were you to do?!

You and my wife should get together and discuss my inability to open myself up emotionally through email.

> Somewhat related - I'd like to be more proactive at keeping an eye on
> travis-ci failures.  I just signed up for the build mailing list.  It
> looks like travis-ci is configured to post there, but I don't see any
> posts from travis-ci on that list since about Feb 2015 or so.  Could it
> be a ML config issue?

I'd need to check with Ben, but I think we needed to respond to some cookie in order to allow posting from travis-ci.

One concern we had about sending messages to ovs-dev was that the tests are somewhat unreliable due to timing issues, so they could end up raising so many false alarms that people ignored them (and, worse, annoyed everyone else on the list).  What we really need to do is improve the tests to be reliable so that when there's a reported error we know there's actually a bug.  Barring actually doing things right, I wonder if we could re-run failed tests to see if they pass on a second run before emailing out a warning...

--Justin