[Bug 774844] dashdemux unit tests are disabled

[GStreamer (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=774844

Tim-Philipp Müller <t.i.m at zen.co.uk> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |t.i.m at zen.co.uk

--- Comment #5 from Tim-Philipp Müller <t.i.m at zen.co.uk> ---
I understand where you're coming from of course, but we simply don't have such
a policy, i.e. to guarantee that there must never be any regression in testing
coverage.

If we had such a policy we would have declared these tests not fit for purpose
at the time and would never have merged these tests in the first place like
that.

The tests were useful for a while, but unfortunately they were built on
quicksand and now they don't work anymore for reasons that are internal to the
way the tests were written.

It does not seem reasonable or desirable to me to block merging of new features
and other improvements based on the condition that they fix up these deficient
tests as well.

Testing coverage is an ongoing effort and on occasions like this where we
unfortunately have to regress in test coverage we just have to hope that
interested parties will sooner or later restore the missing coverage.

The most productive way forward would be to make a list of things that need to
be tested, and try to figure out how and where to restore that coverage.

Most of the testing should probably move to the validate test suite working on
real streams.

We should probably also add more streams to validate in general, like the
official test vectors.

-- 
You are receiving this mail because:
You are the QA Contact for the bug.
You are the assignee for the bug.