[Bug 796608] New: gst-validate-launcher: --forever does not stop on some errors

[GStreamer (GNOME Bugzilla)]

https://bugzilla.gnome.org/show_bug.cgi?id=796608

            Bug ID: 796608
           Summary: gst-validate-launcher: --forever does not stop on some
                    errors
    Classification: Platform
           Product: GStreamer
           Version: git master
                OS: Linux
            Status: NEW
          Severity: normal
          Priority: Normal
         Component: gst-devtools
          Assignee: gstreamer-bugs at lists.freedesktop.org
          Reporter: aboya at igalia.com
        QA Contact: gstreamer-bugs at lists.freedesktop.org
     GNOME version: ---

gst-validate-launcher --forever is not stopping in timeouts, segfaults or
sudden exits, which makes it less than useful to debug these issues (moreso
because by the time you know the test exited a retry has started and the logs
have been destroyed in consequence).

Example output:

$
GST_DEBUG=dashdemux:DEBUG,adaptivedemux:DEBUG,qtdemux:TRACE,basesink:DEBUG,videodecoder:DEBUG
gst-validate-launcher --timeout-factor 4 -m
adaptive.dash.playback.trick_mode_seeks.BBCRD_ondemand_testcard_1_client_manifest-events
--forever
Setting up GstValidate Adaptive Streaming test-vectors tests

[...]

===================
Running iteration 1
===================
===================                                                             
Running iteration 2
===================
adaptive.dash.playback.trick_mode_seeks.BBCRD_ondemand_testcard_1_client_manifest-events:
Failed 'Application returned 18'
       You can reproduce with:
'GST_VALIDATE_OVERRIDE='/home/ntrrgc/gst-validate/gst-integration-testsuites/medias/adaptivecontent/BBCRD_ondemand_testcard_1_client_manifest-events.override'
DISPLAY=':0' GST_GL_XINITTHREADS='1' GST_VALIDATE_SCENARIO='trick_mode_seeks'
GST_VALIDATE_SCENARIOS_PATH='/home/ntrrgc/Apps/gst-build/prefix/share/gstreamer-1.0/validate/scenarios:/home/ntrrgc/Apps/gst-build/subprojects/gst-devtools/validate/data/scenarios'
/home/ntrrgc/Apps/gst-build/build/subprojects/gst-devtools/validate/tools/gst-validate-1.0
playbin
uri=http://rdmedia.bbc.co.uk/dash/ondemand/testcard/1/client_manifest-events.mpd
audio-sink=fakesink sync=true video-sink=fakesink sync=true qos=true
max-lateness=20000000 --set-media-info
/home/ntrrgc/gst-validate/gst-integration-testsuites/medias/adaptivecontent/BBCRD_ondemand_testcard_1_client_manifest-events.stream_info'
    Logs:
         -
/home/ntrrgc/gst-validate/logs/adaptive/dash/playback/trick_mode_seeks/BBCRD_ondemand_testcard_1_client_manifest-events
         -
/home/ntrrgc/gst-validate/logs/adaptive/dash/playback/trick_mode_seeks/BBCRD_ondemand_testcard_1_client_manifest-events.gstdebug

===================
Running iteration 3
===================
[...]
====================                                                            
Running iteration 14
====================
adaptive.dash.playback.trick_mode_seeks.BBCRD_ondemand_testcard_1_client_manifest-events:
Timeout 'Application timed out: 120.0 secs'
       You can reproduce with:
'GST_VALIDATE_OVERRIDE='/home/ntrrgc/gst-validate/gst-integration-testsuites/medias/adaptivecontent/BBCRD_ondemand_testcard_1_client_manifest-events.override'
DISPLAY=':0' GST_GL_XINITTHREADS='1' GST_VALIDATE_SCENARIO='trick_mode_seeks'
GST_VALIDATE_SCENARIOS_PATH='/home/ntrrgc/Apps/gst-build/prefix/share/gstreamer-1.0/validate/scenarios:/home/ntrrgc/Apps/gst-build/subprojects/gst-devtools/validate/data/scenarios'
/home/ntrrgc/Apps/gst-build/build/subprojects/gst-devtools/validate/tools/gst-validate-1.0
playbin
uri=http://rdmedia.bbc.co.uk/dash/ondemand/testcard/1/client_manifest-events.mpd
audio-sink=fakesink sync=true video-sink=fakesink sync=true qos=true
max-lateness=20000000 --set-media-info
/home/ntrrgc/gst-validate/gst-integration-testsuites/medias/adaptivecontent/BBCRD_ondemand_testcard_1_client_manifest-events.stream_info'
    Logs:
         -
/home/ntrrgc/gst-validate/logs/adaptive/dash/playback/trick_mode_seeks/BBCRD_ondemand_testcard_1_client_manifest-events
         -
/home/ntrrgc/gst-validate/logs/adaptive/dash/playback/trick_mode_seeks/BBCRD_ondemand_testcard_1_client_manifest-events.gstdebug

====================
Running iteration 15
====================
====================                                                            
Running iteration 16
====================
====================                                                            
Running iteration 17
====================
adaptive.dash.playback.trick_mode_seeks.BBCRD_ondemand_testcard_1_client_manifest-events:
Failed 'Application segfaulted'
       You can reproduce with:
'GST_VALIDATE_OVERRIDE='/home/ntrrgc/gst-validate/gst-integration-testsuites/medias/adaptivecontent/BBCRD_ondemand_testcard_1_client_manifest-events.override'
DISPLAY=':0' GST_GL_XINITTHREADS='1' GST_VALIDATE_SCENARIO='trick_mode_seeks'
GST_VALIDATE_SCENARIOS_PATH='/home/ntrrgc/Apps/gst-build/prefix/share/gstreamer-1.0/validate/scenarios:/home/ntrrgc/Apps/gst-build/subprojects/gst-devtools/validate/data/scenarios'
/home/ntrrgc/Apps/gst-build/build/subprojects/gst-devtools/validate/tools/gst-validate-1.0
playbin
uri=http://rdmedia.bbc.co.uk/dash/ondemand/testcard/1/client_manifest-events.mpd
audio-sink=fakesink sync=true video-sink=fakesink sync=true qos=true
max-lateness=20000000 --set-media-info
/home/ntrrgc/gst-validate/gst-integration-testsuites/medias/adaptivecontent/BBCRD_ondemand_testcard_1_client_manifest-events.stream_info'
    Logs:
         -
/home/ntrrgc/gst-validate/logs/adaptive/dash/playback/trick_mode_seeks/BBCRD_ondemand_testcard_1_client_manifest-events
         -
/home/ntrrgc/gst-validate/logs/adaptive/dash/playback/trick_mode_seeks/BBCRD_ondemand_testcard_1_client_manifest-events.gstdebug

====================
Running iteration 18
====================
====================                                                            
Running iteration 19
====================
====================                                                            
Running iteration 20
====================

-- 
You are receiving this mail because:
You are the QA Contact for the bug.
You are the assignee for the bug.