<div dir="auto">videotestsrc ! x264enc tune=zerolayency tends to negotiate yuv444+high profile. That can cause introp issues. Ide suggest a caps filter after the encoder with caps video/x-h264,profile=main (or constrained-baseline, though that will not compress as much).<div dir="auto"> </div><div dir="auto">Hopefully this will improve your situation.</div></div> <div class="gmail_quote"><div dir="ltr" class="gmail_attr">Le jeu. 21 sept. 2023, 16 h 30, LEVY David via gstreamer-devel <<a href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a>> a écrit : </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div lang="EN-CA" link="blue" vlink="purple" style="word-wrap:break-word"> <div class="m_1557559011145456005WordSection1"> Same behaviour. I just noted that “need-data” is only called once with ffplay, and twice with gst-launch (probably once udp and once tcp) <div> <div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> From: Michael Gruner <<a href="mailto:michael.gruner@ridgerun.com" target="_blank" rel="noreferrer">michael.gruner@ridgerun.com</a>> Sent: Thursday, September 21, 2023 2:45 PM To: Discussion of the development of and with GStreamer <<a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank" rel="noreferrer">gstreamer-devel@lists.freedesktop.org</a>> Cc: LEVY David <<a href="mailto:David.Levy@ino.ca" target="_blank" rel="noreferrer">David.Levy@ino.ca</a>> Subject: Re: Issue with rtsp server source h264 encoded </div> </div> Hi <div> </div> <div> Try sending periodic I frames, "x264enc key-int-max=10" or, programmatically: </div> <div> </div> <div> <blockquote style="margin-top:5.0pt;margin-bottom:5.0pt"> <div> g_object_set( lEncoder, "key-int-max", 10, NULL ); // 4 = zerolatency </div> </blockquote> <div> <div> </div> </div> <div> </div> <div> 10 is just a made up number to send a reference frame every second (given that your framerate is 10/1). You may space them according to your needs. </div> <div> </div> <div> Michael. </div> <div> <blockquote style="margin-top:5.0pt;margin-bottom:5.0pt"> <div> On 21 Sep 2023, at 09:59, LEVY David via gstreamer-devel <<a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank" rel="noreferrer">gstreamer-devel@lists.freedesktop.org</a>> wrote: </div> <div> <div> Hello, i'm new to gstreamer / rtsp so, sorry if it's a basic mistake. </div> <div> </div> <div> Im trying to set up a pipeline that end with an appsink that push data into a rtsp server starting with an appsrc. </div> <div> </div> <div> It would be: </div> <div> videotestsrc -> x264enc -> appsink (push data to src as soon as received) </div> <div> and </div> <div> appsrc -> rtph264pay </div> <div> </div> <div> I can’t find any example similar, but I found this one: <a href="https://github.com/GStreamer/gst-rtsp-server/blob/master/examples/test-appsrc.c" target="_blank" rel="noreferrer">https://github.com/GStreamer/gst-rtsp-server/blob/master/examples/test-appsrc.c</a> </div> <div> </div> <div> Which does: appsrc-> videoconvert -> x264enc -> rtph264pay (and uses “need-data”) </div> <div> </div> <div> I have successfully tweaked it to videotestsrc -> appsink </div> <div> appsrc-> videoconvert -> x264enc -> rtph264pay (and uses “need-data”) </div> <div> </div> <div> My next step would be </div> <div> Videotestsrc -> x264enc -> appsink </div> <div> appsrc-> rtph264pay (and uses “need-data”) </div> <div> </div> <div> but when I try to read the stream from either </div> <div> gst-launch-1.0 --gst-debug=rtspsrc:2 rtspsrc location=<a rel="noreferrer">rtsp://127.0.0.1:8554/test</a> ! queue ! rtph264depay ! h264parse ! avdec_h264 ! videoconvert ! videoscale ! autovideosink </div> <div> or ffplay <a rel="noreferrer">rtsp://127.0.0.1:8554/test</a> </div> <div> </div> <div> I don’t have any playback: Setting pipeline to PAUSED ... </div> <div> Pipeline is live and does not need PREROLL ... </div> <div> Got context from element 'autovideosink0': gst.gl.GLDisplay=context, gst.gl.GLDisplay=(GstGLDisplay)"\(GstGLDisplayWayland\)\ gldisplaywayland0"; </div> <div> Progress: (open) Opening Stream </div> <div> Pipeline is PREROLLED ... </div> <div> Prerolled, waiting for progress to finish... </div> <div> Progress: (connect) Connecting to <a rel="noreferrer">rtsp://127.0.0.1:8554/test</a> </div> <div> Progress: (open) Retrieving server options </div> <div> Progress: (open) Retrieving media info </div> <div> Progress: (request) SETUP stream 0 </div> <div> Progress: (open) Opened Stream </div> <div> Setting pipeline to PLAYING ... </div> <div> New clock: GstSystemClock </div> <div> Progress: (request) Sending PLAY request </div> <div> Redistribute latency... </div> <div> Progress: (request) Sending PLAY request </div> <div> Redistribute latency... </div> <div> Progress: (request) Sent PLAY request </div> <div> Redistribute latency... </div> <div> Redistribute latency... </div> <div> 0:00:05.945770874 15996 0x55c83ec97f60 WARN rtspsrc gstrtspsrc.c:5964:gst_rtspsrc_reconnect:<rtspsrc0> warning: Could not receive any UDP packets for 5.0000 seconds, maybe your firewall is blocking it. Retrying using a tcp connection. </div> <div> WARNING: from element /GstPipeline:pipeline0/GstRTSPSrc:rtspsrc0: Could not read from resource. </div> <div> Additional debug info: </div> <div> ../gst/rtsp/gstrtspsrc.c(5964): gst_rtspsrc_reconnect (): /GstPipeline:pipeline0/GstRTSPSrc:rtspsrc0: </div> <div> Could not receive any UDP packets for 5.0000 seconds, maybe your firewall is blocking it. Retrying using a tcp connection. </div> <div> Redistribute latency... </div> <div> </div> <div> And it is stuck here I’m using the code below: </div> <div> #include <gst/gst.h> </div> <div> </div> <div> #include <gst/app/gstappsink.h> </div> <div> #include <gst/app/gstappsrc.h> </div> <div> #include <gst/rtsp-server/rtsp-server.h> </div> <div> </div> <div> GstElement *gSink = nullptr; </div> <div> </div> <div> static void InitPipeline() </div> <div> { </div> <div> GstElement *lPipeline = gst_pipeline_new( "x264-pipeline" ); </div> <div> </div> <div> GstElement *lSource = gst_element_factory_make( "videotestsrc", "source" ); </div> <div> GstElement *lEncoder = gst_element_factory_make( "x264enc", "x264-encoder" ); </div> <div> GstElement *lSink = gst_element_factory_make( "appsink", "appsink" ); </div> <div> </div> <div> gst_bin_add_many( GST_BIN( lPipeline ), lSource, lEncoder, lSink, NULL ); </div> <div> // gst_bin_add_many( GST_BIN( lPipeline ), lSource, lSink, NULL ); </div> <div> g_object_set( lEncoder, "tune", 4, NULL ); // 4 = zerolatency </div> <div> </div> <div> GstCaps *lCaps = </div> <div> gst_caps_new_simple( "video/x-raw", "width", G_TYPE_INT, 384, "height", G_TYPE_INT, 288, "framerate", GST_TYPE_FRACTION, 10, 1, NULL ); </div> <div> if( !gst_element_link_filtered( lSource, lEncoder, lCaps ) ) </div> <div> // if( !gst_element_link_filtered( lSource, lSink, lCaps ) ) </div> <div> { </div> <div> gst_caps_unref( lCaps ); </div> <div> throw; </div> <div> } </div> <div> gst_caps_unref( lCaps ); </div> <div> gst_element_link( lEncoder, lSink ); </div> <div> </div> <div> GstStateChangeReturn ret = gst_element_set_state( lPipeline, GST_STATE_PLAYING ); </div> <div> if( ret == GST_STATE_CHANGE_FAILURE ) </div> <div> { </div> <div> throw; </div> <div> } </div> <div> gSink = lSink; </div> <div> } </div> <div> </div> <div> static void need_data( GstElement *appsrc, guint unused, void *aUnused ) </div> <div> { </div> <div> GstSample *lSample = gst_app_sink_pull_sample( GST_APP_SINK_CAST( gSink ) ); </div> <div> GstFlowReturn lRet = gst_app_src_push_sample( GST_APP_SRC( appsrc ), lSample ); </div> <div> gst_sample_unref( lSample ); </div> <div> return; </div> <div> } </div> <div> </div> <div> static void media_configure( GstRTSPMediaFactory *factory, GstRTSPMedia *media, gpointer user_data ) </div> <div> { </div> <div> GstElement *element, *appsrc; </div> <div> </div> <div> element = gst_rtsp_media_get_element( media ); </div> <div> appsrc = gst_bin_get_by_name_recurse_up( GST_BIN( element ), "mysrc" ); </div> <div> </div> <div> gst_util_set_object_arg( G_OBJECT( appsrc ), "format", "time" ); </div> <div> </div> <div> if( GstPad *pad = gst_element_get_static_pad( gSink, "sink" ) ) </div> <div> { </div> <div> g_print( "Got pad\n" ); </div> <div> GstCaps *caps = gst_pad_get_current_caps( pad ); </div> <div> if( caps ) </div> <div> { </div> <div> auto *caps_str = gst_caps_to_string( caps ); </div> <div> g_print( "Got caps %s\n", caps_str ); </div> <div> g_object_set( G_OBJECT( appsrc ), "caps", caps, NULL ); </div> <div> </div> <div> gst_caps_unref( caps ); </div> <div> } </div> <div> } </div> <div> </div> <div> g_signal_connect( appsrc, "need-data", (GCallback)need_data, NULL ); </div> <div> gst_object_unref( appsrc ); </div> <div> gst_object_unref( element ); </div> <div> } </div> <div> </div> <div> int main( int argc, char *argv[] ) </div> <div> { </div> <div> GMainLoop *loop; </div> <div> GstRTSPServer *server; </div> <div> GstRTSPMountPoints *mounts; </div> <div> GstRTSPMediaFactory *factory; </div> <div> </div> <div> gst_init( &argc, &argv ); </div> <div> </div> <div> loop = g_main_loop_new( NULL, FALSE ); </div> <div> </div> <div> InitPipeline(); </div> <div> </div> <div> server = gst_rtsp_server_new(); </div> <div> mounts = gst_rtsp_server_get_mount_points( server ); </div> <div> factory = gst_rtsp_media_factory_new(); </div> <div> </div> <div> // gst_rtsp_media_factory_set_launch( factory, "( appsrc name=mysrc ! videoconvert ! x264enc ! rtph264pay name=pay0 pt=96 )" ); </div> <div> gst_rtsp_media_factory_set_launch( factory, "( appsrc name=mysrc ! rtph264pay name=pay0 pt=96 )" ); </div> <div> </div> <div> g_signal_connect( factory, "media-configure", (GCallback)media_configure, NULL ); </div> <div> gst_rtsp_mount_points_add_factory( mounts, "/test", factory ); </div> <div> g_object_unref( mounts ); </div> <div> </div> <div> gst_rtsp_server_attach( server, NULL ); </div> <div> </div> <div> g_print( "stream ready at <a rel="noreferrer">rtsp://127.0.0.1:8554/test</a><a rel="noreferrer">\n</a>" ); </div> <div> g_main_loop_run( loop ); </div> <div> </div> <div> return 0; </div> <div> } </div> <div> </div> <div> </div> <div> Is it a good idea to convert before the appsink? </div> <div> </div> <div> Thanks for your time </div> </div> </blockquote> </div> </div> </div> </div> </blockquote></div>