<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style></style></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1>Hi,<o:p></o:p><o:p> </o:p>The first thing I notice is that it looks like you have an extra aacparse in your pipeline. The last aacparse before the queue and then the mux seems unneeded.<o:p></o:p><o:p> </o:p>Here is an example of an hlssink pipeline that I have used with a file source.<o:p></o:p><o:p> </o:p>// HLS Sink example<o:p></o:p>gst-launch-1.0 -v -e mpegtsmux name=m m. ! queue ! hlssink filesrc location=/home/rdg/data/the_canoe_h265.ts ! tsdemux name=d d. ! queue max-size-buffers=1200 max-size-buffers=0 max-size-time=0 ! h265parse ! mfxhevcdec ! videoconvert ! mfxvpp width=1280 height=720 ! mfxh264enc rate-control=cbr bitrate=1500 insert-aud=true ! "video/x-h264, stream-format=byte-stream, profile=high" ! m. d. ! queue max-size-buffers=1200 max-size-buffers=0 max-size-time=0 ! aacparse ! avdec_aac ! audioconvert ! voaacenc bitrate=128000 ! m<o:p></o:p><o:p> </o:p>I use queues after the demux. (I have never used a queue prior to the mux)<o:p></o:p><o:p> </o:p>Regards,<o:p></o:p>Rand<o:p></o:p><o:p> </o:p>From: gstreamer-devel [mailto:gstreamer-devel-bounces@lists.freedesktop.org] On Behalf Of Jerry Geis Sent: Tuesday, December 17, 2019 2:29 PM To: gstreamer-devel@lists.freedesktop.org Subject: rtsp to hlssink with audio<o:p></o:p><o:p> </o:p><div>HI - all I am taking RTSP camera to hlssink and trying to get audio to work.<o:p></o:p><div><o:p> </o:p></div><div>gst-launch-1.0 mpegtsmux name=m ! hlssink playlist-root=/ location=hlssink.camera.1636.%05d.ts target-duration=1 max-files=3 playlist-length=2 playlist-location=playlist.camera.1636.m3u8 rtspsrc latency=0 location=rtsp://<a href="http://192.168.2.5">192.168.2.5</a> name=d d. ! rtph264depay ! h264parse config-interval=-1 ! queue ! m. d. ! rtpmp4gdepay ! aacparse ! avdec_aac ! audioconvert ! audioresample ! audiorate ! avenc_aac bitrate=96000 compliance=-2 ! aacparse ! queue ! m.<o:p></o:p></div><div><o:p> </o:p></div><div>This "sort" or works. I get video. Just no audio.<o:p></o:p></div><div>Below is some of the data. Not sure what the error is on libva() - that may be the whole issue.<o:p></o:p></div><div><o:p> </o:p></div><div>also there is about a 3 second latency - any way to reduce that ??/<o:p></o:p></div><div><o:p> </o:p></div><div>gst-inspect-1.0 | grep aac libav: avmux_adts: libav ADTS AAC (Advanced Audio Coding) muxer (not recommended, use aacparse instead) libav: avdec_aac_latm: libav AAC LATM (Advanced Audio Coding LATM syntax) decoder libav: avdec_aac_fixed: libav AAC (Advanced Audio Coding) decoder libav: avdec_aac: libav AAC (Advanced Audio Coding) decoder libav: avenc_aac: libav AAC (Advanced Audio Coding) encoder fluaacdec: fluaacdec: Fluendo AAC Decoder (HE enabled, stereo downmix) voaacenc: voaacenc: AAC audio encoder typefindfunctions: audio/aac: aac, adts, adif, loas audioparsers: aacparse: AAC audio stream parser<o:p></o:p></div><div><o:p> </o:p></div><div>jerry<o:p></o:p></div><div><o:p> </o:p></div><div>libva error: va_getDriverName() failed with unknown libva error,driver_name=(null) Setting pipeline to PAUSED ... Pipeline is live and does not need PREROLL ... Progress: (open) Opening Stream Progress: (connect) Connecting to rtsp://<a href="http://192.168.2.5">192.168.2.5</a> Progress: (open) Retrieving server options Progress: (open) Retrieving media info Progress: (request) SETUP stream 0 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager: latency = 0 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager: ntp-sync = false /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager: rfc7273-sync = false /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager: ntp-time-source = NTP time based on realtime clock /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager: drop-on-latency = false /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager: max-rtcp-rtp-time-diff = 1000 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager: buffer-mode = Slave receiver to sender clock /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc0: timeout = 5000000000 /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc0: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820 /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc1: caps = application/x-rtcp Progress: (request) SETUP stream 1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc2: timeout = 5000000000 /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc2: caps = application/x-rtp, media=(string)audio, payload=(int)97, clock-rate=(int)44100, encoding-name=(string)MPEG4-GENERIC, encoding-params=(string)1, profile-level-id=(string)41, streamtype=(string)5, mode=(string)AAC-hbr, objecttype=(string)64, constantduration=(string)1024, sizelength=(string)13, indexlength=(string)3, indexdeltalength=(string)3, config=(string)12100000000000000000000000000000, ssrc=(uint)4000664930 /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc3: caps = application/x-rtcp Progress: (open) Opened Stream Setting pipeline to PLAYING ... New clock: GstSystemClock /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager: buffer-mode = Slave receiver to sender clock Progress: (request) Sending PLAY request Progress: (request) Sending PLAY request /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc0: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc2: caps = application/x-rtp, media=(string)audio, payload=(int)97, clock-rate=(int)44100, encoding-name=(string)MPEG4-GENERIC, encoding-params=(string)1, profile-level-id=(string)41, streamtype=(string)5, mode=(string)AAC-hbr, objecttype=(string)64, constantduration=(string)1024, sizelength=(string)13, indexlength=(string)3, indexdeltalength=(string)3, config=(string)12100000000000000000000000000000, ssrc=(uint)4000664930, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc0.GstPad:src: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager.GstGhostPad:recv_rtp_sink_0.GstProxyPad:proxypad1: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc1.GstPad:src: caps = application/x-rtcp /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager/GstFunnel:funnel0.GstFunnelPad:funnelpad0: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager.GstGhostPad:recv_rtp_sink_0: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager.GstGhostPad:recv_rtp_sink_0: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager/GstFunnel:funnel1.GstFunnelPad:funnelpad1: caps = application/x-rtcp /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager.GstGhostPad:recv_rtcp_sink_0: caps = application/x-rtcp Progress: (request) Sent PLAY request /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc2.GstPad:src: caps = application/x-rtp, media=(string)audio, payload=(int)97, clock-rate=(int)44100, encoding-name=(string)MPEG4-GENERIC, encoding-params=(string)1, profile-level-id=(string)41, streamtype=(string)5, mode=(string)AAC-hbr, objecttype=(string)64, constantduration=(string)1024, sizelength=(string)13, indexlength=(string)3, indexdeltalength=(string)3, config=(string)12100000000000000000000000000000, ssrc=(uint)4000664930, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager.GstGhostPad:recv_rtp_sink_1.GstProxyPad:proxypad4: caps = application/x-rtp, media=(string)audio, payload=(int)97, clock-rate=(int)44100, encoding-name=(string)MPEG4-GENERIC, encoding-params=(string)1, profile-level-id=(string)41, streamtype=(string)5, mode=(string)AAC-hbr, objecttype=(string)64, constantduration=(string)1024, sizelength=(string)13, indexlength=(string)3, indexdeltalength=(string)3, config=(string)12100000000000000000000000000000, ssrc=(uint)4000664930, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc3.GstPad:src: caps = application/x-rtcp /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager/GstFunnel:funnel2.GstFunnelPad:funnelpad2: caps = application/x-rtp, media=(string)audio, payload=(int)97, clock-rate=(int)44100, encoding-name=(string)MPEG4-GENERIC, encoding-params=(string)1, profile-level-id=(string)41, streamtype=(string)5, mode=(string)AAC-hbr, objecttype=(string)64, constantduration=(string)1024, sizelength=(string)13, indexlength=(string)3, indexdeltalength=(string)3, config=(string)12100000000000000000000000000000, ssrc=(uint)4000664930, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager.GstGhostPad:recv_rtp_sink_1: caps = application/x-rtp, media=(string)audio, payload=(int)97, clock-rate=(int)44100, encoding-name=(string)MPEG4-GENERIC, encoding-params=(string)1, profile-level-id=(string)41, streamtype=(string)5, mode=(string)AAC-hbr, objecttype=(string)64, constantduration=(string)1024, sizelength=(string)13, indexlength=(string)3, indexdeltalength=(string)3, config=(string)12100000000000000000000000000000, ssrc=(uint)4000664930, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager.GstGhostPad:recv_rtcp_sink_1.GstProxyPad:proxypad5: caps = application/x-rtcp /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager/GstFunnel:funnel3.GstFunnelPad:funnelpad3: caps = application/x-rtcp /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager.GstGhostPad:recv_rtcp_sink_1: caps = application/x-rtcp /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc0: timeout = 0 /GstPipeline:pipeline0/GstRTSPSrc:d/GstUDPSrc:udpsrc2: timeout = 0 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager/GstFunnel:funnel0.GstPad:src: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager/GstRtpSession:rtpsession0.GstPad:recv_rtp_src: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager/GstRtpSsrcDemux:rtpssrcdemux0.GstPad:sink: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager/GstRtpSession:rtpsession0.GstPad:recv_rtp_sink: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager/GstRtpJitterBuffer:rtpjitterbuffer0.GstPad:sink: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager/GstRtpJitterBuffer:rtpjitterbuffer0.GstPad:sink: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager/GstRtpPtDemux:rtpptdemux0.GstPad:sink: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRtpH264Depay:rtph264depay0.GstPad:src: caps = video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)0164001fffe1000f2764001fac56c05005ba6a0202020401000428ee3cb0, level=(string)3.1, profile=(string)high /GstPipeline:pipeline0/GstH264Parse:h264parse0.GstPad:sink: caps = video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)0164001fffe1000f2764001fac56c05005ba6a0202020401000428ee3cb0, level=(string)3.1, profile=(string)high /GstPipeline:pipeline0/GstRtpH264Depay:rtph264depay0.GstPad:sink: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d.GstGhostPad:recv_rtp_src_0_3065589820_96.GstProxyPad:proxypad8: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstRTSPSrc:d/GstRtpBin:manager.GstGhostPad:recv_rtp_src_0_3065589820_96.GstProxyPad:proxypad7: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, sprop-parameter-sets=(string)"J2QAH6xWwFAFumoCAgIE\,KO48sA\=\=", profile-level-id=(string)64001F, ssrc=(uint)3065589820, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1 /GstPipeline:pipeline0/GstH264Parse:h264parse0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, level=(string)3.1, profile=(string)high, width=(int)1280, height=(int)720, framerate=(fraction)0/1, interlace-mode=(string)progressive, parsed=(boolean)true /GstPipeline:pipeline0/GstQueue:queue0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, level=(string)3.1, profile=(string)high, width=(int)1280, height=(int)720, framerate=(fraction)0/1, interlace-mode=(string)progressive, parsed=(boolean)true /GstPipeline:pipeline0/GstQueue:queue0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, level=(string)3.1, profile=(string)high, width=(int)1280, height=(int)720, framerate=(fraction)0/1, interlace-mode=(string)progressive, parsed=(boolean)true<o:p></o:p></div></div></div></body></html>