<html> <head> <meta http-equiv="Content-Type" content="text/html; charset=windows-1252"> </head> <body> Hi David We're also struggling to get h264 video to work reliably via webrtc, but here on Ubuntu (18.04 & 20.04), even at lower resolutions & bit rate. It does sound like a similar situation though - when it occasionally works, the video is stuttery with packet loss reported in chrome://webrtc-internals Rob <div class="moz-cite-prefix">On 11/10/2021 06:09, David Ely via gstreamer-devel wrote: </div> <blockquote type="cite" cite="mid:SY4PR01MB66235B28B71BE4172EECE10CF4B59@SY4PR01MB6623.ausprd01.prod.outlook.com"> <meta http-equiv="Content-Type" content="text/html; charset=windows-1252"> <meta name="Generator" content="Microsoft Word 15 (filtered medium)">  <style>@font-face {font-family:Wingdings; panose-1:5 0 0 0 0 0 0 0 0 0;}@font-face {font-family:"Cambria Math"; panose-1:2 4 5 3 5 4 6 3 2 4;}@font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4;}@font-face {font-family:Verdana; panose-1:2 11 6 4 3 5 4 4 2 4;}p.MsoNormal, li.MsoNormal, div.MsoNormal {margin:0cm; font-size:11.0pt; font-family:"Calibri",sans-serif; mso-fareast-language:EN-US;}span.EmailStyle17 {mso-style-type:personal-compose; font-family:"Calibri",sans-serif; color:windowtext;}.MsoChpDefault {mso-style-type:export-only; font-family:"Calibri",sans-serif; mso-fareast-language:EN-US;}div.WordSection1 {page:WordSection1;}ol {margin-bottom:0cm;}ul {margin-bottom:0cm;}</style> <div class="WordSection1"> We are having issues sending a 4K, H264 stream through WebRTC on Windows (3840x2160, 30hz, 8Mbs). Playback of the video stream stutters or may get stuck. Our application captures the desktop, encodes it to H264 and streams it to Chrome or another of our applications, both of which exhibit the problem. This issue only happens on Windows, CentOS7 and Ubuntu20.04 work (using the same hardware). Lower resolutions (1080P) work across all 3 operations systems. Chrome's webrtc-internals shows the packetsLost or freezeCount increase when the stutter occurs.<o:p></o:p> Points of note:<o:p></o:p> <ul type="disc"> <li class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level1 lfo1"> Our GStreamer version is 1.19.1.<o:p></o:p></li> <li class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level1 lfo1"> This was reproduced with two PCs on a local network. The problem won't occur if the sender and receiver are on the same computer.<o:p></o:p></li> <li class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level1 lfo1"> We did some Wireshark captures on the sending PC and it showed some packets aren't making it to the NIC. It appears occasionally a NAL is being truncated.<o:p></o:p></li> <li class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level1 lfo1"> In attempt reduced the scope of the problem, I reproduced the issue in one of the gst-examples (webrtc\sendonly\webrtc-unidirectional-h264.c) by modifying the pipeline to stream from a file (I only tested this on Windows). The file is 30hz, 4K H264 video with a birate of 8 Mbs. The pipeline looks like this <o:p></o:p></li> <ul type="circle"> <li class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level2 lfo1"> filesrc location=C:\tmp\test.mkv ! queue ! matroskademux ! queue ! h264parse ! video/x-h264,alignment=au,stream-format=byte-stream ! rtph264pay config-interval=1 aggregate-mode ! application/x-rtp,media=video,encoding-name=H264,encoding-payload=96 ! webrtcbin<o:p></o:p></li> </ul> <li class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level1 lfo1"> Reducing the bitrate alleviates the problem.<o:p></o:p></li> <li class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level1 lfo1"> For reference this is our application's pipeline on Windows <o:p></o:p></li> <ul type="circle"> <li class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-list:l0 level2 lfo1"> dxgiscreencapsrc cursor=true ! video/x-raw,format=BGRA,framerate=30/1 ! videoconvert ! queue ! video/x-raw,format=I420 ! nvh264enc preset=low-latency-hp bitrate=8192 rc-mode=cbr gop-size=90 zerolatency=true ! video/x-h264,framerate=30/1,alignment=au,stream-format=byte-stream ! rtph264pay ! application/x-rtp,media=video,encoding-name=H264,payload=96 ! webrtcbin<o:p></o:p></li> </ul> </ul> As I was able to reproduce the issue in the modified example it points to webrtcbin as the problem.<o:p></o:p> Any help/suggestions to resolve the problem would be greatly appreciated.<o:p></o:p> Thanks<o:p></o:p> <table class="MsoNormalTable" style="width:100.0%" width="100%" cellspacing="0" cellpadding="0" border="0"> <tbody> <tr> <td style="padding:1.5pt 1.5pt 1.5pt 1.5pt"> David Ely Software Architect<o:p></o:p> </td> </tr> <tr> <td style="padding:4.5pt 1.5pt 3.0pt 1.5pt"> <img style="width:2.0833in;height:.302in" id="_x0000_i1025" src="https://gallery.mailchimp.com/73a7af9caf823e17148efa426/images/399deeaf-a8bb-4b99-a868-deb57d655bb6.png" alt="ImmersaView" moz-do-not-send="true" width="200" height="29"><o:p></o:p> </td> </tr> <tr> <td style="padding:1.5pt 1.5pt 1.5pt 1.5pt"> <table class="MsoNormalTable" style="width:100.0%" width="100%" cellspacing="0" cellpadding="0" border="0"> <tbody> <tr> <td style="width:3.75pt;padding:.75pt .75pt .75pt .75pt" width="5"> T<o:p></o:p> </td> <td style="padding:.75pt .75pt .75pt .75pt"> �+61 7 3123 7133<o:p></o:p> </td> </tr> <tr> <td style="width:3.75pt;padding:.75pt .75pt .75pt .75pt" width="5"> E<o:p></o:p> </td> <td style="padding:.75pt .75pt .75pt .75pt"> �<a href="mailto:david.ely@immersaview.com" moz-do-not-send="true">david.ely@immersaview.com</a><o:p></o:p> </td> </tr> <tr> <td style="width:3.75pt;padding:.75pt .75pt .75pt .75pt" width="5"> W<o:p></o:p> </td> <td style="padding:.75pt .75pt .75pt .75pt"> �<a href="http://www.immersaview.com/" target="_blank" moz-do-not-send="true">www.immersaview.com</a><o:p></o:p> </td> </tr> <tr> <td style="width:3.75pt;padding:.75pt .75pt .75pt .75pt" width="5"> A<o:p></o:p> </td> <td style="padding:.75pt .75pt .75pt .75pt"> �13/67 Depot St, Banyo, QLD 4014<o:p></o:p> </td> </tr> </tbody> </table> </td> </tr> <tr> <td style="padding:1.5pt 1.5pt 1.5pt 1.5pt"> This electronic mail transmission is confidential and is intended only for the review of the party to whom it is addressed. <o:p></o:p> </td> </tr> </tbody> </table> <o:p>�</o:p> <o:p>�</o:p> </div> </blockquote> </body> </html>