please help: high latency livestreaming question (h264/aac, rtp rtcp), playback in gstreamer-0.10 a/v doesn't sync

[Ralf Stoye]

Hi,

I have great success streaming to an DarwinStreamingServer with the following pipeline:
(x264enc settings for better quality than zerolatency, so i get a latency of about 1 second, which is corrected on playback - if the client receives&honors the rtcp informations.
Without the big queues the pipeline doesn't go into state "playing",
quality is very good since x264 has its time to analyse the incoming video)

gst-launch-0.10 -vvv -m gstrtpbin latency=3000 name=rtpbin ntp-sync=true \
    decklinksrc mode=7 connection=4 audio-input=3 name=decklink0 \
    decklink0.audiosrc ! audioconvert ! "audio/x-raw-int,rate=48000,channels=2" ! queue max-size-buffers=40000 max-size-time=2000000000 max-size-bytes=0 ! voaacenc bitrate=128000 ! rtpmp4apay ! rtpbin.send_rtp_sink_0 \
        rtpbin.send_rtp_src_0 ! udpsink host=78.47.221.XXX port=5008 ts-offset=800000000 name=udpaudio \
        rtpbin.send_rtcp_src_0 ! udpsink host=78.47.221.XXX port=5009 sync=false async=false name=udpaudioc \
    decklink0.videosrc  ! ffmpegcolorspace ! queue ! \
	x264enc  bitrate=750  tune=film speed-preset=medium ! \
	  queue max-size-buffers=40000 max-size-time=2000000000 max-size-bytes=0 ! rtph264pay ! rtpbin.send_rtp_sink_1 \
	rtpbin.send_rtp_src_1 ! udpsink host=78.47.221.XXX port=5004 name=udpvid \
	rtpbin.send_rtcp_src_1 ! udpsink host=78.47.221.XXX port=5005 sync=false async=false name=udpvidc
 

this is the sdpfile on the server:

v=0
o=- 1208520720 2590316915 IN IP4 78.47.221.XXX
c=IN IP4 78.47.221.XXX
s=ESP H264+AAC STREAM
m=video 5004 RTP/AVP 96
a=rtpmap:96 H264/90000
a=fmtp:96 media=video; clock-rate=90000; encoding-name=H264; sprop-parameter-sets=Z0LAHtkAtBJsCSIAAAMAAu5rKAAeLFyQAA==,aMuMsg==
a=control:trackID=1
m=audio 5008 RTP/AVP 96
a=rtpmap:96 MP4A-LATM/48000/2
a=fmtp:96 media=audio; clock-rate=48000; encoding-name=MP4A-LATM; cpresent=0; config=40002320; payload=96
a=control:trackID=2

Now for the problem: I can't receive this stream with gstreamer.
I have no problems to play it with Quicktime, VLC, ffmpeg, avplay, even restreaming as rtmp with crtmpserver works.
But I can't receive this stream with gstreamer.
I tried so many pipelines without success, maybe someone on this list has a working example?
(anyone who wants the real serverip can send me a pm)

Thanks,
Ralf Stoye

p.s. 
I even transcode it on the server and create an iOS compatible stream with ffmpeg, but i would prefer to use gstreamer for these tasks.