Audio Video Mixer Application

Stefan Kost ensonic at hora-obscura.de
Sun Jun 5 14:06:19 PDT 2011


Am 01.06.2011 08:08, schrieb bhavna:
> Thanks for the reply
> On 5/31/2011 5:04 PM, Stefan Kost wrote:
>> Am 31.05.2011 06:57, schrieb vineeth:
>>>
>>>
>>> On Mon, May 23, 2011 at 2:21 PM, bhavna<bhavna.yadav at st.com
>>> <mailto:bhavna.yadav at st.com>>  wrote:
>>>
>>>      Hello Guys,
>>>
>>>      Help needed on GStreamer. I don't have much info of it.
>>>      Actually my objective is to find/build the application to satisfy the
>>>      scenario as following
>>>
>>>                             Audio-->)v4l2)
>>>                             |               |
>>>      video played===>HDMI==>  |               |
>>>      from Settop     Rx      |               |
>>>      box                     |               |=====>  MIX and store the data e
>>>                             |               |
>>>                             Video-->RGB Data
>>>
>>>
>>>      Is there any gstreamer application availble which can mix Audio data coming
>>>      from SPDIF pins of HDMI and raw RGB data from HDMI Video pins.
>>>      HDMI Rx will be supporting V4L2 framework.
>>>
>>>
>>> A v4l2 video component is available in gstreamer.
>>> As for spdif / hdmi stuff,  you will have to write the gstreamer plugins;
>>> You can see the list available plugins here :
>>> http://gstreamer.freedesktop.org/documentation/plugins.html
>>
>> alsasrc can record from spdif and as Bhavna wrote v4l2src will support hdmi
>> capture.
>>
>> Bhana, you will need to write a small application (using python if you want). It
>> will be something like:
>> alsasrc ! audio-encoder ! muxer name=m ! filesink v4l2src ! video-encoder ! m.
>>
>> You should consider encodebin as then in becomes:
>> alsasrc ! encodebin name=e ! filesink v4l2src ! e.
> When I will form the pipeline as suggested above will the final received data
> will be in sync.
> As per my understanding ALSA framework used for audio will not provide any
> timestamping.
> 
> 
> Let me explain the scenario in detail:
> 1. Video song played using dvd player send its output to HDMI Receiver
> 2. This HDMI receiver sends Audio data via spdif. Here Audio will use ALSA
> framework and V4L2 framework.
> How they both are linked is still not clear to me???
> 
> 3. Video data i.e Raw RGB from HDMI receiver is sent to a wrapper which is a
> VIDEO IN. This video IN doesn't do any processing just dump data on DDR.
> 
> 4. Now, I want to mix the output of point 2 & 3 and store on mass storage as an
> avi file. SO that I can play it again to verify that
> received output is correct.

You are capturing data from two datasources. The resulting file with be in sync
as much as the source push the data without discontinuities and drift. Both
sources will be synced to a systemclock. Just give it a try.

Stefan
> 
> 
>>
>> Stefan
>>
>>>
>>>
>>>
>>>
>>>      --
>>>      Thanks&  Regards
>>>      Bhavna Yadav
>>>      ST Microelectronics
>>>      _______________________________________________
>>>      gstreamer-devel mailing list
>>>      gstreamer-devel at lists.freedesktop.org
>>>      <mailto:gstreamer-devel at lists.freedesktop.org>
>>>      http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> gstreamer-devel mailing list
>>> gstreamer-devel at lists.freedesktop.org
>>> http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>>
>> _______________________________________________
>> gstreamer-devel mailing list
>> gstreamer-devel at lists.freedesktop.org
>> http://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
>> .
>>
> 
> 



More information about the gstreamer-devel mailing list