[gst-devel] Regarding GStreamer usage for multiple sessions

[Marco Ballesio]

Hi,

On 11/18/10, shibin k <shibin00 at gmail.com> wrote:
> Hi,
>
>    The problem is that we may need to scale our applications to support
> thousands of subscribers simultaneously. i.e, 1000s of subscribers will try
> to download different video files and feed to the gstreamer framework for
> decoding/parsing of these files. So if I need the same kind of pipeline that
> will just decode one video format and do something for all these video
> files, then do I need to create separate pipelines for all these files.
>
>     Our scenario is that we may need to support decoding/parsing of these
> thousands of files (Or even more) simultaneously and if we need to create
> one pipeline per file, we'll end up creating a huge number of threads (one
> per pipeline) which will not be feasible.

do you mean that your hardware/OS can't scale up to thousands of
threads or processes? If it's the case, maybe you need to get a 21st
century system (or later 20th) ;) .

> Please let me know whether this
> kind of scenario can be supported using gstreamer and if yes, plz suggest me
> the best way to achieve this.

if you don't need to transcode on-the-fly (that is, you're fine with
the codecs the original file contains) the overhead generated from the
pipeline should be minimal, so I'd suggest you to definitely go that
way. If you want to transcode, you can just pre-process the files as
soon as you get them so to always get consistent codecs. In case you
really want to transcode on the fly, be prepared and get a really
powerful system (and lightspeed codecs as well).

Regards

>
> *Thanks & Regards,
> Shibin*
>
>
> On Tue, Nov 16, 2010 at 6:02 PM, Marco Ballesio <gibrovacco at gmail.com>wrote:
>
>> Hi,
>>
>> On Tue, Nov 16, 2010 at 1:53 PM, shibin k <shibin00 at gmail.com> wrote:
>>
>>> Hi,
>>>
>>>   Thanks for the reply. I understood that with mutiple pipelines, we can
>>> achieve multiple video sessions. But if I've hundreds of subscribers
>>> trying
>>> to download and decode/parse same or multiple video files simultaneously,
>>> we
>>> will end up creating lot of pipelines and in effect lot of threads right?
>>> This will effect the performance, isn't it? Please let me know whether
>>> gstreamer framework is scalable to achieve the scenario I've mentioned
>>> here
>>> and whether the performance will be hit during such scenario?
>>>
>>
>> there are many excellent GStreamer - based apps scaling very well up to
>> hundreds of threads.
>>
>> One for all:
>>
>> http://www.buzztard.org/index.php/Main_Page
>>
>> Afaik limits are given on how well are the custom elements in your
>> pipeline
>> written and on your system capacity. For instance, you may have custom
>> -and
>> not well designed- codec elements or something coming from gst-plugins-bad
>> (I'm not saying all the stuff there is bad, but imo it's not granted to be
>> in a good shape).
>>
>> Regards
>>
>>
>>> *Best Regards,
>>> Shibin K*
>>>
>>>
>>> On Thu, Nov 11, 2010 at 11:31 PM, Gruenke, Matt
>>> <mgruenke at tycoint.com>wrote:
>>>
>>>>  If you’re talking about having multiple pipelines in the same app (one
>>>> per file), you can definitely do that!
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> Matt
>>>>
>>>>
>>>>
>>>>
>>>>  ------------------------------
>>>>
>>>> *From:* shibin k [mailto:shibin00 at gmail.com]
>>>> *Sent:* Thursday, November 11, 2010 12:14
>>>> *To:* gstreamer-devel at lists.sourceforge.net
>>>> *Subject:* [gst-devel] Regarding GStreamer usage for multiple sessions
>>>>
>>>>
>>>>
>>>> Hi,
>>>>
>>>>
>>>>
>>>>    I'm planning to develop an application using gstreamer that will
>>>> download multiple video files simultaneously and decode them or edit
>>>> those
>>>> files.
>>>>
>>>> My doubt is whether G-streamer APIs are re-entrant? Whether using
>>>> gstreamer api's by multiple video sessions simultaneously create any
>>>> issues?
>>>>
>>>>
>>>>
>>>>     Please reply at the earliest so that I can explore more on
>>>> gstreamer.
>>>> If gstreamer cannot support this, I may need to explore on other
>>>> solutions
>>>> available.
>>>>
>>>>
>>>> *Thanks,*
>>>>
>>>> *Regards,
>>>> Shibin K*
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> Centralized Desktop Delivery: Dell and VMware Reference Architecture
>>>> Simplifying enterprise desktop deployment and management using
>>>> Dell EqualLogic storage and VMware View: A highly scalable, end-to-end
>>>> client virtualization framework. Read more!
>>>> http://p.sf.net/sfu/dell-eql-dev2dev
>>>> _______________________________________________
>>>> gstreamer-devel mailing list
>>>>
>>>> gstreamer-devel at lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>>>>
>>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Beautiful is writing same markup. Internet Explorer 9 supports
>>> standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2 & L3.
>>> Spend less time writing and  rewriting code and more time creating great
>>> experiences on the web. Be a part of the beta today
>>> http://p.sf.net/sfu/msIE9-sfdev2dev
>>>
>>> _______________________________________________
>>> gstreamer-devel mailing list
>>> gstreamer-devel at lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>>>
>>>
>>
>>
>> ------------------------------------------------------------------------------
>> Beautiful is writing same markup. Internet Explorer 9 supports
>> standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2 & L3.
>> Spend less time writing and  rewriting code and more time creating great
>> experiences on the web. Be a part of the beta today
>> http://p.sf.net/sfu/msIE9-sfdev2dev
>> _______________________________________________
>> gstreamer-devel mailing list
>> gstreamer-devel at lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>>
>>
>