[Spice-devel] Getting involved with implementation of remote spice for 3D accelerated VMs

[Victor Toso]

Hi,

On Mon, Jan 09, 2017 at 11:46:56AM -0500, Frediano Ziglio wrote:
> >
> > Hi,
> >
> > On Mon, Jan 09, 2017 at 04:27:35AM -0500, Frediano Ziglio wrote:
> > > The patches for Virgl are working and require only tweaks.  We wanted
> > > to have some working PoC for all next 3D software, that include GPU
> > > passtrough to make sure that the Virgl doesn't complicate the overall
> > > design. We plan to have these definitive PoCs in a couple of months.
> > >
> > > About video streaming acceleration for the client somebody are doing
> > > some stuff. Recent client versions are using gstreamer to handle
> > > decoding so potentially this could be a question of choosing the right
> > > plugins, test and package them correctly
> >
> > Yes, I'm trying to play with it now and then in the client using
> > gstreamer1-vaapi it works but we don't handle hw decoding specifically.
> > If you have all the right bits installed, you can try enabling
> > SPICE_GSTVIDEO_AUTO which uses decodebin. It should try vaapi elemets
> > (and hw decoding) if possible.
> >
>
> This is partially true.
> The best path is never leaving the GPU for the output but I don't
> think this is so automatic.

Since gstreamer 1.10, I think they will always try to setup hw decoding
if possible. Still, I find it important to improve handling this in
spice-gtk for robustness (not because it is or it isn't automatic in
gstreamer).

To be honest, I did not spend too much time thinking on it yet. We
should ask in #gstreamer for some input/ideas on dealing with different
decoders + hw capability.

>
> > But to have this working nicely, we should have an easy way to setup
> > spice-sever to use vp8 or h264 which broadens the hw decoding
> > possibilities (and makes much easier to test too!) - So, I've started
> > playing with that first [0]
> > 
> > [0]
> > https://lists.freedesktop.org/archives/spice-devel/2017-January/034815.html
> > 
> > With that in, working on improving the client-side to handle hw decoding
> > will be easier. If you are interested in the decoding side, feel free to
> > jump in :)
> > 
> > > (this is more challenging for Windows for instance).
> > 
> > Indeed
> >
>
> Not sure how you can use DirectX or other Windows libraries for h/w
> decoding.

No clue yet but I'll try to keep it close to gst as we can (new plugins
if necessary)

Cheers,
  toso

>
> Frediano
> 
> > >
> > > ----- Original Message -----
> > > 
> > > > From: "Behrooz Shabani" <everplays at gmail.com>
> > > > To: "spice-devel" <spice-devel at freedesktop.org>
> > > > Cc: "Armin Ranjbar" <zoup at zoup.org>
> > > > Sent: Sunday, January 8, 2017 12:39:52 PM
> > > > Subject: Re: [Spice-devel] Getting involved with implementation of remote
> > > > spice for 3D accelerated VMs
> > > 
> > > > Thanks Gerd and hello mailing list :-),
> > > 
> > > > As it is obvious from my previous email, I am looking for some guidance
> > > > to
> > > > make some contribution while I am working on my specialization.
> > > 
> > > > At this moment, I know what I like to be able to do with Spice:
> > > 
> > > > * Remote access with 3D acceleration
> > > > * Decoding the video stream via GPU on the client.
> > > > However, I have no idea what their status is and where I should begin to
> > > > contribute. Therefore, any information towards making me useful to spice
> > > > (as
> > > > I want to do more than just basing my research on virtgl/spice), would be
> > > > very helpful.
> > > 
> > > > Thanks in advance.
> > > 
> > > > P.S. I have joined the IRC channel with the nickname `behrooz` as well.
> > > 
> > > > On Fri, Jan 6, 2017 at 10:45 AM, Gerd Hoffmann < kraxel at redhat.com >
> > > > wrote:
> > > 
> > > > > On Mi, 2017-01-04 at 15:40 +0100, Behrooz Shabani wrote:
> > > > 
> > > > > > Hi Gerd,
> > > > 
> > > > > >
> > > > 
> > > > > >
> > > > 
> > > > > > I hope you are doing well.
> > > > 
> > > > > >
> > > > 
> > > > > >
> > > > 
> > > > > > I watched one of your talks about virgl and spice, great work!
> > > > 
> > > > > >
> > > > 
> > > > > >
> > > > 
> > > > > > Currently, I am busy with my specialization at Saxion university
> > > > > > which
> > > > 
> > > > > > is about virtualization of graphic cards.
> > > > 
> > > > > >
> > > > 
> > > > > >
> > > > 
> > > > > > I was wondering how I can get involved to implement 3D accelerated VM
> > > > 
> > > > > > over network with spice. And after that, maybe, with using the GPU of
> > > > 
> > > > > > the system that runs spice to decode the video stream. Essentially, I
> > > > 
> > > > > > am looking for your guidance to understand what needs to be done so I
> > > > 
> > > > > > can get on with implementing it.
> > > > 
> > > 
> > > > > That question is asked best on the spice-devel mainling list (added to
> > > > 
> > > > > Cc:).
> > > > 
> > > 
> > > > > Improving video encoding support in spice is making progress, and
> > > > > remote
> > > > 
> > > > > support for virtio-gpu (and intel-vgpu) will build on top of that.
> > > > 
> > > 
> > > > > But I don't know in detail what the status is and what still needs to
> > > > > be
> > > > 
> > > > > done to complete remote support.
> > > > 
> > > 
> > > > > cheers,
> > > > 
> > > > > Gerd
> > > > 
> > > 
> > > > --
> > > > regards,
> > > > behrooz
> > > 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: not available
URL: <https://lists.freedesktop.org/archives/spice-devel/attachments/20170109/a19f03cc/attachment.sig>