GStreamer Compute

[David Ing]

I hope there is an expert on this list who can answer your question.

I don't have an answer for you, but I wanted to say that this is
potentially a very useful thing to do.  I think there is something about
processing streams of information, which gstreamer does quite well, which
seems central to the way that sensory signals *should* be processed (e.g.
in the context of computer vision problems).  I can imagine doing something
like the Van Essen diagram with gstreamer and OpenCL.

I think having some kind of example around basic convolution -- even
something extremely basic (e.g. sobel edge detection) -- would be a great
example to work from.

I had not heard about SYCL until today, but I just noticed that SYCL seems
to extend some C++ AMP concepts (where GPU code is written as C++ lambda
expressions).  Personally I think this is the correct approach.

On Sun, Apr 7, 2019 at 7:05 PM Aaron Boxer <boxerab at gmail.com> wrote:

> Dear GStreamers,
>
> I'm thinking of writing an OpenCL plugin that will
> add an arbitrary 2d OpenCl kernel into the pipeline;
> possible applications are edge detection, debayering...
>
> Is there any existing element I could use as a template?
> One twist is that GPUs give the highest performance in asynchronous mode,
> so
> the element will need to pull buffers from upstream, schedule them to
> the GPU, and only push the processed buffers downstream when the GPU
> completes.  Also, it would be good to have the option of keeping the memory
> on the device, in order to apply a series of kernels without costly move
> to host and back to device.
>
> Simple use case will be a kernel stored in a single user-specified text
> file that will be passed
> to the plugin, compiled for a specified device, and then executed on the
> buffers.
> For more complex situations, plugin could be sub-classed with multiple
> kernels.
>
> Future work could involve exploring other languages such as SYCL, which
> some say is the future
> of open source compute:
>
> https://en.wikipedia.org/wiki/SYCL
>
> https://www.youtube.com/watch?v=ZTq8wKnVUZ8
> (But Mommy, I don't want to use CUDA ! )
>
> Any advice or guidance would be greatly appreciated.
>
> Many Thanks,
> Aaron
>
>
> _______________________________________________
> gstreamer-devel mailing list
> gstreamer-devel at lists.freedesktop.org
> https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.freedesktop.org/archives/gstreamer-devel/attachments/20190408/507d3048/attachment-0001.html>