<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=koi8-r"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style></style></head><body lang=EN-AU link=blue vlink=purple><div class=WordSection1>Hi,<o:p></o:p><o:p> </o:p>I'd like to stream the framebuffer (/dev/fd0) on a Raspberry Pi to a h264 stream using the omxh264enc element.<o:p></o:p><o:p> </o:p>I'm having some difficulty with this however.š The RPi's framebuffer in Raspbian is using the RGB565 or possibly the BGR565 color space.<o:p></o:p><o:p> </o:p>Here is the output of "fbset"<o:p></o:p>pi@raspberrypi ~ $ fbset -i<o:p></o:p><o:p> </o:p>mode "1024x576"<o:p></o:p>ššš geometry 1024 576 1024 576 16<o:p></o:p>ššš timings 0 0 0 0 0 0 0<o:p></o:p>ššš accel true<o:p></o:p>ššš rgba 5/11,6/5,5/0,0/16<o:p></o:p>endmode<o:p></o:p><o:p> </o:p>Frame buffer device information:<o:p></o:p>ššš Nameššššššš : BCM2708 FB<o:p></o:p>ššš Addressšššš : 0x50006000<o:p></o:p>ššš Sizeššššššš : 1179648<o:p></o:p>ššš Typeššššššš : PACKED PIXELS<o:p></o:p>ššš Visualššššš : TRUECOLOR<o:p></o:p>ššš XPanStepššš : 0<o:p></o:p>ššš YPanStepššš : 0<o:p></o:p>ššš YWrapStepšš : 0<o:p></o:p>ššš LineLengthš : 2048<o:p></o:p>ššš Accelerator : No<o:p></o:p><o:p> </o:p>The closest I've gotten do doing this with just gstreamer is this pipeline:<o:p></o:p><o:p> </o:p>pi@raspberrypi ~/videos/test $ gst-launch-1.0 -v --gst-debug 3 multifilesrc location=/dev/fb0 num-buffers = 100 ! videoparse format=29 width=1024 height=576 framerate=25/1 ! decodebin ! videoconvert ! omxh264enc ! filesink location=ss45.h264<o:p></o:p><o:p> </o:p>0:00:00.438961309 12813šš 0xaa6440 ERRORššššššššššššššššššš omx gstomx.c:2773:plugin_init: Invalid type name 'GstOMXTheoraDec' for element 'omxtheoradec'<o:p></o:p>0:00:00.440577215 12813šš 0xaa6440 ERRORššššššššššššššššššš omx gstomx.c:2773:plugin_init: Invalid type name 'GstOMXVP8Dec' for element 'omxvp8dec'<o:p></o:p>Setting pipeline to PAUSED ...<o:p></o:p>Pipeline is PREROLLING ...<o:p></o:p>0:00:01.216074813 12813šš 0xa00a90 FIXMEššššššššššššššš default gstutils.c:3622:gst_pad_create_stream_id_printf_valist:<multifilesrc0:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id<o:p></o:p>/GstPipeline:pipeline0/GstVideoParse:videoparse0.GstPad:src: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstTypeFindElement:typefind.GstPad:src: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstTypeFindElement:typefind.GstPad:src: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0.GstDecodePad:src_0: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstVideoConvert:videoconvert0.GstPad:src: caps = video/x-raw, width=(int)1024, height=(int)576, format=(string)I420, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstOMXH264Enc-omxh264enc:omxh264enc-omxh264enc0.GstPad:sink: caps = video/x-raw, width=(int)1024, height=(int)576, format=(string)I420, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstVideoConvert:videoconvert0.GstPad:sink: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0.GstDecodePad:src_0.GstProxyPad:proxypad1: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstTypeFindElement:typefind.GstPad:sink: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0.GstGhostPad:sink: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstOMXH264Enc-omxh264enc:omxh264enc-omxh264enc0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)high, level=(string)4, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstFileSink:filesink0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)high, level=(string)4, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstOMXH264Enc-omxh264enc:omxh264enc-omxh264enc0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)high, level=(string)4, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstFileSink:filesink0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)high, level=(string)4, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)25/1 Pipeline is PREROLLED ...<o:p></o:p>Setting pipeline to PLAYING ...<o:p></o:p>0:00:01.569037155 12813šš 0xae1860 ERRORššššššššššš omxvideoenc gstomxvideoenc.c:724:gst_omx_video_enc_handle_output_frame:<omxh264enc-omxh264enc0> No corresponding frame found<o:p></o:p>0:00:01.572056978 12813šš 0xae1860 ERRORššššššššššš omxvideoenc gstomxvideoenc.c:724:gst_omx_video_enc_handle_output_frame:<omxh264enc-omxh264enc0> No corresponding frame found<o:p></o:p>New clock: GstSystemClock<o:p></o:p>Got EOS from element "pipeline0".<o:p></o:p>Execution ended after 21189725790 ns.<o:p></o:p>Setting pipeline to PAUSED ...<o:p></o:p>Setting pipeline to READY ...<o:p></o:p>Setting pipeline to NULL ...<o:p></o:p>Freeing pipeline ...<o:p></o:p><o:p> </o:p><o:p> </o:p><o:p> </o:p>The above pipeline gives me a raw h264 video file.š I can't get a pipeline that will work with any kind of useful muxer.š For instance, a mov:<o:p></o:p><o:p> </o:p>pi@raspberrypi ~/videos/test $ gst-launch-1.0 --gst-debug 3 -v multifilesrc location=/dev/fb0 num-buffers = 100 ! videoparse format=29 width=1024 height=576 framerate=25/1 ! decodebin ! videoconvert ! omxh264enc ! qtmux ! filesink location=ss46.h264.mov<o:p></o:p><o:p> </o:p>0:00:00.478667830 16340š 0x18dc440 ERRORššššššššššššššššššš omx gstomx.c:2773:plugin_init: Invalid type name 'GstOMXTheoraDec' for element 'omxtheoradec'<o:p></o:p>0:00:00.480339731 16340š 0x18dc440 ERRORššššššššššššššššššš omx gstomx.c:2773:plugin_init: Invalid type name 'GstOMXVP8Dec' for element 'omxvp8dec'<o:p></o:p>Setting pipeline to PAUSED ...<o:p></o:p>Pipeline is PREROLLING ...<o:p></o:p>0:00:01.275239952 16340š 0x1904400 FIXMEššššššššššššššš default gstutils.c:3622:gst_pad_create_stream_id_printf_valist:<multifilesrc0:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id<o:p></o:p>/GstPipeline:pipeline0/GstVideoParse:videoparse0.GstPad:src: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstTypeFindElement:typefind.GstPad:src: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstTypeFindElement:typefind.GstPad:src: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0.GstDecodePad:src_0: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstVideoConvert:videoconvert0.GstPad:src: caps = video/x-raw, width=(int)1024, height=(int)576, framerate=(fraction)25/1, format=(string)I420, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive<o:p></o:p>/GstPipeline:pipeline0/GstOMXH264Enc-omxh264enc:omxh264enc-omxh264enc0.GstPad:sink: caps = video/x-raw, width=(int)1024, height=(int)576, framerate=(fraction)25/1, format=(string)I420, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive<o:p></o:p>/GstPipeline:pipeline0/GstVideoConvert:videoconvert0.GstPad:sink: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0.GstDecodePad:src_0.GstProxyPad:proxypad1: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstTypeFindElement:typefind.GstPad:sink: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0.GstGhostPad:sink: caps = video/x-raw, format=(string)RGB16, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)1:1:0:0, framerate=(fraction)25/1<o:p></o:p>/GstPipeline:pipeline0/GstOMXH264Enc-omxh264enc:omxh264enc-omxh264enc0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)high, level=(string)4, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)25/1<o:p></o:p>0:00:01.597787969 16340š 0x1924e00 WARNšššššššššššššš šGST_PADS gstpad.c:3577:gst_pad_peer_query:<omxh264enc-omxh264enc0:src> could not send sticky events<o:p></o:p>/GstPipeline:pipeline0/GstOMXH264Enc-omxh264enc:omxh264enc-omxh264enc0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)high, level=(string)4, width=(int)1024, height=(int)576, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)25/1<o:p></o:p>0:00:01.611191180 16340š 0x1924e00 WARNššššššššššššššš GST_PADS gstpad.c:3577:gst_pad_peer_query:<omxh264enc-omxh264enc0:src> could not send sticky events<o:p></o:p>0:00:01.627075245 16340š 0x1924e00 WARNšššššššššššš omxvideoenc gstomxvideoenc.c:930:gst_omx_video_enc_loop:<omxh264enc-omxh264enc0> error: Internal data stream error.<o:p></o:p>0:00:01.628409167 16340š 0x1924e00 WARNššššššššššš šomxvideoenc gstomxvideoenc.c:930:gst_omx_video_enc_loop:<omxh264enc-omxh264enc0> error: stream stopped, reason not-negotiated<o:p></o:p>ERROR: from element /GstPipeline:pipeline0/GstOMXH264Enc-omxh264enc:omxh264enc-omxh264enc0: Internal data stream error.<o:p></o:p>Additional debug info:<o:p></o:p>gstomxvideoenc.c(930): gst_omx_video_enc_loop (): /GstPipeline:pipeline0/GstOMXH264Enc-omxh264enc:omxh264enc-omxh264enc0:<o:p></o:p>stream stopped, reason not-negotiated<o:p></o:p>ERROR: pipeline doesn't want to preroll.<o:p></o:p>/GstPipeline:pipeline0/GstQTMux:qtmux0.GstPad:src: caps = video/quicktime, variant=(string)apple<o:p></o:p>/GstPipeline:pipeline0/GstFileSink:filesink0.GstPad:sink: caps = video/quicktime, variant=(string)apple Setting pipeline to NULL ...<o:p></o:p>Freeing pipeline ...<o:p></o:p><o:p> </o:p><o:p> </o:p><o:p> </o:p>I have a feeling that videoparse isn't properly turning the raw video into proper video frames.š I've also tried using ffmpeg's fbdev frame bufffer source format to store the raw video wrapped as a mov.š <o:p></o:p><o:p> </o:p>pi@raspberrypi ~/videos/test $ /usr/local/bin/ffmpeg -y -f fbdev -r 10 -i /dev/fb0 -codec:v copy -frames 10 -f mov ss37.raw.mov<o:p></o:p><o:p> </o:p>pi@raspberrypi ~/videos/test $ gst-launch-1.0 --gst-debug 3 -v filesrc location=ss37.raw.mov ! decodebin ! videoconvert ! omxh264enc ! filesink location=ss47.h264<o:p></o:p><o:p> </o:p><o:p> </o:p>0:00:00.396099711 22342š 0x1caa300 ERRORššššššššššššššššššš omx gstomx.c:2773:plugin_init: Invalid type name 'GstOMXTheoraDec' for element 'omxtheoradec'<o:p></o:p>0:00:00.397728615 22342š 0x1caa300 ERRORššššššššššššššššššš omx gstomx.c:2773:plugin_init: Invalid type name 'GstOMXVP8Dec' for element 'omxvp8dec'<o:p></o:p>Setting pipeline to PAUSED ...<o:p></o:p>Pipeline is PREROLLING ...<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstTypeFindElement:typefind.GstPad:src: caps = video/quicktime<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstTypeFindElement:typefind.GstPad:src: caps = video/quicktime<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstQTDemux:qtdemux0.GstPad:sink: caps = video/quicktime<o:p></o:p>0:00:01.284890453 22342š 0x1ce0c60 WARNššššššš šššššššššqtdemux qtdemux_types.c:192:qtdemux_type_get: unknown QuickTime node type L565<o:p></o:p>0:00:01.286235373 22342š 0x1ce0c60 WARNšššššššššššššššš qtdemux qtdemux_types.c:192:qtdemux_type_get: unknown QuickTime node type ‘swr<o:p></o:p>0:00:01.298378659 22342š 0x1ce0c60 WARNšššššššššššššššš default descriptions.c:998:gst_pb_utils_get_codec_description: No description available for media type: video/x-gst-fourcc-L565<o:p></o:p>Missing element: video/x-gst-fourcc-L565 decoder<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstMultiQueue:multiqueue0: max-size-buffers = 5<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstMultiQueue:multiqueue0: max-size-time = 0<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstMultiQueue:multiqueue0: max-size-bytes = 2097152<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstMultiQueue:multiqueue0: max-size-buffers = 5<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstMultiQueue:multiqueue0: max-size-time = 0<o:p></o:p>/GstPipeline:pipeline0/GstDecodeBin:decodebin0/GstMultiQueue:multiqueue0: max-size-bytes = 2097152<o:p></o:p>0:00:01.314092735 22342š 0x1ce0c60 WARNšššššššššššššš decodebin gstdecodebin2.c:3703:gst_decode_bin_expose:<decodebin0> No suitable plugins found<o:p></o:p>0:00:01.315684642 22342š 0x1ce0c60 WARNšššššššššššššš decodebin gstdecodebin2.c:3705:gst_decode_bin_expose:<decodebin0> error: no suitable plugins found<o:p></o:p>ERROR: from element /GstPipeline:pipeline0/GstDecodeBin:decodebin0: Your GStreamer installation is missing a plug-in.<o:p></o:p>Additional debug info:<o:p></o:p>gstdecodebin2.c(3705): gst_decode_bin_expose (): /GstPipeline:pipeline0/GstDecodeBin:decodebin0:<o:p></o:p>no suitable plugins found<o:p></o:p>ERROR: pipeline doesn't want to preroll.<o:p></o:p>Setting pipeline to NULL ...<o:p></o:p>Freeing pipeline ...<o:p></o:p><o:p> </o:p><o:p> </o:p>So it looks like decodebin cannot recognise video/x-gst-fourcc-L565 (which is RGB16, I believe).<o:p></o:p><o:p> </o:p>Any suggestions?<o:p></o:p><o:p> </o:p>Dan<o:p></o:p><o:p> </o:p></div></body></html>