<div dir="ltr">I have submitted a new bug around the Debian package paths: <a href="https://bugzilla.gnome.org/show_bug.cgi?id=796009">https://bugzilla.gnome.org/show_bug.cgi?id=796009</a><div> </div><div>Here is a link to Matthew's bug on the license files (around ASCII vs UTF-8 encoding): <a href="https://bugzilla.gnome.org/show_bug.cgi?id=795792">https://bugzilla.gnome.org/show_bug.cgi?id=795792</a></div><div> </div><div>No bug has been files (yet) on the ARMv7, Raspberry PI stuff. (I won't be filing a bug on that one.)</div></div><div class="gmail_extra"> <div class="gmail_quote">On Wed, May 9, 2018 at 12:17 AM, Matthew Thyer <<a href="mailto:matthew.thyer@adelaide.edu.au" target="_blank">matthew.thyer@adelaide.edu.au</a>> wrote: <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div lang="EN-AU" link="blue" vlink="purple"> <div class="m_723766672656073719WordSection1"> Nicolas, I was initially distressed to hear that the GStreamer project delegates packaging to the Linux distros and hence the information on the "Building from source using Cerbero" web page was misleading (as it’s not what is actually used) but then I refocussed on the fact that I don’t actually need packaging as I’m just looking for the answer to how to build GStreamer from source. I’ve read a bit further on the <a href="https://gstreamer.freedesktop.org/documentation/installing/building-from-source-using-cerbero.html" target="_blank"> "Building from source using Cerbero" web page</a> and noticed something which I’d missed before regarding the prefix for the building. Under the heading “Build a single project with GStreamer” there’s the text “By default, Cerbero uses as prefix a folder in the user directory with the following schema ~/cerbero/dist/$platform_$arch” and that this prefix can be changed by using a “custom configuration file named custom.cbc”. It then gives an example on how to specify the prefix for various platforms. I’ve tested this and my cerbero created packages look much better. I’m yet to test installation of the packages in a minimal system and to see if my application works but I’m feeling a lot closer. My build process is now: 1. docker run -it ubuntu:xenial bash 2. apt install -y sudo python3 python-dev git intltool 3. populate your ~/.gitconfig for your identity 4. mkdir ~/git 5. cd ~/git 6. git clone git://<a href="http://anongit.freedesktop.org/gstreamer/cerbero" target="_blank">anongit.freedesktop.org/gstreamer/cerbero</a> -b 1.14 7. cd ~/git/cerbero 8. git checkout 1.14 9. yes | ./cerbero-uninstalled bootstrap 10. echo prefix=\'/usr/local/gstreamer\' >~/custom.cbc 11. perl -pi -e 's/[^[:ascii:]]//g' packages/gstreamer-1.0/license.txt 12. ./cerbero-uninstalled -c ~/custom.cbc package gstreamer-1.0 Do you think this may meet my requirements for simply being able to build and use any version of GStreamer? If yes, then cerbero is still useful and we just need to fix it to be able to handle UTF-8 text in the packages/gstreamer-1.0/license.txt file. I would also like to fix the cross compilation to be able to build for the ARMv7 hard float architecture so as to be useful for the Raspberry Pi 2, 3, 3B+ but I’ll work on that. P.S. I tried to make Outlook reply to your emails correctly (indenting and allow me to comment inline but it’s very hard so please forgive yet another top posted reply). From: gstreamer-devel <<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org" target="_blank">gstreamer-devel-bounces@lists.freedesktop.org</a>> On Behalf Of Nicolas Dufresne Sent: Monday, 7 May 2018 11:43 PM<div><div class="h5"> To: Discussion of the development of and with GStreamer <<a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank">gstreamer-devel@lists.freedesktop.org</a>> Subject: Re: No specific packager available for the distro version ubuntu_16_04_xenial</div></div><div><div class="h5"> <div> <div> <div> <div> Le lun. 7 mai 2018 15:42, David Ing <<a href="mailto:ding@panopto.com" target="_blank">ding@panopto.com</a>> a écrit : </div> <blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <div> <div> Nicolas, </div> <div> </div> <div> Are you saying that cerbero is not the preferred way of building deb packages? If that is true then what is the preferred way? </div> </div> </blockquote> </div> </div> <div> </div> <div> Each Linux distribution have their own preferred way, tailored for the specific distro configuration. Some uses Debian Makefiles, some uses RPM specs, some have their own formats. </div> <div> </div> <div> The Debian and RPM packagers in Cerbero have never been used by the GStreamer project to deliver prebuilds binaries, we have always delegated the work of distribution to distributions (Debian, UBuntu, Fedora, etc.). This could change in the future, but likely not through Cerbero. </div> <div> </div> <div> These packagers scripts dates back from the commercial GStreamer SDK project, from witch Cerbero build system was built. It's the only build system that we know that supports all the targets we support (Linux, Windows, OSX, iOS and Android) and are very happy that this tool was later contributed upstream. Though we totally understand the limitation it has over build path, including the fact the the prefix does not match the final installation path (Wich Linux distro packagers normally do correctly). We workaround with scripts, as we don't have strong motivation to revisit these. </div> <div> </div> <div> <div> <blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <div> <div> <div> <div> On Mon, May 7, 2018, 5:27 AM Nicolas Dufresne <<a href="mailto:nicolas@ndufresne.ca" target="_blank">nicolas@ndufresne.ca</a>> wrote: </div> <blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <div> <div> <div> <div> Le lun. 7 mai 2018 08:57, Matthew Thyer <<a href="mailto:matthew.thyer@adelaide.edu.au" target="_blank">matthew.thyer@adelaide.edu.au</a>> a écrit : </div> <blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <div> <div> I don’t know what gst-shell is. </div> </div> </blockquote> </div> </div> <div> Or maybe it's called gst-env, anyway, you need a script in ordered to use the files installed by the generated packages. I'm assuming you managed to install it after you worked around the Python UTF8 bug. This second bug need to be fixed, assuming you have utf8 support in your Python installation. It's possible that it's a regression introduced by the porting to Python 3. We don't usually tes on bare distro without utf8 shell. For the first, it will only be fixed if someone is willing to improve this packager. It's not used much these days. </div> <div> </div> <div> </div> <div> <div> <blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <div> <div> I’ve documented my steps to reproduce in the <a href="https://bugzilla.gnome.org/show_bug.cgi?id=795792" target="_blank">report for bug 795792</a>. That’s not exactly correct as I’m now restricting my to the Ubuntu Xenial docker image and I’m also building the 1.14 branch. My exact steps are: <ol start="1" type="1"> <li class="MsoNormal"> docker run -it ubuntu:xenial bash</li><li class="MsoNormal"> apt install -y sudo python3 python-dev git intltool</li><li class="MsoNormal"> populate your ~/.gitconfig for your identity</li><li class="MsoNormal"> mkdir ~/git</li><li class="MsoNormal"> cd ~/git</li><li class="MsoNormal"> git clone git://<a href="http://anongit.freedesktop.org/gstreamer/cerbero" target="_blank">anongit.freedesktop.org/gstreamer/cerbero</a> -b 1.14</li><li class="MsoNormal"> cd ~/git/cerbero</li><li class="MsoNormal"> git checkout 1.14</li><li class="MsoNormal"> yes | ./cerbero-uninstalled bootstrap</li><li class="MsoNormal"> perl -pi -e 's/[^[:ascii:]]//g' packages/gstreamer-1.0/license.txt</li><li class="MsoNormal"> ./cerbero-uninstalled package gstreamer-1.0</li></ol> I hope this makes it easy to reproduce as that’s my intention in using docker. From: gstreamer-devel <<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org" target="_blank">gstreamer-devel-bounces@lists.freedesktop.org</a>> On Behalf Of Nicolas Dufresne Sent: Monday, 7 May 2018 3:58 PM To: Discussion of the development of and with GStreamer <<a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank">gstreamer-devel@lists.freedesktop.org</a>> Subject: Re: No specific packager available for the distro version ubuntu_16_04_xenial <div> <div> <div> <div> Le lun. 7 mai 2018 01:27, Matthew Thyer <<a href="mailto:matthew.thyer@adelaide.edu.au" target="_blank">matthew.thyer@adelaide.edu.au</a>> a écrit : </div> <blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt"> <div> <div> I’ve found that stripping non-ascii characters from the file "packages/gstreamer-1.0/license.txt" allows packaging using the default packager to complete. However, the packages produced are not correct as reported by David Ing for cerbero v1.12.4 in his message: “<a href="https://lists.freedesktop.org/archives/gstreamer-devel/2018-April/067562.html" target="_blank">Cerbero 1.12.4 Problem with paths inside *.deb files</a>”. The error is that the paths for the files to be installed are the paths where the source was built rather than the default installation prefix of /usr/local as is expected. </div> </div> </blockquote> </div> </div> <div> </div> <div> It's not clear what is considered broken here, did you run gst-shell ? </div> <div> </div> <div> <div> <blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt"> <div> <div> <div> <div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> From: gstreamer-devel <<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org" target="_blank">gstreamer-devel-bounces@lists.freedesktop.org</a>> On Behalf Of Matthew Thyer Sent: Friday, 4 May 2018 3:22 PM To: Discussion of the development of and with GStreamer <<a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank">gstreamer-devel@lists.freedesktop.org</a>> Subject: RE: No specific packager available for the distro version ubuntu_16_04_xenial </div> </div> Bug 795792 logged From: gstreamer-devel <<a href="mailto:gstreamer-devel-bounces@lists.freedesktop.org" target="_blank">gstreamer-devel-bounces@lists.freedesktop.org</a>> On Behalf Of Nicolas Dufresne Sent: Thursday, 26 April 2018 11:02 PM To: Discussion of the development of and with GStreamer <<a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank">gstreamer-devel@lists.freedesktop.org</a>> Subject: Re: No specific packager available for the distro version ubuntu_16_04_xenial <div> <div> <div> <div> Le mar. 24 avr. 2018 04:27, Matthew Thyer <<a href="mailto:matthew.thyer@adelaide.edu.au" target="_blank">matthew.thyer@adelaide.edu.au</a>> a écrit : </div> <blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt"> <div> <div> Greetings gstreamer-devel list, I’m wishing to build and package GStreamer v1.14 (or later) for the ARM32 hard-float architecture (for Raspberry Pi 2, 3, 3B+). I mean the GNU Triplet: arm-linux-gnueabihf. As you may have seen from my last two emails (“Failure to cross compile GStreamer v1.14 with config/cross-lin-arm.cbc” & “How to cross compile GStreamer for Raspberry Pi 2, 3, 3B+ (arch=armhf)?”) I’m not currently able to cross compile for this outcome so I have instead setup docker on my Raspberry Pi 3 and run a native build. This completes normally but then fails to package the results of the build. It looks like cerbero tries to fall back to some kind of default packager but then crashes and I get a python traceback. The error messages from the failure are: WARNING: No specific packager available for the distro version ubuntu_16_04_xenial, using generic packager for distro debian WARNING: No packager defined, using default packager "Default <<a href="mailto:default@change.me" target="_blank">default@change.me</a>>" Traceback (most recent call last): File "./cerbero-uninstalled", line 9, in <module> main() File "./cerbero/main.py", line 130, in main Main(sys.argv[1:]) File "./cerbero/main.py", line 55, in __init__ self.run_command() File "./cerbero/main.py", line 105, in run_command res = commands.run(command, self.config, self.args) File "./cerbero/commands/__init__.py", line 78, in run return _commands[command].run(config, args) File "./cerbero/commands/package.py", line 82, in run pkg = Packager(config, p, self.store) File "./cerbero/packages/packager.py", line 53, in __new__ return _packagers[d][v](config, package, store) File "./cerbero/packages/debian.py", line 448, in __new__ return DebianPackager(config, package, store) File "./cerbero/packages/debian.py", line 187, in __init__ self.license = f.read() File "/usr/lib/python3.5/encodings/ascii.py", line 26, in decode return codecs.ascii_decode(input, self.errors)[0] UnicodeDecodeError: 'ascii' codec can't decode byte 0xef in position 0: ordinal not in range(128) I’ve confirmed that I get the same error when running a native build in a docker container on an x86_64 VM so this problem is not specific to the ARM architecture. Does anyone have a solution for this issue? </div> </div> </blockquote> </div> </div> <div> This crash is unrelated to the harmless warnings. It's reading from file expecting ASCII and hit some utf8 char, and crash. Can you file a bug to <a href="http://bugs.gnome.org" target="_blank">bugs.gnome.org</a> with that backtrace attached. </div> <div> </div> <div> </div> <div> <div> <blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt"> <div> <div> Regards, --- Matthew Thyer (08) 8313 9283 4.38 Ingkarni Wardli Adelaide University </div> </div> _______________________________________________ gstreamer-devel mailing list <a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank">gstreamer-devel@lists.freedesktop.org</a> <a href="https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel" target="_blank">https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel</a> </blockquote> </div> </div> </div> </div> </div> _______________________________________________ gstreamer-devel mailing list <a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank">gstreamer-devel@lists.freedesktop.org</a> <a href="https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel" target="_blank">https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel</a> </blockquote> </div> </div> </div> </div> </div> _______________________________________________ gstreamer-devel mailing list <a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank">gstreamer-devel@lists.freedesktop.org</a> <a href="https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel" target="_blank">https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel</a> </blockquote> </div> </div> </div> _______________________________________________ gstreamer-devel mailing list <a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank">gstreamer-devel@lists.freedesktop.org</a> <a href="https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel" target="_blank">https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel</a> </blockquote> </div> </div> </div> _______________________________________________ gstreamer-devel mailing list <a href="mailto:gstreamer-devel@lists.freedesktop.org" target="_blank">gstreamer-devel@lists.freedesktop.org</a> <a href="https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel" target="_blank">https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel</a> </blockquote> </div> </div> </div> </div></div></div> </div> _______________________________________________ gstreamer-devel mailing list <a href="mailto:gstreamer-devel@lists.freedesktop.org">gstreamer-devel@lists.freedesktop.org</a> <a href="https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel" rel="noreferrer" target="_blank">https://lists.freedesktop.org/mailman/listinfo/gstreamer-devel</a> </blockquote></div> </div>