[Bug 721389] New: RFC: api to handle multi-samples

[GStreamer (bugzilla.gnome.org)]

https://bugzilla.gnome.org/show_bug.cgi?id=721389
  GStreamer | gstreamer (core) | 1.x

           Summary: RFC: api to handle multi-samples
    Classification: Platform
           Product: GStreamer
           Version: 1.x
        OS/Version: Linux
            Status: UNCONFIRMED
          Severity: normal
          Priority: Normal
         Component: gstreamer (core)
        AssignedTo: gstreamer-bugs at lists.freedesktop.org
        ReportedBy: ensonic at sonicpulse.de
         QAContact: gstreamer-bugs at lists.freedesktop.org
     GNOME version: ---


Various audio files (XI, IFF-8SVX/16SV) represent instruments using
multi-samples. They do this by assigning each sample a base-note (or
frequency).

I can see several ways to represent this in GStreamer:

1) GstToc, we can use editions as the multisamples are alternatives. The
root-key would be part of the GstTaglist of the GstTocEntry. Application will
use the GST_EVENT_TOC_SELECT to pick the variant to play/decode.

2) Multiple audio tracks via separate sometimes pads. Application need to
carefully associate tags with pads to figure the right base_note for each pad.
Then they can connect to the pad they want to play with input selector.

3) We could use audiometa to pack the alternative versions onto the actual
audio track. Now sure how convenient this would be to use and what issues we'd
face when chunking the content.

-- 
Configure bugmail: https://bugzilla.gnome.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug.
You are the assignee for the bug.