[Matroska-general] Extension to Matroska for use in a real life bike trainer film

Brendan Ball ball.brendan50 at gmail.com
Sat Apr 2 11:30:25 CEST 2022


I hope this is the correct mailing list to ask this question.

I'm exploring options for making an open file format to be used for bike
trainer films.
Bike trainer films are kind of VR where a cyclist recorded a video of them
cycling which includes GPS with elevation gain. You can then use a bike
trainer connected to an app where you watch the video as you cycle and the
video speed is based on your power output from the bike trainer, which
means the video speed changes dynamically very often.
Examples of apps:
- https://ergvideo.com/
- https://www.garmin.com/en-US/p/696770/

There are many apps out there for this, but I haven't found any open file
format that they use, they all seem to implement proprietary file formats.
I would like to make it easier to create content that isn't locked behind a
specific subscription on a specific app. One of the first steps in this is
making an open file format so that any bike trainer app that supports it
can potentially use the same available content.
Given that Matroska is already an open format and seems to be pretty
extensible, I would like to find out from Matroska experts whether you
think making a Matroska extension for this use case instead of making a
completely custom new format is feasible and preferred.

Things to consider:
- GPS data for a video would just be another track in the media that is
synced with the video
- GPS data for the complete video should be easy to extract since it's very
common to show a preview profile of the elevation of the entire video to
help the user choose a video. Other metadata like complete distance is also
either extracted or calculated before playing the video
- Other data might be captured as well from sensors like a gyroscope,
accelerometer etc.
- The Matroska file should be playable as is by existing video players
(even though it contains extra data like GPS). This makes it easy to use
the same files for previewing the video without needing a special app. This
might be especially beneficial when having a collection of videos on a
website to preview before downloading.

I've briefly gone through some of the Matroska spec and it seems that it
should be possible to extend it for this use case. For example, there is a
track type that can be extended. I also saw that there is an extension for
stereoscopic media.

Thinking in more generic terms, we could theoretically link any kind of
data as a track which can be used in many different applications. I think
this use case draws parallels to "4D" movies where you could potentially
extend Matroska to support a "4D" video.

So do you like the idea of creating a Matroska extension for this use case?
Do you as a Matroska expert have any insight for me regarding this?

PS. I'm currently just a casual smart bike trainer user and a software
developer with no particular expertise in multi-media  and not currently
affiliated with any bike trainer app. I'm just a user getting annoyed by
the current state of things, who likes open standards and maybe wants to
make my own and other's experience better by making something easier/more
accessible and therefore providing more options.

Brendan Ball
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.matroska.org/pipermail/matroska-general/attachments/20220402/e5694bad/attachment.htm>

More information about the Matroska-general mailing list