Skip to content

Commit

Permalink
Documentation updates (#136)
Browse files Browse the repository at this point in the history
* Create mpeg-i-scene-description.md

* Update mpeg-i-scene-description.md

* Update mpeg-i-scene-description.md

* Update xr-specifications.md

* Create 3gpp-specifications.md

* Update mpeg-i-scene-description.md

* Update xr-specifications.md

* Update 3gpp-specifications.md

* Update mpeg-i-scene-description.md

* Update mpeg-i-scene-description.md

* Create mpeg-i-sd-0.png

* Add files via upload

* Update mpeg-i-scene-description.md

* Delete pages/xr/xr-specifications.md

* Update xr-worktiems.md

* Update mpeg-i-scene-description.md

* Update 3gpp-specifications.md

* Update 3gpp-specifications.md

* Update mpeg-i-scene-description.md

* Update xr-worktiems.md

* Update xr.md

* Update 5g-media-streaming.md

* Update 5g-multicast-broadcast-services.md

* Update lte-based-5g-broadcast.md

* Rename xr-worktiems.md to 3gpp-worktiems.md

* Update and rename lte-based-5g-broadcast-specifications.md to 3gpp-specifications.md

* Update lte-based-5g-broadcast-workitems.md

* Rename lte-based-5g-broadcast-workitems.md to 3gpp-workitems.md

* Update 3gpp-specifications.md

* Update 3gpp-worktiems.md

* Update mpeg-i-scene-description.md

* Create mpeg-specifications.md

* Update mpeg-specifications.md

* Update mpeg-i-scene-description.md

* Update mpeg-i-scene-description.md

* Update mpeg-i-scene-description.md

* Update mpeg-specifications.md

* Update 3gpp-worktiems.md

* Create ietf-specifications.md

* Update ietf-specifications.md

* Create multimedia-content-delivery.md

* Update 5g-multicast-broadcast-services-specifications.md

* Rename 5g-multicast-broadcast-services-specifications.md to 3gpp-specifications.md

* Rename 5g-multicast-broadcast-services-workitems.md to 3gpp-workitems.md

* Update 3gpp-specifications.md

* Update ietf-specifications.md

* Update 3gpp-specifications.md

* Rename 3gpp-worktiems.md to 3gpp-workitems.md

* Update 3gpp-specifications.md

* Update and rename 5g-media-streaming-specifications.md to 3gpp-specifications.md

* Update and rename 5g-media-streaming-workitems.md to 3gpp-workitems.md

* Update 3gpp-workitems.md

* Update 3gpp-workitems.md

* Update ietf-specifications.md

* Update multimedia-content-delivery.md

* Update xr.md

* Update multimedia-content-delivery.md

* Update 5g-media-streaming.md

* Update multimedia-content-delivery.md

* Update xr.md
  • Loading branch information
jordijoangimenez authored Jul 4, 2024
1 parent 19fe4f3 commit 68d3cb4
Show file tree
Hide file tree
Showing 19 changed files with 119 additions and 44 deletions.
7 changes: 1 addition & 6 deletions pages/5g-media-streaming.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,7 @@
layout: default
title: 5G Media Streaming
has_children: true
nav_order: 1
nav_order: 0
---

# 5G Media Streaming
## 📑 Specifications and relevant references
* Information about relevant specifications can be found in this [page](5g-media-streaming/5g-media-streaming-specifications.html)

## 📑 Relevant Work Items
* A list of relevant 3GPP Work Items can be found in this [page](5g-media-streaming/5g-media-streaming-workitems.html)
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
---
layout: default
title: Specifications
title: 3GPP Specifications
parent: 5G Media Streaming
has_children: false
nav_order: 0
---

# 📑 Specifications and relevant references
# Related 3GPP Specifications

This is a list of specifications in the scope of 5G Media Streaming.

Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
---
layout: default
title: Work Items
title: 3GPP Work Items
parent: 5G Media Streaming
has_children: false
nav_order: 1
---

# 📑 Relevant Work Items
# Related 3GPP Work Items
* TBD
8 changes: 0 additions & 8 deletions pages/5g-multicast-broadcast-services.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,3 @@ nav_order: 3
---

# 5G Multicast Broadcast Services
## 📑 Specifications and relevant references
* Information about relevant specifications can be found in this [page](5g-multicast-broadcast-services/5g-multicast-broadcast-services-specifications.html)

## 📑 Relevant Work Items
* A list of relevant 3GPP Work Items can be found in this [page](5g-multicast-broadcast-services/5g-multicast-broadcast-services-workitems.html)

## 📑 Guidelines and Profiles
* A quick guide on MBS Broadcast RAN Procedure can be found in this [page](5g-multicast-broadcast-services/mbs-broadcast-RAN.html)
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
---
layout: default
title: Specifications
title: 3GPP Specifications
parent: 5G Multicast Broadcast Services
has_children: false
nav_order: 0
---

# 📑 Specifications and relevant references
# Related 3GPP Specifications

This is a list of specifications in the scope of 5G Multicast Broadcast Services.

Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,9 @@
---
layout: default
title: Work Items
title: 3GPP Work Items
parent: 5G Multicast Broadcast Services
has_children: false
nav_order: 1
---

# 📑 Relevant Work Items
* TBD
# Related 3GPP Work Items
5 changes: 0 additions & 5 deletions pages/lte-based-5g-broadcast.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,8 +6,3 @@ nav_order: 2
---

# MBMS and LTE-based 5G Broadcast
## 📑 Specifications and relevant references
* Information about relevant specifications can be found in this [page](lte-based-5g-broadcast/lte-based-5g-broadcast-specifications.html)

## 📑 Relevant Work Items
* A list of relevant 3GPP Work Items can be found in this [page](lte-based-5g-broadcast/lte-based-5g-broadcast-workitems.html)
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
---
layout: default
title: Specifications
title: 3GPP Specifications
parent: MBMS and LTE-based 5G Broadcast
has_children: false
nav_order: 0
---

# 📑 Specifications and relevant references
# Related 3GPP Specifications

This is a list of specifications in the scope of MBMS / LTE-based 5G Terrestrial Broadcast.

Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,9 @@
---
layout: default
title: Work Items
title: 3GPP Work Items
parent: MBMS and LTE-based 5G Broadcast
has_children: false
nav_order: 1
---

# 📑 Relevant Work Items
* TBD
# Related 3GPP Work Items
8 changes: 8 additions & 0 deletions pages/multimedia-content-delivery.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
---
layout: default
title: Multimedia Content Delivery
has_children: true
nav_order: 1
---

# Multimedia Content Delivery
17 changes: 17 additions & 0 deletions pages/multimedia-content-delivery/ietf-specifications.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
layout: default
title: IETF Specifications
parent: Multimedia Content Delivery
has_children: true
nav_order: 1
---

# Related IETF Specifications

This is a list of specifications in the scope of Multimedia Content Delivery Protocols.

## FLUTE: Main specifications and informative references
Details on FLUTE (File Delivery over Unidirectional Transport) are defined in [IETF RFC 6726](https://datatracker.ietf.org/doc/rfc6726/).

## ROUTE: Main specifications and informative references
Details on ROUTE (Real-time Object delivery over Unidirectional Transport) are defined in [IETF RFC 9223](https://datatracker.ietf.org/doc/rfc9223/).
5 changes: 0 additions & 5 deletions pages/xr.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,8 +6,3 @@ nav_order: 4
---

# eXtended Reality (XR)
## 📑 Specifications and relevant references
* Information about relevant specifications can be found in this [page](xr/xr-specifications.html)

## 📑 Relevant Work Items
* A list of relevant 3GPP Work Items can be found in this [page](xr/xr-workitems.html)
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
---
layout: default
title: Specifications
title: 3GPP Specifications
parent: eXtended Reality (XR)
has_children: false
nav_order: 0
---

# 📑 Specifications and relevant references
# Related 3GPP Specifications

This is a list of specifications in the scope of eXtended Reality (XR).

Expand Down Expand Up @@ -71,3 +71,4 @@ This is a list of specifications in the scope of eXtended Reality (XR).
[26.926](https://www.3gpp.org/dynareport/26926.htm) | TR | Traffic Models and Quality Evaluation Methods for Media and XR Services in 5G Systems | Under change control | S4
[26.996](https://www.3gpp.org/dynareport/26996.htm) | TR | Immersive Audio for Split Rendering Scenarios; Performance characterization | Draft | S4
[26.997](https://www.3gpp.org/dynareport/26997.htm) | TR | IVAS codec performance characterization | Draft | S4

10 changes: 6 additions & 4 deletions pages/xr/xr-worktiems.md → pages/xr/3gpp-workitems.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,14 @@
---
layout: default
title: Work Items
parent: eXtended Reality (XR)
title: 3GPP Work Items
grand_parent: eXtended Reality (XR)
parent: 3GPP Specifications
has_children: false
nav_order: 1
nav_order: 0
---

# 📑 Relevant Work Items
# Related 3GPP Work Items

## Release 18

Work Item | Acronym | Title | Rel | WG
Expand Down
Binary file added pages/xr/images/mpeg-i-sd-0.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added pages/xr/images/mpeg-i-sd-1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added pages/xr/images/mpeg-i-sd-2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
55 changes: 55 additions & 0 deletions pages/xr/mpeg-i-scene-description.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,55 @@
---
layout: default
title: Overview on MPEG-I Scene Description
grand_parent: eXtended Reality (XR)
parent: MPEG Specifications
has_children: false
nav_order: 0
---

# Overview on MPEG-I Scene Description
MPEG-I Scene Description (MPEG-I SD) is a standard developed by MPEG for immersive media.
It defines the structure and composition of a 3D scene, referencing and positioning 2D and 3D assets in the scene, and provides information for rendering the scene properly.

The MPEG-I Scene Description standard and glTF (Graphics Library Transmission Format) share a connection in the realm of 3D scenes and models. glTF was chosen as the base scene description technology.
Developed by the Khronos Group, glTF is an open standard that integrates media assets using technologies like OpenGL. In essence, glTF provides a way to describe 3D model geometry, appearance, scene hierarchy, and animation1.

MPEG-I Scene Description (ISO/IEC 23090-14) specifies how to reference and position 2D and 3D assets within a scene, enabling proper rendering and creating rich 3D scenes with real-time media delivery and interactivity.
Khronos has adopted the MPEG-I Scene Description extensions as defined in [https://github.com/KhronosGroup/glTF/blob/main/extensions/README.md](https://github.com/KhronosGroup/glTF/blob/main/extensions/README.md).

## Reference architecture:
MPEG-I SD defined the following reference architecture.
![image](./images/mpeg-i-sd-0.png)

* The Presentation Engine replaces a traditional 2D media player. It is responsible for multi-modal rendering of a scene composed of audiovisuals and haptics media. It also provides information about the viewer's and object pose to optimize delivery.
* The Media Access Function (MAF) is responsible for the media access and processing functions. Media handling is delegated to the MAF by the Presentation Engine. The MAF constructs a suitable media pipeline to transform media from a delivery format into the formats used during rendering. the MAF uses MIME type and codec parameters to identify support for the media reconstruction and assemble the adequate media pipeline.
* The MAF API is used by the Presentation Engine to request immersive media in the scene.
* The Buffers are fed by the processed media with a format defined through the scene description document in SO/IEC 23090-14

## Vendor extensions to Khronos glTF 2.0
![image](./images/mpeg-i-sd-1.png)

A first set of extensions (green in the figure) enable the timed framework including:
* [<em>MPEG_media</em>](https://github.com/KhronosGroup/glTF/blob/main/extensions/2.0/Vendor/MPEG_media/README.md), which enables the referencing of external media streams that are delivered over protocols such as RTP/SRTP, MPEG-DASH, or others
* [<em>MPEG_accessor_timed</em>](https://github.com/KhronosGroup/glTF/blob/main/extensions/2.0/Vendor/MPEG_accessor_timed/README.md), used in a scene that contains timed media and/or metadata to describe access to the dynamically changing data
* [<em>MPEG_buffer_circular</em>](https://github.com/KhronosGroup/glTF/blob/main/extensions/2.0/Vendor/MPEG_buffer_circular/README.md), to extend the buffer into a circular buffer

A second group of extensions (gray in the figure) enables the inclusion of dynamic and temporal media including:
* [<em>MPEG_texture_video</em>](https://github.com/KhronosGroup/glTF/blob/main/extensions/2.0/Vendor/MPEG_texture_video/README.md). provides the possibility to link a texture object defined in glTF 2.0 to media and its respective track
* [<em>MPEG_audio_spatial</em>](https://github.com/KhronosGroup/glTF/blob/main/extensions/2.0/Vendor/MPEG_audio_spatial/README.md), to support spatial audio
* [<em>MPEG_mesh_linking</em>](https://github.com/KhronosGroup/glTF/blob/main/extensions/2.0/Vendor/MPEG_mesh_linking/README.md), provides the possibility to link a mesh to another mesh in a glTF asset
* [<em>MPEG_scene_dynamic</em>](https://github.com/KhronosGroup/glTF/blob/main/extensions/2.0/Vendor/MPEG_scene_dynamic/README.md), [<em>MPEG_viewport_recommended</em>](https://github.com/KhronosGroup/glTF/blob/main/extensions/2.0/Vendor/MPEG_viewport_recommended/README.md), and [<em>MPEG_animation_timing</em>](https://github.com/KhronosGroup/glTF/blob/main/extensions/2.0/Vendor/MPEG_animation_timing/README.md), which indicate that a particular form of timed data is provided to the Presentation Engine during the consumption of the scene and that it shall adapt to the changing information.

![image](./images/mpeg-i-sd-2.png)

A third group of extensions enables the distribution of real-time immersive and interactive media content including:
* Augmented Reality anchor (<em>MPEG_scene_anchor</em>, <em>MPEG_node_anchor</em>), to support AR experiences where virtual content is inserted into the user's real environment
* Interactivity (<em>MPEG_scene_interactivity</em>, <em>MPEG_node_interactivity</em>), to describe interactivity at runtime with support for interactions between user and virtual objects and between virtual objects, with triggers based on proximity, visibility, collision or user input.
* Avatar (<em>MPEG_node_avatar</em>), to support the representation of 3D avatars.
* Lighting (<em>MPEG_light</em>), to provide a realistic user experience including shadows and lighting.
* Haptics (<em>MPEG_haptic</em>, <em>MPEG_material_haptic</em>), to support haptics based on the MPEG standard for Coded representation of Haptics ny attaching haptic information to a node or to a mesh.


# References:
* IBC2023 TECH PAPERS: MPEG-I SCENE DESCRIPTION: A DYNAMIC SCENE DESCRIPTION FRAMEWORK FOR IMMERSIVE MEDIA ([link](https://www.ibc.org/download?ac=24724))
* glTF 2.0 extension in MPEG and 3GPP ([link](https://www.khronos.org/assets/uploads/developers/presentations/glTF_2.0_Extensions_in_MPEG_and_3GPP_.pdf))
17 changes: 17 additions & 0 deletions pages/xr/mpeg-specifications.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
layout: default
title: MPEG Specifications
parent: eXtended Reality (XR)
has_children: true
nav_order: 1
---

# Related MPEG Specifications

This is a list of specifications in the scope of eXtended Reality (XR).

## MPEG-I Scene Description

Number | Title
-- | --
[ISO/IEC 23090-14:2023](https://www.iso.org/standard/80900.html) | Information technology - Coded representation of immersive media - Part 14: Scene description

0 comments on commit 68d3cb4

Please sign in to comment.