11th FOKUS Media Web
Symposium

With the increasing demand for streaming content, it becomes imperative to minimize the environmental impact associated with it. Green Streaming focuses on reducing energy consumption throughout the streaming supply chain, contributing to a more sustainable digital landscape. In this tutorial, we will explore the importance of green streaming, the components of the streaming supply chain, measurement methodologies, and guidelines for optimizing streaming workflows.

The tutorial is structured as follow:

• Video delivery chain: analysis of typical streaming workflows and components involved, relevance for total energy consumption
• Measurements: components to be considered, architectural approach, implementation of probes
• Analysis & results: data analysis, identification of energy saving potential, end devices, encoding solutions
• Guidelines for green streaming: energy saving potentials, guidelines to optimize streaming workflows
• Hands-on: practical session

This tutorial will cover the basics and best practices of adaptive bitrate (ABR) content creation and playback. We will explain how MPEG-DASH and HLS streaming formats allow content providers to deliver their content over-the-top (OTT) to various devices (mobile, desktop, TV, etc.). We will also show how CMAF and CENC standards facilitate compatibility between both streaming formats and multiple DRM systems. We will discuss how streaming tech is evolving to enhance QoE. We will emphasize the importance of streaming analytics to measure and understand the customer experience. Moreover, we will demonstrate how server components can use the collected metrics to optimize the CDN selection for clients. We will explore the emerging trends of server-side logic, such as CMSD, which enables CDNs to influence player behaviour, and new transport protocols, such as HTTP/3 (QUIC), which allow bi-directional communication.

We will present live demos of the key technologies and share the challenges and best practices for deploying them in production.

The second part of the tutorial deals with media player related topics, focusing on dash.js – the official reference client of the DASH Industry Forum (DASH-IF). The primary purpose of dash.js is to implement features from ISO/IEC 23009-1 and the DASH-IF IOP guidelines and provide valuable feedback to the specification editors. In addition, dash.js is production ready and used by the industry in commercial streaming projects. Moreover, dash.js also serves as a foundation for the research community and is widely used in other open-source projects and by other organizations such as DVB, CTA-WAVE, HbbTV and 5G-MAG.

Since November 2019 Fraunhofer FOKUS acts as the official lead developer of the dash.js project. As part of this tutorial, we provide a quick introduction to dash.js and dive into its latest features and additions. We highlight the work that has been done as part of the upcoming version 5 of dash.js and outline the next steps. Moreover, we provide insights on how we are performing automated player testing. Finally, we introduce a set of valuable tools to inspect and debug media streams outside of dash.js.

The tutorial is structured as follow:

• Adaptive Streaming Tech Update: Streaming format updates: DASH, CENC, HLS, CMAF, Streaming optimizations: CMCD/CMSD, Content Steering, HTTP/3, QUIC
• Standards update: DASH-IF, WAVE, DVB
• Cross-platform streaming: Best practices for Android & iOS, Cross-platform deployment to SmartTVs, HbbTV, FireTV, Chromecast, AppleTV, iOS, Android, Desktop, Streaming analytics & troubleshooting
• Types of media playback (Type 1 vs. Type3)
• Overview dash.js
  • Latest features and additions: CMSD, Content Steering, Managed Media Source
  • Work on version 5: AdaptationSet Switching, improved XML parsing, integration of Common Player Library, DRM: support for ref and refId in Content Protection, new documentation: https://dashif.org/dash.js/
  • Future roadmap
  • Automated Player Testing: unit tests , functional tests, ABR testbed
  • dash.js on HbbTV: WebVTT rendering and preloading media segments
• How to debug your streams: JCCP, Media Inspector, MP4 Inspector, MPD Proxy, Livesim2

This first part of the tutorial will deep dive into the intricacies of the Metaverse. The one-hour presentation will cover everything from its fundamental concepts to its practical applications and enabling technologies. Here’s what we’ll cover:

• Metaverse Foundation: gain a foundational understanding of the Metaverse, including its core concepts and recent developments.
• Metaverse Applications & Use Cases: explore real-world applications across consumer, enterprise, and industrial domains, revealing how each sector leverages the Metaverse for varied purposes
• Metaverse Enabler Technologies: uncover the technological underpinnings crucial to the functioning of the Metaverse, including VR/AR/MR devices, graphics engines, computation, communication protocols, and quality of service/experience considerations. Explore the role of generative AI and 3D assets in shaping immersive digital environments.
• Metaverse related Standardization: delve into the realm of Metaverse standards, examining initiatives like the Metaverse Standards Forum (MSF), the Alliance for OpenUSD (AOUSD), and the standardization efforts of organizations like the W3C Immersive Web for WebXR, OpenXR, and glTF.

After the coffee break, we explain the basics and key features of Artificial Intelligence in Education in the second one-hour part of the tutorial. We will present and practically demonstrate advances in Large Language Models (LLMs) for on-premise use, Educational Recommender Systems and Learning Analytics. AI is one of the most important drivers for adaptive learning. The analysis of usage data leads to a better understanding of the learning process and thus to an optimization of learning media, teaching and learning. In addition, virtual AI assistants help learners to find suitable learning media and information, react proactively with hints to detected learning weaknesses and thus make learning more efficient and effective.

This tutorial is a comprehensive deep dive into the exciting world of 5G Media technologies and standards. As 5G continues to revolutionize the media landscape and preparations for 6G are underway, understanding the fundamental concepts, design principles, and future trends is essential for media professionals and technology enthusiasts. Additionally the tutorial focuses on the 5G-MAG Reference Tools. The 5G-MAG Reference Tools are aiming to fill the gap between technical specifications for media services and applications and their implementation, conformance testing, validation and prototyping. As part of this tutorial, we dive deeper into the features of the 5G-MAG Reference Tools, specifically addressing 5G Downlink Media Streaming and LTE-based 5G Broadcast. Moreover, we provide a quick overview of additional work items such as DVB-I over 5G, 5G Multicast-Broadcast Services and XR media integration.

The tutorial is structured as follows:

• 5G Foundation: dive into the fundamentals of 5G/6G Media, exploring the evolution of wireless communication technologies and their impact on the media industry. Gain insights into key 5G concepts such as Network Slicing, Multi-access Edge Computing (MEC), enhanced Mobile Broadband (eMBB), Multimedia Broadcast Multicast Service (MBMS) and ultra reliable low latency communications (URLLC).
• Towards 6G: explore the latest developments in 6G standardization efforts, examining the emerging requirements and technologies that will define the next generation of wireless communication systems
• 5G/6G Media Use Cases: discover media applications empowered by 5G/6G, including Network-Assisted Media Processing, Remote Media Production, immersive experiences, holographic/photorealistic video communication and more.
• 5G Media Streaming: Basic 5G Media Streaming, 5G-MAG reference tools. Consumption Reporting, Metrics Reporting, Network Assistance, Dynamic Policies
• 5G Broadcast: Broadcast content via 5G-MAG Transmitter to Qualcomm CRD device running in ROM with the 5G-MAG Android receiver, Broadcast to Linux receiver
• Other work: DVB-I over 5G, 5MBS, Emergency Alerts, XR Media Integration, AI/ML Evaluation Framework