Video Playback System

The Video Play System is a custom middleware solution designed for games and interactive applications, providing advanced video playback with integrated interactivity. It supports MPEG-1, MPEG-2, and MPEG-4 video formats, with alpha-layer compositing capabilities that enable dynamic visual layering beyond standard fullscreen playback.

The audio subsystem supports multiple formats, including platform-native ADPCM, CRI ADX, CRI AHX (MP2), and AC-3 with 5.1 surround sound. On GameCube and Wii platforms, audio decoding is performed via dedicated DSP microcode optimized for the Macronix 16-bit Audio DSP, ensuring efficient and low-overhead performance.

A core feature of the system is its built-in interactive virtual machine, inspired by DVD-Video navigation. This VM executes custom bytecode to control menus, branching playback, and scripted behaviors. Cue point events provide precise synchronization with external game logic, enabling seamless integration between video content and runtime systems.

The middleware includes support for structured media assets, such as multiple video tracks, multi-channel audio tracks, dedicated voice tracks for dialogue, and external subtitle text files. It also incorporates encryption mechanisms to protect distributed content.

Overall, the Video Play System functions as a complete cinematic runtime, combining media playback, interactivity, and system-level integration into a single unified solution.

• Clock: 81 MHz (GameCube) / 121.5 MHz (Wii)

• Data Width: 16-bit, Big Endian

• Memory:

  • Data RAM: 8 KB

  • Data ROM: 4 KB

  • Instruction RAM: 8 KB

  • Instruction ROM: 8 KB

• Hardware Features: Built-in DSP-ADPCM decoder

• Boot ROM: Contains initialization microcode and data tables

• DSP IDE & Simulator – For writing, testing, and debugging DSP microcode in a virtual environment.

• DSP Assembler – Converts assembly source code into machine instructions for the DSP.

• DSP Linker – Links multiple object files and resolves addresses for DSP execution.

• hex2bin – Converts hexadecimal output files into binary or C format for loading onto the DSP.

• mxhex2h – Converts DSP hex files into C header files for integration with CPU-side code.