Feature-Based Multimedia Semantics: Representational Forms for Instructional Multimedia Design

The aim of this chapter is to sketch a semantic taxonomy of representational forms (or “sign types” in the terminology of semiotics) relevant for the compositional analysis, design, and indexing of multimodal multimedia, specifically, in the domain of instructional design of learning objects, and to contribute to current attempts to bridge the “semantic gap” between the technical and spatio-temporal description of media objects and the contextual perception and interpretation by users of their content.q