Multimodal Interaction Standards at the World Wide Web Consortium

The W3C Multimodal Interaction Working Group has developed several standards that can be used to represent multimodal user inputs and system outputs. We will discuss three of them in this talk. Extensible Multimodal Annotation (EMMA) represents cross-modality metadata for user inputs and system outputs. Ink Markup Language (InkML) represents traces in electronic ink, for example, for applications such as handwriting or gesture recognition. Finally, Emotion Markup Language (EmotionML) can be used to represent emotions. We will describe these three standards, talk about how they interoperate (including a demo of EMMA and EmotionML), and discuss future directions.