End-to-end platform

For the purpose of communication and sharing of musical experience between several users, the project will create an end-to-end research platform supporting mobile music devices, enhanced by context-awareness and natural, expressive/emotional multimodal interfaces enabling physical, experience-centric participation. The end-to-end platform will facilitate wireless access to music metadata, context metadata, users’ state, interaction and embodiment metadata, and application-specific metadata from the mobile music players, and will allow the creation of networked applications on top of the base metadata platform. This will allow mobile devices to connect people for sharing thoughts and experiences. Through mobile music devices, users will be all the time connected to their most important musical colleagues or peers, and it will become possible to share the musical thoughts and feelings physically and in real time, and intervene actively and interactively on the content experience. Nevertheless, communication will be personalized according to the recipient’s context—for example, the shared music experiences will adapt differently if the user is at home, at car, or at office. The project platform will include generalized multimedia plug-ins (e.g., music processing plug-ins, gesture processing plug-ins).