Smart Composite Human-Computer Interfaces
ARTEMIS Join Undertaking / Ministry of Instruction, University and Research - ARTEMIS-2009-2
Nokia (FI), VTT (FI), Barco (BE), Philips Research Labs (NL), Philips Consumer Lifestyle (NL), CNR (IT), Fundacion European Software Institute (ES), Sirris c.d.g. (BE), Indra Sistemas, S.A (ES), Human Interface Group (BE), Valve (FI), University of Twente (NL), Fjord (UK), Honeywell International s.r.o. (CZ), PHI-I (NL), EVALAN (NL)
Objective of SMARCOS is to support users of interconnected embedded systems by ensuring their interusability. Many products today connect with web services (media players, refrigerators, e-books, even cars). This distributed computing is becoming the norm in embedded systems.
However, connection problems, firmware incompatibilities, incomprehensible dialogue boxes and just plain bugs plague many commercial offerings. New challenges have also come up for user interaction: multiple platforms, multi-user applications, internet synchronisation, and application and service adaptation to the changing situational contexts. For instance, which device should give notifications and which one to use for input? What device should decide on automatic actions? What service should track user actions?
Existing efforts towards interoperability (e.g. Artemis project Sofia) have largely focused on architectures, e.g. micro-service interfaces, protocols, parameters. We extend these efforts on the user level. Smarcos allows devices and services to communicate in UI level terms and symbols, exchange context information, user actions, and semantic data. It allows applications to follow the userís actions, predict needs, and react appropriately to unexpected actions.
We construct use cases in three complementary domains: attentive personal systems, interusable devices and complex systems control. The scientific and technical areas include nomadic computing, advanced humancomputer interfaces and distributed computing. We then carry out several pilots that implement the use cases, including one large trial in a major public event (2012 London Olympics). Along the project, several smaller prototypes will be implemented.
Our results will be applicable to all embedded systems that interact with their users, which is a substantial fraction of todayís market. The results will also help web services that are integral parts of such systems.