SEMEiotic Oriented Technology for Individualís CardiOmetabolic risk self-assessmeNt and Self-monitoring

Funding Programme

European Commission - FP7 ICT-2013-10


Consiglio Nazionale delle Ricerche (IT)



Start Date



36 months


The key idea in SEMEOTICONíS is to exploit human face as a major indicator of individualís health status. The application field is the prevention of cardio-metabolic risk, for which healthcare systems are registering an exponential growth of social costs. According to semeiotics viewpoint, face signs are mapped to measures and computational descriptors and, to this end, addresses a multisensory system integrated into a hardware platform (Wize Mirror) having the exterior aspect of a mirror. Thus it easily fits at usersí home or in other sites of their daily life (e.g. fitness and nutritional centres, pharmacies, schools and so on).

The Wize Mirror collects data mainly in the form of videos, images and gas concentration signals. They are processed by dedicated methods to extract biometric, morphometric, colorimetric, and compositional descriptors measuring individualís facial signs. The integration of such descriptors provides a virtual individualís model useful to compute and trace the daily evolution of an individualís wellness index. A health diary is created so as to enable individuals to evaluate and personally correlate lifestyle to well-being and health. Suggestions and coaching messages are also provided. Moreover, if agreed with the individual, data in the diary can be shared with health professionals so as to receive, when needed, direct expert guidance and support. In this frame, we carefully concentrates on the development of user-friendly human-computer interactions so as to foster the perception of the system usefulness and reliability.

A set of user-centric applications and services enhances the Mirror usability and fosters its profitable adoption. Multiple interfaces (e.g., mirror, tablet, smartphone) grant the data access and exploration, enabling the individual user to share information (e.g., with experts, on social networks). The system has several innovative features: starting from the suite of sensors for heterogeneous and multimodal data acquisition, moving to the contactless estimation of several descriptors of skin morphology and composition, and ending up with the assessment of a customized user- adaptive wellness index specific for cardio-metabolic risk and the provisioning of personalized guidance and services.

Exploitation of the Wize Mirror should favour new aggregations between health and well-being actors including industry, fitness, and schools. Significant effects towards the development of new cardiovascular disease (CVD) prevention strategies are expected, with positive impacts to the reduction of avoidable disease burden and health expenditures.

  • Not yet available