skip to main content
research-article

Reflective pervasive systems

Published:04 May 2012Publication History
Skip Abstract Section

Abstract

Pervasive adaptive systems are concerned with the construction of “smart” technologies capable of adapting to the needs of the individual in real time. In order to achieve this level of specificity, systems must be capable of monitoring the psychological status of the user and responding to these changes in real time and across multiple systems if necessary. This article describes a number of conceptual issues associated with this category of adaptive technology. The biocybernetic loop describes different approaches to monitoring the status of the user from physiological sensors to overt behavior. These data are used to drive real time system adaptation tailored to a specific user in a particular context. The rate at which the technology adapts to the individual user are described over three different phases of usage: awareness (short-term), adjustment (medium-term), and coevolution (long-term). An ontology is then proposed for the development of an adaptive software architecture that embodies this approach and may be extended to encompass several distinct loops working in parallel. The feasibility of the approach is assessed through implemented case studies of their performance and functionality.

References

  1. Ahn, H., Teeters, A., Wang, A., Breazeal, C., and Picard, R. W. 2007. Stoop to conquer: Posture and affect interact to influence computer users' persistence. In Proceedings of the 2nd International Conference on Affective Computing and Intelligent Interaction. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Bartlett, M., Littlewort, G., Fasel, I., and Morvellan, J. R. 2003. Real time face detection and facial expression recognition: Development and application to human-computer interaction. In Proceedings of the Conference on Computer Vision and Pattern Recognition for Human-Computer Interaction.Google ScholarGoogle Scholar
  3. Beyer, G., Kroiss, C., and Schroeder, A. 2009. Person aware advertising displays: Emotional, cognitive, physical adaptation capabilities for contact exploitation. In Proceedings of the 1st Workshop on Pervasive Advertising at Pervasive.Google ScholarGoogle Scholar
  4. Bischoff, U., Sundramoorthy, V., and Kortuem, G. 2007. Programming the smart home. In Proceedings of the 3rd IFT International Conference on Intelligent Environments. 544--551.Google ScholarGoogle Scholar
  5. Browne, P. 2009. JBoss Drools Business Rules. Packt Publishing, Birmingham, AL. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Can Bus. 2010. Can bus, vehicular controller area network. http://de.wikipedia.org/wiki/Controller_Area_ Network.Google ScholarGoogle Scholar
  7. Cho, W. H. and Choi, H. 2005. Center of pressure COP during postural balance control of high-heeled woman. In Proceedings of the IEEE Engineering in Medicine and Biology 27th Annual Conference. 2761--2764.Google ScholarGoogle Scholar
  8. Demers, F.-N. and Malenfant, J. 1995. Reflection in logic, functional and object-oriented programming. In Proceedings of the IJCAI'95 Workshop on Reflection and Metalevel Architectures and Their Application in AI. 29--38.Google ScholarGoogle Scholar
  9. Dey, A. K., Abowd, G. D., and Salber, D. 2001. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Hum.-Comput. Interact. 16, 2, 97--166. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Drools. 2010. Drools documentation library. http://www.jboss.org/droolsGoogle ScholarGoogle Scholar
  11. Fairclough, S. H. 2009. Fundamentals of physiological computing. Interfac. Comput. 21, 133--145. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Gilleade, K. M., Dix, A., and Allanson, J. 2005. Affective videogames and modes of affective gaming: Assist me, challenge me, emote me. In Proceedings of the DiGRA Conference.Google ScholarGoogle Scholar
  13. Hancock, P. A., Pepe, A. A., and Murphy, L. L. 2005. Hedonomics: The power of positive and pleasurable ergonomics. Ergonom. Des. 131, 8--14.Google ScholarGoogle Scholar
  14. Hettinger, L. J., Branco, P., Encarnaco, L. M., and Bonato, P. 2003. Neuroadaptive technologies: Applying neuroergonomics to the design of advanced interfaces. Theor. Issues Ergonom. Sci. 4, 220--237.Google ScholarGoogle ScholarCross RefCross Ref
  15. Huebscher, M. C. and McCann, J. A. 2008. A survey of autonomic computing-degrees, models, and applications. ACM Comput. Surv. 40, 3, 1--28. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Kapoor, A., Burleson, W., and Picard, R. W. 2007. Automatic prediction of frustration. Int. J. Hum.-Comput. Studies 65, 724--736. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Kephart, J. O. and Chess, D. M. 2003. The vision of autonomic computing. Comput. 36, 1, 41--50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Kock, G., Ribaric, M., and Serbedzija, N. 2009. Modelling user-centric pervasive adaptive systems- The REFLECT ontology. In Intelligent Systems for Knowledge Management. Studies in Computational Intelligence, vol. 252. Springer.Google ScholarGoogle Scholar
  19. Kogut, P., Cranefield, S., Hart, L., Dutra, M., Baclawski, K., Kokar, M., and Smith, J. 2002. UML for ontology development. The Knowl. Engin. Rev. 171, 61--64. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Kramer, J. and Magee, J. 2007. Self-Managed systems: An architectural challenge. In Proceedings of the Conference on Future of Software Engineering (FOSE'07). IEEE Computer Society Press. 259--268. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Mandryk, R. L. and Atkins, M. S. 2007. A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. Int. J. Hum.-Comput. Studies 65, 329--347. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Marco, M. M. and Zambonelli, F. 2009. Programming pervasive and mobile computing applications: The TOTA approach. ACM Trans. Softw. Engin. Methodol. 18, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. McKinley, P. K., Sadjadi, S. M., Kasten, E. P., and Cheng, B. H. C. 2004. Composing adaptive software. Comput. 37, 7, 56--64. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Norman, D. A. 2007. The Design of Future Things. Basic Books, New York.Google ScholarGoogle Scholar
  25. OSGI. 2005. About OSGI service platform. OSGI white article, OSGI Alliance. http://www.osgi.org/wiki/uploads/Links/OSGiTechnicalWhiteArticle.pdf.Google ScholarGoogle Scholar
  26. Pantic, M. and Rothkrantz, L. J. M. 2003. Towards an affect-sensitive multimodal human-computer interaction. Proc. IEEE 919, 1370--1390.Google ScholarGoogle ScholarCross RefCross Ref
  27. Picard, R. W. 1997. Affective Computing. MIT Press, Cambridge, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Pope, A. T., Bogart, E. H., and Bartolome, D. S. 1995. Biocybernetic system evaluates indices of operator engagement in automated task. Biol. Psychol. 40, 187--195.Google ScholarGoogle ScholarCross RefCross Ref
  29. Printzel, L. J. 2002. Research on hazardous states of awareness and physiological factors in aerospace operations. Tech. rep. no. NASA/TM-2002-211444. NASA, Hampton, Virginia.Google ScholarGoogle Scholar
  30. Printzel, L. J., Parasuraman, R., Freeman, F. G., Scerbo, M. W., Mikulka, P. J., and Pope, A. T. 2003. Three experiments examining the use of electroencephalogram, event-related potentials, and heart-rate variability for real time human-centered adaptive automation design. Tech. rep. no. NASA/TP-2003-212442. NASA.Google ScholarGoogle Scholar
  31. Rani, P., Sarkar, N., and Liu, C. 2005. Maintaining optimal challenge in computer games through real time physiological feedback. In Proceedings of the 11th Human-Computer Interaction International Conference.Google ScholarGoogle Scholar
  32. Reflect. 2011. REFLECT project- Responsive flexible collaborating ambient. http://reflect.pst.ifi.lmu.de/Google ScholarGoogle Scholar
  33. Russell, J. A., Bachorowski, J., and Fernandez-Dols, J. 2003. Facial and vocal expressions of emotion. Ann. Rev. Psychol. 54, 329--349.Google ScholarGoogle ScholarCross RefCross Ref
  34. Scerbo, M. W., Freeman, F. G., and Mikulka, P. J. 2003. A brain-based system for adaptive automation. Theor. Issues Ergonom. Sci. 41, 2, 200--219.Google ScholarGoogle ScholarCross RefCross Ref
  35. Schroeder, A., Zwaag, M., and Hammer, M. 2008. A middleware architecture for human-centered pervasive adaptive applications. In Proceedings of the 1st PerAda Workshop at SASO'08. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Serbedzija, N., Calvosa, A., and Ragnoni, A. 2008. Vehicle as a co-driver. In Proceedings of the 1st Annual International Symposium on Vehicular Computing Systems (ISVCS'08).Google ScholarGoogle Scholar
  37. Serbedzija, N. and Fairclough, S. 2009. Biocybernetic loop: From awareness to evolution. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC'09). Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Sousa, J. P. and Garlan, D. 2002. Aura: An architectural framework for user mobility in ubiquitous computing environments. In Proceedings of the 17th World Computer Congress TCS Stream/3rd Conference on Software Architecture. 29--43. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Szyperski, C. 1998. Component Software: Beyond Object-Oriented Programming. ACM Press/Addison-Wesley. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. van der Zwaag, M. D. and Westerink, J. 2010. Musical induction and persistence of mood. In Proceedings of the 11th International Conference on Music Perception and Cognition. 57--60.Google ScholarGoogle Scholar
  41. Wilson, G. F. and Russell, C. A. 2007. Performance enhancement in an uninhabited air vehicle task using psychophysiologically determined adaptive aiding. Hum. Factors 496, 1005--1018.Google ScholarGoogle ScholarCross RefCross Ref
  42. Yannakakis, G. N., Hallam, J., and Lund, H. 2007. Entertainment capture through heart rate activity on physical interactive playgrounds. User Model. User-Adapt. Interact. 18, 207--243. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Reflective pervasive systems

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Autonomous and Adaptive Systems
          ACM Transactions on Autonomous and Adaptive Systems  Volume 7, Issue 1
          Special section on formal methods in pervasive computing, pervasive adaptation, and self-adaptive systems: Models and algorithms
          April 2012
          365 pages
          ISSN:1556-4665
          EISSN:1556-4703
          DOI:10.1145/2168260
          Issue’s Table of Contents

          Copyright © 2012 ACM

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 4 May 2012
          • Revised: 1 July 2011
          • Accepted: 1 July 2011
          • Received: 1 January 2010
          Published in taas Volume 7, Issue 1

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!