Challenges and lessons learned from implementing longitudinal studies for self-care technology assessment

ABSTRACT

Whilst literature is rich in lessons learned from recruitment and retention of participants in longitudinal studies, papers sharing practical experience of implementing such studies with or about ICT are lacking. We discuss the challenges and lessons learned in four longitudinal studies with older adults and chronic disease patients for the assessment of self-care technology. Despite apparently prosaic, everyday challenges and potential threats to studies with non-mainstream audiences may be hard to anticipate. A reflection by the researchers leading these studies led to three main themes associated to studies' timelines, which are described with practical examples.

References

1. Ana Correia de Barros, Silvia Rêgo, and João Antunes. 2014. Aspects of human-centred design in HCI with older adults: Experiences from the field. In Human-Centered Software Engineering, Lecture Notes in Computer Science. University of Paderborn, University of Rostock, University of Toulouse, KTH Royal Institute of Technology, Springer, 235--242.
2. John Brooke. 2013. SUS: A Retrospective. J. Usability Studies 8, 2 (Feb. 2013), 29--40.
3. Peter Diggle, Patrick Heagerty, Kung-Yee Liang, and Scott Zeger. 2013. Analysis of Longitudinal Data. OUP Oxford.
4. Andrea Poscia et al. 2017. Methodological issues in the observational studies conducted in older population: a narrative review. Epidemiology Biostatistics and Public Health 14, 2 (2017).
5. Martha Abshire et al. 2017. Participant retention practices in longitudinal clinical research studies with high retention rates. BMC Medical Research Methodology 17, 1 (20 Feb 2017), 30.
6. Frederick F Reichheld. 2004. The One Number you Need to Grow. Harvard business review 81 (06 2004), 46--54, 124.
7. Kung-Yee Liang and Scott L. Zeger. 1986. Longitudinal data analysis using generalized linear models. Biometrika 73, 1 (1986), 13--22.
8. Rose McCloskey, Pamela Jarrett, Connie Stewart, and Lisa Keeping-Burke. 2015. Recruitment and Retention Challenges in a Technology-Based Study with Older Adults Discharged from a Geriatric Rehabilitation Unit. Rehabilitation Nursing 40, 4 (2015), 249--259.
9. Marjorie C. McCullagh, Marie-Anne Sanon, and Michael A. Cohen. 2014. Strategies to enhance participant recruitment and retention in research involving a community-based population. Applied Nursing Research 27, 4 (2014), 249--253.
10. Judith C. McHenry, Kathleen C. Insel, Gilles O. Einstein, Amy N. Vidrine, Kari M. Koerner, and Daniel G. Morrow. 2012. Recruitment of Older Adults: Success May Be in the Details. The Gerontologist 55, 5 (08 2012), 845--853.
11. Lona Mody, Douglas Miller, Joanne McGloin, Marcie Freeman, Edward Marcantonio, Jay Magaziner, and Stephanie Studenski. 2008. Recruitment and Retention of Older Adults in Aging Research. Journal of the American Geriatrics Society 56, 12 (2008), 2340--2348.
12. Francisco Nunes, Jorge Ribeiro, Cristiana Braga, and Paula Lopes. 2018. Supporting the Self-care Practices of Shift Workers. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia. ACM, 71--81.
13. Ricardo Peixoto, Jorge Ribeiro, Eduardo Pereira, Francisco Nunes, and Ana Pereira. 2018. Designing the Smart Badge: A Wearable Device for Hospital Workers. In Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare (Pervasive Health '18). EAI.
14. Véronique Provencher, W. Ben Mortenson, Laurence Tanguay-Garneau, Karine Bélanger, and Marion Dagenais. 2014. Challenges and strategies pertaining to recruitment and retention of frail elderly in research studies: A systematic review. Archives of Gerontology and Geriatrics 59, 1 (2014), 18--24.
15. Fernando Rajulton. 2001. The Fundamentals of Longitudinal Research: An Overview. Special Issue on Longitudinal Methodology, Canadian Studies in Population 28, 2 (2001), 169--185.
16. Iman Ridda, Rayna C MacIntyre, Richard I Lindley, and Timothy Tan. 2010. Difficulties in recruiting older people in clinical trials: An examination of barriers and solutions. Vaccine 28, 4 (2010), 901--906.
17. Kerry Rodden, Hilary Hutchinson, and Xin Fu. 2010. Measuring the User Experience on a Large Scale: User-Centered Metrics for Web Applications. In Proceedings of CHI 2010.
18. Rachel Thomson and Janet Holland. 2003. Hindsight, foresight and insight: The challenges of longitudinal qualitative research. International Journal of Social Research Methodology 6, 3 (2003), 233--244.
19. Viswanath Venkatesh and Fred D. Davis. 2000. A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies. Management Science 46, 2 (2000), 186--204.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI design and evaluation methods

      • Field studies