Developing a protocol and experimental setup for using a humanoid robot to assist children with autism to develop visual perspective taking skills

References

[1] L. Wing, The Autistic Spectrum: A Guide for Parents and Professionals, 199610.1136/bmj.312.7027.327Search in Google Scholar

[2] S. Baron-Cohen, C. Gillberg, Mind blindness: An essay on autism and theory of mind, Developmental Medicine and Child Neurology, 1995, 37(12), 1124–112410.7551/mitpress/4635.001.0001Search in Google Scholar

[3] K. Dautenhahn, Robots as social actors: Aurora and the case of autism, In: Proceedings of the CT99, The Third International Cognitive Technology Conference, August, San Francisco, 1999, 359, 374Search in Google Scholar

[4] I. Werry, K. Dautenhahn, Applying mobile robot technology to the rehabilitation of autistic children, In: Proceedings of the SIRS99, 7th Symposium on Intelligent Robotic Systems, 1999Search in Google Scholar

[5] S. Boucenna, A. Narzisi, E. Tilmont, F. Muratori, G. Pioggia, D. Cohen, et al., Interactive technologies for autistic children: A review, Cognitive Computation, 2014, 6(4), 722–74010.1007/s12559-014-9276-xSearch in Google Scholar

[6] J. J. Diehl, L. M. Schmitt, M. Villano, C. R. Crowell, The clinical use of robots for individuals with autism spectrum disorders: A critical review, Research in Autism Spectrum Disorders, 2012, 6(1), 249–26210.1016/j.rasd.2011.05.006Search in Google Scholar

[7] P. Pennisi, A. Tonacci, G. Tartarisco, L. Billeci, L. Ruta, S. Gangemi, et al., Autism and social robotics: A systematic review, Autism Research, 2016, 9(2), 165–18310.1002/aur.1527Search in Google Scholar

[8] S. Baron-Cohen, A. M. Leslie, U. Frith, Does the autistic child have a “theory of mind”?, Cognition, 1985, 21(1), 37–4610.1016/0010-0277(85)90022-8Search in Google Scholar

[9] F. G. Happé, Understanding minds and metaphors: Insights from the study of figurative language in autism, Metaphor and Symbol, 1995, 10(4), 275–29510.1207/s15327868ms1004_3Search in Google Scholar

[10] S. Baron-Cohen, T. Jolliffe, C. Mortimore, M. Robertson, Another advanced test of theory of mind: Evidence from very high functioning adults with autism or Asperger syndrome, Journal of Child Psychology and Psychiatry, 1997, 38(7), 813–82210.1111/j.1469-7610.1997.tb01599.xSearch in Google Scholar

[11] U. Frith, Mind blindness and the brain in autism, Neuron, 2001, 32(6), 969–97910.1016/S0896-6273(01)00552-9Search in Google Scholar

[12] A. Senju, Spontaneous theory of mind and its absence in autism spectrum disorders, The Neuroscientist, 2012, 18(2), 108–11310.1177/1073858410397208Search in Google Scholar PubMed PubMed Central

[13] A. Senju, V. Southgate, S. White, U. Frith, Mindblind eyes: an absence of spontaneous theory of mind in Asperger syndrome, Science, 2009, 325(5942), 883–88510.1126/science.1176170Search in Google Scholar PubMed

[14] J. H. Flavell, The development of knowledge about visual perception, In: Nebraska Symposium on Motivation, University of Nebraska Press, 1977Search in Google Scholar

[15] J. M. Zacks, J. M. Vettel, P. Michelon, Imagined viewer and object rotations dissociated with event-related FMRI, Journal of Cognitive Neuroscience, 2003, 15(7), 1002–101810.1162/089892903770007399Search in Google Scholar PubMed

[16] K. Kessler, L. A. Thomson, The embodied nature of spatial perspective taking: embodied transformation versus sensorimotor interference, Cognition, 2010, 114(1), 72–8810.1016/j.cognition.2009.08.015Search in Google Scholar PubMed

[17] K. Kessler, H. Wang, Differently embodied transformations in visuo-spatial perspective taking, Cognitive Processing, 2012, 13, S21–S22Search in Google Scholar

[18] M. Aichhorn, J. Perner, M. Kronbichler, W. Staffen, G. Ladurner, Do visual perspective tasks need theory of mind?, Neuroimage, 2006, 30(3), 1059–106810.1016/j.neuroimage.2005.10.026Search in Google Scholar PubMed

[19] A. Hamilton, R. Brindley, U. Frith, Visual perspective taking impairment in children with autistic spectrumdisorder, Cognition, 2009, 113(1), 37–4410.1016/j.cognition.2009.07.007Search in Google Scholar PubMed

[20] A. M. Leslie, Pretense and representation: The origins of “theory of mind”, Psychological Review, 1987, 94(4), 41210.1037/0033-295X.94.4.412Search in Google Scholar

[21] T. Reed, C. Peterson, A comparative study of autistic subjects’ performance at two levels of visual and cognitive perspective taking, Journal of Autism and Developmental Disorders, 1990, 20(4), 555–56710.1007/BF02216060Search in Google Scholar PubMed

[22] J. Tan, P. L. Harris, Autistic children understand seeing andwanting, Development and Psychopathology, 1991, 3(2), 163–17410.1017/S0954579400005216Search in Google Scholar

[23] N. Yirmiya, M. Sigman, D. Zacks, Perceptual perspective-taking and seriation abilities in high-functioning children with autism, Development and Psychopathology, 1994, 6(2), 263–27210.1017/S0954579400004570Search in Google Scholar

[24] A. Pearson, D. Ropar, A. F. de C. Hamilton, A review of visual perspective taking in autism spectrumdisorder, Frontiers in Human Neuroscience, 2013, 7, Article 65210.3389/fnhum.2013.00652Search in Google Scholar PubMed PubMed Central

[25] S. M. Anzalone, E. Tilmont, S. Boucenna, J. Xavier, A.-L. Jouen, N. Bodeau, et al., How children with autism spectrum disorder behave and explore the 4-dimensional (spatial 3d+ time) environment during a joint attention induction task with a robot, Research in Autism Spectrum Disorders, 2014, 8(7), 814–82610.1016/j.rasd.2014.03.002Search in Google Scholar

[26] Z. E. Warren, Z. Zheng, A. R. Swanson, E. Bekele, L. Zhang, J. A. Crittendon, et al., Can robotic interaction improve joint attention skills?, Journal of Autism and Developmental Disorders, 2015, 45(11), 3726–373410.1007/s10803-013-1918-4Search in Google Scholar

[27] P. Warreyn, H. Roeyers, T. Oelbrandt, I. De Groote, What are you looking at? joint attention and visual perspective taking in young children with autism spectrumdisorder, Journal of Developmental and Physical Disabilities, 2005, 17(1), 55–7310.1007/s10882-005-2201-1Search in Google Scholar

[28] P. Marti, A. Pollini, A. Rullo, T. Shibata, Engaging with artificial pets, In: Proceedings of the 2005 Annual Conference on European Association of Cognitive Ergonomics, University of Athens, 2005, 99–106Search in Google Scholar

[29] K. Wada, T. Shibata, Robot therapy in a care house – its sociopsychological and physiological effects on the residents, In: Proceedings 2006 IEEE International Conference on Robotics and Automation, ICRA 2006, IEEE, 2006, 3966–3971Search in Google Scholar

[30] W. D. Stiehl, J. Lieberman, C. Breazeal, L. Basel, L. Lalla, M. Wolf, Design of a therapeutic robotic companion for relational, affective touch, In: IEEE International Workshop on Robot and Human Interactive Communication, ROMAN 2005, IEEE, 2005, 408–415Search in Google Scholar

[31] H. Kozima, C. Nakagawa, Y. Yasuda, Children-robot interaction: a pilot study in autism therapy, Progress in Brain Research, 2007, 164, 385–40010.1016/S0079-6123(07)64021-7Search in Google Scholar

[32] P. Chevalier, J.-C. Martin, B. Isableu, C. Bazile, A. Tapus, Impact of sensory preferences of individuals with autism on the recognition of emotions expressed by two robots, an avatar, and a human, Autonomous Robots, 2017, 41(3), 613–63510.1007/s10514-016-9575-zSearch in Google Scholar

[33] P. Chevalier, B. Isableu, J.-C. Martin, A. Tapus, Individuals with autism: Analysis of the first interaction with Nao robot based on their proprioceptive and kinematic profiles, In: Advances in Robot Design and Intelligent Control, Springer, 2016, 225–23310.1007/978-3-319-21290-6_23Search in Google Scholar

[34] A. Tapus, A. Peca, A. Aly, C. Pop, L. Jisa, S. Pintea, et al., Children with autism social engagement in interaction with Nao, an imitative robot: A series of single case experiments, Interaction Studies, 2012, 13(3), 315–34710.1075/is.13.3.01tapSearch in Google Scholar

[35] K. Dautenhahn, A. Billard, Games children with autism can play with robota, a humanoid robotic doll, In: Universal Access and Assistive Technology, Springer, 2002, 179–19010.1007/978-1-4471-3719-1_18Search in Google Scholar

[36] A. Billard, B. Robins, J. Nadel, K. Dautenhahn, Building robota, a mini-humanoid robot for the rehabilitation of children with autism, Assistive Technology, 2007, 19(1), 37–4910.1080/10400435.2007.10131864Search in Google Scholar PubMed

[37] B. Robins, K. Dautenhahn, J. Dubowski, Does appearance matter in the interaction of children with autism with a humanoid robot?, Interaction Studies, 2006, 7(3), 479–51210.1075/is.7.3.16robSearch in Google Scholar

[38] B. Robins, K. Dautenhahn, P. Dickerson, From isolation to communication: a case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot, In: Second International Conference on Advances in Computer-Human Interactions (ACHI’09), IEEE, 2009, 205–21110.1109/ACHI.2009.32Search in Google Scholar

[39] F. Sartorato, L. Przybylowski, D. K. Sarko, Improving therapeutic outcomes in autism spectrum disorders: Enhancing social communication and sensory processing through the use of interactive robots, Journal of Psychiatric Research, 2017, 90, 1–1110.1016/j.jpsychires.2017.02.004Search in Google Scholar PubMed

[40] P. Chevalier, B. Isableu, J.-C. Martin, A. Tapus, Individuals with autism: Analysis of the first interaction with Nao robot based on their proprioceptive and kinematic profiles, In: Advances in Robot Design and Intelligent Control, Springer, 2016, 225–23310.1007/978-3-319-21290-6_23Search in Google Scholar

[41] B. Scassellati, H. Admoni, M. Mataric, Robots for use in autism research, Annual Review of Biomedical Engineering, 2012, 14, 275–29410.1146/annurev-bioeng-071811-150036Search in Google Scholar PubMed

[42] AuRoRA Project, http://www.aurora-project.com/, 2018Search in Google Scholar

[43] IROMEC Project, http://www.iromec.org/, 2018Search in Google Scholar

[44] S. Leekam, Why do children with autism have a joint attention impairment?, In: N. Eilan, C. Hoerl, T. McCormack, J. Roessler (Eds.), Joint Attention: Communication and Other Minds: Issues in Philosophy and Psychology, Consciousness and Self-Consciousness, Oxford: Oxford University Press, 2005, 205–22910.1093/acprof:oso/9780199245635.003.0010Search in Google Scholar

[45] J. Wainer, K. Dautenhahn, B. Robins, F. Amirabdollahian, A pilot study with a novel setup for collaborative play of the humanoid robot Kaspar with children with autism, International Journal of Social Robotics, 2014, 6(1), 45–6510.1007/s12369-013-0195-xSearch in Google Scholar

[46] J. H. Flavell, B. A. Everett, K. Croft, E. R. Flavell, Young children’s knowledge about visual perception: Further evidence for the level 1–level 2 distinction, Developmental Psychology, 1981, 17(1), 9910.1037/0012-1649.17.1.99Search in Google Scholar

[47] H. Moll, M. Tomasello, 12-and 18-month-old infants follow gaze to spaces behind barriers, Developmental Science, 2004, 7(1), F1–F910.1111/j.1467-7687.2004.00315.xSearch in Google Scholar PubMed

[48] H. Moll, M. Tomasello, Level 1 perspective-taking at 24 months of age, British Journal of Developmental Psychology, 2006, 24(3), 603–61310.1348/026151005X55370Search in Google Scholar

[49] H. Moll, M. Carpenter, M. Tomasello, Fourteenmonth-olds know what others experience only in joint engagement, Developmental Science, 2007, 10(6), 826–83510.1111/j.1467-7687.2007.00615.xSearch in Google Scholar PubMed

[50] S. M. Gzesh, C. F. Surber, Visual perspective-taking skills in children, Child Development, 1985, 1204–121310.2307/1130235Search in Google Scholar

[51] K. Dautenhahn, C. L. Nehaniv, M. L. Walters, B. Robins, H. Kose-Bagci, N. A. Mirza, et al., Kaspar – a minimally expressive humanoid robot for human-robot interaction research, Applied Bionics and Biomechanics, 2009, 6(3-4), 369–39710.1155/2009/708594Search in Google Scholar

[52] B. Robins, K. Dautenhahn, Tactile interactions with a humanoid robot: novel play scenario implementations with children with autism, International Journal of Social Robotics, 2014, 6(3), 397–41510.1007/s12369-014-0228-0Search in Google Scholar

[53] S. Costa, H. Lehmann, K. Dautenhahn, B. Robins, F. Soares, Using a humanoid robot to elicit body awareness and appropriate physical interaction in children with autism, International Journal of Social Robotics, 2015, 7(2), 265–27810.1007/s12369-014-0250-2Search in Google Scholar

[54] B. Robins, K. Dautenhahn, L. Wood, A. Zaraki, Developing interaction scenarios with a humanoid robot to encourage visual perspective taking skills in children with autism–preliminary proof of concept tests, In: International Conference on Social Robotics, Springer, 2017, 147–15510.1007/978-3-319-70022-9_15Search in Google Scholar

[55] L. J. Wood, A. Zaraki, M. L. Walters, O. Novanda, B. Robins, K. Dautenhahn, The iterative development of the humanoid robot Kaspar: An assistive robot for children with autism, In: International Conference on Social Robotics, Springer, 2017, 53–6310.1007/978-3-319-70022-9_6Search in Google Scholar

[56] L. Wood, K. Dautenhahn, B. Robins, A. Zaraki, Developing childrobot interaction scenarios with a humanoid robot to assist children with autism in developing visual perspective taking skills, In: 2017 26th IEEE International Symposiumon Robot and Human Interactive Communication (RO-MAN ‘17), IEEE, 2017, 1055–106010.1109/ROMAN.2017.8172434Search in Google Scholar

[57] G.-J. Hogrefe, H. Wimmer, J. Perner, Ignorance versus false belief: A developmental lag in attribution of epistemic states, Child development, 1986, 567–58210.2307/1130337Search in Google Scholar

[58] S. Baron-Cohen, R. Campbell, A. Karmiloff-Smith, J. Grant, J. Walker, Are children with autism blind to the mentalistic significance of the eyes?,” British Journal of Developmental Psychology, 1995, 13(4), 379–39810.1111/j.2044-835X.1995.tb00687.xSearch in Google Scholar

[59] C. Lord, S. Risi, L. Lambrecht, E. H. Cook, B. L. Leventhal, P. C. DiLavore, et al., The autism diagnostic observation schedule – generic: A standard measure of social and communication deficits associated with the spectrum of autism, Journal of Autism and Developmental Disorders, 2000, 30(3), 205–22310.1023/A:1005592401947Search in Google Scholar

[60] G. H. Roid, L. J. Miller, M. Pomplun, C. Koch, Leiter international performance scale (Leiter-3), Los Angeles: Western Psychological Services, 2013Search in Google Scholar

[61] G. H. Roid, C. Koch, Leiter-3: Nonverbal cognitive and neuropsychological assessment, In: Handbook of Nonverbal Assessment, Springer, 2017, 127–15010.1007/978-3-319-50604-3_8Search in Google Scholar

[62] S. M. Kanne, J. K. Randolph, J. E. Farmer, Diagnostic and assessment findings: A bridge to academic planning for children with autism spectrum disorders, Neuropsychology Review, 2008, 18(4), 367–38410.1007/s11065-008-9072-zSearch in Google Scholar PubMed

[63] A. Zaraki, L. Wood, B. Robins, K. Dautenhahn, Development of a semi-autonomous robotic system to assist children with autism in developing visual perspective taking skills, In: 2018 27th IEEE International Symposiumon Robot and Human Interactive Communication (RO-MAN) ‘18, IEEE, 2018, 969–97610.1109/ROMAN.2018.8525681Search in Google Scholar

[64] S. Boucenna, S. Anzalone, E. Tilmont, D. Cohen, M. Chetouani, Learning of social signatures through imitation game between a robot and a human partner, IEEE Transactions on Autonomous Mental Development, 2014, 6(3), 213–22510.1109/TAMD.2014.2319861Search in Google Scholar

[65] S. Boucenna, D. Cohen, A. N. Meltzoff, P. Gaussier, M. Chetouani, Robots learn to recognize individuals from imitative encounters with people and avatars, Scientific reports, 2016, 6, 1990810.1038/srep19908Search in Google Scholar PubMed PubMed Central