skip to main content
10.1145/3658852.3659075acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmocoConference Proceedingsconference-collections
research-article
Open access

Visual instrument co-design embracing the unique movement capabilities of a dancer with physical disability

Published: 27 June 2024 Publication History
  • Get Citation Alerts
  • Abstract

    This paper explores the design of an expressive visual instrument that embraces the unique movement style of a dancer living with physical disability. Through a collaboration between the dancer and an interaction designer/visual artist, the creative qualities of wearable devices for motion tracking are investigated, with emphasis on integrating the dancer’s specific movement capabilities with their creative goals. The affordances of this technology for imagining new forms of creative expression play a critical role in the design process. These themes are drawn together through an experiential performance which augments an improvised dance with an ephemeral real-time visualisation of the performer’s movements. Through practice-based research, the design, development and presentation of this performance work is examined as a ‘testbed’ for new ideas, allowing for the exploration of HCI concepts within a creative context. This paper outlines the creative process behind the development of the work, the insights derived from the practice-based research enquiry, and the role of movement technology in encouraging new ways of moving through creative expression.

    References

    [1]
    Andrea Catherine Alarcón-Aldana, Mauro Callejas-Cuervo, and Antonio Padilha Lanari Bo. 2020. Upper limb physical rehabilitation using serious videogames and motion capture systems: A systematic review. Sensors 20, 21 (2020), 5989.
    [2]
    Ari Y Benbasat and Joseph A Paradiso. 2001. An inertial measurement framework for gesture recognition and applications. In International Gesture Workshop. Springer, 9–20.
    [3]
    Jhedmar Callupe Luna, Juan Martinez Rocha, Eric Monacelli, Gladys Foggea, Yasuhisa Hirata, and Stéphane Delaplace. 2022. WISP, Wearable Inertial Sensor for Online Wheelchair Propulsion Detection. Sensors 22, 11 (2022). https://doi.org/10.3390/s22114221
    [4]
    Linda Candy. 2006. Practice based research: A guide. CCS report 1, 2 (2006), 1–19.
    [5]
    Lynn Catanese. 2012. Thomas Lamb, Marc Harrison, Richard Hollerith and the Origins of Universal Design. Journal of design history 25, 2 (2012), 206–217.
    [6]
    Zelai Sáenz de Urturi, Amaia Méndez Zorilla, and Begoña García Zapirain. 2012. JeWheels: kinect based serious game aimed at wheelchair users. In Ambient Assisted Living and Home Care: 4th International Workshop, IWAAL 2012, Vitoria-Gasteiz, Spain, December 3-5, 2012. Proceedings 4. Springer, 391–398.
    [7]
    Ali Erol, George Bebis, Mircea Nicolescu, Richard D Boyle, and Xander Twombly. 2007. Vision-based hand pose estimation: A review. Computer Vision and Image Understanding 108, 1-2 (2007), 52–73.
    [8]
    Seb Franklin. 2015. Control : digitality as cultural logic. MIT Press, Cambridge, MA.
    [9]
    Emma Frid. 2019. Accessible Digital Musical Instruments—A Review of Musical Interfaces in Inclusive Music Practice. Multimodal Technologies and Interaction 3, 3 (2019). https://doi.org/10.3390/mti3030057
    [10]
    Kathrin M Gerling, Regan L Mandryk, Matthew Miller, Michael R Kalyn, Max Birk, and Jan D Smeddinck. 2015. Designing wheelchair-based movement games. ACM Transactions on Accessible Computing (TACCESS) 6, 2 (2015), 1–23.
    [11]
    James Hallam, Emily Keen, Christa Lee, Alison McKenna, and Mudit Gupta. 2014. Ballet Hero: Building a Garment for Memetic Embodiment in Dance Learning. In Proceedings of the 2014 ACM International Symposium on Wearable Computers: Adjunct Program (Seattle, Washington) (ISWC ’14 Adjunct). Association for Computing Machinery, New York, NY, USA, 49–54. https://doi.org/10.1145/2641248.2641269
    [12]
    Hannes Hoelzl, Isak Han, and Alberto de Campo. 2019. The Airborne Instruments NUFO: A Movement Based Musical Instrument for Possibility Space Exploration. In Proceedings of the 6th International Conference on Movement and Computing (Tempe, AZ, USA) (MOCO ’19). Association for Computing Machinery, New York, NY, USA, Article 20, 4 pages. https://doi.org/10.1145/3347122.3347143
    [13]
    Michaela Honauer. 2018. Designing a Remote-Controlled Interactive Dance Costume. In Proceedings of the 5th International Conference on Movement and Computing (Genoa, Italy) (MOCO ’18). Association for Computing Machinery, New York, NY, USA, Article 40, 6 pages. https://doi.org/10.1145/3212721.3212879
    [14]
    Thomas B Moeslund, Adrian Hilton, and Volker Krüger. 2006. A survey of advances in vision-based human motion capture and analysis. Computer vision and image understanding 104, 2-3 (2006), 90–126.
    [15]
    Madhawa Perera, Armin Haller, Sergio José Rodríguez Méndez, and Matt Adcock. [n. d.]. HDGI: A Human Device Gesture Interaction Ontology for the Internet of Things(The Semantic Web – ISWC 2020). Springer International Publishing, 111–126.
    [16]
    Hans Persson, Henrik Åhman, Alexander Arvei Yngling, and Jan Gulliksen. 2015. Universal design, inclusive design, accessible design, design for all: different concepts—one goal? On the concept of accessibility—historical, methodological and philosophical aspects. Universal Access in the Information Society 14, 4 (2015), 505–526. https://doi.org/10.1007/s10209-014-0358-z
    [17]
    Andreas Riener. 2012. Gestural interaction in vehicular applications. Computer 45, 4 (2012), 42–47.
    [18]
    Elizabeth B-N Sanders. 2002. From user-centered to participatory design approaches. In Design and the social sciences. CRC Press, 18–25.
    [19]
    Andreas Schlegel and Cedric Honnet. 2017. Digital Oxymorons: From Ordinary to Expressive Objects Using Tiny Wireless IMUs. In Proceedings of the 4th International Conference on Movement Computing (London, United Kingdom) (MOCO ’17). Association for Computing Machinery, New York, NY, USA, Article 4, 8 pages. https://doi.org/10.1145/3077981.3078040
    [20]
    Ben Schneiderman. 1992. Designing the user interface, 2nd edn. AddisonWesley. Reading (1992).
    [21]
    Sam Trolland. 2024. Melinda Smith and Sam Trolland Performance Showing. (4 2024). https://doi.org/10.26180/25609404.v2
    [22]
    Sam Trolland, Alon Ilsar, Ciaran Frame, Jon McCormack, and Elliott Wilson. 2022. AirSticks 2.0: Instrument Design for Expressive Gestural Interaction. In NIME 2022. https://doi.org/10.21428/92fbeb44.c400bdc2
    [23]
    Juan Pablo Wachs, Mathias Kölsch, Helman Stern, and Yael Edan. 2011. Vision-based hand-gesture applications. Commun. ACM 54, 2 (2011), 60–71.
    [24]
    Alan Wexelblat. 1995. An approach to natural gesture in virtual environments. ACM Transactions on Computer-Human Interaction (TOCHI) 2, 3 (1995), 179–200.
    [25]
    Yurui Xie, Giulia Barbareschi, Ayesha Nabila, Kai Kunze, and Masa Inakage. 2023. Movement Quality Visualization for Wheelchair Dance. Proc. ACM Comput. Graph. Interact. Tech. 6, 2, Article 23 (aug 2023), 12 pages. https://doi.org/10.1145/3597628

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    MOCO '24: Proceedings of the 9th International Conference on Movement and Computing
    May 2024
    245 pages
    ISBN:9798400709944
    DOI:10.1145/3658852
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 June 2024

    Check for updates

    Author Tags

    1. Dance
    2. Gestural Interaction
    3. Visualisation

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    MOCO '24

    Acceptance Rates

    MOCO '24 Paper Acceptance Rate 35 of 75 submissions, 47%;
    Overall Acceptance Rate 85 of 185 submissions, 46%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 17
      Total Downloads
    • Downloads (Last 12 months)17
    • Downloads (Last 6 weeks)17

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media