Dispatches from the Emergent Interaction Workshop

 This content has been cross-posted at the Orthogonal Lab Medium.

Last month, the Orthogonal Lab was represented at the Emergent Interaction Workshop (part of SIGCHI 2021). We contributed a paper titled “Allostasis Machines: a model for understanding internal states and technological environments”, with a companion presentation now on YouTube. Thanks go to Bradly Alicea, Daniela Cialfi, Anson Lim, and Jesse Parent for their contribution. We are planning an expanded version of this work with Rishabh Chakraborty that will demonstrate Allostasis Machines as a Reinforcement Learning implementation.

The subtitle of this workshop was “Complexity, Dynamics, and Enaction in HCI”. Therefore, the focus was on advancing measurement and theory, in addition to better characterize complexity in the field of Human-Computer Interaction. The four-hour long session was summarized in our weekly meeting on May 22. I have also provided supplemental readings in four workshop-related categories at the bottom of this post.

Overview of the Emergent Interaction Miro board.

There were six other papers made available before the session. Two of the most interesting to the Orthogonal Lab group are “Fields of Affordances and Human Computer Interaction” by Jelle Bruineberg and “Simulating Social Acceptability With Agent-based Modeling” by Alarith Uhde and Marc Hassenzahl.

The Emergent Interaction utilized Zoom, Slack, and a Miro board to enable discussion during the session. Check out the overview paper titled “Emergent Interaction: Complexity, Dynamics, and Enaction in HCI” for more information.

Testing, 1, 2, Emergent T-shirt….

There were a number of interesting and innovative topics discussed in the workshop. Dynamical approaches came up several times, along with topics such as multifractality, attractor analysis, and co-evolutionary experimental design. For more information regarding the first two topics, check out Alan Dix’s blog on Making Sense of Quantitative Data, and Dan Bennett’s preprint “Multifractal Mice: Measuring Task Engagement and Readiness-to-hand via Hand Movement”.

Tom Froese presented on his Enactive Artificial Intelligence and HCI work. His Google Scholar profile features some really interesting work that cuts across the worlds of Artificial Life, Cybernetics, and Cognitive Science, but his workshop topic was how modern Machine Learning approaches are insufficiently embodied. I have posted references to two of his key works (workshop-wise) in the Further Readings section of this post.

Later, Parisa Eslambolchilar presented on first-order closed-loop feedback taking the form of sensor-based human interaction loops. She reviewed some of the things she developed in her Doctoral dissertation, then lead us into her more recent work. Learn more by reading “A Model-Based Approach to Analysis and Calibration of Sensor-based Human Interaction Loops”.

Then, Vassilis Kostakos discussed his work on modeling interactions between technology users (or users and interfaces) as a complex system. He utilized the “lynx-hare” predator-prey analogy, inspired by Lotka-Volterra co-evolutionary dynamics. Read more in this paper published last year in Human-Computer Interaction: “Modeling interaction as a complex system”.

Emergent Interaction is now on Twitter! Give them a follow to join the discussion.

Further Reading: Measurement techniques.

Rebout, N., Lone, J-C., De Marco, A., Cozzolino, R., Lemasson, A., and Thierry, B. (2021). Measuring complexity in organisms and organizations. Royal Society Open Science, 8, 200895.

Zhou, Q., Chua, C-C., Knibbe, J., Goncalves, J., and Velloso, E. (2021). Dance and Choreography in HCI: A Two-Decade Retrospective. Proceedings of CHI, 262, 1–14. Video

Further Reading: Enactive Approaches to Artificial Systems.

Froese, T. and Ziemke, T. (2009). Enactive artificial intelligence: Investigating the systemic organization of life and mind. Artificial Intelligence, 173, 466–500.

Froese, T., McGann, M., Bigge, W., Spiers, A., and Seth, A.K. (2012). The Enactive Torch: A New Tool for the Science of Perception. IEEE Transactions on Haptics, 5(4), 365–375.

Further Reading: Agent-based Modeling approaches.

Bonabeau, E. (2002). Agent-based modeling: Methods and techniques for
simulating human systems. PNAS, 99(3), 7280–7287.

Grimm, V., Revilla, E., Berger, U., Jeltsch, F., Mooij, W.M., Railsback, S.F., Thulke, H-H., Weiner, J., Wiegand, T., and DeAngelis, D.L. (2005).
Pattern-Oriented Modeling of Agent-Based Complex Systems: Lessons from Ecology. Science, 310, 987.

Further Reading: Criticalities and Characterizing Systems.

Dotov, D.G., Nie, L., and Chemero, A. (2010). A Demonstration of the Transition from Ready-to-Hand to Unready-to-Hand. PLoS One, 5(3), e9433.

Kelso, J.A.S. (2021). Unifying Large-and Small-Scale Theories of Coordination. Entropy, 23(5), 537.