Various enterprises and personal interests, such as Man-Machine Interaction (MMI), gesture studies, signs, language, social robotics, healthcare, innovation, music, publications, etc.

Category: Mirror Neurons

Book Review of: Imitation and Social Learning in Robots, Humans and Animals

In 2007 an interesting book was published that I believe is also relevant to gesture researchers:

Imitation and social learning in robots, humans and animals: behavioural, social and communicative dimensions.
Chrystopher L. Nehaniv, Kerstin Dautenhahn (Eds.). Cambridge University Press, 2007 – 479 pagina’s (available online in a limited way, here)

The book is an excellent volume with many interesting chapters, some with contributions by the editors themselves but also by many other authors. Personally, I found the following chapters most interesting (of 21 chapters):

  • 1. Imitation: thoughts about theories (Bird & Heyes)
  • 2. Nine billion correspondence problems (Nehaniv)
  • 7. The question of ‘what to imitate’: inferring goals and intentions from demonstrations (Carpenter & Call)
  • 8. Learning of gestures by imitation in an humanoid robot (Calinon & Billard)
  • 10. Copying strategies by people with autistic spectrum disorder: why only imitation leads to social cognitive development (Williams)
  • 11. A Bayesian model of imitation in infants and robots (Rao et al.)
  • 12. Solving the correspondence problem in robotic imitation across ambodiments: synchrony, perception and culture in artifacts (Alissandrakis et al.)
  • 15. Bullying behaviour, empathy and imitation: an attempted synthesis (Dautenhahn et al.)
  • 16. Multiple motivations for imitation in infancy (Nielsen & Slaughter)
  • 21. Mimicry as deceptive resemblance: beyond the one-trick ponies (Norman & Tregenza)

I’ll probably update this post with more in-depth review remarks later… But at least chapter 21 has connections to earlier posts here regarding animal gestures, such as here.

Imaginary Gestures for Music Therapy?

A while ago I received an inspiring email with an interesting question, see below (and btw, I would encourage anyone reading my blog to start corresponding, which I greatly enjoy). I will try to respond here, sharing my thoughts not only with Paulo Suzuki, but with anyone interested.

Hi Jeroen,

I’m an IT professional and Music Therapist.

I’m working on a research using the Theremin as a music therapeutic tool and
I’d like that you recommend a book (basic or introdutory) regarding
“gestures” so that I can use to justify my issues.

My research is oriented to music therapy patients with little or without
movements – and so I’d like to know if you are familiar with any research on
“imaginary gestures”?

Thanks for the time.


Paulo Suzuki

PS: my 1st resource regarding “gesture” is your blog “Nice Gesture”; thanks
and congratulations.

Before I give you some answers, I would like to point to a prior post about Musical Gesturing with a Theremin and other posts in the Musical Gestures category. Looking back on that post, I would like to add that I believe that the feelings that music arouse in us are as real as we allow them to be, which is ‘very real’ for many people. Undoubtedly, this can be put to many positive uses, such as ‘Musical Therapy’. However, if you are in this business then I think it is important to remember that you are working for a large part with created conventions that need to be learned and accepted by your ‘patients’. Granted, there may be some feelings or ‘gestures’ that certain music has, in and of itself. For example, ‘beats per minute’ may be related to a slower or faster beating of the heart, and therefore to our arousal or activation. However, trusting too much in the emotional values of certain music quickly becomes speculative, highly subjective, and therefore not advisable (unless you either can rely on or have the time to build up a library of shared conventions with your audience, or patients).

So, to answer the first question, I would like to recommend two books:

  • Gesture, Visible Action as Utterance, by Adam Kendon (the basics about gesture and how humans use gestures).
  • Music and Gesture, by Gritten & King (Eds.) (I haven’t read this one myself, but from the contents it looks like it covers the topics you might be interested in).

To answer your second question, regarding research on ‘imaginary gestures’:

  • There is the work on ‘mirror neurons‘ that shows that there is a very close connection in our brains to ‘seeing a gesture’ and ‘producing a gesture’. That might be useful to you? A wild thought: if one wants patients to be able to play music with imaginary gestures perhaps it is possible to record their brains while watching a musician play a certain bit of music, identify the ‘brain activation’, and then watch for that when they ‘play in their minds’ themselves, translating their ‘imaginary gestures’ back to music. I’m taking a couple of shortcuts with this line of reasoning, but well.
  • Then there is the work on helping people who lost a hand or an arm. See for example this story: Robot arm ‘controlled with thoughts’. To some extent the nervous system may still process stimuli that pertain to certain hand actions, or gestures.
  • Another interesting bit of work was done a while ago by Sidney Fels: GloveTalk, a system that translates hand gestures to speech through an adaptive interface. Perhaps the micro gestures Fels uses, can also be translated to music instead of speech. Incidentally, his first ‘user’ was reported to be an experienced piano player…

Hope it helps 🙂

Doodling, Gesture, and Language Origins, the Movie

Here is a very entertaining video (nice music) that tells the tale of gesture and the origins of language in a nutshell. Much has been written about how the language capability may have evolved in humans with gesture as a stepping stone or how Man’s first language may have been a signed language. Recent brain research findings (gesture+speech, mirror neurons, lateralization, sign language aphasia) have added more indirect ‘evidence’ for these theories. It is still hard to really prove anything about pre-historic events though…

One thing that struck me is how the author talks about how people might be aided in their thinking when the gesture, or doodle and fidget. A reference to fidgeting! Hooray! Should I point out that I think gesture and fidgeting are quite different? No, I will just let it be.

Powered by WordPress & Theme by Anders Norén