Facial Expressions and Animation ppt

Facial Expressions and
Facial Expressions and
Animation
Animation
Facial Expressions and Animation
Facial Expressions and Animation


Theory behind Facial Expressions
Theory behind Facial Expressions


Execution in Animation
Execution in Animation


Prof. Paul
Prof. Paul
Ekman
Ekman
z
z
Universality in Facial Expressions?
Universality in Facial Expressions?
Facial Expressions and Animation
Facial Expressions and Animation
Facial Expressions and Animation
Facial Expressions and Animation
Paul
Paul
Ekman

Ekman


Professor of Psychology
Professor of Psychology


Expert in facial expression recognition
Expert in facial expression recognition


Emotions Revealed
Emotions Revealed
(2003)
(2003)


Categorizing
Categorizing
different emotions
different emotions
Paul
Paul
Ekman
Ekman


Nurture
Nurture
vs

vs
Nature
Nature


Are facial expressions universally
Are facial expressions universally
recognizable?
recognizable?


Ekman’s
Ekman’s
proof
proof
z
z
Blind people
Blind people
z
z
Indigenous cultures
Indigenous cultures
Facial Action Coding System
Facial Action Coding System


Method for measuring and describing facial behaviors
Method for measuring and describing facial behaviors
z

z
By Paul
By Paul
Ekman
Ekman
and W.V. Friesen in the 1970s
and W.V. Friesen in the 1970s
z
z
Determining how the contraction of each facial muscle
Determining how the contraction of each facial muscle
(singly and in combination with other muscles) changes
(singly and in combination with other muscles) changes
the appearance of the face
the appearance of the face
z
z
Identifying the specific changes that occurred with
Identifying the specific changes that occurred with
muscular contractions and how best to differentiate one
muscular contractions and how best to differentiate one
from another
from another


Goal: To create a reliable means for skilled human
Goal: To create a reliable means for skilled human
scorers to determine the category or categories in
scorers to determine the category or categories in
which to fit each facial behavior

which to fit each facial behavior


FACS scores are descriptive only, and provide no
FACS scores are descriptive only, and provide no
implications about the meaning of the behavior
implications about the meaning of the behavior
FACS Categories and Actions
FACS Categories and Actions
Original Action Units – Part 1
Original Action Units – Part 2
Original Action Units – Part 3
Original Action Units - Part 4
Original Action Units – Part 5
Categories of Facial Expressions
Categories of Facial Expressions


Facial Expression Categories:
Facial Expression Categories:
z
z
Sadness and agony
Sadness and agony
z
z
Anger
Anger
z
z

Surprise and Fear
Surprise and Fear
z
z
Disgust and Contempt
Disgust and Contempt
z
z
Happiness
Happiness


“No single facial expression can be relied upon always
“No single facial expression can be relied upon always
to be present when an emotion is felt”
to be present when an emotion is felt”
Sadness and Agony
Sadness and Agony


Often invokes similar feelings of sadness
Often invokes similar feelings of sadness


Rarely voluntary
Rarely voluntary


Hard to mimic
Hard to mimic



Consists of a
Consists of a
combination of
combination of
conflicting actions
conflicting actions
Recognizing Sadness
Recognizing Sadness


Mouth
Mouth
z
z
Corner of lips pulled down
Corner of lips pulled down
z
z
Raised cheeks
Raised cheeks
z
z
Possibly dropped jaw (for agony and crying)
Possibly dropped jaw (for agony and crying)


Eyes
Eyes

z
z
Upper eyelids drop
Upper eyelids drop
z
z
Inner corners of eyebrows raised and brought
Inner corners of eyebrows raised and brought
together
together
Sadness
Sadness
Anger
Anger


Unlike sadness:
Unlike sadness:
z
z
Looking at anger does not invoke it
Looking at anger does not invoke it
z
z
Easier to mimic
Easier to mimic
Recognizing Anger
Recognizing Anger



Jaw tightly clenched
Jaw tightly clenched


If teeth exposed, mouth has rectangular
If teeth exposed, mouth has rectangular
shape
shape


Thinning of lips
Thinning of lips
z
z
Subtle but frequent
Subtle but frequent
z
z
Earliest sign
Earliest sign


Lower jaw can be forward
Lower jaw can be forward
Recognizing Anger
Recognizing Anger
Recognizing Anger
Recognizing Anger



Glaring eyes
Glaring eyes
z
z
Raised upper eyelids
Raised upper eyelids
z
z
Possibly tensed lower eye lids
Possibly tensed lower eye lids


Muscle of difficulty
Muscle of difficulty
z
z
Tighten up area around eyes
Tighten up area around eyes
z
z
Mental and physical difficulty cause it to contract
Mental and physical difficulty cause it to contract


Eyebrows lowered and brought together
Eyebrows lowered and brought together
Anger
Anger
Surprise and Fear
Surprise and Fear



Fear has been studied more than any other
Fear has been studied more than any other
emotion
emotion


Hard to distinguish the surprise and fear
Hard to distinguish the surprise and fear


Surprise is a temporary expression, which
Surprise is a temporary expression, which
often converts into other expressions
often converts into other expressions
Recognizing Fear
Recognizing Fear


Eyes
Eyes
z
z
Upper eyelids raised as high as possible
Upper eyelids raised as high as possible
z
z
Tensed lower eyelids
Tensed lower eyelids

z
z
Eyebrows raised and slightly closer together
Eyebrows raised and slightly closer together
z
z
Eyes staring straight ahead
Eyes staring straight ahead


Mouth
Mouth
z
z
Lips stretched horizontally
Lips stretched horizontally
z
z
Possibly dropped jaw
Possibly dropped jaw
Surprise and Fear
Surprise and Fear
Disgust and Contempt
Disgust and Contempt


Subtly different from anger
Subtly different from anger



Rarely photographed in comparison to the
Rarely photographed in comparison to the
other emotions
other emotions


Paul
Paul
Rozin
Rozin


Interpersonal triggers:
Interpersonal triggers:
z
z
Strange, deceased,
Strange, deceased,
misfortunate, morally tainted
misfortunate, morally tainted
Recognizing Disgust and Contempt
Recognizing Disgust and Contempt


Active muscles around nose
Active muscles around nose


Eyes can be relaxed comparatively to anger
Eyes can be relaxed comparatively to anger



Can be limited to one side of the face
Can be limited to one side of the face
z
z
Feeling of imbalance
Feeling of imbalance


Lowered eyebrows
Lowered eyebrows


Raised upper lip
Raised upper lip


Combinations:
Combinations:
z
z
Disgust and anger
Disgust and anger
z
z
Contempt and smile
Contempt and smile
Disgust and Contempt
Disgust and Contempt

Happiness
Happiness


More general term
More general term
z
z
Describes a state of mind
Describes a state of mind


Emotions invoked differ from all the other
Emotions invoked differ from all the other
facial expression categories
facial expression categories


16 Categories of enjoyable emotions
16 Categories of enjoyable emotions
Recognizing Happiness
Recognizing Happiness


Duchenne
Duchenne
Smile
Smile
z
z

Orbicularis
Orbicularis
oculi
oculi
z
z
Can not be voluntary
Can not be voluntary


Fake smiles
Fake smiles