DISSERTATION I

AFFECTIVE COMPUTING DETECTING USER

EMOTIONS FROM KEYBOARD & MOUSE

MAHARASHTRA INSTITUTE OF TECHNOLOGY

Guide:
Dr. N.N. Pise

Co - Guide:
Dr. M.V. Bedekar

Submitted By:
Taranpreet Singh Saini
601016

MIT, Pune

OUTLINE
Web Mining

User Profiling
Flow Psychology
Emotions
Contrasting of Emotions
Categorization of Emotions
Affective Haptics
Affective Computing
Emotion Detection From Keyboard & Mouse
Literature Survey
Working Groups
Datasets
Tools for Affective Computing
Mathematical Modelling
Proof of Concept
Screenshots
Future Scope
Conclusion
References
Publications

MIT, Pune

INTRODUCTION

MIT, Pune

Web Mining
Web mining - is the application of data mining techniques to

discover patterns from the World Wide Web.

Web mining can be divided into three different types:

Usage mining, Web content mining and Web structure mining.

MIT, Pune

Web Browsers
A web browser (commonly referred to as a browser) is a

software application for retrieving, presenting, and traversing

information resources on the World Wide Web.

MIT, Pune

Browsers with User Interface

Most major web browsers have these user interface elements in
common:
Back and forward buttons
A refresh or reload button
A stop button
A home button
An address bar
A search bar
A status bar
The viewport
Major browsers also possess incremental find features to search
within a web page.

MIT, Pune

User Profiling
A user profile is a visual display of personal data associated

with a specific user, or a customized desktop environment.

A profile can be used to store the description of the
characteristics of person.

MIT, Pune

FLOW PSYCHOLOGY

MIT, Pune

Flow Psychology
It is the mental state of operation in which a person performing

an activity is fully immersed in a feeling of energized focus, full

involvement, and enjoyment in the process of the activity.
Named by Mihaly Csikszentmihalyi.

MIT, Pune

10

Flow Psychology
Psychology focuses on three broad divisions : Affect, Behavior

and Cognition (ABC)

Affect is the ability to feel

Behavior is the way in which one acts
Cognition is the mental action

MIT, Pune

Flow Psychology Model

11

MIT, Pune

EMOTIONS

12

MIT, Pune

13

Emotions
Emotion, in everyday speech, is any relatively brief conscious

experience characterized by intense mental activity and a high

degree of pleasure or displeasure.
Feelings are best understood as a subjective representation of

emotions, private to the individual experiencing them.

MIT, Pune

14

Emotions (Cont.)
Moods are diffuse affective states that generally last for much

longer durations than emotions and are also usually less intense
than emotions.
Affect is an encompassing term, used to describe the topics of

emotion, feelings, and moods together, even though it is

commonly used interchangeably with emotion.

MIT, Pune

15

Basic Emotions Paul Ekman

Ekman developed Facial Action Coding System (FAC), which uses muscle movements to quantify
emotions.

MIT, Pune

16

Two Dimensions of Emotions - Russell

Circle of Emotions in Life : Emotion Mapping in 2Dimensions

9th International Conference on Computer and Automation Engineering, Sydney, Australia
Paper will be published in the International Conference Proceedings Series by ACM

MIT, Pune

17

Contrasting of Emotions
The three key criteria used include mental experiences that:
Have a strongly motivating subjective quality like pleasure or
pain;
Are in response to some event or object that is either real or
imagined;
Motivate particular kinds of behaviour.

18

MIT, Pune

Contrasting of Emotions (Cont.)

Kind of Emotion

Related to Object Properties

Future Appraisal

Event-Related

Self-Appraisal

Social

Cathected

Positive Emotions

Negative Emotions

Interest, curiosity

Alarm, panic

Attraction, desire, admiration

Aversion, disgust, revulsion

Surprise, amusement

Indifference, familiarity,
habituation

Hope

Fear

Gratitude, thankfulness

Anger, rage

Joy, elation, triumph, jubilation

Sorrow, grief

Relief

Frustration, disappointment

Pride in achievement, selfconfidence, sociability

Embarrassment, shame, guilt,

remorse

Generosity

Avarice, greed, miserliness,

envy, jealousy

Sympathy
Love

Cruelty
Hate

MIT, Pune

19

Categorization of Emotions
HUMAINE's proposal for EARL (Emotion Annotation and

Representation Language)
Parrott's Emotions by Groups
Plutchiks Wheel of Emotions

MIT, Pune

Parrott's Emotions by Groups

A tree-structured list of emotions.

20

MIT, Pune

Plutchiks Wheel of Emotions

21

MIT, Pune

AFFECTIVE HAPTICS

22

MIT, Pune

23

Affective Haptics
Affective haptics is the emerging area of research which focuses

on the study and design of devices and systems that can elicit,
enhance, or influence the emotional state of a human by means
of sense of touch.
Four basic haptic (tactile) channels governing our emotions can
be distinguished:
(1) physiological changes (e.g., heart beat rate, body
temperature, etc.)
(2) physical stimulation (e.g., tickling)
(3) social touch (e.g., hug, handshake)
(4) emotional haptic design (e.g., shape of device, material,
texture)

MIT, Pune

Technologies of Affective Haptics

Social Touch
Intimate Touch
Implicit Emotion Elicitation
Explicit Emotion Elicitation
Affective (emotional) Haptic Design
Affective Computing

24

MIT, Pune

AFFECTIVE COMPUTING

25

MIT, Pune

26

Affective Computing
Affective computing is the study and development of systems

and devices that can recognize, interpret, process, and simulate

human affects.
The name Affective Computing was given by R.W. Picard.
It is a Empirical research motivated from the theoretical
foundation of psychology and neuroscience.
- Eva Hudicka
To develop a computing device with its capacity to gather cues
to user emotion from a variety of sources.
In Simple words, produce emotion aware machines.

Analysing Human Feelings by Affective Computing - Survey

2nd International Conference on Computing, Communication, Control and Automation,
PCCOE, Pune, 12-13 August, 2016.
Being Published in IEEE Xplore

MIT, Pune

27

Rosalind Picard

Rosalind Wright Picard is Professor of Media Arts and

Sciences at MIT, director and also the founder of the Affective

Computing Research Group at the MIT Media Lab, co-director
of the Things That Think Consortium, and co-founder of start
ups Affectiva and Empatica. In 2005, she was named a Fellow
of the Institute of Electrical and Electronics Engineers.

MIT, Pune

Affective Computing - Areas

28

MIT, Pune

Potential Applications
E-Learning
E-Therapy
Robotics Buddy Devices, Digital Pets
Driver Monitoring (Car Monitoring) Driver Emotions
TV Commercials, Audio Visual
Autism

29

MIT, Pune

KEYBOARD & MOUSE

30

MIT, Pune

31

Emotions Detection From Keyboard & Mouse

This research focuses on the affective computing methods based

on data coming from standard input devices, which enable

systems to recognize users emotional states.
The advantage of the keystroke dynamics or mouse movements
is that they are natural type of biometrics which do not require
any special hardware.
It is possible to record the keyboard and mouse parameters
during the usual computer usage.
But these methods are very less investigated.

MIT, Pune

LITERATURE SURVEY

32

MIT, Pune

33

PANAS Questionnaire
This scale consists of a number of words that describe different

feelings and emotions.

Read each item and then list the number from the scale below
next to each word.
Indicate to what extent you feel this way right now, that is, at
the present moment while working on internet.
Available at :
http://affectivecomputingindia.com/?page_id=101

MIT, Pune

34

PANAS Questionnaire
Scoring Instructions
Positive Affect Score: Add the scores on items 1, 3, 5, 9, 10,

12, 14, 16, 17, and 19.

Scores can range from 10-50, with higher scores representing
higher levels of positive affect.
Negative Affect Score: Add the scores on items 2, 4, 6, 7, 8,
11, 13, 15, 18, and 20.
Scores can range from 10-50, with lower scores representing
lower levels of negative affect.

MIT, Pune

PANAS Questionnaire

35

36

MIT, Pune

Literature Survey
Sr.
No.

Paper & Author

Description

Outcome

1.

Affective Computing, R. W. Picard,

1995

This paper presents and discusses key issues in

affective computing, computing that relates to,
arises from, or influences emotions.

Affective computing is a new field, with

recent results primarily in the recognition
and synthesis of facial expression, and the
synthesis of voice inflection.

2.

Automated Facial Action Coding

System for dynamic analysis of facial
expressions in neuropsychiatric
disorders, Hamm, C. Kohler, R. Gur
and R. Verma, 2011

Ekman and Friesens Facial Action Coding

System (FACS) encode movements of individual
facial muscles from distinct momentary changes
in facial appearance.

The fully automated nature of our method

allows us to perform facial expression
analysis in large scale clinical study in
psychiatric populations.

3.

Motivation, Emotion, Affective

Computing, A Note of Paper Survey,
Edward Shen, 2004

4.

Affective e-Learning: Using

Emotional Data to Improve Learning
in Pervasive Learning Environment,
2009

He has introduce what the term Affective

computing is about, how has this research
developed, what are the concerned topics, what
are the motivations, etc.
Using emotion detection technologies from
biophysical signals, this study explored how
emotion evolves during learning process and how
emotion feedback could be used to improve
learning experiences.

It seems that it is almost impossible; after

all we yet have no clear ideas about how
these components are performed by
humans.
Using physiological signals to predict
emotions, this study explored the emotion
evolution during learning, and proposed an
affective e-learning model.

5.

Research about affective computing,

Zhang Yu

In this paper author explained about the affective Affective computing is way to achieve
computing and how it is related with emotions.
high level of AI. After the study of
human's emotions, they have discuss
affective computing's different aspects.

MIT, Pune

37

Literature Survey
6.

Enhancing Mediated Interpersonal

Communication through Affective
Haptics, Dzmitry Tsetserukou

In the paper, they are describing the development

of novel haptic devices (HaptiHeart, HaptiHug,
HaptiTickler, HaptiCooler, and HaptiWarmer)
integrated into iFeel IM system, which
architecture is presented in detail.

All devices were designed with particular

emphasis on ergonomic design. The user
can comfortably wear them and easily
detach.

7.

Recognising Emotions from Keyboard

Stroke Pattern, Preeti Khanna, M. Sasi
Kumar, 2010

This paper presents an attempt to recognize

selected emotion categories from keyboard stroke
pattern.

It has been observed that approximately 70

percent of users are following the trend of
decrease in the typing speed in negative
emotional state while interacting with the
keyboard with reference to its
corresponding neutral state.

8.

Under Pressure: Sensing Stress of

Computer Users, Javier Hernandez,
Pablo Paredes

This work explores the possibility of using a

pressure-sensitive keyboard and a capacitive
mouse to discriminate between stressful and
relaxed conditions in a laboratory study.

During the stressful conditions, the large

majority of the participants showed
significantly increased typing pressure and
more contact with the surface of the
mouse.

9.

Identifying Emotional States using

Keystroke Dynamics, Clayton Epp,
Michael Lippold, Regan L. Mandryk,
2011

They determine user emotion by analysing the

rhythm of their typing patterns on a standard
keyboard.

Results include 2-level classifiers for

confidence, hesitance, nervousness,
relaxation, sadness, and tiredness with
accuracies ranging from 77 to 88 percent.

10.

Human Emotion Recognition Using

Smart Sensors, Muhammad Tauseef
Quazi, 2012

In this project, they have developed an emotion

recognition system based on information provided
by the physiological signals.

The developed system has shown an

overall emotion recognition rate of
86.25%.

MIT, Pune

Working Groups
Massachusetts Institute of Technology

Media Lab
Available: http://affect.media.mit.edu/
University of Cambridge

Computer Laboratory Emotionally Intelligent Interfaces

Available: http://www.cl.cam.ac.uk/research/rainbow/emotions/
University of Canberra

Human Centred Technology Research Centre

Available: http://www.canberra.edu.au/research/faculty-researchcentres/hct/areas-of-research/accba

38

MIT, Pune

39

Working Groups (Cont.)

Mendeley Affective Computing in Learning

Available: https://www.mendeley.com/groups/1185081/affective-computing-in-learning/
Interaction Design Foundation

Affective Computing
Available: https://www.interaction-design.org/literature/book/the-encyclopedia-ofhuman-computer-interaction-2nd-ed/affective-computing
TECFA Education and Technologies

Emotions, affect, affective computing, flow, creativity

Available: http://tecfa.unige.ch/guides/emotions/pointers.html
AAAC

The Association for the Advancement of Affective Computing

Available: http://emotion-research.net/

MIT, Pune

40

Datasets Available
Computer Vision Lab, ETH Zurich

All data is only for research purposes, unless stated differently.

- Kinect Head Pose Database
- 3D Audio - visual Corpus of Affective Communication
ISEAR Databank

Over a period of many years during the 1990s, a large group of psychologists all over
the world collected data in the ISEAR project, directed by Klaus R. Scherer and Harald
Wallbott.
Eight Emotion Sentics Data

This was the first data set generated as part of the MIT Affective Computing Group's
research. The data set consists of measurements of four physiological signals and eight
affective states, taken once a day, in a session lasting around 25 minutes, for over
twenty days of recordings from an individual trying to keep every other aspect of the
measurements constant.

MIT, Pune

41

Datasets Available
DEAP Dataset

A dataset for emotion analysis using EEG, physiological and video signals.
LIRIS - ACCEDE

The Annotated Creative Commons Emotional Database for affective video

content analysis.
-Discrete LIRIS - ACCEDE
-Continuous LIRIS - ACCEDE
-MediaEval 2015
AFFECTIVA - MIT FACIAL EXPRESSION DATASET (AM-FED)

This dataset consists of 242 facial videos (168,359 frames) recorded in real
world conditions.

MIT, Pune

42

Tools for Affective Computing

S. No.

DESCRIPTION

DEVELOPED BY

PAYED/OPEN

Acume: keen insight, the ability to

make quick decisions. Acume is an
open source toolkit for visualizing
and interacting with behavioural
data.

Massachusetts Institute of
Technology

OPEN

2.

These tools are matlab scripts to

Analysis tools for electro- analyse electro-dermal activity and
dermal activity in sleep
actigraphy data from Affectiva Qsensor with sleep stages.

Massachusetts Institute of
Technology

OPEN

3.

A tool for annotation,

AMA is an Android application for
multi-modal annotations.
monitoring and analysis of
events

Massachusetts Institute of
Technology

OPEN

Massachusetts Institute of
Technology

OPEN

1.

4.

TOOL NAME

ACUME

Attention Meter

Attention Meter measures a face

attention via a WebCAM.
Currently, Attention Meter is
available in Python and Flash

MIT, Pune

43

Tools for Affective Computing (Cont.)

S. No.

TOOL NAME

DESCRIPTION

DEVELOPED BY

PAYED/OPEN

Audio Upload

Flex tool for recording audio on

the web. Includes PHP for storing
audio samples on AWS S3.

Massachusetts Institute of
Technology

OPEN

Mood Meter

Real time system that encourages,

recognizes and monitors the
smiles of a group of people.

Massachusetts Institute of
Technology

7.

Physioboard

Python Server + iOS client for

real time physiological data
visualization on iPhone/iPad/iPod
touch.

Massachusetts Institute of
Technology

OPEN

8.

Speech Prosody Analysis

Software Tools

This software consists of a series

of Matlab routines useful for
various aspects of prosodic
analysis of speech.

Massachusetts Institute of
Technology

OPEN

5.

6.

OPEN- Used
only in MIT
College

MIT, Pune

PROBLEM FORMULATION

44

MIT, Pune

45

Problem Formulation
A user interacts with computer.
We can capture attributes like typing speed, mouse clicks and

sensors.
Then we have mapping functions that will map attributes to
emotions.
At the end, we will have the state of user (emotion).

MIT, Pune

46

Mathematical Modelling
The system is defined by the tuple, S, such that,

S = {I, Ic, O, Oc, F}

I = Input to the system(set of Webpages' W, and user Us activities),
Ic = Input Conditions(Various mouse behaviors MB and Keyboard behaviors, KB,

time spent on webpage's, sensors, etc.)

O = Output of the system(User Profile generated based on the Inputs I and Input

conditions Ic based on the functionality given by the Functions F)

Oc = Output Conditions(changes in User Profiles over time as the behavior of the

user U changes),
F = Functions which map I to O, through Ic inputs to Oc outputs.

MIT, Pune

Mathematical Modelling (Cont.)

Let U be the set of users that use the browser.

U = {U1,U2,U3,,UN}
Let W be the set of webpage's viewed by a particular user

W= {W1,W2,W3,,WN}
Let UB be the browser behavior of a user.

UB = {MB, KB}
Where , MB =Mouse Behavior , KB = Keyboard Behavior
Now, MB = {MLC, MRc, MS, MM}

where
MLC = Mouse Left Click = { STM,BM,SM,F/B,SE,PM}
MRc = Mouse Right Click = { CM,PAM }
MM = Mouse Movements = { VM,H0VM,HIM,HM}
MS = Mouse Scrolls = { VSM,HSM}
Thus,

MB = {VM,H0VM,HIM,HM,BM,SM,F/B,SE,PM,STM,CM,PAM,VSM,HSM}

47

48

MIT, Pune

Mathematical Modelling (Cont.)

Now, KB = {KM,KS, kT}.

Where
KM = Keyboard Movements = { VK,HK,T}.
KS = Keyboard Shortcuts = { BK,SK,SLR,CA,CK,PAK,PK }.
KT = Keyboard Typing Speed = {kTS }

Thus,
KB = {BK,SK,SLR,CA,CK,PAK,PK,VK,HK,T, kTS }
Thus,
UB = {VM, H0VM, HIM, HM, BM, SM, F/B, SE, PM, STM, CM, PAM, VSM, HSM, BK, SK, SLR, CA, CK, PAK,
V
Vertical Mouse Movement
H
Mouse Horizontal
PK, VK, HK, T }
Scroll
M

where

SM

H0VM

Mouse Hover

BK

Keyboard Bookmark

HIM
HM

SK
HSM

BM

Mouse Highlight
Horizontal Mouse
Movement
Mouse Bookmark

BK

Keyboard Save
Mouse Horizontal
Scroll
Keyboard Bookmark

SM
F/B
SE
PM
STM
CM
PAM

Mouse Save
Forward And Backward
Send Email
Mouse Print
Mouse Select Text
Mouse copy
Mouse Paste

SLR
CA
CK
PAK
PK
VK
HK

Shift Left/Right
Control All
Keyboard Copy
Keyboard Paste
Keyboard Print
Keyboard Vertical
Keyboard Horizontal

VSM

Mouse Vertical Scroll

TK

Keyboard Trace

MIT, Pune

49

Mathematical Modelling (Cont.)

Condition 1

UB = 1
(MB,KB) = 1
=>UB = (VM,H0VM,HIM,HM,BM,SM,F/B,SE,PM,STM,CM,PAM,VSM,HSM,BK,SK,SLR,CA,CK,PAK,PK,
VK,HK,T ) = 1
Condition 2
MB = {MLC, MRc, MS, MM} = 1
Since,
MLC = Mouse Left Click = { STM,BM,SM,F/B,SE,PM}
MRc = Mouse Right Click = { CM,PAM }.
MS = Mouse Scrolls = { VSM,HSM}
MM = Mouse Movements = { VM,H0VM,HIM,HM}
=> MB = {VM,H0VM,HIM,HM,BM,SM,F/B,SE,PM,STM,CM,PAM,VSM,HSM} = 1

Condition 3
KB = {KM,KS, kTS } = 1
Since,
KM = Keyboard Movements = { VK,HK,T} KS = Keyboard Shortcuts = { BK,SK,SLR,CA,CK,PAK,PK }
=>KB = {BK,SK,SLR,CA,CK,PAK,PK,VK,HK,T} = 1

MIT, Pune

50

Mathematical Modelling (Cont.)

Relation (Keyboard)

1. User types normally (neutral)

2. User types quickly (speed higher than the average speed of the particular user)
(positive)
3. User types slowly (speed lower than the average speed of the particular user)
(negative)
4. User uses the backspace key often /user hits unrelated keys on the keyboard = errors
more (nervous)
5. User does not use the keyboard. (boredom) (session time, no typing)

MIT, Pune

51

Mathematical Modelling (Cont.)

Relation (Mouse)

1. User clicks and moves mouse normally (neutral)

2. User clicks quickly (speed higher than the average speed of the particular user)
(positive)
3. User moves mouse unnecessarily (clicks on ads and other stuff) = errors (nervous)
4. User does not use the mouse (boredom) (session time)

MIT, Pune

System Flow Diagram

52

MIT, Pune

PROOF OF CONCEPT

53

MIT, Pune

Proof of Concept
Detecting Users Web Activities
Time Spent on Web Page - User Engagement
User Click Behaviour
Copying Text From Web Page
Mouse Movements on Web Page
Amount and Speed of Scrolling on Web Page
Number of Time a Web Page is Visited
User Behaviour Based on Age and Gender
Most Number of Files Viewed

54

MIT, Pune

Proof of Concept
Mouse and Keyboard Using Sensors
Heart Beat Sensor
Force Sensor
Temperature Sensor
Bluetooth Module

55

MIT, Pune

Schematic Diagram

56

MIT, Pune

PCB Diagram

57

MIT, Pune

Sensor Snapshot

58

MIT, Pune

RESULTS

59

MIT, Pune

Survey Results

60

MIT, Pune

Survey Results

61

MIT, Pune

Survey Results

62

MIT, Pune

63

Web User Results

User Overview Data

User Engagement
Data

MIT, Pune

64

Web User Results

User Gender Data

User Flow Data

MIT, Pune

Web User Results

User Age Data

65

MIT, Pune

Web User Results

Mouse Movement Heat Map

66

MIT, Pune

Web User Results

Mouse Movement Heat Map

67

MIT, Pune

Typing Speed Results

Typing Test Keyboard Speed Analysis

68

MIT, Pune

Files Viewed Results

69

MIT, Pune

70

CONCLUSION & FUTURE SCOPE

MIT, Pune

71

Conclusion
At present, there is big hype in computer science and especially

in the field of artificial intelligence. Inspiring the machines to

learn from the data and make sensible decisions in the areas
such as education, healthcare, finance and many more.
There are many applications which are the combination of both
artificial intelligence and affective computing.
The advantage of the keystroke dynamics or mouse movements
is that they are natural type of biometrics which do not require
any special hardware.

MIT, Pune

72

Affective Computing & Artificial Intelligence

JIBO is one of the major application which is developed by

Massachusetts Institute of Technology, lab of robotics.

It is like a Disney character that can perform many tasks like
reading a story to a child, can give voice reminders, can
recognize face and do simple talks.
It is working with the help of Affectiva, which is an affective
computing application.

MIT, Pune

73

Future Scope Gartner Hype Cycle

The Gartner Hype Cycle for Emerging Technologies as

illustrate in figure, is the broadest aggregate Hype Cycle,

featuring technologies that are the focus of attention because of
particularly high levels of interest, and those that Gartner
believes have the potential for significant impact.

MIT, Pune

Gartner Hype Cycle Graph 2016

74

MIT, Pune

75

Market of Affective Computing Market and Market

Survey
It is expected that the affective computing market will grow

from USD 9.35 Billion in 2015 to USD 42.51 Billion by 2020,

at a CAGR of 35.4.
Affective

computing is set to revolutionize the way

organizations, especially across sectors like retail, healthcare,
government, defence and academia, gather, organize,
collaborate, and deliver information. This is a big revolution in
the global IT market and holds a very strong growth potential.

MIT, Pune

76

Publications
Analysing Human Feelings by Affective Computing - Survey

Conference: 2nd International Conference on Computing, Communication, Control

And Automation, PCCOE, Pune, 12-13 August, 2016.
Being Published in IEEE Computer Society Conference Publishing Services (CPS) and
will be submitted for inclusion in IEEE Xplore and CSDL
Circle of Emotions in Life : Emotion Mapping in 2Dimensions

Conference: 9th International Conference on Computer and Automation Engineering,

Sydney, Australia
Paper will be published in the International Conference Proceedings Series by ACM,
(ISBN: 978-1-4503-4791-4), which will be archived in the ACM Digital Library, and
indexed by Ei Compendex and Scopus and submitted to be reviewed by Thomson
Reuters Conference Proceedings Citation Index (ISI Web of Science)

MIT, Pune

77

Publications
Inferring Emotional State of a User by User Profiling

2nd International Conference on Contemporary Computing and Informatics (IC3I

2016) Amity University, Noida, India from 14 - 17 December 2016
Being Published in IEEE Xplore
Automobile Driver Profiling : Inferring Emotions Through Actions for Safe Driving

2nd International Conference on Contemporary Computing and Informatics (IC3I

2016) Amity University, Noida, India from 14 - 17 December 2016
Being Published in IEEE Xplore
Time Alone is Not the Clear Indicator of Relevancy

2nd International Conference on Contemporary Computing and Informatics (IC3I

2016) Amity University, Noida, India from 14 - 17 December 2016
Being Published in IEEE Xplore

MIT, Pune

78

References
R. Picard, "Affective Computing: From Laughter to IEEE", IEEE Transaction Affective Computing, vol. 1, no. 1, pp. 11-

17, 2010.
Hamm, C. Kohler, R. Gur and R. Verma, "Automated Facial Action Coding System for dynamic analysis of facial

expressions in neuropsychiatric disorders", Journal of Neuroscience Methods, vol. 200, no. 2, pp. 237-256, 2011.
"Which emotions can commonly be visually identified by seeing the...Researchgate.net, 2016. [Online]. Available:

https://www.researchgate.net/post/Which_emotions_can_commonly_be_visually_identified_by_seeing_the_speakers_fac
e_and_which_emotions_can_be_interpreted_by_listening_to_person_speech.
Edward Shen, " Affective Computing A Note of Paper Survey, 2004.
L. Shen, M. Wang, and R. Shen, Affective e-Learning: Using emotional data to improve learning in pervasive learning

environment related work and the pervasive e-learning platform, Educational Technology and Society, vol. 12, pp. 176
189, 2009.
"Digital pet", Wikipedia, 2016. [Online]. Available: https://en.wikipedia.org/wiki/Digital_pet.
"MIT Media Lab: Affective Computing Group", Affect.media.mit.edu, 2016. [Online]. Available:

http://affect.media.mit.edu/projects.php?id=4394.
C. Said, N. Sebe and A. Todorov, "Structural resemblance to emotional expressions predicts evaluation of emotionally

neutral faces": Correction to Said, Sebe, and Todorov (2009)." Emotion, vol. 9, no. 4, pp. 509-509, 2009.

MIT, Pune

79

References
M. Murgia, "Affective computing: How 'emotional machines' are about to take over our lives", The Telegraph, 2016. [Online]. Available:

http://www.telegraph.co.uk/technology/2016/01/21/affective-computing-how-emotional-machines-are-about-to-take-ove/.
D. Jennifer, Affective Computing, Emotional Development and Autism, 1st edition, 2014.
D. Tsetserukou and A. Neviarouskaya, "Emotion Telepresence: Emotion Augmentation through Affective Haptics and Visual Stimuli", Journal of Physics:

Conference Series, vol. 352, pp. 012045, 2012.

"Affective haptics", Wikipedia, 2016. [Online]. Available : https://en.wikipedia.org/wiki/Affective haptics Potential applications.
R. Duda, P. Hart and D. Stork, Pattern classification. New York: Wiley, 2001.
J. T. Erimafa, A. Iduseri, and I. W. Edokpa, Application of discriminant analysis to predict the class of degree for graduating students in a university

system, International Journal of Physics Science, vol. 4, no. 1, pp. 1621, 2009.
C. D. Manning and H. Schtze, Foundations of Natural Language Processing, Reading, pp. 678, 2000.
P. K. Abhishek Kumar Chauhan, Moving Object Tracking using Gaussian Mixture Model and Optical Flow, vol. 3, no. 4, pp. 243246, 2013.
D. K. Srivastava, L. Bhambhu, and B. Cet, Data classification using support vector machine, Journal of Theoretical and Applied Information Technology,

2010.
M. S. and W. P, Research Paper on Basic of Artificial Neural Network, International Journal of Recent Innovation Trends Computer Communication, vol.

2, no. 1, pp. 96100, 2014.

MIT, Pune

80

References

P. Sharma and A. P. R. Bhartiya, Implementation of Decision Tree Algorithm to Analysis the Performance, Int. J. Adv. Res. Computer
Communication. Eng., vol. 1, no. 10, pp. 861864, 2012.

F. Park, The Hierarchical Hidden Markov Model : Analysis and Applications, vol. 62, pp. 4162, 1998.

P. Rane, M. Mhatre and L. Kurup, Study of a Home Robot: JIBO, International Journal of Engineering Research & Technology (IJERT),
2014.

"2001: A Space Odyssey (film)", Wikipedia, 2016. [Online].Available: https://en.wikipedia.org/wiki/2001:_A_Space_Odyssey_%28film

%29.

"I, Robot (film)", Wikipedia, 2016. [Online]. Available: https://en.wikipedia.org/wiki/I,_Robot_%28film%29.

Hamm, C. Kohler, R. Gur and R. Verma, "Automated Facial Action Coding System for dynamic analysis of facial expressions in
neuropsychiatric disorders", Journal of Neuroscience Methods, vol. 200, no. 2, pp. 237-256, 2011.

"Affective Computing Market by Technology & Software 2020| MarketsandMarkets", Marketsandmarkets.com, 2016. [Online]. Available:
http://www.marketsandmarkets.com/Market-Reports/affective-computing-market-130730395.html.

"Gartner's 2015 Hype Cycle for Emerging Technologies Identifies the Computing Innovations That Organizations Should Monitor",
Gartner.com, 2016. [Online]. Available: http://www.gartner.com/newsroom/id/3114217.

MIT, Pune

81

References

Russell, J. (1980). A circumplex model of affect. Journal of Personality and Social Psychology. http://doi.org/10.1037/h0077714
Quazi, M. T. (2012). Human Emotion Recognition Using Smart Sensors a Thesis submitted in fulfilment of the Master of Engineering in,
122.

Systems, B. (2014). Emotional State Recognition via Physiological Measurements and Processing, (805), 15.

Maehr, W. (2005). eMotion: Estimation of Users Emotional State by Mouse Motions, 159.

Kolakowska, A. (2013). A review of emotion recognition methods based on keystroke dynamics and mouse movements. 2013 6th
International Conference on Human System Interactions, HSI 2013, 548555. http://doi.org/10.1109/HSI.2013.6577879

Hernandez, J., Paredes, P., Roseway, A., and Czerwinski, M. (2014). Under pressure. The 32nd Annual ACM Conference, 5160. Retrieved
from http://dl.acm.org/citation.cfm?doid=2556288.2557165%0Apapers3://publication/doi/10.1145/2556288.2557165

Lee, H., Choi, Y. S., Lee, S., and Park, I. P. (2012). Towards unobtrusive emotion recognition for affective social communication. 2012
IEEE Consumer Communications and Networking Conference, CCNC2012, 260264. http://doi.org/10.1109/CCNC.2012.6181098

Khanna, P., Sasikumar, M., and Mumbai, K. N. (2010). Recognizing Emotions from Keyboard Stroke Pattern. International Journal of
Computer Applications, 11(9), 9758887. http://doi.org/10.5120/1614-2170

Epp, C., Lippold, M., and Mandryk, R. L. (2011). Identifying emotional states using keystroke dynamics. Proceedings of the 2011 Annual
Conference on Human Factors in Computing Systems - CHI 11, 715724. http://doi.org/10.1145/1978942.1979046

Salmeron-majadas, S., Santos, O. C., and Boticario, J. (2014). Exploring indicators from keyboard and mouse interactions to predict the
user affective state. Proceedings of the 7th International Conference on Educational Data Mining (EDM), 365366.

Solanki, R., and Shukla, P. (2014). Estimation of the Users Emotional State by Keystroke Dynamics. International Journal of Computer
Applications, 94(13), 2123. Retrieved from http://lsia.fi.uba.ar/papers/solanki14.pdf

Watson, D., Clark, L. a, and Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS
scales. Journal of Personality and Social Psychology, 54(6), 106370. http://doi.org/10.1037/0022-3514.54.6.1063

THANK YOU

MIT, Pune

82