Physion Design Documents Weekly

P H Y S IO N W E E K 1 2
0 4 / 0 5 / 2 0 1 0
Play Test Game Detail Data Graph
We started play test. Testers gave many More game detail were added including We made graph for our data collection
useful feedback. spider and lightning. program. It can show graph along with
Page 3 Page 4 time and event that we set during play.
Page 7
AGENDA
1. Play Test
2. Game Detail
3. Game Control
4. Data Graph
5. Story
6. Plan to do
PHYSION WEEKLY REPORT

! !
w w w . e t c . c m u . e d u / p r o j e c t s / l m - m o t i o n /! 2
P H Y S IO N WEEK 1 2
Play Test is under way.
•Play Test
PLAY TEST
•COMPARISON BETWEEN
NEUROSKY AND EMOTIV
As our test computer had set up, we started our play test.
Students from other teams gave us many helpful feedback
about the game. We changed game and plan to change more
in the future based on feedback.
GOOD POINT
•PROGRAM STABILITY
o Environment was well made.
Emotiv is more stable. o Darkness and lighting was effective.
o Flash light was good. But some people said it’s too small in
the outside.
IMPROVEMENT
o Game control was hard.
o Lightning was not very effective.
o Need headshot
o Zombie was too bright in the church.

! !
More Game Detail Added.
Video of current version of the game is available at

http://vimeo.com/10837066 http://vimeo.com/10837097
SPIDER
•SPIDER
PRODUCT
<Spider in the church>
•EFFECTS EFFECTS
Surprising the player
o When player approaches to altar, the spider came out from
the ceiling with creaky noise. Player would be surprised.

! !
LIGHTNING
•LIGHTNING
PRODUCT
<Lightning in the church>
•EFFECTS EFFECTS
Surprising the player
o When player passes middle of the church, there is sudden
lightning and thunder sound. After lightning, candle light is lit
up.

! !
GAME CONTROL
•GAME CONTROL
PRODUCT
<Game Controller>
Movement by Nunchak
Camera movement by Nunchak while holding button
Aiming and shooting by Wiimote

! !
Data Graph
•DATA COLLECTION GRAPH DATA COLLECTION GRAPH
We have the data recording tool with the graph function. After
we collects biofeedback data during the game play, we can see
data with graph. We can choose the value that we want to see,
and also zoom in and zoom out. During the play we can
manually set the time line that indicates the time in the graph.
These biofeedback data includes average, minimum and
maximum values of GSR, Heartbeat, short-term excitement,
•DATA RECORDING longterm excitement and meditation.
It also records various game data such as shooting accuracy,
number of zombies killed and the play time.
It would help to analyze how game affects to the the player.

! !
Background Story
•Zombie Experiment MAD ZOMBIE EXPERIMENT
Some psycho scientists conduct an experiment by putting you

in a remote location to see how long and how well you will
survive in zombie infestation. Player was kidnapped and put in
the church. He needs the key to escape. There are zombies
around the church.,

! !
Plan To Do
Based on the feedback and our schedule, we will keep

developing our game.
•RELATIONSHIP BETWEEN RELATIONSHIP BETWEEN EMOTION AND BIOFEEDBACK

EMOTION AND BIOFEEDBACK
We need to find the relationship between biofeedback and
emotion. We will show testers scary movies and observe the
data. It might give us common biofeedback data when people
got scared.
RELATIONSHIP BETWEEN BIOFEEDBACK AND GAME

•RELATIONSHIP BETWEEN
BIOFEEDBACK AND GAME We also need to define which biofeedback affects to the game
in which way. Once we know the relationship between emotion
and biofeedback, it will be easier to define what is the positive
way that biofeedback affects to the game.
•GAME DEVELOPMENT GAME DEVELOPMENT

o Add game detail
o Game design
o Sound effect
•PLAY TEST PLAY TEST

o User Play Test
We would start basic play testing and get feedback.

! !
03-29-10
PHYSION #11
Floor Plan was

revised.
More Art work added.
Emotiv tested.
GAME DESIGN VISUAL EFFECT DEVICE CONFIRM

The floor plan was We added candle light, After we compared two
revised based on flash light and night device, Emotiv and
faculty‘s advices. sky. Neurosky, we decided
to use Emotiv for
program stability and
data acquisition.
! []! 1
0 3 / 2 9 / 2 0 1 0
Game Design Visual Effect Device Confirm
The floor plan was revised based on faculty We added candle light, flash light and night After we compared two device, Emotiv and
‘s advices. sky. Neurosky, we decided to use Emotiv for
Page 3 Page 5 program stability and data acquisition.
Page 8
AGENDA
1. Floor Plan
2. Visual Effect
3. Device Confirm
4. Faculty Feedback
5. Data Collection
6. Plan to do

! !
Floor Plan was revised!
•FLOOR PLAN FLOOR PLAN

! !
Following advices of faculty, we revised to give more closed

space feeling. This is still in draft stage. After we have more
play testing, we would confirm the change and add art work.
Player would have a limited sight and less place to move. It

would give more salient biofeedback.
1. Collapsed pillar in the middle added.

1. Pillar
Player can’t see the whole interior in the beginning. The pillar
also give the feeling that something might be behind it.
2. Desk added near entrance.

2. Desk
3. More benches.
3. Benches
4. Curtains near altar.

4. Curtains
5. Banner along the wall.
5. Banners

! !
Visual Effect is on the process!
CANDLE LIGHT
•CANDLE LIGHT
PRODUCT
<Candle light in the church>
•EFFECTS EFFECTS
Aesthetic
Drastic change of lighting o It makes aesthetic interior. When it lit up, player would feel
safer We can make moving shadow outside of church, and it
would surprise the player. When the candle is blown off, player
would feel more scared.

! !
•FLASH LIGHT FLASH LIGHT
<Flash light in the church>
•EFFECTS EFFECTS
Limited sight o By using flash light, player would have limited sight.

! !
•NIGHT SKY NIGHT SKY
<Night sky in the outside>
•EFFECTS EFFECTS
Grotesque Environment o We changed the sky box and lighting. It would make more
grotesque environment.

! !
Device is confirmed with Emotiv.
•DEVICE CONFIRM - EMOTIV
•COMPARISON BETWEEN Comparison between Neurosky and Emotiv

NEUROSKY AND EMOTIV
Although its disadvantage in convenience for player, Emotiv
performs better in programming and data acquisition. We
think these are important for our research purpose. If we make
commercial game, Neurosky could be reconsidered.
PROGRAM STABILITY
•PROGRAM STABILITY
Emotiv is more stable. NeuroSky is unstable to connect. It is often that the program
cannot connect with the device, and the whole program was
stuck at this time. Also, it is often that the connection become
bad when we are using the device. Even NeuroSky's own
sample program sometimes cannot work well.!
Emotiv is much easier to connect with program. Even though

sometime the program stopped suddenly and cannot
disconnect, the device can solve this problem by itself.

! !
DATA ACQUISITION DATA ACQUISITION
•EMOTIV acquires more data in

faster way.
NeuroSky's data lagged for a few second, and acquires less data
than Emotiv. The data we can use from NeuroSky are
attention and meditation value, which refresh once per second.!
Emotiv can provide more data, including long term

excitement, short term excitement, meditation, frustration, and
boredom, which refresh 4 times per second.

! !
USER CONVENIENCE USER CONVENIENCE
•Neurosky is easier to use.
Neurosky has two sensor spot. One is for ear and one is for
forhead. It’s easy to setup and play. It has bluetooth
headphone.
Emotiv needs to use 16 damp sensors around the head. It’s less
comfortable to play. It requires 10 minutes to setup the sensors.!

! !
Faculty provided useful feedback!
The team had another meeting with Jesse and show our current
game design to get advice.
Jesse Schell - Associate Professor
•SCARY MOMENTS DESIGN SCARY MOMENTS

Think when player would be scared and how to do it.
BE CREATIVE WITH ZOMBIE

•CREATIVE ZOMBIE
If our zombie can do something unexpected, it would surprise
players.
MAKE BACKGROUND STORY

•BACKGROUND STORY
Define who is the player and what happened to the church. It
would help the game more sensible and engaging.
REVISE ON THE FLOOR PLAN

Church interior might be disorienting.

! !
Calibration and Data Recording
CALIBRATION
•CALIBRATION
We have the basic calibration function. It averages the

biofeedback data before entering the game and uses the data as
a basis for the player.
•DATA RECORDING DATA RECORDING
We have the data recording tool. It collects biofeedback data

along with the time and store in the file. These biofeedback
data includes average, minimum and maximum values of
GSR, Heartbeat, short-term excitement, longterm excitement
and meditation.
It also records various game data such as shooting accuracy,
number of zombies killed and the play time.
It would help to analyze how game affects to the the player.

! !
Plan To Do

•PROGRAMMING PROGRAMMING
Connecting devices to Unity3D o Defining the relationship with biofeedback and gameplay
o Add game detail

o Game design
o Sound effect
PLAY TEST
•PLAY TEST
o User Play Test

We would start basic play testing and get feedback.

! !
03-22-10
PHYSION #10
Game Design and

Floor Plan was made.
GAME DESIGN VISUAL EFFECT FACULTY FEEDBACK

The first game design We made aesthetic and We had meetings with
and floor plan was scary church interior. each faculty members,
made. Also we added blood Shirley, Ruth, Scott,
effect. Mk and Jesse. They
provided various
feedback.
! []! 1
0 3 / 2 2 / 2 0 1 0
Game Design Visual Effect Faculty Feedback
The first game design along with floor plan We made aesthetic and scary church We had meetings with each faculty
was made. interior. Also we added blood effect. members, Ruth, Mk and Jesse. They
Page 3 Page 7 provided various feedback.
Page 10
AGENDA
1. Game Design
2. Visual Effect
3. Faculty Feedback
4. Emotiv Test
5. The Play Test PC
6. Plan to do

! !
Game Design and Floor Plan are ready!
•GAME DESIGN DOCUMENT
[Physion] Game Design Document
•Background: In the 19th Europe BACKGROUND
In the 19th century Europe
•FLOOR PLAN 1

! !
•CONTROL DEVICE CONTROL DEVICE

Movement: Numchuk
Aim: Wiimote
Movement: Nunchuk
Brainwave: Neurosky
Aim: Wiimote
GSR: Wilddivine
Brainwave: Neurosky
GSR: Wilddivine
•FLOOR PLAN 2

! !
EVENT SEQUENCE
•EVENT SEQUENCE
During Event, player loses control of the movement and

camera.
1. EVENT 1. Event
Entering the church Player enters the church the gate in the south east.
Sound: Door close, Foot step
Art: Church / door + animation, church interior
2. Event
2. Event
Creepy Noise
Creepy noise. Camera turns. See nothing. Camera turns
Camera Turns
back.
Sound: Creepy Noise, footstep
Programming: Noise, Camera turn
3. Event 3. Event
Candle Lit Up 2 set of 2 candles lit up mysteriously, but it's very dim.
Art: candle, light
Programming: Camera turn, glowing effect, candle lit
4. Event 4. Event
Creepy noise. Camera turns. Mouse is around the hands
Creepy Noise, see hands arms
and arms.
and mouse
Sound: creepy noise, mouse, cracking sound
Art: dead body, mouse with animation
Programming: Camera turn, sequence
5. Event 5. Event
Taking Artifact Player reaches to the altar. Pick up the artifact.
Art: altar, artifact
Sound: Picking up (V.O)

! !
6. Event 6. Event
Zombies appear Candle off. Camera turns to hallway. See glowing eyes.
Eyes move to the players. Sound: zombie growl, stressful
music, zombie footstep Art: Zombies + animation, broken
window Programming: Glowing effect of eyes, lighting
7. Action 7. Action
Fighting with zombies to escape Player fights the zombies with the gun. He needs to exit
the door in the south west because there are too many
zombies in the South east. He knows there are two doors
from the map in the beginning.
Sound: Running footstep, gunshot, heartbeat, scream of
the player when attacked
Programming: Neurosky to accurate aim, Wilddivine to
generate more zombies, wiimote to shoot
8. Event 8. Event
Exiting Church Player came out to the outside. He breathes in relax and
heavily. Then he found zombies are surrounding him and
coming to him.
Sound: breath, surprising sound
Art: Moon, graveyard
Programming: fog effect
9. Action 9. Action
More zombies to fight Player fights to zombies.
Programming: Neurosky to accurate aim, Wilddivine to
generate more zombies, wiimote to shoot
Other Ideas Other Ideas for later Event 6

Window breaking sound. Dim moonlight through broken
glasses.

! !
Visual Effect is on the process!
Following the advisor Shirley’s suggestion, the producer had
individual meetings with faculty. Each faculty provided their
opinion of good project.
•ENTRANCE OF THE CHURCH
PRODUCT
<Entrance of the church>
FEATURES
•FEATURES
o Fixed church scale
Benches
o Bump map for church exterior
Floor
o Modeled, unwrapped and textured church benches
o Added a floor
o Added some spider web

! !
•ALTAR IN THE CHURCH
! < Altar in the church >
FEATURES
•FEATURES
Interior, Altar o Added bricks, more spiderwebs, candle holders with
Lighting and Shadow candles, and altar
o Refined lighting, shadows and added candle glow

! !
•BLOOD EFFECT WHEN < Blood Blur Effect >

DAMAGED
FEATURES
o Blood blur effect when player gets damage

! !
Following the advisor Shirley’s suggestion, the producer had
individual meetings with faculty. Each faculty provided their
opinion of good project.
Ruth Comley - Art Faculty
•PRESENTATION PRESENTATION
Clear Project Purpose
o The purpose of project was not clear to her. Make it clear.
Good Slide
o The ‘client wants this' is not good answer.
Show Results
o Our slide was clear and image was relevant to our topic. "
o People should be involved even when not presenting. Such
as nodding head. Not walking around or crossing arms.
o Show successful results with numbers in final. People wants
to hear success.
•PRODUCT PRODUCT
More Art Work
Zombie Placement in Game Design o Art level is not sufficient yet. Need more work.
o Zombie is very hard to animating. If it's not well animated,
it looks funny and disrupts the game experience.
o Make sure we have time and resource to finish our work.
o Carefully design where the zombies would be placed and
regenerated.

! !
Mk Haley - Associate Executive Producer
PRESENTATION
•PRESENTATION
Show Data Clearly
o Show data clearly
Pronunciation
o Practice pronunciation
PRODUCT
•PRODUCT
Engaging Player o Engaging player
Value of Biofeedback ! Make player wants to play until end
Choice of Horror o Value of biofeedback
! Why do we use biofeedback?
! Why is it necessary to you and client?
o Explain why the team choose 'horror'

! !
Jesse Schell - Associate Professor
PRESENTATION
•PRESENTATION
Scaring Audience
o During presentation, scaring audience will be bonus.
PRODUCT
•PRODUCT
More Scary Game o The Game was not scary.
Reason of the Project ! Use closed place, sound, lighting
! Headphone can work
o Answer these questions.

! What is the problem the client have?
! Why is important to them?
! Show 'Here is the evidences that we did that thoroughly.'
o The team is not the first one who do the biofeedback

project. Dozens of companies did this.
Address they did this, this, this, but not this. We did this and
the answer is this.

! !
Emotiv is being tested.
•EMOTIV ON THE TEST
Emotiv doesn't work very well with Unity3D. After careful

consideration, we decided to use separately program to run
NeuroSky and Emotiv, and use network program to send data
to our game. We learned how to write network program with
C#, and will optimize it.
The second computer was set up.

•THE PLAY TEST COMPUTER SET
UP
Computer for play test is ready. We also have the second set of
Wilddivine IOM sensor.

! !
Plan To Do

•PROGRAMMING PROGRAMMING
Connecting devices to Unity3D o Connecting Emotiv and NeuroSky to Unity3D through
network program
o Add game detail

o Game design
PURPOSE OF THE PROJECT

•CLARIFY THE PURPOSE OF THE
PROJECT
o Clarify of the purpose of the project
As faculty pointed out, we would clarify the purpose of the
project. It would help faculty to understand our project more.

! !
03-15-10
PHYSION #09
Half Presentation is
Finished.
HALF PRESENTATION CLIENT FEEDBACK FACULTY FEEDBACK

The Half presentation The client atteneded Faculty members,
was on March 07 at our presentation and especially our adivsor
RPIS. Audience was gave various helpful Shirely and Scott gave
including faculty, feedback. a lot of uesful
students, clients and comment.
guests. They really
loved it.
[1]
0 3 / 1 5 / 2 0 1 0
Half Presentation Client Feedback Faculty Feedback
he Half presentation was on March 07 at The Lockheed Martin clients attended our Faculty members including our advisors
RPIS. Audience was including faculty, presentation and gave various helpful provided a lot of useful comments and
students, clients and guests. feedback. suggestions.
Page 2 Page 3 Page 5
AGENDA
1. Half Presentation
2. Client Feedback
3. Faculty Feedback
4. Plan to do
PHYSION WEEKLY REPORT !! www.etc.cmu.edu/projects/lm-motion/

P H Y S IO N WEEK 9
Half Presentation was done in success!
The Half presentation was on March 07 at RPIS. Audience was
•HALF PRESENTATION
•When: March 07
including faculty, students, clients and guests. For the preparation,
•Where: RPIS ETC our team had many rehearsal. The presentation was full of fun and
•Audience: Faculty, ETC students, interesting. We are sure that our presentation was the most
clients and guests enjoyable and interesting presentation through whole half
•Topic: client deliverable, presentation. The audience really loved it.
biofeedback research, demo,
Team Physion was one of few teams that actually shows the
future plan
demo program. We knew that our prototype had not many visual
effect yet and was not scary yet. However, we were not afraid to
show to give audience better understanding for our project. We
hoped that our audience would see through the current state and
understand the concept. Although some of audience might not
think as we intended but it was worth to trying.
The video is available on the website.

http://www.etc.cmu.edu/projects/lm-motion/

P H Y S IO N WEEK 9
Our client gave various helpful feedback!
After presentation, all of Lockheed Martin teams had meeting
with client James and Brad.
During the meeting, they said they liked it a lot. Later they sent
us feedback in detail.
•OVERALL OVERALL
Very Enthusiastic
Good producer o The team is very enthusiastic!
o J is a treat to work with as the producer!
•PROS PROS
Excellent Research
Smart Prototyping
Device as a Mechanic o Excellent Research
The team has done an excellent job of CLEARLY identifying
their options and why they have made the choices they made. Their
report is an exemplar for future ETC projects.
o Smart Prototyping
The team has been very aggressive with getting the biofeedback
devices integrated for use!
o Devices as a Mechanic
The team appears on their way to articulating what may be
‘devices as a game mechanic’; very interested in where this may go.
·

P H Y S IO N WEEK 9
CONS
•CONS
Data in need o Data in need
One unit can be Zombie and another can be Rubber Duck.
collect the data and compare the results.
•ADDITIONAL QUESTIONS
Graphic matters? ADDITIONAL QUESTIONS THAT CLIENT WANT TO KNOW
Game pacing matters? o Do graphics matter in getting a response?
Sound matters?
o Is pacing the game play more important?
o What sounds and when increase the end-users experience? ·
•REQUIRED ACTION REQUIRED ACTION

Order the 2nd set of gear
o Order the 2nd set of gear asap
LMC specifically provided an additional $5k per project per
semester intentionally for hardware.
If Physion establishes 2 (minimum) stations for this game to run
in parallel, they can easily get more users to play their game,double
the amount of data they can collect and can even tweak the user
experience on the fly.
•ACTION TAKEN
ACTION TAKEN BY THE TEAM
IOM sensor ordered.
Data collection as the schedule o IOM sensor ordered.
o As the schedule, the team will be gather data as they develop
the game.

P H Y S IO N WEEK 9
After presentation, the faculty had a meeting and sent us
feedback. We knew that we are on the right track because the
feedback relating to product were in a line with our schedule that
we have. Most of the feedback were suggestions to our future work
relating to our game. We had a plan to implement those after half.
•PRESENTATION PRESENTATION
Good Energy
Tending to watch screen o Quick introduction
o Xiao -great energy, keep it flowing
o Tatyana -a little quick, watch screen, keep energy going
o Yantong -articulate, keep energy going
o J -nice energy and humor
o Nice ending, answer questions okay
•PRODUCT PRODUCT
Use more effect
Add visual detail o Effect
Game Design suggestion Use darkness, scary music, sound
o Visual
Right now zombies are not scary enough
o Game Design
Trap in a corner, Limit ammo, Have me protect someone else,
Being chased
o Concept
Game to induce biofeedback in order to track data, yes?
How can you compare across players and play sessions?

P H Y S IO N WEEK 9
Plan To Do

•PROGRAMMING
PROGRAMMING
Test and compare brainwave
device ‘Emotiv’ and o Test and compare two brainwave device
‘NeuroSky’ Emotiv and NeuroSky
o Try Unity3D code provided by NeuroSky manufacturer
•GAME DEVELOPMENT
GAME DEVELOPMENT
Add game detail
Game design o Add game detail
o Game design
We will design floor plan and scenario.
•PRODUCT HARDWARE
Build the 2nd set of the gear
o Build the 2nd set of the gear
IOM sensor is ordered. PC will be requested to ETC. After we
compare between NeuroSky and Emotiv, we would purchase one
more of them.

Lockheed Martin ETC Projects Spring 2010 Physion
Weekly Report

Team Physion
Week 8 (03-01-2010)
Things we did

1. Game Programming
We made a very simple prototype to show our half presentation.
Completed features
1) Aiming with Wiimote. Change weapon.
2) Zombies walk, attack and die.
2) IOM is working and values are shown at the right bottom.
3) Mindset is working but it crashes sometimes.
4) Fog and glowing effect.

Wiimote Video: Wiimote will move the crosshair http://vimeo.com/10027742

Mindset video: Focus will make crosshair smaller to aim accurately http://vimeo.com/10027749
IOM video: Scared player will lure more zombies http://vimeo.com/10027773

2. Art Work
We have zombies, church and graveyard.

3. Game Design
Meeting with Jesse is postponed but we have draft game design.

4. 10 seconds promotion video
The draft of10 seconds promotion is made. It can͛t have sound.
http://vimeo.com/9947996

Things we will do

1. Preparation for half-presentation
Half presentation is on Wednesday. We would prepare the presentation and demo.

2. Game Programming
Add detail to game.

3. Art Work
We will work on zombie, graveyard and church.

4. Game Design
We will design floor plan and scary point for church.

Weekly Report
Team Physion
Week 7 (02-22-2010)
Things we did

1. IR sensor bar
If we put sensor below or above the screen, aiming point on the screen is not well matched with
what my Wiimote gun actually aim. In shooting game, aiming is basic and crucial part. To solve
aiming, we tried

1) Using two Wiimotes
Block each side of Wiimote and put middle end of the screen. It works in small screen not in big
one because Wiimote has limited horizontal range.

·∙ Use duct tape to block IR
·∙ Put two Wiimotes at each side of screen
·∙ Player need to stay in certain distance to play

2) Using IR LED and attach on the screen
Using IR LED and attach on the screen
It might work well, but the LED would look distracted. We can take the light from the glasses
and attach ƐĐƌĞĞŶ͘ĐĐŽƌĚŝŶŐƚŽ^ƚĞǀĞ͕dŚĂĚƚŚĞŐůĂƐƐĞƐďĞĨŽƌĞďƵƚŶŽƚĐƵƌƌĞŶƚůǇŚĞĚŽĞƐŶ͛ƚ
have it. We think buy new glasses or make our own LED light.

3) Put sensor bar between screen and player

Put sensor bar between screen and player
/ƚ͛ƐǀĞƌǇĞĂƐǇǁĂǇĂnd works in acceptably. However, it is a little distracting that sensor bar is in
front of player and blocks the screen.

2. Game Programming
We will try to make a very simple prototype such as shooting boxes as early as possible.

1) Study Unity 3D engine
We studied Unity 3D engine and make FPS game following tutorial.

2) Integrating Unity 3D with IOM (GSR and heartbeat sensor)
We succeeded in reading data from Wild Divine in Unity 3D

3) Get data from Mindset and Wiimote in C#
We succeeded in reading data from Mindset and Wiimote in C# program for Unity 3D

3. Art Work
We will develop concept art and modeling.
1) Concept art of game stage ʹ church
2) Prototype zombie model

4. Cave System
We talked with Ruth again about the CAVE and the Swiss Ranger sensor (SR). It is really cool to
have a better view, but there are also many challenges. We would develop with normal monitor
first. If we have time later, we would consider using CAVE.

1) SR sensor and projects are not high enough, 7 feet above the floor.
Currently the SR locates lower position, which means the player cannot move freely since SR
has only limited view field. If the player leaves the center point of CAVE a little far away, SR
cannot find the player. In current situation, the valid area is really small, less than 1 square
meter.

In addition, the position of projectors is also low. If a player with 6.5 feet tall is standing at the
center of the CAVE system, his/her head may block some parts of the screen.

To change the position of SR and projector, we have to build a new frame to support them,
which is time consuming, and we need to discuss with ETC.

2) Detecting Aim is hard in CAVE
If we use SR instead of Wiimote to aim, it is hard to detect the gun from the player. In addition,
detecting aim point at three screens will be very complicated. We need to check schedule with
Ruth and i3 team to go to the CAVE room.

5. Purchase New device
Emotiv. It's faster and gives more data than our current device, Mindset.
We ordered the new device but it would come next week. We got the serial number, however,
ǁĞĐĂŶ͛ƚĚŽǁŶůŽĂĚƚŚĞ^<ǇĞƚĚƵĞƚŽŵĂŶƵĨĂĐƚƵƌĞ͛ƐƚĞĐŚŶŝĐĂůƉƌŽďůĞŵ͘

6. Get Unity 3D License
To integrate devices in Unity 3D, we received unity 3D pro license from ETC.

7. Wiimote gun controller test

We received two gun controllers and tested. , The rifle is a little heavy and a little hard to aim.,
An overkill hand cannon has better aim.
.

8 Perforce Setup
We setup Perforce server which enables us faster development.

Things we will do

1. Game Programming
We will make a very simple prototype to show in half presentation.

2. Art Work
We will work on modeling and texturing.

3. Game Design
We will design our game. A meeting with Jesse on Friday will help us to develop our idea.

4. IR sensor bar
-‐ Using IR LED and attach on the screen
We will get LED light and test this method.

Weekly Report
Team Physion
Week 6 (02-15-2010)
Things we did
1. Review of Project in CS using brainwave device
Title: MIND READING: Analyzing EEG Data for Human-Aided Video Retrieval
The original intent was to use EEG signals to reduce the time required to
physically mark an image as relevant; unfortunately, the classifier using thought
alone performed poorly.
There was also noise issue. "Initially, there was great concern that the EEG
signal would contain far too much noise to possibly yield any positive results."
They solved it by "to combine many trials of the same mental action together".
This project is not directly related to ours unless we use EEG.
2. Research on former ETC projects

1) Augmented Cognition (2004)
The website said that checking 'pupil' is not working well. However, we couldn’t
find how they used biofeedback. Jesse, the advisor of the project, was out of
town this week, so we will schedule to meet in next week.
2) Night of the Living Dead (2006)

The website didn't show much information. Theme is similar but game is
different. It’s ‘strategy horror game’. We don't need to request more
information.
3) Review of Project of Serious game (2009)

The program gathers data such as which path player goes, how many cans are
picked up, and which action player does with the time during the game.
They made script to record the data, but it's not on the website. The
programmer of the team, Amith, might still have it.
3. Purchase of Wiimote gun

For the gun, we think to use several guns in the game. We will try various
models and find which will work properly.
1) Black + White Pistol Gun Controller for Wii Remote

$8.82
http://www.dealextreme.com/details.dx/sku.29212
Looks ok and very cheap for two guns. It would be very light so
easy to play.
2) 5-in-1 Laser Light Gun for Wii Remote

$11.81
http://www.dealextreme.com/details.dx/sku.9642
For calibration, it might be easier if we have a gun with laser
pointer.
3) HOUSE OF THE DEAD OVERKILL HAND CANNON (WII)

$35
http://cgi.ebay.com/HOUSE-OF-THE-DEAD-OVERKILL-HAND-CANNON-WII-
NEW_W0QQitemZ180463277821QQcmdZViewItemQQptZVideo_Games_Accessor
ies?hash=item2a047316fd
It is official product for the famous gun shooting game ‘the
house of the dead’.
Quality will be good.
4) Wii Sniper Rifle Gun

$36.07
http://www.amazon.com/Wii-Sniper-Rifle-Gun-Nintendo/dp/B0031QBXJW/
ref=sr_1_2?ie=UTF8&s=videogames&qid=1266362365&sr=8-2
It looks nice. We can take out parts and use different gun such as
blaster, rifle.
4. Game Design
1) Game Engine – Unity 3D
We looked into Unity 3D engine as Lockheed Martin suggested.
We think it can give us better graphics and easier programming
rather than Panda3D. We will use Unity 3D.
2) Art style - Realistic

Between comedy (such as Zombies and Plants) and Realistic (Left 4 Dead), we
choose realistic.
We expect that it can give more immersive, scary feeling to the player.
3) Game background – 18th century Europe

In 18th century Europe, Professional zombie hunter (knight) fights against
zombies in Church with graveyard. The bad boss is the 'priest'.
Things we will do
1. IR sensor bar
1) Discussion with Steve Audia
He has a big screen at home. To play Wii, he uses a customized wii sensor as
big as the size of the screen. We might consider making our own sensor bar. In
last semester BVW, Mark’s team made a small IR light with 9V battery and Chris’
team used AA battery. We will ask them.
2) Commercial Product
There is a safety glass with IR led flashlight. The second year student Sharkee
has it. Yantong will contact him. We might take out IR light from the glass and
put on the screen.
2. Game Design
Based on our background, we will develop a game design and scenario. We hope
that meeting with Jesse will give us some inspiration.
3. Game Programming
We will try to make a very simple prototype such as shooting boxes as early as
possible.
1) Study Unity 3D engine.

2) Integrating Unity 3D with IOM (GSR and heartbeat sensor).
3) Integrating Unity 3D with Mindset (Brainwave).
3. Art Work
We will develop concept art and modeling.
4. Purchase New device

While we continue our research on device, we found a new device, Emotiv. It's
faster and gives more data than our current device, Mindset. We would like to
purchase and try this item. As this item provides SDK, it won’t be hard to
develop a game with it. However, we have only 2 weeks to work until half
presentation, we will continue our work on Mindset for in case.
http://www.emotiv.com/apps/sdk/179/
Price
$500 including Software Developer Kit
Pros
1) Fast data refresh rate
Emotiv detections are mostly updated 4 times per second
(Cognitiv, Affectiv, some Expressiv). Event-driven detections (such as blinks and
winks) are output immediately after detection. If we receive raw EEG data or gyro
signals, these are measured 128 times per second. EEG data is only available
with Research, Education and Enterprise Plus licenses.
2) Various data detection

Expressiv: real-time detection of blinks, left/right winks, horizontal glances
left/right, eyebrow raise, furrow, smile, smirk left/right, clench teeth, laugh
Affectiv: Excitement (short-term and long-term), Engagement/Boredom,

Meditation, Frustration.
Cognitiv: NEUTRAL plus up to four trained actions selected from forward and
backward motions on each of 3 axes, clockwise and anticlockwise rotations
about each of 3 axes (12 detections)
Gyro: 2-axis gyro detects accelerations (nodding, shaking head)
EEG (Research, Education and Enterprise Plus licenses only): 14 channel data at
128 samples per second
Weekly Report

Team Physion
Week 5 (02-08-2010)

Things we did

1. Prepare presentation
We prepared for quarter walkaround, and finished. We got many useful advices from faculties.

2. Item Research
Besides using Wiimote, laser or arcade gun can be considered. As ETC didn͛t have controller, we
found several gun controller on internet. In addition, we would research on Beyond VR and
Thought Technology.

Attached ʹ Physion CIS device report

Things we will do

1. Research based on quarter walkaround feedback
We would look into the advices from faculty.

-‐ Reference to former ETC project
Augmented Cognition F2004 Pittsburgh
Advisor: Jesse

According to Jesse, they used EEG and motion capture. They didn't know what they are doing
and very unsatisfied as well as their client. He suggested proving that it is fun to play with
biofeedback.
-‐> We would make prototype and check it from next week. EEG provides extremly complicated
ĂŶĚ͚ŵŽƚŝŽŶĐĂƉƵƚƌĞ͛ĂƐǁĞůů͘

Mike informed us that there is some CMU Project in Computer Science in CMU using brainwave
checking device.

-‐ Game design suggestion Zen master: game that try to control and calm yourself

When disaster came, player feel embarrassing then player should try to calm.

-‐ Suggestion to use eye tracking device
-‐> It is not biofeedback and Neurosky is already on the head. In addition, the product is still in
prototype stage. It's not reliable yet.

Biofeedback was big boom a few years ago. However, most of them are gone.

-‐ Institute of Creative Technology in University of Southern California does many military
related projects. It is worth to searching.

2. Research on former ETC projects
Faculties suggested to research on former ETC projects. Yantong would make the list of former
ETC project research related on our project. We would research on those and talk the advisors
of them.

Augmented Cognition (Spring 2004, advised by Jesse)
http://www.etc.cmu.edu/projects/biofeedback/
Night of the Living Dead (2006)

http://www.etc.cmu.edu/projects/livingdead/
There are some projects related to motion control, might be useful:
Table Topia
http://www.etc.cmu.edu/projects/tabletopia/
ǯ ȋʹͲͲ͸Ȍ
http://www.etc.cmu.edu/projects/mojox/top.html
Master Motion
http://www.etc.cmu.edu/projects/mastermotion/
Wizards & Lizards

http://www.etc.cmu.edu/projects/wizliz/intro.html

3. Making prototype
We would star make prototype.
Setup system, game design

Weekly Report

Team Physion
Week 4 (02-01-2010)

Things we did

1. Making and Deciding Game Proposal
During the client visit on Friday, among three ideas, we decided to develop the third idea of
African survival. The theme is clearer and game would be more intensive than other ideas. We
would try to combine with the first idea of FPS.

The second idea (jumping game) is very unique and good to show technology. However, it might
have higher learning curve.

Besides using Wiimote, laser or arcade gun can be considered.

1) FPS shooting game
x Use gun model with wiimote to aim.
x Biofeedback augmented with various weapons.
x Focused brainwave (Gamma and Beta) make aim steady with sniper rifle.
x Fast heartbeat enables fast fire rate of machine gun.
x Based on Galvanic Skin Response (GSR), excess nervousness would blur screen.
x Replenish energy when player relaxes.

2) Balancing jumping game (abstract, space-‐y feel)
x Use wiimote to balance.
x If you are focusing, the floor (jumping panel) becomes wider.
x Stable heartbeat would stabilize the floor and make easier to balance.
x Nervousness or stress would delay your jumping action.
x Character would jump when player actually jump, using HMD sensor. (We will not
use HMD but just the HMD sensor.)

3) African Survival game

x Similar to FPS shooting game except you only have one weapon and tons of
zombies.
x Increased heart rate and GSR attract wild animals and you will need to shoot more
of them to stay alive.
x Focus brainwave makes your aim more precise and vice versa.
x Goal is to survive as long as possible.

As Lockheed Martin visited Friday 02/05, we gave quarter presentations. Also, we prepared for
coming quarter presentation. LM suggested giving brief explanation of GSR because some of
audience may not familiar with it during presentation.

3. Item Research
Upon the request of client, we researched more items and made the first Device Search Report.
In device research, price criteria are relative. If we think that it is good device with very high
price, please let client know for future reference. For Lockheed Martin, it might not be
expensive.

Attached File: Device Search Report

4. Making Demo
As we successfully made demo program using Mindset and modified the data mining program
using IOM, we showed to our client.

Things we will do

1. Making and Deciding Game Proposal
As we decide to make survival shooting game, we would start designing game scenario and
game play.

2. Item Research
Besides using Wiimote, laser or arcade gun can be considered. We would research and ask
technical faculty. In addition, we would research on Beyond VR and Thought Technology.

As quarter presentation is coming, we would prepare.


4. Program Stability
As mindset and IOM sensor works on particular system and need some time to operate, we
would try to program stable and learn how to use in our game.

Weekly Report

Team Physion
Week 3 (01-25-2010)

Things we did

1. Making Game Proposal
We thought of 3 potential game proposals.

1) FPS shooting game
x Use gun model with wiimote to aim.
x Biofeedback augmented with various weapons.
x Focused brainwave (Gamma and Beta) make aim steady with sniper rifle.
x Fast heartbeat enables fast fire rate of machine gun.
x Based on Galvanic Skin Response (GSR), excess nervousness would blur screen.
x Replenish energy when player relaxes.

2) Balancing jumping game (abstract, space-‐y feel)
x Use wiimote to balance.
x If you are focusing, the floor (jumping panel) becomes wider.
x Stable heartbeat would stabilize the floor and make easier to balance.
x Nervousness or stress would delay your jumping action.
x Character would jump when player actually jump, using HMD sensor. (We will not
use HMD but just the HMD sensor.)

3) Zombie Survival game (tongue in cheek, think Zombieland)
x Similar to FPS shooting game except you only have one weapon and tons of
zombies.
x Increased heart rate and GSR attract zombies and you will need to shoot more of
them to stay alive.
x Focus brainwave makes your aim more precise and vice versa.
x Goal is to survive as long as possible.


2. Building Logo and Website
We designed a logo, halfsheet, poster and website to put on ETC
homepage.
Website address: http://www.etc.cmu.edu/projects/lm-‐motion/
Attached: Halfsheet design

3. Item Research
Body media and wild divine arrived. We try to find out what data they can detect and how to
extract data. Hardware and software were different with our expectation. We tried to solve the
problem by analyzing code and contacting manufacturing company.

4. Company Contact
1) Minisun -‐ IDEEA
+1 (559) 439-‐4600

x Motion sensor system
x Question to ask
-‐ Possible to get data in real time
-‐ Price and how to buy

2) Wild divine
tori@wilddivine.com
866.594.9453 option "1"
x Received data reporting program ͚Data Parsers͛ and team programmers start to analyze.
x ͚Data Parses͛ exports data manually. We will contact to Wild divine again and ask if
another program is available. If not, we need to modify the program to get data in real
time, however, it is low-‐level programming that our programmers are not familiar with.


3) Body Media
Rachel Jackson
Clinical Research Coordinator
412-‐543-‐1311 (office)
http://www.bodymedia.com

According Body Media,
x There is no provided SDK or way to get raw data with device that we have (GoWear).
x They suggested to us to buy another product of theirs, SenseWear (BMS). BMS
originally costs $3,500 including professional software. After university discount, it
became $2,500. There might be a little room for price negotiation.
x However, both of GoWear and SenWear can't receive data in real time. It stores data
and upload after PC connection.
x For these reasons, we might not use Body Media and just return the item.

4) Thought Technology
1-‐800-‐361-‐3651 or (514) 489-‐8251
x It costs $2300 if we want to use GSR and skin temperature sensor
x To use, an encoder and a sensors are required. 2-‐channel encoder can use 2 sensors.
-‐ 2-‐channel encoder: $ 1700
x Various sensors are available: EEG, EMG, EKG, Respiration, Temperature, etc.
x Professional equipment
x Can get data in real time and export
x Provide API
x 10% student discount
x If we can͛t use Wild Divine either, we will consider this product because of data
accuracy and variable sensor availability.

http://www.thoughttechnology.com/hardware.htm
http://www.thoughttechnology.com/sensors.htm

5) GSR/Temp2
(800) 435-‐5354 (USA/Canada) or (416) 209-‐2495

x Software costs $75 and hardware costs $160
x Also made by Thought Technology, and much simplified one

We contacted Mr. Gordon of MindGrowth, the US distributor. Gordon said it might be possible
to get raw data. We sent questions to Gordon and he would contact the software developer.

http://www.mindgrowth.com/store/index.php?cPath=23
http://www.mindgrowth.com/store/product_info.php?cPath=1&products_id=34
Things we will do


Coming week is due date of 2 game proposal. Based on the feedback, we will develop the ideas.

2. Item Research
The program and use of devices are a little different with our expectation. We will find what
data they can detect and analyze programming code. Then we can find out how to extract data
and where to use.
In additions, in case if we can͛t use IOM, we would contact other manufacturers.


Weekly Report

Team Physion
Week 2 (01-25-2010)

Things we did

Based on our research, we will make at least 2 game proposals.

2. Building Logo and Website
We will design a logo and website to put on ETC homepage.
Website address:

3. Item Research
As soon as other items arrive, we will find what data they can detect. Then we will analyze
programming code and find out how to extract data. In addition, we will discuss its usability.

4. Company Contact
1) Minisun -‐ IDEEA
+1 (559) 439-‐4600

x Motion sensor system
x Question to ask
-‐ Possible to get data in real time
-‐ Price and how to buy

2) Wild divine
tori@wilddivine.com
866.594.WILD (9453) option "1"
x Received data reporting program ͚Data Parsers͛ and
team programmers start to analyze

3) Body Media
Rachel Jackson
Clinical Research Coordinator
412-‐543-‐1311 (office)
http://www.bodymedia.com

According Body Media,
x There is no provided SDK or way to get raw data
with device that we have(GoWear).
x They suggested us buy another product of theirs, SenseWear(BMS). BMS originally costs
$3500 including professional software. There might be a little room for price
negotiation.
x However, both of them can't receive data in real time. It works as storing and uploading.

4) Thought Technology
1-‐800-‐361-‐3651 or (514) 489-‐8251
x It costs $2300 if we want to use GSR and skin temperature sensor
x To use, an encoder and a sensors is required. 2-‐channel encoder can use 2 sensors.
x Various sensors are available: EEG, EMG, EKG, Respiration, Temperature, etc.
x Professional equipment
x Can get data in real time and export
x Provide API
x 10% student discount
x If we can͛t use Wild Divine either, we will consider this product for it has many sensors.

http://www.thoughttechnology.com/hardware.htm
http://www.thoughttechnology.com/sensors.htm

5) GSR/Temp2
Tel: (800) 435-‐5354 (USA/Canada) or (416) 209-‐2495

x Software costs $75 and hardware costs $160
x Also made by Thought Technology, and much simplified one

Contacted to Mr. Gordon of MindGrowth the US distributor that availability of get raw data
We sent questions to Gordon and he would contact the developer of software

http://www.mindgrowth.com/store/index.php?cPath=23
http://www.mindgrowth.com/store/product_info.php?cPath=1&products_id=34

Things we will do


Based on the feedback, we will develop the ideas.

2. Item Research
As soon as other items arrive, we will find what data they can detect. Then we will analyze
programming code and find out how to extract data. In addition, we will discuss its usability.


Weekly Report
Team Physion
Week 1 (01-11-2010)
Things we did
1. Set Weekly Meeting Time

Advisor meeting: Every Monday 11:00
Client meeting: Every Monday 12:00

2. Decide Role
J -‐ Producer
Tatyana -‐ Artist
Xiao -‐ Programmer
Yantong -‐ Programmer

3. Brain Storming
We would divide by category and produce our idea
x Category
Platform / genre / biofeedback / audience / setting

4. Examine CAVE System
1) It has 3 separate screens.
2) It able to detect 3 dimensional movements.
3) It is available on XP and 7.
4) It must notify and coordinate time the faculty team if we want to use.

5. Use of Natal Project
If we cannot get it by next week, we may not use the Natal.
Lockheed Martin would contact to MS

6. Equipment in Need
Discuss with Shirley and Janice
ͻ Whiteboard would be installed on Monday

Things we did
1. Setting Research Plan

We would research on biofeedback first then discuss which method to use.
Research on which biofeedback indicates different emotion or status of mind. And which device
can get those data.
x Biofeedback -‐> Emotion / status of mind -‐> Device

1) Muscle action potential
2) Skin temperature
3) Sweat gland
4) Brain wave
5) Heart rate
6) Abdominal/chest movement,
7) CO2
8) Balance (weight)
9) Eye focus / movement

Tatyana and Xiao would research 1, 2, 3, 4, 5
J and Yantong would do 4, 6, 7, 8, 9

2. Research Meeting
We would have the first research meeting on Tuesday and check our progress.
Next research meeting would take on Thursday.
On Friday, we would analyze and decide which product we need to purchase and examine.

3. Setting Office Hours
Discuss official office hours for the team

Physion Design Documents Weekly

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Physion Design Documents Weekly

Uploaded by

Copyright:

Available Formats

P H Y S IO N W E E K 1 2

PHYSION WEEKLY REPORT

PHYSION WEEKLY REPORT

Video of current version of the game is available at

<Spider in the church>

PHYSION WEEKLY REPORT

<Lightning in the church>

PHYSION WEEKLY REPORT

PHYSION WEEKLY REPORT

•DATA COLLECTION GRAPH DATA COLLECTION GRAPH

PHYSION WEEKLY REPORT

•Zombie Experiment MAD ZOMBIE EXPERIMENT

Some psycho scientists conduct an experiment by putting you

PHYSION WEEKLY REPORT

Based on the feedback and our schedule, we will keep

•RELATIONSHIP BETWEEN RELATIONSHIP BETWEEN EMOTION AND BIOFEEDBACK

RELATIONSHIP BETWEEN BIOFEEDBACK AND GAME

•GAME DEVELOPMENT GAME DEVELOPMENT

•PLAY TEST PLAY TEST

PHYSION WEEKLY REPORT

Floor Plan was

GAME DESIGN VISUAL EFFECT DEVICE CONFIRM

PHYSION WEEKLY REPORT

•FLOOR PLAN FLOOR PLAN

PHYSION WEEKLY REPORT

Following advices of faculty, we revised to give more closed

Player would have a limited sight and less place to move. It

1. Collapsed pillar in the middle added.

2. Desk added near entrance.

4. Curtains near altar.

PHYSION WEEKLY REPORT

<Candle light in the church>

PHYSION WEEKLY REPORT

•FLASH LIGHT FLASH LIGHT

<Flash light in the church>

PHYSION WEEKLY REPORT

•NIGHT SKY NIGHT SKY

<Night sky in the outside>

PHYSION WEEKLY REPORT

•COMPARISON BETWEEN Comparison between Neurosky and Emotiv

Emotiv is much easier to connect with program. Even though

PHYSION WEEKLY REPORT

DATA ACQUISITION DATA ACQUISITION

•EMOTIV acquires more data in

Emotiv can provide more data, including long term

PHYSION WEEKLY REPORT

USER CONVENIENCE USER CONVENIENCE

•Neurosky is easier to use.

PHYSION WEEKLY REPORT

Jesse Schell - Associate Professor

•SCARY MOMENTS DESIGN SCARY MOMENTS

BE CREATIVE WITH ZOMBIE

MAKE BACKGROUND STORY

REVISE ON THE FLOOR PLAN

PHYSION WEEKLY REPORT

We have the basic calibration function. It averages the

•DATA RECORDING DATA RECORDING

We have the data recording tool. It collects biofeedback data

PHYSION WEEKLY REPORT

Based on the feedback and our schedule, we will keep

•GAME DEVELOPMENT GAME DEVELOPMENT

o Add game detail

o User Play Test