1

Scenario
English or Machine Translator (MT) ?

Skill Skill
Good Japanese Good Chinese
Limited English Good English

2
Scenario
English or Machine Translator (MT) ?
Or a Combination?
A Chinese
But which combination? Skill
Good Chinese
Good English

A Japanese
Skill
Good Japanese A Korean
Limited English Skill
Good Korean
Fair English
3
Best Balanced
Machine
Translation
 Methodolog
y
INPUT
List all possible Languages
language sets each user
knows Based on Bramantoro*
Calculate all QoM (Li, MTi,j, Lj) = Accuracy(Li.writing_skill(MTi,j.input_language))
quality of × MTi,j.accuracy
message
(QoM) × Accuracy(Lj.reading_skill(MTi,j.output_language))

Select Pareto Quality of Message from i to j

optimal set(s)

i A
Find best X X j
balanced/bette
r balanced set
あ
Writing Skill Reading Skill
5
 Methodolog
y
List all possible
language sets First, averages QoM between each pair are calculated from

Calculate all
quality of
message
(QoM) AvgQoM can be maximized by selecting appropriate
language set. We define Pareto optimal QoM set as follow
Select Pareto
optimal set(s)
A set of AvgQoMs is called Pareto optimal when it is
impossible to make one AvgQoM better, without making at
Find best least one AvgQoM worse
balanced/bette
r balanced set

6
 Methodolog
y
List all possible Firstly, variance is calculated to measure the difference
language sets
between AvgQoM
Calculate all
A set of QoMs is called best balanced when it is Pareto optimal
quality of
message and the differences between AvgQoMs consisting of every
(QoM) AvgQoMs is minimal

Select Pareto
optimal set(s)
Best Balanced Pareto Optimal& Least Variance
Find best
balanced/bette
r balanced set

7 7
Experiment

We conducted two experiments to

investigate Best Balance method

One of the experiment is collaborative work

Example pages from DSP
on survival game playing including

o Dessert survival problem(DSP)[Lafferty 74]

o Winter survival problem(WSP) [Fermilab

16]

o Lunar survival problem(LSP)[NASA 16]

Participants are asked to rank the

importance of items from 1 to 6 in order to
survive in each situation Choices to be arranged from DSP
8
Experiment This experiment consists of 3 groups of participant with
specific profile shown in table

Language skill is represented as (reading_skill, writing_skill),

while skill is ranged from 0(Minimum) to 1(Maximum)

Participant Profile
Group/ Chinese Japanese Korean
Participa English English English
Gender Gender Gender
nt Skill Skill Skill

Group 1 (1, 1) Male (0.75, 0.5) Female (1, 0.75) Male

Group 2 (1, 1) Female (0.75, 0.5) Male (1, 0.75) Female

Group 3 (1, 1) Male (0.75, 0.5) Male (1, 0.75) Female

9
Experiment

Online Multilingual Discussion

Tool (OMDT) was used as tool for
participants to chat with the
others

MT services used are J-Server

and Toshiba English-Chinese
Machine Translation

OMDT Interface
10
Experiment Finding Best Balanced Set
Good Chinese
Let JA = Japanese, ZH =
Simplified Chinese, and KO = Good English
List all possible Korean A Chinese
language sets
Given the participant’s profiles,
possible language sets are j
Calculate all
quality of C1 : {JA, ZH, KO}
message
C2 : {JA, EN, KO}
(QoM)
C3 : {JA, ZH, KO} Communicatio
n Channels
Select Pareto
optimal set(s) C4 : {JA, EN, EN}

C5 : {EN, ZH, KO} i k

Find best C6 : {EN, EN, KO}
balanced/bette Good Japanese Good Korean
r balanced set C7 : {EN, ZH, EN} Limited English Fair English
A Japanese A Korean
C8 : {EN, EN, EN}
11
Experimen Finding Best Balanced Set
t

List all possible

language sets
Combination
i -> j j -> i j -> k k -> j k -> i i -> k
/ User
Calculate all C1
JP->ZH ZH->JP ZH->KO KO->ZH KO->JP JP->KO
quality of 0.7500 0.6750 0.4188 0.6625 0.7563 0.7875
JP->EN EN->JP EN->KO KO->EN KO->JP JP->KO
message C2
0.8813 0.7000 0.5875 0.6625 0.7563 0.7875
(QoM) JP->ZH ZH->JP ZH->EN EN->ZH EN->JP JP->EN
C3
0.7500 0.6750 0.5875 0.5531 0.7000 0.8813
JP->EN EN->JP EN->EN EN->EN EN->JP JP->EN
Select Pareto C4
0.8813 0.7000 1.0000 0.7500 0.7000 0.8813
optimal set(s) EN->ZH ZH->EN ZH->KO KO->ZH KO->EN EN->KO
C5
0.3688 0.4406 0.4188 0.6625 0.4969 0.4406
EN->EN EN->EN EN->KO KO->EN KO->EN EN->KO
C6
0.7500 0.7500 0.5875 0.6625 0.4969 0.4406
Find best
EN->ZH ZH->EN ZH->EN EN->ZH EN->EN EN->EN
balanced/bette C7
0.3688 0.4406 0.5875 0.5531 0.5000 0.5000
r balanced set EN->EN EN->EN EN->EN EN->EN EN->EN EN->EN
C8
0.7500 0.7500 1.0000 0.7500 0.5000 0.5000

12
Experimen
t

List all possible

language sets
Combination
i -> j j -> i j -> k k -> j k -> i i -> k
/ User
Calculate all C1
JP->ZH ZH->JP ZH->KO KO->ZH KO->JP JP->KO
quality of 0.7125 0.5406 0.7719
JP->EN EN->JP EN->KO KO->EN KO->JP JP->KO
message C2
0.7906 0.6250 0.7719
(QoM) JP->ZH ZH->JP ZH->EN EN->ZH EN->JP JP->EN
C3
0.7125 0.5703 0.7906
JP->EN EN->JP EN->EN EN->EN EN->JP JP->EN
Select Pareto C4
0.7906 0.8750 0.7906
optimal set(s) EN->ZH ZH->EN ZH->KO KO->ZH KO->EN EN->KO
C5
0.4047 0.5406 0.4688
EN->EN EN->EN EN->KO KO->EN KO->EN EN->KO
C6
0.7500 0.6250 0.4688
Find best
EN->ZH ZH->EN ZH->EN EN->ZH EN->EN EN->EN
balanced/bette C7
0.4047 0.5703 0.5000
r balanced set EN->EN EN->EN EN->EN EN->EN EN->EN EN->EN
C8
0.7500 0.8750 0.5000

13
Experimen Finding Best Balanced Set
t

List all possible

language sets
Combination
i -> j j -> i j -> k k -> j k -> i i -> k
/ User
Calculate all C1
JP->ZH ZH->JP ZH->KO KO->ZH KO->JP JP->KO
quality of 0.7125 0.5406 0.7719
JP->EN EN->JP EN->KO KO->EN KO->JP JP->KO
message C2
0.7906 0.6250 0.7719
(QoM) JP->ZH ZH->JP ZH->EN EN->ZH EN->JP JP->EN
C3
0.7125 0.5703 0.7906
JP->EN EN->JP EN->EN EN->EN EN->JP JP->EN
Select Pareto C4
0.7906 0.8750 0.7906
optimal set(s) EN->ZH ZH->EN ZH->KO KO->ZH KO->EN EN->KO
C5
0.4047 0.5406 0.4688
EN->EN EN->EN EN->KO KO->EN KO->EN EN->KO
C6
0.7500 0.6250 0.4688
Find best
EN->ZH ZH->EN ZH->EN EN->ZH EN->EN EN->EN
balanced/bette C7
0.4047 0.5703 0.5000
r balanced set EN->EN EN->EN EN->EN EN->EN EN->EN EN->EN
C8
0.7500 0.8750 0.5000

13
Experimen Communication Channels
t
Using English as Shared Use Full Machine Translation Using Language from the
Language Service Best Balance Method

English Chinese English

ZH ZH ZH

EN MT BB

JA KO JA KO JA KO

English English Japanese Korean Japanese English

15 13
16
 Neal Creative | click & Learn more

TIP │ Use the built-in color

palette with green and yellow
for callouts and accents

Neal Creative ©
Online Multilingual
Discussion Tool
(OMDT)

J-Server
Toshiba English-Chinese
Machine Translation

OMDT Interface
10
 Using English as Shared Use Full Machine Translation Using Language from the
Language Service Best Balance Method

English Chinese English

A Chinese A Chinese A Chinese

EN MT BB

A Japanese A Korean A Japanese A Korean A Japanese A Korean

English English Japanese Korean Japanese English

19
 Korean Chinese Japanese
50% 50%
45% 45%
40% 40%
35%
35%
30%
30%
25%
20% 25%
15% 20%
10% 15%
5%
10%
0%
5%
EN MT BB EN MT BB EN MT BB
0%
Group 1 | Group 2 | Group 3 EN MT BB

Takativeness of Each Participant Average Talkativeness 20

15
 Standard Deviation Comparison between Model and
Average Result
Standard Deviation Standard Deviation
of the Model of the Result model
0.25 0.1 (average QoM value)
0.09
0.2 0.08
result
0.07 (talkativeness)
0.15 0.06
0.05
0.1 0.04
0.03
0.05 0.02
0.01
0 0
C8(EN) C6 C1(MT) C3 C2 C7 C5 C4(BB)
Standard Deviation of the Model
Sandard Deviation of the Result
Standard deviation of
the the result reflects 16
 Breakdown count for each strategy and group
25

20

15

10

0
EN MT BB
Group1 Group2 Group3

17
Encourage user with low shared language skill

oAble to express her/his idea easily and more often

Less conversation nudging from the other users

oHave more confident using mother language

oLess language mistake due to low skill of shared language, leading to ignorance

oUnderstand the conversation by reading the translated message and

KO How do you think about JA-san? ZH Do you agree with that the chocolate is
the most useless one?
ZH JA-san, what do you think? JA can we solve shortening...?
JA chocolate is most useful
KO How do you think about JA-san?
KO Wait a minute, we can get fire from crash
ZH How about JA? ZH Yes
Conversation nudging example (using EN) An example of ignorance (using EN)

18
Reduce MT problems KO Translation doesn't 翻訳が以上解読意 翻译不明白以上解 번역이 이상해서
味を分かりません. 读意义． 4号是什 의미를 모르겠습니
understand the 4番は何ですか? 么？ 다. 4번은 무엇인가
decipherment meaning 요?
above. What is number 4?
oMistranslated message ZH Not so good seems, and あなたの翻訳はあ 你的翻译好像不太 당신의 번역은 별
interrupt the flow, cause your translating is not so まり良いようで、と
ても明らかではない
好，不是太明白 로 좋은 것 같아서,
정말 명확해서는
misunderstanding, or knowing. ではありません 잔잔해져서는 없습
니다
non understandable This is, ha ha, unfortunate, ハッハッ、この運が 哈哈，这倒霉的翻 【핫핫】, 이 운이 나
悪い翻訳システム 译系统 쁜 번역 시스템
and translate a system.

ZH Playing drinking game, and 拳を打ちましょう、 猜拳吧，我出拳头 주먹을 칩시다, 저

私は握りこぶしを出 는 주먹을 드러냅
I pay a fist. します 니다
Somebody has won whom 誰が勝って誰を聞 谁赢了听谁的 누가 이겨서 누구
きました 를 들었습니다
to listen.
KO That's it for the translation, 翻訳が以上ですハ 翻译以以上 번역이 이상합니다
ハハハハ hahahahaha 하하하하하
HAHAHAHAHA.

Example of translation complaints (using MT)

19
oConduct more number of experiment to ensure the model
works for more type of situation
oMore possible situation
oInclude native speakers of English
oExtend number of user in conversation group
oDesign and conduct experiments on Cultural Asymmetry

20
26
—RACHEL GILLETT, FAST COMPANY

27
Revealing key points
one at a time enhances
comprehension.

28
PREPARE

Consider when you give Avoid using sentences Focus on action words
a paper handout in a that will already be used that will enhance the
meeting—everyone’s head when talking viewer experience
goes down and they read,
rather than staying
heads-up and listening.

29
 TIP
To keep the audience focused, always use the same
transition before a new topic

Consistency helps viewer see connections in the story –

use same layout and design for individual sections and
give your audience a mental check-point.
 THE STAGE HAS BEEN SET
go ahead and follow the basic 5 steps

1 2 3 4 5

Reference : The basics you can find anywhere 5 Steps To Successful Storytelling Published on April 5, 2014 Featured in: Marketing & Advertising
31
 FACT

SPEED.
Images are another element that can drive your point home even more
 1

Why does this matter to your audience?

Where are you taking them?

33 33
 2

Who | What | Where | When | Why

34
 3
Images are a great tool
for showing context

SUPPORT
We perceive the world through
more than our eyes and ears;
we smell, we touch, and we taste.
Put your audience in that place and
provide them a point of reference;
the imagination will do the rest.
35
 4

Visualize key messages

A picture is worth a thousand words…
Make a statement
Using graphics, charts, and infographics

36
 5

LEAD
Start your story with an outline,
a framework of points you
need to have to tell your story,
always moving forward to
the conclusion or action points

37
 What do you want them to remember?

Get them excited about what’s to come

Build your presentation and give us your feedback

if this was helpful to you.

38
 “
BECAUSE STORYTELLING,
AND VISUAL STORYTELLING,
WAS PUT IN THE HANDS OF EVERYBODY,
WE HAVE ALL NOW BECOME STORYTELLERS.

—LEVAR BURTON

39
 THANK YOU

Neal Creative © Neal Creative | click & Learn more