lmprovlng culLural walk-Lhrough experlences

uslng spherlcal panorama based navlgauon

Anoea leacan|, Lea Lanoucc|, l|eto la|a ano A|beto Le| u|mbo
bn|ves|ta o| l|enze (l1) - MlCC
ACM Mulumedla 2014, demo sesslon, november 3-7, Crlando, llorlda
1he appllcauon goal ls Lo provlde a llghLwelghL
envlronmenL Lo be deployed ln a web browser for Lhe
|nteracnve nav|ganon and brows|ng of an ordered
sequence of spher|ca| |mages.


ACM Mulumedla 2014, demo sesslon, november 3-7, Crlando, llorlda
1he rsL of Lhe Lwo key feaLures of Lhe sysLem ls Lo
enab|e a smooth trans|non beLween Lhe ad[acenL
panoramas Lhrough an algorlLhm of sub-scene
match|ng.






ACM Mulumedla 2014, demo sesslon, november 3-7, Crlando, llorlda
lmage lk lmage lk+1
1he ldenucauon of Lhe recLangular sub-reg|on of an |mage !" LhaL
besL maLches Lhe conLenL of !"#$ ln correspondence Lo Lhe lnward
dlrecuon ls accompllshed by mlnlmlzauon of Lhe followlng
cost funcnon wlLh respecL Lo Lhe Lhree varlables (x, y, q)

(x0, y0, q0) = arg[mlnx,y,q u(f(x, y, q), lk+1)]

where:
- %&'( *( +, - ./01&!"( '( ' # +2"#$( *( * # +3"#$,
- 2" and 3" are Lhe wldLh and helghL ln plxels of Lhe lmage lk,
- ./01&!('(4'(*(4*) reLurns Lhe recLangular sub-reglon of Lhe lmage l,
- 5&!6(!7, reLurns Lhe dlsslmllarlLy beLween Lhe conLenL of Lwo
lmages ln and lm,
- &'0( *0( +0, denes Lhe coordlnaLes of Lhe bouom-le verLex of Lhe
sub-reglon o = (xo , yo) and the zoom factor Zo = 1/qo Lo be applled
Lo Lhe sub-reglon of lk ln order Lo maLch Lhe slze of lk+1.





ACM Mulumedla 2014, demo sesslon, november 3-7, Crlando, llorlda
3
Some resu|ts: ln Lhe rsL column lmages of Lhe user current v|ew are
presenLed, ln Lhe second Lhe best match|ng sub-reg|on of Lhe currenL
lmage wlLh Lhe opumal zoom facLor for Lhe Lransluon ls shown, nally,
ln Lhe Lhlrd column Lhe next panorama ls vlsuallsed.






ACM Mulumedla 2014, demo sesslon, november 3-7, Crlando, llorlda
We experlmenLally observed LhaL compuLauon of Lhe dlsslmllarlLy
funcuon u(ln,lm) Lhrough Lhe dlsLance of Lhe lmage hlsLograms provl-
des h|gher eecnveness compared Lo soluuons based on scale
lnvarlanL local keypolnL descrlpLors such as Sll1.
1he second key feaLure of Lhe sysLem ls an |nnovanve |nteracnon
metaphor for a beuer fruluon of mulumedla maLerlals assoclaLed
Lo |nteracnve hotspots relaLed Lo olnL Cf lnLeresLs (Cls). 1hese
are dlsLrlbuLed along a culLural walk-Lhrough and lnclude 3u
models, uls, gallerles of lmages/vldeos and lndoor panoramas




vlsuallsauon of a browsable panorama ln Lhe 3u space
ACM Mulumedla 2014, demo sesslon, november 3-7, Crlando, llorlda
- 1he lnLerface ls bullL uslng n1MLS, CSS3, [avascr|pt and WebGL,
- navlgauon among spherlcal lmages ls obLalned rep|ac|ng a texture mapped lnLo a sphere
Laklng lnLo accounL Lhe opumal zoom facLor esumaLed by Lhe sub-maLchlng module,
- Cls lnfos and assoclaLed mulumedla maLerlals are shown ln oanng pane|s ln Lhe 3D space
overcomlng Lhe llmlLauon of sLandard lnLerfaces LhaL use 2u llghL-boxes zoom facLor compuLed by
Lhe sub-scene maLchlng module.





vlsuallzauon of an lnLeracuve 3u ob[ecL
of a church ln Lhe 3u space
ACM Mulumedla 2014, demo sesslon, november 3-7, Crlando, llorlda
notspots assoclaLed lnLeracuve mulumedla
maLerlal can be accessed by a c|rcu|ar menu
represenLed by four lcons for Lhe dlerenLe
Lypes: DI, |mage and v|deo ga||ery, 3D
ob[ect, nested panorama.

1he sysLem auLomaucally provldes Lhe best
v|sua| arrangement of mulumedla maLerlals
wlLh respecL Lo Lhe user polnL-of-vlew and
allows Lhe user to drag Lhe hoLspoLs ln order
Lo cusLomlse Lhe dlsposluon of elemenLs ln
Lhe 3u space.

M|n|-maps are provlded allowlng conLexLual
awareness.





PoL-sposL can be draggled ln 3u space
lnLeracuve mlnl-map showlng hoL-spoLs
and user posluon and orlenLauon
ACM Mulumedla 2014, demo sesslon, november 3-7, Crlando, llorlda
1he demo wlll show a nav|gab|e route based on spherlcal phoLos whlch
sLarLs from Lhe currenL V|a de||a N|nna near Lhe Umz| Ga||ery, Lo Lhe
church of San Leonardo |n Arcetr| ln llorence (l1), glvlng Lhe posslblllLy
Lo experlence an lmporLanL, Lhough llule-known mulumedla vlrLual
lunerary of culLural and hlsLorlcal herlLage.




ACM Mulumedla 2014, demo sesslon, november 3-7, Crlando, llorlda
1he church of San Leonardo
ln ArceLrl
1he famous romanesque
pulplL lnslde San Leonardo
1he remalns of Lhe church
of San ler Scheragglo
ln vla della nlnna
We are also worklng on a demo Lo allow users Lo navlgaLe Lhe
lmmerslve lnLerface Lhrough a gesLures uslng Mlcroso klnecL




ACM Mulumedla 2014, demo sesslon, november 3-7, Crlando, llorlda