Preface…

• Malay house in Kampung Kudei (old kampung Kudei) known to be the

last floating village in Sarawak. Yet not many researcher (local or
foreign) figured out this village from their research. This book
referring to the effort been putting up by research team from culture
and heritage preservation by new media background.
• It is a report of the outcome of level 1 for kampung kudei. Framework
been constructed to allow the mechanism of 3D CGI and supported
by VR technology. Cultural heritage documentation importance is
recognized and supported at international level, the continuous
development of new technology is increasing the pressure to
document and preserve digitally.
•
• All around the world heritage sites are being affected urbanization
and also from natural disasters, weather changes, and human
negligence. Cultural heritage assets received a lot of attention
recently from the authorities and they benefit from advances made in
imaging and computer processing especially in 3D Computer
Generated Imagery (CGI) .
• At the moment cultural heritage assets documentation is well
recognized and there is an increasing pressure to document and
preserve them digitally. Accurate 3D representations of cultural
heritage assets are valuable for conservation, scientific study, and
education.
• Driven by progress in data acquisition systems and data processing
capabilities, the 3D virtual model creation is currently receiving a high
amount of attention from researchers, many computer graphics
artists and 3D scanning specialists have been involved in the 3D
digitization of cultural heritage. This paper stand as a documentation
presentation regarding the whole process of reconstructing the real
environment /RE into virtual environment / VE. Hence into the
process of building walkable or walkthrough in Virtual Reality
platform/ VRP.
The digital cultural heritage

• 3D digitization of cultural heritage assets is considered a common

practice. As presented by Gomes, L., Bellon, R., P., and Silva, L.6 digital
preservation of cultural heritage represents an application area for
digitization technology whose interest has increased in the past two
decades. The main motivations to digital preserve cultural heritage
assets are the following:To ensure that the shape and texture of an
object is not lost in case of damage by accidents or natural causes; To
create 3D models, assets based on the visual data from field work
collection and environments that have a high degree of fidelity
represents a very challenging task that demands advanced knowledge
of digitization techniques and computer graphics.
• The digitization of artefacts and monuments represents a field of
continuous research and development, advances technologies in the
field of 3D modeling can change the whole digitization process. As
presented by Koutsoudis, A., Stavroglou, K., Pavlidis, G. and Chamzas,
C.7, 3D content has become very popular not only due to the
technological trends (e.g. 3D films, computer games, virtual reality
and augmented reality equipment).
The Process; The journey
• Conceptualization and visualization
• In this stage, conceptualization team putting up sketches and coloring
based on the visual support from web; Google Maps.
• Location scouting team/ LST will allocate the actual site for the
research to be conducted. By using google maps, kampung kudei as
shown in map and red line covered area (Please refer to Figure 1.0
Kampung Kudei , Sarawak in Google Maps). After setting research
site, the LST using satellite view from google maps to view kampung
kudei from sky. As shown below;
Visual Support for PreVisualzation

• In this stage, the research getting support from Sarawak Drone Pilot ,
Mr Lau Wei Hong. He is an experience drone pilot. Used to pilot the
drone ( Phantom 3) in foreign country. Getting his help to get some
aerial view for reference. As shown below;
Visualization Process / VP

• Visualization process take place. By using the said visual support from
above, the VP starts with rough sketches ( Please refer to figure 4.0 &
5.0). Then some color setting. From this step if move to simple
modeling, 3D modeling by using Autodesk system’s Maya to support.
First phase using shaded scheme to previsualize the outcome. As
shown below;
Digital Visualization phase 1 ( Computer
Generated Imagery/ CGI) Shaded Mode
Aerial from Research Team

• When the research team led by Aloysius Yapp and Lim Chai Kim
managed to engaged with DJI system. The model they have been used
is Mavic Platinum. New model needs time to practice. The team using
3 months to manage to embark to new platform which putting ‘ eye
in the sky’ first time to support the VR and AR team to be able to
provide visual support from aerial view for the usage in
reconstruction of VE from RE.
Supporting Aerial View photography from Mr
Lau Wei Hong (Sarawak Drone Pilot)
Supporting Aerial View photography from Aloysius
Yapp (Drone Pilot)
Unity VE reconstruction of RE the actual site.
(Aerial View)
3D modelling; Autodesk system ( Maya )/ Computer
Generated Imagery (CGI) Previsualization of The Malay
house
Visual support for Malay house in Sarawak .
( Kampung Kudei)
Autodesk system’s Maya software constructing
Malay House. Presented in shaded mode.
• Computer Generated Imagery (CGI) modelling is a process of
developing a mathematical representation of a 3D object or surface;
this is done using specialized Autodesk system’s software. Computer
Generated Imagery (CGI) modelling makes use of empirical and
topographic techniques to create the 3D representations.
• During an empirical recording different measurements are taken (by
hand) of distances between characteristics points on the surface of
the monument. At the same time, developing team been developed
into 2 separate majors. First major focusing in conceptualization and
second major built for visualization.
• Computer Generated Imagery (CGI) is a simple method and
productive and of low cost. Advanced aerial photographing support
such as DJI system’s mavic Drone can be used to increase the accuracy
of the measurements through the aerial view.
• The digital reconstruction of the kampung Kudei (old side) from
Sarawak was done using Maya modelling from Autodesk system. As
presented in figure 1.0. The documentation regarding the wooden
structure of the house is limited. The main reference for malay house
of Kudei is presented in shaded mode which been projected in Figure
8.0 Digital Visualization phase 1 (Computer Generated Imagery/ CGI)
Shaded Mode’
Unity: for Navigation

• Navigation and User Interface Navigation in a 3D virtual space such as

Unity engine is sometimes a wonderful journey. Basic understanding
must get involved in term reconstructs of real environment to be
presented in virtual environment. In this context known as Virtual
environment / VE.
• After getting VE in place next step, Graphic User Interface / GUI
where point-and-click is the major interaction technique take place.
Development team will take over this task.
• They will design a work flow and chart for the call-off coding asset.
Asset by asset needs to be categorized in 2 big group; playable
character/ PC and Non-playable character/ NPC.
The walkthrough- able visual support. ( Unity
Engine)
Conclusions

• Engaging with VE from RE and VR walkthrough-able outcome is a

project combining the arts and science practice over all. As
conclusions, we managed to have our model in building workflow for
local ( Malaysia ) context in term of heritage and culture preservation
by new media research, known as practice led research from local
content.
• To be able to move faster in the 3D CGI, VE construction process,
drone support is very important. It allowed us to figure out the site
and environment / RE faster than before. By using google maps
support, the previsualization and preparation for research field work
can be easily plan. Autodesk system and unity engine putting lot more
interesting point and approaches in term of construction of VE and
building assets for VE.
• The research in this paper is only the new journey for heritage
preservation locally. Further research will be devoted to improve the
fidelity of the 3D models within this project. Virtual reality
application, augmented reality applications and 3D printed replicas of
damaged/incomplete artefacts are being developed to ensure the
dissemination of this research.
Reference

• B. Bell et al., 2002 An annotated situation awareness aid for augmented reality,
Proc. of the 15th annual ACM symposium on User interface software and
technology, New York, NY, USA, pp. 213-216, 2002
• Bernardini, F., Rushmeier, H., 2002: The 3D Model Acquisition Pipeline. Computer
Graphics Forum, 21(2), pp. 149-172
• El-Hakim, S.F., Gonzo, L., Picard, M., Girardi, S., Simoni, A., Paquet, E., Viktor, H.,
Brenner C., 2003: Visualisation of
• highly textured surfaces. 4th Int. Symp. VAST2003, pp. 231- 240, Brighton, UK
• Fontana, R., Gambino, M.C., Greco, M., Marras, L., Pampaloni, E., Pelagotti, A.,
Pezzati, L., Poggi, P., 2005: Two-dimensional
• imaging and three-dimensional sensing data acquisition and mutual registration
for painting conservation. Videometrics VIII, Vol. 5665-08, San Jose (CA), USA
• Grün, A., Remondino, F. and Zhang, L., 2004: Photogrammetric
Reconstruction of the Great Buddha of Bamiyan, Afghanistan.
Photogrammetric Record, 19(107), pp. 177-199
• Lettner, M., Diem, M., Sablatnig, R., Kammerer, P. and Miklas, H.,
2007: Registration of Multispectral Manuscript Images as
• Prerequisite for Computer Aided Script Description. CVWW07: 12th
Computer Vision Winter Workshop, St. Lambrecht, Austria.
• GLODARIU 1975 Glodariu, I., Un atelier de făurire la Sarmizegetusa
dacică, Acta
• Musei Napocensis, Cluj-Napoca 1975, 107–133.
• GLODARIU/IAROSLAVSKI 1979 Glodariu, I./ Iaroslavski, E. Civilizația fierului
la daci, Dacia, Cluj-
• Napoca 1979.
• GOMES/BELLON/SILVA 2014 Gomes, L./ Bellon, R., P./ Silva, L. 3D
reconstruction methods
• for digital preservation of cultural heritage, Journal of Pattern
• Recognition letters, 2014.
• KOUTSOUDIS/STAVROGLOU/PAVLIDIS/CHAMZAS 2012 Koutsoudis, A./
Stavroglou, K./ Pavlidis, G./ Chamzas, C.
• 3DSSE – A 3D Scene Search Engine Exploring 3D scene using
• keywords, Journal of Cultural Heritage, 2012, 187–194.
• NEAMȚU/POPESCU/MATEESCU 2011 Neamțu, C./ Popescu, D./ Mateescu,
R., From classical to 3D
• archaeology, Annales d’Universite “Valahia” Targoviște, Section
• d’Archeologie et d’Histoire, XIII, 1, 2011, 79–88.
• NEAMȚU/COMES/MATEESCU/GHINEA/DANIEL 2012 Neamțu, C./ Comes,
R./ Matescu, R./ Ghinea, R./ Daniel,
• F./ Using virtual reality to teach history, The 7th International
• Conference on virtual learning (Brașov), 2012, 303–311.
• PAVLIDIS/KOUTSOUDIS/ARNAOUTOGLOU/TSIOUKAS/ CHAMZAS 2007
Pavlidis, G./ Koutsoudis, A./ Arnaoutoglou, F./ Tsioukas, V./ Chamzas, C.
Methods for 3D digitization of Cultural Heritage, Journal of Cultural
Heritage, 2007, 93–98.