Professional Documents
Culture Documents
art ic l e i nf o a b s t r a c t
Article history: With the accelerated aging of world population, complete denture prosthesis plays an increasingly
Received 12 May 2015 important role in mouth rehabilitation. In addition to recovering stomatognathic system function,
Accepted 24 August 2015 restoring the appearance of a third of the area under the face has become a great challenge in complete
denture prosthesis. This study analyzes the interactive relationship between the appearance of a third of
Keywords: the area under the face and complete denture, and proposes a new method to predict facial deformation
BP neural network after complete denture prosthesis. Firstly, to improve computational efficiency, the feature template is
Laplacian deformation constructed to replace the deformed facial region. Secondly, a forecast model of elastic deformation is
Complete denture constructed using BP neural network and predicts elastic deformation amount because of the inhomo-
Soft tissue simulation
geneous, anisotropic and nonlinear material properties of soft tissue. Finally, a new feature template is
Feature Template
calculated using deformation amount, and the deformation of preoperative model is simulated using
Laplacian deformation technique. The average error rates of different hidden layer nodes in the neural
network are analysed. Deformation and postoperative models are superimposed for match analysis.
Experimental results show that this method can predict facial soft tissue deformation quickly and
accurately.
& 2015 Elsevier Ltd. All rights reserved.
http://dx.doi.org/10.1016/j.compbiomed.2015.08.018
0010-4825/& 2015 Elsevier Ltd. All rights reserved.
104 C. Cheng et al. / Computers in Biology and Medicine 66 (2015) 103–112
speed and precision. Mollemans et al. [13] applied MTM to soft deformations of preoperative models were simulated using
tissue simulation for maxillofacial surgery. They reconstructed the Laplacian deformation technique.
facial and skull models by using CT data and then simulated the This study aims to predict the facial deformation of a patient
displacement of skull and facial deformation. MTM is a combina- after complete denture prosthesis and to provide the constraints
tion of FEM and MSM. On the one hand, MTM has the bio- related to the digital arrangement of artificial teeth in the com-
mechanical relevance of FEM. On the other hand, MTM retains the plete denture. The proposed method in this paper is prepared for
easy architecture of MSM. Patients require CT scans to analyse the the digital design and manufacturing of complete denture. The
soft tissue model to determine the boundary conditions of the traditional production of complete denture requires skilled tech-
model. This procedure could affect the health of patients. nicians, high treatment costs, and long production cycle. A CAD/
Artificial neural networks (ANNs) have been widely applied to CAM (Computer Aided Design/Computer Aided Manufacturing)
complex system modelling and are particularly suitable to pro- system can assist the completion of manual arrangement and wax
blems that involve the manipulation of multiple parameters and production by using a computer and a rapid prototyping tech-
nonlinear interpolation. BP neural network is a typical ANN, which nology. A 3D model of the edentulous mould is obtained through
can implement any complex nonlinear mapping functions. Scott scanning. Then critical features are very necessary to provide the
et al. [14] predicted the material properties of ceramic using ANNs. basis of tooth-arrangement and the constraints on the spatial
Suganthi et al. [15] applied BP neural network to predict the position and posture of complete denture. The fullness constraint
multiple quality responses in micro-EDM operations. Oktem [16] surface is one of the most important features of complete denture
constructed BP neural network model for surface roughness pre- production, as shown in Fig. 1. The completely arranged artificial
diction. Models of the diffusion of oxygen through mixed ionic articulation is related to the fullness surface and satisfies indivi-
conductors have provided accurate predictions of the diffusion dualised needs. The fullness constraint surface, which is the inner
coefficient [17]. ANNs have provided accurate predictions in the surface of the skin, is ratiocinated by the prediction of facial
performance of materials with highly complex behaviour [18,19]. deformation of a patient after complete denture prosthesis.
However, ANNs have not been applied in facial deformation pre-
diction research.
No current studies have analysed the prediction of facial 2. Materials and methods
deformation after complete denture prosthesis. This paper pro-
poses a new facial deformation prediction method after complete The models used in this paper were supplied by the Depart-
denture prosthesis. This method has high computational efficiency ment of Orthodontics, School of Stomatology, Peking University. A
and good predictive accuracy and does not require CT scan. Pre- total of 48 edentulous patients agreed to participate in this
operative and postoperative models of 48 patients were obtained research. Preoperative and postoperative models of each patient
from doctors. The feature templates containing several feature were acquired. Face Scan (3D SHAPE, Germany) was used to obtain
points were designed to replace the deformed area of facial the models (scan time: 0.3/0.8 s; scan accuracy: 0.1 mm). Finally,
models. They also improved the computational efficiency. The preoperative and postoperative facial 3D point cloud data of 48
transformation from preoperative to postoperative models must patients were collected.
be examined with BP neural network. Then, BP neural network The main work of this study is to predict the facial deformation
was applied to construct the nonlinear elastic prediction model of of edentulous patients after complete denture prosthesis. The
soft tissue. Forecast output data can be obtained through elastic overview of our simulation pipeline is depicted in Fig. 2. The work
prediction model. According to the forecast output data, the flow includes the following steps:
Fig. 1. (a) Facial model and denture model; (b) deformation model; and (c) relationship between fullness constraint surface and denture model.
C. Cheng et al. / Computers in Biology and Medicine 66 (2015) 103–112 105
(1) Model matching. According to the positions of the eyes and nose,
ICP-based registration can be performed between preoperative
and postoperative models.
(2) Constructing feature templates. Feature templates are con-
structed for the preoperative and postoperative models and
consisted of several feature points.
(3) Constructing elastic deformation prediction model. BP neural
network can be trained using feature templates. Thereafter, BP
neural network becomes an elastic deformation prediction
model.
(4) Prediction and simulation. According to the output data pre-
dicted by elastic deformation prediction model, the deformation
of preoperative model can be simulated using Laplacian defor-
mation technique.
(5) Validation. The computed facial appearance is qualitatively and
quantitatively compared with the real postoperative model. The Fig. 3. Model matching.
average error rates of a different number of hidden layer nodes
of neural network are analysed.
(3) The horizontal isoline across point A in the X direction can be
2.1. Constructing the feature template obtained. According to the contour curvature, the feature points
E and F on both sides of the nose are located. Similar to the
3D face scan data have considerable differences. The vertices middle point G between points A and E, the middle point H
among the models have no corresponding relationship and the between points A and F is computed.
number of vertices contradicts the number of triangle meshes. The (4) Similar to step (2), the vertical isolines across points E, G, H, F in
feature template is constructed to replace the deformed facial the Y direction are obtained. The feature points are located
region to allow manoeuvrability of data, to improve the calculation according to the contour curvature. Finally, the feature template
efficiency and to simplify the point cloud models. comprising feature points 1–29 is collected (Fig. 4(b)).
Before constructing the feature template, ICP-based registration
is performed between preoperative and postoperative models 2.2. Constructing the elastic deformation prediction model
according to the positions of the eyes and nose, as shown in Fig. 3.
The feature template is constructed as shown in Fig. 4(b). The Human skin tissue is a heterogeneous material. Its mechanical
main steps include the following: properties include nonlinearity and anisotropism. BP neural net-
work can express complex, nonlinear and uncertain systems.
(1) The maximum point A (Fig. 4(a)) in the Z direction is founded in In this paper, BP neural network is used to obtain the rela-
the coordinates, as shown in Fig. 3. tionship between elastic deformation and the feature template of
(2) The vertical isoline across point A in the Y direction is shown in the preoperative model. The facial elastic deformation prediction
Fig. 4(a). According to the contour curvature, the feature points model can be constructed.
under the nose and on upper lip part are located and labelled as BP neural network is a feedforward neural network. The main
points 1, 3, 4 and 5. The contour curvature is expressed by mean characteristic of this network is that the signals are transmitted
curvature forward, and the errors are transmitted in reverse. Hecht-Nielsen
n [21] proved that three layers of feedforward network with one
1
H= ∑ Ki i = 1, 2, …, n hidden layer can approach any multivariable polynomial function.
n i=1 (1)
Therefore, the three layers of BP neural network are used to pre-
2∙(pj − pi )∙n⃑ dict the amount of elastic deformation in the preoperative model.
Ki = The topology of BP neural network is shown in Fig. 5.
(pj − pi )∙(pj − pi ) (2)
Fig. 5 shows that {X1, X2 , … , Xn } are the input data of BP neural
where H is the mean curvature; n is the number of points in one network. Xi (i¼ 1,2,…,n) preserves the coordinates of feature points
ring neighbourhood of pi ; pi is the centre point; pj is the point in on the preoperative model. {Y1, Y2, … , Yn } are the predicted values.
one ring neighbourhood of pi ; Ki is the curvature of the surface Yi (i ¼1,2,…,n) preserves the displacements of corresponding fea-
between pi and pj ; and n⃑ is the normal vector at pi . The middle ture points from preoperative to postoperative model, also known
point 2 between points 1 and 3 is computed, and the symmetric as amount of elastic deformation. The number of neuron of input
points 6 and 7 of points 1 and 2 are relative to point 4 in X and Y layer is the same as that of the output layer at 29. ωij and ωjk are
plane. the weights of the BP neural network.
106 C. Cheng et al. / Computers in Biology and Medicine 66 (2015) 103–112
Fig. 4. Constructing feature template: (a) vertical isoline cross point A; and (b) feature template.
Fig. 8. (a) Original and new coordinates of feature points; and (b) original and new coordinates of feature points in XY plane.
nonlinear mapping relationship between input and output. Elastic deformation prediction model predicts the amount of
Therefore, the initial weights are even-distributed empirical dec- elastic deformation, in which feature points in preoperative
imal. L–M algorithm (Levenberg–Marquardt algorithm) is chosen models move, that is Yi (i¼1, 2,…, n). The new coordinates of fea-
to update and compute for ωij and ωjk because L–M algorithm has ture points are expressed as Zi = Xi + Yi (i ¼1, 2,…, n). The feature
fast convergence speed. Nonlinear mapping between input and points in preoperative models are control points applied to
output can be realized. The training of BP neural network is shown deformation. When all control points are moved to their new
in Fig. 6. positions, all points in the point cloud data are computed using
The completely trained BP neural network is the prediction Laplacian deformation technique.
model of nonlinear facial elastic deformation and has the ability to Vertex p in the point cloud data is given as vp . The Laplacian
predict the elastic deformation of preoperative model. coordinate corresponding to vp is shown as δp . The centre point of
one ring neighbourhood of vp is expressed as
Fig. 9. (a) Preoperative model from the front; (b) preoperative model from the side; and (c) deformation model from the front; (d) deformation model from the side.
The new coordinates of all points in the facial point cloud data
can be computed by
⎡ L⎤ ⎡ δ ⎤
⎢⎣ ⎥⎦ V ′ = ⎢⎣ ⎥⎦
I W (8)
3. Results
Fig. 10. Preoperative model matches with deformation model.
Table 2
Average error rate for the different hidden layer nodes.
Number of nodes 5 10 15 20 25 30
Fig. 14. (a) Postoperative model from the front; and (b) postoperative model from the side.
C. Cheng et al. / Computers in Biology and Medicine 66 (2015) 103–112 111
deviations of all five prediction samples were less than 2 mm, as simulation, was less than 10 s, and the run time in single mode
shown in Fig. 16. was less than 3 s. Chabanas et al. [20] presented a complete
maxillofacial planning and the prediction of the new facial
appearance. The computation times ranged from 2 min to 7 min.
4.2. Efficiency analysis
The differences were not more than 2 mm. The accuracy was
similar to this study, but the method used in this study was more
The total run time for the three programs, such as constructing
efficient.
feature template, elastic deformation prediction and deformation
FEM and MTM are widely used in current facial soft tissue
simulation. When the soft tissue model is analysed, patients need
CT scans to determine the boundary conditions of the model [13].
Frequent CT scan could be very harmful to health. This research
does not require skull model but uses facial models for prediction
and simulation.
[1] A.G.H. McCollum, W.G. Evans, Facial soft tissue: the alpha and omega of
treatment planning in orthognathic surgery, Semin. Orthod. 15 (3) (2009)
196–216. Ning Dai. Gender: Male. Education background: Ph.D. The title of a technical post:
[2] K. Wermker, J. Kleinheinz, S. Jung, D. Dirksen, Soft tissue response and facial Professor. University: Nanjing University of Aeronautics and Astronautics. College:
symmetry after orthognathic surgery, J. Cranio-Maxillo-Fac. Surg. 42 (2014) College of Mechanical and Electrical Engineering.
339–345.
[3] R.M. Koch, M.H. Gross, F.R. Carls, D.F. Von Buren, G. Fankhauser, Y.I.H. Parish,
Simulating facial surgery using finite element models, In: Proceedings of
SIGGRAPH, ACM Press, 1999, pp. 421–428.
[4] E. Keeve, S. Girod, R. Kikinis, B. Girod, Deformable modeling of facial tissue for Xiaotong Jiang. Gender: Male. Education background: Ph.D. Candidate. University:
craniofacial surgery simulation, Comput. Aided Surg. 3 (5) (1998) 228–238. Nanjing University of Aeronautics and Astronautics. College: College of Mechanical
[5] M. Teschner, S. Girod, B. Girod, Direct computation of nonlinear soft-tissue and Electrical Engineering.
deformation, Proceedings of Vision, Modeling, Visualization VMV'00, 2000,
pp. 383-390.
[6] A. Sarti, R. Gori, C. Lamberti, A physically based model to simulate max-
illofacial surgery from 3D CT images, Future Gener. Comput. Syst. 15 (2) (1999)
217–222.
[7] S. Zachow, E. Gladiline, H. Hege, P. Deuflhard, Finite-element simulation of soft Yuchun Sun. Gender: Male. Education background: Ph.D. University: Peking Uni-
tissue deformation, in: International Conference on Computer Assisted, versity School and Hospital of Stomatology. Department: Research Centre of
Radiology and Surgery (CARS) & Elsevier Science B.V, 2000, pp. 23 28. Engineering and Technology for Computerised Dentistry.
[8] E. Gladilin, Biomechanical Modeling of Soft Tissue and Facial Expressions for
Craniofacial Surgery Planning, Freien University, Berlin, 2003.
[9] M. Chabanas, V. Luboz, Y. Payan, Patient specific finite element model of the
face soft tissues for computer-assisted maxillofacial surgery, Med. Image Anal.
7 (2) (2003) 131–151. Weiwei Li. Gender: Female. Education background: Master. University: Peking
[10] J.D. Smith, P.M. Thomas, W.R. Proffit, A comparison of current prediction University School and Hospital of Stomatology. Department: Research Centre of
imaging programs, Am. J. Orthod. Dentofac. Orthop. 125 (5) (2004) 527–536. Engineering and Technology for Computerised Dentistry.
[11] R.R. Cousley, E. Grant, J.D. Kindelan, The validity of computerized orthognathic
predictions, J. Orthod. 30 (2) (2003) 149–154.