Model validation is the procedure whereby the fidelity of a model is evaluated. The traditional approaches to dynamic model validation consider model outputs and observations as time series and use their similarity to assess the closeness of the model to the process. A common measure of similarity between the two time series is the cumulative magnitude of their difference, as represented by the sum of squared (or absolute) prediction error. Another important measure is the similarity of shape of the time series, but that is not readily quantifiable and is often assessed by visual inspection. This paper proposes the continuous wavelet transform as the framework for characterizing the shape attributes of time series in the time-scale domain. The feature that enables this characterization is the multiscale differential capacity of continuous wavelet transforms. According to this feature, the surfaces obtained by certain wavelet transforms represent the derivatives of the time series and, hence, can be used to quantify shape attributes, such as the slopes and slope changes of the time series at different times and scales (frequencies). Three different measures are considered in this paper to quantify these shape attributes: (i) the Euclidean distance between the wavelet coefficients of the time series pairs to denote the cumulative difference between the wavelet coefficients, (ii) the weighted Euclidean distance to discount the difference of the wavelet coefficients that do not coincide in the time-scale plane, and (iii) the cumulative difference between the markedly different wavelet coefficients of the two time series to focus the measure on the pronounced shape attributes of the time series pairs. The effectiveness of these measures is evaluated first in a model validation scenario where the true form of the process is known. The proposed measures are then implemented in validation of two models of injection molding to evaluate the conformity of shapes of the models’ pressure estimates with the shapes of pressure measurements from various locations of the mold.

1.
Oberkampf
,
W. L.
, and
Barone
,
M. F.
, 2006, “
Measures of Agreement Between Computation and Experiment: Validations Metrics
,”
J. Comput. Phys.
0021-9991,
217
, pp.
5
36
.
2.
Popper
,
K.
, 1959,
The Logic of Scientific Discovery
, Vol.
1
, 4th ed.,
Hutchinson & Co. Ltd.
,
London
, pp.
178
202
.
3.
Popper
,
K.
, 1994,
The Myth of the Framework
, Vol.
1
,
Routledge
,
New York
.
4.
Dunstan
,
W. J.
, and
Bitmead
,
R. R.
, 2003, “
Nonlinear Model Validation Using Multiple Experiments
,”
Proceedings of the 42nd IEEE Conference on Decision and Control
, Maui, HI.
5.
Akaike
,
H.
, 1974, “
A New Look at the Statistical Model Identification
,”
IEEE Trans. Autom. Control
0018-9286,
19
(
6
), pp.
716
723
.
6.
Koehler
,
A. B.
, and
Murphree
,
E. S.
, 1988, “
A Comparison of the Akaike and Schwarz Criteria for Selecting Model Order
,”
Appl. Stat.
0285-0370,
37
(
2
), pp.
187
195
.
7.
Ljung
,
L.
, 1999,
System Identification
, 2nd ed.,
Prentice-Hall
,
Englewood Cliffs, NJ
, Chap. 16.
8.
Dunstan
,
W. J.
, and
Bitmead
,
R. R.
, 2002, “
Model Confidence for Nonlinear Systems
,”
Proceedings of the 15th IFAC Triennial World Congress
, Barcelona, Spain.
9.
Cole
,
R.
,
Shasha
,
D.
, and
Zhao
,
X.
, 2005, “
Fast Window Correlations Over Uncooperative Time Series
,”
Proceedings of KDD ‘05
, Chicago, IL, Aug. 21–24.
10.
Mallat
,
S.
, and
Hwang
,
W. L.
, 1992, “
Singularity Detection and Processing With Wavelets
,”
IEEE Trans. Inf. Theory
0018-9448,
38
(
2
), pp.
617
643
.
11.
Mallat
,
S.
, 1999,
A Wavelet Tour of Signal Processing
, 2nd ed.,
Academic
,
New York
.
12.
Ljung
,
L.
, and
Glad
,
T.
, 1994, “
On Global Identifiability for Arbitrary Model Parametrizations
,”
Automatica
0005-1098,
30
(
2
), pp.
265
276
.
13.
Wang
,
L.
,
Zhang
,
Y.
, and
Feng
,
J.
, 2005, “
On the Euclidean Distance of Images
,”
IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828,
27
(
8
), pp.
1334
1339
.
14.
Danai
,
K.
, and
McCusker
,
J. R.
, 2009, “
Parameter Estimation by Parameter Signature Isolation in the Time-Scale Domain
,”
ASME J. Dyn. Syst., Meas., Control
0022-0434,
131
(
4
), p.
041008
.
15.
Carson
,
E. R.
,
Cobelli
,
C.
, and
Finkelstein
,
L.
, 1983,
The Mathematical Modeling of Metabolic and Endocrine Systems
,
Wiley
,
New York
.
16.
Bendat
,
J. S.
, and
Piersol
,
A. G.
, 2000,
Random Data Analysis and Measurement Procedures
, 3rd ed.,
Wiley Intersciences
,
New York
.
17.
Tadmor
,
Z.
, and
Gogos
,
C. G.
, 2006,
Principles of Polymer Processing
,
Wiley-Interscience
,
New York
.
18.
Chan
,
F. K.-P.
,
Fu
,
A. W.-C.
, and
Yu
,
C.
, 2003, “
Haar Wavelets for Efficient Similarity Search of Time-Series: With and Without Time Warping
,”
IEEE Trans. Knowl. Data Eng.
1041-4347,
15
(
3
), pp.
686
705
.
You do not currently have access to this content.