You are on page 1of 24

Residential Valuation Modeling Challenge:

Volunteer Modelers Report Their Findings


BY PATRICK M. O’CONNOR, ASA

This article reports the results of a project to explore the latest techniques in residential valuation
modeling. The project was initiated by the 2016 GIS/CAMA Technologies Conference Committee
with the support of the International Association of Assessing Officers (IAAO), the Urban and
Regional Information Systems Association (URISA), and NCSS, LLC. Modelers who volunteered
to participate in the project were (in alphabetical order) Paul Bidanset; James Bryan; James Ellens;
Ingi Finnsson; Brian Guerin, MRICS; Joshua Myers; Brian Newnan; Marcel Pragt; Jennifer
Rearich; James Shontz; and Will Wiggins. Patrick O’Connor, ASA, served as project organizer
and compiled the summaries published here from the participants’ final reports.

O ver the past 40 years, real estate


valuation modeling (specification
and calibration) has evolved significant-
worldwide for residential valuation
modeling. Volunteer modelers were
free to select their preferred valuation
ly. While most assessment jurisdictions techniques. Some chose standard linear
that value property to support property regression, while others experimented
assessments use traditional valuation with regression techniques that are new
approaches of cost, income, and com- to the appraisal profession. Most used
parable sales, an increasing number are some form of multiplicative regression
moving towards more supportable mar- with several participants using regres-
ket valuation techniques available from sions coupled with another statistical
statistical modeling methods. technique. The volunteers did not limit
To demonstrate the current statistical themselves to the three traditional ap-
quality and variety of valuation model proaches to value.
structures, the 2016 GIS/CAMA Tech- At the conclusion of their tests, the
nologies Conference Committee with volunteer modelers provided a report of
the support of the International As- their final model specifications, model
sociation of Assessing Officers (IAAO), calibrations, databases with final estimates
the Urban and Regional Information of value, descriptions of their valuation
Systems Association (URISA), and NCSS, process, and justifications of their model
LLC, organized a project to compare specifications and calibrations. This ar-
current practices and techniques used ticle presents a summary of their findings,

Patrick M. O’Connor, ASA, is president of O’Connor Consulting Incorporated in Plano,


Texas. He provides consulting services for computer-assisted mass appraisal (CAMA) and
automated valuation models (AVM) for residential, apartment, commercial, and industrial
properties as well as appraisal and location analysis for real estate valuations. He served as
organizer and facilitator for the Residential Valuation Modeling Challenge.

Journal of Property Tax Assessment & Administration • Volume 13, Issue 2 69


focusing on the aspects of technology, sales database. This database, which
statistical techniques, experimentation, contained 2,472 sales transfer records,
and ratio study quality statistics. had been adapted to provide a teaching
database for appraisal courses, so it did
Background and Methodology not represent the full extent of the data
Volunteer Demographics quality from the City of Bloomington As-
Eight individuals and one team of three sessor’s Office. Of the 2,472 sales records
completed this modeling project. The designated for modeling, 237 randomly
volunteers come from four countries: identified sold properties were desig-
Canada, Iceland, the Netherlands, and nated for a holdout sample. Volunteers
the United States. Seven were govern- used various means to separate modeling
ment employees, and of the four that from holdout cases.
came from the private sector, two had As in many assessors’ offices that
worked as government modelers. The adopted early computer-assisted mass
members of the one team all work for the appraisal (CAMA) systems, this database
Municipal Property Assessment Corpora- contained sets of numbers that repre-
tion (MPAC) in Ontario, Canada. sented various property characteristic
All those who chose to participate in the categorical sublevels. The Bloomington
project are considered within the field to City Assessor’s Office continues to main-
be experts in the use of statistical models. tain these numbers for use in data entry.
The median level of appraisal experience As computer storage and memory grew
among volunteer modelers is 7 years. The to handle larger pieces of information,
median level of experience in geographic this database evolved by adding property
information systems (GIS) is 3 years. This characteristic names as may be found
increasing expertise in GIS demonstrates in many newer CAMA systems. As an
the growing trend towards the expansion example, table 1 presents the original
of real estate appraisal’s body of knowl- numbers and subcategory names for
edge of this analytical specialty within exterior condition. It is possible that
cadastral mapping. Biographical informa- many newer CAMA systems also use
tion on each of the project participants is subcategory numbers as operational
presented in appendix A. variables stored in their databases but
present results using descriptive names
Modeling Tools to CAMA users. This convention helps to
accommodate the various government
Participating modelers used a vari-
jurisdictions, which may use slightly dif-
ety of statistical software. The most
ferent names for the same function such
(three) used SPSS statistical software;
as: exter wall, exterior wall, and so forth.
the lower-cost NCSS had two users; the
The project assignment was intended
free statistical software “R” was used by
only for valuation of single-family houses,
two modelers. One modeler used MRA
software. A variety of database software Table 1. Example of subcategory numbers
was used by the modelers including the and names
Netherlands WOZ software. Third-party Exterior condition
valuation software by Zillow was used to Number Name
obtain information that was missing from 1 Poor
the project database. 2 Fair
3 Average
Project Database
4 Good
The city assessor of Bloomington, Il-
linois, graciously gave the modeling 5 Very Good
project permission to use its 2011–2013 6 Excellent

70 Journal of Property Tax Assessment & Administration • Volume 13, Issue 2


but the database purposely included model’s overall specification format.
some other property classes to force the Also, regression software is considered a
modelers to filter out data that were not calibration technique, as it is the engine
relevant to the project and assignment. that analyzes sales data (crunches the
This database uses traditional property numbers).
characteristics for land and buildings.
Location in the database is provided by Modelers and Techniques
a set of residential fixed neighborhoods Some volunteers requested to test new
and x, y coordinates. The modelers used software techniques that are not cur-
several variables for location including rently in common use for appraisal
fixed neighborhoods (majority), x,y specification and calibration. This ex-
coordinates, location value response perimentation was encouraged. One
surface (LVRS), and a combination of group considered six test models. As
fixed neighborhoods and LVRS. this modeling project represents pure
Utilizing modeling techniques to ana- research, if the results met the guidelines
lyze sales and property characteristics is in the IAAO ratio studies standard (IAAO
considered a standard part of market 2013), it would be considered a win. The
analysis in real estate appraisal. Modelers following sections contain summaries,
were encouraged to use the modeling presented in alphabetical order, of each
techniques that they preferred. All participant’s modeling approach. A more
modelers started their selection process detailed description of individual models
with a modeling file of 2,235 sales re- is provided in appendix B.
cords. The final model file sizes varied
by modeler, however, because modelers Paul Bidanset
determined their filters for the data. Paul Bidanset developed three regres-
Part of the differences in modeling file sion-based models for the valuation. Two
sizes can be explained by the differ- models were locally weighted regression
ent value ranges modelers selected to (LWR) with a distance-decay weights
value in their modeling files. The upper matrix based on geographical distance.
value range spans from approximately When used for CAMA purposes, the dis-
$800,000 to over $2 million. tance-decay weights matrix allows nearby
Table 2 presents the volunteers’ last sales to have a stronger effect in estimat-
names, the size of their final sales model ing a property value than those farther
file, and their market analysis (model- away. This modeling technique, coined
ing) techniques. All modelers used some geographically weighted regression (GWR),
form of regression, which identifies their helps account for spatial autocorrelation

Table 2. Modelers and market analysis techniques


Modelers Final model file size Market analysis techniques
Bidanset 1920 Geographically weighted regression (GWR)
Finnsson 2060 Multiplicative model, regression
MPAC Team: Guerin,
Bryan, and Ellens 1971 Ordinary least squares (OLS), multiplicative model, quantile regression
Myers 2160 Cross-validation, mixed geographic-attribute weighted regression (GAWR)
Newnan 2057 OLS regression
Pragt 2121 LOESS, localized regression
Rearich 2137 Multiplicative model, regression
Shontz 1710 OLS regression
Wiggins 1727 OLS regression

Journal of Property Tax Assessment & Administration • Volume 13, Issue 2 71


of residuals by allowing coefficients to Three estimates of value were pre-
fluctuate by location for the purpose of pared for each property —one from each
reflecting local markets more accurately model. Ratio studies were conducted
than a model that applies the same coef- for each model by respective neighbor-
ficients to all properties. For example, hoods. An optimization process was
GWR can simultaneously account for the used to review these results. Whichever
positive effect of a pool in one area and model achieved the lowest coefficient of
the negative effect of a pool in another as dispersion (COD) for a particular neigh-
well as varying prices per square foot by borhood had its respective estimates
location, and even the varying effects of applied as final values to all properties
age (e.g., positive in historic areas, nega- therein. No model outperformed the
tive in areas with dilapidated conditions other two in every neighborhood, and
or out-of-date styles). each model was deemed optimal for
Paul’s first GWR model incorporated more than one neighborhood.
a Gaussian weighting kernel, while the This process created excellent results
second GWR model incorporated an in most categories. To review the over-
exponential weighting kernel (nei- all estimates of market value, figure 1
ther model included location-based presents the relationship of sale prices
variables). Paul’s third model was an to estimates of market value (FINAL_
ordinary least squares (OLS)-based ad- PRED). Use of a log function minimized
ditive regression model that included differences between sales and estimates
neighborhood indicator variables to help of market value.
account for location.

Figure 1. Comparison of sale prices to estimates of market value

72 Journal of Property Tax Assessment & Administration • Volume 13, Issue 2


Ingi Finnsson Ingi used a multiplicative model for-
Ingi Finnsson researched additional mula in an additive regression program.
data from third parties, such as Zillow Figure 3 presents the relationship of
software, to find missing year built. He sale prices to estimates of market value
used QGIS to find additional information (fitted.values).
about neighborhoods and other loca-
tional variables. Time adjustments usually MPAC Team: Brian Guerin, James
are analyzed by spline calculations, but Bryan, and James Ellens
Ingi applied a unique adjustment by A team from the Municipal Property
polynomial curve. Figure 2 presents the Assessment Corporation (MPAC) con-
second degree polynomial curve compar- ducted research on six different models
ing sale prices per square foot to date. for this project. The six models specified,
This approach provides a unique curve calibrated, and tested were
function that presents a downward curve • Additive model with fixed
in the last year of the sales data. neighborhoods calibrated us-
In the City of Bloomington, neigh- ing multiple regression analysis
borhoods are maintained on an annual (MRA) and SPSS;
basis by the city’s assessment staff, but
this modeler felt that many neighbor- • Multiplicative model with fixed
hoods were too small. He reconstructed neighborhoods calibrated using
neighborhoods for his model which were MRA and SPSS;
larger and designed around major physi- • Hybrid model with fixed neigh-
cal boundaries that he could determine borhoods calibrated using non-
from his access to GIS files. Although linear regression and SPSS;
the information was not used in his
final model, an age of sewers map Ingi • Additive model with a location
discovered on the Internet was found to value response surface calibrat-
have some explanatory ability. ed using quantile regression in
R and ArcGIS;

Figure 2. Comparison of sale prices per square foot to date

Journal of Property Tax Assessment & Administration • Volume 13, Issue 2 73


Figure 3. Comparison of sale prices to estimates of market value

• Hybrid model with location on 8,850 square feet; typical lot size in
value response surface cali- the sales dataset; and basement area. A
brated using quantile nonlinear new age variable, AGEz, was calculated as
regression in R and ArcGIS; SALEYEAR − YrBlt and was used to create
an adjusted age variable to capture non-
• Hybrid model with fixed neigh-
linearity. Variable ADJAGE was multiplied
borhoods calibrated using quan-
by total living area to produce a per-
tile nonlinear regression in R.
square-foot-per-year adjustment for age
Four models used fixed neighbor- in the model. Second-floor areas were
hoods and two models used location estimated by subtracting the first-floor
value response surface techniques from area from total living area and adding
ArcGIS software. Two models were linear any finished attic space.
(additive) model specifications, one was Linearization factors for four main
multiplicative, and three were hybrid grades (A, B, C, D) and inferior/superior
(nonlinear) model specifications. For ratings (+/− 5% and 10%) were used
calibration techniques, the team used as multipliers to adjust base rates for
basic MRA, nonlinear, and quantile living area by floor levels and finished
regression. basement to reflect differences in con-
The final specified additive model struction grade. Additional variables
included variables for separate living specified in the final additive model
areas—first story, second story, and at- included number of baths, fireplaces,
tic—adjusted by grade and superior/ pool area, poor and fair condition, porch
inferior ratings; age multiplied by living area, deck area, air-conditioning, and
area; finished basement adjusted by a linearized garage area variable by
grade; square root of lot size centered

74 Journal of Property Tax Assessment & Administration • Volume 13, Issue 2


type—attached, detached, and base- In the transition from additive to mul-
ment. Attached and detached garages tiplicative model specification, garages,
were valued using the same rate (coef- pools, porch area, baths, and fireplaces
ficient) with basement garage at 25% of were constrained to their dollar amounts
the base rate. from the additive model. Linearization
Situs variables specified included a factors for grade and inferior/superior
linearized traffic variable and binary ratings were carried forward from the
variables for lakefront, golf course, cul- additive model for inclusion in the
de-sac, and corner lot. Binary variables multiplicative model specification. Site
also were used for neighborhood. Neigh- adjustments included lake front.
borhoods were combined when less than The team’s hybrid models were speci-
five sales were available for analysis. fied in a similar manner to the additive
Some neighborhoods were combined model with separate floor rates for the
based on physical characteristics and first floor, upper floors/attic area, and
location. finished basement area adjusted for
Figure 4 presents changes in sale- construction grade. Additional features
price-to-assessment (fixed in time) included garage area, baths, fireplaces,
ratios over time. The following plot of and air–conditioning; they were defined
sale-to-assessment against sale month in the same way as in the additive models.
indicates moderate price increases Some of the MPAC team’s models are ad-
that are approximated by linear spline ditive regression. Some, however, used new
variables created at sale month periods approaches—quantile regression and loca-
0–16, 17–28, and 29–35 to determine if tion value response surfaces. These were
the rate of change is constant over the developed using sale-to-predicted-value
sales period. ratios and residuals and not sale prices.

Figure 4. Comparison of sale-price-to-assessment ratios over time

Journal of Property Tax Assessment & Administration • Volume 13, Issue 2 75


Response surface for the additive Based on the results of each model and
model was based on a sale-to-assessment available statistics, the model deemed to
ratio (SAR). Predicted values (assess- be the best for this project was the hybrid
ments) were calculated using coefficients model calibrated in R using quantile
from the model specified with fixed nonlinear regression with a location re-
neighborhoods. Neighborhoods were sponse surface developed using residuals
not included in these predicted values and kriging in ArcGIS.
(location was removed from the pre- Figure 5 presents the relationship of
diction). Resultant SARs indicated not time-adjusted sale prices (TASPRICEz)
only model error, which was assumed to estimates of market value (HYBRID_
not to be spatially correlated, but also QUANT_RSA).
locational influence. SARs were then
smoothed using ordinary kriging in Ar- Joshua Myers
cGIS and a location predication surface The models Josh Myers tested were mul-
was generated. These response surfaces tiple regression analysis (MRA) additive,
were then used to generate individual MRA multiplicative, mixed geographi-
location values for each sale in both mod- cally weighted regression (GWR), and
eling and holdout datasets. Response mixed geographic-attribute weighted
surface predictions were centered on regression (GAWR). Leave-one-out cross-
0 (prediction −1) and then used in an validation was used during the modeling
additive quantile regression for final process to gain an indication of real-
value predictions. All quantile regres- world performance without knowledge
sion models were developed in R using of the actual sale prices in the project’s
the QUANTREG package, which allows training dataset and to solve problems
for both linear and nonlinear analysis. associated with model over-fitting in the

Figure 5. Comparison of time-adjusted sale prices to estimates of market value

76 Journal of Property Tax Assessment & Administration • Volume 13, Issue 2


training dataset. Model outliers were not upper-floor living area. Many of these
eliminated from the training dataset model variables would be selected by
during the modeling process. Time ad- appraisers that use the cost approach
justments were generated by sale dates (reasonable variables).
(months) for use in the final model. Josh tested two statistical functions that
The mixed GAWR produced the best are not frequently used in mass appraisal.
statistical results and therefore was Non-cross-validation results have better
chosen as the final model calibration sales ratio quality statistics than cross-
technique. In this framework, individual valuation results, and, to be consistent
sales are weighted by both attribute simi- with the other models presented here,
larity and distance to each sale property non-cross-validation sales ratio quality
in the specification for each sale prop- statistics are reported.
erty. Final model specification for a Figure 6 presents the relationship of
mixed GAWR is in two parts: a set of coef- sale prices to estimate of market value
ficients that are fixed for all properties (model_building_non_cross_val_final).
and a set of coefficients that are spatially
varying from property to property. The Brian Newnan
model calibration process employed an After studying several model specifica-
interactive, pseudo-stepwise routine to tions and calibration techniques, Brian
add variables according to their ability Newnan chose to specify time by month
to improve the model. The final model in a linear structure based on a linear
specification used several square foot- regression calibration. In the project
ages, indicators, and count variables, database, grade is designated in two
including ground-floor living area and ways: one set uses letters with number

Figure 6. Comparison of sale prices to estimates of market value

Journal of Property Tax Assessment & Administration • Volume 13, Issue 2 77


sublevels (5 or 10) between letters, a data appraisal law. By converting the
separate set uses strictly numerical levels. initial database, Marcel was able to use
This presentation is standard for many of his existing CAMA system to analyze this
the qualitative variables in this database. database. Since not all existing neighbor-
Several qualitative variables such as grade hoods or zones had sufficient sales within
are transformed by multiplying grade its geographic area, Marcel used street
by square footage, so building square names to develop zones. In all cases, sales
footage was not a separate variable in were clustered into zones for modeling.
this model. To determine time trends, Marcel used
Neighborhoods were used for location OLS regression and LOESS (localized re-
as was standard in most of the other gression) methods that create a sine wave
model specifications in this project. trend through the data. LOESS was used
Based on sales x, y coordinates, neighbor- only because in the Netherlands, apprais-
hoods were clustered to provide at least als are made at a date in the past. Once a
200 sales per neighborhood. time trend was developed, time-adjusted
Figure 7 presents the relationship of sale prices (TASP) were used to prepare
sale prices (tasp1) to estimates of market estimates of value in three parts, ground
value (esp2_Final_Value). (plot), main property (building), and
remaining buildings, by using ordinary
Marcel Pragt least squares (linear regression).
Marcel Pragt reorganized the initial After the first regression calibration,
database by transforming it to fit in appraisers reviewed both ratios and
the Netherlands standard data format, residuals. If there was a remaining
WOZ, specified in the government tax building or a value-indicating property

Figure 7. Comparison of sale prices to estimates of market value

78 Journal of Property Tax Assessment & Administration • Volume 13, Issue 2


characteristic that the model did not be identified over time. The results are
have sufficient data to estimate, the presented in figure 9. The trend line
item was eliminated from the model. shows that sale price per square foot
Appraisers added market values for the was steady for several years before rising
remaining property characteristics into slightly and then dropping back below
the current model manually and then the starting sale price per square foot.
reappraised/re-calibrated it by using To account for time in the model, she
OLS linear regression. divided time into three sections rather
Once this process of appraising and than use time-adjusted sale price (TASP)
reappraising was completed, values were as the dependent variable in model
converted to prices per square meter for specification.
use in the finished model. The CAMA The project database was designed to
application applied these square-meter require corrections or filters of data be-
prices to all property characteristics fore model specification and calibration.
within each zone. Jennifer performed several data reviews.
Figure 8 presents the relationship of One anomaly she found was that the
sale prices to estimates of market value price per square foot mean and median
(total worth). statistics for exterior condition indicated
a higher value for good condition than
Jennifer Rearich for very good and excellent. Her findings
Jennifer Rearich used a unique adjust- are presented in table 3’s data analysis.
ment for change of value over time. The values in table 3 are not adjusted
She reviewed sale prices per square for location because they were obtained
foot to see what different trends could during a preliminary data review.

Figure 8. Comparison of sale prices to estimates of market value

Journal of Property Tax Assessment & Administration • Volume 13, Issue 2 79


Jennifer considered the possibility neighborhoods, so neighborhoods were
that there might be over-stratification grouped spatially, acknowledging com-
of grade (construction quality) and mon property characteristics as well as
compressed some 20 grade levels into geographic boundaries and landmarks.
a few grade levels to provide sufficient This grouping resulted in nine AREA
sale prices per grade level. Some square- variables that covered the assessment
footage-related areas were converted to jurisdiction. These areas created base
natural logs, while others were converted location adjustments and further strati-
to ratios of central size averages and then fication was utilized only when sufficient
converted to natural logs. neighborhood sales were significantly
Preexisting location designations higher or lower than the defined area.
did not provide sufficient sales in all Along with these areas and neighbor-

Figure 9. Comparison of sale price per square foot to sale date

Table 3. Comparison of exterior condition to sale price per square foot


EXTR_COND Mean Median Minimum Maximum Number
1.00 Poor 61.3964 57.6923 3.57 145.88 23
2.00 Fair 65.4470 62.9921 14.66 127.02 65
3.00 Average 84.0705 81.5697 9.55 160.69 225
4.00 Good 112.5692 110.0453 12.42 358.59 1508
5.00  Very Good 104.7591 103.3787 19.13 184.05 185
6.00 Excellent 108.1657 101.8519 37.70 294.25 229
Total 106.7055 104.6858 3.57 358.59 2235

80 Journal of Property Tax Assessment & Administration • Volume 13, Issue 2


hoods, distances to the central business the city center and higher-value, newer
district (CBD) and distances to highway houses are located on the periphery. In
intersections were measured for use in other cities, the pattern may be reversed
model calibration. Jennifer chose mul- with higher-value (rehabilitated or new)
tiplicative regression specification and housing closer to the center city. It may
calibration for research in this project. be difficult for some modelers/apprais-
As part of the presentation of her ers to recognize these two diametrically
model, Jennifer pointed out two com- different housing patterns.
mon conditions in northern parts of Figure 10 presents the relationship of
the United States that can affect model sale prices to estimates of market value
specification. Most residences in the (ESP Final).
northern U.S. have a heated living area,
so heating systems are assumed to exist in Jim Shontz
all habitable buildings and are not con- Based on his experience, Jim Shontz, in
sidered to contribute to variance in sale his calculation of square foot of living
prices (dependent variable) in regres- area, assigned weights to various building
sion. Sometimes, this causes difficulties areas as follows:
for appraisers when converting from
Square Foot of Living Area = (.75 ×
a cost approach to a market-oriented
Finished Basement Living Area) +
regression that may emphasize different
(1.00 × Main Floor Living Area) +
variables. The other observation relates
(0.75 × Enclosed Porch Square Foot)
to the common development pattern of
+ (0.75 × Upper Floor Living Area) +
older northern U.S. cities in which older,
(Finished Attic Living Area).
less valuable housing is clustered near

Figure 10. Comparison of sale prices to estimates of market value

Journal of Property Tax Assessment & Administration • Volume 13, Issue 2 81


He reviewed this data by neighbor- Will Wiggins
hood and then assigned neighborhoods Because some existing neighborhoods
into the appropriate model. After de- did not contain sufficient sales, Will
termining median values of property Wiggins created super-neighborhoods
characteristics by neighborhood, he cat- containing a minimum of 30 sales.
egorized each neighborhood into three Several property characteristics were
logical groupings. All neighborhoods in a used to determine similarity among
given neighborhood group were directed neighborhoods for combination into
to the same model. A summary of these super-neighborhoods.
three groups is presented in table 4. Will used time-adjusted sale prices as
Jim developed his models using Mi- his dependent variable in linear regres-
crosoft Access, Excel, and Visual Basic sion. Categorical variables sublevels
for Applications to perform statistical were converted into individual binary
analysis. The resulting data were divided variables. Additional geographic loca-
into three models as seen in table 4. All tion influence was developed from a
models were specified as additive models transformed variable of x, y coordinates
with calibration in linear regression. absolute values.
After the linear regression formula Will’s final model was a linear speci-
was applied, a second value estimate was fication with additive regression as the
developed though a comparable sales calibration. Some of the categorical
program. First, property characteristics variables in the model were converted to
were weighted and summed to determine binaries but other quality variables were
the five most comparable sales for each multiplied by square footage before be-
subject property. Second, the comparable ing used as individual sublevels variables
sales were ordered by a comparability such as qualitative variables, grade and
index. Third, the adjusted sale price for neighborhood.
each subject was determined by differenc- Figure 12 presents the relationship of
es between MRA estimates for subjects sale prices to estimates of market value
and comparable sales. Finally, estimates (ESP2).
of subject properties were determined by
averaging the adjusted sale prices of the Statistical Quality Results
middle three comparable sales. The volunteer modelers were encour-
Figure 11 presents the relationship of aged to stretch their professional comfort
sale prices to estimates of market value zones by testing new types of geographic
(MRAEst). areas, techniques, and software. Volun-

Table 4. Median values for three modeling groups


Neighborhood Group A Neighborhood Group B Neighborhood Group C
Sale price $285,000 $160,000 $113,500
Price per square foot $109 $99 $88
Year built 2002 1991 1925
Living area (weighted) 2,700 1,625 1,318
Grade B C+10 C+10
Bedrooms 4 3 2
Bathrooms 2.5 2.5 1
SPloc02 1.67 0.98 0.67
Number of neighborhoods 28 45 29
Number of sales (filtered) 481 734 495

82 Journal of Property Tax Assessment & Administration • Volume 13, Issue 2


Figure 11. Comparison of sale prices to estimates of market value

Figure 12. Comparison of sale prices to estimates of market value

Journal of Property Tax Assessment & Administration • Volume 13, Issue 2 83


teers thus had more freedom to test all achieved excellent ratio study qual-
new ideas/techniques. As evidenced ity statistics. Median sales ratios from
by the scatter plot diagrams in the fig- the modeling files were all within the
ures, modelers utilized different upper IAAO-recommended ranges (IAAO
ranges of sale price and market estimates 2013). The IAAO-recommended range
($800,000 to $2 million). Some interna- for the appraisal level is 90% to 110%.
tional volunteers used the Internet to The IAAO-recommended range for
find missing information they deemed the price-related differential (PRD) is
essential. Some used current technology, 98% to 103%. For the COD, the IAAO-
while others applied technology new to recommended range varies by property
the appraisal profession. The number class and location (see table 5). Most of
of sales records varied in modeler’s final the other quality statistics were within the
modeling and holdout files. IAAO-recommended ranges as well. The
No matter the differences in their price-related bias (PRB) for each partici-
approach, these volunteer modelers pant was within the acceptable range of

Table 5. IAAO-recommended statistical quality standards


General property class Jurisdiction size/profile/market activity COD range
Residential improved Very large jurisdictions/densely populated/newer properties/active markets 5.0 to 10.0
(single-family dwellings, Large to mid-sized jurisdictions/older and newer properties/less active 5.0 to 15.0
condominiums, markets
manufactured housing, Rural or small jurisdictions/older properties/depressed market areas 5.0 to 20.0
2-4 family units)
Income-producing Very large jurisdictions/densely populated/newer properties/active markets 5.0 to 15.0
properties (commercial, Large to mid-sized jurisdictions/older and newer properties/less active 5.0 to 20.0
industrial, apartments) markets
Rural or small jurisdictions/older properties/depressed market areas 5.0 to 25.0
Residential vacant land Very large jurisdictions/rapid development/active markets 5.0 to 15.0
Large to mid-sized jurisdictions/slower development/less active markets 5.0 to 20.0
Rural or small jurisdictions/little development/depressed markets 5.0 to 25.0
Other (nonagricultural) Very large jurisdictions/rapid development/active markets 5.0 to 20.0
vacant land Large to mid-sized jurisdictions/slower development/less active markets 5.0 to 25.0
Rural or small jurisdictions/little development/depressed markets 5.0 to 30.0
Source: IAAO (2013)
Notes:
These types of property are provided for general guidance only and may not represent jurisdictional
requirements.
The coefficient of dispersion (COD) performance recommendations are based upon representative
and adequate sample sizes, with outliers trimmed and a 95% level of confidence.
Appraisal level recommendation for each type of property shown should be between 0.90 and 1.10.
The price-related differential (PRD) for each type of property should be between 0.98 and 1.03 to
demonstrate vertical equity. However, PRD standards are not absolute and may be less meaningful
when samples are small or when wide variation in prices exist. In such cases, statistical tests of
vertical equity hypotheses should be substituted.
Alternatively, assessing officials can rely on the price-related bias (PRB), which is less sensitive to
atypical prices and ratios. PRB coefficients should generally fall between −0.05 and 0.05. PRBs that
are statistically significant and less than −0.10 or greater than 0.10 indicate unacceptable vertical
inequities.
CODs lower than 5.0 may indicate sales chasing or non-representative samples.

84 Journal of Property Tax Assessment & Administration • Volume 13, Issue 2


−0.10 to +0.10; the recommended range All volunteers used some form of regres-
is −0.05 to +0.05. Results for holdout sion in their modeling process; many used
samples were similar to the training/ the more complex form of multiplicative
modeling sample results. regression. Each modeler used different
Each modeler’s quality results are approaches to data analysis and market
presented in table 6. These statistics analysis. These presentations indicate the
were either prepared or confirmed by following were the modelers’ focus:
this author as project coordinator using • Highlights of data and market
the same statistical software. analysis procedures;
The presentation of participants’
quality statistics should provide a clear • Scatter plot graphs that showed
indication of the high quality of research the relationship of sale prices to
performed by these volunteers. These volunteer’s estimates of market
statistics, however, should not be used to value;
choose winners and losers of this model- • Tables and figures showing the
ing challenge, but rather to see the overall reasons for selecting various ad-
quality of the results obtained by this very justment processes, if applicable;
diverse set of volunteer modelers.
• How building square footage
was transformed with more than
Conclusions
one variable in some models so
This residential modeling research that building square footage
project was designed to show the cur- would not be a significant stand-
rent technical level of the mass appraisal alone variable.
profession. While it accomplished this
goal, a more important goal has been Insights gained from the residential
achieved—highlighting the skill levels modeling challenge can be summarized
of participating modelers. Some expe- as follows:
rienced modelers had the opportunity • Volunteers demonstrated that
to test new software programs and tech- modelers are trained to exam-
niques. Some modelers with limited ine data and perform market
experience outside their assessment analysis without making prede-
jurisdictions, states/provinces, and na- termined assumptions;
tions were able to work with a completely • Mass appraisal modelers can
different residential real estate database study existing data to develop
and develop good ratio quality statistics. local geographic knowledge;

Table 6. Ratio quality statistics by modeler

Price-related Coefficient of
Volunteers Sales counts Median differential (PRD) dispersion (COD)
Bidanset 1920 0.998 1.011 7.1
Finnsson 2060 1.005 1.013 8.7
MPAC Team: Guerin, Bryan, and Ellens 1971 0.999 1.011 7.0
Myers 2160 1.001 1.020 8.0
Newnan 1873 1.000 1.014 9.1
Pragt 2121 0.996 1.048 15.5
Rearich 2137 0.996 1.019 9.9
Shontz 1710 1.006 1.017 9.3
Wiggins 1727 1.001 1.036 12.2

Journal of Property Tax Assessment & Administration • Volume 13, Issue 2 85


• Experimentation with newer differences of a few points given the wide
statistical techniques showed range of sale prices and the experimen-
their potential for the appraisal tation with new modeling techniques.
profession; The efforts of all the volunteers have
provided an excellent service to the ap-
• Various techniques can be em-
praisal profession.
ployed to develop statistically
The single most used statistical soft-
significant neighborhoods;
ware in this project was IBM-SPSS.
• Time adjustments can be suc- Together, the lower-cost NCSS and free
cessfully applied using various R statistical software systems were used
techniques; by more participants than SPSS. In the
future, free or low-cost statistical software
• When an anomaly was found in
may become more prevalent in the mass
the database, several ideas were
appraisal profession.
offered on what steps could be
Each volunteer submitted documen-
taken to ameliorate its effect
tation of the models created for the
on the model. Even with all the
project, including model specification
experimentation and pushing
and calibration. As the project organizer,
the limits of current techniques,
I wish to thank all these volunteers for
ratio studies presented good
their hard work and devotion in com-
quality statistics that were mostly
pleting their individual projects and for
within the recommendations
providing sufficient explanations of their
of the Standard on Ratio Studies
models which allowed me to review the
(IAAO 2013).
models and advanced the knowledge of
All volunteers were able to adjust to the appraisal profession.
an unfamiliar database that retained an
older numbering system for categorical
Reference
sub-variables. While the volunteers all
started with the same number of sales IAAO. 2013. Standard on Ratio Studies.
records and a designated number of Kansas, City, MO: International Associa-
randomly identified sold properties for tion of Assessing Officers.
a holdout file, volunteers went on to
use various means to separate model- Additional Sources
ing from holdout cases. This approach Duany, A., E. Plater-Zyberk, and J. Speck.
led to the variety of sales counts in each 2010. Suburban Nation: The Rise of Sprawl
modeler’s final modeling file shown in and the Decline of the American Dream. New
tables 2 and 6. York: North Point Press.
The different size modeling files also
Fotheringham, A.S., C. Brunsdon, and
may be due in part to the value ranges
M. Charlton. 2003. Geographically Weight-
that each modeler attempted to value.
ed Regression: The Analysis of Spatially
As shown in the scatter plot diagrams,
Varying Relationships. Chichester, West
the modelers’ upper value ranged from
Sussex, England: John Wiley & Sons.
nearly $800,000 to over $2 million. This
wide range of values may have an effect Lynch, K. 1960. The Image of the City.
on the quality statistics in the ratio stud- Cambridge, MA: MIT Press.
ies. Therefore, the quality of the models
should not be compared based on small

86 Journal of Property Tax Assessment & Administration • Volume 13, Issue 2


Appendix A. Modeler Biographies
Paul Bidanset Joshua Myers
Paul Bidanset entered the mass appraisal Josh Myers is a U.S.-based statistician
profession in 2012. He is Real Estate and modeler working in the field of
CAMA Modeler for the Office of the mass appraisal. He specializes in spatial
Real Estate Assessor in Norfolk, Virginia, regression modeling, including models
United States. He is a doctoral candidate utilizing geographic-attribute weighted
in the School of the Built Environment at regression. Josh has his own statistical
Ulster University, Northern Ireland. He consulting company, Josh Myers Valua-
is completing his dissertation under the tion Solutions. Josh holds a masters in
supervision of Drs. Peadar Davis, Michael statistics from University of Virginia.
McCord, and William McCluskey.
Brian Newnan
Ingi Finnsson Brian Newnan was formerly senior
Ingi Finnsson is the Director of Valua- appraiser at Travis Central Appraisal
tion and Economics at Registers Iceland, District (CAD) in Austin, Texas, United
where he has been working as a CAMA States. He retired in 2014. While at Travis
modeler since 2008. Registers Iceland CAD, he modeled single-family dwellings
uses regression models for residential for 5 years using MRA, both additive
and commercial real estate valuations and multiplicative. He also has mod-
and is developing them for other prop- eled other large metropolitan districts
erty types. Ingi holds a master’s degree in Texas including Dallas CAD (Dallas)
in industrial engineering from the Uni- and Tarrant CAD (Fort Worth).
versity of Iceland.
Marcel Pragt
MPAC Team Marcel Pragt is a director at The Peb-
Brian Guerin, MRICS bles Group Local Government in the
Brian Guerin is Director, Assessment Netherlands. Marcel has many years of
Standards and Mass Appraisal, with the experience as an information analyst and
Municipal Property Assessment Corpora- has helped many companies with the
tion (MPAC) in Ontario, Canada. Since introduction of information technology.
1999, he has been responsible for develop- He has been responsible for technical
ment of all mass appraisal analytics used management and maintenance of The
in valuation of all property types including Pebbles Group’s software and infrastruc-
eight province-wide assessment updates. ture for many years. He holds bachelor’s
degrees in architecture, informatics, and
James Bryan business administration.
James Bryan is an MPAC mass appraisal
specialist with 5 years’ experience devel- Jennifer Rearich
oping mass appraisal models for valuing Jennifer Rearich joined Maricopa Coun-
residential properties in Ontario. James ty Assessor’s Office (Phoenix, Arizona,
has extensive experience working with United States) in January 2012. She
a variety of statistical software packages spent a year as a residential appraiser
and GIS programs. before becoming a CAMA regression
modeler. She holds a bachelor of sci-
James Ellens ence in planning from Arizona State
James Ellens is an MPAC mass appraisal University and a master of philosophy
specialist with 9 years’ experience in mass in planning, growth, and regeneration
appraisal analytics specializing in research, from the University of Cambridge in the
statistics, automated valuation models, and United Kingdom.
CAMA software system development.

Journal of Property Tax Assessment & Administration • Volume 13, Issue 2 87


Appendix A. Modeler Biographies (continued)
Jim Shontz mercial appraiser. He was promoted
Jim Shontz gained his valuation expe- to Analyst Manager with responsibility
rience in Kansas where the preferred for the residential analyst team. Their
valuation methodology for residential responsibilities included CAMA software
property is the comparable sales ap- enhancements, database mining/scrub-
proach. He currently is CAMA Manager bing, data quality control, economic area
for the Kansas Department of Revenue development, market segmentation,
Property Valuation Division. His respon- linear and multiple regression, and cho-
sibilities include overseeing training and ropleth mapping using ESRI and ArcGIS
support of CAMA applications the office software. He subsequently was promoted
provides throughout the state. to Assistant Director of Real Property
Appraisal. In 2012, he joined North
Will Wiggins Texas Property Tax Services, Dallas, as a
senior property tax consultant. He holds
Will Wiggins obtained his modeling
a bachelor of science degree in finance
exposure at the Travis Central Appraisal
and a certification in real estate from
District in Austin, Texas, United States.
the University of Wyoming in Laramie.
He joined the office in 2010 as a com-

88 Journal of Property Tax Assessment & Administration • Volume 13, Issue 2


Appendix B. Participant’s Models
These models are condensed versions. They present model specification without calibration.

Paul Bidanset
Multiplicative Regression Model with Ordinary Least Squares (Additive Regression)
This model used the following variables:
Dependent: lnSALEPRICE (natural log)
Independent: TOTAL_SF, lnAGE (natural log), SH_LOT_SF, GAR_SF, EXTR_COND (dummy variable), BASEMENT (dummy
variable), FIN_BS_SF, EXTR_WALLS (dummy variable), GRADE_NAME (dummy variable), RM6 (three-month reverse month
of sale spline variable), RM24 (three-month reverse month of sale spline variable), PORCH_STYLE (dummy variable),
Lake_Front (dummy variable), Golfcourse (dummy variable), NH (dummy variables for each neighborhood)

Geographically Weighted Regression


Geographically weighted regression used an adaptive bandwidth with both exponential (wgt = exp(−vdist/bw)) and Gaussian
(wgt = exp(−.5×(vdist/bw)^2)) kernels with the following variables:
Dependent: lnSalePrice
Independent: TOTAL_SF, lnAge, SH_LOT_SF, GAR_SF, FIN_BS_SF, RM6, RM24, GRADE
Results were disaggregated to the neighborhood level and a ratio study was conducted for the following three models:
1. Global (ordinary least squares)
2. Geographically weighted regression (adaptive bandwidth—exponential kernel)
3. Geographically weighted regression (adaptive bandwidth—Gaussian kernel).
Values for each neighborhood were selected based on model with optimal COD. Neighborhood values from respective “optimal
models” were compiled and a ratio study calculated for the entire sample.

Ingi Finnsson
Multiplicative Regression Model with Ordinary Least Squares (Additive Regression)
This model used the following variables:
ln(formula = ln.p1 ~ ln.livarea + ln.garage + ln.porch) + GRADE + age25 + age80.plus + NH.2 + NH.16 + NH.32 +
NH.33 + NH.35 + NH.36 + NH.41 + NH.43 + NH.44 + NH.48 + NH.49 + NH.58 + NH.62 + NH.63 + NH.71 + NH.72 +
NH.73 + NH.82 + NH.84 + NH.85 + NH.95 + NH.98 + NH.104 + NH.108 + NH.110 + is.lakef + f.por5_6 + BATH_COEF
+ Lotsf_adj_11 + EXTR_COND.1 + EXTR_COND.2 + EXTR_COND.3 + Story_Type.1 + Story_Type.2 + Story_Type.3
+ Story_Type.4 + Story_Type.5 + Story_Type.7 + Story_Type.11 + Story_Type.13 + street.1 + street.2 + street.3 +
street.5 + street.6 + street.7 + street.8 + street.10 + FLAG.3 + FLAG.5 + PER_AC.100 + Z1 + Streets.1 + Streets.6 +
series + summer + january
Notes:
1. Ln.pl is time adjustment; NH is neighborhoods.
2. Binary variables are is.lakef, f.por5_6, PER_AC.100, Z1 (zoning), summer, and january.
3. The first portion of the model is converted to log-linear terms and the rest of the model is linear.

MPAC Team: Brian Guerin, James Bryan, and James Ellens


Additive Model with Fixed Neighborhoods
In this model specification, neighborhoods (NB#) are binary variables.
(Constant) + QS_AREA1 + QS_AREA2UA + ADJAGESF + QS_FINBSMT + NB105 + NB21 + GARAGESF + NB85 + NB49 +
Lake_Front + NB91 + NB101 + NB73 + NB110 + NO_FP + NB98 + BSMTAREA + NB18 + NB88 + NB71 + NB58 + NB93
+ LOTSF8850 + BATH_COEF + POOL_SF + NB75 + NB10 + NB40 + NB48 + NB61 + PORCH_SF + NB65 + NB38 + NB104
+ NB36 + NB41 + TRAFFIC + NB5 + NB37 + NB108 + NB79 + NB28 + NB62 + NB66 + NB11 + NB12

Journal of Property Tax Assessment & Administration • Volume 13, Issue 2 89


Appendix B. Participant’s Models (continued)
Multiplicative Model with Fixed Neighborhoods
In this model specification, LN represents natural log of the variable (multiplicative regression).
(Constant) + LN_AREA + LN_PERGOOD + LN_QU_FACT + FINBSMT + NB21 + BSMT + NB49 + NB85 + NB105 + NB101
+ NB91 + NB73 + NB110 + NB18 + NB40 + NB36 + Lake_Front + NB98 + NB58 + LANDTOBLDG + NB71 +NB88 +
NB93 + NB38 + NB41 + LN_TRAFFIC + NB5 + S_15STY + NB65 + NB10 + NB104 + ATTIC + NB75 + NB48 + NB61 +
NB108 + NB79 + NB66 + S_TRILEVEL + NB35 + NB37 + NB34 + NB28 + NB12 + NB14 + NB2 + NB62 + NB31 + NB43
+ NB16 + NB32 + NB69 + NB1 + NB3 + NB4 + NB6 + NB7 + NB8 + NB9 + NB11 + NB20 + NB22 + NB23 + NB26 +
NB42 + NB44 + NB45 + NB47 + NB50 + NB52 + NB53 + NB54 + NB56 + NB57 + NB60 + NB64 + NB76 + NB78 + NB80
+ NB81 + NB82 + NB83 + NB84

Hybrid Model with Fixed Neighborhoods


FLOOR_1R + FLOOR_2R + FINBSMT_R + BSMT_R + PGOOD + GRADEEXP + LANDEXP + GARAGE_R + POOL_R + NH1_R
+ NH2_R + NH3_R + NH4_R + NH5_R + NH6_R + NH7_R + NH8_R + NH9_R + NH10_R + NH11_R + NH12_R +
NH14_R + NH16_R + NH18_R + NH20_R + NH21_R + NH22_R + NH23_R + NH26_R + NH28_R + NH31_R + NH32_R
+ NH34_R + NH35_R + NH36_R + NH37_R + NH38_R + NH40_R + NH41_R + NH42_R + NH43_R + NH44_R +
NH45_R + NH47_R + NH48_R + NH49_R + NH50_R + NH52_R + NH53_R + NH54_R + NH55_R + NH56_R + NH57_R
+ NH58_R + NH60_R + NH61_R + NH62_R + NH64_R + NH65_R + NH66_R + NH69_R + NH71_R + NH73_R +
NH75_R + NH76_R + NH78_R + NH79_R + NH80_R + NH81_R + NH82_R + NH83_R + NH84_R + NH85_R + NH88_R
+ NH89_R + NH91_R + NH93_R + NH95_R + NH97_R + NH98_R + NH99_R + NH101_R + NH104_R + NH105_R +
NH108_R + NH110_R + NH111_R + FP_R + BATH_R + PORCH_R + AC_R + LAKE_PCT + TRAF_ART

Additive Quantile with Location Value Response Surface


INTERCEPT+ QS_AREA1 + QS_AREA2UA + ADJAGESF + LOTSF8850 + PORCH_SF + POOL_SF + QS_FINBSMT +
GARAGESF + BSMTAREA + Lake_Front + BATH_COEF + NO_FP

Hybrid Quantile with Location Value Response Surface


(FLOOR_1R × GFLA + FLOOR_2R × (AREA2U + SF_FIN_ATT) + FINBSMT_R × FIN_BS_SF) × (PERGOOD)^PGOOD ×
((GRADE_FACT × SUP_FACT)^GRADEEXP) + POOL_R × POOL_SF + GARAGE_R × GARAGESF + BSMT_R × BSMTAREA
+ FP_R × NO_FP + BATH_R × BATH_COEF + PORCH_R × PORCH_SF + AC_R × AIRCOND + (69040.49 + Predicted) ×
((SH_LOT_SF/8850)^LANDEXP) × LAKE_PCT^Lake_Front × TRAF_ART^T_ARTERIAL

Hybrid Quantile with Fixed Neighborhoods


(FLOOR_1R × GFLA + FLOOR_2R × (AREA2U + SF_FIN_ATT) + FINBSMT_R × FIN_BS_SF) × (PERGOOD)^PGOOD ×
((GRADE_FACT × SUP_FACT)^GRADEEXP) + POOL_R × POOL_SF + GARAGE_R × GARAGESF + BSMT_R × BSMTAREA +
FP_R × NO_FP + BATH_R × BATH_COEF + PORCH_R × PORCH_SF + AC_R × AIRCOND + (NH1_R^NB1 + NH2_R^NB2
+ NH3_R^NB3 + NH4_R^NB4 + NH5_R^NB5 + NH6_R^NB6 + H7_R^NB7 + NH8_R^NB8 + NH9_R^NB9 +
NH10_R^NB10 + NH11_R^NB11 + NH12_R^NB12 + NH14_R^NB14 + NH16_R^NB16 + NH18_R^NB18 +
NH20_R^NB20 + NH21_R^NB21 + NH22_R^NB22 + NH23_R^NB23 + NH26_R^NB26 + NH28_R^NB28 +
NH31_R^NB31 + NH32_R^NB32 + NH34_R^NB34 + NH35_R^NB35 + NH36_R^NB36 + NH37_R^NB37 +
NH38_R^NB38 + NH40_R^NB40 + NH41_R^NB41 + NH42_R^NB42 + NH43_R^NB43 + NH44_R^NB44 +
NH45_R^NB45 + NH47_R^NB47 + NH48_R^NB48 + NH49_R^NB49 + NH50_R^NB50 + NH52_R^NB52 +
NH53_R^NB53 +
NH54_R^NB54 + NH55_R^NB55 + NH56_R^NB56 + NH57_R^NB57 + NH58_R^NB58 + NH60_R^NB60 +
NH61_R^NB61 + NH62_R^NB62 + NH64_R^NB64 + NH65_R^NB65 + NH66_R^NB66 + NH69_R^NB69 +
NH71_R^NB71 + NH73_R^NB73 + NH75_R^NB75 + NH76_R^NB76 + NH78_R^NB78 + NH79_R^NB79 +
NH80_R^NB80 + NH81_R^NB81 + NH82_R^NB82 + NH83_R^NB83 + NH84_R^NB84 + NH85_R^NB85 +
NH88_R^NB88 + NH89_R^NB89 + NH91_R^NB91 + NH93_R^NB93 + NH95_R^NB95 + NH97_R^NB97 +
NH98_R^NB98 + NH99_R^NB99 + NH101_R^NB101 + NH104_R^NB104 + NH105_R^NB105 + NH108_R^NB108 +
NH110_R^NB110 + NH111_R^NB111) × ((SH_LOT_SF/8850)^LANDEXP) × LAKE_PCT^Lake_Front × T
RAF_ART^T_ARTERIAL

90 Journal of Property Tax Assessment & Administration • Volume 13, Issue 2


Joshua Myers
Geographically Weighted Regression
Fixed coefficients: finished basement square feet + pool square feet + garage count + lake indicator variable + finished attic
indicator variable + number of fireplaces + month of sale + slab square feet + number of bedrooms + basement unfinished
square feet + masonry exterior wall indicator variable + busy street indicator variable + corner lot indicator variable
Spatially varying coefficients: intercept + ground floor living area + upper floor living area + grade + age + age squared

Brian Newnan
Additive Regression with Several Combined Terms—Use, Size, and Qualitative Variables
Constant + AGE + BATHSZ + BS_TYPE1 + BS_TYPE2 + BS_TYPE3 + ECON6 + EWALL7 +FIRPLZ + FOUND1 + GARSPZ +
L_DEPTH + L_LOC3 + LAKE + NBSQ10 + NBSQ101 + NBSQ103 + NBSQ104 + NBSQ105 + NBSQ110 + NBSQ18 + NBSQ21
+ NBSQ29 + NBSQ3 + NBSQ38 + NBSQ40 + NBSQ48 + NBSQ49 + NBSQ52 + NBSQ58 + NBSQ61 + NBSQ65 + NBSQ69
+ NBSQ71 + NBSQ73 + NBSQ75 + NBSQ79 + NBSQ82 + NBSQ83 + NBSQ85 + NBSQ86 + NBSQ88 + NBSQ91 + NBSQ92
+ NBSQ93 + NBSQ96 + NBSQ98 + POOL3 + PORCH4 + PORCHZ + ROOF1 + SFGRAD10 + SFGRAD12 + SFGRAD13 +
SFGRAD14 + SFGRAD15 + SFGRAD16 + SFGRAD17 + SFGRAD18 + SFGRAD19 + SFGRAD20 + SFGRAD3 + SFGRAD4 +
SFGRAD5 + SFGRAD7 + SFGRAD8 + SFGRAD9 + STORY10 + STORY11 + STORY5

Marcel Pragt
Data in English are converted to the Dutch standard WOZ data model. The WOZ model uses the Dutch prescribed standard model,
which uses less data, so Marcel could not use some of the data provided. Time trends are established within the provided transac-
tions based on the LOESS (localized regression) method.
The data initially are divided into zones (neighborhoods). These zones are classified again into parent zones because there
were too few transactions in the zone (A to Z). The software then estimates values in three parts: the main property (building),
the ground (plot), and the remaining buildings.
In the first step, estimated values are statistically calculated using the ordinary least squares method. The Dutch try to establish
a correct value with sales ratios between 0.95 and 1.05 with minimal distribution. The next step relates other features, such as
swimming pools, to market value through comparison of estimates of value to sale prices. These differences are analyzed and placed
in a remaining building model. When this is finished, reappraising is done, and the steps are repeated until the correct ratios remain.
The final step is to convert the analytically calculated estimated value to a separate scaled model for the main building and plot.
Ordinary Least Squares Model
Constant + UnitsTypeG + UnitsTypeGCorr + UnitsTypeGLog + UnitsTypeP + UnitsTypePCorr + UnitsTypePLog +
PositionIndicator_2 + PositionIndicator_4 + PositionIndicator_5 + ObjectClass_01 + ObjectClass_02 + ObjectClass_03
+ ObjectClass_04 + ObjectClass_05 + ObjectClass_06 + ObjectClass_07 + ObjectClass_08 + ObjectClass_09 +
ObjectClass_10 + ObjectClass_11 + ObjectClass_12 + Age + Age2 + ValueArea1_A + ValueArea1_AA + ValueArea1_B
+ ValueArea1_C + ValueArea1_D + ValueArea1_E + ValueArea1_F + ValueArea1_H + ValueArea1_I + ValueArea1_J +
ValueArea1_K + ValueArea1_M + ValueArea1_N + ValueArea1_O + ValueArea1_P + ValueArea1_Q + ValueArea1_R
+ ValueArea1_S + ValueArea1_T + ValueArea1_U + ValueArea1_V + ValueArea1_W + ValueArea1_X + ValueArea1_Y
+ ValueArea1_Z + ValueArea2_1 + ValueArea2_102 + ValueArea2_103 + ValueArea2_104 + ValueArea2_107
+ ValueArea2_109 + ValueArea2_11 + ValueArea2_12 + ValueArea2_13 + ValueArea2_14 + ValueArea2_15
+ ValueArea2_16 + ValueArea2_17 + ValueArea2_18 + ValueArea2_19 + ValueArea2_2 + ValueArea2_20 +
ValueArea2_21 + ValueArea2_22 + ValueArea2_23 + ValueArea2_24 + ValueArea2_25 + ValueArea2_26 +
ValueArea2_28 + ValueArea2_3 + ValueArea2_30 + ValueArea2_31 + ValueArea2_32 + ValueArea2_34 +
ValueArea2_35 + ValueArea2_36 + ValueArea2_37 + ValueArea2_38 + ValueArea2_39 + ValueArea2_4 +
ValueArea2_42 + ValueArea2_43 + ValueArea2_44 + ValueArea2_45 + ValueArea2_46 + ValueArea2_47 +
ValueArea2_48 + ValueArea2_49 + ValueArea2_5 + ValueArea2_50 + ValueArea2_51 + ValueArea2_52 +
ValueArea2_53 + ValueArea2_54 + ValueArea2_55 + ValueArea2_56 + ValueArea2_57 + ValueArea2_58 +
ValueArea2_60 + ValueArea2_61 + ValueArea2_62 + ValueArea2_63 + ValueArea2_64 + ValueArea2_65 +
ValueArea2_67 + ValueArea2_68 + ValueArea2_7 + ValueArea2_70 + ValueArea2_72 + ValueArea2_74 +
ValueArea2_75 + ValueArea2_77 + ValueArea2_78 + ValueArea2_79 + ValueArea2_8 + ValueArea2_80 +

Journal of Property Tax Assessment & Administration • Volume 13, Issue 2 91


Appendix B. Participant’s Models (continued)
ValueArea2_83 + ValueArea2_84 + ValueArea2_85 + ValueArea2_86 + ValueArea2_88 + ValueArea2_89 +
ValueArea2_9 + ValueArea2_90 + ValueArea2_91 + ValueArea2_92 + ValueArea2_93 + ValueArea2_94 +
ValueArea2_95 + ValueArea2_96 + ValueArea2_97 + ValueArea2_98

Jennifer Rearich
Multiplicative Regression Model with Ordinary Least Squares (Additive Regression)
Constant + MONTHS1 + MONTHS2 + MONTHS3 + LN_SQFT + LN_UPPERSQFT_RATIO + LN_FINISHED_BASEMENT_RATIO
+ LN_LANDRATIO + LN_GAR_ALL_RATIO + LINBATH + FND_BRKCONCBLK + ROOF_ROLL + WALL_WOOD +
WALL_STUCCO + WALL_BRKFR2 + WALL_ASPHLT + GRD_D + GRD_CPLS + GRD_BMIN + GRD_B + GRD_BPLS + GRD_
AMIN + GRD_A + GRD_APLS + COND_POOR + LN_LIN_PORCH_RATIO + LN_POOL_SF_RATIO + NO_AC +
LN_PCTGOOD_SQRT + ADJ_FIREPLACE + LAKE_ADJ + GOLF_ADJ + LOC_COR + STREET_CITYART + STREET_PRIVATE +
AREA3 + AREA4 + AREA10 + A1_NH60NEW + A1_NH95X + A2_NH43X + A2_NH51 + A2_NH104 + A3_NH6 + A3_NH9
+ A3_NH55 + A3_NH68 + A3_NH78 + A3_NH80 + A3_NH93 + A3_NH96 + A3_NH103 + A5_NH1 + A5_NH2 +
A5_NH5 + A5_NH45X + A5_NH47X + A5_NH85 + A5_NH91 + A5_NH98 + A5_NH101 + A5_NH105 + A7_NH36 +
A7_NH37X + A7_NH38 + A7_NH50 + A8_NH11 + A8_NH12 + A8_NH13 + A8_NH14 + A8_NH18X + A8_NH58 +
A8_NH86 + A9_NH20 + A9_NH21 + A9_NH23 + A9_NH24 + A9_NH25X + A9_NH31 + A9_NH34 + A10_NH40 +
A10_NH40RR

Jim Shontz
Additive Models with Linear Regression
Neighborhood Group A
Intercept + Age_SFLA_GF + AttGarSF_GF + Baths3_SFLA_GF + BelowGradeSFLA_GF + DS_SFLA_GF + Lake_SFLA_GF
+ LotSF_SPlocAdj + MainLevelSFLA_GF + SFLA_Gfnorm + UpperLevelSFLA_GF

Neighborhood Group B
Intercept + Age_SFLA_GF + AttGarSF_GF + Baths2_SFLA_GF + BelowGradeSFLA_GF + BsmtGarSF_GF + DeckSF_GF +
DetGarSF_GF + DS_SFLA_GF + Golf_SFLA_GF + Lake_SFLA_GF + LotSF_SPlocAdj + MainLevelSFLA_GF +
SFLAnoAC_GF + SFLA_Gfnorm + UnfinBsmtSF_GF + UpperLevelSFLA_GF

Neighborhood Group C
Intercept + Age_SFLA_GF + AttGarSF_GF + Baths2_SFLA_GF + DeckSF_GF + DetGarSF_GF + DS_SFLA_GF +
LotSF_SPlocAdj + NoBsmtSF_GF + NoGarSFLA_GF + SFLAnoAC

Will Wiggins
Additive Models with Linear Regression
Constant + BATH_COEF + BTHQ14 + BTHQ16 + BTHQ19 + BTHQ3 + GAR_SF + GAR4 NO_FP + POOL3 + PRCHST4 +
PRCHST6 + EXTCON2 + EXTWAL2 + ECOB1 + FNCOB1 + STRTYP5 + ROOF3 + BSMT1 + BSMT4 + BSMT8 + FIN_BS_SF
+ TOTAL_SF + SF_CRAWL + GRADE + GRD15SF + GRD17SF + GRD18 + GRD19SF + GRD20SF + NH + NH10 + NH101 +
NH102 + NH103 + NH104 + NH12SF + NH14 + NH18SF + NH21SF + NH26SF + NH28SF + NH38 + NH41 + NH42SF +
NH49 + NH5 + NH50SF + NH54SF + NH71 + NH73SF + NH75 + NH85 + NH86SF + NH88 + NH89 + NH92 + NH95 +
NH96 + NH97 + NH9SF + SNSF15 + SNSF17 + SNSF2 + SNSF20 + SNSF21 + SNSF3 + SNSF7 + PSFLOC02 + Lake_Front
+ SPLOC02 + STREET3 + VALDIS3 + ZONE1 + ZONE13 + ZONE2

92 Journal of Property Tax Assessment & Administration • Volume 13, Issue 2

You might also like