You are on page 1of 618

Version12

Design of Experiments
Guide
Therealvoyageofdiscoveryconsistsnotinseekingnew
landscapes,butinhavingneweyes.
MarcelProust

JMP,ABusinessUnitofSAS
SASCampusDrive
Cary,NC27513

12.1

Thecorrectbibliographiccitationforthismanualisasfollows:SASInstituteInc.2015.
JMP12DesignofExperimentsGuide.Cary,NC:SASInstituteInc.
JMP12DesignofExperimentsGuide
Copyright2015,SASInstituteInc.,Cary,NC,USA
ISBN9781629594422(Hardcopy)
ISBN9781629594446(EPUB)
ISBN9781629594453(MOBI)
ISBN9781629594439(PDF)
Allrightsreserved.ProducedintheUnitedStatesofAmerica.
For a hard-copy book:Nopartofthispublicationmaybereproduced,storedinaretrieval
system,ortransmitted,inanyformorbyanymeans,electronic,mechanical,photocopying,
orotherwise,withoutthepriorwrittenpermissionofthepublisher,SASInstituteInc.
For a web download or e-book:Youruseofthispublicationshallbegovernedbytheterms

establishedbythevendoratthetimeyouacquirethispublication.
Thescanning,uploading,anddistributionofthisbookviatheInternetoranyothermeans
withoutthepermissionofthepublisherisillegalandpunishablebylaw.Pleasepurchase
onlyauthorizedelectroniceditionsanddonotparticipateinorencourageelectronicpiracy
ofcopyrightedmaterials.Yoursupportofothersrightsisappreciated.
U.S. Government License Rights; Restricted Rights:TheSoftwareanditsdocumentationis

commercialcomputersoftwaredevelopedatprivateexpenseandisprovidedwith
RESTRICTEDRIGHTStotheUnitedStatesGovernment.Use,duplicationordisclosureof
theSoftwarebytheUnitedStatesGovernmentissubjecttothelicensetermsofthis
Agreementpursuantto,asapplicable,FAR12.212,DFAR227.72021(a),DFAR227.72023(a)
andDFAR227.72024and,totheextentrequiredunderU.S.federallaw,theminimum
restrictedrightsassetoutinFAR52.22719(DEC2007).IfFAR52.22719isapplicable,this
provisionservesasnoticeunderclause(c)thereofandnoothernoticeisrequiredtobe
affixedtotheSoftwareordocumentation.TheGovernmentsrightsinSoftwareand
documentationshallbeonlythosesetforthinthisAgreement.
SASInstituteInc.,SASCampusDrive,Cary,NorthCarolina275132414.
March2015
July2015

SASandallotherSASInstituteInc.productorservicenamesareregisteredtrademarksor
trademarksofSASInstituteInc.intheUSAandothercountries.indicatesUSA
registration.
Otherbrandandproductnamesaretrademarksoftheirrespectivecompanies.
Technology License Notices

ScintillaCopyright19982014byNeilHodgson<neilh@scintilla.org>.
AllRightsReserved.
Permissiontouse,copy,modify,anddistributethissoftwareanditsdocumentationfor
anypurposeandwithoutfeeisherebygranted,providedthattheabovecopyright
noticeappearinallcopiesandthatboththatcopyrightnoticeandthispermission
noticeappearinsupportingdocumentation.
NEILHODGSONDISCLAIMSALLWARRANTIESWITHREGARDTOTHISSOFTWARE,INCLUDING
ALLIMPLIEDWARRANTIESOFMERCHANTABILITYANDFITNESS,INNOEVENTSHALLNEIL
HODGSONBELIABLEFORANYSPECIAL,INDIRECTORCONSEQUENTIALDAMAGESORANY
DAMAGESWHATSOEVERRESULTINGFROMLOSSOFUSE,DATAORPROFITS,WHETHERINAN
ACTIONOFCONTRACT,NEGLIGENCEOROTHERTORTIOUSACTION,ARISINGOUTOFORIN
CONNECTIONWITHTHEUSEORPERFORMANCEOFTHISSOFTWARE.

TelerikRadControls:Copyright20022012,Telerik.UsageoftheincludedTelerik
RadControlsoutsideofJMPisnotpermitted.

ZLIBCompressionLibraryCopyright19952005,JeanLoupGaillyandMarkAdler.

MadewithNaturalEarth.Freevectorandrastermapdata@naturalearthdata.com.

PackagesCopyright20092010,StphaneSudre(s.sudre.free.fr).Allrightsreserved.
Redistributionanduseinsourceandbinaryforms,withorwithoutmodification,are
permittedprovidedthatthefollowingconditionsaremet:
Redistributionsofsourcecodemustretaintheabovecopyrightnotice,thislistof
conditionsandthefollowingdisclaimer.
Redistributionsinbinaryformmustreproducetheabovecopyrightnotice,thislistof
conditionsandthefollowingdisclaimerinthedocumentationand/orothermaterials
providedwiththedistribution.
NeitherthenameoftheWhiteBoxnorthenamesofitscontributorsmaybeusedto
endorseorpromoteproductsderivedfromthissoftwarewithoutspecificpriorwritten
permission.

THISSOFTWAREISPROVIDEDBYTHECOPYRIGHTHOLDERSANDCONTRIBUTORSASISAND
ANYEXPRESSORIMPLIEDWARRANTIES,INCLUDING,BUTNOTLIMITEDTO,THEIMPLIED
WARRANTIESOFMERCHANTABILITYANDFITNESSFORAPARTICULARPURPOSEARE
DISCLAIMED.INNOEVENTSHALLTHECOPYRIGHTOWNERORCONTRIBUTORSBELIABLEFOR
ANYDIRECT,INDIRECT,INCIDENTAL,SPECIAL,EXEMPLARY,ORCONSEQUENTIALDAMAGES

(INCLUDING,BUTNOTLIMITEDTO,PROCUREMENTOFSUBSTITUTEGOODSORSERVICES;LOSS
OFUSE,DATA,ORPROFITS;ORBUSINESSINTERRUPTION)HOWEVERCAUSEDANDONANY
THEORYOFLIABILITY,WHETHERINCONTRACT,STRICTLIABILITY,ORTORT(INCLUDING
NEGLIGENCEOROTHERWISE)ARISINGINANYWAYOUTOFTHEUSEOFTHISSOFTWARE,
EVENIFADVISEDOFTHEPOSSIBILITYOFSUCHDAMAGE.

iODBCsoftwareCopyright19952006,OpenLinkSoftwareIncandKeJin
(www.iodbc.org).Allrightsreserved.
Redistributionanduseinsourceandbinaryforms,withorwithoutmodification,are
permittedprovidedthatthefollowingconditionsaremet:
Redistributionsofsourcecodemustretaintheabovecopyrightnotice,thislistof
conditionsandthefollowingdisclaimer.
Redistributionsinbinaryformmustreproducetheabovecopyrightnotice,thislist
ofconditionsandthefollowingdisclaimerinthedocumentationand/orother
materialsprovidedwiththedistribution.
NeitherthenameofOpenLinkSoftwareInc.northenamesofitscontributorsmay
beusedtoendorseorpromoteproductsderivedfromthissoftwarewithoutspecific
priorwrittenpermission.
THISSOFTWAREISPROVIDEDBYTHECOPYRIGHTHOLDERSANDCONTRIBUTORSASISAND
ANYEXPRESSORIMPLIEDWARRANTIES,INCLUDING,BUTNOTLIMITEDTO,THEIMPLIED
WARRANTIESOFMERCHANTABILITYANDFITNESSFORAPARTICULARPURPOSEARE
DISCLAIMED.INNOEVENTSHALLOPENLINKORCONTRIBUTORSBELIABLEFORANYDIRECT,
INDIRECT,INCIDENTAL,SPECIAL,EXEMPLARY,ORCONSEQUENTIALDAMAGES(INCLUDING,
BUTNOTLIMITEDTO,PROCUREMENTOFSUBSTITUTEGOODSORSERVICES;LOSSOFUSE,
DATA,ORPROFITS;ORBUSINESSINTERRUPTION)HOWEVERCAUSEDANDONANYTHEORYOF
LIABILITY,WHETHERINCONTRACT,STRICTLIABILITY,ORTORT(INCLUDINGNEGLIGENCEOR
OTHERWISE)ARISINGINANYWAYOUTOFTHEUSEOFTHISSOFTWARE,EVENIFADVISEDOF
THEPOSSIBILITYOFSUCHDAMAGE.

bzip2,theassociatedlibrarylibbzip2,andalldocumentation,areCopyright
19962010,JulianRSeward.Allrightsreserved.

Redistributionanduseinsourceandbinaryforms,withorwithoutmodification,are
permittedprovidedthatthefollowingconditionsaremet:
Redistributionsofsourcecodemustretaintheabovecopyrightnotice,thislistof
conditionsandthefollowingdisclaimer.
Theoriginofthissoftwaremustnotbemisrepresented;youmustnotclaimthatyou
wrotetheoriginalsoftware.Ifyouusethissoftwareinaproduct,anacknowledgment
intheproductdocumentationwouldbeappreciatedbutisnotrequired.
Alteredsourceversionsmustbeplainlymarkedassuch,andmustnotbe
misrepresentedasbeingtheoriginalsoftware.
Thenameoftheauthormaynotbeusedtoendorseorpromoteproductsderivedfrom
thissoftwarewithoutspecificpriorwrittenpermission.
THISSOFTWAREISPROVIDEDBYTHEAUTHORASISANDANYEXPRESSORIMPLIED
WARRANTIES,INCLUDING,BUTNOTLIMITEDTO,THEIMPLIEDWARRANTIESOF
MERCHANTABILITYANDFITNESSFORAPARTICULARPURPOSEAREDISCLAIMED.INNOEVENT
SHALLTHEAUTHORBELIABLEFORANYDIRECT,INDIRECT,INCIDENTAL,SPECIAL,
EXEMPLARY,ORCONSEQUENTIALDAMAGES(INCLUDING,BUTNOTLIMITEDTO,
PROCUREMENTOFSUBSTITUTEGOODSORSERVICES;LOSSOFUSE,DATA,ORPROFITS;OR
BUSINESSINTERRUPTION)HOWEVERCAUSEDANDONANYTHEORYOFLIABILITY,WHETHER
INCONTRACT,STRICTLIABILITY,ORTORT(INCLUDINGNEGLIGENCEOROTHERWISE)ARISING
INANYWAYOUTOFTHEUSEOFTHISSOFTWARE,EVENIFADVISEDOFTHEPOSSIBILITYOF
SUCHDAMAGE.

RsoftwareisCopyright19992012,RFoundationforStatisticalComputing.

MATLABsoftwareisCopyright19842012,TheMathWorks,Inc.ProtectedbyU.S.
andinternationalpatents.Seewww.mathworks.com/patents.MATLABandSimulink
areregisteredtrademarksofTheMathWorks,Inc.See
www.mathworks.com/trademarksforalistofadditionaltrademarks.Otherproductor
brandnamesmaybetrademarksorregisteredtrademarksoftheirrespectiveholders.

libopcisCopyright2011,FlorianReuter.Allrightsreserved.
Redistributionanduseinsourceandbinaryforms,withorwithoutmodification,are
permittedprovidedthatthefollowingconditionsaremet:
Redistributionsofsourcecodemustretaintheabovecopyrightnotice,thislistof
conditionsandthefollowingdisclaimer.

Redistributionsinbinaryformmustreproducetheabovecopyrightnotice,thislist
ofconditionsandthefollowingdisclaimerinthedocumentationand/orother
materialsprovidedwiththedistribution.
NeitherthenameofFlorianReuternorthenamesofitscontributorsmaybeusedto
endorseorpromoteproductsderivedfromthissoftwarewithoutspecificprior
writtenpermission.
THISSOFTWAREISPROVIDEDBYTHECOPYRIGHTHOLDERSANDCONTRIBUTORSASIS
ANDANYEXPRESSORIMPLIEDWARRANTIES,INCLUDING,BUTNOTLIMITEDTO,THE
IMPLIEDWARRANTIESOFMERCHANTABILITYANDFITNESSFORAPARTICULARPURPOSE
AREDISCLAIMED.INNOEVENTSHALLTHECOPYRIGHTOWNERORCONTRIBUTORSBE
LIABLEFORANYDIRECT,INDIRECT,INCIDENTAL,SPECIAL,EXEMPLARY,OR
CONSEQUENTIALDAMAGES(INCLUDING,BUTNOTLIMITEDTO,PROCUREMENTOF
SUBSTITUTEGOODSORSERVICES;LOSSOFUSE,DATA,ORPROFITS;ORBUSINESS
INTERRUPTION)HOWEVERCAUSEDANDONANYTHEORYOFLIABILITY,WHETHERIN
CONTRACT,STRICTLIABILITY,ORTORT(INCLUDINGNEGLIGENCEOROTHERWISE)ARISING
INANYWAYOUTOFTHEUSEOFTHISSOFTWARE,EVENIFADVISEDOFTHEPOSSIBILITY
OFSUCHDAMAGE.

libxml2Exceptwhereotherwisenotedinthesourcecode(e.g.thefileshash.c,list.c
andthetriofiles,whicharecoveredbyasimilarlicencebutwithdifferentCopyright
notices)allthefilesare:
Copyright19982003DanielVeillard.AllRightsReserved.
Permissionisherebygranted,freeofcharge,toanypersonobtainingacopyofthis
softwareandassociateddocumentationfiles(theSoftware),todealintheSoftware
withoutrestriction,includingwithoutlimitationtherightstouse,copy,modify,merge,
publish,distribute,sublicense,and/orsellcopiesoftheSoftware,andtopermitpersons
towhomtheSoftwareisfurnishedtodoso,subjecttothefollowingconditions:
Theabovecopyrightnoticeandthispermissionnoticeshallbeincludedinallcopiesor
substantialportionsoftheSoftware.
THESOFTWAREISPROVIDEDASIS,WITHOUTWARRANTYOFANYKIND,EXPRESSOR
IMPLIED,INCLUDINGBUTNOTLIMITEDTOTHEWARRANTIESOFMERCHANTABILITY,
FITNESSFORAPARTICULARPURPOSEANDNONINFRINGEMENT.INNOEVENTSHALLTHE
DANIELVEILLARDBELIABLEFORANYCLAIM,DAMAGESOROTHERLIABILITY,WHETHER
INANACTIONOFCONTRACT,TORTOROTHERWISE,ARISINGFROM,OUTOFORIN
CONNECTIONWITHTHESOFTWAREORTHEUSEOROTHERDEALINGSINTHESOFTWARE.

Exceptascontainedinthisnotice,thenameofDanielVeillardshallnotbeusedin
advertisingorotherwisetopromotethesale,useorotherdealingsinthisSoftware
withoutpriorwrittenauthorizationfromhim.

GettheMostfromJMP
Whetheryouareafirsttimeoralongtimeuser,thereisalwayssomethingtolearn
aboutJMP.
VisitJMP.comtofindthefollowing:

liveandrecordedwebcastsabouthowtogetstartedwithJMP

videodemosandwebcastsofnewfeaturesandadvancedtechniques

detailsonregisteringforJMPtraining

schedulesforseminarsbeingheldinyourarea

successstoriesshowinghowothersuseJMP

ablogwithtips,tricks,andstoriesfromJMPstaff

aforumtodiscussJMPwithotherusers

http://www.jmp.com/getstarted/

Contents
Design of Experiments Guide
1

Learn about JMP


Documentation and Additional Resources ......................................... 21
FormattingConventions ............................................................ 23
JMPDocumentation ................................................................ 23
JMPDocumentationLibrary ..................................................... 24
JMPHelp ...................................................................... 28
AdditionalResourcesforLearningJMP .............................................. 28
Tutorials ....................................................................... 29
SampleDataTables ............................................................. 29
LearnaboutStatisticalandJSLTerms ............................................. 29
LearnJMPTipsandTricks ....................................................... 30
Tooltips ........................................................................ 30
JMPUserCommunity ........................................................... 30
JMPerCable .................................................................... 30
JMPBooksbyUsers ............................................................. 31
TheJMPStarterWindow ........................................................ 31

Introduction to DOE
Overview of Design of Experiment Platforms ...................................... 33

Starting Out with DOE


Example and Key Concepts ....................................................... 37
OverviewofExperimentalDesignandtheDOEWorkflow ............................ 39
TheCoffeeStrengthExperiment ..................................................... 40
DefinetheStudyandGoals ...................................................... 40
CreatetheDesign ............................................................... 42
RuntheExperiment ............................................................. 48
AnalyzetheData ............................................................... 49
TheDOEWorkflow:Describe,Specify,Design ........................................ 54

10

Design of Experiments Guide

DefineResponsesandFactors ................................................... 55
SpecifytheModel .............................................................. 56
GeneratetheDesign ............................................................ 57
EvaluatetheDesign ............................................................. 58
MaketheTable ................................................................. 58
PrinciplesandGuidelinesforExperimentalDesign ................................... 59
EffectHierarchy ................................................................ 59
EffectHeredity ................................................................. 59
EffectSparsity .................................................................. 59
CenterPoints,ReplicateRuns,andTesting ........................................ 60

Custom Designs
Construct Designs That Meet Your Needs ......................................... 63
OverviewofCustomDesign ........................................................ 65
ExampleofaCustomDesign ....................................................... 66
CreatetheDesign ............................................................... 68
AnalyzetheData ............................................................... 77
CustomDesignWindow ........................................................... 83
Responses ..................................................................... 83
Factors ........................................................................ 85
DefineFactorConstraints ....................................................... 91
Model ......................................................................... 95
AliasTerms .................................................................... 96
DesignGeneration .............................................................. 97
Design ........................................................................ 100
DesignEvaluation ............................................................. 100
OutputOptions ............................................................... 101
CustomDesignOptions ........................................................... 102
SaveXMatrix ................................................................. 106
NumberofStarts .............................................................. 108
DesignSearchTime ............................................................ 108
SetDeltaforPower ............................................................ 109
TechnicalDetails .................................................................. 110
DesignswithRandomizationRestrictions ........................................ 110
CovariateswithHardtoChangeLevels ......................................... 119

Design of Experiments Guide

11

NumbersofWholePlotsandSubplots ........................................... 120


OptimalityCriteria ............................................................ 120
DEfficiency ................................................................... 124
CoordinateExchangeAlgorithm ................................................ 125

Examples of Custom Designs


Perform Experiments That Meet Your Needs ..................................... 127
ScreeningExperiments ............................................................ 129
DesignThatEstimatesMainEffectsOnly ........................................ 129
DesignThatEstimatesAllTwoFactorInteractions ................................ 132
DesignThatAvoidsAliasingofMainEffectsandTwoFactorInteractions .......... 134
SupersaturatedScreeningDesigns ............................................... 138
DesignforFixedBlocks ........................................................ 145
ResponseSurfaceExperiments ..................................................... 150
ResponseSurfaceDesign ....................................................... 150
ResponseSurfaceDesignwithFlexibleBlocking .................................. 156
ComparisonofaDOptimalandanIOptimalResponseSurfaceDesign ............ 159
MixtureExperiments .............................................................. 163
MixtureDesignwithNonmixtureFactors ........................................ 164
MixtureofMixturesDesign ..................................................... 168
ExperimentswithCovariates ....................................................... 171
DesignwithFixedCovariates ................................................... 172
DesignwithHardtoChangeCovariates ......................................... 175
DesignwithaLinearTimeTrend ................................................ 178
ExperimentswithRandomizationRestrictions ....................................... 181
SplitPlotExperiment .......................................................... 181
TwoWaySplitPlotExperiment ................................................. 186

Definitive Screening Designs


.................................................................................. 195

OverviewofDefinitiveScreeningDesign ........................................... 197


ExamplesofDefinitiveScreeningDesigns ........................................... 199
DefinitiveScreeningDesign .................................................... 199
ComparisonwithaFractionalFactorialDesign ................................... 207
DefinitiveScreeningDesignwithBlocking ....................................... 208
ComparisonofaDefinitiveScreeningDesignwithaPlackettBurmanDesign ....... 212

12

Design of Experiments Guide

DefinitiveScreeningDesignWindow ............................................... 216


Responses .................................................................... 217
Factors ....................................................................... 219
OrthogonalBlockingOptions ................................................... 221
BlockinginDefinitiveScreeningDesigns ........................................ 221
Design ........................................................................ 223
DesignEvaluation ............................................................. 223
OutputOptions ............................................................... 224
DefinitiveScreeningDesignOptions ............................................... 225
TechnicalDetails .................................................................. 227
StructureofDefinitiveScreeningDesigns ........................................ 227
AnalysisofExperimentalData .................................................. 228

Screening Designs
................................................................................. 231

OverviewofScreeningDesigns .................................................... 233


ScreeningDesignExamples ........................................................ 234
AStandardDesignwithTwoContinuousFactorsandOneCategoricalFactor ...... 234
AStandardDesignforFiveContinuousFactors .................................. 237
CreatingaScreeningDesign ....................................................... 241
EnterResponses ............................................................... 242
EnterFactors .................................................................. 243
ChooseScreeningType ........................................................ 244
ChoosefromaListofFractionalFactorialDesigns ................................ 244
DesignGeneration ............................................................. 252
NearOrthogonalDesigns ...................................................... 252
DesignEvaluation ............................................................. 254
SpecifyOutputOptions ........................................................ 254
ViewtheDesignTable ......................................................... 255
CreatingaPlackettBurmanDesign ................................................ 256
CreatingaMainEffectsScreeningDesign ........................................... 258

The Screening Platform


Analyze Data from Screening Experiments ....................................... 261
OverviewoftheScreeningPlatform ................................................ 263

Design of Experiments Guide

13

AnExampleComparingScreeningandFitModel ................................... 263


LaunchtheScreeningPlatform ..................................................... 266
TheScreeningReport ............................................................. 267
Contrasts ..................................................................... 267
HalfNormalPlot .............................................................. 268
UsingtheFitModelPlatform ................................................... 269
AdditionalScreeningAnalysisExamples ........................................... 270
AnalyzingaPlackettBurmanDesign ............................................ 271
AnalyzingaSupersaturatedDesign ............................................. 272
TechnicalDetails .................................................................. 274
OrderofEffectEntry ........................................................... 274
ScreeningasanOrthogonalRotation ............................................ 274
LenthsPseudoStandardError .................................................. 275

Response Surface Designs


.................................................................................. 277

ABoxBehnkenDesign:TheTennisBallExample .................................... 279


ThePredictionProfiler ......................................................... 282
AResponseSurfacePlot(ContourProfiler) ...................................... 284
GeometryofaBoxBehnkenDesign ............................................. 286
CreatingaResponseSurfaceDesign ................................................ 286
EnterResponsesandFactors .................................................... 287
ChooseaDesign ............................................................... 287
SpecifyOutputOptions ........................................................ 289
ViewtheDesignTable .......................................................... 290

10 Full Factorial Designs


.................................................................................. 293

TheFiveFactorReactorExample ................................................... 295


AnalyzetheReactorData ....................................................... 296
CreatingaFactorialDesign ........................................................ 301
EnterResponsesandFactors .................................................... 301
SelectOutputOptions .......................................................... 302
MaketheTable ................................................................ 302

14

Design of Experiments Guide

11 Mixture Designs
................................................................................. 305

MixtureDesignTypes ............................................................. 307


TheOptimalMixtureDesign ...................................................... 308
TheSimplexCentroidDesign ...................................................... 309
CreatingtheDesign ............................................................ 309
SimplexCentroidDesignExamples ............................................. 310
TheSimplexLatticeDesign ........................................................ 312
TheExtremeVerticesDesign ....................................................... 314
CreatingtheDesign ............................................................ 315
AnExtremeVerticesExamplewithRangeConstraints ............................ 316
AnExtremeVerticesExamplewithLinearConstraints ............................ 318
ExtremeVerticesMethod:HowItWorks ........................................ 319
TheABCDDesign ................................................................ 320
TheSpaceFillingDesign .......................................................... 320
FFFOptimalityCriterion ....................................................... 321
SetAverageClusterSize ....................................................... 321
LinearConstraints ............................................................. 322
ASpaceFillingExample ....................................................... 322
ASpaceFillingExamplewithaLinearConstraint ................................ 322
CreatingTernaryPlots ............................................................ 323
FittingMixtureDesigns ........................................................... 324
WholeModelTestsandAnalysisofVarianceReports ............................. 325
UnderstandingResponseSurfaceReports ....................................... 325
AChemicalMixtureExample ...................................................... 326
CreatetheDesign .............................................................. 326
AnalyzetheMixtureModel .................................................... 328
ThePredictionProfiler ......................................................... 329
TheMixtureProfiler ........................................................... 330
ATernaryPlotoftheMixtureResponseSurface .................................. 331

12 Covering Arrays
Detecting Component Interaction Failures ....................................... 333
OverviewofCoveringArrays ...................................................... 335

Design of Experiments Guide

15

CoveringArraysandStrength .................................................. 335


ExampleofaCoveringArraywithNoFactorLevelRestrictions ....................... 337
CreatetheDesign .............................................................. 337
AnalyzetheExperimentalData ................................................. 339
ExampleofaCoveringArraywithFactorLevelRestrictions .......................... 341
CreatetheDesign .............................................................. 341
AnalyzetheExperimentalData ................................................. 346
CoveringArrayWindow .......................................................... 347
Factors ........................................................................ 347
RestrictFactorLevelCombinations .............................................. 349
Design ........................................................................ 351
Metrics ....................................................................... 353
OutputOptions ................................................................ 354
TheCoveringArrayDataTable ................................................. 354
CoveringArrayOptions ........................................................... 356
TechnicalDetails .................................................................. 357
AlgorithmforOptimize ........................................................ 357
FormulasforMetrics ........................................................... 357

13 Discrete Choice Designs


.................................................................................. 359

CreateaChoiceDesignwithNoPriorInformation ................................... 361


CreateanExampleChoiceExperiment .............................................. 361
CreateaChoiceDesignandAnalyzetheData ....................................... 365
CreateaChoiceExperimentforaPilotStudy ..................................... 367
AnalyzethePilotStudyData ................................................... 370
DesignaChoiceExperimentUsingPriorInformation ............................. 372
AdministertheSurveyandAnalyzeResults ...................................... 374
ChoiceDesignOptions ............................................................ 377

14 Space-Filling Designs
.................................................................................. 379

OverviewofSpaceFillingDesigns ................................................. 381


SpaceFillingDesignWindow ...................................................... 382
Responses ..................................................................... 382

16

Design of Experiments Guide

Factors ....................................................................... 384


DefineFactorConstraints ...................................................... 386
SpaceFillingDesignMethods .................................................. 390
Design ........................................................................ 390
DesignDiagnostics ............................................................ 390
DesignTable .................................................................. 390
SpaceFillingDesignOptions ...................................................... 391
SpherePackingDesigns ........................................................... 393
CreatingaSpherePackingDesign .............................................. 393
VisualizingtheSpherePackingDesign .......................................... 394
LatinHypercubeDesigns .......................................................... 396
CreatingaLatinHypercubeDesign ............................................. 396
VisualizingtheLatinHypercubeDesign ......................................... 397
UniformDesigns ................................................................. 399
ComparingSpherePacking,LatinHypercube,andUniformMethods ................. 401
MinimumPotentialDesigns ....................................................... 402
MaximumEntropyDesigns ....................................................... 404
GaussianProcessIMSEOptimalDesigns ........................................... 406
FastFlexibleFillingDesigns ....................................................... 407
FFFOptimalityCriterion ....................................................... 407
SetAverageClusterSize ....................................................... 407
Constraints ................................................................... 408
CreatingandViewingaConstrainedFastFlexibleFillingDesign .................. 408
BoreholeModel:ASpherePackingExample ........................................ 410
CreatetheSpherePackingDesignfortheBoreholeData .......................... 411
GuidelinesfortheAnalysisofDeterministicData ................................ 412

15 Accelerated Life Test Designs


Designing Experiments for Accelerated Life Tests ................................ 417
OverviewofAcceleratedLifeTestDesigns .......................................... 419
UsingtheALTDesignPlatform .................................................... 419
PlatformOptions ................................................................. 424
Example ......................................................................... 424

Design of Experiments Guide

17

16 Nonlinear Designs
.................................................................................. 429

ExamplesofNonlinearDesigns .................................................... 431


UsingNonlinearFittoFindPriorParameterEstimates ............................ 431
CreatingaNonlinearDesignwithNoPriorData ................................. 438
CreatingaNonlinearDesign ....................................................... 442
IdentifytheResponseandFactorColumnwithFormula .......................... 443
SetUpFactorsandParametersintheNonlinearDesignDialog .................... 443
EntertheNumberofRunsandPreviewtheDesign ............................... 444
MakeTableorAugmenttheTable ............................................... 445
AdvancedOptionsfortheNonlinearDesigner ...................................... 445

17 Taguchi Designs
.................................................................................. 449

TheTaguchiDesignApproach ..................................................... 451


TaguchiDesignExample .......................................................... 451
AnalyzetheData .............................................................. 454
CreatingaTaguchiDesign ......................................................... 456
DetailtheResponseandAddFactors ............................................ 456
ChooseInnerandOuterArrayDesigns .......................................... 457
DisplayCodedDesign ......................................................... 458
MaketheDesignTable ......................................................... 458

18 Evaluate Designs
Explore Properties of Your Design ................................................ 461
OverviewofEvaluateDesign ...................................................... 463
ExampleofEvaluateDesign ....................................................... 464
AssessingtheImpactofLostRuns .............................................. 464
EvaluatingPowerRelativetoaSpecifiedModel .................................. 471
EvaluateDesignLaunchWindow .................................................. 473
EvaluateDesignWindow .......................................................... 473
Factors ........................................................................ 475
Model ........................................................................ 475
AliasTerms ................................................................... 476
Design ........................................................................ 476

18

Design of Experiments Guide

DesignEvaluation ............................................................. 476


PowerAnalysis ................................................................ 477
PredictionVarianceProfile ..................................................... 483
FractionofDesignSpacePlot ................................................... 484
PredictionVarianceSurface ..................................................... 485
EstimationEfficiency .......................................................... 487
AliasMatrix ................................................................... 488
ColorMaponCorrelations ..................................................... 490
DesignDiagnostics ............................................................ 491
EvaluateDesignOptions .......................................................... 493
TechnicalDetails .................................................................. 494
PowerCalculations ............................................................ 494
RelativePredictionVariance .................................................... 497

19 Augmented Designs
................................................................................. 499

ADOptimalAugmentationoftheReactorExample ................................. 501


AnalyzetheAugmentedDesign ................................................ 504
Factors ........................................................................... 510
AugmentationChoices ............................................................ 510
ReplicateaDesign ............................................................. 511
AddCenterPoints ............................................................. 514
CreatingaFoldoverDesign ..................................................... 515
AddingAxialPoints ........................................................... 516
SpaceFilling .................................................................. 517
AddingNewRunsandTerms .................................................. 518
DefineFactorConstraints .......................................................... 521
SpecialAugmentDesignOptions .................................................. 525
SavetheDesign(X)Matrix ..................................................... 525
ModifytheDesignCriterion(DorIOptimality) ................................ 525
SelecttheNumberofRandomStarts ............................................ 525
DesignSearchTime ............................................................ 526
SpecifytheSphereRadiusValue ................................................ 526

Design of Experiments Guide

19

20 Prospective Sample Size and Power


.................................................................................. 529

LaunchingtheSampleSizeandPowerPlatform ..................................... 531


OneSampleandTwoSampleMeans ............................................... 531
SingleSampleMean ........................................................... 533
SampleSizeandPowerAnimationforOneMean ................................. 536
TwoSampleMeans ............................................................ 537
kSampleMeans .................................................................. 539
OneSampleStandardDeviation ................................................... 540
OneSampleStandardDeviationExample ........................................ 541
OneSampleandTwoSampleProportions .......................................... 542
ActualTestSize ................................................................ 543
OneSampleProportion ........................................................ 543
TwoSampleProportions ....................................................... 545
CountsperUnit .................................................................. 548
CountsperUnitExample ....................................................... 549
SigmaQualityLevel ............................................................... 550
SigmaQualityLevelExample ................................................... 550
NumberofDefectsComputationExample ....................................... 551
ReliabilityTestPlanandDemonstration ............................................ 552
ReliabilityTestPlan ............................................................ 552
ReliabilityDemonstration ...................................................... 555

Column Properties
Understanding Column Properties Assigned by DOE ............................. 559
AddingandViewingColumnProperties ............................................ 561
ResponseLimits .................................................................. 562
ResponseLimitsExample ...................................................... 564
EditingResponseLimits ........................................................ 567
DesignRole ...................................................................... 570
DesignRoleExample .......................................................... 570
Coding ........................................................................... 573
LowandHighValues .......................................................... 573
CodingColumnPropertyandCenterPolynomials ................................ 574

20

Design of Experiments Guide

CodingExample ............................................................... 574


AssigningCoding ............................................................. 577
Mixture .......................................................................... 579
MixtureExample .............................................................. 582
FactorChanges ................................................................... 585
FactorChangesExample ....................................................... 586
ValueOrdering ................................................................... 588
ValueOrderingExample ....................................................... 589
AssigningValueOrdering ...................................................... 591
ValueLabels ..................................................................... 591
ValueLabelsExample .......................................................... 592
RunsPerBlock .................................................................... 594
RunsPerBlockExample ........................................................ 594
ConstraintState ................................................................... 595
ConstraintStateExample ....................................................... 595

Technical Details
The Model and Alias Matrices .................................................... 599
TheModelMatrix ................................................................ 601
TheAliasMatrix .................................................................. 601
DesignswithHardorVeryHardFactorChanges ................................. 602
DesignswithIfPossibleEffects ................................................. 602

C References
Index
Design of Experiments Guide .................................................... 609

Chapter 1
Learn about JMP
Documentation and Additional Resources
Thischapterincludesthefollowinginformation:

bookconventions

JMPdocumentation

JMPHelp

additionalresources,suchasthefollowing:
otherJMPdocumentation
tutorials
indexes
Webresources

Figure 1.1TheJMPHelpHomeWindowonWindows

Contents
FormattingConventions .......................................................... 23
JMPDocumentation.............................................................. 23
JMPDocumentationLibrary .................................................... 24
JMPHelp .................................................................... 28
AdditionalResourcesforLearningJMP ............................................. 28
Tutorials ..................................................................... 29
SampleDataTables ............................................................ 29
LearnaboutStatisticalandJSLTerms............................................ 29
LearnJMPTipsandTricks...................................................... 30
Tooltips ...................................................................... 30
JMPUserCommunity ......................................................... 30
JMPerCable.................................................................. 30
JMPBooksbyUsers ........................................................... 31
TheJMPStarterWindow ....................................................... 31

Chapter 1
Design of Experiments Guide

Learn about JMP


Formatting Conventions

23

Formatting Conventions
Thefollowingconventionshelpyourelatewrittenmaterialtoinformationthatyouseeon
yourscreen.

Sampledatatablenames,columnnames,pathnames,filenames,fileextensions,and
foldersappearinHelveticafont.

CodeappearsinLucida Sans Typewriterfont.

CodeoutputappearsinLucida Sans Typewriteritalicfontandisindentedfartherthan


theprecedingcode.

Helvetica boldformattingindicatesitemsthatyouselecttocompleteatask:

buttons
checkboxes
commands
listnamesthatareselectable
menus
options
tabnames
textboxes

Thefollowingitemsappearinitalics:
wordsorphrasesthatareimportantorhavedefinitionsspecifictoJMP
booktitles
variables
scriptoutput

FeaturesthatareforJMPProonlyarenotedwiththeJMPProicon
ofJMPProfeatures,visithttp://www.jmp.com/software/pro/.

.Foranoverview

Note: SpecialinformationandlimitationsappearwithinaNote.
Tip: HelpfulinformationappearswithinaTip.

JMP Documentation
JMPoffersdocumentationinvariousformats,fromprintbooksandPortableDocument
Format(PDF)toelectronicbooks(ebooks).

24

Learn about JMP


JMP Documentation

Chapter 1
Design of Experiments Guide

OpenthePDFversionsfromtheHelp > Booksmenu.

AllbooksarealsocombinedintoonePDFfile,calledJMPDocumentationLibrary,for
convenientsearching.OpentheJMPDocumentationLibraryPDFfilefromtheHelp > Books
menu.

YoucanalsopurchaseprinteddocumentationandebooksontheSASwebsite:
http://www.sas.com/store/search.ep?keyWords=JMP

JMP Documentation Library


ThefollowingtabledescribesthepurposeandcontentofeachbookintheJMPlibrary.
Document Title

Document Purpose

Document Content

DiscoveringJMP

Ifyouarenotfamiliar
withJMP,starthere.

IntroducesyoutoJMPandgetsyou
startedcreatingandanalyzingdata.

UsingJMP

LearnaboutJMPdata
tablesandhowto
performbasic
operations.

CoversgeneralJMPconceptsand
featuresthatspanacrossallofJMP,
includingimportingdata,modifying
columnsproperties,sortingdata,and
connectingtoSAS.

BasicAnalysis

Performbasicanalysis
usingthisdocument.

DescribestheseAnalyzemenuplatforms:

Distribution

FitYbyX

MatchedPairs

Tabulate

Howtoapproximatesampling
distributionsusingbootstrappingand
modelingutilitiesarealsoincluded.

Chapter 1
Design of Experiments Guide

Learn about JMP


JMP Documentation

Document Title

Document Purpose

Document Content

EssentialGraphing

Findtheidealgraph
foryourdata.

DescribestheseGraphmenuplatforms:

GraphBuilder

OverlayPlot

Scatterplot3D

ContourPlot

BubblePlot

ParallelPlot

CellPlot

Treemap

ScatterplotMatrix

TernaryPlot

Chart

25

Thebookalsocovershowtocreate
backgroundandcustommaps.
Profilers

Learnhowtouse
interactiveprofiling
tools,whichenableyou
toviewcrosssections
ofanyresponse
surface.

CoversallprofilerslistedintheGraph
menu.Analyzingnoisefactorsis
includedalongwithrunningsimulations
usingrandominputs.

Designof
ExperimentsGuide

Learnhowtodesign
experimentsand
determineappropriate
samplesizes.

CoversalltopicsintheDOEmenuand
theScreeningmenuitemintheAnalyze>
Modelingmenu.

26

Learn about JMP


JMP Documentation

Chapter 1
Design of Experiments Guide

Document Title

Document Purpose

Document Content

FittingLinearModels

LearnaboutFitModel
platformandmanyof
itspersonalities.

Describesthesepersonalities,all
availablewithintheAnalyzemenuFit
Modelplatform:

SpecializedModels

Learnaboutadditional
modelingtechniques.

StandardLeastSquares

Stepwise

GeneralizedRegression

MixedModel

MANOVA

LoglinearVariance

NominalLogistic

OrdinalLogistic

GeneralizedLinearModel

DescribestheseAnalyze>Modeling
menuplatforms:

Partition

Neural

ModelComparison

Nonlinear

GaussianProcess

TimeSeries

ResponseScreening

TheScreeningplatformintheAnalyze>
ModelingmenuisdescribedinDesignof
ExperimentsGuide.
Multivariate
Methods

Readabouttechniques
foranalyzingseveral
variables
simultaneously.

DescribestheseAnalyze>Multivariate
Methodsmenuplatforms:

Multivariate

Cluster

PrincipalComponents

Discriminant

PartialLeastSquares

Chapter 1
Design of Experiments Guide

Learn about JMP


JMP Documentation

Document Title

Document Purpose

Document Content

QualityandProcess
Methods

Readabouttoolsfor
evaluatingand
improvingprocesses.

DescribestheseAnalyze>Qualityand
Processmenuplatforms:

Reliabilityand
SurvivalMethods

ConsumerResearch

Learntoevaluateand
improvereliabilityina
productorsystemand
analyzesurvivaldata
forpeopleand
products.

Learnaboutmethods
forstudyingconsumer
preferencesandusing
thatinsighttocreate
betterproductsand
services.

27

ControlChartBuilderandindividual
controlcharts

MeasurementSystemsAnalysis

Variability/AttributeGaugeCharts

ProcessCapability

ParetoPlot

Diagram

DescribestheseAnalyze>Reliabilityand
Survivalmenuplatforms:

LifeDistribution

FitLifebyX

RecurrenceAnalysis

DegradationandDestructive
Degradation

ReliabilityForecast

ReliabilityGrowth

ReliabilityBlockDiagram

Survival

FitParametricSurvival

FitProportionalHazards

DescribestheseAnalyze>Consumer
Researchmenuplatforms:

Categorical

MultipleCorrespondenceAnalysis

FactorAnalysis

Choice

Uplift

ItemAnalysis

28

Learn about JMP


Additional Resources for Learning JMP

Chapter 1
Design of Experiments Guide

Document Title

Document Purpose

Document Content

ScriptingGuide

Learnabouttaking
advantageofthe
powerfulJMP
ScriptingLanguage
(JSL).

Coversavarietyoftopics,suchaswriting
anddebuggingscripts,manipulating
datatables,constructingdisplayboxes,
andcreatingJMPapplications.

JSLSyntaxReference

ReadaboutmanyJSL
functionsonfunctions
andtheirarguments,
andmessagesthatyou
sendtoobjectsand
displayboxes.

Includessyntax,examples,andnotesfor
JSLcommands.

Note: TheBooksmenualsocontainstworeferencecardsthatcanbeprinted:TheMenuCard
describesJMPmenus,andtheQuickReferencedescribesJMPkeyboardshortcuts.

JMP Help
JMPHelpisanabbreviatedversionofthedocumentationlibrarythatprovidestargeted
information.YoucanopenJMPHelpinseveralways:

OnWindows,presstheF1keytoopentheHelpsystemwindow.

Gethelponaspecificpartofadatatableorreportwindow.SelecttheHelptool from
theToolsmenuandthenclickanywhereinadatatableorreportwindowtoseetheHelp
forthatarea.

WithinaJMPwindow,clicktheHelpbutton.

SearchandviewJMPHelponWindowsusingtheHelp > Help Contents,Search Help,and


Help Indexoptions.OnMac,selectHelp > JMP Help.

SearchtheHelpathttp://jmp.com/support/help/(Englishonly).

Additional Resources for Learning JMP


InadditiontoJMPdocumentationandJMPHelp,youcanalsolearnaboutJMPusingthe
followingresources:

Tutorials(seeTutorialsonpage 29)

Sampledata(seeSampleDataTablesonpage 29)

Indexes(seeLearnaboutStatisticalandJSLTermsonpage 29)

Chapter 1
Design of Experiments Guide

Learn about JMP


Additional Resources for Learning JMP

TipoftheDay(seeLearnJMPTipsandTricksonpage 30)

Webresources(seeJMPUserCommunityonpage 30)

JMPerCabletechnicalpublication(seeJMPerCableonpage 30)

BooksaboutJMP(seeJMPBooksbyUsersonpage 31)

JMPStarter(seeTheJMPStarterWindowonpage 31)

29

Tutorials
YoucanaccessJMPtutorialsbyselectingHelp > Tutorials.ThefirstitemontheTutorialsmenu
isTutorials Directory.Thisopensanewwindowwithallthetutorialsgroupedbycategory.
IfyouarenotfamiliarwithJMP,thenstartwiththeBeginners Tutorial.Itstepsyouthroughthe
JMPinterfaceandexplainsthebasicsofusingJMP.
TherestofthetutorialshelpyouwithspecificaspectsofJMP,suchascreatingapiechart,
usingGraphBuilder,andsoon.

Sample Data Tables


AlloftheexamplesintheJMPdocumentationsuiteusesampledata.SelectHelp > Sample
Data Library toopenthesampledatadirectory.
Toviewanalphabetizedlistofsampledatatablesorviewsampledatawithincategories,
selectHelp > Sample Data.
Sampledatatablesareinstalledinthefollowingdirectory:
OnWindows:C:\Program Files\SAS\JMP\<version_number>\Samples\Data
OnMacintosh:\Library\Application Support\JMP\<version_number>\Samples\Data
InJMPPro,sampledataisinstalledintheJMPPRO(ratherthanJMP)directory.InJMP
Shrinkwrap,sampledataisinstalledintheJMPSWdirectory.

Learn about Statistical and JSL Terms


TheHelp menucontainsthefollowingindexes:
Statistics Index Providesdefinitionsofstatisticalterms.

LetsyousearchforinformationaboutJSLfunctions,objects,anddisplay
boxes.YoucanalsoeditandrunsamplescriptsfromtheScriptingIndex.

Scripting Index

30

Learn about JMP


Additional Resources for Learning JMP

Chapter 1
Design of Experiments Guide

Learn JMP Tips and Tricks


WhenyoufirststartJMP,youseetheTipoftheDaywindow.Thiswindowprovidestipsfor
usingJMP.
ToturnofftheTipoftheDay,cleartheShow tips at startupcheckbox.Toviewitagain,select
Help > Tip of the Day.Or,youcanturnitoffusingthePreferenceswindow.SeetheUsingJMP
bookfordetails.

Tooltips
JMPprovidesdescriptivetooltipswhenyouplaceyourcursoroveritems,suchasthe
following:

Menuortoolbaroptions

Labelsingraphs

Textresultsinthereportwindow(moveyourcursorinacircletoreveal)

FilesorwindowsintheHomeWindow

CodeintheScriptEditor

Tip: YoucanhidetooltipsintheJMPPreferences.SelectFile > Preferences > General(orJMP


> Preferences > GeneralonMacintosh)andthendeselectShow menu tips.

JMP User Community


TheJMPUserCommunityprovidesarangeofoptionstohelpyoulearnmoreaboutJMPand
connectwithotherJMPusers.Thelearninglibraryofonepageguides,tutorials,anddemosis
agoodplacetostart.AndyoucancontinueyoureducationbyregisteringforavarietyofJMP
trainingcourses.
Otherresourcesincludeadiscussionforum,sampledataandscriptfileexchange,webcasts,
andsocialnetworkinggroups.
ToaccessJMPresourcesonthewebsite,selectHelp > JMP User Communityorvisit
https://community.jmp.com/.

JMPer Cable
TheJMPerCableisayearlytechnicalpublicationtargetedtousersofJMP.TheJMPerCableis
availableontheJMPwebsite:
http://www.jmp.com/about/newsletters/jmpercable/

Chapter 1
Design of Experiments Guide

Learn about JMP


Additional Resources for Learning JMP

31

JMP Books by Users


AdditionalbooksaboutusingJMPthatarewrittenbyJMPusersareavailableontheJMP
website:
http://www.jmp.com/en_us/software/books.html

The JMP Starter Window


TheJMPStarterwindowisagoodplacetobeginifyouarenotfamiliarwithJMPordata
analysis.Optionsarecategorizedanddescribed,andyoulaunchthembyclickingabutton.
TheJMPStarterwindowcoversmanyoftheoptionsfoundintheAnalyze,Graph,Tables,and
Filemenus.

ToopentheJMPStarterwindow,selectView (WindowontheMacintosh)> JMP Starter.

TodisplaytheJMPStarterautomaticallywhenyouopenJMPonWindows,selectFile >
Preferences > General,andthenselectJMP Starter fromtheInitialJMPWindowlist.On
Macintosh,selectJMP > Preferences > Initial JMP Starter Window.

32

Learn about JMP


Additional Resources for Learning JMP

Chapter 1
Design of Experiments Guide

Chapter 2
Introduction to DOE
Overview of Design of Experiment Platforms
TheJMPDOEplatformshelpyoutodesignexperiments.Mostoftheplatformsfocuson
constructingdesignsofvarioustypes.Otherplatformssupportthedesigneffort.Thischapter
givesaquickoverviewofeachoftheplatformsfoundundertheDOEmenu.
DesignConstructionPlatforms
Constructsdesignsthatfitawidevarietyofsettings.Customdesignstendto
bemorecosteffectiveandflexiblethanapproachesbasedexclusivelyonclassicaldesigns.

Custom Design

Customdesignsaccommodatevarioustypesoffactors,constraints,anddisallowed
combinations.Youcanspecifywhicheffectsarenecessarytoestimateandwhichare
desirabletoestimate,giventhenumberofruns.Youcanspecifyanumberofrunsthat
matchesthebudgetforyourexperimentalsituation.Customdesignsalsosupport
hardtochangeandveryhardtochangefactors,allowingyoutoconstructsplitplotand
relateddesigns.
TheCustomDesignplatformconstructsmanyspecialdesigntypes:
screening
responsesurface
mixture
randomblock
splitplot
splitsplitplot
twowaysplitplot
Youcanconstructclassicalscreening,responsesurface,andmixturedesignsusingother
platforms.However,theCustomDesignplatformgivesyouflexibilitythatisnotavailable
intheotherplatforms.Constructingdesignsforsplitplotsituationscanbedoneonly
usingtheCustomDesignplatform.
Definitive Screening Design Constructsscreeningdesignsforcontinuousandtwolevel

categoricalfactors.Definitivescreeningdesignsareusefulifyoususpectactiveinteractions
orcurvature.Definitivescreeningdesignsenableyoutoidentifythesourceofstrong

34

Introduction to DOE

Chapter 2
Design of Experiments Guide

nonlineareffectswhileavoidingcompleteconfoundingbetweenanyeffectsupthrough
thesecondorder.
Definitivescreeningdesignsaresmall.Theyhaveroughlytwiceasmanyrunsasthereare
factors.Continuousfactorsaresetatthreelevels.Definitivescreeningdesignssupport
groupingrunsintoblocks.Thenumberofblocksisuserspecified.
Screening Design Constructsscreeningdesignsforcontinuous,discretenumeric,and

categoricalfactorswithanarbitrarynumberoflevels.Whenstandarddesignsexist,you
havetwooptions:
Choosefromalistofclassicalscreeningdesigns.Thesedesignsallowtwolevel
continuousfactorsorthreelevelcategoricalordiscretecontinuousfactors.
Generateadesignthatisorthogonalornearlyorthogonalformaineffects.
Nearorthogonaldesignsallowforcategoricalanddiscretenumericfactorswithany
numberoflevels,aswellastwolevelcontinuousfactors.Thesedesignsfocuson
estimatingmaineffectsinthepresenceofnegligibleinteractions.
Formanyscreeningsituations,standarddesignsarenotavailable.Inthesesituations,you
canconstructnearorthogonalscreeningdesigns.
Response Surface Design Constructsdesignsthatmodelaquadraticfunctionofcontinuous

factors.Tofitthequadraticeffects,responsesurfacedesignsrequirethreesettingsforeach
factor.JMPprovidesresponsesurfacedesignsforuptoeightfactors.
YoucanchoosefromalistofCentralCompositeorBoxBehnkendesigns.When
appropriate,CentralCompositedesignsthatblockorthogonallyareincludedinthelist.
VariousmodificationstoCentralCompositedesignsaresupported.
Full Factorial Design Constructsfullfactorialdesignsforanynumberofcontinuousor

categoricalfactors,bothwitharbitrarilymanylevels.Afullfactorialdesignhasarunat
everycombinationofsettingsofthefactors.Fullfactorialdesignstendtobelarge.The
numberofrunsequalstheproductofthenumbersoffactorlevels.
Constructsdesignsthatyouusewhenfactorsareingredientsinamixture.In
amixtureexperiment,achangeintheproportionofoneingredientrequiresthatoneor
moreoftheremainingingredientschangetomaintainthesum.Choosefromamong
severaldesigntypes,includingsomeclassicalmixturedesignapproaches:optimal,
simplexcentroid,simplexlattice,extremevertices,ABCD,andspacefilling.Foroptimal,
extremevertices,andspacefillingmixturedesigns,youcanspecifylinearinequality
constraintstolimitthedesignspace.

Mixture Design

Covering Array Constructscombinatorialdesignsthatyoucanusetotestsoftware,networks,

andothersystems.Astrengthtcoveringarrayhasthepropertythateverycombinationof
levelsofeverytfactorsappearsinatleastonerun.Coveringarraysallowforanynumber
ofcategoricalfactors,eachwithanarbitrarynumberoflevels.Disallowedcombinations
canbespecified.

Chapter 2
Design of Experiments Guide

Introduction to DOE

35

Choice Design Constructsdesignsthatyoucanusetocompareprospectiveproducts.The

factorsinachoicedesignareproductattributes.Thedesignarrangesproductprofiles,
whicharecombinationsofvariousattributes,inpairsoringroupsofthreeorfour.The
experimentconsistsofhavingrespondentsindicatewhichprofileinapairofprofilesthat
theyprefer.Youcangenerateachoicedesignthatreflectspriorinformationaboutthe
productattributes.
Space Filling Design Constructsdesignsforsituationswherethesystemofinterestis

deterministicorneardeterministic.Astandardapplicationinvolvescreatingasimpler
surrogatemodelofahighlycomplexdeterministiccomputersimulationmodel.
Inadeterministicsystem,thereisnovariation.Thegoalistominimizethedifference
betweenthefittedmodelandthetruemodel(bias).Spacefillingdesignsattempttomeet
thisgoaleitherbyspreadingthedesignpointsoutasfarfromeachotheraspossibleorby
spacingthepointsevenlyoverthedesignregion.
JMPprovidessevenspacefillingdesignapproaches.Oneoftheseapproaches,thefast
flexiblefillingdesign,accommodatescategoricalfactorswithanynumberoflevelsand
supportslinearconstraints.
Accelerated Life Test Design Constructsandaugmentsdesignsusefulfortestingproductsat

extremeconditionswhichareintendedtoacceleratefailuretime.Useexperimentalresults
topredictreliabilityundernormaloperatingconditions.
ThelifedistributioncanbelognormalorWeibull.Designscanincludeoneortwo
acceleratingfactors.Iftherearetwoacceleratingfactors,youcanchoosetoincludetheir
interaction.Youcanspecifypriordistributionsfortheaccelerationmodelparameters.
DoptimalandtwotypesofIoptimaldesignsareavailable.
Nonlinear Design Constructsandaugmentsdesignsthatyouusetofitmodelsthatare

nonlinearintheirparameters.Youcanconstructadesignusingestimatesfromamodelfit
toexistingdata.Youcanalsoconstructadesignbyapplyingpriorknowledgeifyoudonot
havemodelbasedestimates.
Taguchi Arrays Constructsdesignsthatyouuseforsignaltonoiseanalysis.Thedesignsare

basedonTaguchisinnerandouterarrayapproach.Controlfactorsettingsconstitutethe
innerarrayandnoisefactorsettingsformtheouterarray.Themeanandsignaltonoise
ratioaretheresponsesofinterest.
AnalternativetousingaTaguchiarrayistoconstructacustomdesignthatincludes
controlfactors,noisefactors,andcontrolbynoiseinteractions.Suchdesigns,called
combinedarrays,aregenerallymorecosteffectiveandinformativethanTaguchiarrays.
SupportingPlatforms
Providesdiagnosticsforanexistingexperimentaldesign.TheEvaluate
Designplatformprovidesvariouswaysforyoutoassessthestrengthsandlimitationsof

Evaluate Design

36

Introduction to DOE

Chapter 2
Design of Experiments Guide

yourdesign.Theplatformcanbeusedwithanydatatable,notonlydesignscreatedusing
JMP.
Severaldiagnosticsareprovided:
poweranalysis
predictionvarianceplots
estimationefficiencyforparameters
thealiasmatrix,showingthebiasstructureformodeleffects
acolormapshowingabsolutecorrelationsamongeffects
designefficiencyvalues
Addsrunstoexistingdesignsinsuchawaythattheresultingdesignis
optimal.AugmentDesignenablesyoutoconductexperimentsinaniterativefashion.You
canreplicatethedesign,addcenterpoints,createafoldoverdesign,addaxialpoints,add
pointstocreateaspacefillingdesign,oraugmentthedesignwithaspecifiednumberof
runs.Youcangrouprunsintoblockstodistinguishtheoriginalrunsfromtheaugmented
runs.Youcanaddmodeleffectsthatwerenotintheoriginalmodelandspecify
estimabilityrequirementsfortheseeffects.

Augment Design

Sample Size and Power Providessamplesizeandpowercalculationsforavarietyoftesting

situations:oneormoresamplemeans,astandarddeviation,oneortwoproportions,
countsperunit(Poissonmean),andsigmaqualitylevel.Fortheseoptions,youspecifytwo
ofthreequantitiestocomputethethird.Thesethreequantitiesarethedifferenceyouwant
todetect,thesamplesize,andthepower.Ifyousupplyonlyoneofthesevalues,aplotof
therelationshipbetweentheothertwovaluesisprovided.
Youcancomputethesamplesizerequiredforareliabilitytestplan,whereyourgoalisto
estimatefailureprobabilities.Youcanalsocomputethesamplesizerequiredfora
reliabilitydemonstration,whereyourgoalistodemonstratethataproductmeetsor
exceedsaspecifiedstandard.

Chapter 3
Starting Out with DOE
Example and Key Concepts
Adesignedexperimentisacontrolledsetoftestsdesignedtomodelandexplorethe
relationshipbetweenfactorsandoneormoreresponses.JMPincludesavarietyoftoolsthat
enableyoutocreateefficientexperimentaldesignsthatworkforyoursituation.Inparticular,
theseclassesofdesignsareavailable:

TheCustomDesignplatformcustomizesadesignforyouruniquesituation.Itconstructs
designsthataccommodateanynumberoffactorsofanytypeandfactorsthataredifficult
tochange(splitplotsituations).Youcontrolthenumberofruns.

TheDefinitiveScreeningDesignplatformconstructsaninnovativeclassofscreening
designswheremaineffectsarenotaliasedwitheachotherorwithtwowayinteractions.
Thesedesignsalsoallowestimationofquadraticterms.

TheScreeningDesign,ResponseSurfaceDesign,FullFactorialDesign,MixtureDesign,
andTaguchiArraysplatformsconstructtraditionalexperimentaldesigns.

TheCoveringArray,ChoiceDesign,SpaceFillingDesign,AcceleratedLifeTestDesign,
andNonlinearDesignplatformsconstructspecializeddesigntypes.

TheEvaluateDesignandAugmentDesignplatformsprovidetoolsforevaluatingand
augmentingexistingdesign.TheSampleSizeandPowerplatformaddressessamplesizeand
powercalculationsforspecializedsituations.
ThischapterpresentsanexamplethatillustratestheJMPapproachtoDOE.Thischapteralso
discussestheframeworkforDOE,theworkflowthatsupportsdesigncreation,andprinciples
thatarefundamentaltoDOE.
Figure 3.1ExampleofaProfilerPlot

Contents
OverviewofExperimentalDesignandtheDOEWorkflow............................. 39
TheCoffeeStrengthExperiment.................................................... 40
DefinetheStudyandGoals ..................................................... 40
CreatetheDesign ............................................................. 42
RuntheExperiment ........................................................... 48
AnalyzetheData .............................................................. 49
TheDOEWorkflow:Describe,Specify,Design ....................................... 54
DefineResponsesandFactors................................................... 55
SpecifytheModel............................................................. 56
GeneratetheDesign........................................................... 57
EvaluatetheDesign ........................................................... 58
MaketheTable................................................................ 58
PrinciplesandGuidelinesforExperimentalDesign................................... 59
EffectHierarchy............................................................... 59
EffectHeredity................................................................ 59
EffectSparsity ................................................................ 59
CenterPoints,ReplicateRuns,andTesting........................................ 60

Chapter 3
Design of Experiments Guide

Starting Out with DOE


Overview of Experimental Design and the DOE Workflow

39

Overview of Experimental Design and the DOE Workflow


Asixstepframeworkprovidesthestructurefordesigninganexperiment,runningthe
experimentaltrials,andanalyzingtheresults.Soundengineeringandprocessknowledgeis
criticaltoallofthesesteps.
Figure 3.2FrameworkforExperimentalDesign
Describe

Identify goal,
responses, and
factors.

Specify

Identify effects
for an assumed
model.

Design

Generate a
design and
evaluate it for
suitability.

Collect

Run trials using


design settings.
Measure response
for each run.

Fit

Determine a
model that best
fits experimental
data.

Predict

Use the model to


optimize factor
settings or to
predict process
performance.

YouperformthefirstthreestepsintheDOEplatforms.Theendresultisadesignthatcanbe
runinyourworkenvironment.Foradetaileddescriptionoftheworkflowforthesethree
steps,seeTheDOEWorkflow:Describe,Specify,Designonpage 54.
Describe Determinethegoalofyourexperiment.Identifyresponsesandfactors.

Yourgoalmightbetoidentifyactivefactors,tofindoptimalfactorsettings,ortobuilda
predictivemodel.
Determineorspecifyanassumedmodelthatyoubelieveadequatelydescribesthe
physicalsituation.

Specify

Yourassumedmodelisaninitialmodelthatideallycontainsalltheeffectsthatyouwantto
estimate.Insomeplatforms,youcanexplicitlybuildthemodelofinterest.Inothers,the
modelisimplicitinthechoicesthatyoumake.Forexample,intheScreeningDesign
platform,youmightselectamodelwithagivenresolution.Theresolutionofthedesign
determineswhicheffectsareconfounded.Confoundingofeffectspotentiallyleadsto
ambiguityaboutwhicheffectistrulyactive.
Generateadesignthatisconsistentwithyourassumedmodel.Evaluatethisdesign
tounderstanditsstrengthsandlimitations,andtoensurethatitprovidestheinformation
thatyouneed,givenyourmodelandgoals.

Design

TheDesignEvaluationorDesignDiagnosticsoutlineinthedesigngenerationplatform
giveyouinsightaboutthepropertiesofyourdesign.
Thenextstepisthedatacollectionphase,wheretheexperimentisrunundercontrolled
conditions.
Collect Conducteachofthetrialsandrecordtheresponsevalues.

40

Starting Out with DOE


The Coffee Strength Experiment

Chapter 3
Design of Experiments Guide

Afteryourunyourexperiment,scriptsinthegenerateddatatablehelpyoufitamodelusing
platformssuchasFitModelandScreening.Dependingonyourgoal,themodelcanhelpyou
identifyactiveeffectsorfindoptimalsettings.
Fit

Fityourassumedmodeltotheexperimentaldata.
UsetheJMPmodelingplatformstofitandrefineyourmodel.Insomesituations,you
mightneedtoaugmentthedesignandperformadditionalrunstoresolvemodel
ambiguity.

Predict

Useyourrefinedmodeltoaddressyourexperimentalgoals.

Determinewhicheffectsareactive,findfactorlevelstooptimizeresponses,orbuilda
predictivemodel.
Designedexperimentsaretypicallyusedsequentiallytoconstructprocessknowledge.A
designstrategyoftenbeginswithascreeningdesigntonarrowthelistofpotentiallyactive
factors.Thentheidentifiedfactorsarestudiedindesignsthatfocusonbuildingabetter
understandingofinteractionsandquadraticeffects.Sometimesthereisaneedtoaugmenta
designtoresolveambiguitiesrelatingtothefactorsresponsibleforeffects.Thestepsoutlined
inthissectionrelatetoconductingandanalyzingasingleexperiment.However,youmay
requireasequenceofexperimentstoachieveyourgoals.
TheexampleinTheCoffeeStrengthExperimentonpage 40explicitlyillustratesthestepsin
theDOEworkflowprocess.Italsoshowshowtouseadatatablescripttoanalyzeyour
experimentaldata.ManyexamplesintheDesignofExperimentsGuideillustrateboththe
workflowthatsupportsagooddesignandtheanalysisoftheexperimentaldatafromthe
study.

The Coffee Strength Experiment


Thisexamplecontainsthefollowingprocesses:

DefinetheStudyandGoalsonpage 40

CreatetheDesignonpage 42

RuntheExperimentonpage 48

AnalyzetheDataonpage 49

Define the Study and Goals


Youremployerisalocalmidsizecoffeeroaster.Youneedtoaddressthestrengthof
individuallybrewedtwelveouncecupsofcoffee.Yourgoalistodeterminewhichfactorshave
aneffectoncoffeestrengthandtofindoptimalsettingsforthosefactors.

Chapter 3
Design of Experiments Guide

Starting Out with DOE


The Coffee Strength Experiment

41

Response
TheresponseiscoffeeStrength.Itismeasuredastotaldissolvedsolids,usingarefractometer.
Thecoffeeisbrewedusingasinglecupcoffeedripperandmeasuredfiveminutesafterthe
liquidisreleasedfromthegrounds.
Previousstudiesindicatethatastrengthreadingof1.3ismostdesirable,thoughthestrength
isstillacceptableifitfallsbetween1.2and1.4.
Factors
Fourfactorsareidentifiedforthestudy:Grind,Temperature,Time,andCharge.Coffeeis
brewedatthreestationsintheworkarea.Toaccountforvariationduetobrewinglocation,
Stationisincludedinthestudyasablockingfactor.Thefollowingdescribesthefactors:

Grindisthecoarsenessofthegrind.Grindissetattwolevels,MediumandCoarse.

TemperatureisthetemperatureindegreesFahrenheitofthewatermeasuredimmediately
beforepouringitoverthegrounds.Temperature issetat195and205degreesFahrenheit.

Time isthebrewingtimeinminutes.Timeissetat3or4minutes.

Charge istheamountofcoffeeplacedintheconefilter,measuredingramsofcoffeebeans
perounceofwater.Charge issetat1.6and2.4.

Stationisthelocationwherethecoffeeisbrewed.Thethreestationsarelabeledas1,2,and

3.
Table 3.1summarizesinformationaboutthefactorsandtheirsettings.Thefactorsandlevels
arealsogivenintheCoffee Factors.jmpsampledatatable,locatedintheDesign Experiment
folder.
Table 3.1FactorsandRangeofSettingsforCoffeeExperiment
Factor

Role

Range of Settings

Grind

Categorical

Medium

Coarse

Temperature

Continuous

195

205

Time

Continuous

Charge

Continuous

1.6

2.4

Station

Blocking

Notethefollowing:

Grindiscategoricalwithtwolevels.

Temperature,Time,andChargearecontinuous.

Stationisablockingfactorwiththreelevels.

42

Starting Out with DOE


The Coffee Strength Experiment

Chapter 3
Design of Experiments Guide

Allfactorscanbevariedandresetforeachrun.Therearenohardtochangefactorsforthis
experiment.
TheapparatususedinrunningthecoffeeexperimentisshowninFigure 3.3.Thisisthesetup
atoneofthethreebrewingstations.Thetwootherstationshavethesametypeofequipment.
Figure 3.3CoffeeExperimentApparatus

NumberofRuns
Basedontheresourcesandtimeavailable,youdeterminethatyoucanconduct12runsinall.
Sincetherearethreestations,youconduct4runsateachstation.

Create the Design


CreatethedesignfollowingthestepsinthedesignworkflowprocessoutlinedinTheDOE
Workflow:Describe,Specify,Designonpage 54:

DefineResponsesandFactorsonpage 55

SpecifytheModelonpage 56

GeneratetheDesignonpage 57

EvaluatetheDesignonpage 58

MaketheTableonpage 58

Chapter 3
Design of Experiments Guide

Starting Out with DOE


The Coffee Strength Experiment

43

Define Responses and Factors


Inthefirstoutlinesthatappear,enterinformationaboutyourresponseandfactors.
Responses
1. SelectDOE > Custom Design.
2. DoubleclickYunderResponseNameandtypeStrength.
NotethatthedefaultGoalisMaximize.Yourgoalistofindfactorsettingsthatenableyou
tobrewcoffeewithatargetstrengthof1.3,withinlimitsof1.2and1.4.
3. ClickonthedefaultGoalofMaximizeandchangeittoMatch Target.
Figure 3.4SelectionofMatchTargetastheGoal

4. ClickunderLower Limitandtype1.2.
5. ClickunderUpper Limitandtype1.4.
6. LeavetheareaunderImportanceblank.
Becausethereisonlyoneresponse,thatresponseisgivenImportance1bydefault.
ThecompletedResponsesoutlineappearsinFigure 3.5.
Factors
Enterfactorseithermanuallyorfromapreexistingtablethatcontainsthefactorsand
settings.Ifyouaredesigninganewexperiment,youmustfirstenterthefactorsmanually.
OnceyouhavesavedthefactorstoadatatableusingtheSaveFactorsoption,youcanload
themusingthesavedtable.
Forthisexample,youcanchooseeitheroption.SeeEnteringFactorsManuallyonpage 43or
seeEnteringFactorsUsingLoadFactorsonpage 45.
EnteringFactorsManually
1. ClickAdd Factor > Categorical > 2 Level.
2. TypeGrindoverthedefaultNameofX1.

44

Starting Out with DOE


The Coffee Strength Experiment

Chapter 3
Design of Experiments Guide

NotethatRoleissettoCategorical,asrequested.TheChangesattributeissettoEasyby
default,indicatingthatGrindsettingscanberesetforeveryrun.
3. ClickthedefaultValues,L1andL2,andchangethemtoCoarseandMedium.
4. Type3nexttoAdd N Factors. ThenclickAdd Factor > Continuous.
5. Typethefollowingnamesandvaluesoverthedefaultentries:
Temperature (195and205)
Time (3and4)
Charge(1.6and2.4)
6. ClickAdd Factor > Blocking > 4 runs per block.
Recallthatyourrunbudgetallowsfor12runs.Youwanttobalancetheserunsamongthe
threestations.
7. TypeStationoverthedefaultNameofX5.
NoticethatRoleissettoBlockingandthatonlyonesettingforValuesappears.Thisis
becauseJMPcannotdeterminethenumberofblocksuntilthedesirednumberofrunsis
specified.OnceyouspecifytheNumberofRunsintheDesignGenerationoutline,JMP
updatesthenumberoflevelsforStationtowhatisrequired.
ThecompletedFactorsoutlineisshowninFigure 3.5.
Figure 3.5CompletedResponsesandFactorsOutlines

8. ClickContinue.
ThefollowingoutlinesareaddedtotheCustomDesignwindow:
DefineFactorConstraints(notusedinthisexample)

Chapter 3
Design of Experiments Guide

Starting Out with DOE


The Coffee Strength Experiment

45

Model
AliasTerms
DesignGeneration
EnteringFactorsUsingLoadFactors
Toenterfactorsusingatablecontainingfactorinformation,proceedasfollows:
1. FromtheCustomDesignredtrianglemenu,selectLoad Factors.
2. SelectHelp > Sample Data LibraryandopenDesign Experiment/Coffee Factors.jmp.
Afterloadingthefactors,theCustomDesignwindowisupdated.Thefollowingoutlines
areaddedtotheCustomDesignwindow:
DefineFactorConstraints(notusedinthisexample)
Model
AliasTerms
DesignGeneration
DefineFactorConstraints
TheDefineFactorConstraintsoutlineappearsonceyouhaveenteredyourfactorsmanually
andclickedContinue,oronceyouhaveloadedthefactorsfromthefactortable.Addingfactor
constraints,ifyouhaveany,ispartoftheResponsesandFactorsstep.Sincethereareno
constraintsonfactorsettingsforthisdesign,leavethisoutlineunchanged.
Specify the Model
ModelOutline
Figure 3.7showstheModeloutline.TheModeloutlineiswhereyouspecifyyourassumed
model,whichcontainstheeffectsthatyouwanttoestimate.SeeSpecifyonpage 39.Thelist
thatappearsbydefaultshowsallmaineffectsasNecessary,indicatingthatthedesignis
capableofestimatingallmaineffects.Becauseyourmaininterestatthispointisinthemain
effectsofthefactors,youdonotaddanyeffectstotheModeloutline.

46

Starting Out with DOE


The Coffee Strength Experiment

Chapter 3
Design of Experiments Guide

Figure 3.6ModelOutlinewithMainEffectsOnly

Steps to Duplicate Results (Optional)


BecausetheCustomDesignalgorithmbeginswitharandomstartingdesign,yourdesign
mightdifferfromtheoneshowninFigure 3.8.Toobtainadesignwithexactlythesameruns
andrunorder,performthefollowingstepsbeforegeneratingyourdesign:
1. FromtheCustomDesignredtrianglemenu,selectSet Random Seed.
2. Type569534903.
3. ClickOK.
4. FromtheCustomDesignredtrianglemenu,selectNumber of Starts.
5. Type100.
6. ClickOK.
Note: SettingtheRandomSeedandNumberofStartsreproducestheexactresultsshownin
thisexample.Inconstructingadesignonyourown,thesestepsarenotnecessary.
Generate the Design
IntheDesignGenerationoutline,youcanenteradditionaldetailsaboutthestructureandsize
ofyourdesign.TheDefaultdesignisshownashaving12runs.Recallthatyourdesignbudget
allowsfor12runs(NumberofRunsonpage 42).
Figure 3.7DesignGenerationOutline

Chapter 3
Design of Experiments Guide

Starting Out with DOE


The Coffee Strength Experiment

47

1. ClickMake Design.
TheDesignandDesignEvaluationoutlinesareaddedtotheCustomDesignwindow.The
OutputOptionspanelalsoappears.
TheDesignoutlineshowsthedesign(Figure 3.8).IfyoudidnotfollowthestepsinSteps
toDuplicateResults(Optional)onpage 46,yourdesignmightbedifferentfromtheone
inFigure 3.8.Thisisbecausethealgorithmbeginswitharandomstartingdesign.
Figure 3.8DesignforCoffeeExperiment

Evaluate the Design


TheDesignEvaluationoutlineprovidesvariouswaystoevaluateyourdesign.Thisisan
importanttopic,butforsimplicity,itisnotcoveredinthecontextofthisexample.Seethe
EvaluateDesignschapteronpage 461.
Make the Table
SpecifytheorderofrunsinyourdatatableusingtheOutputOptionspanel.Thedefault
selection,Randomize within Blocks,isappropriate.Thisselectionarrangestherunsina
randomorderforeachStation.
Figure 3.9OutputOptions

1. ClickMake Table.
ThedatatableshowninFigure 3.10opens.Keepinmindthat,ifyoudidnotfollowthe
stepsinStepstoDuplicateResults(Optional)onpage 46,yourdesigntablemightbe
different.Yourdesigntablerepresentsanotheroptimaldesign.

48

Starting Out with DOE


The Coffee Strength Experiment

Chapter 3
Design of Experiments Guide

Figure 3.10CustomDesignTable

NotetheasterisksintheColumnspaneltotherightofthefactorsandresponse.Theseindicate
columnpropertiesthathavebeensavedtothecolumnsinthedatatable.Thesecolumn
propertiesareusedintheanalysisofthedata.Formoreinformation,seeFactorsonpage 85
andFactorColumnPropertiesonpage 90.

Run the Experiment


Atthispoint,youperformtheexperiment.AteachStation,fourrunsareconductedinthe
ordershowninthedesigntable.Equipmentandmaterialareresetbetweenruns.Forexample,
iftwoconsecutiverunsrequirewaterat195degrees,separate12ouncebatchesofwaterare
heatedto195degreesaftertheheatingcontainercools.TheStrengthmeasurementsare
recorded.
YourdesignandtheexperimentalresultsforStrengtharegivenintheCoffee Data.jmpsample
datatable(Figure 3.11),locatedintheDesign Experimentfolder.
Figure 3.11CoffeeDesignwithStrengthResults

Chapter 3
Design of Experiments Guide

Starting Out with DOE


The Coffee Strength Experiment

49

Analyze the Data


TheCustomDesignplatformfacilitatesthetaskofdataanalysisbysavingaModelscriptto
thedesigntablethatitcreates.SeeFigure 3.10.Runthisscriptafteryouconductyour
experimentandenteryourdata.ThescriptopensaFitModelwindowcontainingtheeffects
thatyouspecifiedintheModeloutlineoftheCustomDesignwindow.
FittheModel
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Coffee Data.jmp.
IntheTablespanel,noticetheModelscriptcreatedbyCustomDesign.
2. ClicktheredtrianglenexttoModelandselectRun Script.
TheModelSpecificationwindowshowstheeffectsthatyouspecifiedintheModeloutline.
Figure 3.12ModelSpecificationWindow

3. SelecttheKeep dialog openoption.


4. ClickRun.

50

Starting Out with DOE


The Coffee Strength Experiment

Chapter 3
Design of Experiments Guide

AnalyzetheModel
TheEffectSummaryandActualbyPredictedPlotreportsgivehighlevelinformationabout
themodel.
Figure 3.13EffectSummaryandActualbyPredictedPlotforFullModel

Notethefollowing:

TheActualbyPredictedPlotshowsnoevidenceoflackoffit.

Themodelissignificant,asindicatedbytheActualbyPredictedPlot.Thenotation
P = 0.0041,shownbelowtheplot,givesthesignificanceleveloftheoverallmodeltest.

TheEffectSummaryreportshowsthatCharge,Station,andTimearesignificantatthe0.05
level.

TheEffectSummaryreportalsoshowsthatTemperatureandGrindarenotsignificant.

ReducetheModel
BecauseTemperatureandGrindappearnottobeactive,theycontributerandomnoisetothe
model.Refitthemodelwithouttheseeffectstoobtainmorepreciseestimatesofthemodel
parametersassociatedwiththeactiveeffects.
1. IntheModelSpecificationwindow,selectTemperatureandGrindintheConstructModel
Effectslist.
2. ClickRemove.

Chapter 3
Design of Experiments Guide

Starting Out with DOE


The Coffee Strength Experiment

51

3. ChangetheEmphasistoEffect Screening.
TheEffectScreeningemphasispresentsreports(suchasthePredictionProfiler)thatare
usefulforanalyzingexperimentaldesigns.
4. ClickRun.
Figure 3.14PartialResultsforReducedModel

Notethefollowing:

TheEffectTestsreportshowsthatallthreeeffectsremainsignificant.

TheScaledEstimatesreportfurtherindicatesthattheStation[1]andStation[3]meansdiffer
significantlyfromtheaverageresponseofStrength.

NotethattheEstimatesthatappearintheParameterEstimatesreportareidenticaltotheir
counterpartsintheScaledEstimatesreport.Thisisbecausetheeffectsarecoded.See
Codingonpage 573intheColumnPropertiesappendix.

TheestimateoftheStation[3]effectonlyappearsintheScaledEstimatesreport,where
nominalfactorsareexpandedtoshowestimatesforalltheirlevels.

TheParameterEstimatesreportgivesestimatesforthemodelcoefficientswherethemodel
isspecifiedintermsofthecodedeffects.

52

Starting Out with DOE


The Coffee Strength Experiment

Chapter 3
Design of Experiments Guide

ExploretheModel
ThePredictionProfilerappearsatthebottomofthereport.
Figure 3.15PredictionProfiler

Recallthat,indesigningyourexperiment,yousetaresponseGoalofMatchTargetwithlimits
of1.2and1.4.JMPusesthisinformationtoconstructadesirabilityfunctiontoreflectyour
specifications.Formoredetails,seeFactorsonpage 85.
NotethefollowinginFigure 3.15:

ThefirsttwoplotsinthetoprowofthegraphshowhowStrengthvariesforoneofthe
factors,giventhesettingoftheotherfactor.Forexample,whenChargeis2,thelineinthe
plotforTimeshowshowpredictedStrengthchangeswithTime.

ThevaluestotheleftofthetoprowofplotsgivethePredictedStrength (inred)anda
confidenceintervalforthemeanStrength fortheselectedfactorsettings.

TherightmostplotinthetoprowshowsthedesirabilityfunctionforStrength.The
desirabilityfunctionindicatesthatthetargetof1.3ismostdesirable.Desirabilitydecreases
asyoumoveawayfromthattarget.Desirabilityiscloseto0atthelimitsof1.2and1.4.

Theplotsinthebottomrowshowthedesirabilitytraceforeachfactoratthesettingofthe
otherfactor.

ThevaluetotheleftofthebottomrowofplotsgivestheDesirabilityoftheresponsevalue
fortheselectedfactorsettings.

Explorevariousfactorsettingsbydraggingthereddashedverticallinesinthecolumnsfor
TimeandCharge.Sincetherearenointeractionsinthemodel,theprofilerindicatesthat
increasingChargeincreasesStrength.Also,Strengthseemstobemoresensitivetochangesin
ChargethantochangesinTime.

Chapter 3
Design of Experiments Guide

Starting Out with DOE


The Coffee Strength Experiment

53

SinceStationisablockingfactor,itdoesnotappearinthePredictionProfiler.However,you
mightliketoseehowpredictedStrengthvariesbyStation.ToincludeStationinthePrediction
Profiler,followthesesteps:
1. FromthePredictionProfilerredtrianglemenu,selectReset Factor Grid.
AFactorSettingswindowappearswithcolumnsforTime,Charge,andStation.Under
Station,noticethattheboxcorrespondingtoShowisnotselected.Thisindicatesthat
StationisnotshowninthePredictionProfiler.
2. SelecttheboxunderStationintherowcorrespondingtoShow.
3. DeselecttheboxunderStationintherowcorrespondingtoLock Factor Setting.
Figure 3.16FactorSettingsWindow

4. ClickOK.
PlotsforStationappearinthePredictionProfiler.
5. ClickineitherplotaboveStationtoinsertadashedredverticalline.
6. MovethedashedredverticallinetoStation1.
Figure 3.17PredictionProfilerShowingResultsforStation1

54

Starting Out with DOE


The DOE Workflow: Describe, Specify, Design

Chapter 3
Design of Experiments Guide

7. MovethedashedredverticallinetoStation3.
Figure 3.18PredictionProfilerShowingResultsforStation3

ThepredictedStrengthinthecenterofthedesignregionforStation1is1.44.ForStation3,
thepredictedStrengthisabout1.18.Themagnitudeofthedifferenceindicatesthatyou
needtoaddressStationvariability.BettercontrolofStationvariationshouldleadtomore
consistentStrength.OnceStationconsistencyisachieved,youcandeterminecommon
optimalsettingsforTimeandCharge.
Theprocessthatyouusedtoconstructthedesignforthecoffeeexperimentfollowedthesteps
intheDOEworkflow.ThenextsectiondescribestheDOEworkflowinmoredetail.

The DOE Workflow: Describe, Specify, Design


TheDOEplatformsarestructuredasaseriesofstepsthatpresenttheworkflowthatis
intrinsictodesigningexperiments.Onceyoucompleteeachstep,youclickContinuetomove
tothenextstep.Theelementsdescribedinthissectionarecommontonineofthedesignof
experimentsplatforms.Thesearetheplatformsthatareaddressedinthissection:

CustomDesign

DefinitiveScreeningDesign

ScreeningDesign

ResponseSurfaceDesign

FullFactorialDesign

MixtureDesign

CoveringArray

SpaceFillingDesign

TaguchiArrays

Chapter 3
Design of Experiments Guide

Starting Out with DOE


The DOE Workflow: Describe, Specify, Design

55

Threespecialpurposeplatformsdiffersubstantially:ChoiceDesigns,AcceleratedLifeTest
Design,andNonlinearDesign.Thesethreeplatformsarenotaddressedinthissection.
ThissectiondescribesthestepsintheDOEworkflow.Italsodiscussestheirimplementationin
thevariousdesignplatforms.
1. DefineResponsesandFactorsonpage 55.
2. SpecifytheModelonpage 56
3. GeneratetheDesignonpage 57
4. EvaluatetheDesignonpage 58
5. MaketheTableonpage 58

Define Responses and Factors


IntheDescribestepoftheexperimentaldesignframework:

Youidentifytheresponsesandfactorsofinterest.

Youdetermineyourgoalsfortheexperiment.Doyouwanttomaximizetheresponse,or
hitatarget?Whatisthattarget?Ordoyousimplywanttoidentifywhichfactorshavean
effectontheresponse?

Youidentifyfactorsettingsthatdescribeyourexperimentalrangeordesignspace.

Whentheyopen,mostoftheJMPDOEplatformsdisplayoutlineswhereyoucanlistyour
responsesandyourfactors.TheResponsesoutlineiscommonacrossplatforms.Thereyou
insertyourresponsesandadditionalinformation,suchastheresponsegoal,lowerlimit,
upperlimit,andimportance.
TheFactorsoutlinevariesacrossplatforms.Thisistoaccommodatethetypesoffactorsand
specificdesignsituationsthateachplatformaddresses.Incertainplatforms,onceresponses
andfactorsareentered,aDefineFactorConstraintsoutlineappearsafteryouclickContinue.
Inthisoutline,youcanconstrainthevaluesofthefactorsthatareavailableforthedesign.
Figure 3.19showstheResponsesandFactorsoutlineusingtheCustomDesignplatformfor
constructingthedesignintheBox Corrosion Split-Plot.jmpsampledatatable,locatedinthe
Design Experimentfolder.AlsoshownistheDefineFactorConstraintsoutline,whichappears
onceyouclickContinue.TheDefineConstraintsoutlineenablesyoutospecifyrestrictions
thatyourfactorsettingsmustsatisfy.

56

Starting Out with DOE


The DOE Workflow: Describe, Specify, Design

Chapter 3
Design of Experiments Guide

Figure 3.19ResponsesandFactorsforBoxCorrosionSplitPlotExperiment

Specify the Model


OnceyouhavecompletedfillingintheResponsesandFactorsoutlines,clicktheContinue
button.Thisbringsyoutothenextphaseofdesignconstruction,whereyoueitherexplicitlyor
implicitlychooseanassumedmodel.
TheCustomDesignplatformenablesyoutoexplicitlyspecifythemodelthatyouwanttofit.
Thedesignthatisgeneratedisoptimalforthismodel.Theotherdesignplatformsdonot
allowyoutoexplicitlyspecifyyourmodel.Forexample,inthescreeningplatform,oneoption
enablesyoutochoosefromalistoffullfactorial,fractionalfactorial,andPlackettBurman
designs.Thealiasingrelationshipsinthesedesignsimplicitlydefinethemodelsthatyoucan
fit.
InCustomDesign,whenyouclickContinueafterfillingintheResponsesandFactors,yousee
theModeloutline.Anexample,forthedesignusedintheBox Corrosion Split-Plot.jmpsample
datatable,isshowninFigure 3.20.TheassumedmodelrequiresthattheFurnace Tempand
Coatingmaineffects,andtheirinteraction,beestimable.Thedesignthatisgenerated
guaranteesestimabilityoftheseeffects.
Inmostotherplatforms,clickingContinuegivesyouacollectionofdesignstochoosefrom.In
FullFactorial,ContinuetakesyoudirectlytoOutputOptions,sincethedesignisdetermined
oncetheFactorsoutlineiscompleted.

Chapter 3
Design of Experiments Guide

Starting Out with DOE


The DOE Workflow: Describe, Specify, Design

57

Figure 3.20ModelOutlineforBoxCorrosionSplitPlotExperiment

Generate the Design


MostoftheDOEplatformsgiveyousomecontroloverthesizeofthefinaldesign.InCustom
Design,youcanspecifythenumberofrunsand,whenappropriate,thenumberofcenter
pointsandreplicateruns.Inotherplatforms,youhavevariousdegreesofflexibility.Oftenyou
canspecifythenumberofcenterpoints,replicateruns,orreplicatesofthedesign.
Onceyouhavespecifiedyouroptionsintermsofthenumberofruns,clickMakeDesign.The
DOEwindowisupdatedtoshowyourdesigninaDesignoutline.
TheDesignoutlinefora24runcustomdesignfortheBox Corrosion Split-Plot.jmpexperiment
isshowninFigure 3.21.BecauseChangesforFurnace TempwasspecifiedasHard,aWhole
PlotsfactorisconstructedtorepresenttherandomblocksofsettingsforFurnace Temp.
Figure 3.21DesignOutlineforBoxCorrosionSplitPlotExperiment

58

Starting Out with DOE


The DOE Workflow: Describe, Specify, Design

Chapter 3
Design of Experiments Guide

Evaluate the Design


WhenyouclickMakeDesign,inmostplatforms,aDesignEvaluationoutlineappears.Here
youcanexplorethedesignthatyoucreatedintermsofthefollowing:itspowertodetect
effects,itspredictionvariance,itsestimationefficiency,itsaliasingrelationships,the
correlationsbetweeneffects,andotherdesignefficiencymeasures.TheDesignEvaluation
outlineforaCustomDesignisshowninFigure 3.22.DesignEvaluationiscoveredinthe
EvaluateDesignschapteronpage 461.
Forsomeplatforms,othertypesofdesigndiagnosticsareappropriate.Forexample,Space
FillingDesignprovidesaDesignDiagnosticsoutlinewithmetricsspecifictospacefilling
designs.CoveringArrayprovidesaMetricsoutlinewithmeasuresthatarespecificto
coverage.
Figure 3.22DesignEvaluationOutlineinCustomDesign

Make the Table


MostplatformsprovideanOutputOptionsnodeorpanel.Dependingontheplatformandthe
design,youcanusetheOutputOptionspaneltospecifyadditionaldesignstructure.For
example,youcanspecifythenumberofruns,centerpoints,replicates,ortheorderinwhich
youwantthedesignrunstoappearinthegenerateddatatable.
TheOutputOptionspanelshowninFigure 3.23isfortheexperimentintheWine.jmpsample
datatable,locatedintheDesign Experimentfolder.Inthisexample,youcanchoosevarious
RunOrderoptionsandconstructthedesigndatatable.Or,youcanchoosetogoBackand
restructureyourdesign.
Figure 3.23OutputOptionsPanelforWineExperiment

Chapter 3
Design of Experiments Guide

Starting Out with DOE


Principles and Guidelines for Experimental Design

59

Principles and Guidelines for Experimental Design


Certainprinciplesunderliethedesignofexperimentsandtheanalysisofexperimentaldata.
Theprinciplesofeffecthierarchy,effectheredity,andeffectsparsityrelateprimarilytomodel
selection.Theseprincipleshelpyoureducethesetofpossiblemodelsinsearchingforabest
model.Fordetails,seeHamadaandWu,1992,andGoosandJones,2011.

Effect Hierarchy
Inregressionmodeling,theprincipleofeffecthierarchymaintainsthatmain(firstorder)effects
tendtoaccountforthelargestamountsofvariationintheresponse.Secondordereffects,that
is,interactioneffectsandquadraticterms,arenextintermsofaccountingforvariation.Then
comehigherorderterms,inhierarchicalorder.
Herearetheimplicationsformodeling:maineffectsaremorelikelytobeimportantthan
secondordereffects;secondordereffectsaremorelikelytobeimportantthanthirdorder
effects;andsoon,forhigherorderterms.

Effect Heredity
Theprincipleofeffectheredityrelatestotheinclusioninthemodeloflowerordercomponents
ofhigherordereffects.Themotivationforthisprincipleisobservationalevidencethatfactors
withsmallmaineffectstendnottohavesignificantinteractioneffects.
Strongeffectheredityrequiresthatalllowerordercomponentsofamodeleffectbeincludedin
themodel.Supposethatathreewayinteraction(ABC)isinthemodel.Thenallofits
componentmaineffectsandtwowayinteractions(A,B,C,AB,AC,BC)mustalsobeinthe
model.
Weakeffectheredityrequiresthatonlyasequenceoflowerordercomponentsofamodeleffect
beincluded.Ifathreewayinteractionisinthemodel,thenthemodelmustcontainoneofthe
factorsinvolvedandonetwowayinteractioninvolvingthatfactor.Supposethatthe
threewayinteractionABCisinthemodel.ThenifBandBCarealsointhemodel,themodel
satisfiesweakeffectheredity.
Forcontinuousfactors,effectheredityensuresthatthemodelisinvarianttochangesinthe
locationandscaleofthefactors.

Effect Sparsity
Theprincipleofeffectsparsityassertsthatmostofthevariationintheresponseisexplainedby
arelativelysmallnumberofeffects.Screeningdesigns,wheremanyeffectsarestudied,rely
heavilyoneffectsparsity.Experienceshowsthatthenumberofrunsusedinascreening
designshouldbeatleasttwicethenumberofeffectsthatarelikelytobesignificant.

60

Starting Out with DOE


Principles and Guidelines for Experimental Design

Chapter 3
Design of Experiments Guide

Center Points, Replicate Runs, and Testing


SeveralDOEplatformsenableyoutoaddcenterpoints(forcontinuousfactors),replicateruns,
orfullreplicatesofthedesign,toyourdesign.Hereissomebackgroundrelativetoadding
designpoints.
AddingCenterPoints
Centerpointsforcontinuousfactorsenableyoutotestforlackoffitduetononlineareffects.
Testingforlackoffithelpsyoudeterminewhethertheerrorvarianceestimatehasbeen
inflatedduetoamissingmodelterm.Thiscanbeawiseinvestmentofruns.
Youcanreplicaterunssolelyatcenterpointsoryoucanreplicateotherdesignruns.JMPuses
replicaterunstoconstructamodelindependenterrorestimate(pureerrorestimate).This
pureerrorestimateenablesyoutotestforlackoffit.
Beawarethatcenterpointsdonothelpyouobtainmorepreciseestimatesofmodeleffects.
Theyenableyoutotestforevidenceofcurvature,butdonotidentifytheresponsible
nonlineareffects.
Toidentifythesourceofcurvature,youmustsetcontinuousfactorsataminimumofthree
levels.Definitivescreeningdesignsarethreeleveldesignswiththeabilitytodetectand
identifyanyfactorscausingstrongnonlineareffectsontheresponse.Fordetails,seeChapter
6,DefinitiveScreeningDesigns.
AddingReplicateRuns
Ifyourrunbudgetallows,youcaneitherreplicaterunsordistributenewrunsoptimally
withinthedesignspace.Addingreplicaterunsaddsprecisionforsomeestimatesand
improvesthepowerofthelackoffittest.However,foragivenrunbudget,addingreplicate
runsgenerallylowerstheabilityofthedesigntoestimatemodeleffects.Youarenotableto
estimateasmanytermsasyoucouldbydistributingtherunsoptimallywithinthedesign
space.
TestingforLackofFit
Designedexperimentsaretypicallyconstructedtorequireasfewrunsaspossible,consistent
withthegoalsoftheexperiment.Withtoofewruns,onlyextremelylargeeffectscanbe
detected.Forexample,foragiveneffect,thetteststatisticistheratioofthechangein
responsemeanstotheirstandarderror.Ifthereisonlyoneerrordegreeoffreedom(df),then
thecriticalvalueofthetestexceeds12.So,forsuchanearlysaturateddesigntodetectan
effect,ithastobeverylarge.
Asimilarobservationappliestothelackoffittest.Thepowerofthistesttodetectlackoffit
dependsonthenumbersofdegreesoffreedominthenumeratoranddenominator.Ifyou
haveonly1dfofeachkind,youneedanFvaluethatexceeds150todeclaresignificanceatthe
0.05level.Ifyouhave2dfofeachkind,thentheFvaluemustexceed19.Inorderforthetestto

Chapter 3
Design of Experiments Guide

Starting Out with DOE


Principles and Guidelines for Experimental Design

61

besignificantinthissecondcase,thelackoffitmeansquaremustbe19timeslargerthanthe
pureerrormeansquare.Itisalsotruethatthelackoffittestissensitivetooutliers.
FordetailsabouttheLackofFittest,seetheStandardLeastSquareschapterintheFitting
LinearModelsbook.
DeterminingtheNumberofRuns
Inindustrialapplications,eachrunisoftenverycostly,sothereisincentivetominimizethe
numberofruns.Toestimatethefixedeffectsofinterest,youneedonlyasmanyrunsasthere
aretermsinthemodel.Todeterminewhethertheeffectsareactive,youneedareasonable
estimateoftheerrorvariance.Unlessyoualreadyhaveagoodestimateofthisvariance,
consideraddingatleast4runstothenumberrequiredtoestimatethemodelterms.

62

Starting Out with DOE


Principles and Guidelines for Experimental Design

Chapter 3
Design of Experiments Guide

Chapter 4
Custom Designs
Construct Designs That Meet Your Needs
UsetheCustomDesignplatformtoconstructoptimaldesignsthatarecustombuiltforyour
specificexperimentalsetting.Generally,acustomdesignismorecosteffectivethanadesign
obtainedusingalternativemethods.Youcanperformthefollowingtasks:

Enterfactorsofmanydifferenttypes.

Specifyconstraintsonthedesignspace.

Indicatewhicheffectsarenecessarytoestimateandwhicharedesirabletoestimate,if
possible,giventhenumberofruns.

Specifyanumberofexperimentalrunsthatmatchesyourbudget.

TheCustomDesignplatformconstructsawidevarietyofdesigns,includingthesespecial
designtypes:Screening,ResponseSurface,Mixture,RandomBlock,SplitPlot,SplitSplitPlot,
andTwoWaySplitPlot.
ThischaptercontainsadetailedexampleofhowtousetheCustomDesignplatform,followed
byinformationabouttheplatform.SeealsotheExamplesofCustomDesignschapteron
page 127.
Figure 4.1ColorMapforAbsoluteCorrelations

Contents
OverviewofCustomDesign ....................................................... 65
ExampleofaCustomDesign ...................................................... 66
CreatetheDesign ............................................................. 68
AnalyzetheData .............................................................. 77
CustomDesignWindow .......................................................... 83
Responses .................................................................... 83
Factors ....................................................................... 85
DefineFactorConstraints ...................................................... 91
Model ....................................................................... 95
AliasTerms................................................................... 96
DesignGeneration ............................................................ 97
Design ...................................................................... 100
DesignEvaluation ............................................................ 100
OutputOptions .............................................................. 101
CustomDesignOptions .......................................................... 102
SaveXMatrix ................................................................ 106
NumberofStarts ............................................................. 108
DesignSearchTime .......................................................... 108
SetDeltaforPower........................................................... 109
TechnicalDetails................................................................ 110
DesignswithRandomizationRestrictions ....................................... 110
CovariateswithHardtoChangeLevels ......................................... 119
NumbersofWholePlotsandSubplots .......................................... 120
OptimalityCriteria........................................................... 120
DEfficiency................................................................. 124
CoordinateExchangeAlgorithm............................................... 125

Chapter 4
Design of Experiments Guide

Custom Designs
Overview of Custom Design

65

Overview of Custom Design


UsetheCustomDesignplatformtoconstructanoptimaldesigncustombuiltforyourspecific
experimentalneeds.
Youcanincludeawiderangeoffactortypes,includingthefollowing:

Continuous

Discretenumeric(withanynumberoflevels)

Categorical(withanynumberoflevels)

Blocking(withanarbitrarynumberofrunsperblock)

Covariate

Mixture

Constant

Uncontrolled

SpecifytheRegionofOperability
Youcanrestrictyourexperimentalregiontoreflectyouroperatingconditionsusinglinear
factorconstraintsordisallowedcombinations.Inparticular,restrictionscanbespecifiedfor
categorical,continuous,anddiscretenumericfactors.SeeDefineFactorConstraintson
page 91.
SpecifyFactorswithHardtoChangeLevels
Forcontinuous,discretenumeric,categorical,andmixturefactors,youcanindicatetwolevels
ofdifficulttochangefactors.Thesedifficultylevelsarerepresentedbywholeplotsorwhole
plotsandsplitplots.Youcanalsospecifyhardtochangecovariates.
SpecifytheEffectsofPrimaryInterest
Youcanexplicitlyspecifyyourassumedmodel.Yourassumedmodelisaninitialmodelthat
ideallycontainsalltheeffectsthatyouwanttoestimate.Yourmodelcancontainany
combinationofmaineffects,interactions,responsesurfaceeffects,andpolynomialeffects(up
tothefifthpower).Youcanspecifytheeffectsforwhichestimabilityisnecessaryandthosefor
whichestimabilityisdesired.CustomDesignusesaBayesianoptimalityapproachtoestimate
effectswhoseestimabilityisdesired,subjecttothenumberofruns.SeeModelonpage 95.

66

Custom Designs
Example of a Custom Design

Chapter 4
Design of Experiments Guide

SpecifytheNumberofRuns
TheCustomDesignplatformenablesyoutospecifythenumberofrunsthatmatchesthe
budgetforyourexperimentalsituation.Theplatformindicatestheminimumnumberofruns
thatcanbeusedtoestimatetherequiredeffectsandprovidesadefaultnumberofruns.These
valuescanserveasaguidefordeterminingafeasiblenumberofruns.SeeDesign
Generationonpage 97.
ConstructtheAppropriateDesignType
CustomDesigncanconstructawidevarietyofdesigntypes.Theseincludeclassicaldesigns
andrandomblockdesigns.Forexamplesofdifferentdesigntypes,seetheExamplesof
CustomDesignschapteronpage 127.
ConstructanOptimalDesign
Givenyourspecificrequirements,theCustomDesignplatformconstructsadesignthatis
optimal.Thealgorithmsupportsseveraloptimalitycriteria:

Doptimality

Ioptimality

BayesianDandIoptimality(usingIfPossibleeffects)

Aliasoptimality

SeeOptimalityCriteriaonpage 120.
Designsareconstructedusingthecoordinateexchangealgorithm(MeyerandNachtsheim,
1995).SeeCoordinateExchangeAlgorithmonpage 125.

Example of a Custom Design


Thefollowingexampledescribesawinetastingexperiment.Youremployergrowstwo
varietiesofPinotNoirgrapesthatcanbeprocessedindifferentways.Yourgoalisto
determinewhichfactorsaffectthetasteofPinotNoirwine.Beforethegrapesareprocessed,
yousetupyourexperimentaldesign.Onceprocessed,thewinesamplesareagedfor12
months,thenfilteredandbottled.Atthispoint,thewinesamplesareratedforqualityby
expertwinetasters.
Response
Mostofyourvineyardsproductissoldtofivelargewinedistributors.Youarrangefora
winetastingexpertfromeachdistributortoevaluatethewinesamplesforquality.To
maximizethenumberoffactorsthatyoucanstudy,youdecidethateachexpertmustrate
eightdifferentsamples.Thismeansthatyourdesignneedstohave40winesamples,orruns.

Chapter 4
Design of Experiments Guide

Custom Designs
Example of a Custom Design

67

Theratingsfollowa0 20scale,where0istheworstand20isthebest.Rating,thevariable
consistingoftheexpertsratings,istheresponseofinterest.Youwanttoidentifythe
winerelatedfactorsthatmaximizetheresponse.
BlockingFactor
Ablockingfactorisusedtoaccountforvariationthatisnotnecessarilyofdirectinterest.A
blockingfactorisparticularlyeffectivewhenobservationstakenatonefactorlevelare
expectedtobemoresimilarthanobservationsatdifferentlevels.Inyourexperiment,ratings
byoneexpertarelikelytohavesimilarcharacteristicsandtodifferfromratingsbyadifferent
expert.Yet,youareinterestedinwhichpropertiesofthewineleadtohighratingsbyall
experts.
Becauseeachratertasteseightwines,Raterisablockingfactorwitheightrunsperblock.For
thisexperiment,onlythesefiveratersareofconcern.Youarenotinterestedingeneralizingto
alargerpopulationofraters.
ProcessFactors
Youhaveidentifiednineprocessfactorsforthestudy.Theseincludethegrapevariety,the
fieldonwhichthegrapesweregrown,andsevenotherfactorsrelatedtoprocessing.Youcan
experimentwithanycombinationofthesefactors.Also,thefactorscanbevariedatwillas
partoftheexperiment.Relativetotheexperiment,thesefactorsareallEasytochange.For
informationaboutspecifyingfactorchanges,seeChangesandRandomBlocksonpage 88.
ThefactorsandtheirlevelsappearinTable 4.1.Notethatallofthesefactorsarecategorical.
ThefactorsandtheirlevelsarealsogiveninthefactortableWine Factors.jmpintheDesign
ExperimentfolderofSample Data.
Toexperimentwithallpossiblecombinationsofthesefactorswouldrequireastaggering
8
4 2 = 1024 runs.However,inthisexample,youareabletoconstructacompellingdesignin
only40runs.
Table 4.1ProcessFactorsandLevelsforWineTastingExperiment
Factor

Levels

Variety

Bernard

Dijon

Field

De-Stem

No

Yes

Yeast

Cultured

Wild

Temperature

High

Low

Press

Hard

Soft

68

Custom Designs
Example of a Custom Design

Chapter 4
Design of Experiments Guide

Table 4.1ProcessFactorsandLevelsforWineTastingExperiment (Continued)


Factor

Levels

Barrel Age

New

2Years

Barrel Seasoning

Air

Kiln

Filtering

No

Yes

Create the Design


Note: InordertointroduceanddescribetheCustomDesignoutlines,thisexampleworks
throughtheoutlinesinsuccession.
Tocreatethecustomdesign,followthestepsinthesesections:

Responsesonpage 68

Factorsonpage 69

Modelonpage 71

AliasTermsonpage 71

StepstoDuplicateResults(Optional)onpage 72

DesignGenerationonpage 72

Designonpage 73

DesignEvaluationonpage 74

OutputOptionsonpage 76

ForinformationaboutthecompleteDOEworkflow,seeTheDOEWorkflow:Describe,
Specify,Designonpage 54intheStartingOutwithDOEchapter.
Responses
Addyourresponse,theresponseGoal,and,ifappropriate,theLowerLimit,UpperLimit,and
Importance.Here,theresponseisRating.
1. SelectDOE > Custom Design.
2. DoubleclickYunderResponseNameandtypeRating.
NotethatthedefaultGoalisMaximize.Becauseyouwanttomaximizethetasterating,do
notchangethegoal.
3. ClickunderLowerLimitandtype0.
Theleastdesirableratingis0.

Chapter 4
Design of Experiments Guide

Custom Designs
Example of a Custom Design

69

4. ClickunderUpperLimitandtype20.
Themostdesirableratingis20.
5. LeavetheareaunderImportanceblank.
Becausethereisonlyoneresponse,thatresponseisgivenImportance1bydefault.
Figure 4.2onpage 70showsthecompletedResponsesoutline.
Factors
Enterfactorseithermanuallyorautomaticallyusingapreexistingtablethatcontainsthe
factorsandsettings.

Ifyouaredesigninganewexperiment,youmustfirstenterthefactorsmanually.See
EnteringFactorsManuallyonpage 69.

OnceyouhavesavedthefactorsusingtheSaveFactorsoption,youcanloadthem
automaticallyusingthesavedtable.SeeEnteringFactorsUsingLoadFactorson
page 70.

BothmethodsaddthesefouroutlinestotheCustomDesignwindow:DefineFactor
Constraints,Model,AliasTerms,andDesignGeneration.
EnteringFactorsManually
1. First,addtheblockingfactor,Rater.ClickAdd Factor> Blocking > 8 runs per block.
2. TypeRateroverthedefaultName ofX1.
NotethatRoleissettoBlocking.NotealsothatonlyonesettingforValuesappears.Thisis
becausethenumberofblockscannotbedetermineduntilthedesirednumberofrunsis
specified.OnceyouspecifytheNumberofRunsintheDesignGenerationoutline,the
numberoflevelsforRaterupdatestowhatisrequired.
3. ClickAdd Factor> Categorical > 2 Level.
4. TypeVarietyoverthedefaultNameofX2.
NotethatRoleissettoCategorical,asrequested,andthatChangesissettoEasyby
default.
5. ClickL1andL2andchangethemtoBernardandDijon.
6. ClickAdd Factor > Categorical > 4 Level.
7. TypeFieldoverthedefaultNameofX3.
8. ClickL1,L2,L3,andL4,andchangethemto1,2,3,and4.
9. ClickAdd Factor>Categorical > 2 Level.
10. TypeDe-StemoverthedefaultNameofX4.

70

Custom Designs
Example of a Custom Design

Chapter 4
Design of Experiments Guide

11. ClickL1andL2andchangethemtoNoandYes.
Addtherestofthefactorsasfollows:
12. Type6nexttoAdd N Factors,andthenclickAdd Factor > Categorical > 2 Level.
13. Typethefollowingnamesandvaluesoverthedefaultones:
Yeast(CulturedandWild)
Temperature(HighandLow)
Press(HardandSoft)
Barrel Age(NewandTwoYears)
Barrel Seasoning(AirandKiln)
Filtering(NoandYes)
ThecompletedFactorsoutlineappearsinFigure 4.2.
Figure 4.2CompletedResponsesandFactorsOutlines

14. ClickContinue.
ThefollowingoutlinesareaddedtotheCustomDesignwindow:

DefineFactorConstraints(notusedinthisexample)

Model

AliasTerms

DesignGeneration

EnteringFactorsUsingLoadFactors
Toenterfactorsusingatablecontainingfactorinformation,proceedasfollows:

Chapter 4
Design of Experiments Guide

Custom Designs
Example of a Custom Design

71

1. FromtheCustomDesignredtrianglemenu,selectLoad Factors.
2. SelectHelp > Sample Data LibraryandopenDesign Experiment/Wine Factors.jmp.
Afterloadingthefactors,theCustomDesignwindowautomaticallyupdates.Thefollowing
outlinesareaddedtotheCustomDesignwindow:

DefineFactorConstraints(notusedinthisexample)

Model

AliasTerms

DesignGeneration

Model
TheModeloutlineshowsallmaineffectsasNecessary,indicatingthatthedesignneedstobe
capableofestimatingallmaineffects.Forthisexample,yourassumedmodelreflectsyour
interestinmaineffectsonly.However,ifyouwantedtoestimateothereffects,youcouldadd
themtotheModeloutline.SeeModelonpage 95.
Figure 4.3ModelOutline

Alias Terms
TheAliasTermsoutlinespecifiestheeffectstobeshownintheAliasMatrix,whichappears
later.SeeAliasMatrixonpage 75.TheAliasMatrixshowsthealiasingrelationships
betweentheModeltermsandtheeffectslistedintheAliasTermsoutline.OpentheAlias
Termsoutlinenodetoverifythatalltwofactorinteractionsarelisted.

72

Custom Designs
Example of a Custom Design

Chapter 4
Design of Experiments Guide

Figure 4.4PartialViewoftheAliasTermsOutline

Steps to Duplicate Results (Optional)


Inthenextstep,yougenerateyourdesign.BecausetheCustomDesignalgorithmbeginswith
arandomstartingdesign,yourdesignmightdifferfromtheoneshowninFigure 4.5.Ifyou
wanttoobtainadesignwithexactlythesamerunsandrunorder,performthefollowing
steps:
1. FromtheCustomDesignredtrianglemenu,selectSet Random Seed.
2. Type100526291(therandomseed).
3. ClickOK.
4. FromtheCustomDesignredtrianglemenu,selectNumber of Starts.
5. Type2.
6. ClickOK.
Note: SettingtheRandomSeedandNumberofStartsreproducestheexactresultsshownin
thisexample.Inconstructingadesignonyourown,thesestepsarenotnecessary.
ProceedtotheDesignGenerationsection.
Design Generation
IntheDesignGenerationoutline,youcanenteradditionaldetailsaboutthestructureandsize
ofyourdesign.Inthisexample,theDefaultdesignshows16runs.Butyouhavefiveraters,
eachofwhomcansampleeightwines.Thismeansthatyouwantadesignwith40runs.
Changethenumberofrunsasfollows:
1. UnderNumber of Runs,type40intheUser Specifiedbox.
Becauseyoudonotwanttoreplicateruns,leavetheNumber of Replicate Runs setto0.

Chapter 4
Design of Experiments Guide

Custom Designs
Example of a Custom Design

73

2. ClickMake Design.
TheDesignandDesignEvaluationoutlinesareaddedtotheCustomDesignwindow.The
OutputOptionspanelalsoappears.
Design
TheDesignoutlineshowstherunsinthedesignthatyouhaveconstructed.Later,youareable
torandomizetheorderunderOutputOptions.Fornow,verifythatthisdesignisappropriate
foryourexperiment.Forexample,checkthateachoffiveRatersevaluateseightwines,thatall
necessaryfactorsareshown,andthatnoneofthesettingsrepresentinfeasiblecombinations.
Figure 4.5DesignforWineExperiment

74

Custom Designs
Example of a Custom Design

Chapter 4
Design of Experiments Guide

Design Evaluation
TheDesignEvaluationoutlineprovidesdifferentwaystoevaluateyourdesign.
Note: FordetailsabouttheDesignEvaluationoutline,seetheEvaluateDesignschapteron
page 461chapter.
Forthisexample,opentheDesignEvaluationoutline,andexaminetheColorMapon
Correlations,theAliasMatrix,andDesignDiagnostics.
ColorMaponCorrelations
TheColorMaponCorrelationsshowstheabsolutecorrelationsbetweeneffects.
Figure 4.6ColorMaponCorrelations

Themaineffectsarerepresentedbythe15termsintheupperleftcornerofthemap.Thedeep
bluecolorcorrespondingtothecorrelationsofmaineffectswithothermaineffectsindicate
correlationsof0.Thismeansthatallmaineffectsareorthogonalandcanbeestimated
independently.

Chapter 4
Design of Experiments Guide

Custom Designs
Example of a Custom Design

75

TheonlyredinFigure 4.6isonthemaindiagonal.Thecolorindicatesabsolutecorrelationsof
one,reflectingthateachtermisperfectlycorrelatedwithitself.Itfollowsthatnomaineffectis
completelyconfoundedwithanytwowayinteraction.Infact,theabsolutevaluesofthe
correlationsofmaineffectswithtwowayinteractionsarefairlylow.Thismeansthatestimates
ofmaineffectsmightbeonlyslightlybiasedbythepresenceofactivetwowayinteractions.
Tip: Positionyourmousepointerovercellsinthecolormaptoseetheabsolutecorrelations
betweeneffects.
AliasMatrix
IntheAliasMatrix,modeleffectsarelistedinthecolumnontheleft.Foragivenmodeleffect,
acolumnentryindicatesthedegreetowhichthecolumneffect(ifactive)biasestheestimateof
themodeleffect.
Figure 4.7PartialViewofAliasMatrix

Forexample,considerthemodeleffectBarrel Seasoning.IfVariety*Pressisactive,thenthe
expectedvalueoftheestimatefortheBarrel Seasoningeffectdiffersfromanunbiasedestimate
ofthateffect.Theamountbywhichitdiffersisequalto0.4timestheeffectofVariety*Press.
Therefore,whatappearstobeasignificantBarrel Seasoningestimatedeffectcouldinrealitybe
asignificantVariety*Presseffect.
DesignDiagnostics
TheDesignDiagnosticsoutlineprovidesinformationabouttheefficiencyofthedesign.
Efficiencymeasurescompareyourdesigntoatheoreticallyoptimaldesign,whichmightnot
exist.Theefficiencyvaluesareratios,expressedaspercents,oftheefficiencyofyourdesignto
theefficiencyofthisoptimaldesign.Fordetailsabouttheefficiencymeasures,seeEstimation
Efficiencyonpage 487intheEvaluateDesignschapter.

76

Custom Designs
Example of a Custom Design

Chapter 4
Design of Experiments Guide

Figure 4.8DesignDiagnosticsOutline

NoticethattheD,G,andAefficiencyvaluesareall100%.Becauseyourdesignisorthogonal
formaineffects,thedesignisoptimalforthemaineffectsmodelrelativetoallthreeefficiency
criteria.
ThefirstlineintheDesignDiagnosticsoutlineindicatesthatyourdesignwasconstructedto
optimizetheDefficiencycriterion.Formoredetails,seetheOptimalityCriteriondescription
inCustomDesignOptionsonpage 102.Inthiscase,yourdesignhasDEfficiencyof100%.
Output Options
SpecifytheorderofrunsinyourdatatableusingtheOutputOptionspanel.Thedefault
selection,Randomize within Blocks,isappropriateforthisexample.SimplyclickMake Table.
ACustomDesigntableiscreatedandopens,similartotheoneinFigure 4.9.
Note: Yourtablemightlookdifferentbecausethealgorithmthatcreatesitusesarandom
startingdesign.ToobtaintheprecisetableshowninFigure 4.9,seeDesignonpage 73.
Figure 4.9CustomDesignTable

Chapter 4
Design of Experiments Guide

Custom Designs
Example of a Custom Design

77

Notethefollowing:

IntheTablepanel,theModelscriptandtheDOEDialogscriptareaddedduringthe
designcreationprocess.TheModelscriptopensaFitModelwindowcontainingthe
effectsthatyouspecifiedasNecessaryintheCustomDesigndialog.TheDOEDialog
scriptrecreatesthewindowusedtogeneratethedesigntable.

IntheColumnspanel,theasteriskstotherightofthefactorsandresponseindicatecolumn
propertiesthathavebeensavedtothecolumnsinthedatatable.Thesecolumnproperties
areusedintheanalysisofthedata.Fordetailsaboutcolumnproperties,seeFactorson
page 85andFactorColumnPropertiesonpage 90.

Analyze the Data


Nowyouarereadytorunyourexperiment,gathertheRatingdata,andinserttheresultsinthe
RatingcolumnofyourCustomDesigntable.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Wine Data.jmp.
TheWine Data.jmptableisexactlythesameastheCustomDesigntableshownin
Figure 4.9,exceptthatitcontainsyourrecordedexperimentalresults.
2. SelectRun Script fromtheredtriangletotheleftoftheModelscript.
Figure 4.10FitModelDialogforWineExperiment

NoticethatRater,theblockingfactor,isaddedasafixedeffect,ratherthanasarandom
blockeffect.Thisisappropriatebecausethefiveraterswerespecificallychosenandarenot
arandomsamplefromalargerpopulation.

78

Custom Designs
Example of a Custom Design

Chapter 4
Design of Experiments Guide

3. ClickRun.
Interpret the Full Model Results
Theresultsareshownbelow.
Figure 4.11PartialModelFitResults

Notethefollowing:

TheActualbyPredictedPlotshowsnoobviousevidenceoflackoffit.

Chapter 4
Design of Experiments Guide

Custom Designs
Example of a Custom Design

79

Themodelissignificant,asindicatedbytheActualbyPredictedPlotandbythePvalue
beneathit.

TheEffectTestsreportindicatesthatsevenofthemodeltermsaresignificantatthe0.05
level.Field,Temperature,andBarrel Agearenotsignificant.

TheEffectSummaryreportliststheseeffectsindecreasingorderofsignificance.Larger
LogWorthvaluescorrespondtohigherPValuesandgreatersignificance.

Reduce the Model


Reducethemodelbyremovingtheeffectsthatyouidentifiedasinactive:
1. IntheEffectSummaryreport,presstheControlkeyandholditasyouselectTemperature,
Field,andBarrel Age.
2. ClickRemove.
Thereportupdatestoshowthemodelfitwiththesethreeeffectsremoved.
Interpret the Reduced Model Results
TheActualbyPredictedPlotforthereducedmodelshowsnolackoffitissues.TheEffect
SummaryandtheEffectTestreportshowthattheremainingseventermsaresignificantatthe
0.05level.
Figure 4.12showsthePredictionProfiler.Recallthatyouspecifiedaresponsegoalof
Maximize,withlowerandupperlimitsof0and20.SettingtheselimitscausedaResponse
LimitscolumnpropertytobesavedtotheRatingcolumnintheCustomDesigntable.The
PredictionProfilerusestheResponseLimitsinformationtoconstructaDesirabilityfunction,
whichappearsintherightmostplotinthetoprowinFigure 4.12.Thebottomrowdisplays
Desirabilitytraces.
Thefirstsixplotsinthetoprowshowtracesofthepredictedmodel.Foreachfactor,thelinein
theplotshowshowRatingvarieswhenallotherfactorsaresetatthevaluesdefinedbythered
dashedverticallines.Bydefault,theprofilerappearswithcategoricalfactorssetattheirlow
settings.Byvaryingthesettingsforthefactors,youcanseehowthepredictedRatingforwines
changes.NoticethataconfidenceintervalisgivenforthemeanpredictedRating.
ObservethatRaterisnotincludedamongthefactorsshownintheprofiler.Thisisbecause
Raterisablockvariable.YouincludedRatertoexplainvariation,butRaterisnotofdirect
interestintermsofoptimizingprocessfactorsettings.ThepredictedRatingforawinewiththe
givensettingsistheaverageofthepredictedratingsforthatwinebyallraters.

80

Custom Designs
Example of a Custom Design

Chapter 4
Design of Experiments Guide

Figure 4.12ProfilerforReducedModel

IfyouwanttoseetheProfilertracesforthelevelsofRater,performthefollowingsteps:
1. FromthePredictionProfilerredtrianglemenu,selectReset Factor Grid.
AFactorSettingswindowappearswithcolumnsforallofthefactors,includingRater.The
boxunderRaterandnexttoShowisnotchecked.ThisindicatesthatRaterisnotshownin
thePredictionProfiler.
2. ChecktheboxunderRaterintherowcorrespondingtoShow.
3. DeselecttheboxunderRaterintherowcorrespondingtoLock Factor Setting.
4. ClickOK.
TheProfilerupdatestoshowaplotforRater.
5. ClickineitherplotaboveRater.
Figure 4.13ProfilerforReducedModelShowingRater

Adashedverticalredlineappears.Dragthislinetoseethetracesforeachoftheraters.

Chapter 4
Design of Experiments Guide

Custom Designs
Example of a Custom Design

81

Optimize Factor Settings


YouwouldliketoidentifysettingsthatmaximizeRating.
1. FromthePredictionProfilerredtrianglemenu,selectMaximize Desirability.
ThereddashedverticallinesinthePredictionProfilerupdatetoshowoptimalsettingsfor
eachfactor.Theoptimalsettingsresultinapredictedratingof19.925.Ingeneral,therecan
bedifferentsetsoffactorsettingsthatresultinthesameoptimalvalue.
Figure 4.14PredictionProfilerwithFactorSettingsOptimized

2. Toseepredictedratingsforallruns,savethePredictionFormula.FromtheResponse
Ratingredtrianglemenu,selectSave Columns > Prediction Formula.
AcolumncalledPred Formula Ratingisaddedtothedatatable.Notethatoneoftheruns,
row33,wasgiventhemaximumratingof20byRater5.Thepredictedratingforthatrun
byRater5is19.550.Buttherow33trialwasrunattheoptimalsettings.Thepredicted
valueof19.925givenforthesesettingsinthePredictionProfilerisobtainedbyaveraging
thepredictedratingsforthatrunoverallfiveraters.
Lock a Factor Level
Whenyoumaximizeddesirability,youlearnedthattheoptimalratingisachievedwiththe
Dijonvarietyofgrapes.SeeFigure 4.14.Yourmanagerpointsoutthatitwouldbe
costprohibitivetoreplantthefieldsthataregrowingBernardgrapeswithyoungDijonvines.
Therefore,youneedtofindoptimalprocesssettingsandthepredictedratingforBernard
grapes.
1. IntheVarietyplotofthePredictionProfiler,dragthereddashedverticallinetoBernard.
2. PressControlandclickinoneoftheVarietyplots.
TheFactorSettingswindowappears.
3. SelectLock Factor SettingandclickOK.

82

Custom Designs
Example of a Custom Design

Chapter 4
Design of Experiments Guide

4. FromthePredictionProfilerredtrianglemenu,selectMaximize Desirability.
Figure 4.15PredictionProfilerwithOptimalSettingsforBernardVariety

Theoptimalsettingsareunchangedbecausethemodelcontainsnointeractionterms.The
predictedratingatthesesettingsis17.975.
Summary
Inyourwinetastingexperiment,usingonly40runs,youhaveidentifiedsix(outofnine)
factorsthathaveaneffectonratingsforPinotNoirgrapes.Youfoundthatyoucouldachievea
predictedratingof19.925(outofapossible20)attheoptimalsettingsforthosefactors.You
alsoidentifiedoptimalsettingsforbothvarietiesofgrapes.
Inthissection,youconstructedadesignusingtheoutlinesintheCustomDesignwindow.The
nextsectionexplainseachoutlineandthedesignstepsinmoredetail.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Window

83

Custom Design Window


TheCustomDesignwindowupdatesasyouworkthroughthedesignsteps.Theoutlinesthat
appear,separatedbybuttonsthatupdatethewindow,followtheflowinFigure 4.16.
Figure 4.16CustomDesignFlow
Responses
Factors

Continue

Define Factor Constraints


Model
Alias Terms
Design Generation

Make
Design

Design
Design Evaluation
Output Options

Make
Table

ThissectiondescribestheoutlinesintheCustomDesignwindow.

Responses
UsetheResponsesoutlinetospecifyoneormoreresponses.
Figure 4.17ResponsesOutline

TheResponsesoutlinecontainsthefollowingbuttons:

84

Custom Designs
Custom Design Window

Chapter 4
Design of Experiments Guide

EntersasingleresponsewithagoaltypeofMaximize,MatchTarget,
Minimize,orNone.IfyouselectMatchTarget,enterlimitsforyourtargetvalue.Ifyou
selectMaximizeorMinimize,enteringlimitsisnotrequiredbutcanbeuseful.

Add Response

Remove Removestheselectedresponses.

Entersadditionalresponsessothatthenumberthatyouenteristhe
totalnumberofresponses.IfyouhaveenteredaresponseotherthanthedefaultY,the
GoalforeachoftheadditionalresponsesistheGoalassociatedwiththelastresponse
entered.Otherwise,theGoaldefaultstoMatchTarget.ClicktheGoaltypeinthetableto
changeit.

Number of Responses

Tip: WhenyouhavecompletedyourResponsespanel,considerselectingSave Responses


fromtheredtrianglemenu.Thissavestheresponsenames,goals,limits,andimportance
valuesinadatatablethatyoucanlaterreload.
TheResponsesoutlinecontainsthefollowingcolumns:
Thenameoftheresponse.Whenadded,aresponseisgivenadefaultname
ofY,Y2,andsoon.Tochangethisname,doubleclickitandenterthedesiredname.

Response Name

Goal, Lower Limit, Upper Limit TheGoaltellsJMPwhetheryouwanttomaximizeyour

response,minimizeyourresponse,matchatarget,orthatyouhavenoresponsegoal.JMP
assignsaResponseLimitscolumnproperty,basedonthesespecifications,toeachresponse
columninthedesigntable.Itusesthisinformationtodefineadesirabilityfunctionforeach
response.TheProfilerandContourProfilerusethesedesirabilityfunctionstofindoptimal
factorsettings.Forfurtherdetails,seetheProfilersbookandResponseLimitson
page 562intheColumnPropertiesappendix.
AGoalofMaximizeindicatesthatthebestvalueisthelargestpossible.Ifthereare
naturallowerorupperbounds,youcanspecifytheseastheLowerLimitorUpper
Limit.
AGoalofMinimizeindicatesthatthebestvalueisthesmallestpossible.Ifthereare
naturallowerorupperbounds,youcanspecifytheseastheLowerLimitorUpper
Limit.
AGoalofMatchTargetindicatesthatthebestvalueisaspecifictargetvalue.The
defaulttargetvalueisassumedtobemidwaybetweentheLowerLimitandUpper
Limit.
AGoalofNoneindicatesthatthereisnogoalintermsofoptimization.Nodesirability
functionisconstructed.
Note: IfyourtargetresponseisnotmidwaybetweentheLowerLimitandtheUpper
Limit,youcanchangethetargetafteryougenerateyourdesigntable.Inthedatatable,
opentheColumnInfowindowfortheresponsecolumn(Cols>Column Info)andenterthe
desiredtargetvalue.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Window

85

Importance Whenyouhaveseveralresponses,theImportancevaluesthatyouspecifyare

usedtocomputeanoveralldesirabilityfunction.Thesevaluesaretreatedasweightsfor
theresponses.Ifthereisonlyoneresponse,thenspecifyingtheImportanceisunnecessary
becauseitissetto1bydefault.
EditingtheResponsesOutline
IntheResponsesoutline,notethefollowing:

Doubleclickaresponsetoedittheresponsename.

Clickthegoaltochangeit.

Clickonalimitorimportancevaluetochangeit.

Formultipleresponses,youmightwanttoentervaluesfortheimportanceweights.

Response Limits Column Property


TheGoal,LowerLimit,UpperLimit,andImportancethatyouspecifywhenyouentera
responseareusedinfindingoptimalfactorsettings.Foreachresponse,theinformationis
savedinthegenerateddesigndatatableasaResponseLimitscolumnproperty.JMPusesthis
informationtodefinethedesirabilityfunction.Thedesirabilityfunctionisusedinthe
PredictionProfilertofindoptimalfactorsettings.ForfurtherdetailsabouttheResponse
Limitscolumnpropertyandexamplesofitsuse,seeResponseLimitsonpage 562inthe
ColumnPropertiesappendix.
IfyoudonotspecifyaLowerLimitandUpperLimit,JMPusestherangeoftheobserveddata
fortheresponsetodefinethelimitsforthedesirabilityfunction.SpecifyingtheLowerLimit
andUpperLimitgivesyoucontroloverthespecificationofthedesirabilityfunction.Formore
detailsabouttheconstructionofthedesirabilityfunction,seetheProfilersbook.

Factors
AddfactorsintheFactorsoutline.
Figure 4.18FactorsOutline

86

Custom Designs
Custom Design Window
Add Factor

Chapter 4
Design of Experiments Guide

Selectthefactortype.Fordetails,seeFactorTypesonpage 87.

Remove Removestheselectedfactors.

Note: IfyouattempttoremoveallfactorsafterclickingtheContinueorBackbutton,one
continuousfactorremains.Youcandeleteitafteryouaddnewfactors.
Add N Factors Addsmultiplefactors.Enterthenumberoffactorstoadd,clickAdd Factor,

andthenselectthefactortype.RepeatAdd N Factorstoaddmultiplefactorsofdifferent
types.
Tip: WhenyouhavecompletedtheFactorsoutline,considerselectingSave Factorsfromthe
redtrianglemenu.Thissavestheresponsenames,goals,limits,andimportancevaluesina
datatablethatyoucanlaterreload.
Factors Outline
TheFactorsoutlinecontainsthefollowingcolumns:
Thenameofthefactor.Whenadded,afactorisgivenadefaultnameofX1,X2,andso
on.Tochangethisname,doubleclickitandenterthedesiredname.

Name

Role SpecifiestheDesignRoleofthefactor.TheDesignRolecolumnpropertyforthefactor

issavedtothedatatable.Thispropertyensuresthatthefactortypeismodeled
appropriately.
Changes IndicateswhetherthefactorlevelsareEasy,Hard,orVeryHardtochange.Clickon

thedefaultvalueofEasytochangeit.WhenyouspecifyfactorsasHardorVeryHardto
change,yourdesignreflectstheserestrictionsonrandomization.Afactorcannotbe
designatedasVeryHardunlesstheFactorslistcontainsafactordesignatedasHard.The
FactorChangescolumnpropertyissavedtothedatatable.Formoredetails,seeChanges
andRandomBlocksonpage 88.
Theexperimentalsettingsforthefactors.ToinsertValues,clickonthedefaultvalues
andenterthedesiredvalues.

Values

EditingtheFactorsOutline
IntheFactorsoutline,notethefollowing:

Toeditafactorname,doubleclickthefactorname.

Categoricalfactorshaveadownarrowtotheleftofthefactorname.Clickthearrowto
addalevel.

Toremoveafactorlevel,clickthevalue,clickDelete,andclickoutsidethetextbox.

TomodifytheentryunderChanges,clickthevalueintheChangescolumnandselectthe
appropriateentry.

Toeditavalue,clickthevalueintheValuescolumn.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Window

87

Factor Types
Tochooseafactortype,clickAdd FactorinCustomDesign.
Note: ADesignRolecolumnpropertycontainingeachfactorsroleisaddedtothatfactors
columninthedesigntablethatisgenerated.TheDesignRolecolumnpropertyensuresthat
thefactorismodeledcorrectly.
Continuous Numericdatatypesonly.Acontinuousfactorisafactorthatyoucan

conceptuallysettoanyvaluebetweenthelowerandupperlimitsyousupply,giventhe
limitationsofyourprocessandmeasurementsystem.
Discrete Numeric Numericdatatypesonly.Adiscretenumericfactorcanassumeonlya

discretenumberofvalues.Thesevalueshaveanimpliedorder.
Thedefaultvaluesforadiscretenumericfactorwithklevels,where k 2 ,aretheintegers
1 2 k .Thedefaultvaluesforadiscretenumericfactorwith k = 2 levelsare1and1.
Replacethedefaultvalueswiththesettingsthatyouplantouseinyourexperiment.
Note: Notalllevelsofadiscretenumericfactorappearinthedesign.Thelevelsthat
appeararedeterminedbyyourspecificationsintheModeloutline.
Intheassumedmodel,theeffectsforadiscretenumericfactorwithklevelsinclude
polynomialtermsinthateffectthroughorderk1.Forkgreaterthan6,powersuptothe5th
levelareincluded.TheEstimabilityforpolynomialeffects(powersoftwoorhigher)isset
toIfPossible.Thisallowsthealgorithmtousethemultiplelevelsaspermittedbytherun
size.Ifthepolynomialtermsarenotincluded,thenamaineffectsonlydesigniscreated.
Formoredetailsabouthowdiscretenumericfactorsaretreatedintheassumedmodel,see
Modelonpage 95.
FitModeltreatsadiscretenumericfactorasacontinuouspredictor.TheModelscriptthat
issavedtothedesigntabledoesnotcontainanypolynomialtermsofordergreaterthan
two.
Eithernumericorcharacterdatatypes.Thedatatypeintheresultingdatatable
iscategorical.Thevalueorderingofthelevelsistheorderofthevalues,asenteredfrom
lefttoright.ThisorderingissavedintheValueOrderingcolumnpropertyafterthedesign
datatableiscreated.

Categorical

Blocking Eithernumericorcharacterdatatypes.Ablockingfactorisaspecialtypeof

categoricalfactorthatcanenterthemodelonlyasamaineffect.Whenyoudefinea
blockingfactor,youspecifythenumberofrunsperblock.TheRunsPerBlockcolumn
propertyissavedtothedesigntable.TheDefaultrunsizealwaysassumesthatthereareat
leasttwoblocks.Ifyouspecifyarunsizethatisnotanintegermultipleofthenumberof
runsperblock,JMPtriestobalancethedesigntotheextentpossible.Inbalancingthe
design,JMPensuresthatthereareatleasttworunsperblock.

88

Custom Designs
Custom Design Window

Chapter 4
Design of Experiments Guide

Covariate Eithernumericorcharacterdatatypes.Thevaluesofacovariatefactorare

measurementsonexperimentalunitsthatareknowninadvanceofanexperiment.
Covariatevaluesareselectedtoensuretheoptimalityoftheresultingdesignrelativetothe
optimalitycriterion.SeeChangesandRandomBlocksonpage 88andCovariateswith
HardtoChangeLevelsonpage 119.
JMPobtainsthecovariatefactorsandtheirvaluesfromadatatablethatcontainsthe
measuredcovariatesfortheavailableexperimentalunits.Makethisdatatableyourcurrent
datatable.WhenyouselectCovariate,alistofcolumnsinthecurrentdatatableopens,and
youselectthecolumnscontainingcovariatesfromthislist.
Note: YoucannotspecifyaNumberofRunsorNumberofWholePlotsthatexceedsthe
numberofrowsinthecovariatesdatatable.
Mixture Continuousfactorsthatrepresentingredientsinamixture.Thevaluesforamixture

factormustsumtoaconstant.Bydefault,thevaluesforallmixturefactorssumtoone.To
setthesumofthemixturecomponentstosomeotherpositivevalue,selectAdvanced
Options > Mixture Sumfromtheredtrianglemenu.TheMixturecolumnpropertyissaved
tothedatatable.
Eithernumericorcharacterdatatypes.Aconstantfactorisafactorwhosevalues
arefixedduringanexperiment.ConstantfactorsarenotincludedintheModeloutlineor
intheModelscriptthatissavedtothedatatable.

Constant

Uncontrolled Eithernumericorcharacterdatatypes.Anuncontrolledfactorisonewhose

valuescannotbecontrolledduringanexperiment,butitisafactorthatyouwantto
includeinthemodel.AnemptycolumnwithaContinuousModelingTypeiscreatedin
thedesigntable.YoucanchangethecolumnsDataTypeandModelingTypeinthe
ColumnInfowindowifrequired.Enteryourdatainthiscolumn.Uncontrolledfactorsare
includedintheModeloutlineandtheModelscriptthatissavedtothedatatable.
Changes and Random Blocks
Specifyingtherelativedifficultyofchangingafactorfromruntorunisusefulinindustrial
experimentation.Itisoftenconvenienttomakeseveralrunswhilekeepingfactorsthatare
hardtochangefixedatsomesetting.AChangesvalueofHardresultsinasplitplotdesign.A
ChangesvalueofVeryHardresultsinasplitsplitplotdesignoratwowaysplitplotdesign.
YoucansetChangesforContinuous,DiscreteNumeric,Categorical,andMixturefactorsto
HardandVeryHard.TosetafactortoVeryHard,thelistmustcontainanotherfactorthatis
settoHard.
YoucansetChangesforaCovariatefactortoHard.Inthiscase,allothercovariatesarealsoset
toHardandtheremainingfactorsaresettoEasy.Thealgorithmrequiresacombinationof
rowexchangeandcoordinateexchange.Forthisreason,evenmoderatelysizeddesignsmight
takesometimetogenerate.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Window

89

FordesignswithHardorVeryHardtochangefactors,CustomDesignstrivestofindadesign
thatisoptimal,givenyourspecifiedoptimalitycriterion.SeeOptimalityCriteriaon
page 120.Fordetailsaboutthemethodologyusedtogeneratesplitplotdesigns,seeJonesand
Goos(2007).Fordetailsrelatingtodesignswithhardtochangecovariates,seeJonesandGoos
(2014,toappear).
Figure 4.19showsasplitsplitplotscenario,usingthefactorsfromtheCheese Factors.jmp
sampledatatable(locatedintheDesignExperimentfolder).
Figure 4.19FactorsandDesignGenerationOutlineforaSplitSplitPlotDesign

IfyouassignChangesasHardforoneormorefactors,butnofactorshaveChangesassigned
asVeryHard,acategoricalfactorcalledWhole Plotsisaddedtothedesign.Thissituation
resultsinasplitplotdesign:

EachlevelofWhole Plotscorrespondstoablockofconstantsettingsofthehardtochange
factors.
TheModelscriptinthedesigntableappliestheRandomEffectattributetothefactor
Whole Plots.

ThefactorWhole PlotsisassignedtheDesignRolecolumnpropertywithavalueof
RandomBlock.

90

Custom Designs
Custom Design Window

Chapter 4
Design of Experiments Guide

WhenyoudesignateChangesasbothHardandVeryHard,categoricalfactorscalledSubplots
andWhole Plotsareaddedtothedesign.Thissituationresultsinasplitsplitplotdesign:

EachlevelofSubplotscorrespondstoablockofconstantsettingsofthehardtochange
factors.

EachlevelofWhole Plotscorrespondstoablockofconstantsettingsofthe
veryhardtochangefactors.

TheModelscriptinthedesigntableappliestheRandomEffectattributetotheWhole Plots
andSubplotseffects.

Thelevelsofthehardtochangefactorareassumedtobenestedwithinthelevelsofthe
veryhardtochangefactorbydefault.

Inthedesigntable,bothofthefactorsWhole PlotsandSubplotsareassignedtheDesign
RolecolumnpropertywithavalueofRandomBlock.

Toconstructatwowaysplitplotdesign,selecttheHard to change factors can vary


independently of Very Hard to change factorsoptionunderDesignGeneration.Theoption
crossesthelevelsofthehardtochangefactorwiththelevelsoftheveryhardtochange
factor.SeeTwoWaySplitPlotDesignsonpage 115.
UsetheNumberofWholePlotsandNumberofSubplotstextboxestospecifyvaluesforthe
numbersofwholeplotsorsubplots.Theseboxesareinitializedtosuggestednumbersof
wholeplotsandsubplots.Forinformationabouthowthesevaluesareobtained,see
NumbersofWholePlotsandSubplotsonpage 120.
Formoredetailsandscenariosthatillustraterandomblocksplitplot,splitsplitplot,and
twowaysplitplotdesigns,seeDesignswithRandomizationRestrictionsonpage 110.For
detailsaboutdesignswithhardtochangecovariates,seeCovariateswithHardtoChange
Levelsonpage 119.
Factor Column Properties
Foreachfactor,variouscolumnpropertiesaresavedtothedatatable.Youcanfinddetails
aboutthesecolumnpropertiesandrelatedexamplesinAppendixA,ColumnProperties.
Design Role EachfactorisgiventheDesignRolecolumnproperty.TheRolethatyouspecify

indefiningthefactordeterminesthevalueofitsDesignRolecolumnproperty.Whenyou
addarandomblockunderDesignGeneration,thatfactorisassignedtheRandomBlock
value.TheDesignRolepropertyreflectshowthefactorisintendedtobeusedinmodeling
theexperimentaldata.DesignRolevaluesareusedintheAugmentDesignplatform.For
details,seeDesignRoleonpage 570intheColumnPropertiesappendix.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Window

91

Factor Changes EachfactorisassignedtheFactorChangescolumnproperty.Thevaluethat

youspecifyunderChangesdeterminesthevalueofitsFactorChangescolumnproperty.
TheFactorChangespropertyreflectshowthefactorisusedinmodelingtheexperimental
data.FactorChangesvaluesareusedintheAugmentDesignandEvaluateDesign
platforms.Fordetails,seeFactorChangesonpage 585intheColumnProperties
appendix.
IftheRoleisContinuous,DiscreteNumeric,acontinuousCovariate,or
Uncontrolled,theCodingcolumnpropertyforthefactorissaved.Thisproperty
transformsthefactorvaluessothatthelowandhighvaluescorrespondto1and+1,
respectively.Fordetails,seeCodingonpage 573intheColumnPropertiesappendix.

Coding

IftheRoleisCategoricalorBlocking,theValueOrderingcolumnpropertyfor
thefactorissaved.Thispropertydeterminestheorderinwhichlevelsofthefactorappear.
Fordetails,seeValueOrderingonpage 588intheColumnPropertiesappendix.

Value Ordering

Mixture IftheRoleisMixture,theMixturecolumnpropertyforthefactorissaved.This

propertyindicatesthelimitsforthefactorandthemixturesum.Italsoenablesyouto
choosethecodingforthemixturefactors.Fordetails,seeMixtureonpage 579inthe
ColumnPropertiesappendix.
RunsPerBlock Forablockingfactor,indicatesthemaximumallowablenumberofrunsin

eachblock.WhenaBlockingfactorisspecifiedintheFactorsoutline,theRunsPerBlock
columnpropertyissavedforthatfactor.Fordetails,seeRunsPerBlockonpage 594inthe
ColumnPropertiesappendix.

Define Factor Constraints


Note: IfyouareworkinginCoveringArrays,seetheCoveringArrayschapteronpage 333
formoreinformation.
UseDefineFactorConstraintstorestrictthedesignspace.Unlessyouhaveloadedaconstraint
orincludedoneaspartofascript,theNoneoptionisselected.Tospecifyconstraints,select
oneoftheotheroptions:
Specify Linear Constraints Specifiesinequalityconstraintsonlinearcombinationsoffactors.

OnlyavailableforfactorswithaRoleofContinuousorMixture.SeeSpecifyLinear
Constraints.
Use Disallowed Combinations Filter Definessetsofconstraintsbasedonrestrictingvaluesof

individualfactors.YoucandefinebothANDandORconstraints.SeeUseDisallowed
CombinationsFilter.
Use Disallowed Combinations Script Definesdisallowedcombinationsandotherconstraints

asBooleanJSLexpressionsinascripteditorbox.SeeUseDisallowedCombinations
Script.

92

Custom Designs
Custom Design Window

Chapter 4
Design of Experiments Guide

Specify Linear Constraints


Incaseswhereitisimpossibletovarycontinuousfactorsindependentlyoverthedesign
space,youcanspecifylinearinequalityconstraints.Linearinequalitiesdescribefactorlevel
settingsthatareallowed.
ClickAddtoenteroneormorelinearinequalityconstraints.
Add Addsatemplateforalinearexpressioninvolvingallthecontinuousfactorsinyour

design.Entercoefficientvaluesforthefactorsandselectthedirectionoftheinequalityto
reflectyourlinearconstraint.Specifytheconstrainingvalueintheboxtotherightofthe
inequality.Toaddmoreconstraints,clickAddagain.
Note: TheAddoptionisdisabledifyouhavealreadyconstrainedthedesignregionby
specifyingaSphereRadius.
Remove Last Constraint Removesthelastconstraint.

Checkstheconstraintsforconsistency.Thisoptionremovesredundant
constraintsandconductsfeasibilitychecks.AJMPalertappearsifthereisaproblem.If
constraintsareequivalenttoboundsonthefactors,aJMPalertindicatesthattheboundsin
theFactorsoutlinehavebeenupdated.

Check Constraints

Use Disallowed Combinations Filter


ThisoptionusesanadaptationoftheDataFiltertofacilitatespecifyingdisallowed
combinations.FordetailedinformationaboutusingtheDataFilter,seetheUsingJMPbook.
SelectfactorsfromtheAddFilterFactorslistandclickAdd.Thenspecifythedisallowed
combinationsbyusingtheslider(forcontinuousfactors)orbyselectinglevels(forcategorical
factors).
TheredtriangleoptionsfortheAddFilterFactorsmenuarethosefoundintheSelect
Columnspanelofmanyplatformlaunchwindows.SeetheUsingJMPbookforadditional
detailsaboutthecolumnselectionmenu.
WhenyouclickAdd,theDisallowedCombinationscontrolpanelshowstheselectedfactors
andprovidesoptionsforfurthercontrol.Factorsarerepresentedasfollows,basedontheir
modelingtypes:
Continuous Factors Foracontinuousfactor,adoublearrowsliderthatspanstherangeof

factorsettingsappears.Anexpressionthatdescribestherangeusinganinequalityappears
abovetheslider.Youcanspecifydisallowedsettingsbydraggingthesliderarrowsorby
clickingontheinequalityboundsintheexpressionandenteringyourdesiredconstraints.
Intheslider,asolidbluehighlightrepresentsthedisallowedvalues.
Categorical Factor Foracategoricalfactor,thepossiblelevelsaredisplayedeitheraslabeled

blocksor,whenthenumberoflevelsislarge,aslistentries.Selectaleveltodisallowit.To

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Window

93

selectmultiplelevels,holdtheControlkey.Theblockorlistentriesarehighlightedto
indicatethelevelsthathavebeendisallowed.Whenyouaddacategoricalfactortothe
DisallowedCombinationspanel,thenumberoflevelsofthecategoricalfactorisgivenin
parenthesesfollowingthefactorname.
DisallowedCombinationsOptions
Thecontrolpanelhasthefollowingcontrols:
Clearsalldisallowedfactorlevelsettingsthatyouhavespecified.Thisdoesnotclear
theselectedfactors.

Clear

Start Over Removesallselectedfactorsandreturnsyoutotheinitiallistoffactors.


AND OpenstheAddFilterFactorslist.SelectedfactorsbecomeanANDgroup.Any

combinationoffactorlevelsspecifiedwithinanANDgroupisdisallowed.
ToaddafactortoanANDgrouplateron,clickthegroupsoutlinetoseeahighlighted
rectangle.SelectANDandaddthefactor.
Toremoveasinglefactor,selectDeletefromitsredtrianglemenu.
OR OpenstheAddFilterFactorslist.SelectedfactorsbecomeaseparateANDgroup.For

ANDgroupsseparatedbyOR,acombinationisdisallowedifitisspecifiedinatleastone
ANDgroup.
RedTriangleOptionsforFactors
AfactorcanappearinseveralORgroups.AnoccurrenceofthefactorinaspecificORgroupis
referredtoasaninstanceofthefactor.
Delete RemovestheselectedinstanceofthefactorfromtheDisallowedCombinationspanel.
Clear Selection

Clearsanyselectionforthatinstanceofthefactor.

Deselectstheselectedvaluesandselectsthevaluesnotpreviouslyselected
forthatinstanceofthefactor.

Invert Selection

Availableonlyforcategoricalfactors.Changestheappearanceofthedisplay.
Optionsinclude:

Display Options

Blocks Displayshowseachlevelasablock.
List Displayshowseachlevelasamemberofalist.
Single Category Display showseachlevel.
Check Box Display addsacheckboxnexttoeachvalue.
Availableonlyforcategoricalfactors.Providesatextboxbeneaththefactornamewhere
youcanenterasearchstringforlevelsofthefactor.PresstheEnterkeyorclickoutsidethe
textboxtoperformthesearch.OnceFindisselected,thefollowingFindoptionsappearin
theredtrianglemenu:

Find

94

Custom Designs
Custom Design Window

Chapter 4
Design of Experiments Guide

Clear FindclearstheresultsoftheFindoperationandreturnsthepaneltoitsoriginal
state.
Match Caseusesthecaseofthesearchstringtoreturnthecorrectresults.
Containssearchesforvaluesthatincludethesearchstring.
Does not containsearchesforvaluesthatdonotincludethesearchstring.
Starts withsearchesforvaluesthatstartwiththesearchstring.
Ends withsearchesforvaluesthatendwiththesearchstring.
Use Disallowed Combinations Script
UsethisoptiontodisallowparticularcombinationsoffactorlevelsusingaJSLscript.This
optioncanbeusedwithcontinuousfactorsormixedcontinuousandcategoricalfactors.
Thisoptionopensascriptwindowwhereyouinsertascriptthatidentifiesthecombinations
thatyouwanttodisallow.ThescriptmustevaluateasaBooleanexpression.Whenthe
expressionevaluatesastrue,thespecifiedcombinationisdisallowed.
Whenformingtheexpressionforacategoricalfactor,usetheordinalvalueofthelevelinstead
ofthenameofthelevel.Ifafactorslevelsarehigh,medium,andlow,specifiedinthatorder
intheFactorsoutline,theirassociatedordinalvaluesare1,2,and3.Forexample,supposethat
youhavetwocontinuousfactors,X1andX2,andacategoricalfactorX3withthreelevels:L1,
L2,andL3,inorder.Youwanttodisallowlevelswherethefollowingholds:
e

X1

+ 2X 2 0andX 3 = L2

Entertheexpression(Exp(X1) + 2*X2 < 0) & (X3 == 2)intothescriptwindow.


Figure 4.20ExpressioninScriptEditor

(Inthefigure,unnecessaryparentheseswereremovedbyparsing.)Noticethatfunctionscan
beenteredaspartoftheBooleanexpression.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Window

95

Model
Specifyyourassumedmodel(whichcontainsalltheeffectsthatyouwanttoestimate)inthe
Modeloutline.Foreacheffectthatyouspecify,youcandesignatethateffectsEstimability.The
EstimabilityvalueindicateswhetheritisNecessarytoestimatethateffect,orifyouare
contenttoestimatethateffectIfPossible.
WhentheModeloutlineopens,formostfactorsonlythemaineffectsappear.Ifyouhave
enteredadiscretenumericfactor,polynomialtermsalsoappear.TheEstimabilityof
secondandhigherordertermsissettoIf Possible.Ifyouwanttoensurethatthesetermsare
estimable,changetheirEstimabilitytoNecessary.
Note: Youcanensurethattheestimabilityofdiscretenumericpolynomialtermsisalwaysset
toNecessary.SelectFile > Preferences > Platforms > DOE.CheckDiscreteNumericPowersSet
toNecessary.
Figure 4.21ModelOutline

Whenyouconstructyourdesigntable,JMPsavesaModelscripttothedatatable.Exceptfor
discretenumericfactors,theModelscriptcontainstheeffectsshownintheModeloutline.For
adiscretenumericfactor,theModelscriptcontainsonlyitsmaineffectandquadraticterm.
TheModeloutlinecontainsthefollowingbuttonsandfields:
Main Effects Addsmaineffectsforallfactorsinthemodel,andpolynomialtermsfordiscrete

numericfactors.
Interactions Addsinteractioneffects.IfnofactorsareselectedintheFactorsoutline,select

2nd,3rd,4th,or5thtoaddallappropriateinteractionsuptothatorder.Addinteractions
uptoagivenorderforspecificfactorsbyselectingthefactornamesintheFactorsoutline,
selectingInteractions,andthenspecifyingtheappropriateorder.Interactionsbetween
nonmixtureandmixturefactors,andinteractionswithblockingandconstantfactors,are
notadded.
RSM Addsinteractionandquadratictermsuptothesecondorder(responsesurfacemodel

terms)forcontinuousfactors.CategoricalfactorsarenotincludedinRSMterms.Main
effectsfornonmixturefactorsthatinteractwithallthemixturefactorsareremoved.

96

Custom Designs
Custom Design Window

Chapter 4
Design of Experiments Guide

Addsspecificinteractionterms.SelectfactornamesintheFactorsoutlineandeffect
namesintheModeloutline.ClickCrosstoaddthecrossedtermstotheModeloutline.

Cross

Addspolynomialterms.IfnofactornamesareselectedintheFactorsoutline,adds
polynomialtermsforallcontinuousfactors. IffactornamesareselectedintheFactors
outline,addspolynomialtermsforonlythosefactors.Select2nd,3rd,4th,or5thtoadd
polynomialtermsofthatorder.

Powers

Scheff Cubic AddsScheffcubictermsforallmixturefactors.Thesetermsareusedto

specifyamixturemodelwiththirddegreepolynomialterms.
Remove Term Removesselectedeffects.
Name

Nameoftheeffect.

Estimability Adesignationofyourneedtoestimatetheeffect.

IfEstimabilityissettoNecessary,thealgorithmensuresthattheeffectisestimable.
IfEstimabilityissettoIfPossible,thealgorithmattemptstomakethateffectestimable,
aspermittedbythenumberofrunsthatyouspecify.
Exceptforpolynomialtermsfordiscretenumericfactors,alleffectsarespecifiedas
Necessarybydefault.ClickaneffectsEstimabilityvaluetochangeit.
BayesianDOptimalityandEstimationofIfPossibleEffects
TheBayesianDOptimaldesignapproachobtainspreciseestimationofallNecessaryterms
whileprovidingomnibusdetectability(andsomeestimability)forIf Possibleterms.Formore
detail,seeResponseSurfaceExperimentsonpage 150intheExamplesofCustomDesigns
chapterandBayesianDOptimalityonpage 121.

Alias Terms
Itispossiblethateffectsnotincludedinyourassumedmodelareactive.IntheAliasTerms
outline,addpotentiallyactiveeffectsthatarenotinyourassumedmodelbutmightbiasthe
estimatesofmodelterms.Onceyougenerateyourdesign,theAliasMatrixoutlineappears
underDesignEvaluation.TheAliasMatrixentriesrepresentthedegreeofbiasimpartedto
modelparametersbytheeffectsthatyouspecifiedintheAliasTermsoutline.Fordetails,see
theTheAliasMatrixonpage 601intheTechnicalDetailsappendix.
Bydefault,theAliasTermsoutlineincludesalltwowayinteractioneffectsthatarenotinyour
Modeloutline(withtheexceptionoftermsinvolvingblockingfactors).Addtermsusingthe
buttons.ForadescriptionofhowtousethesebuttonstoaddeffectstotheAliasTermstable,
seeModelonpage 95.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Window

97

Forexample,supposethatyouspecifyadesignwiththreecontinuousfactors.Yourassumed
model,specifiedintheModeloutline,containsonlythosethreemaineffects.Youcanafford
onlysixruns.Youwanttoseehowestimatesofthemaineffectsmightbebiasedbyactive
twowayinteractionsandthethreewayinteraction.
TheAliasTermstableincludesalltwowayinteractionsbydefault.Youcanaddthethreeway
interactionbyselectingInteractions > 3rd.
Figure 4.22AliasTermsOutline

OnceyouspecifysixrunsintheDesignGenerationoutlineandclickMake Design,theDesign
Evaluationoutlineappears.OpentheDesignEvaluationoutlineandtheAliasMatrixoutline.
SeeFigure 4.23.
Figure 4.23AliasMatrix

TheAliasMatrixindicatesthateachmaineffectispartiallyaliasedwithtwoofthe
interactions.SeeAliasMatrixonpage 488intheEvaluateDesignschapterandTheAlias
Matrixonpage 601intheTechnicalDetailsappendix.

Design Generation
TheDesignGenerationoutlinegivesyouchoicesrelatingtothesizeandstructureofthe
design.Typically,theinputareahastwoparts:

Designstructureoptions

Numberofrunsoptions

98

Custom Designs
Custom Design Window

Chapter 4
Design of Experiments Guide

Figure 4.24DesignGenerationOutline

DesignStructureOptions
Group runs into random blocks of size (Notavailableifablockingfactorisspecified)To

constructarandomblockdesign,enterthenumberofrunsthatyouwantineachblock.
Whenyouspecifythesamplesize,afactorcalledRandom Blockiscreated.Itslevelsdefine
blocksofasizethatisconsistentwiththeblocksizethatyouentered,giventhespecified
numberofruns.Ifthenumberofrunsisanintegermultipleoftheblocksize,theblock
sizesequalyourspecifiedvalue.
Number of Whole Plots Appearswhenyouspecifyahardorveryhardtochangefactor.The

factorWhole Plotscorrespondstotheveryhardtochangefactors(splitsplitplotdesign),
ifthereareany,otherwisetothehardtochangefactors(splitplotdesign).JMPsuggestsa
valueforthenumberofwholeplotsthatmaximizestheinformationaboutthecoefficients
inthemodel.Or,youcanenteravalueforthenumberofwholeplots.Fordetails,see
NumbersofWholePlotsandSubplotsonpage 120.
Number of Subplots

Appearswhenyouspecifyaveryhardtochangefactor.Thefactor

Subplotscorrespondstothehardtochangefactorsinthesplitsplitplotdesign.JMP

suggestsvaluesforthenumberofwholeplotsandsubplotsthatmaximizetheinformation
aboutthecoefficientsinthemodel.Or,youcanenteravalueforthenumberofsubplots.
Fordetails,seeNumbersofWholePlotsandSubplotsonpage 120.
Hard to change factors can vary independently of Very Hard to change factors Selectthis

optiontocreateastripplot(alsoknownastwowaysplitplotorsplitblock)design.This
optioncreatesadesignwherethehardtochangefactorsarerandomizedwithinthelevels
oftheveryhardtochangefactors.Theyarenotnestedwithintheveryhardtochange
factors.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Window

99

Number of Center Points AppearsonlyifthedesigncontainsfactorswithaContinuousor

Mixturefactortype.Specifyhowmanyadditionalrunsyouwanttoaddascenterpointsto
thedesign.Acenterpointisarunwhosesettingforeachcontinuousfactorismidway
betweenthehighandlowsettings.SeeCenterPoints,ReplicateRuns,andTestingon
page 60intheStartingOutwithDOEchapter.
Ifadesigncontainsbothcontinuousandothertypesoffactors,centerpointsmightnotbe
balancedrelativetothelevelsoftheotherfactors.CustomDesignchoosesthecenterpoints
tomaximizetheD,I,oraliasefficiencyofthedesign.
Number of Replicate Runs Specifythenumberofreplicatetrialsthatyouwanttoaddtothe

design.Thisdoesnotreplicatetheentiredesign,butchoosestheoptimaldesignpointsto
replicate.SeeCenterPoints,ReplicateRuns,andTestingonpage 60intheStartingOut
withDOEchapter.
NumberofRunsOptions
Minimum Alowerboundonthenumberofrunsnecessarytoavoidfailuresindesign

generation.WhenyouselectMinimum,theresultingdesignissaturated.Thereareno
degreesoffreedomforerror.
Note: IfyouselecttheMinimumnumberofruns,therewillbenoerrortermfortesting.
Youwillnotbeabletotestparameterestimates.Thischoiceisappropriateonlywhenthe
costofadditionalrunsisprohibitive.
Suggeststhenumberofruns.Thisvalueisbasedonheuristicsforcreatingabalanced
designwithatleastfourrunsmorethantheMinimumnumberofruns.

Default

Specifythenumberofrunsthatyouwant.EnterthatvalueintotheNumber of
Runstextbox.Thisoptionenablesyoutobalancethecostofadditionalrunsagainstthe

User Specified

potentialgainininformation.
Number of Runs ThisistheonlyoptionthatappearswhenacovariatefactorwithChanges

settoEasyisspecified.Thenumberofrunsshownisthenumberofrowsinthedatatable
associatedwithyourcovariateorcovariates.Youcanspecifyasmallernumberofruns.In
thatcase,thecovariaterunsthatareselectedoptimizethedesigncriterion.
MakeDesign
OnceyouhavecompletedtheDesignGenerationoutline,clickMake Design.CustomDesign
generatesthedesign,presentsitintheDesignoutline,andprovidesevaluationinformationin
theDesignEvaluationoutline.TheOutputOptionspanelalsoappears,allowingyoutocreate
thedesigntable.

100

Custom Designs
Custom Design Window

Chapter 4
Design of Experiments Guide

Note: Sometimesseveraldesignscanoptimizetheoptimalitycriterion.Whenthisisthecase,
thedesignalgorithmmightgeneratedifferentdesignswhenyouclicktheBack andMake
Designbuttonsrepeatedly.

Design
TheDesignoutlineshowstherunsforadesignthatisoptimal,giventheconditionsthatyou
havespecified.Therunsmightnotappeartobeproperlyrandomized.YoucanselectRun
OrderoptionsintheOutputOptionspanelbeforegeneratingyourdesigntable.

Design Evaluation
TheDesignEvaluationoutlineprovidesanumberofwaystoevaluatethepropertiesofthe
generateddesign.OpentheDesignEvaluationoutlinetoseethefollowingoptions:
Power Analysis Enablesyoutoexploreyourabilitytodetecteffectsofgivensizes.
Prediction Variance Profile Showsthepredictionvarianceovertherangeoffactorsettings.
Fraction of Design Space Plot

Showshowmuchofthemodelpredictionvarianceliesbelow

(orabove)agivenvalue.
Prediction Variance Surface Showsasurfaceplotofthepredictionvarianceforanytwo

continuousfactors.
Estimation Efficiency Foreachparameter,givesthefractionalincreaseinthelengthofa

confidenceintervalcomparedtothatofanidealized(orthogonal)design,whichmightnot
exist.Alsogivestherelativestandarderroroftheparameters.
Givescoefficientsthatindicatethedegreebywhichthemodelparametersare
biasedbyeffectsthatarepotentiallyactive,butnotinthemodel.Youspecifytheterms
representingpotentiallyactiveeffectsintheAliasTermstable.SeeTheAliasMatrixon
page 601intheTechnicalDetailsappendix.

Alias Matrix

Color Map on Correlations Showstheabsolutecorrelationbetweeneffectsonaplotusingan

intensityscale.
Design Diagnostics Indicatestheoptimalitycriterionusedtoconstructthedesign.Alsogives

efficiencymeasuresforyourdesign.SeeOptimalityCriterioninCustomDesignOptions
onpage 102andOptimalityCriteriaonpage 120.
Note: TheDesignDiagnosticsoutlinedoesnotprovidethefollowingstatisticswhenthe
modelincludesfactorswithChangessettoHardorVeryHardorwithEstimabilitysetto
IfPossible:DEfficiency,GEfficiency,AEfficiency.
FormoredetailsabouttheDesignEvaluationoutline,seeDesignEvaluationonpage 476in
theEvaluateDesignschapter.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Window

101

Output Options
UsetheOutputOptionspaneltoperformthefollowingtasks:

specifyhowyouwantthecustomdesigndatatabletoappear

constructthedesigntable

returntoapreviouspointintheCustomDesignwindow

Inmostcases,theOutputOptionspanelappearsasshowninFigure 4.25.
Figure 4.25OutputOptionsPanel

TheOutputOptionspanelcontainstheseoptions:

RunOrderonpage 101

MakeTableonpage 101

Backonpage 102

RunOrder
TheRun Orderoptionsdeterminetheorderoftherunsinthedesigntable.Choicesincludethe
following:
Keep the Same RowsinthedesigntableareinthesameorderasintheDesignoutline.
Sort Left to Right

Columnsinthedesigntablearesortedfromlefttoright.

Randomize Rowsinthedesigntableareinrandomorder.
Sort Right to Left Columnsinthedesigntablearesortedfromrighttoleft.
Randomize within Blocks

Rowsinthedesigntableareinrandomorderwithintheblocks.

MakeTable
ClickMake Tabletoconstructthecustomdesigndatatable.IntheCustomDesigntable,the
Tablepanel(intheupperleft)cancontainscripts,asappropriategivenyourdesign.The
ModelandDOEDialogscriptsarealwaysprovided.Torunascript,selectRun Scriptfromthe
redtrianglemenu.

102

Custom Designs
Custom Design Options

Chapter 4
Design of Experiments Guide

Figure 4.26CustomDesignTableShowingScripts

Possiblescriptsincludethefollowing:
Screening RunstheAnalyze>Modeling>Screeningplatform.
Model RunstheAnalyze>Fit Model platform.Themodeldescribedbythescriptis

determinedbyyourchoicesintheModeloutlineandbythetypeofdesign.
ShowsmodelconstraintsthatyouenteredintheDefineFactorConstraintsoutline
usingtheSpecify Linear Constraints option.

Constraint

Disallowed Combinations ShowsmodelconstraintsthatyouenteredintheDefineFactor

ConstraintsoutlineusingtheUse Disallowed Combinations Filter ortheUse Disallowed


Combinations Script options.
DOE Dialog RecreatestheCustomDesignwindowthatyouusedtogeneratethedesign

table.Thescriptalsocontainstherandomseedusedtogenerateyourdesign.
Back
TheBackbuttontakesyoubacktowhereyouwerebeforeclickingMakeDesign.Youcan
makechangestothepreviousoutlinesandregeneratethedesign.
Note: IfyouattempttoremoveallfactorsafterclickingtheBackbutton,onecontinuousfactor
remains.Youcandeletethecontinuousfactorafternewfactorsareadded.

Custom Design Options


TheCustomDesignredtrianglemenucontainsthefollowingoptions:
Createsadatatablecontainingarowforeachresponsewithacolumn
calledResponse Namethatidentifiestheresponses.Fouradditionalcolumnscontainthe
Lower Limit,Upper Limit,Response Goal,andImportance.Savingresponsesallowsyouto
quicklyloadthemintoaDOEwindow.

Save Responses

Load Responses

LoadsresponsesthatyouhavesavedusingtheSaveResponsesoption.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Options

103

Save Factors Createsadatatablecontainingacolumnforeachfactorthatcontainsitsfactor

levels.Afactorscolumncontainscolumnpropertiesassociatedwiththefactor.Saving
factorsallowsyoutoquicklyloadthemintoaDOEwindow.
Note: Itispossibletocreateafactorstablebytypingdataintoanemptytable,but
remembertoassigneachcolumnanappropriateDesignRole.Dothisbyrightclickingon
thecolumnnameinthedatagridandselectingColumn Properties > Design Role.Inthe
DesignRolearea,selecttheappropriaterole.
Load Factors

LoadsfactorsthatyouhavesavedusingtheSaveFactorsoption.

Save Constraints (Unavailableforsomeplatforms)Savesfactorconstraintsthatyouhave

definedintheDefineFactorConstraintsorLinearConstraintsoutline.TheSave
Constraintsoptioncreatesadatatablethatcontainsacolumnforeachconstraint.Saving
constraintsallowsyoutoquicklyloadthemintoaDOEwindow.
Theconstrainttablecontainsacolumnforeachlinearconstraint.Thefirstrowscontainthe
coefficientsforeachfactor.Thelastrowcontainstheinequalitybound.Eachconstraints
columncontainsacolumnpropertycalledConstraintStatethatidentifiestheconstraintasa
lessthanoragreaterthanconstraint.SeeColumnPropertiesonpage 559inthe
ColumnPropertiesappendix.
(Unavailableforsomeplatforms)Loadsfactorconstraintsthatyouhave
savedusingtheSaveConstraintsoption.

Load Constraints

Set Random Seed SetstherandomseedthatJMPusestocontrolcertainactionsthathavea

randomcomponent.Theseactionsinclude:
simulatingresponsesusingtheSimulateResponsesoption
randomizingRunOrderfordesignconstruction
selectingastartingdesignfordesignsbasedonrandomstarts.
Toreproduceadesignorsimulatedresponses,entertherandomseedusedtogenerate
them.Fordesignsusingrandomstarts,settheseedbeforeclickingMakeDesign.To
controlsimulatedresponsesorrunorder,settheseedbeforeclickingMakeTable.
NotethattherandomseedassociatedwithadesignisincludedintheDOEDialogscript
thatissavedtothedesigndatatable.
Addsresponsevaluestothedesigntablethatisgenerated.Selectthis
optionbeforeyouclickMakeTable.InthedesigntablethatresultsfromclickingMake
Table,theresponsecolumnscontainsimulatedvalues.

Simulate Responses

Forcertaintypesofdesigns,aSimulateResponseswindowliststhecoefficientsanderror
standarddeviationusedtosimulatetheresponsevalues.Youcanreplacethesecoefficients

104

Custom Designs
Custom Design Options

Chapter 4
Design of Experiments Guide

andclickApplytoseeyoursimulatedresponsevaluesinthedatatable.Thedefaultvalues
forthecoefficientsareeither1or1.Thedefaultvaluefortheerrorstandarddeviationis1.
SomeplatformsallowyoutosetAnticipatedCoefficientsaspartofPowerAnalysisunder
DesignEvaluation.Fortheseplatforms,thedefaultvaluesintheSimulateResponses
windowarethevaluesthatyouspecifyasAnticipatedCoefficientsandAnticipatedRMSE
(ErrorStd)inthePowerAnalysisoutline.Ifitisnotpossibletofitthemodelspecifiedin
thedatatablesModelscript,theinterceptandcoefficientshavedefaultvaluesof0.
Note: Youcansetapreferencetoalwayssimulateresponses.SelectFile > Preferences >
Platforms > DOE.CheckSimulateResponses.
Save X Matrix SavesscriptscalledMomentsMatrixandModelMatrixtothedesigndata

table.Thesescriptscontainthemomentsanddesignmatrices.Usetheseinscriptsthatyou
write.SeeSaveXMatrixonpage 106.
Optimality Criterion

Changesthedesignoptimalitycriterion.Thedefaultcriterion,

Recommended,specifies Doptimalityforalldesigntypes,unlessyouaddedquadratic

effectsusingtheRSMbuttonintheModeloutline.FormoreinformationabouttheD,I,
andaliasoptimaldesigns,seeOptimalityCriteriaonpage 120.
Note: Youcansetapreferencetoalwaysuseagivenoptimalitycriterion.SelectFile >
Preferences > Platforms > DOE.CheckOptimalityCriterionandselectyourpreferred
criterion.
Number of Starts Enablesyoutospecifythenumberofrandomstartsusedinconstructing

thedesign.SeeNumberofStartsonpage 108.
Design Search Time Maximumnumberofsecondsspentsearchingforadesign.Thedefault

searchtimeisbasedonthecomplexityofthedesign.SeeDesignSearchTimeon
page 108andNumberofStartsonpage 108.
Iftheiterationsofthealgorithmrequiremorethanafewseconds,aComputingDesign
progresswindowappears.IfyouclickCancelintheprogresswindow,thecalculation
stopsandgivesthebestdesignfoundatthatpoint.Theprogresswindowalsodisplays
DefficiencyforDoptimaldesignsthatdonotincludefactorswithChangessettoHardor
VeryHardorwithEstimabilitysettoIfPossible.
Note: YoucansetapreferenceforDesignSearchTime.SelectFile > Preferences > Platforms
> DOE.CheckDesignSearchTimeandenterthemaximumnumberofseconds.Incertain
situationswheremoretimeisrequired,JMPextendsthesearchtime.
Sphere Radius Constrainsthecontinuousfactorsinadesigntoahypersphere.Specifythe

radiusandclickOK.Designpointsarechosensothattheirdistancefrom0equalsthe
SphereRadius.SelectthisoptionbeforeyouclickMakeDesign.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Options

105

Note: SphereRadiusconstraintscannotbecombinedwithconstraintsaddedusingthe
SpecifyLinearConstraintsoption.Also,theoptionisnotavailablewhenhardtochange
factorsareincluded(splitplotdesigns).
Advanced Options > Mixture Sum Setthesumofthemixturefactorstoanypositivevalue.Use

thisoptiontokeepacomponentofamixtureconstantthroughoutanexperiment.
Advanced Options > Split Plot Variance Ratio Specifytheratioofthevarianceoftherandom

wholeplotandthesubplotvariance(ifpresent)totheerrorvariance.Beforesettingthis
value,youmustdefineahardtochangefactorforyoursplitplotdesign,orhardand
veryhardtochangefactorsforyoursplitsplitplotdesign.Thenyoucanenteroneortwo
positivenumbersforthevarianceratios,dependingonwhetheryouhavespecifieda
splitplotorasplitsplitplotdesign.
(AvailableonlywhentheModeloutlineis
available)SpecifytheweightsthatareusedforfactorswhoseEstimabilityissettoIf
Possible.TheoptionupdatestoshowthedefaultweightswhenyouclickMakeDesign.
Enterapositivenumberforeachofthetermsforwhichyouwanttospecifyaweight.The
valuethatyouenteristhesquarerootofthereciprocalofthepriorvariance.Alargervalue
representsasmallervarianceandthereforemorepriorinformationthattheeffectisnot
active.

Advanced Options > Prior Parameter Variance

BayesianDorIoptimalityisusedinconstructingdesignswithIfPossiblefactors.The
defaultvaluesusedinthealgorithmare0forNecessaryterms,4forinteractionsinvolving
IfPossibleterms,and1forIfPossibleterms.Formoredetails,seeTheAliasMatrixon
page 601intheTechnicalDetailsappendixandOptimalityCriteriaonpage 120.
SpecifytherelativeimportanceofDefficiencyto
aliasoptimalityinconstructingthedesign.Selectthisoptiontobalancereducingthe
varianceofthecoefficientswithobtainingadesirablealiasstructure.Valuesshouldbe
between0and1.LargervaluesgivemoreweighttoDEfficiency.Thedefaultvalueis0.5.
ThisoptionhasaneffectonlywhenyouselectMakeAliasOptimalDesignasyour
OptimalityCriterion.

Advanced Options > D Efficiency Weight

ForthedefinitionofDefficiency,seeOptimalityCriteriaonpage 120.Fordetailsabout
aliasoptimality,seeAliasOptimalityonpage 124.
Specifythedifferenceinthemeanresponsethatyou
wanttodetectformodeleffects.SeeSetDeltaforPoweronpage 109.

Advanced Options > Set Delta for Power

Save Script to Script Window Createsthescriptforthedesignthatyouspecifiedinthe

CustomDesignwindowandplacesitinanopenscriptwindow.

106

Custom Designs
Custom Design Options

Chapter 4
Design of Experiments Guide

Save X Matrix
ThisoptionsavesscriptscalledMomentsMatrixandModelMatrixthatcontainthemoments
matrixandthemodelmatrix.Themomentsmatrixandthemodelmatrixareusedtocalculate
theAverageVarianceofPrediction,whichappearsintheDesignDiagnosticssectionofthe
DesignEvaluationoutline.Fordetails,seeGoosandJones(2011).Ifthedesignisasplitplot
design,anVInversescriptisalsosaved.TheVInversescriptcontainstheinverseofthe
covariancematrixoftheresponses.
Note: Youcansetapreferencetoalwayssavethematrixscript.SelectFile > Preferences >
Platforms > DOE.CheckSaveXMatrix.
ModelMatrix
Themodelmatrixdescribesthedesignfortheexperiment.Themodelmatrixhasarowforeach
runandacolumnforeachtermofthemodelspecifiedintheModeloutline.Foreachrun,the
correspondingrowofthemodelmatrixcontainsthecodedvaluesofthemodelterms.
Continuoustermsarecodedtorangefrom1to1.Nominaltermsarecodedbyapplyingthe
GramSchmidtorthogonalizationproceduretoJMPscodingfornominaleffects.Find
additionalinformationaboutcodingfornominaleffectsintheFittingLinearModelsbook.See
alsoTheModelMatrixonpage 601intheTechnicalDetailsappendix.
MomentsMatrix
Themomentsmatrixisdependentuponthemodeleffectsbutisindependentofthedesign.Itis
definedasfollows:
M =

f x f x ' dx
R

where f x denotesthemodeleffectscorrespondingtofactorcombinationsofthevectorof
factors, x ,andRdenotesthedesignspace.Foradditionaldetailsconcerningmomentsand
designmatrices,seeGoosandJones(2011,pp8890)andMyersetal.(2009).Notethatthe
momentsmatrixiscalledamatrixofregionmomentsinMyersetal.(2009,p.376).
Scripts
FromtheCustomDesignredtrianglemenu,selectSave X Matrix.Afterthedesignandthe
tablearecreated,intheCustomDesigntable,theMomentsMatrixandModelMatrixscripts,
andifthedesignisasplitplot,theVInversescript,aresavedastableproperties.

SelectEditfromtheredtrianglenexttoeithertheMomentsMatrix,ModelMatrix,orV
Inversescript.Thescriptshowsthecorrespondingmatrix.Youcancopythismatrixinto
scriptsthatyouwrite.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Options

107

WhenyouruntheMomentsMatrixscript,thelogshowsthenumberofrowsinthe
momentsmatrix,calledMoments.

WhenyourunthescriptModelMatrix,thelogdisplaysthenumberofrowsinthemodel
matrix,calledX.

WhenyourunthescriptVInverse,thelogdisplaysthenumberofrowsintheinverse
covariancematrix,calledVInverse.

Example
Followthesestepstoillustratethesefeatures:
Tip: Toseethelog,selectView > Log(Window > LogontheMacintosh).
1. SelectDOE>Custom Design.
2. Add3continuousfactorsandclickContinue.
3. ClickInteractions > 2nd.
4. FromtheCustomDesignredtrianglemenu,selectSave X Matrix.
5. UsingtheDefaultNumberofRuns(12),clickMake DesignandthenMake Table.
6. IntheTablepanel,selectEditfromtheredtrianglenexttoMomentsMatrix.
Thescriptappearsinascriptwindow.Thescriptshowsthemomentsmatrix,whichis
calledMoments.
Figure 4.27MomentsMatrixScript

7. Ifitisnotalreadyopen,selectView > Log(Window > LogontheMacintosh).


8. IntheTablepanel,selectRun ScriptfromtheredtrianglenexttoMomentsMatrix.
ThenumberofrowsappearinthelogasN Row(Moments)=7.
9. IntheTablepanel,selectEditfromtheredtrianglenexttoModelMatrix.
Thescriptappearsinascriptwindow.Thescriptshowsthemodelmatrix,whichiscalled
X.

108

Custom Designs
Custom Design Options

Chapter 4
Design of Experiments Guide

10. SelectRun Script fromtheredtrianglenexttoModelMatrix.


ThenumberofrowsappearsinthelogasN Row(X)=12.
11. ToviewtheModelMatrixasadatatable,addtheselinestothescript:
dt = New Table("Model Matrix");
dt << SetMatrix(X);

12. SelectRun Script.

Number of Starts
Thenumberofstartsisthenumberoftimesthatthecoordinateexchangealgorithminitiates
withanewdesign.SeeCoordinateExchangeAlgorithmonpage 125.Youcanspecifyyour
ownvalueusingtheNumber of Startsoption.Increasingthenumberofrandomstartstendsto
improvetheoptimalityoftheresultingdesign.
UnlessyouspecifyavalueforNumberofStartsandclickOK,thenumberofstartsis
controlledbyDesignSearchTime.Toseehowmanystartswereusedtoconstructadesign,
clickMakeDesign.ThenselectNumberofStarts.Thevalueinthetextboxisthenumberof
startsusedtoconstructthespecificdesign.
Incertainspecialcases,thegloballyoptimaldesignisknownfromtheory.Ifthe
coordinateexchangealgorithmdetectsthatithasfoundanoptimaldesign,itstopssearching
andreturnsthatdesign.
Tip: Toreproduceaspecificdesign,youneedtospecifytheNumberofStartsandtheRandom
Seedoriginallyusedtoproducethedesign.Obtainthesevaluesfromtheredtriangleoptions
afteryouclickMakeDesign.
Inexamplesofcustomdesignsinthedocumentation,therandomseedandnumberofstarts
areoftenprovidedsothatyoucanreconstructtheexactdesignbeingdiscussed.

Design Search Time


DesignSearchTimeistheamountoftimeallocatedtofindinganoptimaldesign.Custom
Designscoordinateexchangealgorithmconsistsoffindingnearoptimaldesignsbasedon
randomstartingdesigns.SeeCoordinateExchangeAlgorithmonpage 125.TheDesign
SearchTimedetermineshowmanydesignsareconstructedbasedonrandomstarting
designs.
YoucanspecifyyourownvalueusingtheDesign Search Time option.Increasingthesearch
timetendstoimprovetheoptimalityoftheresultingdesign.
Keepinmindthatdesignsproducedbyrerunningthealgorithmcandiffer.Evenwiththe
samerandomseed,thenumbersofstartingdesignsusedtoconstructthefinaldesignmight
differbecauseofvariationsincomputingspeedandotherfactors.

Chapter 4
Design of Experiments Guide

Custom Designs
Custom Design Options

109

Note: ThenumberofstartingdesignsisgivenbythevalueintheNumberofStartstextbox.
However,thisvalueisnotupdateduntilafteryouconstructyourdesignbyclickingMake
Design.
Incertainspecialcases,thegloballyDoptimaldesignisknownfromtheory.Thesecases
include:

Twolevelfractionalfactorialdesignsornonregularorthogonalarrays.Theseareglobally
Doptimalforallmaineffectandtwofactorinteractionmodels.

Latinsquaredesigns.TheseareDoptimalformaineffectmodelsassumingtheright
samplesizeandnumbersoflevelsofthefactors.

PlackettBurmandesigns.TheseareDoptimalformaineffectmodels.

Ifthecoordinateexchangealgorithmdetectsthatithasfoundanoptimaldesign,itstops
searchingandreturnsthatdesign.

Set Delta for Power


Thisoptionspecifiesthedifferenceinthemeanresponsethatyouwanttobeabletodetectfor
modeleffects.PowercalculationsappearinthePowerAnalysisoutlinewithintheDesign
Evaluationoutline.Poweriscalculatedforeachmodelparameterbasedondetectingthe
specifieddifferenceofdelta.Forcategoricaleffects,thepowercalculationisbasedon
detectingamaximumchangeofdeltabetweenanytwolevels.
Forexample,supposethatyouwanttodetectachangeof3unitsinthemeanresponse.Allof
yourfactorsarecontinuous.Becauseyourfactorsareexpressedincodedunits(thecoded
levelsare1and1),achangeof3unitsintheresponsecorrespondstoparametercoefficient
valuesof1.5.Whenyouspecify3intheSetDeltaforPowertextbox,theAnticipated
CoefficientsinthePowerAnalysisoutlinearesetto1.5.Foreachparameter,theprobabilityof
detectingthechangeof3unitsintheresponseappearsinthePowercolumntotherightofthe
parameter.
Bydefault,deltaissetto2.Thedefaultcoefficientforeachcontinuouseffectissetto1.An
nlevelcategoricalfactorisrepresentedbyn1indicatorvariables.Thedefaultcoefficientsfor
then1terms(whichrepresentthecategoricalfactor)arealternatingvaluesof1and1.The
defaultcoefficientsforaninteractioneffectwithmorethanonedegreeoffreedomarealso
alternatingvaluesof1and1.
Note: TheorderinwhichparametersappearinthePowerAnalysisreportmightnotbe
identicaltotheirorderintheParameterEstimatesreportobtainedusingStandardLeast
Squares.Thisdifferencecanoccuronlywhenthemodelcontainsaninteractionwithmore
thanonedegreeoffreedom.

110

Custom Designs
Technical Details

Chapter 4
Design of Experiments Guide

Givenaspecifiedvalueofdelta,eachcoefficientintheAnticipatedCoefficientslistissetat
delta/2multipliedbythedefaultcoefficient.Foracontinuousfactor,thisassignmentensures
thatadifferenceofdeltaisdetectedwiththecalculatedpower.Foracategoricalfactor,this
assignmentofcoefficientsensuresthatamaximumdifferenceofdeltabetweenanytwolevels
isdetectedwiththecalculatedpower.

Technical Details
Thissectioncontainstechnicaldetailsforthefollowingtopics:

DesignswithRandomizationRestrictionsonpage 110

CovariateswithHardtoChangeLevelsonpage 119

NumbersofWholePlotsandSubplotsonpage 120

OptimalityCriteriaonpage 120

OptimalityCriteriaonpage 120

CoordinateExchangeAlgorithmonpage 125

Designs with Randomization Restrictions


ThissectiondescribeshowtheCustomDesignplatformhandlesvarioustypesofdesigns
whererandomassignmentofexperimentalunitstofactorlevelsettingsisrestricted.Random
blockdesignsandvarioustypesofsplitplotdesignsareincluded.
Random Block Designs
Arandomblockdesigngroupstherunsofanexperimentintoblocksthatareconsideredtobe
randomlychosenfromalargerpopulation.Runswithinablockofrunsareusuallymore
homogeneousthanrunsindifferentblocks.Intheseinstances,youareoftenbetterableto
discernothereffectsifyouaccountforthevariationexplainedbytheblockingvariables.
ScenarioforaRandomBlockDesign
Goos(2002)presentsanexampleinvolvingapastrydoughmixingexperiment.Thepurpose
oftheexperimentistounderstandhowcertainpropertiesofthedoughdependonthree
factors:feedflowrate,initialmoisturecontent,androtationalscrewspeed.Sinceitwas
possibletoonlyconductfourrunsaday,theexperimentrequiredseveraldaystorun.Itis
likelythatrandomdaytodaydifferencesinenvironmentalvariableshavesomeeffectonall
oftherunsthatareperformedonagivenday.Toaccountforthedaytodayvariation,the
runsweregroupedintoblocksofsizefoursothatthisvariationwouldnotcompromisethe
informationaboutthethreefactors.

Chapter 4
Design of Experiments Guide

Custom Designs
Technical Details

111

Theblockingfactor,Day,consistsofeachdaysruns.Thedaysonwhichthetrialswere
conductedarerepresentativeofalargepopulationofdayswithdifferentenvironmental
conditions.ItfollowsthatDayisarandomblockingfactor.
SetupforaRandomBlockDesign
Tocreatearandomblockdesign,usetheCustomDesignplatformtoenterresponsesand
factorsanddefineyourmodelasusual.IntheDesignGenerationoutline,selecttheGroup
runs into random blocks of sizeoptionandenterthenumberofrunsyouwantineachblock.
SeeDesignStructureOptionsonpage 98.
Note: Todefineafixedblockingfactor,enterablockingfactorintheFactorsoutline.Todefine
arandomblockingfactor,donotenterablockingfactorintheFactorsoutline.Instead,select
theGroup runs into random blocks of sizeoptionunderDesignGeneration.
Split-Plot Designs
Splitplotdesignsareusedinsituationswherethesettingsofcertainfactorsareheldconstant
forgroupsofruns.Inindustry,theseareusuallyfactorsthataredifficultorexpensiveto
changefromruntorun.Factorswhosesettingsneedtobeheldconstantforgroupsofrunsare
classifiedashardtochangeinJMP.
Becausecertainfactorsarehardtochange,itisnotpracticaltorandomlyallocatethemto
experimentalunits.Instead,theyareallocatedtogroupsofunits.Thisimposesarestrictionon
randomizationthatmustbeconsideredingeneratingadesignandinanalyzingtheresults.
ScenarioforaSplitPlotDesign
Boxetal.(2005)presentsanexperimenttostudythecorrosionresistanceofsteelbars.The
barsareplacedinafurnaceforcuring.Afterward,acoatingisappliedtoincreaseresistanceto
corrosion.Thetwofactorsofinterestare:

Temperatureindegreescentigrade,withlevels360,370,and380

Coating,withlevelsC1,C2,C3,andC4depictingfourdifferenttypesofcoating

Temperatureisahardtochangefactor,duetothetimeittakestoresetthetemperatureinthe

furnace.Forthisreason,fourbarsareprocessedforeachsettingoffurnacetemperature.Ata
laterstage,thefourcoatingsarerandomlyassignedtothefourbars.
Theexperimentalunitsarethebars.Temperatureisahardtochangefactorwhoselevels
definewholeplots.Withineachwholeplot,theCoatingfactorisrandomlyassignedtothe
experimentalunitstowhichthewholeplotfactorwasapplied.

112

Custom Designs
Technical Details

Chapter 4
Design of Experiments Guide

Figure 4.28FactorsandDesignOutlinesforSplitPlotDesign

TheFactorsoutlineforthecorrosionexperimenthasChangessettoHardforTemperatureand
EasyforCoating.The10rundesignconsistsoffivewholeplots,withinwhichthesettingsof
Temperatureareheldconstant.
SetupforaSplitPlotDesign
Ingeneral,severalfactorscanbeappliedtoaprocessingstepwheresettingsare
hardtochange.Inthefurnaceexample,youmightconsiderafurnacelocationfactor,aswell
astemperature.IntheFactorsoutline,undertheChangescolumn,youwouldspecifya
ChangesvalueofHardforsuchfactors.
Whenacustomdesigninvolvesonlyeasytochangeandhardtochangefactors,therunsof
thehardtochangefactorsaregroupedusinganewfactorcalledWhole Plots.Thevaluesof
Whole Plotsdesignateblocksofrunswithidenticalsettingsforthehardtochangefactors.The
ModelscriptthatissavedtothedesigntabletreatsWhole Plotsasarandomeffect.Fordetails,
seeChangesonpage 86andDesignStructureOptionsonpage 98.
Foranexampleofcreatingasplitplotdesignandanalyzingtheexperimentaldata,see
SplitPlotExperimentonpage 181intheExamplesofCustomDesignschapter.
Split-Split-Plot Designs
Asplitsplitplotdesignisusedwhentherearetwolevelsoffactorsthatarehardtochange.
Inindustry,suchdesignsoftenoccurwhenbatchesofmaterialorexperimentalunitsfromone
processingstagepasstoasecondprocessingstage.Factorsareappliedtobatchesofmaterial

Chapter 4
Design of Experiments Guide

Custom Designs
Technical Details

113

atthefirststage.Thenthosebatchesaredividedforsecondstageprocessing,where
additionalfactorsarestudied.Thefirststagefactorsareconsideredveryhardtochange,and
thesecondstagefactorsareconsideredhardtochange.Additionalfactorscanbeappliedto
experimentalunitsafterthesecondprocessingstage.Thesefactorsareconsidered
easytochange.
Inasplitsplitplotdesign,thebatchesareconsideredtoberandomblocks.Sincethebatches
aredividedforsecondstageprocessing,thesecondstagefactorsarenestedwithinthe
firststagefactors.
ScenarioforaSplitSplitPlotDesign
Schoen(1999)presentsanexampleofasplitsplitplotdesignthatrelatestocheesequality.
ThefactorsaregivenintheCheese Factors.jmpdatatablefoundintheDesignExperiment
folder.Theexperimentconsistsofthreestagesofprocessing:

Milkisreceivedfromfarmersandstoredinalargetank.

Milkfromthistankisdistributedtosmallertanksusedforcurdprocessing.

Thecurdsfromeachtankaretransportedtopressesforprocessingindividualcheeses.

Theexperimentconsistsoftesting:

Twofactorsthatareappliedwhenthemilkisinthelargestoragetank.

Fivefactorsthatareappliedtothesmallercurdprocessingtanks.

Threefactorsthatareappliedtotheindividualcheesesfromacurdsprocessingtank.

Noticethatthelevelsoffactorsappliedtothecurdprocessingtanks(subplots)arenested
withinthelevelsoffactorsappliedtothemilkstoragetank(wholeplots).
TheFactorsoutlineforthecheeseexperimenthaveChangessetasfollows:

VeryHardforthetwostoragetankfactors

Hardforthefivecurdprocessingtankfactors

Easyforthethreefactorsthatcanberandomlyassignedtocheeses

114

Custom Designs
Technical Details

Chapter 4
Design of Experiments Guide

Figure 4.29FactorsandDesignGenerationOutlineforSplitSplitPlotDesign

Thedefaultnumberofwholeplotsis5andthedefaultnumberofsubplotsis11.ClickMake
Designtoseea22rundesign.

Figure 4.30SplitSplitPlotDesignforCheeseScenario

Chapter 4
Design of Experiments Guide

Custom Designs
Technical Details

115

Thefivewholeplotscorrespondtothestoragefactors,storage 1andstorage 2.Thesettingsof


thestoragefactorsareconstantwithinawholeplotandshouldberesetbetweenwholeplots.
Forexample,youshouldresetthesettingsforstorage 1betweenruns10and11andfor
storage 2betweenruns18and19.
The11subplotscorrespondtothecurdsfactors.Withinasubplot,thesettingsofthecurds
factorsareconstant.EachlevelofSubplotsonlyappearswithinonelevelofWhole Plots,
indicatingthatthelevelsofSubplotsarenestedwithinthelevelsofWhole Plots.
Levelsofthecheesefactorsvaryrandomlyfromruntorun.
SetupforaSplitSplitPlotDesign
Inasplitsplitplotdesign,theFactorsoutlinecontainsfactorswithChangessettoVeryHard
andHard.ThedesigncanalsocontainfactorswithChangessettoEasy.Twofactorsare
created:

AfactorcalledWhole Plotsrepresentstheblocksofconstantlevelsofthefactorswith
ChangessettoVeryHard.

AfactorcalledSubplotsrepresentstheblocksofconstantlevelsofthefactorswith
ChangessettoHard.

ThefactorSubplotsreflectsthenestingofthelevelsofthefactorswithChangessettoHard
withinthelevelsofthefactorswithChangessettoVeryHard.

ThelevelsoffactorswithChangessettoEasyarerandomlyassignedtounitswithin
subplots.

ThefactorsWhole PlotsandSubplotsaretreatedasrandomeffectsintheModelscriptthat
issavedtothedesigntable.

Fordetails,seetheChangesdescriptionunderFactorsOutlineonpage 86andDesign
StructureOptionsonpage 98.
Two-Way Split-Plot Designs
Atwowaysplitplot(alsoknownasstripplotorsplitblock)designconsistsoftwosplitplot
components.Inindustry,thesedesignsarisewhenbatchesofmaterialorexperimentalunits
fromoneprocessingstagepasstoasecondprocessingstage.But,afterthefirstprocessing
stage,itispossibletodividethebatchesintosubbatches.Thesecondstageprocessingfactors
areappliedrandomlytothesesubbatches.Foraspecificsecondstageexperimentalsetting,
allofthesubbatchesassignedtothatsettingcanbeprocessedsimultaneously.Additional
factorscanbeappliedtoexperimentalunitsafterthesecondprocessingstage.
Incontrasttoasplitsplitplotdesign,thesecondstagefactorsarenotnestedwithinthe
firststagefactors.Afterthefirststage,thebatchesaresubdividedandformedintonew
batches.Therefore,boththefirstandsecondstagefactorsareappliedtowholebatches.

116

Custom Designs
Technical Details

Chapter 4
Design of Experiments Guide

Althoughfactorsatbothstagesmightbeequallyhardtochange,todistinguishthesefactors,
JMPdenotesthefirststagefactorsasveryhardtochange,andthesecondstagefactorsas
hardtochange.Additionalfactorsappliedtoexperimentalunitsafterthesecondprocessing
stageareconsideredeasytochange.
ScenarioforaTwoWaySplitPlotDesign
VivacquaandBisgaard(2004)describeanexperimenttoimprovetheopencircuitvoltagein
batterycells.Twostagesofprocessingareofinterest:

Firststage:Acontinuousassemblyprocess

Secondstage:Acuringprocesswitha5daycycletime

Theengineerswanttostudysixtwolevelfactors:

Fourfactors,X1,X2,X3,andX4,thatareappliedtotheassemblyprocess

Twofactors,X5andX6,thatareappliedtothecuringprocess

Afullfactorialdesignwithallfactorsattwolevelswouldrequire26=64runs,andwould
requireaprohibitive64*5=320days.Also,itisnotpracticaltovaryassemblyconditionsfor
individualbatteries.However,assemblyconditionscanbechangedforlargebatches,suchas
batchesof2000batteries.
Boththefirstandsecondstagefactorsarehardtochange.Inasense,therearetwosplitplot
designs.However,thebatchesof2,000batteriesfromthefirststageexperimentcanbe
dividedintofoursubbatchesof500batterieseach.Thesesubbatchescanberandomly
assignedtothefoursettingsofthetwosecondstagefactors.Allofthebatchesassignedtoa
givensetofcuringconditionscanbeprocessedsimultaneously.Inotherwords,thefirstand
secondstagefactorsarecrossed.
Todistinguishbetweenthefirstandsecondstagefactors,youdesignatetheChangesforthe
firststagefactorsasVeryHard,andtheChangesforthesecondstagefactorsasHard.See
Figure 4.31.Also,underDesignGeneration,notethefollowingoption:Hard to change factors
can vary independently of Very Hard to change factors.Ifthisisnotchecked,thedesignis
treatedasasplitsplitplotdesign,withnestingoffactorsatthetwolevels.Checkthisoption
tocreateatwowaysplitplotdesign.

Chapter 4
Design of Experiments Guide

Custom Designs
Technical Details

Figure 4.31FactorsandDesignGenerationOutlineforTwoWaySplitPlotDesign

Thedefaultnumberofwholeplotsis7;thedefaultnumberofsubplotsis14.ClickMake
Designtoseethe28rundesign.

117

118

Custom Designs
Technical Details

Chapter 4
Design of Experiments Guide

Figure 4.32TwoWaySplitPlotDesignforBatteryCells

Thesevenwholeplotscorrespondtothefirststagefactors,X1,X2,X3,andX4.Thesettingsof
thesefactorsareconstantwithinawholeplot.The14subplotscorrespondtothesecondstage
factors,X5andX6.Forexample,thesubbatchesforruns1and15(fromdifferentwholeplots)
aresubjecttothesamesubplottreatment,whereX5issetat1andX6at1.
SetupforaTwoWaySplitPlotDesign
AtwowaysplitplotdesignrequiresfactorswithChangessettoVeryHardandtoHard.As
describedinSetupforaSplitSplitPlotDesignonpage 115,factorscalledWhole Plotsand
Subplotsarecreated.However,inatwowaysplitplotdesign,Subplotsdoesnotnestthe
levelsoffactorswithChangessettoHardwithinthelevelsoffactorswithChangessettoVery
Hard.BothWhole PlotsandSubplotsaretreatedasrandomeffectsintheModelscriptthatis
savedtothedesigntable.
YouneedtoensurethatthefactorSubplotsisnotnestedwithinthefactorWhole Plots.Select
theoptionHard to change factors can vary independently of Very Hard to change factorinthe
DesignGenerationoutline(Figure 4.31).Formoredetails,seeChangesonpage 86and
DesignStructureOptionsonpage 98.
Foranexampleofcreatingasplitplotdesignandanalyzingtheexperimentaldata,see
TwoWaySplitPlotExperimentonpage 186intheExamplesofCustomDesignschapter.

Chapter 4
Design of Experiments Guide

Custom Designs
Technical Details

119

Covariates with Hard-to-Change Levels


Supposethatyouhavemeasurementsonbatchesofmaterialthatareavailableforusein
testingexperimentalfactors.Orsupposethatyouhavemeasurementsonindividualswho
mightbeselectedtoparticipateintestingexperimentalfactors.Themeasurementsonbatches
orindividualsareknowninadvanceoftheexperimentandareconsideredtobecovariates.
Thebatchesorindividualscorrespondtowholeplots.Youmightwanttouseonlysomeof
thesewholeplotsinyourexperiment.Becauseinformationaboutthewholeplotsintheform
ofcovariatesisavailable,thedesignshouldchoosethewholeplotsinanoptimalfashion.
IntheFactorsoutline,theCustomDesignplatformenablesyoutodesignatecovariatesas
hardtochange.Themodel,asgivenbythetermsthatyouincludeintheModeloutline,can
includeinteractionsandpowersconstructedusingcovariatesandexperimentalfactors.
Note: WhenyousetChangesforaCovariatefactortoHard,allothercovariatesarealsosetto
HardTheremainingfactorsmustbesettoEasy.Becausethealgorithmrequiresacombination
ofrowexchangeandcoordinateexchange,evenmoderatelysizeddesignsmighttakesome
timetogenerate.
ScenarioforanExperimentwithaHardtoChangeCovariate
AnexperimentinvolvingbatchesofpolypropyleneplatesisdiscussedinGoosandJones
(2011,Chapter9)andJonesandGoos(2014,toappear).Largebatchesofpolypropyleneplates
areproducedaccordingtovariousformulationsdeterminedbyseveralvariables.Someplates
areusedimmediately,andtheremainderarestoredforfutureexperimentalpurposes.The
compositionsofthesestoredbatchesareknown.
Acustomerhascertainrequirementsregardingtheplateformulation.Futureexperiments
involvecustomizingthegasplasmatreatmenttothetypesofformulationsrequiredbythe
customer.Thecompositionvariablesareconsideredhardtochangecovariates.Gasplasma
treatmentfactorscanbeappliedtosubbatchesofplateswithagivenformulation.
Theoptimaldesignidentifiesthebatches(definedbythecovariates)touse,determinesthe
numberofplatesfromeachbatchtouse,andprovidessettingsforthegasplasmalevels.Note
thattheoptimalnumberofbatchesandplatesfromagivenbatchdependonthecovariates.
AnexampleisprovidedinExamplesofCustomDesignschapteronpage 127.

120

Custom Designs
Technical Details

Chapter 4
Design of Experiments Guide

Numbers of Whole Plots and Subplots


JMPsuggestsdefaultvaluesfortheNumberofWholePlotsandNumberofSubplots.These
valuesarebasedonheuristicsforcreatingabalanceddesignthatallowsforestimationofthe
effectsspecifiedintheModeloutline.
IfyouentermissingvaluesforNumberofWholePlotsorNumberofSubplots,JMPchooses
valuesthatmaximizetheDefficiencyofthedesign.Thealgorithmusesthevaluesspecifiedin
theSplitPlotVarianceRatiooption.SeeAdvancedOptions>SplitPlotVarianceRatioon
1
page 105.TheDefficiencyisgivenbythedeterminantof X V X ,whereV1istheinverseof
thevariancematrixoftheresponses.Forfurtherdetails,seeGoos,2002.
IfyouentervaluesfortheNumberofWholePlotsandNumberofSubplots,CustomDesign
attemptstomaximizetheoptimalityoftheresultingdesign.Fordetailsaboutsplitplot
designs,seeJonesandGoos(2007).Fordetailsaboutdesignswithhardtochangecovariates,
seeJonesandGoos(2014,toappear).

Optimality Criteria
Thissectionprovidesinformationaboutthefollowingdesigns:

DOptimalityonpage 120

BayesianDOptimalityonpage 121

IOptimalityonpage 122

BayesianIOptimalityonpage 123

AliasOptimalityonpage 124

D-Optimality
Bydefault,theCustomDesignplatformoptimizestheDoptimalitycriterionexceptwhena
fullquadraticmodeliscreatedusingtheRSMbutton.Inthatcase,anIoptimaldesignis
constructed.
TheDoptimalitycriterionminimizesthedeterminantofthecovariancematrixofthemodel
coefficientestimates.ItfollowsthatDoptimalityfocusesonpreciseestimatesoftheeffects.
Thiscriterionisdesirableinthefollowingcases:

screeningdesigns

experimentsthatfocusonestimatingeffectsortestingforsignificance

designswhereidentifyingtheactivefactorsistheexperimentalgoal

TheDoptimalitycriterionisdependentontheassumedmodel.Thisisalimitationbecause
oftentheformofthetruemodelisnotknowninadvance.TherunsofaDoptimaldesign
optimizetheprecisionofthecoefficientsoftheassumedmodel.Intheextreme,aDoptimal

Chapter 4
Design of Experiments Guide

Custom Designs
Technical Details

121

designmightbesaturated,withthesamenumberofrunsasparametersandnodegreesof
freedomforlackoffit.
Specifically,aDoptimaldesignmaximizesD,whereDisdefinedasfollows:
D = det X X
andwhereXisthemodelmatrixasdefinedinSaveXMatrixonpage 106.
DoptimalsplitplotdesignsmaximizeD,whereDisdefinedasfollows:
1

D = det X V X
and V

istheblockdiagonalcovariancematrixoftheresponses(Goos2002).

SinceaDoptimaldesignfocusesonminimizingthestandarderrorsofcoefficients,itmight
notallowforcheckingthatthemodeliscorrect.Forexample,aDoptimaldesigndoesnot
includecenterpointsforafirstordermodel.Whentherearepotentiallyactivetermsthatare
notincludedintheassumedmodel,abetterapproachistospecifyIfPossibletermsandtouse
aBayesianDoptimaldesign.
Bayesian D-Optimality
BayesianDoptimalityisamodificationoftheDoptimalitycriterion.TheBayesian
Doptimalitycriterionisusefulwhentherearepotentiallyactiveinteractionsornonlinear
effects.SeeDuMouchelandJones(1994)andJonesetal(2008).
BayesianDoptimalityestimatesaspecifiedsetofmodelparametersprecisely.Thesearethe
effectswhoseEstimabilityyoudesignateasNecessaryintheModeloutline.Butatthesame
time,BayesianDoptimalityhastheabilitytoestimateother,typicallyhigherordereffects,as
allowedbytherunsize.ThesearetheeffectswhoseEstimabilityyoudesignateasIfPossible
intheModeloutline.Totheextentpossiblegiventherunsizerestriction,aBayesian
DoptimaldesignallowsfordetectinginadequacyinamodelthatcontainsonlytheNecessary
effects.
TheBayesianDoptimalitycriterionismosteffectivewhenthenumberofrunsislargerthan
thenumberofNecessaryterms,butsmallerthanthesumoftheNecessaryandIfPossible
terms.Whenthisisthecase,thenumberofrunsissmallerthanthenumberofparametersthat
youwouldliketoestimate.UsingpriorinformationintheBayesiansettingallowsforprecise
estimationofalloftheNecessarytermswhileprovidingtheabilitytodetectandestimate
someIfPossibleterms.
Toallowforameaningfulpriordistributiontoapplytotheparametersofthemodel,
responsesandfactorsarescaledtohavecertainproperties(DuMouchelandJones,1994,
Section2.2).
Considerthefollowingnotation:

XisthemodelmatrixasdefinedinSaveXMatrixonpage 106

122

Custom Designs
Technical Details

Chapter 4
Design of Experiments Guide

Kisadiagonalmatrixwithvaluesasfollows:
k=0forNecessaryterms
k=1forIfPossiblemaineffects,powers,andinteractionsinvolvingacategoricalfactor
withmorethantwolevels
k=4forallotherIfPossibleterms

ThepriordistributionimposedonthevectorofIfPossibleparametersismultivariatenormal,
2
withmeanvector0anddiagonalcovariancematrixwithdiagonalentries 1 k .Therefore,a
2
value k isthereciprocalofthepriorvarianceofthecorrespondingparameter.
Thevaluesforkareempiricallydetermined.IfPossiblemaineffects,powers,andinteractions
withmorethanonedegreeoffreedomhaveapriorvarianceof1.OtherIfPossibletermshave
apriorvarianceof1/16.InthenotationofDuMouchelandJones,1994, k = 1 .
TocontroltheweightsforIfPossibleterms,selectAdvanced Options > Prior Parameter
Variancefromtheredtrianglemenu.SeeAdvancedOptions>PriorParameterVarianceon
page 105.
2 1

Theposteriordistributionfortheparametershasthecovariancematrix XX + K .The
BayesianDoptimaldesignisobtainedbymaximizingthedeterminantoftheinverseofthe
posteriorcovariancematrix:
2

det XX + K
I-Optimality
Ioptimaldesignsminimizetheaveragevarianceofpredictionoverthedesignspace.The
IoptimalitycriterionismoreappropriatethanDoptimalityifyourprimaryexperimental
goalisnottoestimatecoefficients,butrathertodothefollowing:

predictaresponse

determineoptimumoperatingconditions

determineregionsinthedesignspacewheretheresponsefallswithinanacceptablerange

Inthesecases,precisepredictionoftheresponsetakesprecedenceoverpreciseestimationof
theparameters.
Thepredictionvariancerelativetotheunknownerrorvarianceatapoint x 0 inthedesign
spacecanbecalculatedasfollows:
1
var Y x 0 = f x 0 XX f x 0

whereXisthemodelmatrixasdefinedinSaveXMatrixonpage 106.

Chapter 4
Design of Experiments Guide

Custom Designs
Technical Details

123

IoptimaldesignsminimizetheintegralIofthepredictionvarianceovertheentiredesign
space,whereIisgivenasfollows:
I = f x XX

f x dx = Trace XX M

HereMisthemomentsmatrix:
M =

f x f x dx
R

SeeSaveXMatrixonpage 106.Forfurtherdetails,seeGoosandJones(2011).
Themomentsmatrixdoesnotdependonthedesignandcanbecomputedinadvance.The
rowvectorf(x)consistsofa1followedbytheeffectscorrespondingtotheassumedmodel.
Forexample,forafullquadraticmodelintwocontinuousfactors,f(x)isdefinedasfollows:
f x = 1 x 1 x 2 x 1 x 2 x 21 x 22
Bayesian I-Optimality
TheBayesianIoptimaldesignminimizestheaveragepredictionvarianceoverthedesign
regionforNecessaryandIfPossibleterms.
Considerthefollowingnotation:

Xisthemodelmatrix,definedinSaveXMatrixonpage 106

Kisadiagonalmatrixwithvaluesasfollows:
k=0forNecessaryterms
k=1forIfPossiblemaineffects,powers,andinteractionsinvolvingacategoricalfactor
withmorethantwolevels
k=4forallotherIfPossibleterms

ThepriordistributionimposedonthevectorofIfPossibleparametersismultivariatenormal,
2
withmeanvector0anddiagonalcovariancematrixwithdiagonalentries 1 k .(See
BayesianDOptimalityonpage 121formoredetailsaboutthevaluesk.)
Theposteriorvarianceofthepredictedvalueatapointx0isasfollows:
2 1

x = f x X X + K
var Y
0
0

f x0

TheBayesianIoptimaldesignminimizestheaveragepredictionvarianceoverthedesign
region,asfollows:
2 1

I B = Trace X X + K M

124

Custom Designs
Technical Details

Chapter 4
Design of Experiments Guide

whereMisthemomentsmatrix.SeeSaveXMatrixonpage 106.
Alias Optimality
Aliasoptimalityseekstominimizethealiasingbetweeneffectsthatareintheassumedmodel
andeffectsthatarenotinthemodelbutarepotentiallyactive.Effectsthatarenotinthemodel
butthatareofpotentialinterestarecalledaliaseffects.Fordetailsaboutaliasoptimaldesigns,
seeJonesandNachtsheim(2011).
Specifically,letX1bethemodelmatrixcorrespondingtothetermsintheassumedmodel,as
definedinSaveXMatrixonpage 106.Thedesigndefinesthemodelthatcorrespondstothe
aliaseffects.DenotethematrixofmodeltermsforthealiaseffectsbyX2.
ThealiasmatrixisthematrixA,definedasfollows:
A = X 1 X 1 1 X 1 X 2
Theentriesinthealiasmatrixrepresentthedegreeofbiasassociatedwiththeestimatesof
modelterms.SeeTheAliasMatrixonpage 601intheTechnicalDetailsappendixforthe
derivationofthealiasmatrix.
ThesumofsquaresoftheentriesinAprovidesasummarymeasureofbias.Thissumof
squarescanberepresentedintermsofatraceasfollows:
trace AA
DesignsthatreducethetracecriteriongenerallyhavelowerDefficiencythantheDoptimal
design.Consequently,aliasoptimalityseekstominimizethetraceof AA subjecttoalower
boundonDefficiency.ForthedefinitionofDefficiency,seeOptimalityCriteriaon
page 120.ThelowerboundonDefficiencyisgivenbytheDefficiencyweight,whichyoucan
specifyunderAdvancedOptions.SeeAdvancedOptions>DEfficiencyWeightonpage 105.

D-Efficiency
LetXdenotethedesign,ormodel,matrixforagivenassumedmodelwithpparameters.For
thedefinitionofthemodelmatrix,seeSaveXMatrixonpage 106.Let X D denotethemodel
matrixforaDoptimaldesignfortheassumedmodel.ThentheDefficiencyofthedesign
givenbyXisasfollows:
XX 1 p
DEfficiency = ------------------X D X D

Chapter 4
Design of Experiments Guide

Custom Designs
Technical Details

125

Coordinate-Exchange Algorithm
CustomDesignconstructsadesignthatseekstooptimizeoneofseveraloptimalitycriteria.
(SeeOptimalityCriteriaonpage 120.)Tooptimizethecriterion,CustomDesignusesthe
coordinateexchangealgorithm(MeyerandNachtsheim,1995).Thealgorithmbeginsby
randomlyselectingvalueswithinthespecifieddesignregionforeachfactorandeachrunto
constructastartingdesign.
Supposeyourstudyrequirescontinuousfactors,nofactorconstraints,andamaineffects
model.Aniterationconsistsoftestingeachvalueofthemodelmatrix,asfollows:

Thecurrentvalueofeachfactorisreplacedbyitstwomostextremevalues.

Theoptimalitycriterioniscomputedforbothofthesereplacements.

Ifoneofthevaluesincreasestheoptimalitycriterion,thisvaluereplacestheoldvalue.

Theprocesscontinuesuntilnoreplacementoccursforanentireiteration.
Appropriateadjustmentsaremadetothealgorithmtoaccountforpolynomialterms,nominal
factors,andfactorconstraints.
Thedesignobtainedusingthisprocessisoptimalinalargeclassofneighboringdesigns.Butit
isonlylocallyoptimal.Toimprovethelikelihoodoffindingagloballyoptimaldesign,the
coordinateexchangealgorithmisrepeatedalargenumberoftimes.GoosandJones(2011,
p. 36)recommendusingatleast1,000randomstartsforallbutthemosttrivialdesign
situations.ThenumberofstartingdesignsiscontrolledbytheNumberofStartsoption.See
NumberofStartsonpage 108.CustomDesignprovidesthedesignthatmaximizesthe
optimalitycriterionamongalltheconstructeddesigns.

126

Custom Designs
Technical Details

Chapter 4
Design of Experiments Guide

Chapter 5
Examples of Custom Designs
Perform Experiments That Meet Your Needs
UsetheCustomDesignplatformasyourprimarytoolforconstructingawiderangeof
experimentaldesigns.Youcanconstructavarietyofdesigntypesandfinetunethemtoyour
specificexperimentalneedsandresourcebudget.
CustomDesignprovidesmoreoptionsandcontrolthantheScreening,ResponseSurface,Full
Factorial,andMixtureDesignplatforms.Thedesignsthatyouconstructarecreated
specificallytomeetyourgoals.Thiseliminatesthestruggletofindaclassicaldesignthatonly
comesclosetomeetingyourgoals.
TheflexiblespecialpurposedesignsthatyoucanconstructusingCustomDesigninclude:

Screeningdesigns,includingsupersaturatedscreeningdesigns

Responsesurfacedesigns,includingthosewithcategoricalfactors

Mixturedesigns,includingthosewithprocessfactors,andmixtureofmixturedesigns

Designsthatincludecovariatesorthatarerobusttolineartimetrends

Fixedandrandomblockdesigns

Splitplot,splitsplitplot,andtwowaysplitplot(stripplot)designs

InthischapteryouconstructmostofthesedesigntypeswithintheCustomDesignplatform.
Inmanycases,youalsoanalyzetheexperimentalresults.ForhelpwithusingtheCustom
Designplatform,seetheCustomDesignschapteronpage 63.
Figure 5.1FractionofDesignSpacePlot

Contents
ScreeningExperiments ........................................................... 129
DesignThatEstimatesMainEffectsOnly ........................................ 129
DesignThatEstimatesAllTwoFactorInteractions................................ 132
DesignThatAvoidsAliasingofMainEffectsandTwoFactorInteractions ........... 134
SupersaturatedScreeningDesigns .............................................. 138
DesignforFixedBlocks....................................................... 145
ResponseSurfaceExperiments .................................................... 150
ResponseSurfaceDesign ...................................................... 150
ResponseSurfaceDesignwithFlexibleBlocking.................................. 156
ComparisonofaDOptimalandanIOptimalResponseSurfaceDesign ............. 159
MixtureExperiments ............................................................ 163
MixtureDesignwithNonmixtureFactors ....................................... 164
MixtureofMixturesDesign.................................................... 168
ExperimentswithCovariates ..................................................... 171
DesignwithFixedCovariates .................................................. 172
DesignwithHardtoChangeCovariates ........................................ 175
DesignwithaLinearTimeTrend ............................................... 178
ExperimentswithRandomizationRestrictions ...................................... 181
SplitPlotExperiment ......................................................... 181
TwoWaySplitPlotExperiment................................................ 186

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Screening Experiments

129

Screening Experiments
Intheearlystagesofstudyingaprocess,youidentifyalistoffactorsthatpotentiallyaffect
yourresponseorresponses.Youareinterestedinidentifyingtheactivefactors,thatis,the
factorsthatactuallydoaffectyourresponseorresponses.Ascreeningdesignhelpsyou
determinewhichfactorsarelikelytobeactive.Oncetheactivefactorsareidentified,youcan
constructmoresophisticateddesigns,suchasresponsesurfacedesigns,tomodelinteractions
andcurvature.
ScreeningdesignsconstructedusingtheCustomDesignplatformareoftenequivalenttothe
classicaldesignsprovidedintheScreeningDesignplatform.However,CustomDesigncan
constructdesignsforcaseswhereclassicalscreeningdesignsarenotavailable.
TheCustomDesignplatformconstructsscreeningdesignsusingeithertheDoptimalityor
BayesianDoptimalitycriterion.TheDoptimalitycriterionminimizesthedeterminantofthe
covariancematrixofthemodelcoefficientestimates.ItfollowsthatDoptimalityfocuseson
preciseestimatesoftheeffects.Fordetails,seeOptimalityCriteriaonpage 120inthe
CustomDesignschapter.
Thissectioncontainsthefollowingexamples:

DesignThatEstimatesMainEffectsOnlyonpage 129

DesignThatEstimatesAllTwoFactorInteractionsonpage 132

DesignThatAvoidsAliasingofMainEffectsandTwoFactorInteractionsonpage 134

SupersaturatedScreeningDesignsonpage 138

DesignforFixedBlocksonpage 145

Design That Estimates Main Effects Only


Note: Fordetailsaboutmaineffectsonlyscreeningdesigns,seetheScreeningDesigns
chapteronpage 231.
Inthisexample,youareinterestedinstudyingthemaineffectsofsixfactors.Youconstructa
screeningdesignwhereallofthemaineffectsareorthogonal.However,themaineffectsare
aliasedwithtwofactorinteractions.
1. SelectDOE > Custom Design.
2. IntheFactorsoutline,type6nexttoAdd N Factors.
3. ClickAdd Factor > Continuous.
4. ClickContinue.
TheModeloutlineappears.ItincludesonlymaineffectswithEstimabilitydesignatedas
Necessary.Thismeansthatallmaineffectsareestimableinthedesignthatisgenerated.

130

Examples of Custom Designs


Screening Experiments

Chapter 5
Design of Experiments Guide

Figure 5.2CustomDesignWindowShowingModelOutline

Keepthedefaultof12runs.
Note: SettingtheRandomSeedinstep5andNumberofStartsinstep6reproducesthe
exactresultsshowninthisexample.Whenconstructingadesignonyourown,thesesteps
arenotnecessary.
5. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1839634787,andclickOK.
6. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type1,
andclickOK.
7. ClickMake Design.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Screening Experiments

131

Figure 5.3DesignforMainEffectsOnly

8. OpentheDesign Evaluation > Color Map on Correlations outline.


Figure 5.4ColorMaponCorrelations

Noticethefollowing:
Themaineffectsarerepresentedbythesixtermsintheupperleftcornerofthemap.
Thedeepbluecolorcorrespondingtothecorrelationsofthesixmaineffectswithother
maineffectsindicatescorrelationsof0.Thismeansthatallmaineffectsareorthogonal
andcanbeestimatedindependentlyofeachother.
Thelightbluecolorinthesquarescorrespondingtosometwowayinteractions
indicatesthatthecorrespondingeffectsarecorrelated.Thismeansthattheseeffects
cannotbeestimatedindependentlyofothereffects.Placeyourcursoroverthese
squarestoseetheexactcorrelation.

132

Examples of Custom Designs


Screening Experiments

Chapter 5
Design of Experiments Guide

Noticethatnoeffectsarecompletelyconfoundedwitheachother.Theonlyred
squares,indicatingabsolutecorrelationsof1,areonthemaindiagonal.
9. OpentheDesign Evaluation > Alias Matrixoutline.
Figure 5.5AliasMatrix

TheAliasMatrixshowshowthecoefficientsofthemaineffecttermsinthemodelarebiased
bypotentiallyactivetwofactorinteractioneffects.Thecolumnlabelsidentifyinteractions.For
example,intheX1row,thecolumnX2*X3hasavalueof0.333andthecolumnX2*X4 hasa
valueof0.33.ThismeansthattheexpectedvalueofthemaineffectofX1isthesumofthe
maineffectofX1plus0.333timestheeffectofX2*X3,plus0.33timestheeffectofX2*X4,and
soon,fortherestoftheX1 row.InorderfortheestimateofthemaineffectofX1tobe
meaningful,youmustassumethattheseinteractionsarenegligibleinsizecomparedtothe
effectofX1.
Tip: TheAliasMatrixisageneralizationoftheconfoundingpatterninfractionalfactorial
designs.

Design That Estimates All Two-Factor Interactions


TheAliasMatrixinFigure 5.5showspartialaliasingofeffects.Inothercases,maineffects
mightbefullyaliased,orconfounded,withtwofactorinteractions.Inbothofthesecases,
strongtwofactorinteractionscanconfusetheresultsofmaineffectsonlyexperiments.To
avoidthisrisk,createadesignthatresolvesalltwofactorinteractions.
Inthisexample,youcreatearesolutionVscreeningdesign.Twofactorinteractionsare
orthogonal,buttheyareconfoundedwiththreefactorinteractions.
1. SelectDOE > Custom Design.
2. Type5nexttoAdd N Factors.
3. ClickAdd Factor > Continuous.
4. ClickContinue.
5. IntheModeloutline,selectInteractions > 2nd.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Screening Experiments

133

Figure 5.6ModelOutlineShowingInteractions

6. ClickMinimumtoaccept16forthenumberofruns.
Note: SettingtheRandomSeedinstep7andNumberofStartsinstep8reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
7. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
819994207,andclickOK.
8. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type1,
andclickOK.
9. ClickMake Design.
Figure 5.7showstherunsofthedesign.Allmaineffectsandtwofactorinteractionsare
estimablebecausetheirEstimabilitywasdesignatedasNecessary(bydefault)inthe
Modeloutline.

134

Examples of Custom Designs


Screening Experiments

Chapter 5
Design of Experiments Guide

Figure 5.7DesigntoEstimateAllTwoFactorInteractions

10. OpentheDesign Evaluation > Color Map on Correlations outline.


Figure 5.8ColorMaponCorrelations

TheColorMapindicatesthatthefivemaineffectsandthetentwowayinteractionsareall
mutuallyorthogonal.

Design That Avoids Aliasing of Main Effects and Two-Factor Interactions


Supposethatyourprimaryinterestisinestimatingthemaineffectsofsixcontinuousfactors.
However,youwanttodothisinawaythatminimizesaliasingofmaineffectswithpotentially
activetwofactorinteractions.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Screening Experiments

135

Yourbudgetallowsforonly16runs.Withsixfactors,thereare15possibletwofactor
interactions.Theminimumnumberofrunsrequiredtofittheconstant,thesixmaineffects,
andthe15twofactorinteractionsis22.
Inthisexample,youfindacompromisebetweenan8runmaineffectsonlydesign(see
DesignThatEstimatesMainEffectsOnlyonpage 129)anda22rundesigncapableoffitting
allthetwofactorinteractions.YouuseAliasOptimalityastheoptimalitycriteriontoachieve
yourgoal.
1. SelectDOE > Custom Design.
2. Type6nexttoAdd N Factors.
3. ClickAdd Factor > Continuous.
4. ClickContinue.
Themodelincludesthemaineffecttermsbydefault.Thedefaultestimabilityofthese
termsisNecessary.IntheAliasTermsoutline,noticethatsecondorderinteractionsare
added.Bydefault,alltwowayinteractionsnotincludedintheassumedmodelareadded
totheAliasTermslist.
5. SelectOptimality Criterion > Make Alias Optimal Designfromtheredtrianglemenu.
TheMakeAliasOptimalDesignselectiontellsJMPtogenerateadesignthatbalances
reductioninaliasingwithDefficiency.SeeAliasOptimalityonpage 124intheCustom
Designschapter.
6. ClickUser Specifiedandchangethenumberofrunsto16.

136

Examples of Custom Designs


Screening Experiments

Chapter 5
Design of Experiments Guide

Figure 5.9Factors,Model,AliasTerms,andNumberofRuns

Note: SettingtheRandomSeedinstep7andNumberofStartsinstep8reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
7. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1692819077,andclickOK.
8. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type161,
andclickOK.
9. ClickMake Design.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Screening Experiments

137

10. OpentheDesign Evaluation > Alias Matrixoutline.


Figure 5.10AliasMatrix

Allrowscontainonlyzeros,whichmeansthattheInterceptandmaineffecttermsarenot
biasedbyanytwofactorinteractions.
11. OpentheDesign Evaluation > Color Map on Correlations outline.
Figure 5.11ColorMaponCorrelations

TheColorMaponCorrelationsshowsthatmaineffectscanbeestimatedindependentlyof
twowayinteractions.However,sometwowayinteractionsarefullyaliasedwithother
twowayinteractions.Placeyourcursorovertheoffdiagonalredsquarestoseewhich
twowayinteractionsareconfounded.
ItturnsoutthatthisparticulardesignisaresolutionIVorthogonalscreeningdesign.Main
effectsarenotaliasedwitheachotherorwithtwowayinteractions.Buttwowayinteractions
arefullyaliasedwithothertwowayinteractions.

138

Examples of Custom Designs


Screening Experiments

Chapter 5
Design of Experiments Guide

Supersaturated Screening Designs


Itiscommonforbrainstormingsessionstoidentifydozensofpotentiallyactivefactors.Rather
thanreducethelistwithoutthebenefitofdata,youcanuseasupersaturateddesign.
Inasaturateddesign,thenumberofrunsequalsthenumberofmodelterms.Inasupersaturated
design,thenumberofmodeltermsexceedsthenumberofruns(Lin,1993).Asupersaturated
designcanexaminedozensoffactorsusingfewerthanhalfasmanyrunsasfactors.This
makesitanattractivechoiceforfactorscreeningwhentherearemanyfactorsand
experimentalrunsareexpensive.
LimitationsofSupersaturatedDesigns
Therearedrawbackstosupersaturateddesigns:

Ifthenumberofactivefactorsismorethanhalfthenumberofrunsintheexperiment,then
itislikelythatthesefactorswillbeimpossibletoidentify.Ageneralruleisthatthenumber
ofrunsshouldbeatleastfourtimeslargerthanthenumberofactivefactors.Inother
words,ifyouexpectthattheremightbeasmanyasfiveactivefactors,youshouldplanon
atleast20runs.

Analysisofsupersaturateddesignscannotyetbereducedtoanautomaticprocedure.
However,usingforwardstepwiseregressionisreasonable.Inaddition,theScreening
platform(Analyze>Modeling>Screening)offersastreamlinedanalysis.

Generating a Supersaturated Design


Inthisexample,youwanttoconstructasupersaturateddesigntostudy12factorsin8runs.
Note: Thisexampleisforillustrationonly.Youshouldhaveatleast14runsinany
supersaturateddesign.Ifthereareasmanyasfouractivefactors,itisverydifficulttointerpret
theresultsofan8rundesign.SeeLimitationsofSupersaturatedDesignsonpage 138.
SettheEstimabilityofallmodelterms(excepttheintercept)toIfPossible.WhenthereareIf
Possibletermsinamodel,JMPusestheBayesianDoptimalitycriteriontoobtainadesign.
Proceedasfollows:
1. SelectDOE > Custom Design.
2. Type12nexttoAdd N Factors.
3. ClickAdd Factor > Continuous.
4. ClickContinue.
5. IntheModeloutline,selectalltermsexcepttheIntercept.
6. ClickNecessarynexttoanyeffectandchangeittoIf Possible.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Screening Experiments

139

Figure 5.12Factors,Model,andNumberofRuns

7. IntheAliasTermsoutline,selectalleffectsandclickRemove Term.
ThisensuresthatonlythemaineffectsappearintheColorMaponCorrelations.Thisplot
isconstructedoncethedesigniscreated.
8. SelectSimulate Responsesfromtheredtrianglemenu.
Thisoptiongeneratesrandomresponsesthatappearinyourdesigntable.Youwilluse
theseresponsestoseehowtoanalyzeexperimentaldata.
KeeptheNumberofRunssettotheDefaultof8.

140

Examples of Custom Designs


Screening Experiments

Chapter 5
Design of Experiments Guide

Note: SettingtheRandomSeedinstep9andNumberofStartsinstep10reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
9. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1008705125,andclickOK.
10. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type100,
andclickOK.
11. ClickMake Design.
12. ClickMake Table.
DonotcloseyourCustomDesignwindow.Youreturntoitlaterinthisexample.
Thedesigntable(Figure 5.13)andtheSimulateResponseswindow(Figure 5.14)appear.
Figure 5.13DesignTablewithSimulatedResponses

Theresponsecolumn,Y,containssimulatedvalues.Thesearerandomlygeneratedusing
themodeldefinedbytheparametervaluesintheSimulateResponseswindow.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Screening Experiments

141

Figure 5.14SimulateResponsesWindow

TheSimulateResponseswindowshowscoefficientsof0forallterms,withanErrorStdof
1.ThevaluesintheYcolumncurrentlyreflectonlyrandomvariation.Noticethatthe
modelcoefficientsaresetto0becausenotallcoefficientsareestimable.
13. ChangethevaluesofthecoefficientsintheSimulateResponseswindowasshownin
Figure 5.15.
Figure 5.15ParameterValuesforSimulatedResponses

14. ClickApply.
TheresponsevaluesintheYcolumnchange.SeeFigure 5.16.
Note: Ifyoudidnotsettherandomseedandthenumberofstarts,orifyouclickApplymore
thanonce,yourresponsevalueswillnotmatchthoseinFigure 5.16.

142

Examples of Custom Designs


Screening Experiments

Chapter 5
Design of Experiments Guide

Figure 5.16ResponseColumnwithX1andX11Active

Inyoursimulation,youspecifiedX1 andX11asactivefactorswithlargeeffectsrelativetothe
errorvariation.Forthisreason,youranalysisofthedatashouldidentifythesetwofactorsas
active.
Analyzing a Supersaturated Design Using the Screening Platform
TheScreeningplatformprovidesawaytoidentifyactivefactors.Thedesigntablein
Figure 5.16containsthreescripts.TheScreeningscriptanalyzesyourdatausingtheScreening
platform(locatedundertheAnalyze > Modeling > Screeningmenu).
1. IntheTablespanelofthedesigntable,selectRun Scriptfromtheredtrianglenextto
Screening.
Figure 5.17ScreeningReportforSupersaturatedDesign

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Screening Experiments

143

ThefactorsX1andX11havelargecontrastandLenthtRatiovalues.Also,their
SimultaneouspValuesaresmall.IntheHalfNormalPlot,bothX1andX11fallfarfrom
theline.TheContrastsandtheHalfNormalPlotreportsindicatethatX1 andX11are
active.AlthoughX12hasanIndividualpValuelessthan0.05,itseffectismuchsmaller
thanthatofX1andX11.
Becausethedesignissupersaturated,pvaluesmightbesmallerthantheywouldbeina
modelwherealleffectsareestimable.Thisisbecauseeffectestimatesarebiasedbyother
potentiallyactivemaineffects.InFigure 5.17,anotedirectlyabovetheMakeModel
buttonwarnsyouofthispossibility.
Youmightalsowanttocheckwhethertheeffectsthatappearactivecouldbehighly
correlatedwithothereffects.Whenthisoccurs,oneeffectcanmaskthetruesignificanceof
anothereffect.Seestep4.
2. ClickMake Model.
TheconstructedmodelcontainsonlytheeffectsX1,X11, andX12.
3. ClickRunintheModelSpecificationwindow.
Figure 5.18ParameterEstimatesforModel

NotethattheparameterestimatesforX11 andX1areclosetothetheoreticalvaluesthat
youusedtosimulatethemodel.SeeFigure 5.15,whereyouspecifiedamodelwithX1 = 10
andX11 = 10.ThesignificanceofthefactorX12isanexampleofafalsepositive.
4. InyourCustomDesignwindow,opentheDesignEvaluation>ColorMaponCorrelations
outline.

144

Examples of Custom Designs


Screening Experiments

Chapter 5
Design of Experiments Guide

Figure 5.19ColorMaponCorrelationsOutline

Withyourcursor,placeyourmousepointerovercellstoseetheabsolutecorrelations.
NoticethatX1hascorrelationsashighas0.5withothermaineffects(X4,X5,X7).
Analyzing a Supersaturated Design Using Stepwise Regression
Stepwiseregressionisanotherwaytoidentifyactivefactors.ThedesigntableinFigure 5.16
containsthreescripts.TheModelscriptanalyzesyourdatausingstepwiseregressioninthe
FitModelplatform.
1. IntheTablespanelofthedesigntable,selectRun Scriptfromtheredtrianglenextto
Model.
2. ChangethePersonalityfromStandard Least SquarestoStepwise.
3. ClickRun.
4. IntheStepwiseFitforYreport,changetheStopping RuletoMinimum AICc.
Fordesignedexperiments,BICistypicallyamorelenientstoppingrulethanAICcasit
tendstoallowinactiveeffectsintothemodel.
5. ClickGo.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Screening Experiments

145

Figure 5.20StepwiseRegressionforSupersaturatedDesign

Figure 5.20showsthattheselectedmodelconsistsofthetwoactivefactors,X1andX11.
Thestephistoryappearsinthebottompartofthereport.Keepinmindthatcorrelations
betweenX1andX11andotherfactorscouldmasktheeffectsofotheractivefactors.See
Figure 5.19.
Note: Thisexampledefinestwolargemaineffectsandsetstheresttozero.Realworld
situationscanbelesslikelytohavesuchclearlydifferentiatedeffects.

Design for Fixed Blocks


Traditionalscreeningdesignsrequireblocksizestobeapoweroftwo.However,theCustom
Designplatformcancreatedesignshavingfixedblocksofanysize.
Supposethatyouwanttostudythreefactors.Youcanrunonlythreetrialsperdayandyou
expectsubstantialdaytodayvariation.Consequently,youneedtoblockyourdesignover
multipledays.Also,inthisstudy,youareinterestedinestimatingalltwofactorinteractions.
Inthisexample,youconstructadesignwiththreerunsperblock.

146

Examples of Custom Designs


Screening Experiments

Chapter 5
Design of Experiments Guide

1. SelectDOE > Custom Design.


2. IntheFactorsoutline,type3nexttoAdd N Factors.
3. ClickAdd Factor > Continuous.
4. ClickAdd Factor > Blocking > 3 runs per block.
NotethattheblockingfactorX4showsonlyonelevelunderValues.Thisisbecausetherun
sizeisunknownatthispoint.OnceyouclickContinue,theFactorsoutlineshowsan
appropriatenumberofblocks,calculatedastheDefaultrunsizedividedbythenumberof
runsperblock.Ifyouspecifyadifferentrunsize,theFactorsoutlineupdatestoshowthe
appropriatenumberofvaluesfortheblockingfactor.
Figure 5.21FactorsOutlineShowingOneBlockforX4

5. ClickContinue.
Thedefaultsamplesizeof9requiresthreeblocks.TheFactorsoutlinenowshowsthatX4
hasthreevalues,indicatingthethreeblocks.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Screening Experiments

147

Figure 5.22FactorsOutlineShowingThreeBlocksforX4

6. Selectthethreecontinuousfactors,X1,X2,andX3,intheFactorsoutline.
7. IntheModeloutline,clickInteractions > 2nd.
ThisaddsalltwowayinteractionsinvolvingthenonblockingfactorstotheModel
outline.Interactionswiththeblockingfactorshouldnotbeaddedtotheassumedmodel.

148

Examples of Custom Designs


Screening Experiments

Chapter 5
Design of Experiments Guide

Figure 5.23FactorsOutlineShowingSixBlocksforX4

TheNumberofRunspanelnowshowsthat18istheDefaultrunsize.NotethattheFactors
outlinehasupdatedtoshowsixvaluesforX4,indicatingsixblocks.
Note: SettingtheRandomSeedinstep8andNumberofStartsinstep9reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
8. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
458027747,andclickOK.
9. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type10,
andclickOK.
10. ClickMake Design.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Screening Experiments

149

Figure 5.24FixedBlockDesign

TheDesignoutlineshowsthedesign.RecallthatX4istheblockingfactor.Observethatthe
sixblocksarerepresented.Whenyouconductyourexperiment,yourunthethreetrials
whereX4 = 1onthefirstday,thethreewhereX4 = 2onthesecondday,andsoon.Soyou
wouldlikethedesigntabletorandomizethetrialswithinblocks.IntheOutputOptions
panel,notethatRandomizewithinBlocksisthedefaultsettingforRunOrder.
11. ClickMake Table.
Figure 5.25DesignTableforFixedBlockDesign

Therowsinthedesigntablearegroupedbyeachdaysruns.Thisdesignenablesyouto
estimatetheblockeffect,allmaineffects,andtwofactorinteractions.

150

Examples of Custom Designs


Response Surface Experiments

Chapter 5
Design of Experiments Guide

Response Surface Experiments


Responsesurfaceexperimentstypicallyinvolveasmallnumber(generally2to8)of
continuousfactorsthathavebeenidentifiedasactive.Themaingoalofaresponsesurface
experimentistodevelopapredictivemodeloftherelationshipbetweenthefactorsandthe
response.Often,youusethepredictivemodeltofindbetteroperatingsettingsforyour
process.Forthisreason,yourassumedmodelforaresponsesurfaceexperimentisusually
quadratic.
Becauseascreeningdesignisfocusedonidentifyingactiveeffects,ameasureofitsqualityis
thesizeoftherelativevarianceofthecoefficients.Youwanttheserelativevariancestobe
small.Doptimalityaddressestheserelativevariances.
Inresponsesurfaceexperiments,thepredictionvarianceovertherangeofthefactorsismore
importantthanthevarianceofthecoefficients.Thepredictionvarianceoverthedesignspace
isaddressedbyIoptimality.AnIoptimaldesigntendstoplacefewerrunsattheextremesof
thedesignspacethandoesaDoptimaldesign.FordetailsaboutDandIoptimality,see
OptimalityCriteriaonpage 120intheCustomDesignschapter.
Bydefault,CustomDesignusestheRecommendedoptionfortheOptimalityCriterion.
CustomDesignusestheIoptimalitycriterionastheRecommendedcriterionwheneveryou
addquadraticeffectsusingtheRSMbuttonintheModeloutline.Otherwise,CustomDesign
usestheDoptimalitycriterionastheRecommendedcriterion.SeeOptimalityCriteriaon
page 120intheCustomDesignschapter.
Thissectioncontainsthefollowingexamples:

ResponseSurfaceDesignonpage 150

ResponseSurfaceDesignwithFlexibleBlockingonpage 156

ComparisonofaDOptimalandanIOptimalResponseSurfaceDesignonpage 159

Response Surface Design


Thefollowingexamplecontainsthesesections:

ConstructingaResponseSurfaceDesignonpage 150

AnalyzingtheExperimentalResultsonpage 153

Constructing a Response Surface Design


Constructaresponsesurfacedesignforthreecontinuousfactorsthatyouhaveidentifiedas
active.Youwanttofindprocesssettingstomaintainyourresponse(Y)withinspecifications.
ThelowerandupperspecificationlimitsforYare54and56,respectively,withatargetof55.
1. SelectDOE > Custom Design.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Response Surface Experiments

151

2. IntheResponsesoutline,clickMaximizeandselectMatch Target.
3. Type54astheLower Limitand56astheUpper Limit.
4. LeaveImportanceblank.
Becausethereisonlyoneresponse,theImportancevalueissetto1bydefault.
5. Type3nexttoAdd N Factors.
6. ClickAdd Factor > Continuous.
Thisaddsthreecontinuousfactors:X1,X2,andX3.
7. ClickContinue.
8. IntheModeloutline,clicktheRSMbutton.
Thisaddsquadraticandinteractiontermstothemodel.Italsosetsthevalueofthe
RecommendedoptimalitycriteriontoIoptimality.YoucanverifythisintheDesign
DiagnosticsoutlineonceyouclickMakeDesign.
LeavetheDefaultNumberofRunssetto16.
Note: SettingtheRandomSeedinstep9andNumberofStartsinstep10reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
9. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
929281409,andclickOK.
10. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type40,
andclickOK.
11. ClickMake Design.
TheDesignoutlineshowsthedesign.
Figure 5.26RSMDesign

152

Examples of Custom Designs


Response Surface Experiments

Chapter 5
Design of Experiments Guide

Inordertoestimatequadraticeffects,aresponsesurfacedesignusesthreelevelsforeach
factor.NotethatthedesigninFigure 5.26isafacecenteredCentralCompositeDesign
withtwocenterpoints.
12. OpentheDesign Evaluation > Design Diagnosticsoutline.
Figure 5.27DesignDiagnosticsOutline

ThefirstlineintheDesignDiagnosticsoutlineidentifiestheoptimalitycriterionbeing
used.ThisdesignisIoptimal.
13. OpentheDesign Evaluation > Prediction Variance Profile outline.
Figure 5.28PredictionVarianceProfile

Theverticalaxisshowstherelativepredictionvarianceoftheexpectedvalueofthe
response.Therelativepredictionvarianceisthepredictionvariancedividedbytheerror
variance.Whentherelativepredictionvarianceisone,itsabsolutevarianceequalsthe
errorvarianceoftheregressionmodel.
Theprofilershowsvaluesoftherelativepredictionvarianceoverthedesignspace.You
canmovethesliderstoexplorethepredictionvariancesbehavior.Thepredictionvariance
issmallestinthecenterofthedesignspace.Itisfairlyconstant,withvaluesonlyslightly
largerthan0.2,forfactorsettingsbetween0.5and0.5.Thepredictionvarianceincreases
asthesettingsapproachthedesignspaceboundaries.
14. SelectMaximize DesirabilityfromtheredtrianglemenunexttoPredictionVarianceProfile
outline.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Response Surface Experiments

153

Figure 5.29PredictionVarianceProfilewithRelativeVarianceMaximized

Theprofilershowsthatthemaximumvalueoftherelativepredictionvarianceis0.79569.
15. OpentheDesign Evaluation > Fraction of Design Space Plot outline.
Figure 5.30FractionofDesignSpacePlot

Thebluecurveintheplotshowstherelativepredictionvarianceasafunctionofthefractionof
designspace.Thereddashedcrosshairsindicatethat,for50%ofthedesignspace,the
predictionvarianceisabout0.32orless.Usethecrosshairtooltodrawotherinferences.For
example,whentheFractionofSpaceis0.95,thePredictionVarianceisabout0.52.Thismeans
thatfor95%ofthedesignspace,therelativepredictionvarianceisbelow0.52.
Analyzing the Experimental Results
TheCustom RSM.jmpsampledatatablecontainstheresultsoftheexperiment.TheModel
scriptopensaFitModelwindowshowingalloftheeffectsspecifiedintheDOEwindows
Modeloutline.ThisscriptwassavedtothedatatablebytheCustomDesignplatform.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Custom RSM.jmp.
2. IntheTablespanel,clicktheredtrianglenexttoModelandselectRun Script.
3. ClickRun.

154

Examples of Custom Designs


Response Surface Experiments

Chapter 5
Design of Experiments Guide

TheEffectSummaryreportshowstheLogWorthandPValueforeacheffectinthemodel.
Theverticalbluelineintheplotissetatthevalue2.ALogWorththatexceeds2is
significantatthe0.01level.
Figure 5.31EffectSummaryReport

ThereportshowsthatX1,X2,X1*X1,andX2*X2aresignificantatthe0.01level.Noneofthe
othereffectsaresignificantateventhe0.10level.Reducethemodelbyremovingthese
insignificanteffects.
4. IntheEffectSummaryreport,selectX3,X1*X2,X3*X3,X1*X3,andX2*X3.
Figure 5.32EffectSummaryReportwithInsignificantEffectsSelected

5. ClickRemove.
TheFitLeastSquaresreportisupdatedtoshowamodelcontainingonlythesignificant
effects:X1,X2,X1*X1,andX2*X2.
UsethePredictionProfiler(atthebottomoftheFitLeastSquareswindow)toexplorehow
thepredictedresponse(Y)changesasyouvarythefactorsX1andX2.Notethequadratic
behaviorofYacrossthevaluesofX1andX2.
RememberthatyouenteredresponselimitsforYintheResponsesoutlineoftheCustom
Designwindow.Asaresult,theResponseLimitcolumnpropertyisattachedtotheY
columninthedesigntable.TheDesirabilityfunctionforY(inthetopplotatright)isbased

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Response Surface Experiments

155

ontheinformationcontainedintheResponseLimitcolumnproperty.JMPusesthis
functiontocalculateDesirabilityasafunctionofthesettingsofX1andX2.Thetracesof
theDesirabilityfunctionappearinthebottomrowofplots.
6. InthePredictionProfilerreport,selectMaximize Desirabilityfromtheredtriangleoptions.
Figure 5.33PredictionProfilerwithDesirabilityMaximized

Thepredictedresponseachievesthetargetvalueof55attheprocesssettingsshowninred
aboveX1andX2.Figure 5.33showsthatavalueofX1near0.65alsoachievesapredicted
valueof55whenX2=0.75062.Infact,yourPredictionProfilermightshowdifferent
settingsasthosethatmaximizedesirability.Thisisbecausethepredictedresponseis55for
manysettingsofX1andX2.
7. SelectFactor Profiling > Contour ProfilerfromtheredtrianglenexttoResponseY.
8. IntheContourProfilerreport,type55asthevalueforContour.

156

Examples of Custom Designs


Response Surface Experiments

Chapter 5
Design of Experiments Guide

Figure 5.34ContourProfiler

ThesettingsofX1andX2thatcorrespondtotheredcontourhavepredictedresponse
valuesof55.Youmightwanttoselectfromamongtheseprocesssettingsbasedoncost
efficiency.

Response Surface Design with Flexible Blocking


Whenoptimizingaprocess,youmightneedtoincludequalitativefactorsinyourexperiment
aswellascontinuousfactors.Youmightneedtoblockbybatchorday,orincludefactorssuch
asmachineordeliverymechanism.
TheResponseSurfaceDesignplatformsupportsonlycontinuousfactors.Toobtainaresponse
surfacedesignwithaqualitativefactor,youcanreplicatethedesignovereachlevelofthe
factor.However,thisisinefficient.TheCustomDesignplatformconstructsanoptimaldesign
withfewerruns.
Inthisexample,youconstructaresponsesurfacedesignthataccommodatestwocontinuous
factorsandablockingfactorwithfourrunsperblock.Youcanincludecategoricalordiscrete
numericfactorsinasimilarfashion.
1. SelectDOE > Custom Design.
2. Type2nexttoAdd N Factors.
3. ClickAdd Factor > Continuous.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Response Surface Experiments

157

4. ClickAdd Factor>Blocking > 4 runs per block.


NoticethatonlyonelevelappearsunderValues.Thisisbecausethenumberofblocks
cannotbedetermineduntilthenumberofrunsisdetermined.
Figure 5.35FactorsOutlinewithTwoContinuousFactorsandaBlockingFactor

5. ClickContinue.
TheDefaultnumberofrunsis12.TheFactorsoutlineupdatestoshowthreelevelsforthe
Blockingfactor,X3.BecauseyourequiredX3tohavefourrunsperblock,the12runsallow
threeblocks.
6. ClickRSM.
AninformationalJMPAlertwindowremindsyouthattheblockingfactorcannotappear
ininteractionorquadraticterms.JMPaddsonlytheappropriateRSMtermstothelist.
7. ClickOKtodismissthemessage.
QuadraticandinteractionstermsforX1andX2areaddedtothemodel.Becauseyou
addedRSMterms,theRecommendedoptimalitycriterionchangesfromDOptimalto
IOptimal.YoucanseethislaterintheDesignDiagnosticsoutline.
Figure 5.36ModelOutlinewithResponseSurfaceEffects

Note: SettingtheRandomSeedinstep8andNumberofStartsinstep9reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
8. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1415408414,andclickOK.
9. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type21,
andclickOK.

158

Examples of Custom Designs


Response Surface Experiments

Chapter 5
Design of Experiments Guide

10. ClickMake Design.


11. OpentheDesign Evaluation > Design Diagnosticsoutline.
Figure 5.37DesignDiagnosticsOutline

ThefirstlineintheDesignDiagnosticsoutlineidentifiestheoptimalitycriterionbeing
used.ThisdesignisIoptimal.
12. ClickMake Table.
Figure 5.38DesignTablewithBlockingFactor

BecausethedefaultRunOrderwasRandomizewithinBlocks,thelevelsoftheblocking
factor(X3)aresorted.
13. IntheTablespanelofthedesigntable,clicktheredtrianglenexttoModelandselectRun
Script.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Response Surface Experiments

Figure 5.39FitModelWindow

Noticethefollowing:
Theblockingfactor(X3)isenteredasaneffect.
NointeractionsinvolvingX3areincluded.
TheotherfiveeffectsdefinearesponsesurfacemodelforX1andX2.

Comparison of a D-Optimal and an I-Optimal Response Surface Design


Inthisexample,youexplorethedifferencesbetweenIoptimalityandDoptimalityinthe
contextofatwofactorresponsesurfacedesign.
I-Optimal Design
1. SelectDOE > Custom Design.
2. Type2nexttoAdd N Factors.
3. ClickAdd Factor > Continuous.
4. ClickContinue.
5. ClickRSM.
QuadraticandinteractionstermsforX1andX2areaddedtothemodel.Becauseyou
addedRSMterms,theRecommendedoptimalitycriterionchangesfromDOptimalto
IOptimal.YoucanseethislaterintheDesignDiagnosticsoutline.

159

160

Examples of Custom Designs


Response Surface Experiments

Chapter 5
Design of Experiments Guide

Note: SettingtheRandomSeedinstep6andNumberofStartsinstep7reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
6. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
383570403,andclickOK.
7. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type8,
andclickOK.
8. ClickMake Design.
Figure 5.40IOptimalDesign

InthisIoptimaldesign,runs1,4,7,and10areatthecenterpoint(X1 = 0andX2 = 0).


Ioptimaldesignstendtoplacemorerunsinthecenter(andconsequentlyfewerrunsat
theextremes)ofthedesignspacethandoDoptimaldesigns.Youcancomparethisdesign
totheDoptimaldesignshowninFigure 5.42.
9. OpentheDesign Evaluation>Prediction Variance Profileoutline.
Figure 5.41PredictionVarianceProfileforIOptimalModel

Therelativepredictionvarianceoftheexpectedresponseissmallestinthecenterofthe
designspace.
10. OpentheFraction of Design Space Plotoutline.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Response Surface Experiments

161

TheFractionofDesignSpacePlotappearsontheleftinFigure 5.44.WhentheFractionof
Spaceis0.95,theverticalcoordinateofthebluecurveisabout0.5.Thismeansthatforabout
95%ofthedesignspace,therelativepredictionvarianceisbelow50%oftheerrorvariance.
ThisCustomDesignwindowcontainsyourIoptimaldesign.Keepthiswindowopen.Inthe
nextsection,yougenerateaDoptimaldesign,andcomparethetwo.
D-Optimal Design
TocomparePredictionVarianceProfileandFractionofDesignSpaceplotsfortheIand
Doptimaldesigns:
1. IntheCustomDesignwindowcontainingyourIoptimaldesign,fromtheCustomDesign
redtrianglemenu,selectSave Script to Script Window.
Awindowappears,showingascriptthatreproducesyourwork.
2. Inthisnewscriptwindow,selectEdit > Run Script.
AduplicateCustomDesignwindowappears,butwiththeDesignEvaluationoutlines
closed.
3. InthisnewCustomDesignwindow,clickBack.
4. FromtheredtrianglenexttoCustomDesign,selectOptimality Criterion > Make D-Optimal
Design.
5. ClickMake Design.
YoucurrentCustomDesignwindowcontainsyourDoptimaldesign.
Figure 5.42DOptimalDesign

InthisDoptimaldesign,run7istheonlyrunatthecenterpoint.Doptimaldesignstend
toplacemorerunsattheextremesofthedesignspacethandoIoptimaldesigns.Recall
thattheIoptimaldesignhadfourcenterruns(Figure 5.40).
6. OpentheDesign Evaluation>Prediction Variance Profileoutline.

162

Examples of Custom Designs


Response Surface Experiments

Chapter 5
Design of Experiments Guide

Figure 5.43PredictionVarianceProfileforDOptimalModel

Atthecenterofthedesignregion,therelativepredictionvarianceis0.53562,ascompared
to0.208333fortheIoptimaldesign(Figure 5.41).Thismeansthattherelativestandard
erroris0.732fortheDoptimaldesignand0.456fortheIoptimaldesign.Allelsebeing
equal,atthecenterofthedesignregion,confidenceintervalsfortheexpectedresponse
basedontheDoptimaldesignareabout60%widerthanthosebasedontheIoptimal
design.
TheDesignoutlineshowsthattheDoptimaldesignhasninedesignpoints,oneforevery
combinationofX1andX2setto1,0,1.TheDoptimalitycriterionattemptstokeepthe
relativepredictionvariancelowateachofthesedesignpoints.Explorethevarianceatthe
extremesofthedesignregionbymovingtheslidersforX1andX2to1and1.Notethatthe
varianceattheseextremepointsisusuallysmallerthanthevariancefortheIoptimal
designatthesepoints.
7. OpentheDesign Evaluation>Fraction of Design Space Plotoutline.
TheFractionofDesignSpacePlotappearsontherightinFigure 5.44.
Figure 5.44FractionofDesignSpacePlots(IOptimalonleft,DOptimalonright)

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Mixture Experiments

163

Theredcrosshairsineachplotindicatethemaximumpredictionvariancefor50%ofthe
designspace.For50%ofthedesignspace,thepredictionvariancefortheIoptimaldesign
fallsbelowabout0.27.FortheDoptimaldesign,thepredictionvarianceisabout0.4.
8. RightclickintheFractionofDesignSpacePlotforyourIoptimaldesign.SelectEdit >
Copy Frame Contents.
9. RightclickintheFractionofDesignSpacePlotforyourDoptimaldesign.SelectEdit >
Paste Frame Contents.
Figure 5.45FractionofDesignSpacePlotsSuperimposed

ThevariancecurvefortheIoptimaldesignisbelowthecurvefortheDoptimaldesign
overatleast90%ofthedesignspace.ThisreflectsthefactthatIoptimalityattemptsto
minimizepredictionvarianceoverallofthedesignspace.Incontrast,Doptimality
focusesonreducingpredictionvarianceatthedesignpoints.

Mixture Experiments
BoththeCustomDesignandMixtureDesignplatformsconstructdesignsforsituationswhere
allofyourfactorsareingredientsinamixture.However,mixtureexperimentscaninvolve
nonmixtureprocessvariables,orprocessfactors.TheCustomDesignplatformcanconstructa
designtoaccommodatebothmixtureingredientsandprocessfactors.TheCustomDesign
platformalsoallowsthemixturecomponentstosumtoanypositivenumber.SeeAdvanced
Options>MixtureSumonpage 105.
Thissectioncontainsthefollowingexamples:

MixtureDesignwithNonmixtureFactorsonpage 164

MixtureofMixturesDesignonpage 168

164

Examples of Custom Designs


Mixture Experiments

Chapter 5
Design of Experiments Guide

Mixture Design with Nonmixture Factors


InthefollowingexamplefromAtkinsonandDonev(1992),youcreateadesignforan
experimentinvolvingbothmixturefactorsandprocessfactors.Thedesignisan18rundesign
thatisbalancedwithrespecttothelevelsofacategoricalfactor.Thedesignenablesyoutofita
fullresponsesurface.YouuseDesignEvaluationplotsandresultstoexaminetherelative
predictionvarianceofthedesign.
Theresponseandfactorsinvolvedinthedesignareasfollows:

TheresponseisDamping,whichmeasurestheelectromagneticdampingofanacrylonitrile
powder.

Thethreemixtureingredientsare:
CuSO4(coppersulphate),rangingfrom0.2to0.8
Na2S2O3(sodiumthiosulphate),rangingfrom0.2to0.8
Glyoxal(glyoxal),rangingfrom0to0.6

ThenonmixtureenvironmentalfactorofinterestisWavelength(thewavelengthoflight)at
threelevelsdenotedL1,L2,andL3.
Wavelengthisacontinuousvariable.However,theresearcherswereinterestedonlyin
predictionsatthreespecificwavelengths.Forthisreason,youtreatWavelengthasa

categoricalfactorwiththreelevels.
Thisexamplecontainsthefollowingsteps:

CreatetheDesignonpage 164

EvaluatetheDesignonpage 166

CreatetheDesign
1. SelectDOE > Custom Design.
2. DoubleclickYunderResponseNameandtypeDamping.
3. ClickMaximizeunderGoalandchangeittoNone.
ThegoalissettoNonebecausetheauthorsofthestudydonotmentionhowmuch
dampingisdesirable.
4. FromtheCustomDesignredtrianglemenu,selectLoad Factors.
5. SelectHelp > Sample Data Library andopenDesign Experiment/Donev Mixture Factors.jmp.
Thisloadsthethreemixtureingredientsandthecategoricalprocessfactor.Notethatthe
boundsonthevaluesofthethreemixturefactorsarealsoloaded.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Mixture Experiments

165

Figure 5.46ResponsesOutlineandFactorsOutline

6. ClickInteractions > 2nd.


AninformationalJMPAlertwindowremindsyouthatJMPremovesthemaineffectterms
fornonmixturefactorsthatinteractwithallthemixturefactors.Thismeansthatthemain
effectofWavelengthisremoved,butalltwowayinteractionsofmixturefactorswith
Wavelengthareadded.
7. ClickOKtodismissthemessage.
TheeffectsintheModeloutlinedefinearesponsesurfacemodelinthemixture
ingredientsalongwiththeadditiveeffectofthewavelength.SeeScheff(1958).
Figure 5.47ModelandDesignGenerationOutlines

166

Examples of Custom Designs


Mixture Experiments

Chapter 5
Design of Experiments Guide

8. Leavethedefaultnumberofrunsat18.
Thechoiceof18runsallowssixrunsforeachofthethreelevelsofthewavelengthfactor.
Note: SettingtheRandomSeedinstep9andNumberofStartsinstep10reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
9. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
858576648,andclickOK.
10. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type10,
andclickOK.
11. ClickMake Design.
Figure 5.48DesignOutlineShowing18RunDesign

YoucancheckthattherearesixrunsforeachlevelofWavelength.
EvaluatetheDesign
1. OpentheDesign Evaluation>Prediction Variance Profile outline.
Figure 5.49PredictionVarianceProfilefor18RunDesign

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Mixture Experiments

167

MovethesliderforWavelengthtoverifythattherelativepredictionvarianceprofilesfor
themixturefactorsdonotchangeacrossthelevelsofWavelength.Movethesliderforany
oneofthemixturefactors.Thefactorsfortheothertwomixturefactorsadjusttomakethe
mixtureingredientssumtoone.Noticethatthesmallestrelativepredictionvariances
occurnearthecentersettingsforthemixturefactors.
2. FromthePredictionVarianceProfileredtrianglemenu,selectMaximize Desirability.
Noticethatthemaximumrelativepredictionvarianceoverthedesignspaceis0.8times
theerrorvariance.
3. OpentheFraction of Design Space Plotoutline.
Figure 5.50FractionofDesignSpacePlotfor18RunDesign

Overtheentiredesignspace,therelativepredictionvarianceisbelow0.8.Theminimum
relativepredictionvarianceisabout0.32.AsseeninFigure 5.49,theminimumoccursnear
thecentersettingsforthemixturefactors.
4. OpentheDesign Diagnostics outline.
Figure 5.51DesignDiagnosticsOutlinefor18RunDesign

ThedesignisoptimalrelativetotheDoptimalitycriterion,eventhoughitsDefficiencyis
verylow(3.6%).Becausemixturedesignsarefarfromorthogonalduetothemixture
constraint,theytypicallyhaveverylowDefficiencies.TheAverage(relative)Varianceof
Predictionis0.410395.ThisisconsistentwiththeFractionofDesignSpaceplotinFigure 5.50.

168

Examples of Custom Designs


Mixture Experiments

Chapter 5
Design of Experiments Guide

Mixture of Mixtures Design


Inthisexample,constructadesignforamixtureofmixturessituation.
Considertheingredientsthatgointoacake.Dryingredientsincludeflour,sugar,andcocoa.
Wetingredientsincludemilk,meltedbutter,andeggs.Thewetanddrycomponentsofthe
cakearetwomixturesthatarefirstmixedseparatelyandthenblendedtogether.Table 5.1lists
thefactorsandtherangesoverwhichyouvarythemaspartofyourexperiment.
Table 5.1DryandWetComponentsandExperimentalRanges
Mixture

Ingredient

Lower Level

Upper Level

Dry

Cocoa

10%(0.1)

20%(0.2)

Sugar

0%(0)

15%(0.15)

Flour

20%(0.2)

30%(0.3)

Butter

10%(0.1)

20%(0.2)

Milk

25%(0.25)

35%(0.35)

Eggs

5%(0.05)

20%(0.20)

Wet

Thedrycomponents(themixtureofflour,sugar,andcocoa)comprise45%ofthecombined
mixture.Thewetcomponents(butter,milk,andeggs)comprise55%.
ThegoalofyourexperimentistooptimizeaTasterating.Tasteisratedonascaleof1to10,
with10representingthebesttaste.
Youconstructa10rundesigntofitamaineffectsmodel.Becauseoftheconstraintonthe
proportionsofdryandwetingredients,youneedtoincludeonlyfivefactorsintheModel
outlinetoavoidsingularity.Thechoiceofwhichfactornottoincludeisarbitrary.
Thisexamplecontainsthefollowingsteps:

CreatetheDesignonpage 168

AnalyzetheExperimentalResultsonpage 171

CreatetheDesign
1. SelectDOE > Custom Design.
2. DoubleclickYunderResponseNameandtypeTaste.
NotethatthedefaultgoalisMaximize.BecauseyouwanttomaximizetheTasterating,do
notchangethegoal.
3. ClickunderLowerLimitandtype0.
Theleastdesirableratingis0.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Mixture Experiments

169

4. ClickunderUpperLimitandtype10.
Themostdesirableratingis10.
5. LeavetheareaunderImportanceblank.
Becausethereisonlyoneresponse,thatresponseisgivenImportance1bydefault.
6. FromtheCustomDesignredtrianglemenu,selectLoad Factors.
7. OpenCake Factors.jmpfromtheDesign Experimentsampledatafolder.
Figure 5.52CompletedResponsesandFactorsOutlines

Notethatthefactorsareallmixturefactors.TheValuesthatdefinetherangeofsettingsfor
theexperimentvaryfromfactortofactor.
8. IntheDefineFactorConstraintsoutline,selectSpecify Linear Constraints.
9. IntheLinearConstraintspanel,clickAdd twice.
10. EntertheconstraintsshowninFigure 5.53.
Forthesecondconstraintsetting,besuretoselectthegreaterthanorequaltodirection.
Figure 5.53DefineFactorConstraints

170

Examples of Custom Designs


Mixture Experiments

Chapter 5
Design of Experiments Guide

Thetwoinequalitiesensurethatthedryfactorssumtoexactly45%ofthetotal,ensuring
thatthewetfactorsconstitutetheremaining55%.
11. IntheModeloutline,selectanyeffectandclickRemove Term.
Becauseoftheequalityconstraint,amodelcontainingallsixeffectswouldbesingular.
12. Type10nexttoUser Specified.
Yourexperimentrequiresbaking10cakes.
Note: SettingtheRandomSeedinstep13andNumberofStartsinstep14reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
13. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1992991263,andclickOK.
14. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type40,
andclickOK.
15. ClickMake Design.
AJMPAlertinformsyouthatyourfactorconstraintsincludeanequalityconstraint.This
waswhatyouintended,becausethesumofthedryingredientproportionsisconstrained
to45%.
16. ClickOKtodismisstheJMPAlert.
17. ClickMake Table.
Figure 5.54MixtureofMixturesDesign

Each run sums to 0.45.

Each run sums to 0.55.

Thesettingsforthedryingredientssumto45%ofthemixtureandthesettingsforthewet
ingredientssumto55%ofthemixture.Thesettingsalsoconformtotheupperandlower
limitsgivenintheFactorsoutline.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Experiments with Covariates

171

AnalyzetheExperimentalResults
TheCake Data.jmpsampledatatableshowstheresultsoftheexperiment.Thedesigntable
containsaModelscriptthatopensaFitModelwindowshowingthefivemaineffectsspecified
intheDOEwindowsModeloutline.NoticethatthemaineffectofEggisnotincludedinthe
Modeloutlineforthisdesign.Thisscriptwassavedtothedatatablewhenitwascreatedby
CustomDesign.
1. OpentheCake Data.jmpsampledatatable,locatedintheDesignExperimentfolder.
2. IntheTablespanelofthedesigntable,clicktheredtrianglenexttoModelandselectRun
Script.
ThemaineffectduetoEggisnotincludedbecauseitwasexcludedfromtheModeloutline
intheCustomDesignwindow.AllfiveeffectsaredesignatedasResponseSurfaceand
Mixtureeffects.
3. ClickRun.
AJMPAlertappears,notifyingyouthattheProfilercannotbeshownbecauseofthe
additionalconstraint.
4. ClickOKtodismisstheJMPAlert.
TheParameterEstimatesreportindicatesthatSugar,Flour,andButteraresignificantatthe0.05
level.
Figure 5.55ParameterEstimatesReport

Experiments with Covariates


Sometimesmeasurementsontheexperimentalunitsthatareintendedforanexperimentare
available.Thesemeasurementsmightaffecttheexperimentalresponse.Itisusefultoinclude
thesevariables,calledcovariates,asdesignfactors.Althoughyoucannotdirectlycontrolthese
values,youcanensurethatthelevelsoftheotherdesignfactorsarechosentoyieldthemost
preciseestimatesofalltheeffects.
TheCustomDesignplatformconstructsadesignthatselectscovariatevaluesinanoptimal
fashion.Covariatevaluesareselectedfromanexistingdatatablethatprovidescovariate
informationaboutthepotentialexperimentalunits.Youcanspecifyanumberofrunsthatis
smallerthanthenumberofexperimentalunitslistedinyourdatatable.Youcanalsospecify
covariatesthatarehardtochange.

172

Examples of Custom Designs


Experiments with Covariates

Chapter 5
Design of Experiments Guide

Note: Thenumberofrowsinthecovariatedatatablewherecovariatefactorshavenonmissing
valuesmustbegreaterthanorequaltothespecifiedNumberofRuns.

Design with Fixed Covariates


Inthisexample,youareinterestedinmodelingtheShrinkageofpartsproducedbyan
injectionmoldingprocess.TheThermoplastic.jmpsampledatatableintheDesign Experiment
folderlists25batchesofraw(thermoplastic)materialforpotentialuseinyourstudy.Foreach
batch,materialwasremovedtoobtainmeasurementsofSpecific GravityandTensile Strength.
Athirdcovariate,Supplier,isalsoavailable.
Youwanttostudytheeffectsofthreecontrollablefactors,Temperature(moldtemperature),
Speed(screwspeed),andTime(holdtime),onShrinkage.Butyoualsowanttostudythe
effectsofthecovariates:Specific Gravity,Tensile Strength,andSupplier.Yourresourcesallow
for12runs.
Createyourdesignasfollows:
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Thermoplastic.jmp.
2. SelectDOE > Custom Design.
3. DoubleclickYunderResponseNameandtypeShrinkage.
4. ClickMaximizeunderGoalandchangeittoMinimize.
5. ClickAdd FactorandselectCovariate.
6. SelectSpecific Gravity,Tensile Strength,andSupplierfromthelistandclickOK.
Thesearecovariatesandcannotbecontrolled.
7. Type3nexttoAdd N Factors.
8. ClickAdd Factor > Continuous.
9. RenamethethreecontinuousfactorsTemperature,Speed,andTime.
Thesearefactorsthatcanbecontrolled.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Experiments with Covariates

173

Figure 5.56ResponsesandFactorsOutlines

10. ClickContinue.
TheNumberofRunsshowsthenumberofrowswithcovariatevaluesavailable.Youhave
25batcheswithmeasuredcovariates.
11. Type12nexttoNumber of Runs.
Note: SettingtheRandomSeedinstep12andNumberofStartsinstep13reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
12. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
84951,andclickOK.
13. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type40,
andclickOK.
14. ClickMake Design.

174

Examples of Custom Designs


Experiments with Covariates

Chapter 5
Design of Experiments Guide

Figure 5.57TwelveRunOptimalDesign

ThisdesignisDoptimal,giventhepotentialcovariatevalues.Itselectsthebestsetsof
covariatevaluesandthebestsettingsforthethreecontrollablefactors.
15. OpentheDesign Evaluation > Color Map On Correlationsoutline.
Figure 5.58ColorMaponCorrelations

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Experiments with Covariates

175

Theseventermscorrespondingtomaineffectsappearintheupperleftcornerofthecolor
map.Noticethattheseseventermsareclosetoorthogonal.Thelargestabsolutecorrelationis
betweenTensile StrengthandSupplier2.Thisabsolutecorrelationofabout0.43isa
consequenceoftheavailablecovariatevalues.

Design with Hard-to-Change Covariates


Inthisexample,youconstructadesignfordevelopingarunningshoeforseriousrunnersthat
hasgoodwear(Wear)properties.Yourexperimentalfactorsincludethefollowing:

solethickness(Thickness)

amountofgelcushioning(Gel)

outsolematerial(Outsole)

midsolematerial(Midsole)

Toobtaingeneralizableconclusions,youneedtotestyourshoesonabroadbaseofserious
runners.Toaccommodateyourexperimentalbudget,eachrunnermusttestseveral
experimentalcombinations.
Yourcompanyhascollecteddataon100suitablerunnerswillingtoparticipateinyourstudy.
Theconcomitantvariables(covariates)measuredontheserunnersareaveragedailymilesrun
(Miles),weight(Weight),andthefootsstrikepoint(Strike Point).
Createyourdesignasfollows:
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Runners Covariates.jmp.
2. SelectDOE > Custom Design.
3. DoubleclickYunderResponseNameandtypeWear.
4. ClickMaximizeunderGoalandchangeittoMinimize.
5. ClickAdd FactorandselectCovariate.
6. SelectMiles,Weight,andStrike PointfromthelistandclickOK.
Thesearethehardtochangecovariatesassociatedwiththerunners.
7. ForoneofthefactorsMiles,Weight,andStrike Point,underChanges,clickEasyandchange
ittoHard.
NotethatChangesforallthreecovariatesturntoHard.
8. Toaddtheremainingfactorsmanually,followstep9throughstep17.Or,toloadfactors
fromasavedtable,selectLoad FactorsfromtheredtrianglemenunexttoCustomDesign.
OpentheRunners Factors.jmpsampledatatable,locatedintheDesignExperimentfolder.
IfyouselectLoad Factors,skipstep9throughstep17.
9. Type2nexttoAdd N Factors.
10. ClickAdd Factor > Continuous.

176

Examples of Custom Designs


Experiments with Covariates

Chapter 5
Design of Experiments Guide

11. RenamethetwofactorsThicknessandGel.
12. ChangetheValuesforThicknessto5and20.
13. ChangetheValuesforGelto1and10.
14. Type2nexttoAdd N Factors.
15. ClickAdd Factor > Categorical > 3 Level.
16. RenamethetwofactorsOutsoleandMidsole.
KeepthedefaultValuesforthesefactors.
Figure 5.59ResponsesandFactorsOutlines

17. ClickContinue.
18. SelectInteractions > 2nd.
Thespecifiedmodelfitsalltwofactorinteractions,includingcovariatebyexperimental
factorinteractions.
19. SettheNumberofWholePlots,orrunners,to32(ifitisnotalreadysettothatnumber).
20. Type64nexttoUserSpecifiedunderNumberofRuns(ifitisnotalreadysettothat
number).
Note: SettingtheRandomSeedinstep21andNumberofStartsinstep22reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
21. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
12345,andclickOK.
22. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Startsandsetit
to1(ifitisnotalreadysettothatnumber).ClickOK.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Experiments with Covariates

177

23. ClickMake Design.


Figure 5.60First40RunsofDesignforHardtoChangeCovariates

Ofthe100runners,32areselectedbasedontheircovariatevalues.Therows
correspondingtotheselectedrunnersareselectedintheRunnersCovariates.jmpsample
datatable.SettingsoftheexperimentalfactorsThickness,Gel,Insole,andOutsoleare
determinedsothatthedesignisoptimalforthemodeldescribedintheModelOutline.
24. WiththeRunnersCovariates.jmpsampledatatableastheactivetable,selectAnalyze >
Distribution.
25. SelectallthreecolumnsasY, Columns.
26. CheckHistograms Only.
27. ClickOK.

178

Examples of Custom Designs


Experiments with Covariates

Chapter 5
Design of Experiments Guide

Figure 5.61Histogramsfor100RunnerswithSelectedRunnerDataShaded

ThehistogramsindicatethatalloftherunnerswithMilesof14.0orhigherwereselected.
RunnersattheextremesoftheWeightdistributionwereselected.Almostalloftherunners
withaStrike PointofForefootwereselected.Noticethatthedesignissomewhatbalanced
intermsofStrike Point.

Design with a Linear Time Trend


Often,experimentsconductedinatimesequenceexperiencealineardriftintheresponse.If
yourandomizetheorderoftheruns,thenthedriftseffectdoesnotgenerallybiasthe
estimatedfactoreffects.However,byaccountingforthedrift,youcanreducethevarianceof
thoseeffects.
Supposethatthereisreasontosuspectastronglineartrendintheresponseovertime
independentofthefactorchanges.Thenyoucanconstructadesignthatincludesalinear
covariatetoaccountforthetrend.Theresultingdesignisoptimal,giventhistrendcovariate.
Inthisexample,youdesignanexperimentfor7factors.Youconstructa16rundesignthatis
robusttolineartrend.
1. SelectFile > New > Data Table.
2. RightclickColumn1andselectColumn Info.
3. ChangethecolumnnametoRun Order.
4. FromthelistofInitialize Dataoptions,selectSequence Data.
5. Type16nexttoTo.
6. ClickOK.
Consecutiveintegersfrom1to16havebeenenteredinthedatatable.
7. SelectDOE > Custom Design.
8. ClickAdd Factor > Covariate.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Experiments with Covariates

179

9. SelectRun Orderandclick OK.


10. Type7nexttoAdd N Factors.
11. ClickAdd Factor > Continuous.
Figure 5.62ResponsesandFactorsOutlines

12. ClickContinue.
13. OpentheAlias Termsoutline.
14. SelectalloftheeffectsinthelistandclickRemove Term.
Thisomitstheinteractioneffectsfromthecorrelationcolormap,leavingonlythemain
effects.
Note: SettingtheRandomSeedinstep15andNumberofStartsinstep16reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
15. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1084680980,andclickOK.
16. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type
30000,andclickOK.
17. ClickMake Design.
AprogressbardisplayselapsedtimeandDEfficiency.

180

Examples of Custom Designs


Experiments with Covariates

Chapter 5
Design of Experiments Guide

Figure 5.63DesignOutline

18. OpentheDesign Evaluation > Color Map On Correlationsoutline.


Figure 5.64ColorMapShowingAbsoluteCorrelationswithRunOrder

TheColorMapshowsthefollowing:
Thesevencontinuousfactors,X2throughX8,areorthogonaltoeachother.
Run Order,thelineartimetrendvariable,hasextremelylowabsolutecorrelationwith
X2throughX8.
19. OpentheDesign Evaluation > Estimation Efficiency outline.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Experiments with Randomization Restrictions

181

Figure 5.65EstimationEfficiencyOutline

ThesmallabsolutecorrelationsofRun OrderwithX2throughX8resultinverysmall
increasesinconfidenceintervallengths,relativetoanidealorthogonaldesign.The
increasesinthelengthsofconfidenceintervalsforX2throughX8arealllessthan0.1%.
Inthisexample,therunorderfactorisnearlyorthogonaltothefactoreffects.Insomecases,
yourdesignmighthavemoresubstantialcorrelationsbetweentherunorderfactorandother
factors.Eveninsuchasituation,includingtherunorderasafactoraccountsforanylinear
trendeffect.Includingtherunorderalsoallowsformorepreciseestimationoftheotherfactor
effects.

Experiments with Randomization Restrictions


TheCustomDesignplatformconstructssplitplot,splitsplitplot,andtwowaysplitplot
(stripplot)designsthatareDoptimalorIoptimal.Fordetailsaboutconstructingthese
designs,seeGoos(2002).Inthissection,youconstructexamplesoftwoofthesedesigns:a
splitplotdesignthatinvolvesmixturefactors,andatwowaysplitplotdesign.

Split-Plot Experiment
Splitplotdesignsoriginatedinagriculture,butarecommonplaceinmanufacturingand
engineeringstudies.Inasplitplotexperiment,hardtochangefactorsareresetonlybetween
onewholeplotandthenextwholeplot.Thewholeplotisdividedintosubplots,andthelevels
oftheeasytochangefactorsarerandomlyassignedtoeachsubplot.
TheexampleinthissectionisadaptedfromKowalski,Cornell,andVining(2002).Youare
interestedintheeffectsoffivefactorsonthethicknessofvinylthatisusedtomake
automobileseatcovers.Theresponseandfactorsintheexperimentaredescribedbelow:

Theresponseisthethicknessofthevinylthatisproduced.Youwanttomaximize
thickness.Alowerlimitforthicknessvaluesis10.

Thewholeplotfactorsaretherateofextrusion(extrusion rate)andthetemperature
(temperature)ofdrying.Theseareprocessvariablesandarehardtochange.

182

Examples of Custom Designs


Experiments with Randomization Restrictions

Chapter 5
Design of Experiments Guide

Thesubplotfactorsarethreeplasticizerswhoseproportions(m1,m2,andm3)sumtoone.
Thesefactorsaremixturecomponents.

Yourexperimentalbudgetallowsforrunning7settingsofthesewholeplotfactors.Foreach
wholeplot,youcanconduct4runsofthesubplotfactors.Thisgivesyouatotalof28runs.
CreatingtheDesign
1. SelectDOE > Custom Design.
2. DoubleclickYunderResponseNameandtypethickness.
KeepthedefaultgoalsettoMaximize.
3. EnteraLowerLimitof10.
4. Toaddfactorsmanually,followstep5throughstep12.Or,toloadfactorsfromasaved
table,selectLoad FactorsfromtheredtrianglemenunexttoCustomDesign.Openthe
Vinyl Factors.jmpsampledatatable,locatedintheDesignExperimentfolder.Ifyouselect
Load Factors,skipstep5throughstep12.
5. Type2nexttoAdd N Factors.
6. ClickAdd Factor > Continuous.
7. Renamethesefactorsextrusion rateandtemperature.
KeepthedefaultValuesof1and1forthesetwofactors.
8. ClickEasyandselectHardforbothextrusion rateandtemperature.
Thisdefinesextrusion rateandtemperaturetobewholeplotfactors.
9. Type3nexttoAdd N Factors.
10. ClickAdd Factor > Mixture.
11. Renamethethreemixturefactorsm1,m2,andm3.
KeepthedefaultValuesof0and1forthosethreefactors.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Experiments with Randomization Restrictions

183

Figure 5.66ResponsesandFactorsOutlines

12. ClickContinue.
13. ClickInteractions > 2nd.
14. ClickOKtodismisstheinformativemessage.
Notethat5isthedefaultvaluefortheNumberofWholePlots.
15. Type7nexttoNumber of Whole Plots.
16. Type28nexttoUser Specified.
Note: SettingtheRandomSeedinstep17andNumberofStartsinstep18reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
17. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
123686,andclickOK.
18. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type10,
andclickOK.
19. ClickMake Design.

184

Examples of Custom Designs


Experiments with Randomization Restrictions

Chapter 5
Design of Experiments Guide

Figure 5.67DesignOutline

Notethatthewholeplotfactors,extrusion rateandtemperature,areresetseventimesin
accordancewiththelevelsofthefactorWhole Plots.WithineachlevelofWhole Plots,the
settingsforthemixtureingredients,m1,m2,andm3,areassignedatrandom.
AnalyzingtheResults
TheVinyl Data.jmpsampledatatablecontainsexperimentalresultsusingadesigncreatedina
previousversionofJMP.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Vinyl Data.jmp.
Thissampledatatablecontains28runsandresponsevalues.Thedesignsettingsinthe
tablethatyoucreatedusingtheCustomDesignplatformmightdifferfromthoseusedin
theVinyl Data.jmpdesign.
2. SelectRun ScriptfromtheredtrianglenexttoModel.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Experiments with Randomization Restrictions

185

Figure 5.68FitModelWindow

NoticethefollowingintheFitModelwindow:
ThefactorWhole PlotshastheAttributecalledRandomEffects(&Random).This
specifiesthatthelevelsofWhole Plotsarerandomrealizations.Theyhaveanassociated
errorterm.
TheanalysismethodisREML (Recommended).Thismethodisspecifiedprecisely
becausethemodelcontainsarandomeffect.FormoreinformationaboutREML
models,seetheFittingLinearModelsbook.
Tip: IntheFitModelwindow,JMPProuserscanchangethePersonalitytoMixedModel.
3. ClickRun.

186

Examples of Custom Designs


Experiments with Randomization Restrictions

Chapter 5
Design of Experiments Guide

Figure 5.69SplitPlotAnalysisResults

TheParameterEstimatesreportshowsthatthethreemixtureingredients,aswellasthe
extrusion rate*m3interaction,aresignificantatthe0.05level.
TheREMLVarianceComponentEstimatesreportindicatesthatthevariancecomponent
associatedwithWhole Plotsis2.476748.Thisis38.838%ofthetotalvariation.Itfollowsthat
theerrortermassociatedwithwholeplotreplicationissmallerthantheresidual(or
withinplot)errorterm.

Two-Way Split-Plot Experiment


Atwowaysplitplot(alsoknownasstripplotorsplitblock)designconsistsoftwosplitplot
components.Inindustry,thesedesignsarisewhenbatchesofmaterialorexperimentalunits
fromoneprocessingstagepasstoasecondprocessingstage.Touseatwowaysplitplot
design,youmustbeabletoreordertheunitsbetweenstages.
Afterthefirstprocessingstage,youmustbeabletodividethebatchesintosubbatches.The
secondstageprocessingfactorsareappliedrandomlytothesesubbatches.Foraspecific
secondstageexperimentalsetting,allofthesubbatchesassignedtothatsettingcanbe
processedsimultaneously.Additionalfactorscanbeappliedtoexperimentalunitsafterthe
secondprocessingstage.
Incontrasttoasplitsplitplotdesign,thesecondstagefactorsarenotnestedwithinthe
firststagefactors.Afterthefirststage,thebatchesaresubdividedandformedintonew
batches.Therefore,boththefirstandsecondstagefactorsareappliedtowholebatches.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Experiments with Randomization Restrictions

187

Althoughfactorsatbothstagesmightbeequallyhardtochange,inordertodistinguishthese
factors,JMPdenotesthefirststagefactorsasveryhardtochangeandthesecondstagefactors
ashardtochange.Additionalfactorsappliedtoexperimentalunitsafterthesecond
processingstageareconsideredeasytochange.
ScenarioforaTwoWaySplitPlotDesign
Thisexampleisbasedonanexperimenttoimprovetheopencircuitvoltage(OCV)inbattery
cells(VivacquaandBisgaard,2004).YouneedtominimizetheOCVinordertokeepthecells
fromdischargingontheirown.
Batterycellsmovethroughtwostagesofprocessing:

Firststage:Acontinuousassemblyprocesswherebatteriesareprocessedinbatchesof
2000.

Secondstage:Acuringprocesswitha5daycycletimeinachamberthatcan
accommodate4000batteries.

Youwanttostudysixtwolevelcontinuousfactors:

Fourfactors(A1,A2,A3,andA4)areappliedtotheassemblyprocess.Youcanrun16trials
forthefirststagefactors.

Twofactors(C5andC6)areappliedtothecuringprocess.Becausecuringrequiresa5day
cycletime,youcanrunonly6cycles(30days)forthesecondstagefactors.Usingsix
curingcyclesgivesyoupartialreplicationofthecuringsettings,enablingyoutotestfor
curingeffects.

Boththefirstandsecondstagefactorsarehardtochange,suggestingtwosplitplots.
However,thebatchesof2,000batteriesfromthefirststageexperimentcanbedividedinto
subbatchesof500batterieseach.Eightofthesesubbatchescanberandomlyselectedand
processedsimultaneouslyinthecuringchamber.
Theexperimenthas48experimentalunits.Notethatthefirstandsecondstagefactorsare
crossed.
CreatingtheDesign
Todesignatwowaysplitplotexperiment:
1. SelectDOE > Custom Design.
2. DoubleclickYunderResponseNameandtypeOCV.
3. UnderGoal,clickMaximizeandselectMinimize.
4. Toaddfactorsmanually,followstep5throughstep10.Or,toloadfactorsfromasaved
table,selectLoad FactorsfromtheredtrianglemenunexttoCustomDesign.Openthe
Battery Factors.jmpsampledatatable,locatedintheDesignExperimentfolder.Ifyou
selectLoad Factors,skipstep5throughstep10.

188

Examples of Custom Designs


Experiments with Randomization Restrictions

Chapter 5
Design of Experiments Guide

5. Type6nexttoAdd N Factors.
6. ClickAdd Factor > Continuous.
7. RenamethefactorsA1,A2,A3,A4,C1,andC2.
KeepthedefaultValuesof1and1forthesefactors.
8. ForeachofthefactorsA1,A2,A3,andA4,underChanges,clickEasyandchangeittoVery
Hard.
Todistinguishbetweenthefirstandsecondstagefactors,youdesignatetheChangesfor
thefirststagefactorsasVeryHard,andtheChangesforthesecondstagefactorsasHard.
9. ForeachofthefactorsC1andC2,underChanges,clickEasyandchangeittoHard.
Figure 5.70ResponsesandFactorsOutlines

10. ClickContinue.
11. SelectInteractions> 2ndintheModeloutline.
12. IntheDesignGenerationoutline,selecttheoptionHard to change factors can vary
independently of Very Hard to change factors.
SeeFigure 5.71.Checkingthisoptioncreatesatwowaysplitplotdesign.Ifthisoptionis
notchecked,thedesignistreatedasasplitsplitplotdesign,withnestingoffactorsatthe
twolevels.
13. Type16astheNumber of Whole Plots.
Thisisthenumberoftrialsthatyoucanrunforthefirststagefactors.
14. Type6astheNumber of Subplots.
Thisisthenumberoftrialsthatyoucanrunforthesecondstagefactors.
15. UnderNumberofRuns,type48nexttoUser Specified.
Thisisthetotalnumberofexperimentalunits.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Experiments with Randomization Restrictions

189

Figure 5.71DesignGenerationOutline

Note: SettingtheRandomSeedinstep16andNumberofStartsinstep17reproducesthe
exactresultsshowninthisexample.Inconstructingadesignonyourown,thesestepsare
notnecessary.
16. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type
1866762673,andclickOK.
17. (Optional)FromtheCustomDesignredtrianglemenu,selectNumber of Starts,type21,
andclickOK.
18. ClickMake Design.
19. ClickMake Table.
Figure 5.72PartialViewofDesignTable

190

Examples of Custom Designs


Experiments with Randomization Restrictions

Chapter 5
Design of Experiments Guide

Thedesigntableshows16levelsforWhole Plots.ForeachlevelofWhole Plots,thesettingsof


thefourassemblyfactorsareconstant.FromeachlevelofWhole Plots,threebatchesof500
batteries(Subplots)arerandomlyassignedtosettingsofthecuringfactors.Twosetsofcuring
conditionsarereplicated(C1 = 1,C2 = 1andC1 = 1,C2 = 1).Toseethis,selectcolumnsC1and
C2,rightclickintheheaderarea,andselectSort > Ascending.
AnalyzingtheResults
TheBattery Data.jmpsampledatatablecontainsexperimentalresultsforthedesignthatyou
generated.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Battery Data.jmp.
2. FromtheredtrianglenexttoModel,selectRun Script.
NoticethefollowingintheFitModelwindow:
ThefactorWhole PlotshastheAttributecalledRandomEffects(&Random).This
specifiesthatthelevelsofWhole Plotsarerandomrealizations.Theyhaveanassociated
errorterm.
ThefactorSubplotsalsohastheRandomEffectsAttribute(&Random).
TheanalysisMethodisREML (Recommended).Thismethodisspecifiedprecisely
becausethemodelcontainsrandomeffects.FormoreinformationaboutREMLmodels,
seetheFittingLinearModelsbook.
Tip: IntheFitModelwindow,JMPProuserscanchangethePersonalitytoMixedModel.
3. ChecktheoptiontoKeep dialog open.
4. ClickRun.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Experiments with Randomization Restrictions

191

Figure 5.73ReportforFullModel

TheParameterEstimatesreportindicatesthatfourtwowayinteractions,A1*C1,A1*C2,
A2*C1,andA4*C2,andtwomaineffects,A1andA4,aresignificantatthe0.05level.
5. IntheBattery Data.jmptable,fromtheredtrianglenexttoReduced Model 1,selectRun
Script.
ThescriptopensaFitModelwindowwhereinsignificantinteractionshavebeenremoved.
TheremainingeffectsareallmaineffectsandthefourtwowayinteractionsA1*C1,A1*C2,
A2*C1,andA4*C2.Youarereducingthemodelinaconservativefashion.
6. ClickRun.

192

Examples of Custom Designs


Experiments with Randomization Restrictions

Chapter 5
Design of Experiments Guide

Figure 5.74ReportforPreliminaryReducedModel

NoticethatthemaineffectC2isnowsignificantatthe0.05level(Prob>|t| = 0.0331)
7. IntheFitModelwindow,removeA3.
ThemaineffectA3istheonlymaineffectthatisnotsignificantandnotinvolvedina
twowayinteraction.
8. ClickRun.
Figure 5.75ReportforReducedModel

TheREMLVarianceComponentEstimatesreportshowsthatthevariancecomponent
associatedwithWhole Plotsisaboutsixtimesaslargeasthevariancecomponentfor
Subplots.Thissuggeststhattheassemblyprocessismorevariablethanthecuringprocess.
Also,thewithin(Residual)errorislargerthanthatforSubplots.Effortstoreducevariation
shouldfocusontheassemblyprocessandonbatterytobatterydifferences.
9. FromtheredtrianglenexttoResponseOCV,selectFactor Profiling > Profiler.

Chapter 5
Design of Experiments Guide

Examples of Custom Designs


Experiments with Randomization Restrictions

10. FromtheredtrianglenexttoPredictionProfiler,selectMaximize Desirability.


Figure 5.76PredictionProfilerwithSettingsThatMinimizeOCV

TheprofilershowsthefivefactorsidentifiedasactiveandsettingsthatminimizeOCV.

193

194

Examples of Custom Designs


Experiments with Randomization Restrictions

Chapter 5
Design of Experiments Guide

Chapter 6
Definitive Screening Designs
Definitivescreeningdesignsworkforfactorscreeningifyouhaveanycombinationof
continuousortwolevelcategoricalfactors.Thesedesignsareparticularlyusefulifyou
suspectactivetwofactorinteractions,oryoususpectthataplotofacontinuousfactorseffect
ontheresponsemightexhibitstrongcurvature.
Definitivescreeningdesignsaresmalldesigns.Forsixormorefactors,thereareonlyabout
twiceasmanyrunsasfactors.Yet,theyoftenconclusivelyidentifywhichofseveralfactors
affecttheresponse.Inparticular,theycandetectandidentifyanyfactorscausingstrong
nonlineareffectsontheresponse.
Hereareareaswheredefinitivescreeningdesignsaresuperiortostandardscreeningdesigns:

Theyhelpidentifythecausesofnonlineareffectsbyfieldingeachcontinuousfactorat
threelevels.Instandardscreeningdesigns,continuousfactorshaveonlytwolevels.You
canaddcenterpointstoscreeningdesigns,butthesepointsonlyestablishifcurvature
exists.Theydonotallowyoutoidentifythefactorsresponsibleforquadraticeffects.

Theyavoidconfoundingbetweenanyeffectsupthroughthesecondorder.Forcontinuous
factors,definitivescreeningdesignshavemaineffectsthatareorthogonaltoeachother
andorthogonaltotwofactorinteractionsandquadraticeffects.Twofactorinteractionsare
notcompletelyconfoundedwitheachother.Confoundingoccursinmanystandard
screeningdesignswithasimilarnumberofruns.

Theyavoidtheneedforcostlyadditionalexperimentationtoresolveambiguityfromthe
initialresultsofstandardscreeningdesigns.

Figure 6.1PlotofResponseagainstFactorValuesShowingCurvature

Contents
OverviewofDefinitiveScreeningDesign ........................................... 197
ExamplesofDefinitiveScreeningDesigns .......................................... 199
DefinitiveScreeningDesign ................................................... 199
ComparisonwithaFractionalFactorialDesign ................................... 207
DefinitiveScreeningDesignwithBlocking....................................... 208
ComparisonofaDefinitiveScreeningDesignwithaPlackettBurmanDesign........ 212
DefinitiveScreeningDesignWindow .............................................. 216
Responses ................................................................... 217
Factors ...................................................................... 219
OrthogonalBlockingOptions.................................................. 221
BlockinginDefinitiveScreeningDesigns........................................ 221
Design ...................................................................... 223
DesignEvaluation ............................................................ 223
OutputOptions .............................................................. 224
DefinitiveScreeningDesignOptions ............................................... 225
TechnicalDetails................................................................ 227
StructureofDefinitiveScreeningDesigns........................................ 227
AnalysisofExperimentalData................................................. 228

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Overview of Definitive Screening Design

197

Overview of Definitive Screening Design


Investigatorsusescreeningdesignswhentheywanttoidentifythefactorsthathavethemost
substantialeffectsonaresponse.Ascreeningdesignenablesyoutostudyalargenumberof
factorsinafairlysmallexperiment.
Manystandardscreeningdesignsfocusonestimatingmaineffects.Definitivescreening
designsofferadvantagesoverstandardscreeningdesigns.Theyavoidconfoundingofeffects
andcanidentifyfactorshavinganonlineareffectontheresponse.Fordetailsaboutthe
advantagesandconstructionofdefinitivescreeningdesigns,seeJonesandNachtsheim(2011).
Table 6.1comparessomeofthepropertiesofdefinitivescreeningdesignsandstandard
screeningdesignsfordesignscontainingonlycontinuousfactors.Whenquadraticeffectsare
mentioned,thestandardscreeningdesignsareassumedtohavecenterpoints.These
propertiesaredescribedmorefullyintheremainderofthissection.
Table 6.1ComparisonofDefinitiveScreeningandStandardScreeningDesignsfor
ContinuousFactors
Property

Definitive Screening
Designs

Standard Screening
Designs

Maineffectsareorthogonalto
twofactorinteractions

Always

OnlyforResolution
IVorhigher

Notwofactorinteractioniscompletely
confoundedwithanyothertwofactor
interaction

Always

OnlyforResolutionV
orhigher

Allquadraticeffectsareestimablein
modelscontainingonlymainand
quadraticeffects

Always

Never

StandardScreeningDesigns
Standardscreeningdesigns,suchasfractionalfactorialorPlackettBurmandesigns,attempt
tostudymanyfactorswitharelativelysmallallocationofresources.However,standard
screeningdesignshaveseveralundesirablefeatures:

Theycanaliassomemaineffectswithtwofactorinteractions.InPlackettBurmandesigns,
forexample,maineffectsarecorrelatedwithseveraltwofactorinteractions.Ifoneormore
twofactorinteractioneffectsaresubstantial,thentheexperimentermustperform
additionalrunstoresolvetheambiguities.

Theycanalsoconfoundsometwofactorinteractionswitheachother.Consequently,ifa
twofactorinteractioneffectissubstantial,thentheexperimentermustperformadditional
runstoresolvetheremainingambiguities.

198

Definitive Screening Designs


Overview of Definitive Screening Design

Chapter 6
Design of Experiments Guide

Continuousfactorsareusuallysetatonlytwolevels(lowandhigh).However,engineers
andscientistsoftenpreferdesignswherecontinuousfactorsaresetatthreelevels(low,
middle,andhigh).Thisisbecausetwolevelsarenotsufficienttodetectnonlinearity,
whichiscommoninphysicalsystems.Youcanuseatraditionalscreeningdesignwith
addedcenterpointstodetectnonlinearity,butsuchadesigndoesnotidentifythe
responsiblefactors.

DefinitiveScreeningDesigns
Usingdefinitivescreeningdesigns,youcan:

Avoidmodelambiguity,allowingyoutoidentifyimportantfactorsmorequicklyand
efficiently.

Identifythecauseofnonlineareffectswhileavoidingconfoundinganytermsuptosecond
order.Sonotonlycanyoudetectnonlinearity,asyoumightwithcenterpointsina
traditionalscreeningdesign,butyoucanidentifytheresponsiblefactors.

Definitivescreeningdesignsofferthefollowingadvantages:

Definitivescreeningdesignsrequireonlyasmallnumberofruns.Forsixormorefactors,
thenumberofrequiredrunsisusuallyonlyafewmorethantwicethenumberoffactors.
Formoredetailonthenumberofruns,seeConferenceMatricesandtheNumberof
Runsonpage 228.

Maineffectsareorthogonaltotwofactorinteractions.Thismeansthatestimatesofmain
effectsarenotbiasedbythepresenceofactivetwofactorinteractions,whetherthese
interactionsareincludedinthemodelornot.NotethatresolutionIIIscreeningdesigns
confoundsomemainandinteractioneffects.Also,PlackettBurmandesignsproduce
biasedmaineffectestimatesifthereareactivetwofactorinteractions.

Notwofactorinteractioniscompletelyconfoundedwithanyothertwofactorinteraction.
However,atwofactorinteractionmightbecorrelatedwithothertwofactorinteractions.
NotethatresolutionIVscreeningdesignscompletelyconfoundsometwofactor
interactioneffects.

Allquadraticeffectsareestimableinmodelscomprisedonlyofmaineffectsandquadratic
terms.Thisenablesyoutoidentifythefactorsthataccountfornonlinearity.Notethat
traditionalscreeningdesignswithaddedcenterpointsdonotallowestimationofall
quadraticeffectsinmodelsconsistingofmainandquadraticeffects.

Quadraticeffectsareorthogonaltomaineffectsandnotcompletelyconfoundedwith
twofactorinteractions.Aquadraticeffectmightbecorrelatedwithinteractioneffects.

For6throughatleast30factors,itispossibletoestimatetheparametersofanyfull
quadraticmodelinvolvingthreeorfewerfactorswithhighprecision.

For18factorsormore,theycanfitfullquadraticmodelsinany4factors.For24factorsor
more,theycanfitfullquadraticmodelsinany5factors.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Examples of Definitive Screening Designs

199

DefinitiveScreeningDesignPlatform
TheDefinitiveScreeningDesignplatformenablesyoutoconstructdefinitivescreening
designsforcontinuousfactorsandfortwolevelcategoricalfactors.Italsoenablesyouto
constructblockeddesigns.
Toviewtheabsolutevaluesofthecorrelationsamongeffects,usetheColorMapon
CorrelationsprovidedaspartoftheDesignEvaluationoutlineintheDefinitiveScreening
Designwindow.Youcancomparethealiasingstructureofdefinitivescreeningdesignstothat
ofotherdesignsbycomparingtheircolormapsoncorrelations.Fordetails,seeColorMapon
Correlationsonpage 490intheEvaluateDesignschapter.
Fordetails,seeStructureofDefinitiveScreeningDesignsonpage 227.Forinformationon
definitivescreeningdesignswithblocks,seeBlockinginDefinitiveScreeningDesignson
page 221.Forsuggestionsonhowtoanalyzedataobtainedusingdefinitivescreeningdesigns,
seeAnalysisofExperimentalDataonpage 228.

Examples of Definitive Screening Designs


Thissectioncontainsthefollowingexamples:

DefinitiveScreeningDesignonpage 199

ComparisonwithaFractionalFactorialDesignonpage 207

DefinitiveScreeningDesignwithBlockingonpage 208

ComparisonofaDefinitiveScreeningDesignwithaPlackettBurmanDesignon
page 212

Definitive Screening Design


Supposethatyouneedtodeterminewhichofsixfactorshaveaneffectontheyieldofan
extractionprocess.
Create the Design
ThefactorsandtheirsettingsaregiveninthedatatableExtraction Factors.jmp.Youcreatea
definitivescreeningdesigntoinvestigate.
1. SelectDOE > Definitive Screening Design.
2. DoubleclickYunderResponseNameandtypeYield.
3. Fromtheredtrianglemenu,selectLoad Factors.
4. OpentheExtraction Factors.jmpsampledatatable,locatedintheDesign Experimentfolder.
ThefactornamesandrangesareaddedtotheFactorsoutline.

200

Definitive Screening Designs


Examples of Definitive Screening Designs

Chapter 6
Design of Experiments Guide

Figure 6.2ResponsesandFactorsforExtractionDesign

5. ClickContinue.
TheOrthogonalBlockingOptionsoutlineopens.Hereyoucanspecifyablocking
structure.Thereisnoneedtoblockinthisexample,soyouacceptthedefaultselectionof
No Blocks Required.
Note: SettingtheRandomSeedinstep6reproducestheexactresultsshowninthis
example.Inconstructingadesignonyourown,thisstepisnotnecessary.
6. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type123,
andclickOK.
7. ClickMake Design.
TheDefinitiveScreeningDesignwindowupdatestoshowaDesignoutlineandaDesign
Evaluationoutline.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Examples of Definitive Screening Designs

Figure 6.3DesignOutline

8. OpentheDesign Evaluation > Color Map on Correlations outline.


TheColorMaponCorrelationsassignsacolorintensityscaletotheabsolutevaluesof
correlationsamongallmaineffectsandtwofactorinteractions.
Figure 6.4ColorMaponCorrelationsforExtractionDesign

Notethefollowing:
Thesoliddeepblueareashowsthatthereisnocorrelationbetweenmaineffectsor
betweenmaineffectsandtwofactorinteractions.

201

202

Definitive Screening Designs


Examples of Definitive Screening Designs

Chapter 6
Design of Experiments Guide

Thelighterblueandgrayareasindicatethattheabsolutecorrelationsbetween
twofactorinteractionsaresmall.
Thesolidredsquaresindicateabsolutecorrelationsof1.Theseallappearonthe
diagonal,reflectingtheexpectedcorrelationofaneffectwithitself.
9. IntheOutputOptionspanel,notethattheRunOrderissettoRandomize.ClickMake
TabletoobtainthedatatableshowninFigure 6.5.
Figure 6.5DefinitiveScreeningDesignforExtractionProcess

Analyze the Experimental Data


Now,conductyourexperimentandrecordyourdataintheYieldcolumnofthegenerateddata
table(Figure 6.5).TheExtraction Data.jmpsampledatatablecontainsyourexperimental
results.
ModelSpecifyingOnlyMainEffects
Amaineffectsmodelfailstoshowoverallsignificance.Onlyoneeffect,Methanol,isidentified
asactive.Toseethis,followthesesteps:
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Extraction Data.jmp.
2. IntheTablespanel,clicktheredtrianglenexttoModelandselectRun Script.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Examples of Definitive Screening Designs

Figure 6.6ModelSpecificationWindow

NotethattheresultingModelSpecificationwindowshowsamaineffectsonlymodel.
3. ClickRun.

203

204

Definitive Screening Designs


Examples of Definitive Screening Designs

Chapter 6
Design of Experiments Guide

Figure 6.7PartialResultsforMainEffectsModel

Notethefollowing:
TheActualbyPredictedPlotandtheAnalysisofVariancereportindicatethatthe
modelisnotsignificant.
TheEffectSummaryreportshowsthatMethanolistheonlysignificanteffect,witha
pvalueof0.01840.
ModelSpecifyingMainandAllSecondOrderEffects
Supposethatyoususpectthatthereareactivesecondordereffects.Toexploreall
secondordereffects,oneoptionistouseAllPossibleModelsregression.Anotheroptionisto
useforwardstepwiseregression,asyouwilldointhisexample.UsingStepwiseRegression,
youcanentereffectsmanually,startingwithmaineffectsandaddinghigherordertermsthat
accountforsubstantialvariation.Or,youcanusetheStepwiseplatformsautomaticfitting
capabilities:
1. IntheTablespaneloftheExtractionData.jmpsampledatatable,clicktheredtrianglenext
toModelandselectRun Script.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Examples of Definitive Screening Designs

205

TheresultingModelSpecificationwindowshowsamaineffectsonlymodel.Inthenext
twosteps,youaddalltwowayinteractionandquadraticeffects.
2. IntheSelectColumnslist,selectMethanolthroughTime.
3. SelectMacros > Response Surface.
4. ChangethePersonalitytoStepwiseandclickRun.
5. IntheStepwiseFitforYieldreport,changetheStopping RuletoMinimum AICc.
Forscreeningexperiments,BICistypicallyamorelenientstoppingrulethanAICc.As
such,ittendstoallowinactiveeffectstoenterthemodel.
EnsurethatDirectionissettoForward and Rules issetto Combine.
6. ClickGo.
TheCurrentEstimatesreportshowstheresultingmodel.
Figure 6.8CurrentEstimatesReportforStepwiseFit

Stepwiseidentifiesamodelconsistingofthreemaineffects,aquadraticeffect,andan
interactioneffect:Methanol,Ethanol,Time,Methanol*Methanol, and Ethanol*Time.
7. ClickMake ModelintheupperrightoftheStepwiseRegressionControlreport.
ThisactionopensaModelSpecificationwindowthatcontainsonlytheeffectsidentified
byStepwise.

206

Definitive Screening Designs


Examples of Definitive Screening Designs

Chapter 6
Design of Experiments Guide

8. IntheModelSpecificationwindow,clickRun.
Figure 6.9PartialResultsforModelwithSecondOrderTerms

Notethefollowing:
TheActualbyPredictedPlotshowsthatthemodelissignificant(P<.0001).Itdoesnot
indicateanyanomaliesorlackoffitissues.
TheEffectSummaryreportshowsthatalleffectsotherthanEthanolaresignificantat
the0.05level.Ethanolisnearlysignificantatthe0.05levelanditisacomponentofthe
Ethanol*Timeinteraction,whichissignificant.Consequently,youretainEthanolasa
modeleffect.
TheParameterEstimatesreportgivesestimatesofthecoefficientsforthepredictive
model.Becausealleffectsarecontinuous,thetestsfornoninterceptestimatesarethe
sameasthosegivenintheEffectSummary.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Examples of Definitive Screening Designs

207

Ifyouhadusedanordinaryscreeningdesignwithcenterruns,thenonlinearitycouldhave
beendetected.However,furtherrunswouldhavebeennecessarytoidentifyMethanolasthe
sourceofthequadraticeffect.

Comparison with a Fractional Factorial Design


Supposethatyouhadchosenatraditionalscreeningdesigninsteadofthedefinitivescreening
designinDefinitiveScreeningDesignonpage 199.Thisexampleshowsyouhowto
comparethetwodesigns.
1. SelectDOE > Screening Design.
2. DoubleclickYunderResponseNameandtype Yield.
3. SelectLoad FactorsFromtheredtrianglenexttoDefinitiveScreeningDesign.
4. OpentheExtraction Factors.jmpsampledatatable,locatedintheDesign Experimentfolder.
ThefactornamesandrangesareaddedtotheFactorsoutline.
5. ClickContinue.
6. SelectChoose from a list of fractional factorial designs.
7. ClickContinue.
PotentialdesignsappearintheDesignList.
Figure 6.10ScreeningDesignListforSixContinuousFactors

208

Definitive Screening Designs


Examples of Definitive Screening Designs

Chapter 6
Design of Experiments Guide

8. Selectthesixteenrunfractionalfactorialdesignwithnoblocks,shownhighlightedin
Figure 6.10.
9. ClickContinue.
10. OpentheDesign Evaluation > Aliasing of Effectsoutline.
Figure 6.11AliasingofEffectsforFractionalFactorialDesign

TheAliasingofEffectsoutlineforthe16runfractionalfactorialdesignshowsthatevery
twofactorinteractionisconfoundedwithatleastoneothertwofactorinteraction.Inthis
fractionalfactorialdesign,theEthanol*TimeinteractionisconfoundedwithMethanol*pH.To
determinewhichinteractionisactive,youneedtorunadditionaltrials.Hadthefactorsbeen
enteredinadifferentorder,theEthanol*Timeinteractionmighthavebeenaliasedwithtwo
othertwofactorinteractions.
InthesectionDefinitiveScreeningDesignonpage 199,youconstructeda13rundefinitive
screeningdesign.Whenyouanalyzedtheexperimentalresultsforthis13rundesign,the
Ethanol*Timeinteractionwasfoundtobeactive.SeeModelSpecifyingMainandAllSecond
OrderEffectsonpage 204.
Usingthe13rundefinitivescreeningdesign,youalsodeterminedthatthequadraticeffect
Methanol*Methanolwaslikelytobeactive.Forthe16runfractionalfactorialdesign,this
quadraticeffectcannotevenbeestimated.Thisisbecausethesettingsforeachfactorareat
eithertheloworthehighvalue.Ifyouaddcenterpoints,youmightbeabletodetect
curvature.Butyouwillnotbeabletodeterminewhichfactorisresponsiblewithoutfurther
runs.
The13rundefinitivescreeningdesigngivesmoreinformationthanthe16runfractional
factorialdesign.Italsogreatlyreducestheneedforfollowupexperimentation.

Definitive Screening Design with Blocking


Supposethat,duetorawmaterialconstraints,theextractionexperimentrequiresthatyourun
itusingmaterialfromtwoseparatelots.Youcangenerateadefinitivescreeningdesignwitha
blockingvariabletoaccountforthepotentiallotvariation.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Examples of Definitive Screening Designs

209

Create the Design


TheextractionfactorsandtheirsettingsaregiveninthedatatableExtraction Factors.jmp.
Generateadefinitivescreeningdesignwithablockasfollows.
1. SelectDOE > Definitive Screening Design.
2. DoubleclickYunderResponseNameandtype Yield.
3. Fromtheredtrianglemenu,selectLoad Factors.
4. OpentheExtraction Factors.jmpsampledatatable,locatedintheDesign Experimentfolder.
ThefactornamesandrangesareaddedtotheFactorsoutline.
5. ClickContinue.
TheOrthogonalBlockingOptionsoutlineopens.Hereyoucanspecifyablocking
structure.
6. SelectAdd Blocks with Center Runs to Estimate Quadratic Effects.
LeaveNumber of Blockssetat2.
Note: SettingtheRandomSeedinstep7reproducestheexactrunordershowninthis
example.Inconstructingadesignonyourown,thisstepisnotnecessary.
7. (Optional)FromtheCustomDesignredtrianglemenu,selectSet Random Seed,type123,
andclickOK.
8. ClickMake Design.
TheDefinitiveScreeningDesignwindowupdatestoshowaDesignoutlineandaDesign
Evaluationoutline.
CheckthatBlockhasbeenaddedtotheFactorsoutlineandtotheDesign.
9. IntheFactorsoutline,DoubleclickBlockandtypeLot.
10. IntheOutputOptionspanel,notethattheRunOrderissettoRandomize within Blocks.
ClickMake Table toobtainthedatatableshowninFigure 6.12.

210

Definitive Screening Designs


Examples of Definitive Screening Designs

Chapter 6
Design of Experiments Guide

Figure 6.12DefinitiveScreeningDesignwithBlockforExtractionProcess

Noticethatrun6isacenterpointruninLot1andrun8isacenterpointruninLot2.
Analyze the Experimental Data
Atthispoint,youconductyourexperimentandrecordyourdataintheYieldcolumnofthe
designtable(Figure 6.12).TheExtraction2 Data.jmpsampledatatablecontainsyour
experimentalresults.
Toexploreallsecondordereffects,oneoptionistouseAllPossibleModelsregression.
Anotheroptionistouseforwardstepwiseregression,asdoneinthisexample.UsingStepwise
Regression,youcanentereffectsmanually,startingwithmaineffectsandaddinghigherorder
termsthataccountforsubstantialvariation.Or,youcanusetheStepwiseplatformsautomatic
fittingcapabilities:
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Extraction2 Data.jmp.
2. IntheTablespanelofthedesigntable,clicktheredtrianglenexttoModelandselectRun
Script.
3. IntheSelectColumnslist,selectMethanolthroughTime.
4. SelectMacros > Response Surface.
5. ChangethePersonalitytoStepwise.
6. ClickRun.
7. IntheStepwiseFitforYieldreport,changetheStopping RuletoMinimum AICc.
Forscreeningexperiments,BICistypicallyamorelenientstoppingrulethanAICc.As
such,ittendstoallowinactiveeffectstoenterthemodel.
NotethatDirectionissettoForward and Rules issetto Combine.
8. IntheEnteredcolumnintheCurrentEstimatesoutline,checktheboxnexttoLot(21).

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Examples of Definitive Screening Designs

211

RecallthatLotisablockingvariable.Itspurposeistoaccountfornuisancevariationso
thatyoucanmoreclearlyseetheeffectsofotherfactors.Forthisreason,youwantLottobe
partofallmodelsconsideredbyStepwise.Inthenextstep,youlocktheLot(12)termso
thatitremainsinallmodelsfitbyStepwise.
9. IntheLockcolumnintheCurrentEstimatesoutline,checktheboxnexttoLot(21).
ThecheckintheboxunderEntereddimsasareminderthatLot(12)islockedintothe
model.
10. ClickGo.
TheCurrentEstimatesreport(Figure 6.13)showsthatStepwiseselectsamodelconsisting
oftheblockingvariable,threemaineffects,aquadraticeffect,andaninteraction:Lot,
Methanol,Ethanol,Time,Methanol*Methanol,andEthanol*Time.
Figure 6.13CurrentEstimatesReportforStepwiseFit

11. ClickMake ModelintheupperrightoftheStepwiseRegressionControlreport.


ThisactionopensaModelSpecificationwindowthatcontainsonlytheeffectsidentified
byStepwise.
12. IntheModelSpecificationwindow,clickRun.

212

Definitive Screening Designs


Examples of Definitive Screening Designs

Chapter 6
Design of Experiments Guide

Figure 6.14ModelFitResultsforBlockedDesign

Notethefollowing:
TheActualbyPredictedPlotshowsthatthemodelissignificant.Itdoesnotindicate
anyanomaliesorlackoffitissues.
TheEffectTestsreportshowsthatalleffectsaresignificant.
TheEffectTestsreportalsoshowsthatLothasthelargestSumofSquaresamongthe
modeleffects.Haditnotbeenincludedinthemodel,othereffectswouldnotappear
significant.

Comparison of a Definitive Screening Design with a Plackett-Burman Design


PlackettBurmandesignsareanalternativetofractionalfactorialsforscreening.However,
PlackettBurmandesignshavecomplexaliasingofthemaineffectsbytwofactorinteractions.
ThisexampleshowshowtocompareadefinitivescreeningwithaPlackettBurmandesign.
TheDefinitiveScreeningDesign
1. SelectDOE > Definitive Screening Design.
2. Type4intheAdd N FactorsboxandclickContinuous.
3. Type2intheAdd N FactorsboxandclickCategorical.
YourwindowshouldappearasshowninFigure 6.15.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Examples of Definitive Screening Designs

213

Figure 6.15DefinitiveScreeningDialogwith4Continuousand2CategoricalFactors

4. ClickContinue.
Thisexampledoesnotrequireablock.UndertheOrthogonalBlockingOptionsOutline,
checkthattheNoBlocksRequiredoptionisselected.
5. ClickMake Design.
Thedesignthatisgeneratedhas14runs.
6. OpentheDesign Evaluation > Color Map On Correlationsoutline.

214

Definitive Screening Designs


Examples of Definitive Screening Designs

Chapter 6
Design of Experiments Guide

Figure 6.16ColorMapforDefinitiveScreeningDesign

Noticethatthecategoricalmaineffectshavesmallcorrelationswitheachotherandwith
thecontinuousfactorsmaineffects.Thesecorrelationsleadtoasmallreductioninthe
precisionoftheestimates.
7. DonotcloseyourDefinitiveDesignScreeningwindowuntilyoucomparethecolormap
withthatofthePlackettBurmandesign,below.
ThePlackettBurmanDesign
NowcreateaPlackettBurmandesignusingthesamefactorstructure.
1. SelectDOE > Screening Design.
2. Type4intheAdd N FactorsboxandclickContinuous.
3. Type2intheAdd N FactorsboxandclickCategorical > 2 Level.
4. ClickContinue.
5. SelectChoose from a list of fractional factorial designsandclickContinue.
PotentialdesignsappearintheDesignList,showninFigure 6.17.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Examples of Definitive Screening Designs

215

Figure 6.17PlackettBurmanDesign

6. Selectthe12runPlackettBurmandesign.SeeFigure 6.17.
7. ClickContinue.
8. OpentheDesign Evaluation > Color Map On Correlationsoutline.
Comparethecolormapforthe12runPlackettBurmandesigntothecolormapforthe
14rundefinitivescreeningdesign.

216

Definitive Screening Designs


Definitive Screening Design Window

Chapter 6
Design of Experiments Guide

Figure 6.18PlackettBurmanCorrelations(left)andDefinitiveScreeningCorrelations(right)

Figure 6.18showsbothcolormaps,butonlyshowstheportionofthePlackettBurmancolor
mapthatinvolvesmaineffectsandtwowayinteractions.SeeColorMaponCorrelationson
page 490intheEvaluateDesignschapterfordetailsabouthowtoconstructacolormapfor
onlymaineffectsandtwowayinteractions.
InthecolormapforthePlackettBurmandesignontheleft,youseethatmosttwofactor
interactionsarecorrelatedwithmaineffects.Thismeansthatanynonnegligibletwofactor
interactionwillbiasseveralmaineffects.Thiscanleadtoafailuretoidentifyanactivemain
effectorthefalseconclusionthataninactivemaineffectisactive.
Contrastthiswiththecolormapforthedefinitivescreeningdesignontheright.Withonly
twoadditionalruns,thedefinitivescreeningdesigntradesoffasmallincreaseinthevariance
ofthemaineffectsforcompleteindependenceofmaineffectsandtwofactorinteractions.

Definitive Screening Design Window


Thedefinitivescreeningdesignwindowupdatesasyouworkthroughthedesignsteps.For
moreinformation,seeTheDOEWorkflow:Describe,Specify,Designonpage 54.The
outlines,separatedbybuttonsthatupdatetheoutlines,followtheflowinFigure 6.19.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Definitive Screening Design Window

217

Figure 6.19DefinitiveScreeningDesignFlow
Responses
Factors

Continue

Orthogonal
Blocking
Options

Make
Design

Design
Design Evaluation
Output Options

Make
Table

Responses
UsetheResponsesoutlinetospecifyoneormoreresponses.
Figure 6.20ResponsesOutline

TheResponsesoutlinecontainsthefollowingbuttons:
EntersasingleresponsewithagoaltypeofMaximize,MatchTarget,
Minimize,orNone.IfyouselectMatchTarget,enterlimitsforyourtargetvalue.Ifyou
selectMaximizeorMinimize,enteringlimitsisnotrequiredbutcanbeuseful.

Add Response

Remove Removestheselectedresponses.

Entersadditionalresponsessothatthenumberthatyouenteristhe
totalnumberofresponses.IfyouhaveenteredaresponseotherthanthedefaultY,the
GoalforeachoftheadditionalresponsesistheGoalassociatedwiththelastresponse
entered.Otherwise,theGoaldefaultstoMatchTarget.ClicktheGoaltypeinthetableto
changeit.

Number of Responses

Tip: WhenyouhavecompletedyourResponsespanel,considerselectingSave Responses


fromtheredtrianglemenu.Thissavestheresponsenames,goals,limits,andimportance
valuesinadatatablethatyoucanlaterreload.
TheResponsesoutlinecontainsthefollowingcolumns:
Thenameoftheresponse.Whenadded,aresponseisgivenadefaultname
ofY,Y2,andsoon.Tochangethisname,doubleclickitandenterthedesiredname.

Response Name

Goal, Lower Limit, Upper Limit TheGoaltellsJMPwhetheryouwanttomaximizeyour

response,minimizeyourresponse,matchatarget,orthatyouhavenoresponsegoal.JMP
assignsaResponseLimitscolumnproperty,basedonthesespecifications,toeachresponse
columninthedesigntable.Itusesthisinformationtodefineadesirabilityfunctionforeach
response.TheProfilerandContourProfilerusethesedesirabilityfunctionstofindoptimal

218

Definitive Screening Designs


Definitive Screening Design Window

Chapter 6
Design of Experiments Guide

factorsettings.Forfurtherdetails,seetheProfilersbookandResponseLimitson
page 562intheColumnPropertiesappendix.
AGoalofMaximizeindicatesthatthebestvalueisthelargestpossible.Ifthereare
naturallowerorupperbounds,youcanspecifytheseastheLowerLimitorUpper
Limit.
AGoalofMinimizeindicatesthatthebestvalueisthesmallestpossible.Ifthereare
naturallowerorupperbounds,youcanspecifytheseastheLowerLimitorUpper
Limit.
AGoalofMatchTargetindicatesthatthebestvalueisaspecifictargetvalue.The
defaulttargetvalueisassumedtobemidwaybetweentheLowerLimitandUpper
Limit.
AGoalofNoneindicatesthatthereisnogoalintermsofoptimization.Nodesirability
functionisconstructed.
Note: IfyourtargetresponseisnotmidwaybetweentheLowerLimitandtheUpper
Limit,youcanchangethetargetafteryougenerateyourdesigntable.Inthedatatable,
opentheColumnInfowindowfortheresponsecolumn(Cols>Column Info)andenterthe
desiredtargetvalue.
Importance Whenyouhaveseveralresponses,theImportancevaluesthatyouspecifyare

usedtocomputeanoveralldesirabilityfunction.Thesevaluesaretreatedasweightsfor
theresponses.Ifthereisonlyoneresponse,thenspecifyingtheImportanceisunnecessary
becauseitissetto1bydefault.
EditingtheResponsesOutline
IntheResponsesoutline,notethefollowing:

Doubleclickaresponsetoedittheresponsename.

Clickthegoaltochangeit.

Clickonalimitorimportancevaluetochangeit.

Formultipleresponses,youmightwanttoentervaluesfortheimportanceweights.

Response Limits Column Property


TheGoal,LowerLimit,UpperLimit,andImportancethatyouspecifywhenyouentera
responseareusedinfindingoptimalfactorsettings.Foreachresponse,theinformationis
savedinthegenerateddesigndatatableasaResponseLimitscolumnproperty.JMPusesthis
informationtodefinethedesirabilityfunction.Thedesirabilityfunctionisusedinthe
PredictionProfilertofindoptimalfactorsettings.ForfurtherdetailsabouttheResponse
Limitscolumnpropertyandexamplesofitsuse,seeResponseLimitsonpage 562inthe
ColumnPropertiesappendix.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Definitive Screening Design Window

219

IfyoudonotspecifyaLowerLimitandUpperLimit,JMPusestherangeoftheobserveddata
fortheresponsetodefinethelimitsforthedesirabilityfunction.SpecifyingtheLowerLimit
andUpperLimitgivesyoucontroloverthespecificationofthedesirabilityfunction.Formore
detailsabouttheconstructionofthedesirabilityfunction,seetheProfilersbook.

Factors
AddfactorsintheFactorsoutline.
Figure 6.21FactorsOutline

Thefactorsoutlinecontainsthefollowingbuttons.
Continuous EntersthenumberofcontinuousfactorsspecifiedinAdd N Factors.
Categorical

EntersthenumberofnominalfactorsspecifiedinAdd N Factors.

Remove Removestheselectedfactors.
Add N Factors Addsmultiplefactorsofagiventype.Enterthenumberoffactorstoaddand

clickContinuousorCategorical.RepeatAdd N Factorstoaddmultiplefactorsofdifferent
types.
Tip: WhenyouhavecompletedyourFactorspanel,selectSaveFactorsfromtheredtriangle
menu.Thissavesthefactornamesandvaluesinadatatablethatyoucanlaterreload.See
DefinitiveScreeningDesignOptionsonpage 225.
TheFactorsoutlinecontainsthefollowingcolumns:
Name Thenameofthefactor.Whenadded,afactorisgivenadefaultnameofX1,X2,andso

on.Tochangethisname,doubleclickitandenterthedesiredname.
Role SpecifiestheDesignRoleofthefactor.TheDesignRolecolumnpropertyforthefactor

issavedtothedatatable.Thispropertyensuresthatthefactortypeismodeled
appropriately.
Theexperimentalsettingsforthefactors.ToinsertValues,clickonthedefaultvalues
andtypethedesiredvalues.
Values

220

Definitive Screening Designs


Definitive Screening Design Window

Chapter 6
Design of Experiments Guide

EditingtheFactorsOutline
IntheFactorsoutline,notethefollowing:

Toeditafactorname,doubleclickthefactorname.

Toeditavalue,clickthevalueintheValuescolumn.

Factor Types
Continuous Numericdatatypesonly.Acontinuousfactorisafactorthatyoucan

conceptuallysettoanyvaluebetweenthelowerandupperlimitsyousupply,giventhe
limitationsofyourmeasurementsystem.
Eithernumericorcharacterdatatypeswithtwolevels.Foracategoricalfactor,
thevalueorderingistheorderofthevalues,asenteredfromlefttoright.Thisorderingis
savedintheValueOrderingcolumnpropertyafterthedesigndatatableiscreated.

Categorical

Factor Column Properties


Foreachfactor,variouscolumnpropertiesaresavedtothedatatable.
Design Role EachfactorisassignedtheDesignRolecolumnproperty.TheRolethatyou

specifyindefiningthefactordeterminesthevalueofitsDesignRolecolumnproperty.
WhenyouaddablockunderOrthogonalBlockingOptions,thatfactorisassignedthe
Blockingvalue.TheDesignRolepropertyreflectshowthefactorisintendedtobeusedin
modelingtheexperimentaldata.DesignRolevaluesareusedintheAugmentDesign
platform.
Factor Changes EachfactorisassignedtheFactorChangescolumnpropertywithasettingof

Easy.Indefinitivescreeningdesigns,itisassumedthatfactorlevelscanbechangedfor
eachexperimentalrun.FactorChangesvaluesareusedintheEvaluateDesignand
AugmentDesignplatforms.
IftheRoleisContinuous,theCodingcolumnpropertyforthefactorissaved.This
propertytransformsthefactorvaluessothatthelowandhighvaluescorrespondto1and
+1,respectively.TheestimatesandtestsintheFitLeastSquaresreportarebasedonthe
transformedvalues.

Coding

IftheRoleisCategoricalorBlocking,theValueOrderingcolumnpropertyfor
thefactorissaved.Thispropertydeterminestheorderinwhichlevelsofthefactorappear.

Value Ordering

RunsPerBlock Indicatesthenumberofrunsineachblock.WhenaBlockisselectedinthe

OrthogonalBlockingOptionsoutlineandyouthenclickMakeDesign,afactorwiththe
defaultnameBlockisaddedtotheFactorslist.TheRunsPerBlockcolumnpropertyis
savedforthatfactor.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Definitive Screening Design Window

221

Orthogonal Blocking Options


TheOrthogonalBlockingOptionsoutlineenablesyoutoconstructadesignwheretheblock
effectsareorthogonaltothemaineffects.Blocksizesneednotbeequal.
Theoutlinecontainsthefollowingoptions:
No Blocks Required Indicatesthatthedesignwillnotcontainablockingfactor.Thisisthe

defaultselection.
Add Blocks with Center Runs to Estimate Quadratic Effects Addsthenumberofblocks

specifiedintheNumberofBlockstextbox.Constructsadesignwhereblockeffectsare
orthogonaltomaineffectsandwherethemodelconsistingofallmainandquadratic
effectsisestimable.Fordetails,seeAddBlockswithCenterRunstoEstimateQuadratic
Effectsonpage 222
Add Blocks without Extra Center Runs AddsthenumberofblocksspecifiedintheNumberof

Blockstextbox.Addsonlyasmanycenterrunsasrequiredbythedesignstructure.
Constructsadesignwhereblockeffectsareorthogonaltomaineffects,butthemodel
consistingofallmaineffectsandquadraticeffectsmaynotbeestimable.Fordetails,see
AddBlockswithoutExtraCenterRunsonpage 222.
Note: UsetheAdd Blocks without Extra Center Runsoptiononlyifyoucanassumethat
notallquadraticeffectsareimportant.
Number of Blocks Indicatesthenumberofblockstoadd.Thenumberofblocksthatyoucan

addrangesfromtwotothenumberoffactors.
Make Design Generatesthedesign,presentsitintheDesignoutline,andprovidesevaluation

informationintheDesignEvaluationoutline.TheOutputOptionspanelalsoappears,
enablingyoutocreatethedesigntable.

Blocking in Definitive Screening Designs


Thissectiondescribesthetwoblockingoptions:

AddBlockswithCenterRunstoEstimateQuadraticEffectsonpage 222

AddBlockswithoutExtraCenterRunsonpage 222

Ifadesigncontainsacategoricalfactor,acenterrunisarunwhereallcontinuousfactorsare
setattheirmiddlevalues.Ifallfactorsarecategorical,thetwoblockingoptionsareavailable.
Bothoptionsproducedesignswhoseblocksareorthogonaltomaineffects.

222

Definitive Screening Designs


Definitive Screening Design Window

Chapter 6
Design of Experiments Guide

Add Blocks with Center Runs to Estimate Quadratic Effects


Note: Fordetailsontheconstructionandpropertiesofblockeddesignsthatestimate
quadraticeffects,seeJonesandNachtsheim(toappear,2014).Thepaperalsocontains
informationontreatingtheblocksasrandomeffects.
TheAdd Blocks with Center Runs to Estimate Quadratic Effects optionconstructsadesign
withtheseproperties:

Blockeffectsareorthogonaltomaineffects.

Themodelconsistingofallmainandquadraticeffectsisestimable.

Ifadesigncontainsonlycontinuousfactors,ablockeddesignforkfactorshavingthese
propertiescanbeconstructedasfollows:

RemovethecenterrunfromtheDSDdesignforkfactors.

Assignconferencematrixfoldoverpairstothesameblock.

Addonecenterruntoeachblock.

Whensomefactorsarecategorical,theAdd Blocks with Center Runs to Estimate Quadratic


Effectsoptionaddspairsofcenterrunswithincertainblocks.Thisstructureensures
orthogonalityandtheabilitytoestimateallmainandquadraticeffects.
Becausetheonlyrequirementonblocksizeisthatablockcontainsafoldoverpair,thenumber
ofblockscanrangefrom2tok,ifkisevenandfrom2tok+1,ifkisodd.SeeConference
MatricesandtheNumberofRunsonpage 228.JMPattemptstoconstructblocksofequal
size.
Add Blocks without Extra Center Runs
TheAdd Blocks without Extra Center Runs optionconstructsadesignthathasasinglecenter
runwhenallfactorsarecontinuousandtwocenterrunswhensomefactorsarecategorical.
Theresultingdesignhastheseproperties:

Blockeffectsareorthogonaltomaineffects.

Eachblockeffectisconfoundedwithalinearcombinationofquadraticeffects.This
impliesthatthemodelconsistingofallmainandquadraticeffectsisnotestimable.

Forthisreason,usethisoptiononlyifyoucanassumethatsomequadraticeffectsare
negligible.
Ablockeddesignforkfactorswithoutextracenterrunsisconstructedasfollows:

Assignconferencematrixfoldoverpairstothesameblock.

Ifallfactorsarecontinuous,assignthesinglecenterruntoasingleblock.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Definitive Screening Design Window

223

Iftherearecategoricalfactors,theunblockeddefinitivescreeningdesignrequiresthe
additionoftwocenterrunstothefoldoverpairsdefinedbytheconferencematrix.See
ConferenceMatricesandtheNumberofRunsonpage 228.Toconstructtheblocked
designwithoutextracenterruns,thesetwocenterrunsareaddedtoasingleblock.

Becausetheonlyrequirementonblocksizeisthatablockcontainsafoldoverpair,thenumber
ofblockscanrangefrom2tok,ifkisevenandfrom2tok+1,ifkisodd.SeeConference
MatricesandtheNumberofRunsonpage 228.JMPattemptstoconstructblocksofequal
size.

Design
TheDesignoutlineshowstherunsforthedefinitivescreeningdesign.Therunsaregivenina
standardorder.Tochangetherunorderforyourdesigntable,youcanselectRunOrder
optionsintheOutputOptionspanelbeforegeneratingthetable.
Note: Definitivescreeningdesignsforfourorfewerfactorsarebasedonafivefactordesign.
SeeDefinitiveScreeningDesignsforFourorFewerFactorsonpage 228.

Design Evaluation
TheDesignEvaluationoutlineprovidesanumberofwaystoevaluatethepropertiesofthe
generateddesign.OpentheDesignEvaluationoutlinetoseethefollowingoptions:
Power Analysis Enablesyoutoexploreyourabilitytodetecteffectsofgivensizes.
Prediction Variance Profile Showsthepredictionvarianceovertherangeoffactorsettings.
Fraction of Design Space Plot

Showshowmuchofthemodelpredictionvarianceliesbelow

(orabove)agivenvalue.
Prediction Variance Surface Showsasurfaceplotofthepredictionvarianceforanytwo

continuousfactors.
Estimation Efficiency Foreachparameter,givesthefractionalincreaseinthelengthofa

confidenceintervalcomparedtothatofanideal(orthogonal)design,whichmightnot
exist.Alsogivestherelativestandarderroroftheparameters.
Givescoefficientsthatindicatethedegreebywhichthemodelparametersare
biasedbyeffectsthatarepotentiallyactive,butnotinthemodel.

Alias Matrix

Color Map on Correlations Showstheabsolutecorrelationbetweeneffectsonaplotusingan

intensityscale.
Design Diagnostics Indicatestheoptimalitycriterionusedtoconstructthedesign.Alsogives

efficiencymeasuresforyourdesign.

224

Definitive Screening Designs


Definitive Screening Design Window

Chapter 6
Design of Experiments Guide

FormoredetailsabouttheDesignEvaluationpanel,seeDesignEvaluationonpage 476in
theEvaluateDesignschapter.

Output Options
UsetheOutputOptionspaneltoperformthefollowingtasks:

specifytheorderfortherunsinthedesigndatatable

constructthedesigntable

returntoapreviouspointintheDefinitiveScreeningDesignwindow

Figure 6.22OutputOptionsPanel

TheOutputOptionspanelcontainstheseoptions:
RunOrder
TheRun Orderoptionsdeterminetheorderoftherunsinthedesigntable.Choicesincludethe
following:
Keep the Same RowsinthedesigntableareinthesameorderasintheDesignoutline.
Sort Left to Right

Columnsinthedesigntablearesortedfromlefttoright.

Randomize Rowsinthedesigntableareinrandomorder.
Sort Right to Left Columnsinthedesigntablearesortedfromrighttoleft.
Randomize within Blocks

Rowsinthedesigntableareinrandomorderwithintheblocks.

MakeTable
ClickMake TabletoconstructtheDefinitiveScreeningDesigndatatable.
IntheDefinitiveScreeningDesigntable,theTablepanel(intheupperleft)containsthe
followingscripts.Torunascript,selectRun Scriptfromtheredtrianglemenu.
Screening RunstheAnalyze>Modeling>Screeningplatform.
Model RunstheAnalyze>Fit Model platform.Themodeldescribedbythescriptcontainsthe

maineffectsforthefactorsthatyouspecified.Ifyourequestedablock,themodelincludes
thefactorBlock.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Definitive Screening Design Options

225

DOE Dialog RecreatestheDefinitiveScreeningDesignwindowthatyouusedtogeneratethe

designtable.
Figure 6.23DefinitiveScreeningDesignTableShowingScripts

Back
TheBackbuttontakesyoubacktowhereyouwerebeforeclickingMakeDesign.Youcan
makechangestothepreviousoutlinesandregeneratethedesign.

Definitive Screening Design Options


TheredtrianglemenuintheDefinitiveScreeningDesignplatformcontainstheseoptions:
Createsadatatablecontainingarowforeachresponsewithacolumn
calledResponse Namethatidentifiestheresponses.Fouradditionalcolumnscontainthe
Lower Limit,Upper Limit,Response Goal,andImportance.Savingresponsesallowsyouto
quicklyloadthemintoaDOEwindow.

Save Responses

Load Responses

LoadsresponsesthatyouhavesavedusingtheSaveResponsesoption.

Save Factors Createsadatatablecontainingacolumnforeachfactorthatcontainsitsfactor

levels.Afactorscolumncontainscolumnpropertiesassociatedwiththefactor.Saving
factorsallowsyoutoquicklyloadthemintoaDOEwindow.
Note: Itispossibletocreateafactorstablebytypingdataintoanemptytable,but
remembertoassigneachcolumnanappropriateDesignRole.Dothisbyrightclickingon
thecolumnnameinthedatagridandselectingColumn Properties > Design Role.Inthe
DesignRolearea,selecttheappropriaterole.
Load Factors

LoadsfactorsthatyouhavesavedusingtheSaveFactorsoption.

226

Definitive Screening Designs


Definitive Screening Design Options

Chapter 6
Design of Experiments Guide

Save Constraints (Unavailableforsomeplatforms)Savesfactorconstraintsthatyouhave

definedintheDefineFactorConstraintsorLinearConstraintsoutline.TheSave
Constraintsoptioncreatesadatatablethatcontainsacolumnforeachconstraint.Saving
constraintsallowsyoutoquicklyloadthemintoaDOEwindow.
Theconstrainttablecontainsacolumnforeachlinearconstraint.Thefirstrowscontainthe
coefficientsforeachfactor.Thelastrowcontainstheinequalitybound.Eachconstraints
columncontainsacolumnpropertycalledConstraintStatethatidentifiestheconstraintasa
lessthanoragreaterthanconstraint.SeeColumnPropertiesonpage 559inthe
ColumnPropertiesappendix.
(Unavailableforsomeplatforms)Loadsfactorconstraintsthatyouhave
savedusingtheSaveConstraintsoption.

Load Constraints

Set Random Seed SetstherandomseedthatJMPusestocontrolcertainactionsthathavea

randomcomponent.Theseactionsinclude:
simulatingresponsesusingtheSimulateResponsesoption
randomizingRunOrderfordesignconstruction
selectingastartingdesignfordesignsbasedonrandomstarts.
Toreproduceadesignorsimulatedresponses,entertherandomseedusedtogenerate
them.Fordesignsusingrandomstarts,settheseedbeforeclickingMakeDesign.To
controlsimulatedresponsesorrunorder,settheseedbeforeclickingMakeTable.
NotethattherandomseedassociatedwithadesignisincludedintheDOEDialogscript
thatissavedtothedesigndatatable.
Addsresponsevaluestothedesigntablethatisgenerated.Selectthis
optionbeforeyouclickMakeTable.InthedesigntablethatresultsfromclickingMake
Table,theresponsecolumnscontainsimulatedvalues.

Simulate Responses

Forcertaintypesofdesigns,aSimulateResponseswindowliststhecoefficientsanderror
standarddeviationusedtosimulatetheresponsevalues.Youcanreplacethesecoefficients
andclickApplytoseeyoursimulatedresponsevaluesinthedatatable.Thedefaultvalues
forthecoefficientsareeither1or1.Thedefaultvaluefortheerrorstandarddeviationis1.
SomeplatformsallowyoutosetAnticipatedCoefficientsaspartofPowerAnalysisunder
DesignEvaluation.Fortheseplatforms,thedefaultvaluesintheSimulateResponses
windowarethevaluesthatyouspecifyasAnticipatedCoefficientsandAnticipatedRMSE
(ErrorStd)inthePowerAnalysisoutline.Ifitisnotpossibletofitthemodelspecifiedin
thedatatablesModelscript,theinterceptandcoefficientshavedefaultvaluesof0.
Note: Youcansetapreferencetoalwayssimulateresponses.SelectFile > Preferences >
Platforms > DOE.CheckSimulateResponses.

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Technical Details

227

Specifythedifferenceinthemeanresponsethatyou
wanttodetectformodeleffects.SeeEvaluateDesignOptionsonpage 493inthe
EvaluateDesignschapter.

Advanced Options > Set Delta for Power

Save Script to Script Window Createsthescriptforthedesignthatyouspecifiedinthe

CustomDesignplatformandsavesitinanopenscriptwindow.

Technical Details
Thissectioncontainstechnicaldetailsforthefollowingtopics:

StructureofDefinitiveScreeningDesignsonpage 227

AnalysisofExperimentalDataonpage 228

Structure of Definitive Screening Designs


Figure 6.24showsanexampleofadefinitivedesignwitheightcontinuousfactors.Noticethat
eachpairofrowsisafoldoverpair;eachevennumberedrowis1timesthepreviousrow.The
foldoveraspectofthedesignremovestheconfoundingoftwofactorinteractionsandmain
effects.Eachfactorissetatitscentervalueforthreeruns;this,togetherwiththedesigns
construction,makesallquadraticeffectsestimable.Addingthecenterruninthelastrow
enablesyoutofitamodelthatincludesaninterceptandallmainandquadraticeffects.This
structureistypicalofdefinitivescreeningdesignsforcontinuousfactors.
Figure 6.24DefinitiveScreeningDesignforEightContinuousFactors

228

Definitive Screening Designs


Technical Details

Chapter 6
Design of Experiments Guide

Conference Matrices and the Number of Runs


DefinitivescreeningdesignsinJMPareconstructedusingconferencematrices(Xiaoetal.,2012).
AconferencematrixisanmxmmatrixCwheremiseven.ThematrixChas0sonthe
diagonal,offdiagonalentriesequalto1or1,andsatisfies C C = m 1 I mxm .
Supposethatthenumberoffactors,k,isfiveorlarger.Forthecaseofk 4factors,see
DefinitiveScreeningDesignsforFourorFewerFactorsonpage 228.
Considerthecaseofcontinuousfactors.Whenkiseven,thekxkconferencematrixisusedto
definekrunsofthedesign.Itsnegative,C,definesthefoldoverruns.Acenterpointisadded
toensurethatamodelcontaininganintercept,maineffects,andquadraticeffectsisestimable.
So,forkeven,thenumberofrunsis2k+1.Whenkisodd,a(k+1)x(k+1)conferencematrixis
used,withitslastcolumndeleted.Thus,forkodd,thenumberofrunsis2k+3.
Asimilarprocedureisusedwhensomefactorsarecategorical.SeeJonesandNachtsheim
(2013).Twoadditionalrunsarerequired.Thesetworunsarecenterrunswhereallcontinuous
factorsaresetattheirmiddlevalues.Whentherearekfactorsandkiseven,thenumberof
runsinthedesignis2k+2.Whenkisodd,thenumberofrunsis2k+4.
Forcertainevenvaluesofm,aconferencematrixmightnotexist.Insuchacase,adefinitive
screeningdesigncanbeconstructedusingthenextlargestconferencematrix.Asaresult,the
requirednumberofrunsmightexceed2k+3,inthecontinuouscase,and2k+4,inthe
categoricalcase.
Definitive Screening Designs for Four or Fewer Factors
Definitivescreeningdesignsforfourorfewerfactorsareconstructedusingthefivefactor
definitivescreeningdesignasabase.Thisisbecausedesignsfork 4factorsconstructed
strictlyaccordingtotheconferencematrixapproachhaveundesirableproperties.In
particular,itisdifficulttoseparatesecondordereffects.
Ifyouspecifyk 4factors,adefinitivescreeningdesignforfivefactorsisconstructedand
unnecessarycolumnsaredropped.Forthisreason,thenumberofrunsforanunblocked
designwithk 4factorsis13ifallfactorsarecontinuousor14ifsomefactorsarecategorical.

Analysis of Experimental Data


Ingeneral,youwanttofitamodelthatpermitsthepossibilitythattwowayinteractionsare
active.Youalsomightwanttoincludepurequadratictermsinyourmodel.Youmightwantto
postulateafullsecondordermodel,oryoumightwanttospecifyanapriorimodel
containingonlycertainsecondorderterms.
Infittingsuchamodel,youneedtobemindfuloftwofacts:

twowayinteractioneffectsandquadraticeffectsareoftencorrelated

twowayinteractionandquadraticeffectscannotallbeestimatedsimultaneously

Chapter 6
Design of Experiments Guide

Definitive Screening Designs


Technical Details

229

Figure 6.25showsaColorMaponCorrelationsforthedesignwitheightcontinuousfactors
showninFigure 6.24.Thecolormapisforafullquadraticdesign.Theeightpurequadratic
effectsarelistedtothefarright.YoucanconstructthisplotbyusingDOE>EvaluateDesign
andenteringtheappropriatetermsintotheAliasTermslist.SeeAliasTermsonpage 476in
theEvaluateDesignschapterfordetails.
Figure 6.25ColorMaponCorrelationsforFullQuadraticModel

Useyourcursortoholdyourmousepointeroverthecellsofthecolormapinordertoseethe
absolutecorrelationsbetweeneffects.Youseethatmaineffectsareuncorrelatedwithall
twowayinteractionandpurequadraticeffects.Youalsoseethatnoneoftheeffectsare
completelyconfoundedwithothereffectsbecausetheonlyredcellsareonthemaindiagonal.
Butnotethatsomeoftheabsolutecorrelationsbetweentwofactorinteractionsaresubstantial,
withsomeat0.667.Notealsothatabsolutecorrelationsbetweentwofactorinteractionsand
purequadraticeffectsareeither0or0.3673.
Ifonlymainandpurequadraticeffectsareactive,youcanfitasaturatedmodelthatcontains
maineffectsandquadraticeffects.Thismodelwillresultineffectestimatesthatareunbiased,
assumingnoactivethreewayorhigherordereffects.

230

Definitive Screening Designs


Technical Details

Chapter 6
Design of Experiments Guide

Becauseofthecorrelationsinvolvingsecondordereffects,youmustbecarefulinfittinga
modelwithtwowayinteractions.Reasonableanalysismethodologiesinclude:

ForwardstepwiseregressionusingtheStoppingRulesettoMinimumAICcandtheRules
settoCombinetoensuremodelheredity.Becauseofeffectconfounding,severalmodels
mightbeequivalent.Toidentifythese,youcanfollowupbyselectingtheAllPossible
Modelsredtriangleoption.Additionalrunswillbenecessarytoresolvetheconfounding.

AllPossibleModelsregression,whereyouselecttheoptionthatimposestheHeredity
RestrictionandusetheAICccriterionformodelselection.

Chapter 7
Screening Designs
Screeningdesignsareamongthemostpopulardesignsforindustrialexperimentation.They
aretypicallyusedintheinitialstagesofexperimentation.Theyexaminemanyfactorsto
identifythosethathavethegreatesteffectontheresponseorresponses.Thefactorsidentified
arethenstudiedusingmoresensitivedesigns.
Screeningdesignsgenerallyrequirefewerexperimentalrunsthanotherdesigns.Theyare
attractivebecausetheyarearelativelyinexpensiveandefficientwaytobeginimprovinga
process.
Inascreeningdesign,eachcontinuousfactorisusuallysetattwolevelstoeconomizeonthe
numberofrunsneeded.Thedesignconsistsofonlyafractionofthepossiblecombinationsof
factorlevels.Tablesofstandarddesignsthatinvolvecontinuousandcategoricalfactorshave
beencataloged.
Whenstandardscreeningdesignsexist,theScreeningDesignplatformsuppliesalistof
popularscreeningdesignsfortwoormorefactors.Thesefactorscanbetwolevelcontinuous
factorsorthreelevelcategoricalordiscretecontinuousfactors.
However,screeningsituationsoccurforwhichstandarddesignsarenotavailable.Forthese
situations,JMPgeneratesmaineffectsscreeningdesigns.Therearedesignsthatareeither
orthogonalornearorthogonal.Theyfocusonestimatingmaineffectsinthepresenceof
negligibleinteractions.
IntheScreeningDesignplatform,youenteryourfactorsandtheirlevels.Ifastandard
screeningdesignexists,youaregiventheoptiontochoosesuchadesignfromalistof
standardscreeningdesignsthatincludesblockingdesigns.Alternatively,youcangeneratea
maineffectsscreeningdesign,whichassuresyouofanorthogonalornearorthogonaldesign.
Ifastandardscreeningdesigndoesnotexist,amaineffectsscreeningdesignisautomatically
generatedforyou.

Contents
OverviewofScreeningDesigns ................................................... 233
ScreeningDesignExamples....................................................... 234
AStandardDesignwithTwoContinuousFactorsandOneCategoricalFactor ........ 234
AStandardDesignforFiveContinuousFactors.................................. 237
CreatingaScreeningDesign...................................................... 241
EnterResponses.............................................................. 242
EnterFactors ................................................................ 243
ChooseScreeningType ....................................................... 244
ChoosefromaListofFractionalFactorialDesigns................................ 244
DesignGeneration ........................................................... 252
NearOrthogonalDesigns ..................................................... 252
DesignEvaluation ............................................................ 254
SpecifyOutputOptions....................................................... 254
ViewtheDesignTable ........................................................ 255
CreatingaPlackettBurmanDesign ................................................ 256
CreatingaMainEffectsScreeningDesign........................................... 258

Chapter 7
Design of Experiments Guide

Screening Designs
Overview of Screening Designs

233

Overview of Screening Designs


Eachcontinuousfactorinascreeningdesignistypicallysetattwolevels.Classicaldesignscan
alsoaccommodatecategoricalfactorswiththreelevels.Whenthenumberofpossiblefactor
levelcombinationsresultsinaninfeasibledesignsize,responsemeasurementsaretakenfor
onlyafractionofthesecombinations.
Thescreeningdesignplatformprovidesscreeningdesignsfortwolevelcontinuousfactors,
categoricalfactors,anddiscretecontinuousfactors.Thesedesignsareoftwotypes:

Classicaldesigns:Forsituationswherestandardscreeningdesignsexist,youcanchoose
fromalistofthesedesigns.

MainEffectsScreeningDesigns:Forsituationswherestandarddesignsarenotavailable,
JMPgeneratesdesignsthatareeitherorthogonalornearorthogonal.Likesomeofthe
standarddesigns,thesedesignsfocusonestimatingmaineffectsinthepresenceof
negligibleinteractions.SeeNearOrthogonalDesignsonpage 252.

Theemphasisonstudyingmaineffectsearlyonintheexperimentationprocessissupported
bytheHierarchicalOrderingPrinciple(WuandHamada,2000).Thisprinciplecontendsthat
lowereffectsaremorelikelytobeimportantthanhigherordereffects.Forthisreason,
screeningdesignsgenerallyassumethatinteractionsarenegligible.Incaseswherethis
assumptionisnotreasonable,screeningdesignsassumethattwofactorinteractionsaremore
importantthanthreefactorinteractions,andsoon.
Theefficiencyofscreeningdesignsalsodependsonthecriticalassumptionofeffectsparsity.
Effectsparsityreflectsthefactthatrealworldprocessesusuallyhaveonlyafewdriving
factors.Otherfactorsarerelativelyunimportant.Tounderstandtheimportanceofeffect
sparsity,youcancontrastscreeningdesignstofullfactorialdesigns:

Fullfactorialdesignsconsistofallcombinationsofthelevelsofthefactors.Thenumberof
runsistheproductofthefactorlevels.Forexample,afullfactorialexperimentwiththree
twolevelfactorsandafourlevelfactorhas2x2x2x4=32runs.

Bycontrast,screeningdesignsrequireonlyafractionoftherunsinthefullfactorial
design.Themaineffectsofthefourfactorsdescribedabovecanbestudiedinaneightrun
maineffectsscreeningdesign.

Thischaptershowsyouhowtogenerateandanalyzescreeningdesigns,pointingouttheir
limitationsintheprocess.

234

Screening Designs
Screening Design Examples

Chapter 7
Design of Experiments Guide

Screening Design Examples


A Standard Design with Two Continuous Factors and One Categorical Factor
Supposeanengineerwantstoinvestigateaprocessthatusesanelectronbeamwelding
machinetojointwoparts.Theengineerfitsthetwopartsintoaweldingfixturethatholds
themsnuglytogether.Avoltageappliedtoabeamgeneratorcreatesastreamofelectronsthat
heatsthetwoparts,causingthemtofuse.Theidealdepthofthefusedregionis0.17inches.
Theengineerwantstostudytheweldingprocesstodeterminethebestsettingsforthebeam
generatortoproducethedesireddepthinthefusedregion.
Forthisstudy,theengineerwantstoexplorethefollowingthreeinputs,whicharethefactors
forthestudy:

Operator,whoisthetechnicianoperatingtheweldingmachine

Rotation Speed,whichisthespeedatwhichthepartrotatesunderthebeam

Beam Current,whichisacurrentthataffectstheintensityofthebeam

Aftereachprocessingrun,theengineercutsthepartinhalf.Thisrevealsanareawherethe
twopartshavefused.TheLength ofthisfusedareaisthedepthofpenetrationoftheweld.
Thisdepthofpenetrationistheresponseforthestudy.
Thegoalsofthestudyarethefollowing:

Findwhichfactorsaffectthedepthoftheweld.

Quantifythoseeffects.

Findspecificfactorsettingsthatpredictawelddepthof0.17inches.

Tobeginthisexample,selectDOE > Screening Designfromthemainmenu.Notethatinthe


Responsespanel,thereisasingledefaultresponsecalledY.Changethedefaultresponseas
follows:
1. DoubleclicktheresponsenameandchangeittoDepth (in).
2. ThedefaultgoalforthesingledefaultresponseisMaximize.Butthegoalofthisprocessis
togetatargetvalueof0.17incheswithalowerboundof0.12andanupperboundof0.22.
ClicktheGoalboxandchooseMatch Targetfromthedropdownmenu,asshownin
Figure 7.1.

Chapter 7
Design of Experiments Guide

Screening Designs
Screening Design Examples

235

Figure 7.1ScreeningDesignResponsewithMatchTargetGoal

Click the Goal box and


choose Match Target

3. ClicktheLower Limittexteditareaandenter0.12asthelowerlimit(minimumacceptable
value).ThenclicktheUpper Limittexteditareaandenter0.22astheupperlimit
(maximumacceptablevalue).
Thisexamplehasonecategoricalfactor(Operator)andtwocontinuousfactors(Speedand
Current).IntheFactorspanel:
4. Addthecategoricalfactorbyselecting2 LevelfromtheCategorical list.
5. Addtwocontinuousfactorsbytyping2intheAdd N Factors boxandclickingthe
Continuous button.
6. DoubleclickthefactornamesandrenamethemOperator,Speed,andCurrent.
7. AssignJohnandMaryasvaluesforthecategoricalfactorOperator.Sethighandlow
valuesforSpeedto3and5(rpm).SethighandlowvaluesforCurrentto150and165
(amps).YourScreeningDesignwindowshouldappearasshowninFigure 7.2.
Figure 7.2ScreeningDesignwithTwoContinuousandOneCategoricalFactor

8. ClickContinue.
SincethereisastandarddesignintheDesignListforthecombinationoffactorsandlevels
thatyouhavespecified,theChooseScreeningTypepanelappears(Figure 7.3).Youcan
choosebetweenselectingastandarddesignfromalistorgeneratinganorthogonalor

236

Screening Designs
Screening Design Examples

Chapter 7
Design of Experiments Guide

nearorthogonaldesign.AcceptthedefaultselectiontoChoose from a list of fractional


factorial designsandclickContinue.
Figure 7.3ChooseScreeningTypePanel

9. SelectFull Factorialinthelistofdesigns,asshowninFigure 7.4,andthenclickContinue.


Figure 7.4ListofScreeningDesignsforTwoContinuousandOneCategoricalFactors

IntheOutputOptionsreport,clicktheRun OrdermenuandselectSort Left to Right (see


Figure 7.8).ThenclickMake TabletocreatetheJMPtablethatcontainsthespecifieddesign.
ThetableinFigure 7.5appears.Becauseyouhavesortedtheruns,theyarearrangedina
specificorder.Thishasbeendoneforexpositorypurposes.Ingeneral,youwanttorandomize
therowsinthedatatablebeforerunningyourexperiment.
Thetableusesthenamesforresponses,factors,andlevelsthatyouspecified.ThePattern
variableshowsthecodeddesignruns.Thetableproducedinthisexampleisshownin
DOE Example 1.jmp,foundintheDesign Experimentssubfolderofthesampledatafolder.

Chapter 7
Design of Experiments Guide

Screening Designs
Screening Design Examples

237

Figure 7.5TheDesignDataTable

A Standard Design for Five Continuous Factors


Asillustratedintheprevioussection,experimentsforscreeningtheeffectsofmanyfactors
usuallyconsideronlytwolevelsofeachfactor.Thisallowstheexaminationofmanyfactors
withaminimumnumberofruns.
Thefollowingexample,adaptedfromMeyer,etal.(1996),demonstrateshowtouseJMPs
screeningdesignerwhenyouhavemanyfactors.Inthisstudy,achemicalengineer
investigatestheeffectsoffivefactorsonthepercentreactionofachemicalprocess.Thefactors
are:

feedrate,theamountofrawmaterialaddedtothereactionchamberinlitersperminute

percentageofcatalyst

stirrate,theRPMsofapropellerinthechamber

reactiontemperatureindegreesCelsius

concentrationofreactant

ToStarttheExample:
1. SelectDOE > Screening Design.
2. YouseeonedefaultresponsecalledY.Changethedefaultresponsename(Y)to Percent
Reacted.
3. TheGoal istomaximizetheresponse,butchangetheminimumacceptablereaction
percentageto90(Lower Limit),andupperlimitto99(Upper Limit),asshowninFigure 7.6.
4. Addfivecontinuousfactorsbyentering5intheAdd N Factorsboxandclicking
Continuous.
5. Changethedefaultfactornames(X1X5)toFeed Rate,Catalyst,Stir Rate,Temperature,and
Concentration.
6. Enterthehighandlowvalues,asshowninFigure 7.6.

238

Screening Designs
Screening Design Examples

Chapter 7
Design of Experiments Guide

Figure 7.6ScreeningforManyFactors

7. ClickContinue.
8. FromtheChooseScreeningTypepanel,acceptthedefaultselectiontoChoose from a list of
fractional factorial designs.
DesignsforthenumberoffactorsthatyouspecifiedarelistedintheDesignList
(Figure 7.7).
9. Selectthefirstiteminthelist,whichisan8runfractionalfactorialdesignwithnoblocks
(Figure 7.7).

Chapter 7
Design of Experiments Guide

Screening Designs
Screening Design Examples

239

Figure 7.7ScreeningDesignforFiveFactors

10. ClickContinue toseetheOutputOptionspanelshowninFigure 7.8.


TheOutputOptionspanelletsyoumodifythefinaldesignbyspecifyingtherunorder,the
numberofcenterpoints,andthenumberoftimesthedesignisreplicated.Designsshould
beruninrandomorder.Screeningdesignsaretypicallynotreplicated.
11. Toshowastandardorderingforthedesign,selectSort Left to RightfromtheRunOrder
list.
Figure 7.8OutputOptionsforDesignTable

12. ClickMake Tabletocreatethedatatable.Thedesigntable,showninFigure 7.9,liststhe


runsforthedesignthatyouselected.NotethatitalsoinsertsacolumncalledPercent
Reacted forrecordingexperimentalresults.Alsoincludedarethreescripts,Screening,
Model,andDOE Dialog.

240

Screening Designs
Screening Design Examples

Chapter 7
Design of Experiments Guide

Figure 7.9JMPTableofRunsforScreeningExample

13. SelectHelp > Sample Data LibraryandopenDesign Experiment/Reactor 8 Runs.jmp.


Notethatthisdesignwasobtainedusingdifferentgeneratingrulesthanthoseusedforthe
designthatyoujustgenerated.
Ofthefivefactorsintheexperiment,youexpectafewtostandoutincomparisontothe
others.Youusethisdatatoidentifyactiveeffectsforexperimentalresultsfromthisdesign.
14. ClicktheredtrianglenexttotheScreeningscriptinupperleftofthedatatable.SelectRun
Script.Alternatively,youcananalyzethedatadirectlybyselectingAnalyze > Modeling >
Screening.SelectPercent ReactedasYandallothercontinuousvariablesasX.
15. ClickOK.
ThereportisshowninFigure 7.10.Sincethepvaluesareobtainedusinga
simulationbasedtechnique,yourpvaluesmightnotpreciselymatchthoseshownbelow.
SeethesectionTheScreeningReportonpage 267intheTheScreeningPlatform
chapterforacompletediscussionofthescreeningreport.

Chapter 7
Design of Experiments Guide

Screening Designs
Creating a Screening Design

241

Figure 7.10ReportforScreeningExample

Creating a Screening Design


Tobegin,select DOE > Screening Design,orclicktheScreening Design buttonontheJMP
StarterDOEpage.Then,seethefollowingsectionsforeachsteptocreateascreeningdesign:
1. EnterResponsesonpage 242
2. EnterFactorsonpage 243
3. ChooseScreeningTypeonpage 244
DisplayandModifyDesignonpage 249,ifyouchooseastandarddesignfromthe
DesignTable
DesignGenerationonpage 252,ifyouchoosetogenerateamaineffectsscreening
design
4. EvaluateDesignschapteronpage 461
5. SpecifyOutputOptionsonpage 254
6. ViewtheDesignTableonpage 255
MostoftheredtriangleoptionsforthescreeningplatformaredescribedinCustomDesign
Optionsonpage 102intheCustomDesignschapter.Threeoptionsarespecificto
screeningdesigns:

SuppressCotterDesigns,describedinCotterDesignsonpage 247

242

Screening Designs
Creating a Screening Design

Chapter 7
Design of Experiments Guide

NumberofStarts,describedinDesignGenerationonpage 252

NumberofColumnStarts,describedinDesignGenerationonpage 252

Enter Responses
Toenterresponses,followthestepsinFigure 7.11.
1. Toenteroneresponseatatime,clickandthenselectagoaltype.Possiblegoaltypesare
Maximize,Match Target,Minimize,orNone.
2. (Optional)Doubleclicktoedittheresponsename.
3. (Optional)Clicktochangetheresponsegoal.
4. (Optional)Clicktoenterlowerandupperlimitsandimportanceweights.
Figure 7.11EnteringResponses
4

Tip: Toquicklyentermultipleresponses,clicktheNumber of Responsesbuttonandenterthe


numberofresponsesthatyouwant.
Specifying Goal Types and Lower and Upper Limits
Whenenteringresponses,youcantellJMPthatyourgoalistoobtainthemaximumor
minimumvaluepossible,tomatchaspecificvalue,orthatthereisnogoal.
Thefollowingdescriptionexplainstherelationshipbetweenthegoaltype(step3in
Figure 7.11)andthelowerandupperlimits(step4inFigure 7.11):

Forresponsessuchasstrengthoryield,thebestvalueisusuallythelargestpossible.A
goalofMaximizesupportsthisobjective.

TheMinimizegoalsupportsanobjectiveofhavingthesmallestvaluebethemostdesirable,
suchaswhentheresponseisimpurityordefects.

TheMatch Targetgoalsupportstheobjectivewhenthebestvalueforaresponseisa
specifictargetvalue,suchasdimensionsofamanufacturedpart.Thedefaulttargetvalue
isassumedtobemidwaybetweenthelowerandupperlimits.

Chapter 7
Design of Experiments Guide

Screening Designs
Creating a Screening Design

243

Note: Ifyourtargetrangeisnotsymmetricaroundthetargetvalue,youcanalterthedefault
targetafteryoumakeatableforthedesign.Inthedatatable,opentheresponsesColumnInfo
dialogbydoubleclickingthecolumnname,andentertheappropriatetargetvalue.
Understanding Importance Weights
Whencomputingoveralldesirability,JMPusesthevaluethatyouenterastheimportance
weight(step4inFigure 7.11)toweighteachresponse.Ifthereisonlyoneresponse,then
specifyingimportanceisunnecessary.Withtworesponses,youcangivegreaterweighttoone
responsebyassigningitahigherimportancevalue.

Enter Factors
Next,youenterfactors.ThisprocessisdescribedinFigure 7.12.
1. Toenteracontinuousfactor,clicktheContinuousbutton.ToenteraDiscrete Numericora
Categoricalfactor,selecttheappropriatenumberoflevelsforthefactorfromthelist.
2. Toenterseveralofonetypeoffactor,enterthenumberoffactorsintheboxnexttoAdd N
Factors.Thenselectthetypeoffactorforwhichyouwanttoaddthespecifiednumberof
factors.
3. Toremoveafactorfromthelist,highlightthefactorandclicktheRemove button.
4. Doubleclicktoeditafactorname.
5. Clicktoenterfactorvalues.
Figure 7.12EnteringFactors
2
1

3
4

Types of Factors
Ingeneral,whendesigningexperiments,youcanenterdifferenttypesoffactorsinthemodel.
Belowisadescriptionoffactortypesfromwhichyoucanchoosewhencreatingscreening
designs:
Continuous Continuousfactorshavenumericdatatypesonly.Intheory,youcanseta

continuousfactortoanyvaluebetweenthelowerandupperlimitsthatyousupply.

244

Screening Designs
Creating a Screening Design

Chapter 7
Design of Experiments Guide

Discrete Numeric Discretenumericfactorshavenumericdatatypesonly.Adiscretenumeric

factorcanassumeonlyadiscretenumberofvalues.Thesevalueshaveanimpliedorder.
Thedefaultvaluesforadiscretenumericfactorwithklevels,where k 2 ,aretheintegers
1 2 k .Thedefaultvaluesforadiscretenumericfactorwith k = 2 levelsare1and1.
Replacethedefaultvalueswiththesettingsthatyouplantouseinyourexperiment.
Everylevelofadiscretenumericfactorappearsinthedesignselectedorconstructedusing
theScreeningDesignplatform.
FitModeltreatsadiscretenumericfactorasacontinuouspredictor.Foreachdiscrete
numericfactor,theModelscriptthatissavedtothedesigntablecontainsonlyitsmain
effect.Youcanaddpolynomialtermsforadiscretenumericfactortothemodeleffectslist
intheModelSpecificationwindow.
Categoricalfactors(eithernumericorcategoricaldatatypes)havenoimplied
order.Ifthevaluesarenumbers,theorderisthenumericmagnitude.Ifthevaluesare
character,theorderisthesortingsequence.Thesettingsofacategoricalfactorarediscrete
andhavenointrinsicorder.Examplesofcategoricalfactorsaremachine,operator,and
gender.

Categorical

Afteryouenterresponsesandfactors,clickContinue.

Choose Screening Type


IfastandarddesignlistedintheDesignTableappliesforyourfactorsandlevels,thentwo
optionsappearintheChooseScreeningTypepanel,belowtheFactorspanel:
Choose from a list of fractional factorial designs Enablesyoutoselectfromalistofdesigns.

Thisoptionisthedefault.Fordetails,seeChoosefromaListofFractionalFactorial
Designsonpage 244.
Generate orthogonal or near orthogonal designs for main effects only OpenstheDesign

Generationoutlinewhereyoucanspecifythenumberofrunsinthenearorthogonal
design.Fordetailsaboutnearorthogonaldesigns,seeNearOrthogonalDesignson
page 252.
Note: Ifnolistedstandarddesignexistsforyourspecificationoffactors,thentheChoose
ScreeningTypepaneldoesnotappear.TheDesignGenerationoutlineforconstructinga
nearorthogonaldesignopens.

Choose from a List of Fractional Factorial Designs


Whenyouselectthisoption,theDesignListreportopens.(SeeDesignListonpage 245.
Onceyouselectadesign,clickContinuetoseetheDisplayandModifyDesignreport.See
DisplayandModifyDesignonpage 249.

Chapter 7
Design of Experiments Guide

Screening Designs
Creating a Screening Design

245

Design List
Thelistofscreeningdesignsthatyoucanuseincludesdesignsthatgrouptheexperimental
runsintoblocksofequalsizeswherethesizeisapoweroftwo.Highlightthetypeof
screeningdesignthatyouwanttouseandclickContinue.
Figure 7.13ChoosingaTypeofScreeningDesign

Thescreeningdesignerprovidesthefollowingtypesofdesigns:
TwoLevelFullFactorial
Afullfactorialdesignhasrunsforallcombinationsofthelevelsofthefactors.Thesamples
sizeistheproductofthelevelsofthefactors.Fortwoleveldesigns,thisis2kwherekisthe
numberoffactors.Thiscanbeexpensiveifthenumberoffactorsisgreaterthan3or4.
Thesedesignsareorthogonal.Thismeansthattheestimatesoftheeffectsareuncorrelated.If
youremoveaneffectintheanalysis,thevaluesoftheotherestimatesremainthesame.Their
pvalueschangeslightly,becausetheestimateoftheerrorvarianceandthedegreesoffreedom
aredifferent.
Fullfactorialdesignsallowtheestimationofinteractionsofallordersuptothenumberof
factors.Mostempiricalmodelinginvolvesfirstorsecondorderapproximationstothetrue
functionalrelationshipbetweenthefactorsandtheresponses.Thefiguretotheleftin
Figure 7.14isageometricrepresentationofatwolevelfullfactorialdesignwiththreefactors.
TwoLevelRegularFractionalFactorial
Aregularfractionalfactorialdesignalsohasasamplesizethatisapoweroftwo.Ifkisthe
numberoffactors,thenumberofrunsinaregularfractionalfactorialdesignis2kpwherep<
k.Thefractionofthefullfactorialis2p.Likethefullfactorial,regularfractionalfactorial
designsareorthogonal.
Thetradeoffinscreeningdesignsisbetweenthenumberofrunsandtheresolutionofthe
design.Ifpriceisnoobject,youcanrunseveralreplicatesofallpossiblecombinationsofm
factorlevels.Thisprovidesagoodestimateofeverything,includinginteractioneffectstothe
mthdegree.Butbecauserunningexperimentscoststimeandmoney,youtypicallyonlyruna
fractionofallpossiblelevels.Thiscausessomeofthehigherordereffectsinamodelto
becomenonestimable.Aneffectisnonestimablewhenitisconfoundedwithanothereffect,

246

Screening Designs
Creating a Screening Design

Chapter 7
Design of Experiments Guide

meaningthattheeffectscannotbedistinguishedfromeachother.Infact,fractionalfactorials
aredesignedbydecidinginadvancewhichinteractioneffectsareconfoundedwiththeother
interactioneffects.
ResolutionNumber:TheDegreeofConfounding
Inpractice,fewexperimentersworryaboutinteractionshigherthantwowayinteractions.
Thesehigherorderinteractionsareassumedtobezero.
Experimentscanthereforebeclassifiedbyresolutionnumberintothreegroups:

Resolution=3meansthatmaineffectsareconfoundedwithoneormoretwoway
interactions.Forthemaineffectstobemeaningful,theseinteractionsmustbeassumedto
bezero.

Resolution=4meansthatmaineffectsarenotconfoundedwithothermaineffectsor
twofactorinteractions.However,twofactorinteractionsareconfoundedwithother
twofactorinteractions.

Resolution5meansthereisnoconfoundingbetweenmaineffects,betweentwofactor
interactions,orbetweenmaineffectsandtwofactorinteractions.

Aminimumaberrationdesignisoneinwhichthereareaminimumnumberofconfoundings
foragivenresolution.ForDOEexperts,theminimumaberrationdesignofagivenresolution
minimizesthenumberofwordsinthedefiningrelationthatareofminimumlength.
ThefigureontherightinFigure 7.14isageometricrepresentationofatwolevelfractional
factorialdesignwiththreefactors.
Figure 7.14RepresentationofFullFactorial(Left)andTwoLevelFractionalFactorial(Right)
Designs
-1, 1, -1
-1, -1, -1

1, -1, -1

1, 1, -1

1, 1, 1
-1, -1, 1

PlackettBurmanDesigns
PlackettBurmandesignsareanalternativetoregularfractionalfactorialsforscreening.One
usefulcharacteristicisthatthesamplesizeisamultipleoffourratherthanapoweroftwo.

Chapter 7
Design of Experiments Guide

Screening Designs
Creating a Screening Design

247

Therearenotwolevelfractionalfactorialdesignswithsamplesizesbetween16and32runs.
However,thereare20run,24run,and28runPlackettBurmandesigns.
Themaineffectsareorthogonalandtwofactorinteractionsareonlypartiallyconfounded
withmaineffects.Thisisdifferentfromresolutionthreefractionalfactorialwheretwofactor
interactionsareindistinguishablefrommaineffects.
Incasesofeffectsparsity,astepwiseregressionapproachcanallowforremovingsome
insignificantmaineffectswhileaddinghighlysignificantandonlysomewhatcorrelated
twofactorinteractions.TheScreeningplatforminJMP,Analyze>Modeling>Screening,isa
streamlinedapproachforlookingatsparsedata.Thisplatformcanacceptmultipleresponses
andmultiplefactors,thenautomaticallyfitsatwoleveldesignandshowssignificanteffects
withplotsandstatistics.SeeTheScreeningPlatformchapteronpage 261fordetails.
MixedLevelDesigns
Formostdesignsthatinvolvecategoricalordiscretenumericfactorsatthreeormorelevels,
standarddesignsdonotexist.Insuchcases,thescreeningplatformgeneratesmaineffects
screeningdesignsthatareorthogonalornearlyorthogonalformaineffects.
TheDesignListprovidesfractionalfactorialdesignsforpurethreelevelfactorialswithupto
13factors.Formixedtwolevelandthreeleveldesigns,theDesignlistincludesthecomplete
factorialsandspecializedorthogonalarraydesignslistedinTable 7.1.
Ifyournumberoffactorsdoesnotexceedthenumberforadesignlistedinthetable,youcan
usethatdesignbyselectinganappropriatesubsetofcolumnsfromtheoriginaldesign.Some
ofthesedesignsarenotbalanced,eventhoughtheyareallorthogonal.
Table 7.1TableofMixedLevelDesigns
Design

TwoLevel Factors

ThreeLevel Factors

L18John

L18Chakravarty

L18Hunter

L36

11

12

CotterDesigns
Cotterdesignsareusedwhenyouhaveveryfewresourcesandmanyfactors,andyoubelieve
theremightbeinteractions.Supposeyoubelieveineffectsparsitythatveryfeweffectsare
trulynonzero.Youarewillingtobetthatifyouaddupanumberofeffects,thesumwillshow
aneffectifitcontainsanactiveeffect.Thedangeristhatseveralactiveeffectswithmixedsigns
mightcancelandstillsumtonearzeroandgiveafalsenegative.

248

Screening Designs
Creating a Screening Design

Chapter 7
Design of Experiments Guide

Cotterdesignsareeasytosetup.Forkfactors,thereare2k+2runs.Thedesignissimilartothe
varyonefactoratatimeapproachmanybookscallinefficientandnaive.
ACotterdesignbeginswitharunhavingallfactorsattheirhighlevel.Thenfollowkruns
eachwithonefactorinturnatitslowlevel,andtheothershigh.Thenextrunsetsallfactorsat
theirlowlevelandsequencesthroughkmorerunswithonefactorhighandtherestlow.This
completestheCotterdesign,subjecttorandomizingtheruns.
WhenyouuseJMPtogenerateaCotterdesign,thedesignalsoincludesasetofextracolumns
touseasregressors.TheseareoftheformfactorOddandfactorEvenwherefactorisafactor
name.Theyareconstructedbyaddingupalltheoddandeveninteractiontermsforeach
factor.Forexample,ifyouhavethreefactors,A,B,andC:
Table 7.2CotterDesignTable
AOdd=A+ABC

AEven=AB+AC

BOdd=B+ABC

BEven=AB+BC

COdd=C+ABC

CEven=BC+AC

BecausethesecolumnsinaCotterdesignmakeanorthogonaltransformation,testingthe
parametersonthesecombinationsisequivalenttotestingthecombinationsontheoriginal
effects.Intheexampleoffactorslistedabove,AOddestimatesthesumofoddtermsinvolving
A.AEvenestimatesthesumoftheeventermsinvolvingA,andsoon.
BecauseCotterdesignshaveafalsenegativerisk,manystatisticiansdiscouragetheiruse.
HowtoRunaCotterDesign
Bydefault,JMPdoesnotincludeaCotterdesigninthelistofavailablescreeningdesigns
(Figure 7.13).However,ifyouwanttomakeaCotterdesign:
1. Immediatelyafterenteringresponsesandfactors(andbeforeclickingContinue),clickthe
redtriangleiconintheScreeningDesigntitlebar.
2. DeselectSuppress Cotter Designs.(Theoptionisinitiallyselected.)
Changingthesettingviatheredtrianglemenuappliesonlytothecurrentdesign.Toalterthe
settingforallscreeningdesigns:
1. SelectFile > Preferences.
2. ClickthePlatformsicon.
3. ClickDOEtohighlightit.
4. UnchecktheboxbesideSuppress Cotter Designs.

Chapter 7
Design of Experiments Guide

Screening Designs
Creating a Screening Design

249

Display and Modify Design


IfyouhavechosenaFractionalFactorialdesignfromtheDesignList,onceyouclickContinue,
theDisplayandModifyDesignreportopens.Thisreportgivesyouoptionsformodifying
yourdesign.
Figure 7.15DisplayandModifyOptions

Change Generating Rules Controlsthechoiceofdifferentfractionalfactorialdesignsfora

givennumberoffactors.
Aliasing of Effects Showstheconfoundingpatternforfractionalfactorialdesigns.
Coded Design Showsthepatternofhighandlowvaluesforthefactorsineachrun.

Aliasing of Effects
Toseewhicheffectsareconfoundedwithwhichothereffects,opentheAliasingofEffects
outline.Itshowseffectsandconfoundinguptotwofactorinteractions.
Figure 7.16GeneratingRulesandAliasingofEffectsPanel

Forexample,afullfactorialwithfivefactorsrequires25=32runs.Eightrunscanonly
accommodateafullfactorialwiththreetwolevelfactors.Itisnecessarytoconstructthetwo
additionalfactorsintermsofthefirstthreefactors.

250

Screening Designs
Creating a Screening Design

Chapter 7
Design of Experiments Guide

Thepriceofreducingthenumberofrunsfrom32toeightiseffectaliasing(confounding).
Confoundingisthedirectresultoftheassignmentofnewfactorvaluestoproductsofthe
codeddesigncolumns.
Intheexampleabove,thevaluesforTemperaturearetheproductofthevaluesforFeed Rate
andConcentration.ThismeansthatyoucannottellthedifferenceoftheeffectofTemperature
andthesynergistic(interactive)effectofFeed RateandConcentration.
The+/optionenablesyoutospecifynegativegeneratingrelations.Thisenablesyoutoobtain
differentfractionsofthedesign.Whenyoudeselectthe+/option,thisswitchesthesignsof
thelevelsfordesigncolumnsgeneratedbythefactorsintherelation.
IntheexampleshowninFigure 7.16,allthemaineffectsareconfoundedwithtwofactor
interactions.Thisisanexampleofaresolutionthreedesign.
Look at the Confounding Pattern
JMPcancreateadatatablethatshowsthealiasingpatternforaspecifiedlevel.Tocreatethis
table:
1. ClicktheredtriangleatthebottomoftheAliasingofEffectsarea.
2. Select Show Confounding Pattern(Figure 7.17).
Figure 7.17ShowConfoundingPatterns

3. Entertheorderofconfoundingyouwanttosee(Figure 7.18).
Figure 7.18EnterOrderofConfoundinginTextEditBox

Chapter 7
Design of Experiments Guide

Screening Designs
Creating a Screening Design

251

4. ClickOK.
Figure 7.19showsthethirdorderaliasingforthefivefactorreactorexample.Theeffectnames
beginwithC(Constant)andareshownbytheirordernumberinthedesign.Thus,
Temperatureappearsas4,withsecondorderaliasingas15(Feed RateandConcentration),
andthirdorderconfoundingas123(Feed Rate,Catalyst,andStir Rate).
Figure 7.19TheThirdLevelAliasfortheFiveFactorReactorExample

Understanding Design Codes


IntheCodedDesignpanel,eachrowrepresentsarun.Plussignsdesignatehighlevelsand
minussignsrepresentlowlevels.AsshowninFigure 7.20,rowsforthefirstthreecolumnsof
thecodeddesign,whichrepresentFeed Rate,Catalyst,andStir Rateareallcombinationsof
highandlowvalues(afullfactorialdesign).Thefourthcolumn(Temperature)ofthecoded
designistheelementbyelementproductofthefirstthreecolumns.Similarly,thelastcolumn
(Concentration)istheproductofthesecondandthirdcolumns.
Figure 7.20DefaultCodedDesigns
Feed Rate
Catalyst

Temperature

Concentration

Stir Rate

Changing the Coded Design


IntheChangeGeneratingRulespanel,changingthecheckmarksandclickingApplychanges
thecodeddesign;itchangesthechoiceofdifferentfractionalfactorialdesignsforagiven

252

Screening Designs
Creating a Screening Design

Chapter 7
Design of Experiments Guide

numberoffactors.TheCodedDesigntableinFigure 7.20showshowthelasttwocolumnsare
constructedintermsofthefirstthreecolumns.ThecheckmarksintheChangeGenerating
RulestableshowninFigure 7.21forTemperaturenowshowitisafunctionofFeed Rate,and
Catalyst.ThecheckmarksforConcentrationshowitisafunctionofFeed Rate andStir Rate.
IfyouchecktheoptionsasshowninFigure 7.21andclickApply,theCodedDesignpanel
changes.Thefirstthreecolumnsofthecodeddesignremainafullfactorialforthefirstthree
factors(Feed Rate,Catalyst,andStir Rate).TemperatureisnowtheproductofFeed Rateand
Catalyst,sothefourthcolumnofthecodeddesignistheelementbyelementproductofthe
firsttwocolumns.ConcentrationisafunctionofFeed RateandStir Rate.
Figure 7.21ModifiedCodedDesignsandGeneratingRules

Design Generation
TheDesignGenerationreportappearswhenyouselecttheoptionGenerate orthogonal or
near orthogonal designs for main effects onlyorwhentherearenostandarddesignsforyour
experimentalsituation.Youcanspecifyanumberofrunsinthepanel,acceptthedefault
number,orselecttheminimumrequirednumber.Anorthogonalornearorthogonaldesignis
constructed.ClickMakeDesigntoseethegenerateddesign.

Near-Orthogonal Designs
Ifanexperimentinvolvescategoricalordiscretenumericfactorsorifthenumberofrunsis
constrained,itmightnotbepossibletoconstructanorthogonaldesignforscreeningmain
effects.However,anearorthogonaldesigncanbeconstructed.SeeLekivetzetal.(2014,in
press).

Chapter 7
Design of Experiments Guide

Screening Designs
Creating a Screening Design

253

Anearorthogonaldesignisadesignwithgoodbalancepropertiesasdescribedbya
Chisquarecriterion.SeeChi2Efficiencyonpage 253.Suchdesignshavedesirablestatistical
propertiesformaineffectmodels.
Thealgorithmusedtogeneratethedesignattemptstoconstructanorthogonalarrayof
strengthtwo.Strengthtwoorthogonalarrayspermitorthogonalestimationofmaineffects
wheninteractionsarenegligible.Thesearraysareidealforscreeningdesigns.Regular
fractionalfactorialdesignsofresolutionthreeandPlackettBurmandesignsareexamplesof
strengthtwoorthogonalarrays.
Considerallpossiblepairsoflevelsforfactorsinthedesign.Thealgorithmattemptsto
balancethenumberofpairsoflevelsasfaraspossible.Giventhatafixednumberofcolumns
hasbeengenerated,anewbalancedcolumnisrandomlyconstructed.Ameasureisdefined
thatreflectsthedegreeofbalanceachievedforpairsthatinvolvethenewcolumn.The
algorithmattemptstominimizethismeasurebyinterchanginglevelswithinthenewcolumn.
Related Options
Youcancontrolcertainaspectsofthealgorithmusingoptionsintheredtrianglemenu:
Number of Starts Specifythemaximumnumberoftimesthatthealgorithmregenerates

entiredesignsfromscratch,attemptingtooptimizetheoveralldesign.
Design Search Time Specifythemaximumnumberofsecondsspentsearchingforadesign.

Thedefaultsearchtimeis15seconds.YoucansetapreferenceforDesignSearchTime(File
> Preferences > Platforms > DOE).

TheprogressbardisplaysChi2Efficiency.SeeChi2Efficiencyonpage 253.
Number of Column Starts Specifythemaximumnumberoftimesthatthealgorithmattempts

tooptimizeagivencolumnbeforemovingontoconstructingthenextcolumn.Thedefault
numberofcolumnstartsis50.
Chi2 Efficiency
Supposethatadesignhasnrunsandpfactorscorrespondingtothecolumnsofthedesign
matrix.

Denotethelevelsoffactorskandlby a = 0 1 s k 1 and b = 0 1 s l 1 ,respectively.

Denotethenumberoftimesthatthecombinationoflevels(a,b)appearsincolumnskandl
by n kl a b .

Ameasureofthelackoforthogonalityevidencedbycolumnskandlisgivenbythefollowing:
2

kl =

sk 1 sl 1

a=0 b=0

n kl a b n s k s l
-------------------------------------------------------n sk sl

254

Screening Designs
Creating a Screening Design

Chapter 7
Design of Experiments Guide

Ameasureoftheaveragenonorthogonalityofthedesignisgivenbythisexpression:
2 =

1klp

kl p p 1 2

Themaximumpossiblevalueof2,denoted 2max ,isobtained.TheChi2Efficiencyofadesign


isdefinedasfollows:
Chi2Efficiency = 100 1 2 2max
Chi2Efficiencyindicateshowclose2isto0relativetoadesigninwhichpairsoflevelsshow
extremelackofbalance.

Design Evaluation
FordetailsabouttheDesignEvaluationreport,seeDesignEvaluationonpage 476inthe
EvaluateDesignschapter.

Specify Output Options


UsetheOutputOptionspaneltospecifyhowyouwanttheoutputdatatabletoappear.When
youhavefinished,clickMake Tabletoconstructadatatableforthedesign.Figure 7.22shows
theOutputOptionspanelforastandarddesign.Foramaineffectsscreeningdesign,onlyRun
Orderisavailable.
Figure 7.22SelecttheOutputOptions

Chapter 7
Design of Experiments Guide

Screening Designs
Creating a Screening Design

255

Run Order Letsyoudesignatetheorderyouwanttherunstoappearinthedatatablewhenit

iscreated.Choicesare:
Keep the Same

Therows(runs)intheoutputtableappearastheydointheCoded

Designpanel.
Sort Left to Right
Randomize

Therows(runs)intheoutputtableappearsortedfromlefttoright.

Therows(runs)intheoutputtableappearinarandomorder.

Sort Right to Left

Therows(runs)intheoutputtableappearsortedfromrighttoleft.

Randomize within Blocks Therows(runs)intheoutputtableappearinrandomorder


withintheblocksthatyouspecify.
Number of Center Points Specifieshowmanyadditionalrunstoaddascenterpointstothe

design.Acenterpointisarunwhereeverycontinuousfactorissetatthecenterofthe
factorsrange.ThisoptionisnotavailableifyouselectGenerate orthogonal or near
orthogonal designs for main effects only.
Supposethatyourdesignincludesbothcontinuousandcategoricalfactors.Ifyourequest
centerpointsintheOutputOptionspanel,thecenterpointsaredistributedasfollows.The
settingsforthecategoricalfactorsareorderedusingthevalueorderingspecifiedinthe
Factorsoutline.Onecenterpointisassignedtoeachcombinationofthesettingsofthe
categoricalfactorsinorder,andthisisrepeated,untilallcenterpointsareassigned.
Number of Replicates FordesignsfromtheDesignList,specifiesthenumberoftimesto

replicatetheentiredesign,includingcenterpoints.Enterthenumberoftimesyouwantto
replicatethedesignintheassociatedtextbox.Onereplicatedoublesthenumberofruns.
ThisoptionisnotavailableifyouselectGenerate orthogonal or near orthogonal designs for
main effects only.
Note: IfyourequestCenterPointsorReplicatesandclickMakeTablerepeatedly,theseactions
areappliedtothemostrecentlyconstructeddesigntable.

View the Design Table


ClickMake Table tocreateadatatablethatcontainstherunsforyourexperiment.Inthetable,
thehighandlowvaluesthatyouspecifiedaredisplayedforeachrun.

256

Screening Designs
Creating a Plackett-Burman Design

Chapter 7
Design of Experiments Guide

Figure 7.23TheDesignDataTable

Thenameofthetableisthedesigntypethatgeneratedit.RuntheScreeningscripttoscreen
foractiveeffects.ThecolumncalledPatternshowsthepatternoflowvaluesdenotedand
highvaluesdenoted+.Patternisespeciallyusefulasalabelvariableinplots.

Creating a Plackett-Burman Design


Thepreviousexampleshowsan8runfractionalfactorialdesignforfivecontinuousfactors.
Butsupposeyoucanafford4additionalruns.First,repeatthestepsshownintheprevious
sections.Thistime,usetheLoadResponsesandLoadFactorscommandstodefinethedesign,
asfollows:
1. SelectDOE > Screening Design.
2. SelectLoad ResponsesfromtheredtrianglemenuontheScreeningDesigntitlebar.
NavigatetotheDesignExperimentfolderintheSampleDatainstalledwithJMPandopen
thefilecalledReactor Response.jmp.
3. Next,selectLoad FactorsfromredtrianglemenuontheScreeningDesigntitlebar.
NavigatetotheDesignExperimentfolderintheSampleDatainstalledwithJMPandopen
thefilecalledReactor Factors.jmp.
ThesetwocommandscompletetheDOEscreeningdialogforyou,withthecorrect
responseandfactornames,goalandlimitsfortheresponse,andthevaluesforthefactors.
4. ClickContinueonthecompletedScreeningdesigndialog.IntheChooseScreeningType
panel,clickContinueagaintoseethelistofdesignsinFigure 7.24.Selectthe
Plackett-Burmandesign,asshown.

Chapter 7
Design of Experiments Guide

Screening Designs
Creating a Plackett-Burman Design

257

Figure 7.24DesignListfor5FactorPlackettBurmanScreeningDesign

5. ClickContinue.
AfteryouselectthedesignfromtheDesignlist,theDisplayandModifyDesignand
DesignEvaluationoutlinesappear.IntheCustomdesigner,youhavetheabilitytoform
anymodeleffectsthatyouwant.TheScreeningdesignercreatesthedesigneffectsbased
onthedesignthatyouchoose.Inparticular,thefullfactorialwithalltwofactor
interactionshasnoaliasingoftheincludedinteractions.
AcompletediscussionoftheDesignEvaluationoptionsisintheEvaluateDesigns
chapteronpage 461.
Tocontinuewiththisexample,dothefollowing:
6. ChooseSort Left to RightintheOutputOptionspanel.
7. ClickMake TabletoseethedesignrunsshowninFigure 7.25.
ExaminethedatatableandnotethePatternvariabletoseethearrangementofplusandminus
signsthatdefinetheruns.Thistableisusedintheanalysissectionsthatfollow.

258

Screening Designs
Creating a Main Effects Screening Design

Chapter 7
Design of Experiments Guide

Figure 7.25Listingofa5FactorPlacketBurmanDesignTable

Creating a Main Effects Screening Design


Maineffectsscreeningdesignsareorthogonalornearorthogonaldesigns.Thesedesignsare
offeredbothinplaceofstandarddesignsandinsituationswherestandarddesignsdonot
exist.Maineffectsscreeningdesignsareexcellentdesignsforestimatingmaineffectswhen
interactionsarenegligible.
Thisexampleillustratesmaineffectsscreeningdesigns.Forthisexperimentalsituation,no
standarddesignexists.Youneedadesigntostudy13factors:2arecategorical,onewith4
levelsandonewith6levels,and11arecontinuous.
SelectDOE > Screening Designfromthemainmenu.IntheResponsespanel,thereisasingle
defaultresponsecalledY.DothefollowingintheFactorspanel:
1. Select4 LevelfromtheCategoricallist.ThisaddsthevariableX1withlevelsL1,L2,L3,
andL4.
2. Select6 LevelfromtheCategoricallist.ThisaddsthevariableX2,withlevelsL1,L2,L3,L4,
L5,andL6.
3. Enter11intheboxtotherightofAdd N Factors.
4. ClickContinuous.Thisadds11factors,X3toX13,eachattwolevels,1and1.
WhenyouclickContinue,theDesignGenerationpanelappears(Figure 7.26).Notethatthe
optionofselectingadesignfromtheDesignListdoesnotappear,asthereisnoavailable
standarddesignforthisexperimentalsituation.

Chapter 7
Design of Experiments Guide

Screening Designs
Creating a Main Effects Screening Design

259

Figure 7.26ScreeningDesignDialogfor13Factors,withDesignGenerationPanel

TheBackbuttongivesyoutheoptiontoreturntotheResponsesandFactorspanels.Accept
thedefaultnumberofruns(24)andclickMake Design.
TherandomizeddesignisshownaspartoftheScreeningDesignreport.Thealgorithmthat
generatesthedesignisstochastic,sotoreproducethisdesign,youneedtosavethescriptwith
therandomseed.(Todothis,selectSave Script to Script Windowfromtheredtrianglemenu
nexttothereporttitle.)
Toseethatthisspecificdesignisorthogonal,clickthedisclosureiconnexttoDesign
Evaluation.Next,clickthedisclosureiconnexttoColor Map On Correlations.Thecolormap
(Figure 7.27)showsredentriescorrespondingtocorrelationofoneonthemaindiagonal.
Offdiagonalcorrelationsarealldeepblue,indicatingthatcorrelationsbetweenthe
parametersareallzero.
Figure 7.27ColorMaponCorrelations

260

Screening Designs
Creating a Main Effects Screening Design

Chapter 7
Design of Experiments Guide

Chapter 8
The Screening Platform
Analyze Data from Screening Experiments
TheScreeningplatformisamodelingplatformthatyoucanusetoanalyzeexperimentaldata
thatresultsfromascreeningdesign.TheScreeningplatformhelpsyouselectamodelby
identifyingeffectsthathavealargeimpactontheresponse.
TheScreeningplatformisbasedontheprincipleofeffectsparsity(BoxandMeyer,1986).This
principleassertsthatrelativelyfewoftheeffectsthatyoustudyinascreeningdesignare
active.Mostareinactive,meaningthattheirtrueeffectsarezeroandthattheirestimatesare
randomerror.
Ascreeningdesignoftenprovidesnodegreesoffreedomforerror.Consequently,classical
testsforeffectsarenotavailable.Insuchcases,theScreeningplatformisparticularlyuseful.
Figure 8.1HalfNormalPlotfromScreeningReport

Contents
OverviewoftheScreeningPlatform ............................................... 263
AnExampleComparingScreeningandFitModel ................................... 263
LaunchtheScreeningPlatform .................................................... 266
TheScreeningReport............................................................ 267
Contrasts.................................................................... 267
HalfNormalPlot ............................................................. 268
UsingtheFitModelPlatform .................................................. 269
AdditionalScreeningAnalysisExamples ........................................... 270
AnalyzingaPlackettBurmanDesign ........................................... 271
AnalyzingaSupersaturatedDesign............................................. 272
TechnicalDetails................................................................ 274
OrderofEffectEntry.......................................................... 274
ScreeningasanOrthogonalRotation............................................ 274
LenthsPseudoStandardError ................................................. 275

Chapter 8
Design of Experiments Guide

The Screening Platform


Overview of the Screening Platform

263

Overview of the Screening Platform


Theanalysisofscreeningdesignsdependsoneffectsparsity,wheremosteffectsareassumedto
beinactive.Usingthisassumption,effectswithsmallestimatescanhelpestimatetheerrorin
themodelanddeterminewhetherthelargereffectsareactive.Basically,ifalltheeffectsare
inactive,theyshouldvaryrandomly,withnoeffectdeviatingsubstantiallyfromtheother
effects.
DatafromascreeningexperimentcanbeanalyzedusingFitModel(Analyze > Fit Model)or
Screening(Analyze > Modeling > Screening).UsetheScreeningplatformtoanalyzedatafrom
screeningexperimentsInaccordancewiththefollowingguidelines:

Ifyourfactorsarealltwolevelandorthogonal,thenallofthestatisticsintheScreening
platformareappropriate.

Forhighlysupersaturatedmaineffectdesigns,theScreeningplatformiseffectivein
selectingfactors,butisnotaseffectiveatestimatingtheerrororthesignificance.The
MonteCarlosimulationtoproducepvaluesusesassumptionsthatarenotvalidforthis
case.

Ifyouhaveacategoricaloradiscretenumericfactorwithmorethantwolevels,thenthe
Screeningplatformisnotanappropriatewaytoanalyzethedata.JMPtreatsthe
associatedmodeltermsascontinuous.Thevariationforthefactorisscatteredacrossmain
andpolynomialeffectsforthatterm.

Ifyourdataarenotorthogonal,thentheconstructedestimatesaredifferentfromstandard
regressionestimates.JMPcanpickoutbigeffects,butitdoesnoteffectivelytesteach
effect.Thisisbecauselatereffectsareartificiallyorthogonalized,makingearliereffects
lookmoresignificant.

TheScreeningplatformisnotappropriateformixturedesigns.

An Example Comparing Screening and Fit Model


ConsidertheHalf Reactor.jmpsampledatatable.Thedataarederivedfromadesigndiscussed
inBox,Hunter,andHunter(1978).Youareinterestedinamodelwithmaineffectsand
twowayinteractions.Thisexampleusesamodelwithfifteenparametersforadesignwith
sixteenruns.
Forthisexample,selectallcontinuousfactors,excepttheresponse,Percent Reacted, asthe
screeningeffects,X.SelectPercent ReactedastheresponseY.Thescreeningplatform
constructsinteractionsautomatically.ThisisincontrasttoFitModel,whereyoumanually
specifytheinteractionsthatyouwanttoincludeinyourmodel.

264

The Screening Platform


An Example Comparing Screening and Fit Model

Chapter 8
Design of Experiments Guide

Figure 8.2showstheresultofusingtheFitModelplatform,whereafactorialtodegree2
modelisspecified.Sincetherearenotenoughobservationstoestimateanerrorterm,itisnot
possibletoconductstandardtests.
Figure 8.2TraditionalSaturatedHalf Reactor.jmpDesignOutput

JMPcancalculateparameterestimates,butdegreesoffreedomforerror,standarderrors,
tratios,andpvaluesareallmissing.RatherthanuseFitModel,youcanusetheScreening
platform,whichspecializesingettingthemostinformationoutofthesesituations,leadingto
abettermodel.ThereportfromtheScreeningplatformforthesamedataisshownin
Figure 8.3.

Chapter 8
Design of Experiments Guide

The Screening Platform


An Example Comparing Screening and Fit Model

265

Figure 8.3Half Reactor.jmpScreeningDesignReport

NotethefollowingfeaturesoftheScreeningreport:

EstimateslabeledContrast.Effectswhoseindividualpvalueislessthan0.10are
highlighted.

AtratioiscalculatedusingLenthsPSE(pseudostandarderror).TheLenthPSEisshown
belowtheHalfNormalPlot.

Bothindividualandsimultaneouspvaluesareshown.Thosethatarelessthan0.05are
shownwithanasterisk.

TheHalfNormalPlotenablesyoutoquicklyexaminetheeffects.Effectsinitially
highlightedintheeffectslistarealsolabeledinthisplot.

YoucanhighlighteffectsbyclickingonthemintheContrastsoutline.

TheMake ModelbuttonopenstheFitModelwindowandpopulatesitwiththeselected
effects.TheRun Modelbuttonrunsthemodelbasedontheselectedeffects.

266

The Screening Platform


Launch the Screening Platform

Chapter 8
Design of Experiments Guide

Forthisexample,Catalyst,Temperature,andConcentration,alongwithtwooftheirtwofactor
interactions,areselected.

Launch the Screening Platform


OpenthedatatablecalledPlackett-Burman.jmp,foundinDesignExperimentfolderinthe
SampleDatainstalledwithJMP.ThistablecontainsthedesignrunsandthePercent Reacted
experimentalresultsforthe12runPlackettburmandesigncreatedintheprevioussection.
ThedatatablehastwoscriptscalledScreeningandModel,showingintheupperleftcornerof
thetable,thatwerecreatedbytheDOEScreeningdesigner.Youcanusethesescriptsto
analyzethedata,howeveritissimpletoruntheanalysesyourself.
1. SelectHelp > Sample Data Library andopenDesign Experiment/Plackett-Burman.jmp.
2. SelectAnalyze>Modeling > Screening.
Thepopulatedlaunchwindowappears.WhenyouusetheScreeningDesignplatformto
createadesign,aScreeningscriptissavedtothedesigntable.ThisallowsJMPtopopulate
thescreeninglaunchwindow.
Figure 8.4LaunchDialogfortheScreeningPlatform

3. ClickOK.
TheScreeningreport,showninFigure 8.5,appears.

Chapter 8
Design of Experiments Guide

The Screening Platform


The Screening Report

267

Figure 8.5ScreeningReport

Ifalleffectsareinactive,theirestimatesarerandomnormalnoise.Theirestimates
(contrasts)shouldfallclosetothelineshownintheHalfNormalplotinFigure 8.5.Effects
thatfallfarfromthelinearelikelynotnoise,andsomayrepresentactiveeffects.Notethat
effectswithIndividualpValuesthatfallbelow0.10arehighlightedintheContrasts
outline.TheseeffectsarelabeledintheHalfNormalPlotandthentendtofallfarfromthe
line.

The Screening Report


TheScreeningreporthastwoparts:TheContrastsoutlineandtheHalfNormalPlotoutline.

Contrasts
TheContrastsoutlinelistsmodeleffects,acontrastvalueforeacheffect,Lenthtratios
(calculatedasthecontrastvaluedividedbytheLenthPSE(pseudostandarderror),individual
andsimultaneouspvalues,andaliasesifthereareany.Effectsareenteredintotheanalysis

268

The Screening Platform


The Screening Report

Chapter 8
Design of Experiments Guide

followingahierarchicalordering.SeeOrderofEffectEntryonpage 274fordetails.Effects
withIndividualpValuelessthan0.10arehighlighted.
Table 8.1DescriptionoftheContrastsReport
Term

Nameofthefactor.

Contrast

Estimateforthefactor.Fororthogonaldesigns,thisnumberisthe
sameastheregressionparameterestimate.Thisisnotthecasefor
nonorthogonaldesigns.Anasteriskmightappearnexttothe
contrast,indicatingalackoforthogonality.

BarChart

ShowstheLenthtratioswithblueverticallinesindicatingavalue
thatissignificantatthe0.10level.

LenthtRatio

Lenthstratio,calculatedas Contrast PSE ,wherePSEisLenths


PseudoStandardError.SeeLenthsPseudoStandardErroron
page 275fordetails.

IndividualpValue

Analogoustothestandardpvaluesforalinearmodel.Small
valuesofthisvalueindicateasignificanteffect.RefertoLenths
PseudoStandardErroronpage 275fordetails.
Donotexpectthepvaluestobeexactlythesameiftheanalysisis
rerun.TheMonteCarlomethodshouldgivesimilar,butnot
identical,valuesifthesameanalysisisrepeated.

Simultaneous
pValue

Similartotheindividualpvalue,butmultiplecomparison
adjusted.

Aliases

Appearsonlyifthereareexactaliasesoflatereffectstoearlier
effects.

Half Normal Plot


TheHalfNormalPlotshowstheabsolutevalueofthecontrastsplottedagainsttheabsolute
valueofquantilesforthehalfnormaldistribution.Significanteffectsappearseparatedfrom
thelinetowardstheupperrightofthegraph.
TheHalfNormalPlotisinteractive.Selectdifferentmodeleffectsbydraggingarectangle
aroundtheeffectsofinterest,orholddownCTRLandclickonaneffectnameinthereport.

Chapter 8
Design of Experiments Guide

The Screening Platform


The Screening Report

269

Using the Fit Model Platform


TheMake ModelbuttonbeneaththeHalfNormalPlotcreatesaFitModeldialogthatincludes
allthehighlightedeffects.
1. OpenthePlackett-Burman.jmpsampledatatable,foundinDesignExperimentfolder.
2. SelectAnalyze>Modeling > Screening.
3. ClickOK.
4. ClicktheMake ModelButtonbeneaththeHalfNormalPlot.
NotethattheCatalyst*Stir Rateinteractionishighlighted,buttheStir Ratemaineffectis
not.InaccordancewiththeprincipleofEffectHeredity,addtheStir Ratemaineffecttothe
model.SeeEffectHeredityonpage 59intheStartingOutwithDOEchapter.
5. SelectStir RateandclickAddintheFitModelwindow.
6. ClickRun.
The Actual-by-Predicted Plot
TheWholeModelactualbypredictedplot,showninFigure 8.6,appearsatthetopoftheFit
Modelreport.Youseeataglancethatthismodelfitswell.Thebluelinefallsoutsidethe
boundsofthe95%confidencecurves(reddottedlines),whichtellsyouthemodelis
significant.Themodelpvalue(p = 0.0208),R2,andRMSEappearbelowtheplot.TheRMSEis
anestimateofthestandarddeviation,assumingthattheunestimatedeffectsarenegligible.
Figure 8.6AnActualbyPredictedPlot

The Scaled Estimates Report


Toseeascaledestimatesreport,useEffect Screening>Scaled Estimatesfoundinthered
trianglemenuontheResponse Percent Reactedtitlebar.Whentherearequadraticor
polynomialeffects,thecoefficientsandthetestsforthemaremoremeaningfulifeffectsare
scaledandcoded.TheScaledEstimatesreportincludesabarchartoftheindividualeffects

270

The Screening Platform


Additional Screening Analysis Examples

Chapter 8
Design of Experiments Guide

embeddedinatableofparameterestimates.Thelastcolumnofthetablehasthepvaluesfor
eacheffect.
Figure 8.7ExampleofaScaledEstimatesReport

A Power Analysis
TheFitModelreporthasoutlinenodesfortheCatalystandTemperature effects.Toruna
poweranalysisforaneffect,clicktheredtriangleicononitstitlebarandselectPower
Analysis.
ThisexampleshowsapoweranalysisfortheCatalystvariable,usingdefaultvaluefor(0.05),
therootmeansquareerrorandparameterestimateforCatalyst,forasamplesizeof12.The
resultingpoweris0.8926,whichmeansthatinsimilarexperiments,youcanexpectan89%
chanceofdetectingasignificanteffectforCatalyst.
Figure 8.8ExampleofaPowerAnalysis

RefertotheFittingLinearModelsbookfordetails.

Additional Screening Analysis Examples


ThissectionprovidesexamplesofusingtheScreeningplatform.

Chapter 8
Design of Experiments Guide

The Screening Platform


Additional Screening Analysis Examples

271

Analyzing a Plackett-Burman Design


PlackettBurmandesignsareanalternativetofractionalfactorialscreeningdesigns.Twolevel
fractionalfactorialdesignsmust,bytheirnature,haveanumberofrunsthatareapowerof
two.PlackettBurmandesignsexistfor12,24,and28rundesigns.
Weld-Repaired Castings.jmpfromthesample datafolderusesaPlackettBurmandesign,andis

foundintextbookssuchasGiesbrechtandGumpertz(2004)andBox,Hunter,andHunter
(1978).Sevenfactorsarethoughttobeinfluentialonweldquality.Thesevenfactorsinclude
Initial Structure,Bead Size,Pressure Treatment,Heat Treatment,Cooling Rate,Polish,andFinal
Treatment.APlackettBurmandesignwith12runsisusedtoinvestigatetheimportanceofthe
sevenfactors.Theresponseis 100 log lifetime .(Therearealsofourtermsthatwereusedto
modelerrorthatarenotusedinthisanalysis.)
UsingtheScreeningplatform,selecttheseveneffectsasXandLog LifeasY.(Iftermsare
automaticallypopulatedintheScreeningPlatformlaunchwindow,removethefourerror
termslistedaseffects.)ClickOK.Figure 8.9appears,showingonlyasinglesignificanteffect.
Figure 8.9ScreeningReportforWeld-Repaired Castings.jmp

272

The Screening Platform


Additional Screening Analysis Examples

Chapter 8
Design of Experiments Guide

Noteasterisksmarkfourterms,indicatingthattheyarenotorthogonaltoeffectspreceding
them,andtheobtainedcontrastvaluewasafterorthogonalization.So,theywouldnotmatch
correspondingregressionestimates.

Analyzing a Supersaturated Design


Supersaturateddesignshavemorefactorsthanruns.Theobjectiveistodeterminewhich
effectsareactive.Theyrelyheavilyoneffectsparsityfortheiranalysis,sotheScreening
platformisidealfortheiranalysis.
Asanexample,lookatSupersaturated.jmp,fromthesample datafolder,asimulateddataset
with18factorsbutonly12runs.Yisgeneratedby
Y = 2 X7 + 5 X10 3 X15 +

where~N(0,1).So,Yhasbeenconstructedwiththreeactivefactors.
Todetecttheactivefactors,runtheScreeningplatformwithX1X18asXandYasY.The
reportshowninFigure 8.10appears.

Chapter 8
Design of Experiments Guide

The Screening Platform


Additional Screening Analysis Examples

273

Figure 8.10ScreeningReportforSupersaturated.jmp

Notethatthethreeactivefactorshavebeenhighlighted.Oneotherfactor,X18,hasalsobeen
highlighted.ItshowsintheHalfNormalplotclosetotheblueline,indicatingthatitiscloseto
the0.1cutoffsignificancevalue.The0.1criticalvalueisgenerousinitsselectionoffactorsso
youdontmissthosethatarepossiblyactive.
Thecontrastsof5.1,3,and1.8areclosetotheirsimulatedvalues(5,3,2).However,the
similarityofthesevaluescanbeincreasedbyusingaregressionmodel,withouttheeffectof
orthogonalization.
Thepvalues,whileuseful,arenotentirelyvalidstatistically,sincetheyarebasedona
simulationthatassumesorthogonaldesigns,whichisnotthecaseforsupersaturateddesigns.

274

The Screening Platform


Technical Details

Chapter 8
Design of Experiments Guide

Technical Details
Order of Effect Entry
TheScreeningplatformhasacarefullydefinedorderofoperations.

First,themaineffecttermsenteraccordingtotheabsolutesizeoftheircontrast.Alleffects
areorthogonalizedtotheeffectsprecedingtheminthemodel.Themethodassuresthat
theirorderisthesameasitwouldbeinaforwardstepwiseregression.Orderingbymain
effectsalsohelpsinselectingpreferredaliasedtermslaterintheprocess.

Aftermaineffects,allsecondorderinteractionsarebroughtin,followedbythirdorder
interactions,andsoon.Thesecondorderinteractionscrosswithallearliertermsbefore
bringinginanewterm.Forexample,withsizeorderedmaineffectsA,B,C,andD,B*C
entersbeforeA*D.Ifafactorhasmorethantwolevels,squareandhigherorder
polynomialtermsarealsoconsidered.

Aneffectthatisanexactaliasforaneffectalreadyinthemodelshowsinthealiascolumn.
Effectsthatarealinearcombinationofseveralpreviouseffectsarenotdisplayed.Ifthere
ispartialaliasing(alackoforthogonality)theeffectsinvolvedaremarkedwithanasterisk.

Theprocesscontinuesuntilneffectsareobtained,wherenisthenumberofrowsinthe
datatable,thusfullysaturatingthemodel.Ifcompletesaturationisnotpossiblewiththe
factors,JMPgeneratesrandomorthogonalizedeffectstoabsorbtherestofthevariation.
TheyarelabeledNull nwherenisanumber.Forexample,thissituationoccursifthereare
exactreplicaterowsinthedesign.

Screening as an Orthogonal Rotation


Mathematically,theScreeningplatformtakesthenvaluesintheresponsevectorandrotates
themintonnewvalues.Therotatedvaluesarethenmappedbythespaceofthefactorsand
theirinteractions.
Contrasts=TResponses
whereTisanorthonormalizedsetofvaluesstartingwiththeintercept,maineffectsoffactors,
twowayinteractions,threewayinteractions,andsoon,untilnvalueshavebeenobtained.
SincethefirstcolumnofTisanintercept,andalltheothercolumnsareorthogonaltoit,these
othercolumnsareallcontrasts,thatis,theysumtozero.SinceTisorthogonal,itcanserveas
Xinalinearmodel.Itdoesnotneedinversion,sinceTisalsoT1and(TT)T.Thecontrasts
aretheparametersestimatedinalinearmodel.

Ifnoeffectinthemodelisactiveaftertheintercept,thecontrastsarejustanorthogonal
rotationofrandomindependentvariatesintodifferentrandomindependentvariates.
Thesenewlyorthogonallyrotatedvariateshavethesamevarianceastheoriginalrandom
independentvariates.Totheextentthatsomeeffectsareactive,theinactiveeffectsstill

Chapter 8
Design of Experiments Guide

The Screening Platform


Technical Details

275

representthesamevariationastheerrorinthemodel.Thehopeisthattheeffectsandthe
designarestrongenoughtoseparatetheactiveeffectsfromtherandomerroreffects.

Lenths Pseudo-Standard Error


Atthispoint,Lenthsmethod(Lenth,1989)identifiesinactiveeffectsfromwhichitconstructs
anestimateoftheresidualstandarderror,knownastheLenthPseudoStandardError(PSE).
ThevalueforLenthsPSEisshownatthebottomoftheScreeningreport.FromthePSE,
tratiosareobtained.Togeneratepvalues,aMonteCarlosimulationof10,000runsofn1
purelyrandomvaluesiscreatedandLenthtratiosareproducedfromeachset.Thepvalueis
theinterpolatedfractionalpositionamongthesevaluesindescendingorder.The
simultaneouspvalueistheinterpolationalongthemax(|t|)ofthen1valuesacrossthe
runs.ThistechniqueissimilartothatinYeandHamada(2000).
Ifyouwanttorunmoreorlessthanthe10,000defaultruns,youmustassignavaluetoa
globalJSLvariablenamedLenthSimN.Asanexample,usingthesampledataHalf Reactor.jmp:
1. OpenthesampledataHalf Reactor.jmp.
2. SelectAnalyze > Modeling > Screening.
3. SelectPercent Reactedastheresponsevariable,Y.
4. Selectalltheothercontinuousvariablesaseffects,X.
5. ClickOK.
6. SelectScript > Save Script to Script Windowfromtheredtrianglemenuofthereport.
7. AddLenthSimN=50000;tothetopoftheScriptWindow(abovethecode).
8. HighlightLenthSimN=50000;andtheremainingcode.
9. RunthescriptfromtheScriptWindow.
NotethatifLenthSimN=0,thestandardtdistributionisused(notrecommended).

276

The Screening Platform


Technical Details

Chapter 8
Design of Experiments Guide

Chapter 9
Response Surface Designs
Responsesurfacedesignsareusefulformodelingacurvedquadraticsurfacetocontinuous
factors.Aresponsesurfacemodelcanpinpointaminimumormaximumresponse,ifone
existsinsidethefactorregion.Threedistinctvaluesforeachfactorarenecessarytofita
quadraticfunction,sothestandardtwoleveldesignscannotfitcurvedsurfaces.
Themostpopularresponsesurfacedesignisthecentralcompositedesign,illustratedinthe
figuretotheleftbelow.Itcombinesatwolevelfractionalfactorialandtwootherkindsof
points:

Centerpoints,forwhichallthefactorvaluesareatthezero(ormidrange)value.

Axial(orstar)points,forwhichallbutonefactoraresetatzero(midrange)andthatone
factorissetatouter(axial)values.

TheBoxBehnkendesign,illustratedinthefigureontherightbelow,isanalternativeto
centralcompositedesigns.OnedistinguishingfeatureoftheBoxBehnkendesignisthatthere
areonlythreelevelsperfactor.
AnotherimportantdifferencebetweenthetwodesigntypesisthattheBoxBehnkendesign
hasnopointsattheverticesofthecubedefinedbytherangesofthefactors.Thisissometimes
usefulwhenitisdesirabletoavoidthesepointsduetoengineeringconsiderations.Theprice
ofthischaracteristicisthehigheruncertaintyofpredictionneartheverticescomparedtothe
centralcompositedesign.
Figure 9.1ResponseSurfaceDesigns
Central Composite Design

Box-Behnken Design
fractional factorial points

axial points

center points

Contents
ABoxBehnkenDesign:TheTennisBallExample .................................... 279
ThePredictionProfiler ........................................................ 282
AResponseSurfacePlot(ContourProfiler)...................................... 284
GeometryofaBoxBehnkenDesign............................................. 286
CreatingaResponseSurfaceDesign ............................................... 286
EnterResponsesandFactors ................................................... 287
ChooseaDesign ............................................................. 287
SpecifyOutputOptions....................................................... 289
ViewtheDesignTable ........................................................ 290

Chapter 9
Design of Experiments Guide

Response Surface Designs


A Box-Behnken Design: The Tennis Ball Example

279

A Box-Behnken Design: The Tennis Ball Example


TheBounce Data.jmpsampledatafilehasresponsesurfacedatainspiredbythetiretreaddata
describedinDerringerandSuich(1980).Theobjectiveofthisexperimentistomatcha
standardizedtargetvalue(450)oftennisballbounciness.Thebouncinessvarieswithamounts
ofSilica,Silane,andSulfurusedtomanufacturethetennisballs.Theexperimenterwantsto
collectdataoverawiderangeofvaluesforthesevariablestoseeifaresponsesurfacecanfind
acombinationoffactorsthatmatchesaspecifiedbouncetarget.Tofollowthisexample:
1. Select DOE > Response Surface Design.
2. LoadfactorsbyclickingtheredtriangleiconontheResponseSurfaceDesigntitlebarand
selectingLoad Factors.NavigatetothesampledatafolderinstalledwithJMP,andopen
Bounce Factors.jmpfromtheDesign Experimentfolder.
3. LoadtheresponsesbyclickingtheredtriangleiconontheResponseSurfaceDesigntitle
barandselectingLoad Responses.Navigatetothesampledatafolder,andopenBounce
Response.jmp fromtheDesign Experimentfolder.Figure 9.2showsthecompleted
ResponsepanelandFactorspanel.
Figure 9.2ResponseandFactorsForBounceData

Aftertheresponsedataandfactorsdataareloaded,theResponseSurfaceDesignChoice
dialogliststhedesignsinFigure 9.3.(ClickContinuetoseethechoicesontheright.)

280

Response Surface Designs


A Box-Behnken Design: The Tennis Ball Example

Chapter 9
Design of Experiments Guide

Figure 9.3ResponseSurfaceDesignSelection

TheBoxBehnkendesignselectedforthreeeffectsgeneratesthedesigntableof15runsshown
inFigure 9.4.
Inreallife,youwouldconducttheexperimentandthenentertheresponsesintothedata
table.SupposeyoucompletedtheexperimentandthefinaldatatableisBounce Data.jmp.
1. OpenBounce Data.jmpfromtheDesign Experiment folderfoundinthesampledata
installedwithJMP(Figure 9.4).
Figure 9.4JMPTableforaThreeFactorBoxBehnkenDesign

AfteropeningtheBounce Data.jmpdatatable,runafitmodelanalysisonthedata.Thedata
tablecontainsascriptlabeledModel,showingintheupperleftpanelofthetable.
2. ClicktheredtrianglenexttoModelandselectRun Scripttostartafitmodelanalysis.
3. WhentheFitModeldialogappears,clickRun.
ThestandardFitModelanalysisresultsappearintablesshowninFigure 9.5,withparameter
estimatesforallresponsesurfaceandcrossedeffectsinthemodel.
Thepredictionmodelishighlysignificantwithnoevidenceoflackoffit.Allmaineffectterms
aresignificantaswellasthetwointeractioneffectsinvolvingSulfur.

Chapter 9
Design of Experiments Guide

Response Surface Designs


A Box-Behnken Design: The Tennis Ball Example

281

Figure 9.5JMPStatisticalReportsforaResponseSurfaceAnalysisofBounceData

SeetheFittingLinearModelsbookformoreinformationaboutinterpretationofthetablesin
Figure 9.5.
Note: DOEresponsesurfacedesignsareavailableforuptoeightfactorsonly.IntheDOE
ResponseSurfaceDesignplatform,anerrormessageisgeneratedifmorethaneightfactors
arespecifiedwitharesponsesurfacedesign.Responsesurfacedesignswithmorethaneight
factorscanbegeneratedusingDOE > Custom Design,whereeitheraDoptimaloran
Ioptimaldesigncanbespecified.ForexamplesofusingCustomDesigntocreateresponse
surfacedesigns,seeResponseSurfaceExperimentsonpage 150intheExamplesofCustom
Designschapter.Curvatureanalysisisnotshown(noerrororwarningmessageisgiven)for
responsesurfacedesignsofmorethan20factorswhenusingCustomDesignortheFitModel
platform.
TheResponseSurfacereportalsohasthetablesshowninFigure 9.6.

282

Response Surface Designs


A Box-Behnken Design: The Tennis Ball Example

Chapter 9
Design of Experiments Guide

Figure 9.6StatisticalReportsforaResponseSurfaceAnalysis

TheResponseSurfacereportshowsasummaryoftheparameterestimates.
TheSolutionreportliststhecriticalvaluesofthesurfacefactorsandtellsthekindofsolution
(maximum,minimum,orsaddlepoint).Thesolutionforthisexampleisasaddlepoint.The
tablealsowarnsthatthecriticalvaluesgivenbythesolutionareoutsidetherangeofdata
values.
TheCanonicalCurvaturereportshowseigenvaluesandeigenvectorsoftheeffects.The
eigenvectorvaluesshowthatthedominantnegativecurvature(yieldingamaximum)is
mostlyintheSulfurdirection.Thedominantpositivecurvature(yieldingaminimum)is
mostlyintheSilicadirection.ThisisconfirmedbythepredictionprofilerinFigure 9.8.
SeetheFittingLinearModelsbookfordetailsabouttheresponsesurfaceanalysistablesin
Figure 9.6.

The Prediction Profiler


Next,usetheresponsePredictionProfilertogetacloserlookattheresponsesurfaceandhelp
findthesettingsthatproducethebestresponsetarget.ThePredictionProfilerisawayto
interactivelychangevariablesandlookattheeffectsonthepredictedresponse.
1. IfthePredictionProfilerisnotalreadyopen,clicktheredtriangleontheResponseStretch
titlebarandselectFactor Profiling > Profiler.
ThefirstthreeplotsinthetoprowofplotsinthePredictionProfiler(Figure 9.7)display
predictiontracesforeachxvariable.Apredictiontraceisthepredictedresponseasonevariable
ischangedwhiletheothersareheldconstantatthecurrentvalues(Jones1991).

Chapter 9
Design of Experiments Guide

Response Surface Designs


A Box-Behnken Design: The Tennis Ball Example

283

ThecurrentpredictedvalueofStretch,396,isbasedonthedefaultfactorsetting.Itis
representedbythehorizontaldottedlinethatshowsslightlybelowthedesirabilityfunction
targetvalue(Figure 9.7).TheprofilershowsdesirabilitysettingsforthefactorsSilica,Silane,
andSulfurthatgiveavalueforStretchof396,whichisquitedifferentfromthespecifiedtarget
of450.
Thebottomrowhasaplotforeachfactor,showingitsdesirabilitytrace.Theprofileralso
containsaDesirabilitycolumn,whichgraphsdesirabilityonascalefrom0to1andhasan
adjustabledesirabilityfunctionforeachyvariable.Theoveralldesirabilitymeasureisonthe
leftofthedesirabilitytraces.
Figure 9.7ThePredictionProfiler

2. ToadjustthepredictiontracesofthefactorsandfindaStretchvaluethatisclosertothe
target,clicktheredtriangleonthePredictionProfilertitlebarandselectMaximize
Desirability.Thiscommandadjuststheprofiletracestoproducetheresponsevalueclosest
tothespecifiedtarget(thetargetgivenbythedesirabilityfunction).Therangeof
acceptablevaluesisdeterminedbythepositionsoftheupperandlowerhandles.
Figure 9.8showstheresultofthemostdesirablesettings.Findingmaximumdesirabilityisan
iterativeprocesssoyourresultsmaydifferslightlyfromthoseshownbelow.

284

Response Surface Designs


A Box-Behnken Design: The Tennis Ball Example

Chapter 9
Design of Experiments Guide

Figure 9.8PredictionProfilerwithMaximumDesirabilitySetforaResponseSurfaceAnalysis

SeetheProfilersbookforfurtherdiscussionofthePredictionProfiler.

A Response Surface Plot (Contour Profiler)


AnotherwaytolookattheresponsesurfaceistousetheContourProfiler.Clickthered
triangleontheResponseStretchtitlebarandselectFactor Profiling > Contour Profilerto
displaytheinteractivecontourprofiler,asshowninFigure 9.9.
Thecontourprofilerisusefulforviewingresponsesurfacesgraphically,especiallywhenthere
aremultipleresponses.ThisexampleshowstheprofiletoSilicaand Sulfurforafixedvalueof
Silane.
OptionsontheContourProfilertitlebarcanbeusedtosetthegriddensity,requestasurface
plot(meshplot),andaddcontoursatspecifiedintervals,likethoseshowninthecontourplot
inFigure 9.9.TheslidersforeachfactorsetvaluesforCurrentXandCurrentY.

Chapter 9
Design of Experiments Guide

Response Surface Designs


A Box-Behnken Design: The Tennis Ball Example

285

Figure 9.9ContourProfilerforaResponseSurfaceAnalysis

EntertheLolimitandHilimitvaluestoshadetheunacceptableregionsinthecontourplot.
Figure 9.10ContourProfilerwithHighandLowLimits

ThePredictionProfilerandtheContourProfilerarediscussedinmoredetailintheProfilers
book.

286

Response Surface Designs


Creating a Response Surface Design

Chapter 9
Design of Experiments Guide

Geometry of a Box-Behnken Design


ThegeometricstructureofadesignwiththreeeffectsisseenbyusingtheScatterplot3D
platform.TheplotshowninFigure 9.11illustratesthethreeBoxBehnkendesigncolumns.
Youcanclearlyseethecenterpointsandthe12pointsmidwaybetweenthevertices.For
detailsonhowtousetheScatterplot3Dplatform,seetheEssentialGraphingbook.
Figure 9.11Scatterplot3DRenditionofaBoxBehnkenDesignforThreeEffects

Creating a Response Surface Design


ResponseSurfaceMethodology(RSM)isanexperimentaltechniqueinventedtofindthe
optimalresponsewithinspecifiedrangesofthefactors.Thesedesignsarecapableoffittinga
secondorderpredictionequationfortheresponse.Thequadratictermsintheseequations
modelthecurvatureinthetrueresponsefunction.Ifamaximumorminimumexistsinsidethe
factorregion,RSMcanestimateit.Inindustrialapplications,RSMdesignsusuallyinvolvea
smallnumberoffactors.Thisisbecausetherequirednumberofrunsincreasesdramatically
withthenumberoffactors.Usingtheresponsesurfacedesigner,youchoosetouse
wellknownRSMdesignsfortwotoeightcontinuousfactors.Someofthesedesignsalsoallow
blocking.
Responsesurfacedesignsareusefulformodelingandanalyzingcurvedsurfaces.

Chapter 9
Design of Experiments Guide

Response Surface Designs


Creating a Response Surface Design

287

Tostartaresponsesurfacedesign,selectDOE > Response Surface Design,orclickthe


Response Surface Design buttonontheJMPStarterDOEpage.Then,followthesteps
describedinthefollowingsections.

EnterResponsesandFactorsonpage 287

ChooseaDesignonpage 287

SpecifyAxialValue(CentralCompositeDesignsOnly)onpage 288

SpecifyOutputOptionsonpage 289

ViewtheDesignTableonpage 290

Enter Responses and Factors


ThestepsforenteringresponsesareoutlinedinResponsesonpage 83intheCustom
Designschapter.
Factorsinaresponsesurfacedesigncanonlybecontinuous.TheFactorspanelforaresponse
surfacedesignappearswithtwodefaultcontinuousfactors.Toentermorefactors,typethe
numberyouwantintheFactorspaneleditboxandclickAdd,asshowninFigure 9.12.
Figure 9.12EnterFactorsintoaResponseSurfaceDesign

ClickContinuetoproceedtothenextstep.

Choose a Design
HighlightthetypeofresponsesurfacedesignyouwantandclickContinue.Thenextsections
describethetypesofresponsesurfacedesignsshowninFigure 9.13.

288

Response Surface Designs


Creating a Response Surface Design

Chapter 9
Design of Experiments Guide

Figure 9.13ChooseaDesignType

Box-Behnken Designs
TheBoxBehnkendesignhasonlythreelevelsperfactorandhasnopointsattheverticesof
thecubedefinedbytherangesofthefactors.Thisissometimesusefulwhenitisdesirableto
avoidextremepointsduetoengineeringconsiderations.Thepriceofthischaracteristicisthe
higheruncertaintyofpredictionneartheverticescomparedtothecentralcompositedesign.
Central Composite Designs
Theresponsesurfacedesignlistcontainstwotypesofcentralcompositedesigns:uniform
precisionandorthogonal.Thesepropertiesofcentralcompositedesignsrelatetothenumberof
centerpointsinthedesignandtotheaxialvalues:

Uniformprecisionmeansthatthenumberofcenterpointsischosensothattheprediction
variancenearthecenterofthedesignspaceisveryflat.

Fororthogonaldesigns,thenumberofcenterpointsischosensothatthesecondorder
parameterestimatesareminimallycorrelatedwiththeotherparameterestimates.

Specify Axial Value (Central Composite Designs Only)


Whenyouselectacentralcomposite(CCDUniformPrecision)designandthenclick
Continue,youseethepanelinFigure 9.14.Itsuppliesdefaultaxialscalinginformation.
Entering1.0inthetextboxinstructsJMPtoplacetheaxialvalueonthefaceofthecube
definedbythefactors,whichcontrolshowfarouttheaxialpointsare.Youhavetheflexibility
toenterthevaluesyouwanttouse.

Chapter 9
Design of Experiments Guide

Response Surface Designs


Creating a Response Surface Design

289

Figure 9.14DisplayandModifytheCentralCompositeDesign

makesthevarianceofpredictiondependonlyonthescaleddistancefromthe
centerofthedesign.Thiscausestheaxialpointstobemoreextremethantherangeofthe
factor.Ifthisfactorrangecannotbepracticallyachieved,itisrecommendedthatyou
chooseOn Faceorspecifyyourownvalue.

Rotatable

Orthogonal makestheeffectsorthogonalintheanalysis.Thiscausestheaxialpointstobe

moreextremethanthe1or1representingtherangeofthefactor.Ifthisfactorrange
cannotbepracticallyachieved,itisrecommendedthatyouchooseOn Faceorspecifyyour
ownvalue.
On Face leavestheaxialpointsattheendofthe1and1ranges.
User Specified

usesthevalueyouenterintheAxialValuetextbox.

Ifyouwanttoinscribethedesign,clicktheboxbesideInscribe.Whenchecked,JMPrescales
thewholedesignsothattheaxialpointsareatthelowandhighendsoftherange(theaxials
are1and1andthefactorialsareshrunkenbasedonthatscaling).

Specify Output Options


UsetheOutputOptionspaneltospecifyhowyouwanttheoutputdatatabletoappear.When
theoptionsarespecifiedthewayyouwantthem,clickMake Table.Notethattheexample
showninFigure 9.15isforaBoxBehnkendesign.TheBoxBehnkendesignfromthedesign
listandtheOutput Optionsrequest3centerpointsandnoreplicates.
Figure 9.15SelecttheOutputOptions

290

Response Surface Designs


Creating a Response Surface Design

Chapter 9
Design of Experiments Guide

Run Orderprovidesamenuwithoptionsfordesignatingtheorderyouwanttherunsto
appearinthedatatablewhenitiscreated.Menuchoicesare:
Keep the Same therows(runs)intheoutputtablewillappearinthestandardorder.
Sort Left to Right

therows(runs)intheoutputtablewillappearsortedfromlefttoright.

Randomize therows(runs)intheoutputtablewillappearinarandomorder.
Sort Right to Left therows(runs)intheoutputtablewillappearsortedfromrighttoleft.

therows(runs)intheoutputtablewillappearinrandomorder
withintheblocksyousetup.

Randomize within Blocks

AddadditionalpointswithoptionsgivenbyMake JMP Table from design plus:


Number of Center Points Specifieshowmanyadditionalrunstoaddascenterpointstothe

design.Acenterpointisarunthatislocatedinthecenteroftherangeofeachcontinuous
factor.
Number of Replicates Specifythenumberoftimestoreplicatetheentiredesign,including

centerpoints.Typethenumberoftimesyouwanttoreplicatethedesignintheassociated
textbox.Onereplicatedoublesthenumberofruns.

View the Design Table


Nowyouhaveadatatablethatoutlinesyourexperiment,asdescribedinFigure 9.16.
Figure 9.16TheDesignDataTable

Thenameofthetableisthedesigntypethatgeneratedit.
RuntheModelscripttofitamodelusingthevaluesinthedesigntable.

Chapter 9
Design of Experiments Guide

Response Surface Designs


Creating a Response Surface Design

291

ThecolumncalledPatternidentifiesthecodingofthefactors.Itshowsallthecodingswith+
forhigh,forlowfactor,aandAforlowandhighaxialvalues,and0formidrange.
Patternissuitabletouseasalabelvariableinplotsbecausewhenyouhoveroverapointina
plotofthefactors,thepatternvalueshowsthefactorcodingofthepoint.Thethreerows
whosevaluesinthePatterncolumnare000arethreecenterpoints.
TherunsinthePatterncolumnareintheorderyouselectedfromtheRun Ordermenu.
TheYcolumnisforrecordingexperimentalresults.

292

Response Surface Designs


Creating a Response Surface Design

Chapter 9
Design of Experiments Guide

Chapter 10
Full Factorial Designs
Afullfactorialdesigncontainsallpossiblecombinationsofasetoffactors.Thisisthemost
foolproofdesignapproach,butitisalsothemostcostlyinexperimentalresources.Thefull
factorialdesignersupportsbothcontinuousfactorsandcategoricalfactorswithuptonine
levels.
Infullfactorialdesigns,youperformanexperimentalrunateverycombinationofthefactor
levels.Thesamplesizeistheproductofthenumbersoflevelsofthefactors.Forexample,a
factorialexperimentwithatwolevelfactor,athreelevelfactor,andafourlevelfactorhas2x
3x4=24runs.
Factorialdesignswithonlytwolevelfactorshaveasamplesizethatisapoweroftwo
(specifically2fwherefisthenumberoffactors).Whentherearethreefactors,thefactorial
designpointsareattheverticesofacubeasshowninthediagrambelow.Formorefactors,the
designpointsaretheverticesofahypercube.
Fullfactorialdesignsarethemostconservativeofalldesigntypes.Thereislittlescopefor
ambiguitywhenyouarewillingtotryallcombinationsofthefactorsettings.
Unfortunately,thesamplesizegrowsexponentiallyinthenumberoffactors,sofullfactorial
designsaretooexpensivetorunformostpracticalpurposes.
Figure 10.1FullFactorialDesign

Contents
TheFiveFactorReactorExample .................................................. 295
AnalyzetheReactorData...................................................... 296
CreatingaFactorialDesign....................................................... 301
EnterResponsesandFactors ................................................... 301
SelectOutputOptions ........................................................ 302
MaketheTable............................................................... 302

Chapter 10
Design of Experiments Guide

Full Factorial Designs


The Five-Factor Reactor Example

295

The Five-Factor Reactor Example


Thefollowingexample,adaptedfromMeyeretal.(1996)andBox,Hunter,andHunter(1978),
showsafivefactorreactorexample.
InAStandardDesignforFiveContinuousFactorsonpage 237intheScreeningDesigns
chapter,youinvestigatedtheeffectsoffivefactorsonthepercentreactionofachemical
processusingaScreeningDesign.Thefactors(Feed Rate,Catalyst,Stir Rate,Temperature,and
Concentration)arealltwolevelcontinuousfactors.Thenextexamplestudiesthesamesystem
usingafullfactorialdesign.
1. SelectDOE > Full Factorial Design.
2. ClicktheredtriangleiconontheFullFactorialDesigntitlebarandselectLoad Responses.
3. Inthesampledatafolder(installedwithJMP),open Reactor Response.jmpfoundinthe
Design Experimentfolder.
4. ClicktheredtriangleiconontheFullFactorialDesigntitlebarandselectLoad Factors.
5. Inthesampledatafolder(installedwithJMP),openReactor Factors.jmpfoundinthe
Design Experiment folder.
ThecompleteddialogshouldlookliketheoneshowninFigure 10.2.
Figure 10.2FullFactorialExampleResponseandFactorsPanels

296

Full Factorial Designs


The Five-Factor Reactor Example

Chapter 10
Design of Experiments Guide

6. ClickContinuetoseetheOutputOptionspanel.IntheOutputOptionspanel,selectSort
Left to RightfromtheRunOrdermenu,asshowntotheright.Thiscommanddefinesthe
orderofrunsastheywillbeinthefinalJMPdesigntable.

7. ClickMake Table.
Thedesigndatatable(Figure 10.3)containsarunforeverycombinationofhighandlow
valuesforthefivevariables,whichcoversallcombinationsoffivefactorswithtwolevelseach.
Sincetherearefivevariables,thereare25=32runs.Initially,thetablehasanemptyYcolumn
namedPercent Reactedforenteringresponsevalueswhentheexperimentiscomplete.
Toseethecompletedexperimentandcontinuethisexample,openReactor 32 Runs.jmpfound
intheDesign Experiment sampledatafolder.
Figure 10.3PartialListingofReactor32Runs.jmpfromtheSampleDataFolder

Analyze the Reactor Data


Begintheanalysiswithaquicklookattheresponsedatabeforefittingthefactorialmodel.
1. SelectAnalyze > Distribution.
2. HighlightPercent ReactedandclickY, Columns.ThenclickOK.
3. ClicktheredtriangleicononthePercentReactedtitlebarandselectNormal Quantile Plot.
TheresultsareshowninFigure 10.4.

Chapter 10
Design of Experiments Guide

Full Factorial Designs


The Five-Factor Reactor Example

297

Figure 10.4DistributionofResponseVariableforReactorData

Thisinitialanalysisshowssomeexperimentalrunswithaveryhighpercentreactedresponse.
Starttheformalanalysiswithastepwiseregression.Thedatatablehasascriptstoredwithit
thatautomaticallydefinesananalysisofthemodelwithmaineffectsandalltwofactor
interactions.
4. ClicktheredtriangleiconnexttotheFitModelscriptandselectRun Script.Thestepwise
analysisbeginswiththeStepwiseRegressionControlpanelshowninFigure 10.5.
5. SelectP-value ThresholdfromtheStoppingRulelist.
6. Theprobabilitytoenterafactor(ProbtoEnter)inthemodelshouldbe0.05.
7. Theprobabilitytoremoveafactor(ProbtoLeave)shouldbe0.1.
8. AusefulwaytousetheStepwiseplatformistocheckallthemaineffectsintheCurrent
Estimatestable.However,makesurethatthemenubesideDirectionintheStepwise
RegressionControlpanelspecifiesMixed (seeFigure 10.5).
Figure 10.5StepwiseControlPanel

9. ChecktheboxesforthemaineffectsofthefactorsasshowninFigure 10.6.

298

Full Factorial Designs


The Five-Factor Reactor Example

Chapter 10
Design of Experiments Guide

Figure 10.6StartingModelForStepwiseProcess

10. ClickGo.
Themixedstepwiseprocedureremovesinsignificantmaineffectsandaddsimportant
interactions.TheendresultisshowninFigure 10.7.NotethattheFeed RateandStir Rate
factorsarenolongerinthemodel.
Figure 10.7ModelAfterMixedStepwiseRegression

11. ClicktheMake ModelbuttonintheStepwiseRegressionControlpanel.TheModel


Specificationwindowthatappearsisautomaticallysetupwiththeappropriateeffects
(Figure 10.8).

Chapter 10
Design of Experiments Guide

Full Factorial Designs


The Five-Factor Reactor Example

299

Figure 10.8FittingaPredictionModel

12. ClickRuntoseetheanalysisforacandidatepredictionmodel(Figure 10.9).


ThefigureontheleftinFigure 10.9showstheactualbypredictedplotforthemodel.The
predictedmodelcoversarangeofpredictionsfrom40%to95%reacted.Thesizeofthe
randomnoiseasmeasuredbytheRMSEisonly3.3311%,whichismorethananorderof
magnitudesmallerthantherangeofpredictions.Thisisstrongevidencethatthemodelhas
goodpredictivecapability.
ThefigureontherightinFigure 10.9showsatableofmodelcoefficientsandtheirstandard
errors(labeledParameterEstimates).Alleffectsselectedbythestepwiseprocessarehighly
significant.
Figure 10.9ActualbyPredictedPlotandPredictionParameterEstimatesTable

ThefactorPredictionProfileralsogivesyouawaytocomparethefactorsandfindoptimal
settings.

300

Full Factorial Designs


The Five-Factor Reactor Example

Chapter 10
Design of Experiments Guide

1. ToopenthePredictionProfiler,clicktheredtriangleontheResponsePercentReactedtitle
barandselectFactor Profiling > Profiler.
Figure 10.10showstheprofilersinitialdisplay.ThePredictionProfilerisdiscussedin
moredetailinthechapterResponseSurfaceDesignsonpage 277,andintheProfilers
book.
Figure 10.10ViewingtheProfiler

2. ClicktheredtriangleonthePredictionProfilertitlebarandselectMaximize Desirabilityto
seetheprofilerinFigure 10.11.
Figure 10.11ViewingthePredictionProfilesattheOptimumSettings

Chapter 10
Design of Experiments Guide

Full Factorial Designs


Creating a Factorial Design

301

ThegoalistomaximizePercent Reacted.Thereactionisunfeasibleeconomicallyunlessthe
Percent Reactedisabove90%.Percent Reactedincreasesfrom65.5atthecenterofthefactor
rangestoapredictedmaximumof95.8752.96atthemostdesirablesettings.Thebest
settingsofallthreefactorsareattheendsoftheirranges.Futureexperimentscould
investigatewhathappensasyoucontinuemovingfurtherinthisdirection.

Creating a Factorial Design


Tostartafullfactorialdesign,select DOE > Full Factorial Design,orclicktheFull Factorial
DesignbuttonontheJMPStarterDOEpage.Then,followthestepsbelow:

EnterResponsesandFactorsonpage 301

SelectOutputOptionsonpage 302

MaketheTableonpage 302

Enter Responses and Factors


ThestepsforenteringresponsesareoutlinedinResponsesonpage 83intheCustom
Designschapter
Thestepsforenteringfactorsinafullfactorialdesignareuniquetothisdesign.Toaddfactors,
seeFigure 10.12.
1. Toenterfactors,clickeithertheContinuousbuttonortheCategoricalbuttonandselectthe
numberoflevels.
2. Doubleclicktoeditthefactorname.
3. Clicktoentervaluesorchangethelevelnames.
Figure 10.12EnteringFactorsinaFullFactorialDesign
1

Whenyoufinishaddingfactors,clickContinue.

302

Full Factorial Designs


Creating a Factorial Design

Chapter 10
Design of Experiments Guide

Select Output Options


UsetheOutputOptionspaneltospecifyhowyouwanttheoutputdatatabletoappear,as
illustratedinFigure 10.13:
Figure 10.13OutputOptionsPanel

Run Ordergivesoptionstodesignatetheorderyouwanttherunstoappearinthedatatable

whenitiscreated.Choicesare:
Keep the Same therows(runs)intheoutputtablewillappearinthestandardorder.
Sort Left to Right

therows(runs)intheoutputtablewillappearsortedfromlefttoright.

Randomize therows(runs)intheoutputtablewillappearinarandomorder.
Sort Right to Left therows(runs)intheoutputtablewillappearsortedfromrighttoleft.

Addadditionalpointstothedatatablewiththeseoptions:
Number of Center Points Specifieshowmanyadditionalrunstoaddascenterpointstothe

design.Acenterpointisarunthatislocatedinthecenteroftherangeofeachcontinuous
factor.
Number of Replicates Specifythenumberoftimestoreplicatetheentiredesign,including

centerpoints.Typethenumberoftimesyouwanttoreplicatethedesignintheassociated
textbox.Onereplicatedoublesthenumberofruns.

Make the Table


WhenyouclickMake Table,thetableshowninFigure 10.14appears.
Figure 10.14FactorialDesignTable

Chapter 10
Design of Experiments Guide

Full Factorial Designs


Creating a Factorial Design

Thenameofthetableisthedesigntypethatgeneratedit.
RuntheModelscripttofitamodelusingvaluesinthedesigntable.
ValuesinthePatterncolumndescribetheruneachrowrepresents.

Forcontinuousfactors,aplussignrepresentshighlevels.

Forcontinuousfactors,aminussignrepresentslowlevels.

Levelnumbersrepresentvaluesofcategoricalfactors.

303

304

Full Factorial Designs


Creating a Factorial Design

Chapter 10
Design of Experiments Guide

Chapter 11
Mixture Designs
Themixturedesignersupportsexperimentswithfactorsthatareingredientsinamixture.You
canchooseamongseveralclassicalmixturedesignapproaches,suchassimplex,extreme
vertices,andlattice.Fortheextremeverticesapproachyoucansupplyasetoflinear
inequalityconstraintslimitingthegeometryofthemixturefactorspace.
Thepropertiesofamixturearealmostalwaysafunctionoftherelativeproportionsofthe
ingredientsratherthantheirabsoluteamounts.Inexperimentswithmixtures,afactorsvalue
isitsproportioninthemixture,whichfallsbetweenzeroandone.Thesumoftheproportions
inanymixturerecipeisone(100%).
Designsformixtureexperimentsarefundamentallydifferentfromthoseforscreening.
Screeningexperimentsareorthogonal.Thatis,overthecourseofanexperiment,thesettingof
onefactorvariesindependentlyofanyotherfactor.Thus,theinterpretationofscreening
experimentsisrelativelysimple,becausetheeffectsofthefactorsontheresponseare
separable.
Withmixtures,itisimpossibletovaryonefactorindependentlyofalltheothers.Whenyou
changetheproportionofoneingredient,theproportionofoneormoreotheringredientsmust
alsochangetocompensate.Thissimplefacthasaprofoundeffectoneveryaspectof
experimentationwithmixtures:thefactorspace,thedesignproperties,andtheinterpretation
oftheresults.
Becausetheproportionssumtoone,mixturedesignshaveaninterestinggeometry.The
feasibleregionfortheresponseinamixturedesigntakestheformofasimplex.Forexample,
considerthreefactorsina3Dgraph.Theplanewherethesumofthethreefactorssumtoone
isatriangleshapedslice.Youcanrotatetheplanetoseethetrianglefaceonandseethepoints
intheformofaternaryplot.
Figure 11.1MixtureDesign
x3
triangular feasible region
x2

x1

Contents
MixtureDesignTypes............................................................ 307
TheOptimalMixtureDesign...................................................... 308
TheSimplexCentroidDesign ..................................................... 309
CreatingtheDesign .......................................................... 309
SimplexCentroidDesignExamples ............................................. 310
TheSimplexLatticeDesign ....................................................... 312
TheExtremeVerticesDesign...................................................... 314
CreatingtheDesign .......................................................... 315
AnExtremeVerticesExamplewithRangeConstraints ............................ 316
AnExtremeVerticesExamplewithLinearConstraints ............................ 318
ExtremeVerticesMethod:HowItWorks ........................................ 319
TheABCDDesign ............................................................... 320
TheSpaceFillingDesign ......................................................... 320
FFFOptimalityCriterion...................................................... 321
SetAverageClusterSize....................................................... 321
LinearConstraints............................................................ 322
ASpaceFillingExample ...................................................... 322
ASpaceFillingExamplewithaLinearConstraint ................................ 322
CreatingTernaryPlots........................................................... 323
FittingMixtureDesigns.......................................................... 324
WholeModelTestsandAnalysisofVarianceReports ............................. 325
UnderstandingResponseSurfaceReports ....................................... 325
AChemicalMixtureExample ..................................................... 326
CreatetheDesign ............................................................ 326
AnalyzetheMixtureModel.................................................... 328
ThePredictionProfiler ........................................................ 329
TheMixtureProfiler .......................................................... 330
ATernaryPlotoftheMixtureResponseSurface .................................. 331

Chapter 11
Design of Experiments Guide

Mixture Designs
Mixture Design Types

307

Mixture Design Types


Tocreateamixturedesign,chooseDOE > Mixture Design,entertheresponsesandfactorsinto
theinitialmixturedesignerpanel,andclickContinue.YouthenseetheLinearConstraints
reportandtheChooseMixtureDesignTypepanel.BothareshowninFigure 11.2.
Threedesigntypessupportlinearconstraints:Optimal,ExtremeVertices,andSpaceFilling.If
youhavelinearconstraintsandplantousetheExtremeVerticesorSpaceFillingDesign
Types,clicktheLinearConstraintbuttonandenterthesefirst.IfyouplantousetheOptimal
DesignType,clickOptimalandaddtheconstraintsunderDefineFactorConstraintsinthe
dialogwindowthatopens.
Selectoneofthedesigntypesfromthepanel.ThedefaultvaluesshownforK,Numberof
Levels,Degree,andRunsdependonthenumberoffactorsentered.Thedesigntypesare:
Optimal invokesthecustomdesignerwithallthemixturevariablesalreadydefined.
Simplex Centroid letsyouspecifythedegreetowhichthefactorcombinationsaremade.
Simplex Lattice letsyouspecifyhowmanylevelsyouwantoneachedgeofthegrid.
Extreme Vertices letsyouspecifylinearconstraintsorrestricttheupperandlowerboundsto

bewithinthe0to1range.
ABCD Design

generatesascreeningdesignformixturesdevisedbySnee(1975).

constructsadesignthataccommodateslinearconstraints.Designpointsare
spreadthroughoutthedesignspace.

Space Filling

Figure 11.2MixtureDesignSelectionDialog

308

Mixture Designs
The Optimal Mixture Design

Chapter 11
Design of Experiments Guide

Afteryouselectthedesigntype,enterselectionsoracceptdefaultstoadjustthenumberof
runsintheDesignGenerationpanel.ThenclickMake DesignorMake Table,asappropriate.
Thefollowingsectionsdescribeeachmixturedesigntypeandshowexamples.

The Optimal Mixture Design


TheOptimalmixturedesignchoiceinvokesthecustomdesignerwiththemixturevariables
enteredintotheresponseandfactorspanels.Tocreateanoptimalmixturedesign:
1. SelectDOE > Mixture Design.
2. Enterfactorsandresponses.ThestepsforenteringresponsesareoutlinedinResponses
onpage 83intheCustomDesignschapter.
3. Afteryouenterresponsesandfactors,clickContinue.
4. ClickOptimal ontheChooseMixtureDesignTypepanel.
5. OpentheDefine Factor ConstraintsnodeandclickAdd Constrainttoaddlinear
constraints,ifyouhaveany.
6. Addeffectstothemodelusingtheinstructionsbelow.
7. IntheDesign Generationpanel,makeselectionsrelativetoblocks,centerpoints,replicates,
andthenumberofruns.
8. ClickMake DesigntogeneratetheMixtureDesignreport,whichdisplaysthedesignand
DesignEvaluationreport.
9. ClickMake TableintheOutputOptionspaneloftheMixtureDesignreporttogeneratethe
datatable.
Adding Effects to the Model
Initially,theModelpanellistsonlythemaineffectscorrespondingtothefactorsthatyou
entered,asshowninFigure 11.3.
Figure 11.3TheModelPanel

Chapter 11
Design of Experiments Guide

Mixture Designs
The Simplex Centroid Design

309

However,youcanaddfactorinteractions,specificcrossedfactorterms,powers,orScheff
Cubictermstothemodel.

Toaddinteractiontermstoamodel,clicktheInteractionsbuttonandselect2nd,3rd,4th,
or5th.Forexample,ifyouhavefactors X1and X2,clickInteractions > 2nd andX1*X2is
addedtothelistofmodeleffects.

Toaddcrossedeffectstoamodel,highlightthefactorsandeffectsthatyouwanttocross
andclicktheCrossbutton.

Toaddpowersofcontinuousfactorstothemodel,clickthePowersbuttonandselect2nd,
3rd,4th,or5th.

Whenyouwantamixturemodelwiththirddegreepolynomialterms,theScheff Cubic
buttonprovidesapolynomialspecificationofthesurfacebyaddingtermsoftheform
X1*X2*(X1X2).

The Simplex Centroid Design


Asimplexcentroiddesignofdegreekwithnfactorsconsistsofmixturerunswiththe
followingcharacteristics:

allonefactor

allcombinationsoftwofactorsatequallevels

allcombinationsofthreefactorsatequallevels

andsoon,uptokfactorsatatimecombinedatkequallevels.

Acenterpointrunwithequalamountsofalltheingredientsisalwaysincluded.

Creating the Design


Tocreateasimplexcentroiddesign:
1. SelectDOE > Mixture Design.
2. Enterfactorsandresponses.ThestepsforenteringresponsesareoutlinedinResponses
onpage 83intheCustomDesignschapter.
3. Afteryouenterresponsesandfactors,clickContinue.
4. EnterthenumberofingredientsintheboxunderK.JMPcreatesrunsforeachingredient
withoutmixing.JMPalsocreatesrunsthatmixequalproportionsofKingredientsata
timetothespecifiedlimit.
5. ClicktheSimplex Centroidbutton.
6. ViewfactorsettingsandOutputOptions,asillustratedinFigure 11.4.

310

Mixture Designs
The Simplex Centroid Design

Chapter 11
Design of Experiments Guide

Figure 11.4ExampleofFactorSettingsandOutputOptions

7. Specify RunOrder,whichistheorderinwhichtherunsthatappearinthedatatablethat
youwillcreate.Runorderchoicesare:
Keep the Same:Therows(runs)intheoutputtableappearastheydointheFactor

Settingspanel.
Sort Left to Right:Therows(runs)intheoutputtableappearsortedfromlefttoright.
Randomize:Therows(runs)intheoutputtableappearinarandomorder.
Sort Right to Left:Therows(runs)intheoutputtableappearsortedfromrighttoleft.
Randomize within Blocks:Therows(runs)intheoutputtableappearinrandomorder
withintheblocksthatyousetup.

8. SpecifyNumber of Replicates.Thenumberofreplicatesisthenumberoftimestoreplicate
theentiredesign,includingcenterpoints.Enterthenumberoftimesyouwanttoreplicate
thedesignintheassociatedtextbox.Onereplicatedoublesthenumberofruns.
9. ClickMake Table.

Simplex Centroid Design Examples


Thetableofrunsforadesignofdegree1withthreefactors(leftinFigure 11.5)showsrunsfor
eachsingleingredientfollowedbythecenterpoint.Thetableofrunstotherightisforthree
factorsofdegree2.Thefirstthreerunsareforeachsingleingredient,thesecondsetshows
eachcombinationoftwoingredientsinequalparts,andthelastrunisthecenterpoint.

Chapter 11
Design of Experiments Guide

Mixture Designs
The Simplex Centroid Design

311

Figure 11.5ThreeFactorSimplexCentroidDesignsofDegrees1and2

TogeneratethetwosetsofrunsinFigure 11.5:
1. ChooseDOE > Mixture Design.
2. Enterthreemixturefactors.
3. ClickContinue.
4. Enter1intheKbox,andclickSimplex CentroidtoseethedesignontheleftinFigure 11.6.
5. ClicktheBackbutton,clickContinue,andthenenter2intheKbox.ThenclickSimplex
CentroidtoseethedesignontherightinFigure 11.6.
Figure 11.6CreateSimplexCentroidDesignsofDegrees1and2

Asanotherexample:
1. ChooseDOE > Mixture Design.
2. EnterfivefactorsandclickContinue.
3. Usethedefaultvalue,4,intheKbox.
4. ClickSimplex Centroid.
5. ClickMake Table.
Figure 11.7showspartofthe31rundesign.Notethatyourtablemightlookdifferent
becausethedesignwascreatedwithRunOrdersettoRandomize.

312

Mixture Designs
The Simplex Lattice Design

Chapter 11
Design of Experiments Guide

Figure 11.7PartialListingofFactorSettingsforFiveFactorSimplexCentroidDesign

The Simplex Lattice Design


Thesimplexlatticedesignisaspacefillingdesignthatcreatesatriangulargridofruns.The
designisthesetofallcombinationswherethefactorsvaluesarei/m.iisanintegerfrom0to
msuchthatthesumofthefactorsis1.
Tocreatesimplexlatticedesigns:
1. SelectDOE > Mixture Design.
2. Enterfactorsandresponses.ThestepsforenteringresponsesareoutlinedinResponses
onpage 83intheCustomDesignschapter.
3. ClickContinue.
4. SpecifythenumberoflevelsthatyouwantintheMixtureDesignTypedialog(Figure 11.2)
andclickSimplex Lattice.
Figure 11.8showstherunsforthreefactorsimplexlatticedesignsofdegrees3,4,and5,with
theircorrespondinggeometricrepresentations.Incontrasttothesimplexcentroiddesign,the
simplexlatticedesigndoesnotnecessarilyincludethecentroid.

Chapter 11
Design of Experiments Guide

Mixture Designs
The Simplex Lattice Design

Figure 11.8ThreeFactorSimplexLatticeDesignsforFactorLevels3,4,and5

Figure 11.9liststherunsforasimplexlatticeofdegree3forfiveeffects.Inthefivelevel
example,therunscreepacrossthehypertriangularregionandfillthespaceinagridlike
manner.

313

314

Mixture Designs
The Extreme Vertices Design

Chapter 11
Design of Experiments Guide

Figure 11.9JMPDesignTableforSimplexLatticewithFiveVariables,Order(Degree)3

The Extreme Vertices Design


Theextremeverticesdesigncanbeselectedonlyifyouhavemodifiedtherangesonthe
factorsintheFactorspanelorifyouhavespecifiedalinearconstraint.Thisdesignaccounts
forfactorlimitsandselectsverticesandtheiraverages(formedbyfactorlimits)asdesign
points.Additionallimitsareusuallyintheformofrangeconstraints,upperbounds,and
lowerboundsonthefactorvalues.
Theextremeverticesdesignfindsthecorners(vertices)ofafactorspaceconstrainedbylimits
specifiedforoneormoreofthefactors.Thepropertythatthefactorsmustbenonnegativeand
mustadduptooneisthebasicmixtureconstraintthatmakesatriangularshapedregion.
Sometimesotheringredientsneedrangeconstraintsthatconfinetheirvaluestobegreater
thanalowerboundorlessthananupperbound.Rangeconstraintschopoffpartsofthe
triangularshaped(simplex)regiontomakeadditionalvertices.Itisalsopossibletohavea
linearconstraint,whichdefinesalinearcombinationoffactorstobegreaterorsmallerthan
someconstant.

Chapter 11
Design of Experiments Guide

Mixture Designs
The Extreme Vertices Design

315

Thegeometricshapeofaregionboundbylinearconstraintsiscalledasimplex.Becausethe
verticesrepresentextremeconditionsoftheoperatingenvironment,theyareoftenthebest
placestouseasdesignpointsinanexperiment.
Youusuallywanttoaddpointsbetweenthevertices.Theaverageofpointsthatsharea
constraintboundaryiscalledacentroidpoint,andcentroidpointsofvariousdegreescanbe
added.Thecentroidpointfortwoneighboringverticesjoinedbyalineisaseconddegree
centroidbecausealineistwodimensional.Thecentroidpointforverticessharingaplaneisa
thirddegreecentroidbecauseaplaneisthreedimensional,andsoon.

Creating the Design


Followthesestepstocreateanextremeverticesdesign.Thenextsectionsshowexampleswith
specificconstraints.
1. SelectDOE > Mixture Design.
2. Enterfactorsandresponses.ThesestepsareoutlinedinCustomDesignWindowon
page 83intheCustomDesignschapter.Ifyourfactorrangesareconstrained,enterthe
limitsasupperandlowerlimitsintheFactorspanel(seeFigure 11.10).
3. ClickContinue.
4. Ifyouhavelinearconstraints,clickLinear Constraintsandenterthem.
Note: Theextremeverticesdesigncanbeselectedonlyifyouhavemodifiedtherangeson
thefactorsintheFactorspanelorifyouhavespecifiedalinearconstraint.
5. Inthe Degreetextbox,enterthedegreeofthecentroidpointthatyouwanttoadd.The
centroidpointistheaverageofpointsthatshareaconstraintboundary.
6. Ifyouhavelinearconstraints,clicktheLinear Constraintsbuttonforeachconstraintthat
youwanttoadd.Usethetextboxesthatappeartodefinealinearcombinationoffactorsto
begreaterorsmallerthansomeconstant.
7. ClickExtreme Verticestoseethefactorsettings.
8. SpecifytheRunOrder.Thisdeterminestheorderoftherunsinthedatatablewhenitis
created.Runorderchoicesare:
Keep the Same:Therows(runs)intheoutputtableappearastheydointheDesignpanel.
Sort Left to Right:Therows(runs)intheoutputtableappearsortedfromlefttoright.
Randomize:Therows(runs)intheoutputtableappearinarandomorder.
Sort Right to Left:Therows(runs)intheoutputtableappearsortedfromrighttoleft.
Randomize within Blocks:Therows(runs)intheoutputtableappearinrandomorder
withintheblocksthatyousetup.

9. Enterthesamplesizethatyouwantinthe Choose desired sample sizetextbox.

316

Mixture Designs
The Extreme Vertices Design

Chapter 11
Design of Experiments Guide

10. (Optional)ClickFind Subset togeneratetheoptimalsubsethavingthenumberofruns


specifiedinsamplesizeboxdescribedinStep8.TheFind Subsetoptionusestherow
exchangemethod(notcoordinateexchange)tofindtheoptimalsubsetofrows.
11. ClickMake Table.

An Extreme Vertices Example with Range Constraints


Thefollowingexampledesigntableisforfivefactorswiththerangeconstraintsshownin
Figure 11.10,wheretherangesaresmallerthanthedefault0to1range.
1. SelectDOE > Mixture Design.
2. Addtwoadditionalfactors(foratotalof5factors)andgivethemthevaluesshownin
Figure 11.10.
3. ClickContinue.
4. Enter4intheDegreetextbox(Figure 11.10).
Figure 11.10ExampleofFivefactorExtremeVertices

5. ClickExtreme Vertices.
6. SelectSort Left to RightfromtheRun Ordermenu.
7. ClickMake Table.
Figure 11.11showsapartiallistingofaresultingdesign.NotethattheRowspanelinthe
datatableshowsthatthetablehasthedefault116runs.

Chapter 11
Design of Experiments Guide

Mixture Designs
The Extreme Vertices Design

317

Figure 11.11JMPDesignTableforExtremeVerticeswithRangeConstraints

Supposeyouwantfewerruns.Youcangobackandenteradifferentsamplesize(number
ofruns).
8. ClickBackandthenclickContinue.
9. Enter4intheDegreetextboxandclickExtreme Vertices.
10. Inthesamplesizetextbox,enter10asthesamplesize.
11. ClickFind Subset togenerateanoptimalsubsethavingthenumberofrunsspecified.
Theresultingdesign(Figure 11.12)isanoptimal10runsubsetofthe116currentruns.
Thisisusefulwhentheextremeverticesdesigngeneratesalargenumberofvertices.Your
designmightlookdifferent,becausetherearedifferentsubsetsthatachievethesame
Defficiency.

318

Mixture Designs
The Extreme Vertices Design

Chapter 11
Design of Experiments Guide

Figure 11.12JMPDesignTablefor10RunSubsetofthe116CurrentRuns

Note: TheFind Subsetoptionusestherowexchangemethod(notcoordinateexchange)to


findtheoptimalsubsetofrows.

An Extreme Vertices Example with Linear Constraints


ConsidertheclassicexamplepresentedbySnee(1979)andPiepel(1988).Thisexamplehas
threefactors,X1,X2,andX3,withfiveindividualfactorboundconstraintsandthree
additionallinearconstraints:
Table 11.1LinearConstraintsfortheSneeandPiepelExample
X1
X1
X2
X2
X3

0.1
0.5
0.1
0.7
0.7

90 85*X1 + 90*X2 + 100*X3


85*X1 + 90*X2 + 100*X3 95
.4 0.7*X1 + X3

Toentertheseconstraints:
1. Entertheupperandlowerlimitsinthefactorspanel.
2. ClickContinue.
3. ClicktheLinear Constraintbuttonthreetimes.Entertheconstraintsasshownin
Figure 11.13.
4. ClicktheExtreme Verticesbutton.
5. ChangetherunordertoSort Right to Left,andkeepthesamplesizeat13.SeeFigure 11.13
forthedefaultFactorSettingsandcompletedOutputOptions.
6. ClickMake Table.

Chapter 11
Design of Experiments Guide

Mixture Designs
The Extreme Vertices Design

319

Figure 11.13Constraints

Thisexampleisbestunderstoodbyviewingthedesignasaternaryplot,asshownattheend
ofthischapter,inFigure 11.16.Theternaryplotshowshowclosetooneagivencomponentis
byhowcloseitistothevertexofthatvariableinthetriangle.SeeCreatingTernaryPlotson
page 323,fordetails.

Extreme Vertices Method: How It Works


Iftherearelinearconstraints,JMPusestheCONSIMalgorithmdevelopedbyR.E.Wheeler,
describedinSnee(1979)andpresentedbyPiepel(1988)asCONVRT.Themethodisalso
describedinCornell(1990,Appendix10a).Themethodcombinesconstraintsandchecksto
seewhetherverticesviolatethem.Ifso,itdropstheverticesandcalculatesnewones.The
methodnamedCONAEVfordoingcentroidpointsisbyPiepel(1988).
Iftherearenolinearconstraints(onlyrangeconstraints),theextremeverticesdesignis
constructedusingtheXVERTmethoddevelopedbySneeandMarquardt(1974)andSnee
(1975).Aftertheverticesarefound,asimplexcentroidmethodgeneratescombinationsof
verticesuptoaspecifiedorder.
TheXVERTmethodfirstcreatesafull2nf1designusingthegivenlowandhighvaluesofthe
nf 1factorswithsmallestrange.Then,itcomputesthevalueoftheonefactorleftoutbased
ontherestrictionthatthefactorsvaluesmustsumtoone.Itkeepspointsthatarenotin
factorsrange.Ifnot,itincrementsordecrementsthevaluetobringitwithinrange,and
decrementsorincrementseachoftheotherfactorsinturnbythesameamount.Thismethod
keepsthepointsthatstillsatisfytheinitialrestrictions.
Theabovealgorithmcreatestheverticesofthefeasibleregioninthesimplexdefinedbythe
factorconstraints.However,Snee(1975)hasshownthatitcanalsobeusefultohavethe
centroidsoftheedgesandfacesofthefeasibleregion.Ageneralizedndimensionalfaceofthe

320

Mixture Designs
The ABCD Design

Chapter 11
Design of Experiments Guide

feasibleregionisdefinedbynf noftheboundariesandthecentroidofafacedefinedtobe
theaverageoftheverticeslyingonit.Thealgorithmgeneratesallpossiblecombinationsofthe
boundaryconditionsandthenaveragesovertheverticesgeneratedonthefirststep.

The ABCD Design


ThisapproachbySnee(1975)generatesascreeningdesignformixtures.TocreateanABCD
design:
1. SelectDOE > Mixture Design.
2. Enterfactorsandresponses.ThestepsforenteringresponsesareoutlinedinResponses
onpage 83intheCustomDesignschapter.
3. Afteryouenterresponsesandfactors,clickContinue.
4. ClicktheABCD Design button.
5. ViewfactorsettingsandOutputOptions.
6. SpecifyRunOrder,whichistheorderyouwanttherunstoappearinthedatatablewhen
itiscreated.Runorderchoicesare:
Keep the Same:Therows(runs)intheoutputtableappearastheydointheFactorSettings

panel.
Sort Left to Right:Therows(runs)intheoutputtableappearsortedfromlefttoright.
Randomize:Therows(runs)intheoutputtableappearinarandomorder.
Sort Right to Left:Therows(runs)intheoutputtableappearsortedfromrighttoleft.
Randomize within Blocks:Therows(runs)intheoutputtableappearinrandomorder
withintheblocksthatyousetup.

7. SpecifyNumberofReplicates.Thenumberofreplicatesisthenumberoftimestoreplicate
theentiredesign,includingcenterpoints.Enterthenumberoftimesyouwanttoreplicate
thedesignintheassociatedtextbox.Onereplicatedoublesthenumberofruns.
8. ClickMake Table.

The Space Filling Design


TheSpaceFillingmixturedesigntypespreadsdesignpointsfairlyuniformlythroughoutthe
designregion.Itaccommodateslinearconstraints.Thedesignisgeneratedinafashionsimilar
totheFastFlexibleFillingdesignmethodfoundunderDOE>SpaceFillingDesign(Fast
FlexibleFillingDesignsonpage 407).

Chapter 11
Design of Experiments Guide

Mixture Designs
The Space Filling Design

321

TworedtriangleoptionsrelatetotheSpaceFillingDesign:
FFF Optimality Criterion FortheFastFlexibleFillingmixturedesigntype,enablesyouto

selectbetweentheMaxProcriterion(thedefault)andtheCentroidcriterion.SeeFFF
OptimalityCriteriononpage 321.
Advanced Options > Set Average Cluster Size FortheFastFlexibleFillingmixturedesign

type,enablesyoutospecifytheaveragenumberofrandomlygeneratedpointsusedto
defineeachclusteror,equivalently,eachdesignpoint.SeeSetAverageClusterSizeon
page 321.

FFF Optimality Criterion


ThealgorithmsforFastFlexibleFillingdesignsbeginbygeneratingalargenumberofrandom
pointswithinthespecifieddesignregion.ThesepointsarethenclusteredusingaFastWard
algorithmintoanumberofclustersthatequalstheNumberofRunsthatyouspecified.
ThefinaldesignpointscanbeobtainedbyusingthedefaultMaxPro(maximumprojection)
optimalitycriterionorbyselectingtheCentroidcriterion.Youcanfindtheseoptionsunder
FFFOptimalityCriterioninthereportsredtrianglemenu.
MaxPro ForpfactorsandnequaltothespecifiedNumberofRuns,theMaxProcriterion

strivestofindpointsintheclustersthatminimizethefollowingcriterion:
C MaxPro =

n1

j = i+1

x ik x jk

k=1

TheMaxProcriterionmaximizestheproductofthedistancesbetweenpotentialdesign
pointsinawaythatinvolvesallfactors.Thissupportsthegoalofprovidinggood
spacefillingpropertiesonprojectionsoffactors.SeeJosephetal.(2014,forthcoming).The
MaxProoptionisthedefault.
Centroid Thismethodplacesadesignpointatthecentroidofeachcluster.Ithastheproperty

thattheaveragedistancefromanarbitrarypointinthedesignspacetoitsclosest
neighboringdesignpointissmallerthanforotherdesigns.
Note: Youcansetapreferencetoalwaysuseagivenoptimalitycriterion.SelectFile >
Preferences > Platforms > DOE.SelectFFFOptimalityCriterionandselectyourpreferred
criterion.

Set Average Cluster Size


TheSetAverageClusterSizeoptionisfoundunderAdvancedOptionsintheMixtureDesign
redtrianglemenu.Thisoptionenablesyoutospecifytheaveragenumberofuniformly
generatedpointsusedtodefineeachclusteror,equivalently,eachdesignpoint.

322

Mixture Designs
The Space Filling Design

Chapter 11
Design of Experiments Guide

Bydefault,ifthenumberofRunsfortheSpaceFillingdesigntypeis200orsmaller,atotalof
10,000randomuniformlygeneratedpointsareusedasthebasisfortheclusteringalgorithm.
WhenthenumberofRunsexceeds200,thedefaultvalueis50.Increasingthisvaluecanbe
particularlyusefulindesignswithalargenumberoffactors.
Note: DependingonthenumberoffactorsandthespecifiedvalueforRuns,youmightwant
toincreasetheaveragenumberofinitialpointsperdesignpointbyselectingAdvanced
Options > Set Average Cluster Size.

Linear Constraints
ThedesignregioncanberestrictedbyselectingtheLinear Constraint optionintheLinear
Constraintsoutline.
Whenyouspecifylinearconstraints,therandompointsthatformthebasisfortheclustering
algorithmarerandomlydistributedwithintheconstraineddesignregion.Theclustering
algorithmusesthesepoints.

A Space Filling Example


Tocreateaspacefillingdesign:
1. SelectDOE > Mixture Design.
2. Enterfactorsandresponses.
3. ClickContinue.
4. AddLinear Constraints,ifyouhaveany.
5. SpecifythenumberofrunsyouwantintheRunsboxtotherightoftheSpaceFilling
buttonintheMixtureDesignTypedialog(Figure 11.2).
6. ClickSpace Filling.

A Space Filling Example with a Linear Constraint


Considerathreefactormixturedesignwiththesinglelinearconstraint: 0.7*X1 + X2 0.4 .
Figure 11.14showsaternaryplotfora30runSpaceFillingdesignthatsatisfiesthisconstraint.
(Foradiscussionofternaryplots,seeCreatingTernaryPlotsonpage 323.)Notethatthe
pointsfallintheconstraineddesignregionandarefairlywellspreadthroughoutthisregion.

Chapter 11
Design of Experiments Guide

Mixture Designs
Creating Ternary Plots

323

Figure 11.14SpaceFillingDesignwithOneLinearConstraint

Creating Ternary Plots


Amixtureprobleminthreecomponentscanberepresentedintwodimensionsbecausethe
thirdcomponentisalinearfunctionoftheothers.TheternaryplotinFigure 11.16showshow
closetoone(1)agivencomponentisbyhowcloseitistothevertexofthatvariableinthe
triangle.TheplotinFigure 11.15illustratesaternaryplot.
Figure 11.15TernaryPlotforMixtureDesign
X1

X1 (1, 0, 0)
(1/3, 1/3, 1/3)
(1/2, 1/2, 0)
(0.1, 0.1, 0.8)

X2 (0, 1, 0)

X3 (0, 0, 1)

X2

X3

ThePiepel(1979)examplereferencedinAnExtremeVerticesExamplewithLinear
Constraintsonpage 318isbestunderstoodbytheternaryplotshowninFigure 11.16.

324

Mixture Designs
Fitting Mixture Designs

Chapter 11
Design of Experiments Guide

Toviewamixturedesignasaternaryplot:
1. CreatethePiepelmixturedataasshownpreviously,oropenthetablecalledPiepel.jmp,
foundintheDesignExperimentsfolderoftheSampleDataLibrary.
2. ChooseGraph > Ternary Plot.
3. IntheTernaryPlotlaunchwindow,specifythethreemixturecomponentsandclickOK.
Theternaryplotplatformrecognizesthethreefactorsasmixturefactors,andalsoconsiders
theupperandlowerconstraintsenteredintotheFactorspanelwhenthedesignwascreated.
Theternaryplotusesshadingtoexcludetheunfeasibleareasexcludedbythoseconstraints.
ThePiepeldatahadadditionalconstraints,enteredaslinearconstraintsfortheextreme
verticesdesign.Therearesixactiveconstraints,sixvertices,andsixcentroidpointsshownon
theplot,aswellasthreeinactive(redundant)constraints.Thefeasibleareaistheinnerwhite
polygondelimitedbythedesignpointsandconstraintlines.
Figure 11.16DiagramofTernaryPlotShowingPiepelExampleConstraints

Fitting Mixture Designs


Whenfittingamodelformixturedesigns,takeintoaccountthatthefactorssumtoaconstant;
atraditionalfulllinearmodelarenotfullyestimable.
TherecommendedresponsesurfacemodeliscalledtheScheffpolynomial(Scheff1958).See
thediscussionofCoxMixturesandtheScheffCubicmacrointheFittingLinearModelsbook.
TheScheffpolynomialmodeldoesthefollowing:

suppressestheintercept

includesallthelinearmaineffectterms

excludesallthesquareterms(suchasX1*X1)

Chapter 11
Design of Experiments Guide

Mixture Designs
Fitting Mixture Designs

325

includesallthecrossterms(suchasX1*X2)

Tofitamodel:
1. ChooseDOE > Mixture Designandmakethedesigndatatable.Tofitamodel,theY
columninthedatatablemustcontainvalues.EitherassignresponsesorselectSimulate
ResponsesfromtheredtrianglemenubeforeyouclickMake Table.
2. Thedesigndatatablestoresthemodelinthedatatableasatableproperty.Thistable
propertyisaJSLscriptcalledModel,locatedintheleftpanelofthetable.
3. RightclickthemodelandselectRun ScripttoopentheFitModellaunchwindow,whichis
automaticallyfilledwiththesavedmodel.
4. ClickRunontheFitModelwindow.
Inthismodel,theparametersareeasytointerpret(Cornell1990).Thecoefficientsonthelinear
termsarethefittedresponseattheextremepointswherethemixtureconsistsofasingle
factor.Thecoefficientsonthecrosstermsindicatethecurvatureacrosseachedgeofthefactor
space.
Themodelreportusuallyhasseveralsectionsofinterest,includingthewholemodeltests,
AnalysisofVariancereports,andresponsesurfacereports,whicharedescribedbelow.

Whole Model Tests and Analysis of Variance Reports


InawholemodelAnalysisofVariancetable,JMPtraditionallyteststhatalltheparametersare
zeroexceptfortheintercept.Inamixturemodelwithoutanintercept,JMPlooksforahidden
intercept,inthesensethatalinearcombinationofeffectsisaconstant.Ifitfindsahidden
intercept,itdoesthewholemodeltestwithrespecttotheinterceptmodelratherthana
zerointerceptmodel.Thistestisequivalenttotestingthatalltheparametersarezeroexcept
thelinearparameters,andtestingthattheyareequal.
ThehiddeninterceptpropertyalsocausestheR2tobereportedwithrespecttotheintercept
modelratherthanreportedasmissing.

Understanding Response Surface Reports


Whenthereareeffectsmarkedasresponsesurfaceeffects&RS,JMPcreatesadditional
reportsthatanalyzethefittedresponsesurface.Thesereportswereoriginallydesignedforfull
responsesurfaces,notmixturemodels.However,JMPmightencounteranointerceptmodel
andfindahiddeninterceptwithlinearresponsesurfaceterms,butnosquareterms.Thenit
foldsitscalculations,collapsingonthelastresponsesurfacetermtocalculatecriticalvaluesfor
theoptimum.Thiscanbedoneforanycombinationthatyieldsaconstantandinvolvesthe
lastresponsesurfaceterm.

326

Mixture Designs
A Chemical Mixture Example

Chapter 11
Design of Experiments Guide

A Chemical Mixture Example


Threeplasticizers(p1,p2,andp3)comprise79.5%ofthevinylusedforautomobileseatcovers
(Cornell,1990).Withinthis79.5%,theindividualplasticizersarerestrictedbythefollowing
constraints:0.409x10.849,0x20.252,and0.151x30.274.

Create the Design


TocreateCornellsmixturedesigninJMP:
1. SelectDOE > Mixture Design.
2. IntheFactorspanel,usethethreedefaultfactorsbutnamethemp1,p2,andp3,andenter
thehighandlowconstraintsasshowninFigure 11.17.Or,loadthefactorswiththeLoad
FactorscommandintheredtriangleontheMixtureDesigntitlebar.Toimportthefactors,
openPlastifactors.jmp,foundintheDesign Experiment sampledatafolderthatwas
installedwithJMP.
Figure 11.17FactorsandFactorConstraintsforthePlasticizerExperiment

3. Click Continue.
4. Enter3intheDegreetextbox.
5. ClickExtreme Vertices.
6. Click Make Table.JMPusesthe9factorsettingstogenerateaJMPtable(Figure 11.18).

Chapter 11
Design of Experiments Guide

Mixture Designs
A Chemical Mixture Example

327

Figure 11.18ExtremeVerticesMixtureDesign

7. Addanextrafivedesignrunsbyduplicatingthevertexpointsandcenterpoint,togivea
totalof14rowsinthetable.
Note: Toidentifythevertexpointsandthecenter(orinterior)point,usethesampledata
scriptcalledLabelMixturePoints.jsl intheSampleScriptsfolderinstalledwithJMP.
8. RuntheLabelMixturePoints.jsltoseetheresultsinFigure 11.19,andhighlightthevertex
pointsandtheinteriorpointasshown.
Figure 11.19IdentifyVerticesandCenterPointwithSampleScript

9. SelectEdit > Copy,tocopytheselectedrowstotheclipboard.


10. SelectRows > Add Rows andtype5asthenumberofrowstoadd.
11. ClicktheAtEndradiobuttononthedialogandthenclickOK.
12. HighlightthenewrowsandselectEdit > Pastetoaddtheduplicaterowstothetable.
ThePlasticizerdatawiththeresults(Yvalues)thatCornellobtainedareavailableinthe
sampledata.OpenPlasticizer.jmpinthesampledatafolderinstalledwithJMPtoseethistable
(Figure 11.20).

328

Mixture Designs
A Chemical Mixture Example

Chapter 11
Design of Experiments Guide

Figure 11.20Plasticizer.jmpDataTablefromtheSampleDataLibrary

Analyze the Mixture Model


UsethePlasticizer.jmpdatafromthesampledatalibrary(Figure 11.20)torunthemixture
model:
1. SelectRun ScriptfromtheModelredtrianglemenuintheupperleftcornerofthedata
table.
AcompletedFitModellaunchwindowappears.
2. ClickRuntoseetheresponsesurfaceanalysis.
3. Plasticizer.jmpcontainsacolumncalledPred Formula Y.Thiscolumnwasaddedafterthe
analysisbyselectingSave Columns > Prediction Formula fromtheResponseYredtriangle
menu.
4. Toseethepredictionformula,rightclick(pressCtrlandclickonMacintosh)thecolumn
nameandselectFormula:
050.1465*p1 282.198*p2 911.648*p3+ p2*p1*317.363 + p2*p1*1464.330 +
p3*p2*1846.218

Note: TheseresultscorrectthecoefficientsreportedinCornell(1990).
TheResponseSurfaceSolutionreport(Figure 11.21)showsthatamaximumpredictedvalue
of19.570299occursatpoint(0.63505,0.15568,0.20927).

Chapter 11
Design of Experiments Guide

Mixture Designs
A Chemical Mixture Example

329

Figure 11.21MixtureResponseSurfaceAnalysis

The Prediction Profiler


Thereportcontainsapredictionprofiler.
1. Iftheprofilerisnotvisible,clicktheredtriangleintheResponseYtitlebarandselect
Factor Profiling > Profiler.YoushouldseetheinitialprofilershowninFigure 11.22.
Thecrossedeffectsshowascurvatureinthepredictiontraces.Dragoneofthevertical
referencelines,andtheothertwolinesmoveintheoppositedirectionmaintainingtheir
ratio.
Note: Theaxesofpredictionprofilertracesrangefromtheupperandlowerboundsofthe
factors,p1,p2,andp3, enteredtocreatethedesignandthedesigntable.Whenyou
experimentmovingavariabletrace,youseetheothertracesmovesuchthattheirratiois
preserved.Asaresult,whenthelimitofavariableisreached,itcannotmovefurtherand
onlythethirdvariablechanges.
2. Tolimitthevisibleprofilecurvestoboundsthatuseallthreevariables,selectProfile at
Boundary > Stop at BoundariesfromPredictionProfilerredtrianglemenu.
3. Ifneeded,selecttheDesirability Functionscommandtodisplaythedesirabilityfunction
showingtotherightofthepredictionprofileplotsinFigure 11.23.
4. SelectMaximize DesirabilityfromthePredictionProfilermenutoseethebestfactor
settings.
TheprofilerinFigure 11.23,displaysoptimalsettings(rounded)of0.6350forp1,0.1557forp2,
and0.2093forp3,whichgiveanestimatedresponseof19.5703.

330

Mixture Designs
A Chemical Mixture Example

Chapter 11
Design of Experiments Guide

Figure 11.22InitialPredictionProfiler

Figure 11.23MaximumDesirabilityinProfilerforMixtureAnalysisExample

The Mixture Profiler


TheFitModelreportalsohasaMixture Profiler thatisusefulforvisualizingandoptimizing
responsesurfacesfrommixtureexperiments.
ManyofthefeaturesarethesameasthoseoftheContourProfiler.However,someareunique
totheMixtureProfiler:

AternaryplotisusedinsteadofaCartesianplot,whichenablesyoutoviewthreemixture
factorsatatime.

Ifyouhavemorethanthreefactors,radiobuttonsletyouchoosewhichfactorstoplot.

Ifthefactorshaveconstraints,youcanentertheirlowandhighlimitsintheLoLimitand
HiLimitcolumns.Thissettingshadesnonfeasibleregionsintheprofiler.

Chapter 11
Design of Experiments Guide

Mixture Designs
A Chemical Mixture Example

331

SelectFactor Profiling >Mixture ProfilerfromResponseYredtrianglemenutoseethemixture


profilerfortheplasticizerdata,showninFigure 11.24.
Figure 11.24MixtureProfilerforPlasticizerExample

A Ternary Plot of the Mixture Response Surface


Youcanalsoplottheresponsesurfaceoftheplasticizerdataasaternaryplotusingthe
TernaryPlotplatformandcontourtheplotwithinformationfromanadditionalvariable:
1. ChooseGraph > Ternary Plot.
2. Specifyplotvariables(p1,p2,andp3)andclickX, Plotting,asshowninFigure 11.25.
3. Toidentifythecontourvariable(thepredictionequation),selectPred Formula Yandclick
theContour Formulabutton.Thecontourvariablemusthaveapredictionformulatoform
thecontourlines,asshownbytheternaryplotsatthebottominFigure 11.26.Ifthereisno
predictionformula,theternaryplotonlyshowspoints.

332

Mixture Designs
A Chemical Mixture Example

Chapter 11
Design of Experiments Guide

Figure 11.25TernaryPlotLaunchWindow

4. ClickOKandviewtheresults,asshowninFigure 11.26.
Bydefault,theternaryplotshowscontourlinesonly.AddafillbyselectingContour Fill
fromtheTernaryPlotredtrianglemenuandthenselectingFill AboveorFill Below.
Figure 11.26TernaryPlotofaMixtureResponseSurface

Chapter 12
Covering Arrays
Detecting Component Interaction Failures
Coveringarraysareusedintestingdeterministicsystemswherefailuresoccurasaresultof
interactionsamongcomponentsorsubsystems.Thedesigngoalistorevealifanyinteraction
inducesafailureinthesystem.Applicationareasincludesoftware,circuit,andnetwork
design.
Sincethetestsaredeterministic,theemphasisdrivingthedesignistheneedtocoverall
requiredinteractions.TheCoveringArraysplatformconstructshighlyefficientcovering
arrays.Youcanalsoexcludefactorlevelcombinationsthatarenotfeasibleforyourtesting
protocol.
Figure 12.1Strength3CoveringArray

Contents
OverviewofCoveringArrays ..................................................... 335
CoveringArraysandStrength ................................................. 335
ExampleofaCoveringArraywithNoFactorLevelRestrictions....................... 337
CreatetheDesign ............................................................ 337
AnalyzetheExperimentalData ................................................ 339
ExampleofaCoveringArraywithFactorLevelRestrictions .......................... 341
CreatetheDesign ............................................................ 341
AnalyzetheExperimentalData ................................................ 346
CoveringArrayWindow ......................................................... 347
Factors ...................................................................... 347
RestrictFactorLevelCombinations............................................. 349
Design ...................................................................... 351
Metrics ..................................................................... 353
OutputOptions .............................................................. 354
TheCoveringArrayDataTable ................................................ 354
CoveringArrayOptions.......................................................... 356
TechnicalDetails................................................................ 357
AlgorithmforOptimize ....................................................... 357
FormulasforMetrics.......................................................... 357

Chapter 12
Design of Experiments Guide

Covering Arrays
Overview of Covering Arrays

335

Overview of Covering Arrays


Youcanusecoveringarraystotestsystemswherefailuresoccurasaresultofinteractions
amongcomponentsorsubsystems.Coveringarraysareoftenusedinareassuchassoftware,
circuit,andnetworkdesign,wherethefollowingconditionsarelikelytobetrue:

Thecostoftestingisusuallyhigh.

Testingfocusesonrevealinginteractionsforwhichfailuresoccur.

Atestrunistypicallydeterministicandresultsineithersuccessorfailure.

Replicaterunsarewastefulbecausetheyyieldidenticalresults.

Theefficiencyofadesignisbasedonhowmanyofthepossibleconditionsarecovered
withoutincludingredundantruns.

Becausesystemstestingisexpensive,reducingtheamountoftestingiscritical.Testingall
possibleinteractionsisusuallyprohibitiveandoftenunnecessary.Experienceshowsthatmost
failuresresultfromtheinteractionofasmallnumberofcomponents.Thesizeofthelargest
combinationofcomponentslikelytodriveafailure,calledthestrength,drivesthesizeofthe
design.
IntheCoveringArrayplatform,youspecifytherequiredstrengthofyourdesign.If
appropriate,youdefinefactorlevelcombinationsthatarenotpermitted.TheCoveringArray
platformconstructsahighlyefficientdesignthatmeetsyourrequirements.Itprovidesmetrics
thatyoucanusetoassessthequalityofthedesignintermsofitscoverage.Italsoprovidesa
scriptinthedatatableforthedesignthatenablesyoutoanalyzeyourresults.
Coveringarraysareoftenusedinsituationswherecertaincombinationsoffactorlevelsettings
arenotfeasible.TheCoveringArrayplatformisabletofindveryefficientcoveringarrays
evenwhenrestrictionsareplacedonfactorlevelcombinations.
Forbackgroundonthestructureofcoveringarraysandalgorithmsforcomputingthem,see
Colbourn(2004),Colbournetal.(2011),HartmanandRaskin(2004),andMartirosyan(2003).
Fordetailsaboutcoveringarrayswithrestrictionsonfactorlevels,seeCohenetal.(2007)and
Morgan(2009).

Covering Arrays and Strength


Acoveringarrayofstrengthtisadesignthattestsallcombinationsoftfactorlevelsettings.
Consideraninteractiondefinedbyspecificsettingsforkfactors.Iffailuresoccurforalltests
involvingthatinteraction,thenthatinteractiondetectsafailure.Usingthisterminology,a
strengthtdesignenablesyoutodetectfailuresassociatedwithanyinteractionofuptot
factors.
Intheliterature,coveringarraysarealsoreferredtoasfactorcoveringdesigns.Forbackground
anddetails,seeYilmazetal.(2014),Cohenetal.(2003),andDalalandMallows(1998).

336

Covering Arrays
Overview of Covering Arrays

Chapter 12
Design of Experiments Guide

Toillustratethenatureofcoveringarrays,considerasituationinvolvingsevencategorical
factorseachwithtwolevels.Youwanttotestallpairwisecombinationsoffactorlevels.
Adesignthatmightbeusedinthissituationisthe8runresolutionIIImaineffectsdesign
givenasfollows:
Figure 12.2AResolutionIIIDesignwithStrength2

Notethatthisdesignisastrength2coveringarraybecauseallpairwisecombinationsoflevels
ofanytwofactorsappear.Forexample,forX1andX2,thefollowingcombinationseach
appeartwice:

L2andL1

L2andL2

L1andL1

L1andL2

However,the6rundesigninFigure 12.3isalsoastrength2coveringarray:
Figure 12.3Strength2CoveringArray

Allpairwisecombinationsoflevelsofanytwofactorsappearandthisisaccomplishedinsix
runs,ratherthaneight.TheCoveringArraydesignismoreefficientthantheResolutionIII
designbecauseitachievesstrength2coverageinfewerruns.
Theefficiencyofacoveringarrayismeasuredbythenumberofrunsrequiredtoachievethe
requiredcoverage.Thesmallerthenumberofruns,themoreefficientthedesign.

Chapter 12
Design of Experiments Guide

Covering Arrays
Example of a Covering Array with No Factor Level Restrictions

337

Example of a Covering Array with No Factor Level Restrictions


Thedatainthisexamplepertaintointeroperabilityintheareaofsoftwaretesting.Thereare
fourfactorsofinterest:

Web Browser(Safari,IE,Firefox,Chrome,Other)

Operating System(WindowsorMacintosh)

RAM(4,8,or16MB)

Connection Speedatthreesettings(01,15,orgreaterthan5Mbps)

Youareinterestedinfindingoutwhichcombinationsofthesefactorsarelikelytocause
failures.
Theresponseiswhetherthesystemfunctionsproperlyforeachcombinationoffactorsettings.
Testingeachcombinationofsettingswouldrequire90(5x2x3x3)trials.Tokeeptherunsize
manageable,youdecidetorequireStrength3coverage,indicatingthatallcombinationsofany
threefactorsaretested.

Create the Design


CreatetheStrength3coveringarraybyfollowingthesesteps.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Software Factors.jmp.
TheSoftware Factors.jmpdatatablecontainsthefactorsandtheirsettings.
2. SelectDOE > Covering Array.
3. FromthemenunexttoStrength: t = ,select3.
4. FromtheCoveringArrayredtrianglemenu,selectLoad Factors andclickContinue.
TheFactorsoutlineispopulatedwiththefourfactorsandtheirlevels.
Figure 12.4FactorsOutlineforSoftwareFactors

5. ClickContinue.

338

Covering Arrays
Example of a Covering Array with No Factor Level Restrictions

Chapter 12
Design of Experiments Guide

TheRestrictFactorLevelCombinationsoutlineopens,whereyoucanenterrestrictionson
thedesignsettings.Becausetherearenorestrictionsforthisdesign,donotchangethe
defaultselectionofNone.
6. ClickMake Design.
TheDesignoutlineopenstoshowa45rundesign.
Figure 12.5DesignandMetricsOutlinesforSoftwareFactors

IntheMetricsoutline,considertherowthatcorrespondstot = 3.TheCoverageis100%,
indicatingthatthedesigncovers100%ofthethreefactorinteractions.Thisiswhatyou
want,becauseyourequestedaStrength3design.Fort = 3,theDiversitycolumnindicates
that68.33%ofthethreefactorinteractionsthatappeararedistinct.Thereissomeminor
repetitionofthreefactorcombinations.
Fort = 4,theCoverageis50%,indicatingthatthedesigncovershalfofthefourfactor
interactions.Thereare90possibledistinctcombinationsofthefourfactorsettings.The45
runsinthedesigncompriseonehalfofthesedistinctcombinations.TheDiversityvalueof
100%reinforcesthefactthatnoneofthefourwayinteractionsarerepeated.
7. ClickMake Table.

Chapter 12
Design of Experiments Guide

Covering Arrays
Example of a Covering Array with No Factor Level Restrictions

339

Figure 12.6DesignTableforSoftwareFactors

Thedesignispresentedinadatatable.NoticethefollowingintheTablepanelatthetopleft:

TheDesignnoteindicatesthatthisisastrength3coveringarray.

TheDOEDialogscriptreproducestheCoveringArraywindowsettings.

TheAnalysisscriptanalyzestheexperimentaldata.

Analyze the Experimental Data


Nowthatyouhaveyourdesigntable,youcanconductyourexperimentandrecordyourdata
intheResponsecolumnofthedesigntable(Figure 12.6).Yourexperimentalresultsareinthe
Software Data.jmpsampledatatable.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Software Data.jmp.
2. IntheTablepanel,clicktheredtrianglenexttoAnalysisandselectRun Script.
Figure 12.7AnalysisofSoftwareExperimentalData

340

Covering Arrays
Example of a Covering Array with No Factor Level Restrictions

Chapter 12
Design of Experiments Guide

TheSummaryoutlineindicatesthatthreetestsfailedandfourtestsdidnotresultinapass
orfailoutcome.
TheFailureAnalysisDetailsoutlinegivesabreakdownoffailuresintermsofthe
associatedthreewayinteractions.Theoutlinelistsonlycombinationsoffactorlevels
wherealltestsresultedinfailure.Ifanytestthatinvolvesagiventhreewaycombination
ofsettingsresultsinsuccess,thenthatthreewaycombinationofsettingscannotbe
responsibleforsystemfailure.
TwofailureswereassociatedwithWeb BrowsersettoFirefox,Operating Systemsetto
Macintosh,andRAMsetto8 MB.Noticethatthiscombinationledtofailureregardlessof
thesettingofConnection Speed.
3. Selectthefirstlineinthe3FactorInteractionsreport.
Figure 12.8SelectionofanInteractionintheAnalysisReport

Thisactionselectsthecorrespondingrowsandcolumnsinthedatatable.
Figure 12.9CorrespondingSelectionofRowsandColumnsintheDataTable

Chapter 12
Design of Experiments Guide

Covering Arrays
Example of a Covering Array with Factor Level Restrictions

341

ThreefailureswereassociatedwithcombinationsofWeb Browser,RAM,and
Connection Speed.Notethattwoofthesefailures,Firefox,8 MB,15 MbpsandFirefox,
8 MB,>5 Mbps,areamongthetwofailuresfortheWeb Browser,Operating System,and
RAMinteraction.Selectinganyoftheserowsinthereportselectsthecorrespondingrows
andcolumnsinthedatatable.

Example of a Covering Array with Factor Level Restrictions


ThefollowingexampleispatternedafteranexampledescribedinDalalandMallows(1998).
Anoriginatingphone(NearPhone)callsareceivingphone(FarPhone).Eachphonecallgoes
throughaninterfaceoftypeAorB.Fivefactorsareofinterest:

Market:USA,UK,Canada,France,Mexico

NearPhone:ISDN,Bus(Business),Coin,Res(Residential)

NearInterface:AorB

FarPhone:ISDN,Bus(Business),Coin,Res(Residential)

FarInterface:AorB

Youareinterestedinwhichcombinationsofpairsofthesefactorsarelikelytocausefailures.
However,certaincombinationsarenotpossible:

AnISDNlineoneitherphone(NearorFar)cannotuseinterfaceA.

BusinessandResidentiallinesontheoriginatingphone(Near)cannotuseinterfaceB.

Create the Design


ThefactorsandtheirsettingsaregiveninthedatatablePhone Factors.jmp.CreateaStrength2
coveringarraybyfollowingthesesteps.
Load Factors
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Phone Factors.jmp.
ThePhone Factors.jmpdatatablecontainsthefactorsandtheirsettings.
2. SelectDOE > Covering Array.
NoticethatthemenunexttoStrength: t = ,issetto2bydefault.
3. FromtheCoveringArrayredtrianglemenu,selectLoad Factors.
TheFactorsoutlineispopulatedwiththefivefactorsandtheirlevels.

342

Covering Arrays
Example of a Covering Array with Factor Level Restrictions

Chapter 12
Design of Experiments Guide

Figure 12.10FactorsOutlineforPhoneFactors

4. ClickContinue.
TheRestrictFactorLevelCombinationsoutlineopens.
Restrict Factor Level Combinations
Youcanspecifydisallowedcombinationsintwoways:

UseDisallowedCombinationsFilter

UseDisallowedCombinationsScript

Thefiltergivesanintuitivewaytospecifydisallowedcombinations.Thescriptprovidesa
quickandeasywaytospecifydisallowedcombinations,butrequiresthatyouhavewrittenor
savedascript.Inthisexample,ifyoudonotwanttospecifycombinationsusingthefilter,skip
toSpecifyDisallowedCombinationsUsingaScriptonpage 344.
Recallthattherestrictionsarethefollowing:

AnISDNlineoneitherphone(NearorFar)cannotuseinterfaceA.

BusinessandResidentialphonesontheoriginatingphone(Near)cannotuseinterfaceB.

Specify Disallowed Combinations Using the Filter


Usethisapproachtoenterdisallowedcombinationsusingthefilterinterface.Alternatively,
youcanpasteascriptasshowninSpecifyDisallowedCombinationsUsingaScripton
page 344.
1. SelectUse Disallowed Combinations Filter.
2. FromtheAddFilterFactorslist,selectNear PhoneandNear InterfaceandclickAdd.
3. HolddowntheCtrlkeyandclickISDNunderNear PhoneandAunderNear Interface.

Chapter 12
Design of Experiments Guide

Covering Arrays
Example of a Covering Array with Factor Level Restrictions

343

Figure 12.11DisallowedCombinationsPanelShowingFirstConstraints

Bothblocksshouldturndark.YouhaveaddedtheconstraintthatanISDNlineonthe
originatingphone(Near)cannotuseinterfaceA.
4. ClickOR.
5. FromtheAddFilterFactorslist,selectFar PhoneandFar InterfaceandclickAdd.
6. HolddowntheCtrlkeyandclickISDNunderFar PhoneandAunderFar Interface.
YouhaveaddedtheconstraintthatanISDNlineonthereceivingphone(Far)cannotuse
interfaceA.
7. ClickOR.
8. FromtheAddFilterFactorslist,selectNear PhoneandNear InterfaceandclickAdd.
9. HolddowntheCtrlkeyandclickBusandResunderNear PhoneandBunderNear
Interface.
YouhaveaddedtherestrictionthatBusinessandResidentiallinesontheoriginating
phone(Near)cannotuseinterfaceB.

344

Covering Arrays
Example of a Covering Array with Factor Level Restrictions

Chapter 12
Design of Experiments Guide

Figure 12.12CompletedDisallowedCombinationsFilter

Specify Disallowed Combinations Using a Script


Alternatively,youcanspecifydisallowedcombinationsbyconstructingascript.Afterloading
yourfactors(LoadFactorsonpage 341),dothefollowing:
1. ClickContinue.
2. SelectUse Disallowed Combinations Script.
3. CopythefollowingscriptandpasteitintheDisallowedCombinationsExpressionscript
box:
(Near Phone == "ISDN" & Near Interface == "A") |
(Far Phone == "ISDN" & Far Interface == "A") |
(Near Phone == "Bus" & Near Interface == "B") |
(Near Phone == "Res" & Near Interface == "B")

Chapter 12
Design of Experiments Guide

Covering Arrays
Example of a Covering Array with Factor Level Restrictions

345

Figure 12.13CompletedDisallowedCombinationsScriptWindow

Note: InDOEplatformsotherthanCoveringArrays,ascriptfordisallowedcombinations
mustspecifythelevelnumberratherthanthelevelname.
Construct the Design Table
Note: SettingtheRandomSeedinthenexttwostepsreproducestheexactresultsshownin
thisexample.Whenconstructingadesignonyourown,thesestepsarenotnecessary.
1. Fromtheredtrianglemenu,selectSet Random Seed.
2. Enter632andclickOK.
3. ClickMake Design.
TheDesignoutlineopenstoshowa20rundesign.AMetricsoutlineisaddedtothe
window.
Figure 12.14MetricsOutlineforPhoneDesign

TheMetricsoutlineindicatesthatStrength2coverageis100%.Thismeansthatall
permissibletwofactorcombinationsarerepresentedinthedesign.Thedesignalsocovers
65%ofallthreefactorcombinations.
4. ClickMake Table.
Thedesignisplacedinadesigntable.Acolumnfortheresponseisprovided,aswellas
variousscripts.

346

Covering Arrays
Example of a Covering Array with Factor Level Restrictions

Chapter 12
Design of Experiments Guide

Figure 12.15CoveringArrayDesignTable

Analyze the Experimental Data


Nowthatyouhaveyourdesigntable,youcanconductyourexperimentandrecordyourdata
intheResponsecolumnofthedesigntable.Yourexperimentalresultsareinthe
Phone Data.jmpsampledatatable.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Phone Data.jmp.
2. IntheTablepanel,clicktheredtrianglenexttoAnalysisandselectRun Script.
Figure 12.16AnalysisofPhoneExperimentalData

Chapter 12
Design of Experiments Guide

Covering Arrays
Covering Array Window

347

TheSummaryoutlineindicatesthatthreetestsfailed.
TheFailureAnalysisDetailsoutlinecontainsa2FactorInteractionsreport,becausea
twowayinteractionisthelowestlevelinteractionthatdetectsafailure.
The2FactorInteractionsreportshowsthecombinationsthatmighthavecausedthethree
failures.Itispossiblethatonecombination,Near InterfacesettoAandFar Phonesetto
Coin,isresponsibleforallthreefailures.Oritispossiblethattwoorthreeother
combinationscausedthethreefailures.
3. Selectthefirstlineinthe2FactorInteractionsreport.
Inthedatatable,rows1,3,and15areselected.Failuresoccurforthesecombinations,
regardlessofthesettingsforMarket,Near Phone,andFar Interface.Butnotethatother
combinationsoffactorsettingscouldaccountforthesefailuresaswell.

Covering Array Window


Thecoveringarraywindowupdatesasyouworkthroughthedesignsteps.Formore
informationaboutthegeneralflowofDOEwindows,seeTheDOEWorkflow:Describe,
Specify,Designonpage 54.Theoutlines,separatedbybuttonsthatupdatetheoutlines,
followtheflowinFigure 12.17.
Figure 12.17CoveringArrayFlow
Factors

Continue

Restrict Factor Level


Combinations

Factors
AddfactorsintheFactorsoutline.
Figure 12.18FactorsOutline

Make
Design

Design
Metrics
Output Options

Make
Table

348

Covering Arrays
Covering Array Window

Chapter 12
Design of Experiments Guide

EntersthenumberoffactorsspecifiedinAdd N Factors.Allfactorsare
categorical.Selectorspecifythenumberoflevels.

Add Factor

Remove Removestheselectedfactors.
Add N Factors Addsmultiplefactorswithaspecificnumberoflevels.Enterthenumberof

factorstoadd,clickAdd Factor,andselectorspecifythenumberoflevels.RepeatAdd N
Factorstoaddmultiplefactorswithdifferentnumbersoflevels.
Strength t = Selectavaluetospecifythestrengthofthearray.

Tip: WhenyouhavecompletedyourFactorspanel,selectSave Factorsfromtheredtriangle


menu.Thissavesthefactornamesandvaluesinadatatablethatyoucanlaterreload.See
CoveringArrayOptionsonpage 356.
Factors Table
TheFactorstablecontainsthefollowingcolumns:
Thenameofthefactor.Whenafactorisadded,itisgivenadefaultnameofX1,X2,
andsoon.Tochangethisname,doubleclickitandenterthedesiredname.

Name

Role SpecifiestheDesignRoleofthefactor.TheDesignRoleforallcoveringarrayfactorsis

Categorical.TheDesignRolecolumnpropertyforthefactorissavedtothedatatable.This
propertyensuresthatthefactorismodeledappropriately.
Thesettingsforthefactors.ToinsertValues,clickonthedefaultvaluesandenterthe
desiredvalues.Thevalueorderinginthedesigntableistheorderofthevaluesasentered
fromlefttoright.

Values

Editing the Factors Table


IntheFactorsoutline,noticethefollowing:

Toeditafactorname,doubleclickthefactorname.

Categoricalfactorshaveadownarrowtotheleftofthefactorname.Clickthearrowto
addalevel.

Toremoveafactorlevel,clickthevalue,clickDelete,andclickoutsidethetextbox.

Toeditavalue,clickthevalueintheValuescolumn.

Factor Column Properties


Foreachfactor,theValueLabelscolumnpropertyissavedtothedesigntable.TheValue
Labelscolumnpropertyrepresentsvaluesinacolumnwithspecifiedlabels.Theselabelsare

Chapter 12
Design of Experiments Guide

Covering Arrays
Covering Array Window

349

showninthedatatableandareusedinplotsandreports.Fordetails,seeValueLabelson
page 591intheColumnPropertiesappendix.

Restrict Factor Level Combinations


WhenyoucompletetheFactorsoutlineandclickContinue,theRestrictFactorLevel
Combinationsoutlineappears.Thisoutlineenablesyoutospecifyfactorlevelcombinations
thatareprohibited.Unlessyouhaveloadedaconstraintorincludedoneaspartofascript,the
Noneoptionisselected.Tospecifyconstraints,selectoneoftheotheroptions:
Use Disallowed Combinations Filter Definessetsofconstraintsbasedonrestrictingvaluesof

individualfactors.YoucandefinebothANDandORconstraints.SeeUseDisallowed
CombinationsFilteronpage 349.
Use Disallowed Combinations Script Definesdisallowedcombinationsandotherconstraints

asBooleanJSLexpressionsinascripteditorbox.SeeUseDisallowedCombinations
Scriptonpage 351.
Use Disallowed Combinations Filter
ThisoptionusesanadaptationoftheDataFiltertofacilitatespecifyingdisallowed
combinations.FordetailedinformationaboutusingtheDataFilter,seetheUsingJMPbook.
Toadddisallowedcombinations:
1. SelectfactorsfromtheAddFilterFactorslistandclickAdd.
2. Specifythedisallowedcombinationsbyselectinglevels.
Note: TheredtriangleoptionsintheAddFilterFactorsmenuarethesameasthosefoundin
theSelectColumnspanelofmanyplatformlaunchwindows.SeetheUsingJMPbookfor
additionaldetails.
WhenyouclickAdd,theinitialpanelisupdated.TheDisallowedCombinationscontrolpanel
showstheselectedfactorsandprovidesoptionsforfurthercontrol.
TheCoveringArrayplatformallowsonlycategoricalfactors.Forcategoricalfactors,the
possiblelevelsareshowneitheraslabeledblocksor,whenthenumberoflevelsislarge,aslist
entries.Selectaleveltodisallowit.Toselectmultiplelevels,holddowntheCtrlkey.Theblock
orlistentriesarehighlightedtoindicatethelevelsthathavebeendisallowed.Whenyouadda
factortotheDisallowedCombinationspanel,thenumberoflevelsofthecategoricalfactoris
giveninparenthesesfollowingthefactorname.
DisallowedCombinationsOptions
Clearsalldisallowedfactorlevelsettingsthatyouhavespecified.Thisdoesnotclear
theselectedfactors.

Clear

350

Covering Arrays
Covering Array Window

Chapter 12
Design of Experiments Guide

Start Over Removesallselectedfactorsandreturnsyoutotheinitiallistoffactors.


AND OpenstheAddFilterFactorslist.SelectedfactorsbecomeanANDgroup.Any

combinationoffactorlevelsspecifiedwithinanANDgroupisdisallowed.
ToaddafactortoanANDgrouplateron,clickthegroupsoutlinetoseeahighlighted
rectangle.SelectANDandaddthefactor.
Toremoveasinglefactor,selectDeletefromitsredtrianglemenu.
OR OpenstheAddFilterFactorslist.SelectedfactorsbecomeaseparateANDgroup.For

ANDgroupsseparatedbyOR,acombinationisdisallowedifitisspecifiedinatleastone
ANDgroup.
RedTriangleOptionsforFactors
AfactorcanappearinseveralORgroups.AnoccurrenceofthefactorinaspecificORgroupis
referredtoasaninstanceofthefactor.
Delete RemovestheselectedinstanceofthefactorfromtheDisallowedCombinationspanel.
Clear Selection

Clearsanyselectionforthatinstanceofthefactor.

Deselectstheselectedvaluesandselectsthevaluesnotpreviouslyselected
forthatinstanceofthefactor.

Invert Selection

Display Options

Changestheappearanceofthedisplay.Optionsincludethefollowing:

Blocks Displayshowseachlevelasablock.
List Displayshowseachlevelasamemberofalist.
Single Category Display showseachlevel.
Check Box Display addsacheckboxnexttoeachvalue.
Find Providesatextboxbeneaththefactornamewhereyoucanenterasearchstringfor

levelsofthefactor.PresstheEnterkeyorclickoutsidethetextboxtoperformthesearch.
OnceFindisselected,thefollowingFindoptionsappearintheredtrianglemenu:
Clear FindclearstheresultsoftheFindoperationandreturnsthepaneltoitsoriginal
state.
Match Caseusesthecaseofthesearchstringtoreturnthecorrectresults.
Containssearchesforvaluesthatincludethesearchstring.
Does not containsearchesforvaluesthatdonotincludethesearchstring.
Starts withsearchesforvaluesthatstartwiththesearchstring.
Ends withsearchesforvaluesthatendwiththesearchstring.

Chapter 12
Design of Experiments Guide

Covering Arrays
Covering Array Window

351

Use Disallowed Combinations Script


Thisoptionopensascriptwindowwhereyouinsertascriptthatidentifiesthecombinations
thatyouwanttodisallow.ThescriptmustevaluateasaBooleanexpression.Whenthe
expressionevaluatesastrue,thespecifiedcombinationisdisallowed.
Whencreatingtheexpression,usethenameofthelevelinquotationmarks.Donotusethe
ordinalvalueofthelevel.Forexample,Figure 12.19showsthescriptthatyouenteredinthe
phoneinterfaceexample,SpecifyDisallowedCombinationsUsingaScriptonpage 344.
Note: InDOEplatformsotherthanCoveringArrays,ascriptfordisallowedcombinations
mustspecifythelevelnumberratherthanthelevelname.
Figure 12.19ScriptWindowShowingNamesofLevelsinQuotes

Design
WhenyouclickMakeDesign,theDesignandMetricsoutlinesappear.Fordesignsthat
requireextensivecomputation,aprogressbarappears.
TheDesignoutlineshowsthedesignthatyouhaveconstructed.ThefirstcolumnlistsaRun
order.Youmightneedtousethescrollbartoviewalltheruns.Theremainingcolumnsshow
factorsettingsforeachrun.
Optimize
SelectOptimizetoreducethesizeofadesignthatwasconstructedbytheCoveringArray
platformorthatyouhaveloadedusingtheLoadDesignredtriangleoption.Optimizeisnot
availablefordesignsconstructedbytheCoveringArrayplatformthatareknowntobe
optimal.Inparticular,allunconstrainedstrength2designsfortwolevelfactorsconstructed
bytheplatformareoptimal.Also,anyunconstrainedstrengthtdesignfort+1factorsis
optimalforanyt.
Fordetailsaboutthealgorithm,seeAlgorithmforOptimizeonpage 357.

352

Covering Arrays
Covering Array Window

Chapter 12
Design of Experiments Guide

Note: Optimizeistimeintensive,butcanberunrepeatedlytoyieldincrementallybetter
designs.
UsetheMaximum iterationsoptiontospecifyamaximumnumberofiterationstobeusedin
optimizingthedesign.
Unsatisfiable Constraints
Ifasetofconstraintsprohibitstheconstructionofacoveringarraywhereallrequiredfactor
levelsarerepresented,itissaidtobeunsatisfiable.
ExampleofUnsatisfiableConstraints
Considerastrength2designforthreefactors,eachatthreelevels.
1. SelectDOE > Covering Array.
2. NexttoAdd N Factors,type3.
3. FromtheAdd Factormenu,select3 Level.
4. ClickContinue.
5. SelectUse Disallowed Combinations Filter.
6. FromtheAdd Filter Factorslist,selectallthreefactorsandclickAdd.
7. HolddowntheCtrlkeyandselectthefollowinglevels:
ForX1,selectL1.
ForX2,selectL1,L2,andL3.
ForX3,selectL3.
Figure 12.20CompletedRestrictFactorLevelCombinationsPanel

Chapter 12
Design of Experiments Guide

Covering Arrays
Covering Array Window

353

Note: SettingtheRandomSeedinthenexttwostepsreproducestheexactresultsshownin
thisexample.Whenconstructingadesignonyourown,thesestepsarenotnecessary.
8. FromtheCoveringArrayredtrianglemenu,selectSet Random Seed.
9. Enter12345andclickOK.
10. ClickMake Design.
Figure 12.21DesignandMetricsOutlines

AnotebeneaththeDesignoutlineindicatesthatonerunhasamissingsettingduetothe
constraints.Thatrunisrun11.Toensurethatthecoveringarrayhasstrength2,the
combinationofX1settoL1andX3settoL3isrequired.Butforthesesettings,the
constraintsprohibitallsettingsforX2.

Metrics
TheMetricsoutlinegivesyouinformationabouthowwellthedesignmeetsthestrength
requirements.SeeDalalandMallows(1998)forbackgroundonthesemetricsfor
unconstraineddesigns.
t Thenumberoffactors.
Coverage Theratioofthenumberofdistincttfactorsettingsthatappearinthedesigntothe

totalpossiblenumberoftfactorsettings,expressedasapercent.Atcoverageof100%

354

Covering Arrays
Covering Array Window

Chapter 12
Design of Experiments Guide

indicatesthatallpossibletfactorsettingsarecoveredbythedesign.Notethateachtfactor
settingcanappearmultipletimes.
Forconstrainedandunsatisfiabledesigns,thedefinitionofCoverageisadjustedforthe
numberoftfactorsettingsthatarepossibleoncetheconstraintshavebeenappliedtoall
tfactorcombinations.SeeFormulasforMetricsonpage 357.
Diversity Theratioofthenumberofdistincttfactorsettingsinthedesigntothetotalnumber

ofoccurrencesoftfactorsettingsinthedesign,expressedasapercentage.Thetdiversity
measureshowwellthedesignavoidsreplication.Atdiversityof100%indicatesthatno
tfactorsettingsarerepeated.Atdiversityof50%indicatesthattheaveragenumberof
timesthatdistincttfactorsettingsappearistwo.
Forconstrainedandunsatisfiabledesigns,thedefinitionofDiversityisadjustedforthe
numberofrunswithmissingsettings.SeeFormulasforMetricsonpage 357.

Output Options
Make Table ConstructstheCoveringArraydatatable.
Back TakesyoubacktotheFactorsoutline.Youcanmakechangestothepreviousoutlines

andregeneratethedesign.
Note: IfyouhavedefinedDisallowedCombinationsintheRestrictFactorLevelCombinations
outline,theseareretainedasascript.ThescriptisshownintheUseDisallowedCombinations
ScriptpanelwhenyouclickContinue.

The Covering Array Data Table


TheCoveringArraydatatablecontainsafirstcolumnwhereyoucanentertheresponse.The
remainingcolumnsgivethefactorsettings.
TheTablepanelintheupperleftcontainsaDesignnoteindicatingthatthedesignisa
CoveringArrayandgivingtheStrengthofthedesign.TheTablepanelalsocontainsthe
followingscripts.
DOE Dialog RecreatestheCoveringArraywindowthatyouusedtogeneratethedesign

table.
Disallowed Combinations ShowsfactorlevelrestrictionsthatyouenteredintheRestrict

FactorLevelCombinationsoutline.
Analysis Providesananalysisofyourexperimentaldata.Fordetails,seeAnalysisScripton

page 355.Forbackground,seeZhangandZhang(2011).
Tip: Torunascript,selectRun Scriptfromtheredtrianglemenu.

Chapter 12
Design of Experiments Guide

Covering Arrays
Covering Array Window

355

Figure 12.22PartialViewofCoveringArrayTableforSoftwareData.jmpShowingScripts

Analysis Script
TheAnalysisscriptassumesthefollowingabouttheResponsecolumn:

Theresponsesarerecordedas0forfailureand1forsuccess.

Missingvaluesarepermitted.

TheResponsecolumniscontinuous.

YoucanrenameormovetheResponsecolumn.

TheAnalysisscriptproducesareportwithtwooutlines:

TheSummaryoutlinegivesthenumberofrunsresultinginSuccess,Failure,andthe
numberofrunsforwhichtheresponseisMissing.

TheFailureAnalysisDetailsreportcontainsa<k>FactorInteractionsreport.Thevalueofk
isthesmallestnumberofinteractionsthatdetectafailure.(Foradefinitionofdetect,see
CoveringArraysandStrengthonpage 335.)Thethreecolumnscontainthefollowing:
TheFactorscolumnlistsallkfactorcombinationsthatdetectfailures.
TheFailure Levels columnliststhevaluesofthekfactorsintheFactorscolumnthat
detectfailures.
TheFailure Countcolumngivesthenumberoffailurescorrespondingtothekfactor
combinationofFailure Levels.
Note: Afailureobservationcanappearinmorethanoneofthekfactorcombinations
listedintheFailure Levelscolumn.

Therowsinthe<k>FactorInteractionsreportaredynamicallylinkedtothedatatable.Ifyou
selectoneormorerowsinthereport,thecorrespondingrowsareselectedinthedatatable.

356

Covering Arrays
Covering Array Options

Chapter 12
Design of Experiments Guide

Covering Array Options


TheredtrianglemenuintheCoveringArrayplatformcontainstheseoptions:
Save Factors Createsadatatablecontainingacolumnforeachfactorthatcontainsitsfactor

levels.Eachfactorscolumncontainsthesecolumnproperties:DesignRole,Value
Ordering,andFactorChanges.SavingfactorsenablesyoutoquicklyloadthemintoaDOE
window.
Note: YoucancreateafactorstableforaCoveringArraybyenteringdataintoanempty
table,butremembertoassigneachcolumnanappropriateDesignRoleofCategorical.
RightclickonthecolumnnameinthedatagridandselectColumn Properties > Design
Role.IntheDesignRolearea,selectCategorical.
LoadsfactorsthatyouhavesavedusingtheSaveFactorsoptionintothe
Factorsoutline.

Load Factors

Loadsadesignfromtheactivedatatable.Ifnodatatableisactive,youare
promptedtoopenone.WhenyouselectLoadDesign,amenuappearsthatenablesyouto
selectthecolumnsthatyouwanttospecifyasfactorsinthedesign.Allcolumnsare
importedascategorical.ColumnsandtheirvaluesarelistedintheFactorsoutline.The
DesignoutlineshowsaRunforeachrowinthedatatableandgivesthevaluesofthe
factorsforeachrun.

Load Design

TheLoadDesignoptionsenablesyoutoobtainmetrics,modify,orconstructanAnalysis
scriptforanexistingdesign:
TheMetricsoutlineshowstCoverageandtDiversityforthespecifieddesign.
YoucanclickBacktoimposefactorlevelrestrictionsandthenconstructanewdesign.
ClickingMake Tableconstructsadesigntablewhereyoucanenterresponses.Thetable
containsanAnalysisscriptforthedesign.
Set Random Seed SetstherandomseedthatJMPusestocontrolcertainactionsthathavea

randomcomponent.ForCoveringArrays,theseedselectsastartingdesignandan
iterationcount.Formostdesigns,therandomseedguaranteesreproducibilityofthe
design,butnotoftherunorder.
Note: Upperlimitsontimeaswellasiterationcountareusedtolimitdesignconstruction
time.Forsomelargeandhighstrengthdesigns,dependingonthemachine,thetimelimit
mightoverridetheiterationlimit.Forsuchdesigns,therandomseedwillnotguarantee
reproducibility.
Toreproduceadesign,entertherandomseedusedtogenerateitbeforeclickingMake
Design.

Chapter 12
Design of Experiments Guide

Covering Arrays
Technical Details

357

Note: TherandomseedassociatedwithadesignisincludedintheDOEDialogscriptthatis
savedtothedesigndatatable.
Advanced Options NotavailableforCoveringArrays.
Save Script to Script Window Createsthescriptforthedesignthatyouspecifiedinthe

CoveringArraywindowandplacesitinanopenscriptwindow.

Technical Details
Algorithm for Optimize
TheOptimizebuttoninvokesanalgorithmthatisconceptuallysimilartoaclassofcovering
arrayoptimizerssometimesreferredtoaspostconstructionrandomizedoptimizers(Nayerietal.,
2013).However,JMPsalgorithmdiffersfrommostinthatitalsoaddressesdesignswith
constraints.Inparticular,itoptimizesconstrainedcoveringarraysaswellasunsatisfiable,
constrainedcoveringarrays.
Thealgorithmassumesthatthedesigntobeoptimizedisacoveringarrayofthespecified
strength.ForaKfactordesignofstrengtht,thealgorithmiterativelyexaminesallKCtfactor
projectionstodeterminewhetherrunscanbeeliminatedormerged.Consequently,asKort
increases,theruntimeofthealgorithmquicklyescalates.Toimproveperformance,theJMP
implementationisthreadedtouseasmanyCPUcoresasareavailableonyourworkstation.

Formulas for Metrics


TheformulasforCoverageandDiversitydependonwhetherthereareconstraints.The
followingnotationisused:
uCvisthenumberofcombinationsofuthingstakenvatatime

tisthestrengthofthedesign
Kisthenumberoffactors
M = KCt
i = 1,2,..., Misanindexthatordersallcombinations,orprojections,oftfactors
vikisthenumberoflevelsforthekthfactor
niisthenumberofdistinctttuplesinthedesignfortheithprojection
piistheproductofthevikforthefactorsintheithprojection
risthenumberofrunsinthedesign

358

Covering Arrays
Technical Details

Chapter 12
Design of Experiments Guide

Unconstrained Design
CoverageandDiversityaregivenbythefollowing:
1
Coverage = ----M

ni pi

i=1
M

1
Diversity = ----M

ni r

i=1

Constrained Design
Inaconstraineddesign,certainttuplesarenotallowed.Thiscanresultinmissingvaluesfor
somettuples.Forsomecombinationsoftfactors,theremightbenovalidttupleswhatsoever.
Coverageanddiversitymustbedefinedintermsofthepossiblevalidcombinations.Forthis
reason,theformulasforconstraineddesignsrequireadditionalnotation:
aiisthenumberofinvalidttuplesarisingfromfactorsintheithprojection
misthenumberofprojectionswheretherearenovalidttuples
qiisthenumberofrunsinthedesignwithmissingvaluesforanyfactorintheith
projection
r i = r qi
M = M m
CoverageandDiversityaregivenbythefollowing:
1
Coverage = ------M

ni pi ai

i=1
M

1
Diversity = ------M

ni ri

i=1

Iftherearenoinvalidttuples(M = M)andiftherearenomissingvalues(ri r,foralli),then


thedefinitionsforcoverageanddiversityforconstraineddesignsreducetothedefinitionsfor
unconstraineddesigns.Fordetails,seeMorgan(2014).

Chapter 13
Discrete Choice Designs
TheDiscreteChoicedesignercreatesexperimentswithfactorsthatareproductattributes.A
collectionofattributesiscalledaproductprofile.Respondentschooseoneineachsetof
productprofiles.
Industrialexperimentationdealswiththequestionofhowtoimproveprocessestodeliver
betterproducts.Choiceexperimentshelpacompanyprioritizeproductfeaturesfortheir
market.Thepurposeofachoiceexperimentistodefineaproductthatpeoplewanttobuy.
Choiceexperimentsalwaysinvolvepeoplecomparingprospectiveproductsandpickingthe
onethattheyprefer.Forexample,supposeacomputercompanywantstoupdateitshighend
laptop.Laptopshavemanyfeaturesthatareimportanttocustomerssuchasprocessorspeed,
harddisksize,screensize,batterylife,andprice.Tobuildalaptopthatcustomerswant,the
computercompanyneedstoknowtherelativeimportanceofeachfeature.Mostpeopleprefer
afastercomputerwithmorestorage,longerbatterylife,andalowprice.Whatthecompany
doesnotknowishowmuchbatterylifeorharddisksizeisasimportantasdoublingthe
processorspeedworthtoacustomer.Achoiceexperimentcananswerthesequestionsand
indicatetheoptimalsetoftradeoffsamongproductfeatures.

Contents
CreateaChoiceDesignwithNoPriorInformation................................... 361
CreateanExampleChoiceExperiment ............................................. 361
CreateaChoiceDesignandAnalyzetheData ....................................... 365
CreateaChoiceExperimentforaPilotStudy .................................... 367
AnalyzethePilotStudyData .................................................. 370
DesignaChoiceExperimentUsingPriorInformation............................. 372
AdministertheSurveyandAnalyzeResults ..................................... 374
ChoiceDesignOptions........................................................... 377

Chapter 13
Design of Experiments Guide

Discrete Choice Designs


Create a Choice Design with No Prior Information

361

Create a Choice Design with No Prior Information


Inthisexample,acoffeeshopisinterestedinmakinganidealcupofcoffeetosatisfythe
majorityofitscustomers.Thecoffeeshopcanvaryeachcupofcoffeebygrindsize,
temperature,brewingtime,andtheamountofcoffeegrindsused(charge).Theywantto
knowwhichfactorsaffecttheircustomerspreferences.Whereshouldtheyseteachfactorto
makeanidealcupofcoffee?
Wecandesignasimpleexperimentwherewesystematicallyvaryeachfactorfordifferent
combinationsandaskpeoplewhichtheyprefer.

Grindsize(mediumorcoarse)

Temperature(195,200,205)

Brewingtime(3minutes,3.5minutes,or4minutes)

Charge(1.6grams/ounce,2grams/ounce,or2.4grams/ounce)

Everyparticipantcouldsampleeverypossiblecombinationofcupsofcoffee,butthiswould
notbeefficientoreconomical.Instead,eachparticipantcanindicatehisorherpreferencein
severalchoicesets.Inthesimplestdesign,eachchoicesetwouldhaveonlytwocupsofcoffee
tochoosebetween.Analysisofthepreferencesofmultiplerespondentscanbeusedtodraw
conclusionsabouthowtomakeacupofcoffeethatpleasesmostcustomers.
Inthiscoffeeexperiment,fourrespondentschoosetheirpreferencebetweenthreesetsoftwo
cupsofcoffeeeach.Thisisrepeatedseventimesforatotalof21responsesperrespondent.
Thegoalistogivethecoffeeshopthemostimportantinformationfortheleasttimeand
expense.Thus,eachrespondenttastescupsofcoffeethatarethebestrepresentationsofthe
factorsathand.

Create an Example Choice Experiment


1. ChoseDOE>Choice Design,andcompletetheinitialwindowasshowninFigure 13.1.
ForGrind,selectAdd Factorandthen2 Level.
Fortheremainingfactors,selectAdd Factorandthen3 Level.
EnterthevaluesshowninFigure 13.1.

362

Discrete Choice Designs


Create an Example Choice Experiment

Figure 13.1ChoiceDesignWindowwithAttributesDefined

2. ClickContinue.
3. IntheModelpanel,opentheDOEModelControlsoutline.

Chapter 13
Design of Experiments Guide

Chapter 13
Design of Experiments Guide

Discrete Choice Designs


Create an Example Choice Experiment

363

Figure 13.2ChoiceDesignWindow

4. Enter21forthenumber of choice sets per survey.


5. Enterfourfortheexpected number of respondents per survey.
ThevaluesintheDesignGenerationpaneldescribethecoffeeexperiment.
Thereare21choicesetsinthisexamplesurvey.Eachrespondentchooseshisorher
preferenceinthreechoicesetsoftwocupsofcoffeeeach.Thisisrepeatedforseventrials,
soweenter21forthenumber of choice sets per survey.
Inthisexample,wehaveonlyfourrespondentsandonesurvey,soweenter4forthe
expected number of respondents per survey.

6. ClickMake DesigntoseetheexamplesurveyresultsinFigure 13.3.Notethatonlyasubset


ofchoicesetsareshown.
Thereare21choicesets,eachconsistingoftwocoffeeprofiles.

364

Discrete Choice Designs


Create an Example Choice Experiment

Chapter 13
Design of Experiments Guide

Figure 13.3SurveyResultsBasedonaSimpleModelandDefaultPriorInformation

7. SelectOutput separate tables for profiles and responses beneaththedesignsettingsto


generatethesurveysettingsinoneJMPtableandsurveyresultsinasecondtable.
8. ClickMake Tableandtwodatatablesaregenerated.Figure 13.4showstheChoiceProfiles
table,whichliststhecombinationsoffactorsforeachchoiceset.TheChoiceRunstablein
Figure 13.5enablesyoutoenteraresponseforeachrespondentspreferenceineachchoice
set.

Chapter 13
Design of Experiments Guide

Discrete Choice Designs


Create a Choice Design and Analyze the Data

365

Figure 13.4ChoiceProfilesforExperimentDesign

Figure 13.5ChoiceRunsforExperimentDesign

YoucannowanalyzetheseresultsusingtheChoiceplatformintheAnalyzemenu(Analyze>
Consumer Research>Choice).SeeConsumerResearchbookfordetails.

Create a Choice Design and Analyze the Data


AnotherwaytousetheDOEplatformistogenerateasmallpilotstudy,analyzetheresults,
andusetheparameterestimatestodesignalargerstudy.Forthisexample,acomputer
manufacturerisinterestedinmanufacturinganewlaptopandwantsinformationabout

366

Discrete Choice Designs


Create a Choice Design and Analyze the Data

Chapter 13
Design of Experiments Guide

customerpreferencebeforebeginninganexpensivedevelopmentprocess.Theydecideto
examinepreferencesforfourpossiblelaptopattributes.

sizeofharddrivedisk(40GBor80GB)

speedofprocessor(1.5GHzor2.0GHz)

batterylife(4Hrsor6Hrs)

costofcomputer($1000,$1200or$1500)

Table 13.1showshypotheticalresultsfromasinglesurveydesignedtocollectinformation
aboutconsumerpreferencesforlaptopcomputers.

Eachcolumninthesurveyidentifiesalaptopattribute.

Eachlineinthesurveydefinesalaptopprofile,whichisacollectionofattributevalues.

Eachchoicesetconsistsoftwoattributeprofiles.

Alloftheattributevaluesareallowedtochangeacrossthetwoprofilesinachoiceset.

Table 13.1HypotheticalChoiceSurveyResultsfromaSingleRespondent,SubjectID2
For each pair, please check the combination of attributes that you find most
appealing.

Disk Size

Speed

Battery Life

Price

Preference

40 GB

1.5 GHz

6 hours

$1,000

_X_

80 GB

1.5 GHz

4 hours

$1,200

___

40 GB

1.5 GHz

4 hours

$1,500

___

80 GB

2.0 GHz

4 hours

$1,200

_X_

40 GB

2.0 GHz

4 hours

$1,200

_X_

80 GB

2.0 GHz

6 hours

$1,500

___

40 GB

2.0 GHz

4 hours

$1,000

_X_

80 GB

1.5 GHz

6 hours

$1,200

___

40 GB

1.5 GHz

6 hours

$1,000

_X_

40 GB

2.0 GHz

4 hours

$1,500

___

Chapter 13
Design of Experiments Guide

Discrete Choice Designs


Create a Choice Design and Analyze the Data

367

Table 13.1HypotheticalChoiceSurveyResultsfromaSingleRespondent,SubjectID
For each pair, please check the combination of attributes that you find most
appealing.

Disk Size

Speed

Battery Life

Price

Preference

40 GB

2.0 GHz

6 hours

$1,200

_X_

80 GB

1.5 GHz

4 hours

$1,500

___

40 GB

2.0 GHz

6 hours

$1,500

___

80 GB

1.5 GHz

4 hours

$1,000

_X_

40 GB

1.5 GHz

4 hours

$1,200

___

80 GB

2.0 GHz

4 hours

$1,000

_X_

TheDOEChoicedesignercancreateasurveylikethatshowninTable 13.1.However,tocreate
aneffectivedesign,theChoicedesignerneedsinformationabouttheattributes.Forexample,
mostlaptopattributeshavevaluesthatareintrinsicpreferences.Thatis,abiggerdisksizeis
better,longerbatterylifeisbetter,andsoon.Thepurposeofconductingachoicesurveyisto
findouthowpotentiallaptoppurchasersfeelabouttheadvantagesofacollectionof
attributes.
Onewaytogainpriorinformationaboutsurveyattributesistoconductasingleexample
surveyandusetheresultsaspriorinformationtocreatethefinalsurvey.
Thischaptershowshowtocreateasamplesurveyforapilotstudyanduseitsresultsasprior
informationforafinalsurveydesign.

Create a Choice Experiment for a Pilot Study


TheChoicedesigncancreateasurveyliketheoneinTable 13.1.
1. ChooseDOE>Choice Design,andcompletetheinitialwindowasshowninFigure 13.6.

368

Discrete Choice Designs


Create a Choice Design and Analyze the Data

Chapter 13
Design of Experiments Guide

Figure 13.6ChoiceDesignWindowwithAttributesDefined

2. ClickContinue.Forthisexample,usethedefaultvaluesintheDOEModelControlsand
DesignGenerationpanels,asshowninFigure 13.7.
Figure 13.7DesignGenerationPanelfortheLaptopExperiment

Note: Recallthatthisfirstexampleisusedtogeneratepriorinformation,thenusedto
createamorerealisticsurvey.Thisexampleisasinglesurveygiventoasinglerespondent.
3. ClickMake DesigntoseetheexamplesurveyresultsinFigure 13.8.
Youcanseethatthereareeightchoicesets,eachconsistingoftwolaptopprofiles.

Chapter 13
Design of Experiments Guide

Discrete Choice Designs


Create a Choice Design and Analyze the Data

369

Figure 13.8SurveyResultsBasedonaSimpleModelandDefaultPriorInformation

4. SelectCombine profiles and responses in one tablebeneaththedesignsettingstogenerate


thesurveysettingsandsurveyresultsinthesametable.
5. ClickMake Table.
Thisdefaultdesignwascreatedwithnogivenpriorinformation.Withoutpriorinformation,
thereisnowayofknowingwhichattributelevelsarebetter(forexample,thatalowerprice
mightbemoredesirablethanahigherprice).Asaresult,youcanseethatsomechoicesets
mightnotconveyusefulinformation.Theanalysisresultsareusedaspriorinformationina
newChoiceDesignwindow.

370

Discrete Choice Designs


Create a Choice Design and Analyze the Data

Chapter 13
Design of Experiments Guide

Figure 13.9JMPDataTableforPreliminaryLaptopChoiceSurvey

Analyze the Pilot Study Data


Onceasurveydesigniscomplete,arespondentchoosesoneprofilefromeachset,entering1
forthechosenprofileand0fortherejectedprofile.Supposearespondentcompletedthe
examplesurveyasshowninFigure 13.10.YoucannowanalyzetheseresultsusingtheChoice
platformintheAnalyzemenu(Analyze>Consumer Research >Choice).
Figure 13.10JMPTablewithSurveyChoiceSetsandResponses

1. ClicktheChoicescriptinthe Laptop DesignsampledatatableandselectRun Script to


analyzethosedatawiththeChoicemodelingplatformfromtheAnalyzemenu.
WhenyouruntheChoicemodelscript,theChoiceplatformlaunchwindowshownin
Figure 13.11appears.TheChoicewindowisdesignedtocoveravarietyofchoicesurvey
results,whichcanincludedatasavedinmultipledatatables.Thisexampleshowsalldata

Chapter 13
Design of Experiments Guide

Discrete Choice Designs


Create a Choice Design and Analyze the Data

371

inasingletable.FordetailsaboutusingtheChoiceanalysisplatform,seetheChoice
platformchapterintheConsumerResearchbook.
Figure 13.11ChoiceModelFittingDialog

2. ClickRun ModelontheChoicemodelfittingwindow.
3. Anadditionalwindowthenappears,askingifthisisaonetableanalysiswithallthedata
intheProfileTable,whichisthecaseinthissamplesurvey.ClickYes inthiswindowto
continue.
TheanalysisshowsasinFigure 13.12.
Todesignthefinalchoicesurveyusingpriorinformation,youneedtoenterestimatesof
themeanandvarianceoftheattributeparameterestimates.Theanalysisonthetopin
Figure 13.12hasestimatesoftheattributemeans,calledEstimate,andestimatesofthe
standarddeviationoftheattributes,called Std Error.Aneasywaytoseethevarianceofthe
attributesistocapturetheanalysisinaJMPtableandcomputethevariance.
4. RightclicktheParameterEstimatesreportandselectMake into Data Tablefromthemenu,
asshown.
5. InthenewUntitleddatatable,createanewcolumnandcallitVar.
6. SelectFormula fromtheColsmenu(Cols>Formula),orrightclicktheVarcolumnand
selectFormula.
7. IntheFormulaEditor,clicktheStd Errorcolumninthecolumnlistandclicktheexponent
button( )ontheformulaeditorpaneltocomputethevarianceshownontherightin
Figure 13.12.

372

Discrete Choice Designs


Create a Choice Design and Analyze the Data

Chapter 13
Design of Experiments Guide

Figure 13.12AnalysisoftheSampleLaptopSurvey

Thispreliminarysurveywithitsanalysisgivesyoutheinformationneededtodesignafinal
surveyappropriateforgatheringinformationfrommultiplerespondents.Keepinmindthat
inarealsituation,youmighthavepriorinformationaboutfactorattributesandnotneedtodo
asampledesign.
Note: LeavetheUntitleddatatablewiththemeanandvarianceinformationopentobeusedin
thenextexample.

Design a Choice Experiment Using Prior Information


Insomesituations,youmightknowfromprevioussurveysorexperiencehowtospecifyprior
informationintheChoicedesigneraboutproductattributes.Thisexamplecontinuesby
designingthelaptopexperimentagain,usingtheanalysisinformationgainedfromthe
sampledesign.
1. ChooseDOE>Choice Designandentertheattributesandvaluesasbefore.
2. ClickContinuetoseetheChoicedesignpanelsinFigure 13.13.

Chapter 13
Design of Experiments Guide

Discrete Choice Designs


Create a Choice Design and Analyze the Data

373

3. NowenterthevaluesfromtheJMPtablecreatedbythepreviousanalysisintothePrior
MeanandPriorVarianceMatrixpanelsoftheChoiceDesignwindow,asshownin
Figure 13.13.Youcancopyandpastetotransferthevaluesfromthedatatabletothe
Choicewindowpanels.
Figure 13.13EnterPriorMeanandVarianceInformationfromPreliminarySurvey

4. IntheDesignGenerationpanel,enter2forthenumber of surveys andfiveforthe


expected number of respondents per survey,asshowninFigure 13.14.Thisgivesusatotal
of10respondents.
Figure 13.14DesignSpecificationsforFinalLaptopSurvey

5. ClickMake Design.ApartialviewofthedesignisshowninFigure 13.15.

374

Discrete Choice Designs


Create a Choice Design and Analyze the Data

Chapter 13
Design of Experiments Guide

Figure 13.15DesignRunsforTwoChoiceSurveys

6. ClickMake Table.Thefinaldatatablehasrunsfortensurveyrespondents,givingatotalof
160observations(2profiles*8choicesets*2surveys*5respondents=160observations).

Administer the Survey and Analyze Results


ThesurveydatatablewithitsresultsisstoredintheSampleDataDesignExperimentfolder
installedwithJMP.Figure 13.16isapartiallistingofthesurveydatatablewithresults.The
ChoicescriptcreatedbytheChoicedesignerandsavedwiththesurveydatatablecanbeused
toanalyzethedata.ThedefaultdatatablecreatedbytheChoicedesignerisnamedChoice
Profiles.NoteinFigure 13.16,thedatatablenameischangedtoLaptopResults.
Initial Choice Platform Analysis
1. Tocontinuetheexample,openthetablecalledLaptop Results.jmp,savedinthesample
datafolder.
2. Toanalyzethedata,clicktheChoicescriptsavedwiththedataandselectRun Scriptfrom
themenutoseethecompletedwindowshowninFigure 13.16.
Notethatthiswindowhasthreegroupingvariables(Respondent,Survey,andChoice Set).
ThewindowshowninFigure 13.11hadonlytheChoice Setgroupingvariablebecause
therewasasinglesurveyandasinglerespondent.Thisexampleincludedmultiple
surveysandrespondents,whichmustbeincludedintheanalysis.

Chapter 13
Design of Experiments Guide

Discrete Choice Designs


Create a Choice Design and Analyze the Data

375

Figure 13.16ChoiceModelFittingWindowtoAnalyzetheLaptopSurvey

3. ClickRun ModelontheFitModelwindow.Thequeryagainappears,askingiftheanalysis
isaonetableanalysiswithallthedataintheprofiletable.ClickYestoseetheinitial
analysisresultshowninFigure 13.17.
Theresultsareclear.Alloftheeffectsaresignificant(ormarginallysignificantforBattery
Life),andthemostsignificantattributeisSpeed.
Figure 13.17InitialAnalysisoftheFinalLaptopSurvey

376

Discrete Choice Designs


Create a Choice Design and Analyze the Data

Chapter 13
Design of Experiments Guide

Find Unit Cost and Trade Off Costs with the Profiler
Youwouldliketoknowhowchangingtheprice,orothercharacteristics,ofalaptopaffectsthe
desirabilityasperceivedbypotentialbuyers.Thisdesirabilityiscalledtheutilityvalueofthe
laptopattributes.Theprofilershowstheutilityvalueandhowitchangesasthelaptop
attributeschange.
1. SelectProfilerfromthemenuontheChoiceModeltitlebartoseethePredictionProfilerin
Figure 13.18.
Figure 13.18DefaultPredictionProfilerforLaptopChoiceAnalysis

Wheneachattributevalueissettoitslowestvalue,theUtilityvalueis0.3406.Thefirst
thingthatyouwanttoknowistheunitutilitycost.
2. Tofindtheunitutilitycost,movethetraceforPriceto$1,500andnotehowtheUtility
valuechanges.
ComparetheUtilityvaluesinFigure 13.18andFigure 13.19.ThevalueofUtilitychanges
from0.3406to2.3303whencostisraisedfrom$1,000to$1,500.Thatis,raisingtheprice
ofalaptop$500.00lowerstheutility(ordesirability)approximately2units.Thus,youcan
saythattheunitutilitycostisapproximately$250.00.
Figure 13.19CompareChangeinUtilityOverPrice

Withthisunitutilitycostestimate,youcannowvarytheotherattributes,notethechange
inutility,andfindanapproximatedollarvalueassociatedwiththatattributechange.For
example,themostsignificantattributeisspeed(seeFigure 13.17).

Chapter 13
Design of Experiments Guide

Discrete Choice Designs


Choice Design Options

377

3. InthePredictionProfiler,setPricetoitslowestvalueandchangeSpeedtoitshighervalue.
YoucanseeinFigure 13.20thattheUtilityvaluechangesfromtheoriginalvalueshownin
Figure 13.18of0.3406to0.9886,foratotalchangeof1.3292units.Iftheunitutilitycostis
estimatedtobe$250.00,asshownabove,thentheincreaseinpricefora2.0GHzlaptop
overa1.5GHzlaptopcanbecomputedtobe1.3292*$250.00=$332.30.Thisisthedollar
valuetheChoicesurveyprovidesthemanufacturerasabasisforpricingdifferentlaptop
products.Youcanmakesimilarcalculationsfortheotherattributes.
Figure 13.20ChangeSpeedinProfilerandNoteUtilityValue

ThissimpleChoicesurveyanditsanalysisshowshowthiskindifinformationcanbeusedto
helpmanufacturersandretailersidentifyimportantproductattributesandassignvaluesto
them.
TheChoicedesignerallowsmorecomplexdesigns,suchasdesignswithinteractionsand
otherterms.TheChoiceanalysisplatformcanbeusedtoanalyzecomplexdesigns,anditcan
beusedtoincorporatedatafrommultipledatasetsthatincludedemographicinformation
abouttherespondents.

Choice Design Options


IntheChoiceDesignwindow,thereareseveraloptionstospecifyyourdesign.

TheDOEModelControlsenableyoutospecifypotentialmaineffectsandinteractions.In
somesituations,youmightexpectthereareinteractionsandwanttogenerateprofilesets
thathelpdetectthem.YoucanusetheDOEModelControlspaneltoaddinteractionsto
thechoicemodel.
Toaddaninteraction,clicktheInteractionsbutton.Allpossibleinteractionsload.After
addingtheinteraction,theDOEModelControlspanelcollapses.Ifyoudonotwantto
testalloftheinteractions,opentheDOEModelControlspanel,highlightthe
interactionsthatyoudonotwant,andclicktheRemove Termbutton.

ThePriorSpecificationpanelenablesyoutoenterpriormeansandvariancesaswedidin
thelaptopexample.

378

Discrete Choice Designs


Choice Design Options

Chapter 13
Design of Experiments Guide

YoucanspecifyaspectsofyourdesignwiththeDesignGenerationpanel.
Numberofattributesthatcanchangewithinachoiceset: Thisisusuallythetotal
numberofattributes,orvariables,youareexamining.Youcanenterfewerthanthe
totalnumberofattributestoconstrainthetotalnumberthatcanbechangedwithina
choiceset.Thismightbeareasonablethingtodoifyouhadalargenumberof
attributesandyouwanttomakeiteasierfortherespondentstomakeachoice.For
example,asurveymightbeinterestedin20ormoreattributesofacellphone,butshow
andchangeonly5orfewerattributesinachoiceset.
Numberofprofilesperchoiceset:Thenumberofitemsthatarecomparedforeach
preferencetest.Youcandesignchoiceexperimentswithmorethantwoprofilesina
choiceset.
Numberofchoicesetspersurvey:Thenumberofpreferencesthatyouwanttogetfrom
eachrespondent.
Numberofsurveys:Youmightwanttogenerateseveralversionsofthesurveyto
administertomultiplerespondents.
Expectednumberofrespondentspersurvey:Thetotalnumberofrespondentsforeach
survey.Ifyouhave100respondentsand4differentsurveys,youwouldhave25
respondentspersurvey.

Chapter 14
Space-Filling Designs
Spacefillingdesignsareusefulinsituationswhereruntorunvariabilityisoffarlessconcern
thantheformofthemodel.Considerasensitivitystudyofacomputersimulationmodel.In
thissituation,andforanymechanisticordeterministicmodelingproblem,anyvariabilityis
smallenoughtobeignored.Forsystemswithnovariability,replication,randomization,and
blockingareirrelevant.
TheSpaceFillingplatformprovidesdesignsforsituationswithbothcontinuousand
categoricalfactors.Forcontinuousfactors,spacefillingdesignshavetwoobjectives:

maximizethedistancebetweenanytwodesignpoints

spacethepointsuniformly

Figure 14.1SpaceFillingDesign

Contents
OverviewofSpaceFillingDesigns................................................. 381
SpaceFillingDesignWindow ..................................................... 382
Responses ................................................................... 382
Factors ...................................................................... 384
DefineFactorConstraints ..................................................... 386
SpaceFillingDesignMethods .................................................. 390
Design ...................................................................... 390
DesignDiagnostics........................................................... 390
DesignTable................................................................. 390
SpaceFillingDesignOptions ..................................................... 391
SpherePackingDesigns .......................................................... 393
CreatingaSpherePackingDesign .............................................. 393
VisualizingtheSpherePackingDesign .......................................... 394
LatinHypercubeDesigns......................................................... 396
CreatingaLatinHypercubeDesign............................................. 396
VisualizingtheLatinHypercubeDesign......................................... 397
UniformDesigns ................................................................ 399
ComparingSpherePacking,LatinHypercube,andUniformMethods .................. 401
MinimumPotentialDesigns ...................................................... 402
MaximumEntropyDesigns....................................................... 404
GaussianProcessIMSEOptimalDesigns........................................... 406
FastFlexibleFillingDesigns ...................................................... 407
FFFOptimalityCriterion...................................................... 407
SetAverageClusterSize....................................................... 407
Constraints .................................................................. 408
CreatingandViewingaConstrainedFastFlexibleFillingDesign ................... 408
BoreholeModel:ASpherePackingExample ........................................ 410
CreatetheSpherePackingDesignfortheBoreholeData........................... 411
GuidelinesfortheAnalysisofDeterministicData................................. 412

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Overview of Space-Filling Designs

381

Overview of Space-Filling Designs


Spacefillingdesignsareusefulformodelingsystemsthataredeterministicor
neardeterministic.Oneexampleofadeterministicsystemisacomputersimulation.Such
simulationscanbeverycomplexinvolvingmanyvariableswithcomplicated
interrelationships.Agoalofdesignedexperimentsonthesesystemsistofindasimpler
empiricalmodelthatadequatelypredictsthebehaviorofthesystemoverlimitedrangesofthe
factors.
Inexperimentsonsystemswherethereissubstantialrandomnoise,thegoalistominimize
thevarianceofprediction.Inexperimentsondeterministicsystems,thereisnovariancebut
thereisbias.Biasisthedifferencebetweentheapproximationmodelandthetrue
mathematicalfunction.Thegoalofspacefillingdesignsistoboundthebias.
Therearetwoschoolsofthoughtonhowtoboundthebias.Oneapproachistospreadthe
designpointsoutasfarfromeachotheraspossibleconsistentwithstayinginsidethe
experimentalboundaries.Theotherapproachistospacethepointsoutevenlyovertheregion
ofinterest.
TheSpace Fillingdesignersupportsthefollowingdesignmethods:
Note: Ifthenumberofrunsis500orless,aGaussianProcessmodelissavedtothedatatable.
Ifthenumberofrunsexceeds500,aNeuralmodelissavedtothedatatable.
Sphere Packing maximizestheminimumdistancebetweenpairsofdesignpoints.
Latin Hypercube maximizestheminimumdistancebetweendesignpointsbutrequireseven

spacingofthelevelsofeachfactor.Thismethodproducesdesignsthatmimictheuniform
distribution.TheLatinHypercubemethodisacompromisebetweentheSpherePacking
methodandtheUniformdesignmethod.
minimizesthediscrepancybetweenthedesignpoints(whichhaveanempirical
uniformdistribution)andatheoreticaluniformdistribution.

Uniform

Minimum Potential

spreadspointsoutinsideaspherearoundthecenter.

Maximum Entropy

measurestheamountofinformationcontainedinthedistributionofaset

ofdata.
Gaussian Process IMSE Optimal createsadesignthatminimizestheintegratedmeansquared

erroroftheGaussianprocessovertheexperimentalregion.
Fast Flexible Filling TheFastFlexibleFillingmethodformsclustersfromrandompointsin

thedesignspace.Theseclustersareusedtochoosedesignpointsaccordingtoan
optimizationcriterion.Thisistheonlymethodthatcanaccommodatecategoricalfactors
andconstraintsonthedesignspace.Youcanspecifylinearconstraintsanddisallowed

382

Space-Filling Designs
Space Filling Design Window

Chapter 14
Design of Experiments Guide

combinations.SeeCreatingandViewingaConstrainedFastFlexibleFillingDesignon
page 408andseeFFFOptimalityCriteriononpage 407.

Space Filling Design Window


TheSpaceFillingDesignwindowupdatesasyouworkthroughthedesignsteps.Theoutlines
thatappear,separatedbybuttonsthatupdatethewindow,followtheflowinFigure 14.2.
Figure 14.2SpaceFillingDesignFlow
Responses
Factors

Continue

Define Factor Constraints

Space Filling
Design Methods

Design
Design Diagnostics

Make
Table

ThissectiondescribestheoutlinesintheSpaceFillingDesignwindow.

Responses
UsetheResponsesoutlinetospecifyoneormoreresponses.
Figure 14.3ResponsesOutline

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Space Filling Design Window

383

TheResponsesoutlinecontainsthefollowingbuttons:
EntersasingleresponsewithagoaltypeofMaximize,MatchTarget,
Minimize,orNone.IfyouselectMatchTarget,enterlimitsforyourtargetvalue.Ifyou
selectMaximizeorMinimize,enteringlimitsisnotrequiredbutcanbeuseful.

Add Response

Remove Removestheselectedresponses.

Entersadditionalresponsessothatthenumberthatyouenteristhe
totalnumberofresponses.IfyouhaveenteredaresponseotherthanthedefaultY,the
GoalforeachoftheadditionalresponsesistheGoalassociatedwiththelastresponse
entered.Otherwise,theGoaldefaultstoMatchTarget.ClicktheGoaltypeinthetableto
changeit.

Number of Responses

Tip: WhenyouhavecompletedyourResponsespanel,considerselectingSave Responses


fromtheredtrianglemenu.Thissavestheresponsenames,goals,limits,andimportance
valuesinadatatablethatyoucanlaterreload.
TheResponsesoutlinecontainsthefollowingcolumns:
Thenameoftheresponse.Whenadded,aresponseisgivenadefaultname
ofY,Y2,andsoon.Tochangethisname,doubleclickitandenterthedesiredname.

Response Name

Goal, Lower Limit, Upper Limit TheGoaltellsJMPwhetheryouwanttomaximizeyour

response,minimizeyourresponse,matchatarget,orthatyouhavenoresponsegoal.JMP
assignsaResponseLimitscolumnproperty,basedonthesespecifications,toeachresponse
columninthedesigntable.Itusesthisinformationtodefineadesirabilityfunctionforeach
response.TheProfilerandContourProfilerusethesedesirabilityfunctionstofindoptimal
factorsettings.Forfurtherdetails,seetheProfilersbookandResponseLimitson
page 562intheColumnPropertiesappendix.
AGoalofMaximizeindicatesthatthebestvalueisthelargestpossible.Ifthereare
naturallowerorupperbounds,youcanspecifytheseastheLowerLimitorUpper
Limit.
AGoalofMinimizeindicatesthatthebestvalueisthesmallestpossible.Ifthereare
naturallowerorupperbounds,youcanspecifytheseastheLowerLimitorUpper
Limit.
AGoalofMatchTargetindicatesthatthebestvalueisaspecifictargetvalue.The
defaulttargetvalueisassumedtobemidwaybetweentheLowerLimitandUpper
Limit.
AGoalofNoneindicatesthatthereisnogoalintermsofoptimization.Nodesirability
functionisconstructed.

384

Space-Filling Designs
Space Filling Design Window

Chapter 14
Design of Experiments Guide

Note: IfyourtargetresponseisnotmidwaybetweentheLowerLimitandtheUpper
Limit,youcanchangethetargetafteryougenerateyourdesigntable.Inthedatatable,
opentheColumnInfowindowfortheresponsecolumn(Cols>Column Info)andenterthe
desiredtargetvalue.
Importance Whenyouhaveseveralresponses,theImportancevaluesthatyouspecifyare

usedtocomputeanoveralldesirabilityfunction.Thesevaluesaretreatedasweightsfor
theresponses.Ifthereisonlyoneresponse,thenspecifyingtheImportanceisunnecessary
becauseitissetto1bydefault.
EditingtheResponsesOutline
IntheResponsesoutline,notethefollowing:

Doubleclickaresponsetoedittheresponsename.

Clickthegoaltochangeit.

Clickonalimitorimportancevaluetochangeit.

Formultipleresponses,youmightwanttoentervaluesfortheimportanceweights.

Response Limits Column Property


TheGoal,LowerLimit,UpperLimit,andImportancethatyouspecifywhenyouentera
responseareusedinfindingoptimalfactorsettings.Foreachresponse,theinformationis
savedinthegenerateddesigndatatableasaResponseLimitscolumnproperty.JMPusesthis
informationtodefinethedesirabilityfunction.Thedesirabilityfunctionisusedinthe
PredictionProfilertofindoptimalfactorsettings.ForfurtherdetailsabouttheResponse
Limitscolumnpropertyandexamplesofitsuse,seeResponseLimitsonpage 562inthe
ColumnPropertiesappendix.
IfyoudonotspecifyaLowerLimitandUpperLimit,JMPusestherangeoftheobserveddata
fortheresponsetodefinethelimitsforthedesirabilityfunction.SpecifyingtheLowerLimit
andUpperLimitgivesyoucontroloverthespecificationofthedesirabilityfunction.Formore
detailsabouttheconstructionofthedesirabilityfunction,seetheProfilersbook.

Factors
AddfactorsintheFactorsoutline.

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Space Filling Design Window

385

Figure 14.4FactorsOutline

TheFactorsoutlinecontainstheseoptions:
Continuous EntersthenumberofcontinuousfactorsspecifiedinAdd N Factors.
Categorical

EntersthenumberofnominalfactorsspecifiedinAdd N Factors.

Remove Removestheselectedfactors.
Add N Factors Addsmultiplefactorsofagiventype.Enterthenumberoffactorstoaddand

clickContinuousorCategorical.RepeatAdd N Factorstoaddmultiplefactorsofdifferent
types.
Tip: WhenyouhavecompletedyourFactorspanel,selectSave Factorsfromtheredtriangle
menu.Thissavesthefactornamesandvaluesinadatatablethatyoucanlaterreload.See
SpaceFillingDesignOptionsonpage 391.
Factors Outline
TheFactorsoutlinecontainsthefollowingcolumns:
Name Thenameofthefactor.Whenadded,afactorisgivenadefaultnameofX1,X2,andso

on.Tochangethisname,doubleclickitandenterthedesiredname.
Role SpecifiestheDesignRoleofthefactor.TheDesignRolecolumnpropertyforthefactor

issavedtothedatatable.Thispropertyensuresthatthefactortypeismodeled
appropriately.
Theexperimentalsettingsforthefactors.ToinsertValues,clickonthedefaultvalues
andenterthedesiredvalues.

Values

EditingtheFactorsOutline
IntheFactorsoutline,notethefollowing:

Toeditafactorname,doubleclickthefactorname.

386

Space-Filling Designs
Space Filling Design Window

Chapter 14
Design of Experiments Guide

Categoricalfactorshaveadownarrowtotheleftofthefactorname.Clickthearrowto
addalevel.

Toremoveafactorlevel,clickthevalue,clickDelete,andclickoutsidethetextbox.

Toeditavalue,clickthevalueintheValuescolumn.

Factor Types
Continuous Numericdatatypesonly.Acontinuousfactorisafactorthatyoucan

conceptuallysettoanyvaluebetweenthelowerandupperlimitsyousupply,giventhe
limitationsofyourprocessandmeasurementsystem.
Eithernumericorcharacterdatatypes.Foracategoricalfactor,thevalue
orderingistheorderofthevaluesasenteredfromlefttoright.Thisorderingissavedina
ValueOrderingcolumnpropertyafterthedesigndatatableiscreated.

Categorical

Factor Column Properties


Foreachfactor,variouscolumnpropertiesaresavedtothedatatable.
Design Role EachfactorisassignedtheDesignRolecolumnproperty.TheRolethatyou

specifyindefiningthefactordeterminesthevalueofitsDesignRolecolumnproperty.The
DesignRolepropertyreflectshowthefactorisintendedtobeusedinmodelingthe
experimentaldata.DesignRolevaluesareusedintheAugmentDesignplatform.
Factor Changes EachfactorisassignedtheFactorChangescolumnpropertywithasettingof

Easy.Inscreeningdesigns,itisassumedthatfactorlevelscanbechangedforeach
experimentalrun.FactorChangesvaluesareusedintheEvaluateDesignandAugment
Designplatforms.
IftheRoleisContinuous,theCodingcolumnpropertyforthefactorissaved.This
propertytransformsthefactorvaluessothatthelowandhighvaluescorrespondto1and
+1,respectively.TheestimatesandtestsintheFitLeastSquaresreportarebasedonthe
transformedvalues.

Coding

IftheRoleisCategoricalorBlocking,theValueOrderingcolumnpropertyfor
thefactorissaved.Thispropertydeterminestheorderinwhichlevelsofthefactorappear.

Value Ordering

Define Factor Constraints


Note: ConstraintscanbespecifiedonlyfordesignsconstructedusingtheFastFlexibleFilling
method.
UseDefineFactorConstraintstorestrictthedesignspace.Unlessyouhaveloadedaconstraint
orincludedoneaspartofascript,theNoneoptionisselected.Tospecifyconstraints,select
oneoftheotheroptions:

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Space Filling Design Window

387

Specify Linear Constraints Specifiesinequalityconstraintsonlinearcombinationsoffactors.

OnlyavailableforfactorswithaRoleofContinuousorMixture.SeeSpecifyLinear
Constraints.
Use Disallowed Combinations Filter Definessetsofconstraintsbasedonrestrictingvaluesof

individualfactors.YoucandefinebothANDandORconstraints.SeeUseDisallowed
CombinationsFilter.
Use Disallowed Combinations Script Definesdisallowedcombinationsandotherconstraints

asBooleanJSLexpressionsinascripteditorbox.SeeUseDisallowedCombinations
Script.
Specify Linear Constraints
Incaseswhereitisimpossibletovarycontinuousfactorsindependentlyoverthedesign
space,youcanspecifylinearinequalityconstraints.Linearinequalitiesdescribefactorlevel
settingsthatareallowed.
ClickAddtoenteroneormorelinearinequalityconstraints.
Add Addsatemplateforalinearexpressioninvolvingallthecontinuousfactorsinyour

design.Entercoefficientvaluesforthefactorsandselectthedirectionoftheinequalityto
reflectyourlinearconstraint.Specifytheconstrainingvalueintheboxtotherightofthe
inequality.Toaddmoreconstraints,clickAddagain.
Note: TheAddoptionisdisabledifyouhavealreadyconstrainedthedesignregionby
specifyingaSphereRadius.
Remove Last Constraint Removesthelastconstraint.

Checkstheconstraintsforconsistency.Thisoptionremovesredundant
constraintsandconductsfeasibilitychecks.AJMPalertappearsifthereisaproblem.If
constraintsareequivalenttoboundsonthefactors,aJMPalertindicatesthattheboundsin
theFactorsoutlinehavebeenupdated.

Check Constraints

Use Disallowed Combinations Filter


ThisoptionusesanadaptationoftheDataFiltertofacilitatespecifyingdisallowed
combinations.FordetailedinformationaboutusingtheDataFilter,seetheUsingJMPbook.
SelectfactorsfromtheAddFilterFactorslistandclickAdd.Thenspecifythedisallowed
combinationsbyusingtheslider(forcontinuousfactors)orbyselectinglevels(forcategorical
factors).
TheredtriangleoptionsfortheAddFilterFactorsmenuarethosefoundintheSelect
Columnspanelofmanyplatformlaunchwindows.SeetheUsingJMPbookforadditional
detailsaboutthecolumnselectionmenu.

388

Space-Filling Designs
Space Filling Design Window

Chapter 14
Design of Experiments Guide

WhenyouclickAdd,theDisallowedCombinationscontrolpanelshowstheselectedfactors
andprovidesoptionsforfurthercontrol.Factorsarerepresentedasfollows,basedontheir
modelingtypes:
Continuous Factors Foracontinuousfactor,adoublearrowsliderthatspanstherangeof

factorsettingsappears.Anexpressionthatdescribestherangeusinganinequalityappears
abovetheslider.Youcanspecifydisallowedsettingsbydraggingthesliderarrowsorby
clickingontheinequalityboundsintheexpressionandenteringyourdesiredconstraints.
Intheslider,asolidbluehighlightrepresentsthedisallowedvalues.
Categorical Factor Foracategoricalfactor,thepossiblelevelsaredisplayedeitheraslabeled

blocksor,whenthenumberoflevelsislarge,aslistentries.Selectaleveltodisallowit.To
selectmultiplelevels,holdtheControlkey.Theblockorlistentriesarehighlightedto
indicatethelevelsthathavebeendisallowed.Whenyouaddacategoricalfactortothe
DisallowedCombinationspanel,thenumberoflevelsofthecategoricalfactorisgivenin
parenthesesfollowingthefactorname.
DisallowedCombinationsOptions
Thecontrolpanelhasthefollowingcontrols:
Clearsalldisallowedfactorlevelsettingsthatyouhavespecified.Thisdoesnotclear
theselectedfactors.

Clear

Start Over Removesallselectedfactorsandreturnsyoutotheinitiallistoffactors.


AND OpenstheAddFilterFactorslist.SelectedfactorsbecomeanANDgroup.Any

combinationoffactorlevelsspecifiedwithinanANDgroupisdisallowed.
ToaddafactortoanANDgrouplateron,clickthegroupsoutlinetoseeahighlighted
rectangle.SelectANDandaddthefactor.
Toremoveasinglefactor,selectDeletefromitsredtrianglemenu.
OR OpenstheAddFilterFactorslist.SelectedfactorsbecomeaseparateANDgroup.For

ANDgroupsseparatedbyOR,acombinationisdisallowedifitisspecifiedinatleastone
ANDgroup.
RedTriangleOptionsforFactors
AfactorcanappearinseveralORgroups.AnoccurrenceofthefactorinaspecificORgroupis
referredtoasaninstanceofthefactor.
Delete RemovestheselectedinstanceofthefactorfromtheDisallowedCombinationspanel.
Clear Selection

Clearsanyselectionforthatinstanceofthefactor.

Deselectstheselectedvaluesandselectsthevaluesnotpreviouslyselected
forthatinstanceofthefactor.

Invert Selection

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Space Filling Design Window

389

Availableonlyforcategoricalfactors.Changestheappearanceofthedisplay.
Optionsinclude:

Display Options

Blocks Displayshowseachlevelasablock.
List Displayshowseachlevelasamemberofalist.
Single Category Display showseachlevel.
Check Box Display addsacheckboxnexttoeachvalue.
Availableonlyforcategoricalfactors.Providesatextboxbeneaththefactornamewhere
youcanenterasearchstringforlevelsofthefactor.PresstheEnterkeyorclickoutsidethe
textboxtoperformthesearch.OnceFindisselected,thefollowingFindoptionsappearin
theredtrianglemenu:

Find

Clear FindclearstheresultsoftheFindoperationandreturnsthepaneltoitsoriginal
state.
Match Caseusesthecaseofthesearchstringtoreturnthecorrectresults.
Containssearchesforvaluesthatincludethesearchstring.
Does not containsearchesforvaluesthatdonotincludethesearchstring.
Starts withsearchesforvaluesthatstartwiththesearchstring.
Ends withsearchesforvaluesthatendwiththesearchstring.
Use Disallowed Combinations Script
UsethisoptiontodisallowparticularcombinationsoffactorlevelsusingaJSLscript.This
optioncanbeusedwithcontinuousfactorsormixedcontinuousandcategoricalfactors.
Thisoptionopensascriptwindowwhereyouinsertascriptthatidentifiesthecombinations
thatyouwanttodisallow.ThescriptmustevaluateasaBooleanexpression.Whenthe
expressionevaluatesastrue,thespecifiedcombinationisdisallowed.
Whenformingtheexpressionforacategoricalfactor,usetheordinalvalueofthelevelinstead
ofthenameofthelevel.Ifafactorslevelsarehigh,medium,andlow,specifiedinthatorder
intheFactorsoutline,theirassociatedordinalvaluesare1,2,and3.Forexample,supposethat
youhavetwocontinuousfactors,X1andX2,andacategoricalfactorX3withthreelevels:L1,
L2,andL3,inorder.Youwanttodisallowlevelswherethefollowingholds:
e

X1

+ 2X 2 0andX 3 = L2

Entertheexpression(Exp(X1) + 2*X2 < 0) & (X3 == 2)intothescriptwindow.

390

Space-Filling Designs
Space Filling Design Window

Chapter 14
Design of Experiments Guide

Figure 14.5ExpressioninScriptEditor

(Inthefigure,unnecessaryparentheseswereremovedbyparsing.)Noticethatfunctionscan
beenteredaspartoftheBooleanexpression.

Space Filling Design Methods


Thefollowingmethodsforconstructingspacefillingdesignsareavailable:

SpherePackingDesignsonpage 393

LatinHypercubeDesignsonpage 396

UniformDesignsonpage 399

MinimumPotentialDesignsonpage 402

MaximumEntropyDesignsonpage 404

GaussianProcessIMSEOptimalDesignsonpage 406

FastFlexibleFillingDesignsonpage 407

Design
TheDesignoutlineshowstherunsforthespacefillingscreeningdesign.

Design Diagnostics
TheDesignDiagnosticsoutlineshowsthevaluesforthefactorsscaledfromzerotoone.The
MinimumDistanceisbasedonthesescaledvaluesandistheminimumdistancefromeach
pointtoitsnearestneighbor.TherownumberforthenearestneighborisgivenintheNearest
Pointcolumn.Thediscrepancyvalueshownbelowthetableistheintegrateddifference
betweenthedesignpointsbasedandauniformdistribution.

Design Table
Make Table ConstructstheSpaceFillingDesigndatatable.
Back TakesyoubacktowhereyouwerebeforeclickingMake Design.Youcanmakechanges

tothepreviousoutlinesandregeneratethedesign.

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Space Filling Design Options

391

Space Filling Design Options


TheredtrianglemenuintheSpaceFillingDesignplatformcontainstheseoptions:
Createsadatatablecontainingarowforeachresponsewithacolumn
calledResponse Namethatidentifiestheresponses.Fouradditionalcolumnscontainthe
Lower Limit,Upper Limit,Response Goal,andImportance.Savingresponsesallowsyouto
quicklyloadthemintoaDOEwindow.

Save Responses

Load Responses

LoadsresponsesthatyouhavesavedusingtheSaveResponsesoption.

Save Factors Createsadatatablecontainingacolumnforeachfactorthatcontainsitsfactor

levels.Afactorscolumncontainscolumnpropertiesassociatedwiththefactor.Saving
factorsallowsyoutoquicklyloadthemintoaDOEwindow.
Note: Itispossibletocreateafactorstablebytypingdataintoanemptytable,but
remembertoassigneachcolumnanappropriateDesignRole.Dothisbyrightclickingon
thecolumnnameinthedatagridandselectingColumn Properties > Design Role.Inthe
DesignRolearea,selecttheappropriaterole.
Load Factors

LoadsfactorsthatyouhavesavedusingtheSaveFactorsoption.

Save Constraints (Unavailableforsomeplatforms)Savesfactorconstraintsthatyouhave

definedintheDefineFactorConstraintsorLinearConstraintsoutline.TheSave
Constraintsoptioncreatesadatatablethatcontainsacolumnforeachconstraint.Saving
constraintsallowsyoutoquicklyloadthemintoaDOEwindow.
Theconstrainttablecontainsacolumnforeachlinearconstraint.Thefirstrowscontainthe
coefficientsforeachfactor.Thelastrowcontainstheinequalitybound.Eachconstraints
columncontainsacolumnpropertycalledConstraintStatethatidentifiestheconstraintasa
lessthanoragreaterthanconstraint.SeeColumnPropertiesonpage 559inthe
ColumnPropertiesappendix.
(Unavailableforsomeplatforms)Loadsfactorconstraintsthatyouhave
savedusingtheSaveConstraintsoption.

Load Constraints

Set Random Seed SetstherandomseedthatJMPusestocontrolcertainactionsthathavea

randomcomponent.Theseactionsinclude:
simulatingresponsesusingtheSimulateResponsesoption
randomizingRunOrderfordesignconstruction

392

Space-Filling Designs
Space Filling Design Options

Chapter 14
Design of Experiments Guide

selectingastartingdesignfordesignsbasedonrandomstarts.
Toreproduceadesignorsimulatedresponses,entertherandomseedusedtogenerate
them.Fordesignsusingrandomstarts,settheseedbeforeclickingMakeDesign.To
controlsimulatedresponsesorrunorder,settheseedbeforeclickingMakeTable.
NotethattherandomseedassociatedwithadesignisincludedintheDOEDialogscript
thatissavedtothedesigndatatable.
Addsresponsevaluestothedesigntablethatisgenerated.Selectthis
optionbeforeyouclickMakeTable.InthedesigntablethatresultsfromclickingMake
Table,theresponsecolumnscontainsimulatedvalues.

Simulate Responses

Forcertaintypesofdesigns,aSimulateResponseswindowliststhecoefficientsanderror
standarddeviationusedtosimulatetheresponsevalues.Youcanreplacethesecoefficients
andclickApplytoseeyoursimulatedresponsevaluesinthedatatable.Thedefaultvalues
forthecoefficientsareeither1or1.Thedefaultvaluefortheerrorstandarddeviationis1.
SomeplatformsallowyoutosetAnticipatedCoefficientsaspartofPowerAnalysisunder
DesignEvaluation.Fortheseplatforms,thedefaultvaluesintheSimulateResponses
windowarethevaluesthatyouspecifyasAnticipatedCoefficientsandAnticipatedRMSE
(ErrorStd)inthePowerAnalysisoutline.Ifitisnotpossibletofitthemodelspecifiedin
thedatatablesModelscript,theinterceptandcoefficientshavedefaultvaluesof0.
Note: Youcansetapreferencetoalwayssimulateresponses.SelectFile > Preferences >
Platforms > DOE.CheckSimulateResponses.
FFF Optimality Criterion FortheFastFlexibleFillingdesignmethod,enablesyoutoselect

betweentheMaxProcriterion(thedefault)andtheCentroidcriterion.SeeFFFOptimality
Criteriononpage 407.
Number of Starts Specifiesthenumberoftimesthatthealgorithmforthechosendesigntype

initiatestoconstructanewdesign.Thebestdesign,basedonthecriterionforthegiven
designtype,isreturned.Setto1bydefaultforalldesigntypes.NotusedforFastFlexible
FillingDesigns.
Advanced Options > Set Average Cluster Size FortheFastFlexibleFillingdesignmethod,

enablesyoutospecifytheaveragenumberofrandomlygeneratedpointsusedtodefine
eachclusteror,equivalently,eachdesignpoint.
Save Script to Script Window Createsthescriptforthedesignthatyouspecifiedinthe

CustomDesignplatformandsavesitinanopenscriptwindow.

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Sphere-Packing Designs

393

Sphere-Packing Designs
TheSpherePackingdesignmethodmaximizestheminimumdistancebetweenpairsofdesign
points.Theeffectofthismaximizationistospreadthepointsoutasmuchaspossibleinside
thedesignregion.

Creating a Sphere-Packing Design


1. SelectDOE > Space Filling Design.
2. Enterresponsesandfactors.
SeeResponsesonpage 382.
3. Alterthefactorlevelvalues,ifnecessary.Forexample,Figure 14.6showsthetwoexisting
factors, X1and X2,withvaluesthatrangefrom0to1(insteadofthedefault1to1).
Figure 14.6SpaceFillingDialogforTwoFactors

4. ClickContinue.
5. Inthedesignspecificationdialog,specifyasamplesize(Number of Runs).Figure 14.7
showsasamplesizeofeight.

394

Space-Filling Designs
Sphere-Packing Designs

Chapter 14
Design of Experiments Guide

Figure 14.7SpaceFillingDesignDialog

6. ClickSphere Packing.
JMPcreatesthedesignanddisplaysthedesignrunsandthedesigndiagnostics.
Figure 14.8showstheDesignDiagnosticspanelopenwith0.518astheMinimum Distance.
Yourresultsmightdifferslightlyfromtheonesbelow,buttheminimumdistanceisthe
same.
Figure 14.8SpherePackingDesignDiagnostics

7. ClickMake Table.Usethistabletocompletethevisualizationexample,describednext.

Visualizing the Sphere-Packing Design


TovisualizethenatureoftheSpherePackingtechnique:

Createanoverlayplot.

Adjusttheplotsframesize.

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Sphere-Packing Designs

395

AddcirclesusingtheminimumdistancefromthediagnosticreportshowninFigure 14.8
astheradiusforthecircles.

Example
Usingthetableyoujustcreated,proceedasfollows:
1. SelectGraph > Overlay Plot.
2. SpecifyX1asXandX2asY,andthenclickOK.
3. Adjusttheframesizesothattheframeissquarebyrightclickingtheplotandselecting
Size/Scale > Size to Isometric.
4. RightclicktheplotandselectCustomize.WhentheCustomizepanelappears,clickthe
plussigntoseeatexteditareaandenterthefollowingscript:
For Each Row(Circle({:X1, :X2}, 0.518/2))
where0.518istheminimumdistancenumberthatyounotedintheDesignDiagnostics
panel.Thisscriptdrawsacirclecenteredateachdesignpointwithradius0.259(halfthe
diameter,0.518),asshownontheleftinFigure 14.9.ThisplotshowstheefficientwayJMP
packsthedesignpoints.
5. Nowrepeattheprocedureexactlyasdescribedintheprevioussection,butwithasample
sizeof10insteadofeight.
Remembertochange0.518 inthegraphicsscripttotheminimumdistanceproducedby
10runs.Whentheplotappears,againsettheframesizeandcreateagraphicsscriptusing
theminimumdistancefromthediagnosticreportasthediameterforthecircle.Youshould
seeagraphsimilartotheoneontherightinFigure 14.9.Notetheirregularnatureofthe
spherepacking.Infact,youcanrepeattheprocessathirdtimetogetaslightlydifferent
picturebecausethearrangementisdependentontherandomstartingpoint.
Figure 14.9SpherePackingExamplewithEightRuns(left)and10Runs(right)

396

Space-Filling Designs
Latin Hypercube Designs

Chapter 14
Design of Experiments Guide

Latin Hypercube Designs


InaLatinHypercube,eachfactorhasasmanylevelsastherearerunsinthedesign.Thelevels
arespacedevenlyfromthelowerboundtotheupperboundofthefactor.Likethe
spherepackingmethod,theLatinHypercubemethodchoosespointstomaximizethe
minimumdistancebetweendesignpoints,butwithaconstraint.Theconstraintmaintainsthe
evenspacingbetweenfactorlevels.

Creating a Latin Hypercube Design


TousetheLatinHypercubemethod:
1. SelectDOE > Space Filling Design.
2. Enterresponses,ifnecessary,andfactors.
SeeResponsesonpage 382.
3. Alterthefactorlevelvalues,ifnecessary.Figure 14.10showsaddingtwofactorstothetwo
existingfactorsandchangingtheirvaluesto1and8insteadofthedefault1and1.
Figure 14.10SpaceFillingDialogforFourFactors

4. ClickContinue.
5. Inthedesignspecificationdialog,specifyasamplesize(Number of Runs).Thisexample
usesasamplesizeofeight.

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Latin Hypercube Designs

397

6. ClickLatin Hypercube(seeFigure 14.7).Factorsettingsanddesigndiagnosticsresults


appearsimilartothoseinFigure 14.11,whichshowstheLatinHypercubedesignwith
fourfactorsandeightruns.
Note: Thepurposeofthisexampleistoshowthateachcolumn(factor)isassignedeachlevel
onlyonce,andeachcolumnisadifferentpermutationofthelevels.
Figure 14.11LatinHypercubeDesignforFourFactorsandEightRunswithEightLevels

Visualizing the Latin Hypercube Design


TovisualizethenatureoftheLatinHypercubetechnique:

Createanoverlayplot

Adjusttheplotsframesize

Addcirclesusingtheminimumdistancefromthediagnosticreportastheradiusforthe
circle

Example
1. CreateanotherLatinHypercubedesignusingthedefaultX1and X2factors.
2. Besuretochangethefactorvaluessothattheyare0and1insteadofthedefault1and1.
3. ClickContinue.
4. Specifyasamplesizeofeight(Number of Runs).
5. ClickLatin Hypercube.FactorsettingsanddesigndiagnosticsareshowninFigure 14.12.

398

Space-Filling Designs
Latin Hypercube Designs

Chapter 14
Design of Experiments Guide

Figure 14.12LatinHypercubeDesignwithTwoFactorsandEightRuns

6. ClickMake Table.
7. SelectGraph > Overlay Plot.
8. SpecifyX1asXandX2asY,andthenclickOK.
9. RightclicktheplotandselectSize/Scale > Size to Isometrictoadjusttheframesizesothat
theframeissquare.
10. Rightclicktheplot,selectCustomizefromthemenu.IntheCustomizepanel,clickthe
largeplussigntoseeatexteditarea,andenterthefollowingscript:
For Each Row(Circle({:X1, :X2}, 0.404/2))

where0.404istheminimumdistancenumberthatyounotedintheDesignDiagnostics
panel(Figure 14.12).Thisscriptdrawsacirclecenteredateachdesignpointwithradius
0.202(halfthediameter,0.404),asshownontheleftinFigure 14.13.Thisplotshowsthe
efficientwayJMPpacksthedesignpoints.
11. Repeattheaboveprocedureexactly,butwith10runsinsteadofeight(step5).Remember
tochange0.404inthegraphicsscripttotheminimumdistanceproducedby10runs.
YoushouldseeagraphsimilartotheoneontherightinFigure 14.13.Notetheirregular
natureofthespherepacking.Infact,youcanrepeattheprocesstogetaslightlydifferent
picturebecausethearrangementisdependentontherandomstartingpoint.

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Uniform Designs

399

Figure 14.13ComparisonofLatinHypercubeDesignswithEightRuns(left)and10Runs
(right)

NotethattheminimumdistancebetweeneachpairofpointsintheLatinHypercubedesignis
smallerthanthatfortheSpherePackingdesign.ThisisbecausetheLatinHypercubedesign
constrainsthelevelsofeachfactortobeevenlyspaced.TheSpherePackingdesignmaximizes
theminimumdistancewithoutanyconstraints.

Uniform Designs
TheUniformdesignminimizesthediscrepancybetweenthedesignpoints(empiricaluniform
distribution)andatheoreticaluniformdistribution.
Note: Thesedesignsaremostusefulforgettingasimpleandpreciseestimateoftheintegralof
anunknownfunction.Theestimateistheaverageoftheobservedresponsesfromthe
experiment.
1. SelectDOE > Space Filling Design.
2. Enterresponses,ifnecessary,andfactors.
SeeResponsesonpage 382.
3. Alterthefactorlevelvaluesto0and1.
4. ClickContinue.
5. Inthedesignspecificationdialog,specifyasamplesize.Thisexampleusesasamplesize
ofeight(Number of Runs).
6. ClicktheUniform button.JMPcreatesthisdesignanddisplaysthedesignrunsandthe
designdiagnosticsasshowninFigure 14.14.

400

Space-Filling Designs
Uniform Designs

Chapter 14
Design of Experiments Guide

Note: TheemphasisoftheUniformdesignmethodisnottospreadoutthepoints.The
minimumdistancesinFigure 14.14varysubstantially.
Figure 14.14FactorSettingsandDiagnosticsforUniformSpaceFillingDesignswithEight
Runs

7. ClickMake Table.
AUniformdesigndoesnotguaranteeevenspacingofthefactorlevels.However,increasing
thenumberofrunsandrunningadistributiononeachfactor(useAnalyze>Distribution)
showsflathistograms.
Figure 14.15HistogramsAreFlatforEachFactorWhenNumberofRunsIsIncreasedto20

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Comparing Sphere-Packing, Latin Hypercube, and Uniform Methods

401

Comparing Sphere-Packing, Latin Hypercube, and Uniform


Methods
Tocomparespacefillingdesignmethods,createtheSphere Packing,Latin Hypercube,and
Uniformdesigns,asshowninthepreviousexamples.TheDesignDiagnosticstablesshowthe
valuesforthefactorsscaledfromzerotoone.Theminimumdistanceisbasedonthesescaled
valuesandistheminimumdistancefromeachpointtoitsclosestneighbor.Thediscrepancy
valueistheintegrateddifferencebetweenthedesignpointsandtheuniformdistribution.
Figure 14.16showsacomparisonofthedesigndiagnosticsforthreeeightrunspacefilling
designs.NotethatthediscrepancyfortheUniformdesignisthesmallest(best).The
discrepancyfortheSpherePackingdesignisthelargest(worst).ThediscrepancyfortheLatin
Hypercubetakesanintermediatevaluethatisclosertotheoptimalvalue.
Alsonotethattheminimumdistancebetweenpairsofpointsislargest(best)forthe
SpherePackingmethod.TheUniformdesignhaspairsofpointsthatareonlyabouthalfasfar
apart.TheLatinHypercubedesignbehavesmoreliketheSpherePackingdesigninspreading
thepointsout.
Forbothspreadanddiscrepancy,theLatinHypercubedesignrepresentsahealthy
compromisesolution.

402

Space-Filling Designs
Minimum Potential Designs

Chapter 14
Design of Experiments Guide

Figure 14.16ComparisonofDiagnosticsforThreeEightRunSpaceFillingMethods

SpherePacking

Latin
Hypercube

Uniform

Anotherpointofcomparisonisthetimeittakestocomputeadesign.TheUniformdesign
methodrequiresthemosttimetocompute.Also,thetimetocomputethedesignincreases
rapidlywiththenumberofruns.Forcomparableproblems,allthespacefillingdesign
methodstakelongertocomputethantheDoptimaldesignsintheCustomDesigner.

Minimum Potential Designs


TheMinimumPotentialdesignspreadspointsoutinsideasphere.Tounderstandhowthis
designiscreated,imaginethepointsaselectronswithspringsattachedtoeveryotherpoint,as
illustratedtotheright.Thecoulombforcepushesthepointsapart,butthespringspullthem
together.Thedesignisthespacingofpointsthatminimizesthepotentialenergyofthesystem.

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Minimum Potential Designs

403

Figure 14.17MinimumPotentialDesign

MinimumPotentialdesigns:

havesphericalsymmetry

arenearlyorthogonal

haveuniformspacing

ToseeaMinimumPotentialexample:
1. SelectDOE > Space Filling Design.
2. Add1continuousfactor.
SeeFactorsonpage 384.
3. Alterthefactorlevelvaluesto0and1,ifnecessary.
4. ClickContinue.
5. Inthedesignspecificationdialog(shownontheleftinFigure 14.18),enterasamplesize
(Number of Runs).Thisexampleusesasamplesizeof12.
6. ClicktheMinimum Potential button.JMPcreatesthisdesignanddisplaysthedesignruns
andthedesigndiagnostics(shownontherightinFigure 14.18).
Figure 14.18SpaceFillingMethodsandDesignDiagnosticsforMinimumPotentialDesign

404

Space-Filling Designs
Maximum Entropy Designs

Chapter 14
Design of Experiments Guide

7. ClickMake Table.
YoucanseethesphericalsymmetryoftheMinimumPotentialdesignusingtheScatterplot3D
graphicsplatform.
1. AfteryoumaketheJMPdesigntable,choosetheGraph>Scatterplot 3Dcommand.
2. IntheScatterplot3Dlaunchdialog,selectX1,X2,and X3asY, ColumnsandclickOK tosee
theinitialthreedimensionalscatterplotofthedesignpoints.
3. ToseetheresultssimilartothoseinFigure 14.19:
SelecttheNormal Contour EllipsoidsoptionfromthemenuintheScatterplot3Dtitle
bar.
Makethepointslarger.RightclickontheplotandselectSettings,andthenincreasethe
Marker Sizeslider.
Nowitiseasytoseethepointsspreadevenlyonthesurfaceoftheellipsoid.
Figure 14.19MinimumPotentialDesignPointsonSphere

Maximum Entropy Designs


TheLatinHypercubedesigniscurrentlythemostpopulardesignassumingyouaregoingto
analyzethedatausingaGaussianProcessmodel.Computersimulationexpertsliketousethe
LatinHypercubedesignbecauseallprojectionsontothecoordinateaxesareuniform.
However,astheexampleatthetopinFigure 14.20shows,theLatinHypercubedesigndoes
notnecessarilydoagreatjobofspacefilling.ThisisatwofactorLatinHypercubewith16

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Maximum Entropy Designs

405

runsandwiththefactorlevelsettingssetbetween1and1.Notethatthisdesignseamsto
leaveaholeinthebottomrightoftheoverlayplot.
Figure 14.20TwofactorLatinHypercubeDesign

Note the empty area in the


Latin Hypercube design

TheMaximumEntropydesignisacompetitortotheLatinHypercubedesignforcomputer
experimentsbecauseitoptimizesameasureoftheamountofinformationcontainedinan
experiment.Seethetechnicalnotebelow.Withthefactorlevelssetbetween1and1,the
twofactorMaximumEntropydesignshowninFigure 14.21coverstheregionbetterthanthe
LatinhypercubedesigninFigure 14.20.Thespacefillingpropertygenerallyimprovesasthe
numberofrunsincreaseswithoutbound.
Figure 14.21TwoFactorMaximumEntropyDesign

Technical MaximumEntropydesignsmaximizetheShannoninformation(ShewryandWynn
(1987))ofanexperiment,assumingthatthedatacomefromanormal(m,s2R)distribution,
where

406

Space-Filling Designs
Gaussian Process IMSE Optimal Designs

Chapter 14
Design of Experiments Guide

2
R ij = exp k x ik x jk
k

isthecorrelationofresponsevaluesattwodifferentdesignpoints,xiandxj.Computationally,
thesedesignsmaximize|R|,thedeterminantofthecorrelationmatrixofthesample.Ifxiand
xjarefarapart,thenRijapproacheszero.Ifxiandxjareclosetogether,thenRijisnearone.

Gaussian Process IMSE Optimal Designs


TheGaussianprocessIMSEoptimaldesignisalsoacompetitortotheLatinHypercube
design.ThisisbecauseitminimizestheintegratedmeansquarederroroftheGaussian
processmodelovertheexperimentalregion.
YoucancomparetheIMSEoptimaldesigntotheLatinHypercube(shownpreviouslyin
Figure 14.20).ThetableandoverlayplotinFigure 14.22showaGaussianIMSEoptimal
design.Youcanseethatthedesignprovidesuniformcoverageofthefactorregion.
Figure 14.22ComparisonofTwofactorLatinHypercubeandGaussianIMSEOptimal
Designs

Note: BoththeMaximumEntropydesignandtheGaussianProcessIMSEOptimaldesign
werecreatedusing100randomstarts.

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Fast Flexible Filling Designs

407

Fast Flexible Filling Designs


Note: IfyouhaveCategoricalfactorsorfactorconstraints,thenFastFlexibleFillingistheonly
Methodavailable.

FFF Optimality Criterion


ThealgorithmsforFastFlexibleFillingdesignsbeginbygeneratingalargenumberofrandom
pointswithinthespecifieddesignregion.ThesepointsarethenclusteredusingaFastWard
algorithmintoanumberofclustersthatequalstheNumberofRunsthatyouspecified.
ThefinaldesignpointscanbeobtainedbyusingthedefaultMaxPro(maximumprojection)
optimalitycriterionorbyselectingtheCentroidcriterion.Youcanfindtheseoptionsunder
FFFOptimalityCriterioninthereportsredtrianglemenu.
MaxPro ForpfactorsandnequaltothespecifiedNumberofRuns,theMaxProcriterion

strivestofindpointsintheclustersthatminimizethefollowingcriterion:
C MaxPro =

n1

j = i+1

x ik x jk

k=1

TheMaxProcriterionmaximizestheproductofthedistancesbetweenpotentialdesign
pointsinawaythatinvolvesallfactors.Thissupportsthegoalofprovidinggood
spacefillingpropertiesonprojectionsoffactors.SeeJosephetal.(2014,forthcoming).The
MaxProoptionisthedefault.
Centroid Thismethodplacesadesignpointatthecentroidofeachcluster.Ithastheproperty

thattheaveragedistancefromanarbitrarypointinthedesignspacetoitsclosest
neighboringdesignpointissmallerthanforotherdesigns.
Note: Youcansetapreferencetoalwaysuseagivenoptimalitycriterion.SelectFile >
Preferences > Platforms > DOE.CheckFFFOptimalityCriterionandselectyourpreferred
criterion.

Set Average Cluster Size


TheSetAverageClusterSizeoptionisfoundunderAdvancedOptionsintheSpaceFilling
Designredtrianglemenu.Thisoptionenablesyoutospecifytheaveragenumberof
randomlygeneratedpointsusedtodefineeachclusteror,equivalently,eachdesignpoint.
Bydefault,iftheNumberofRunsissetto200orless,atotalof10,000randomlygenerated
pointsareusedasthebasisfortheclusteringalgorithm.WhenthenumberofRunsexceeds
200,adefaultvalueof50isused.Increasingthisvaluecanbeparticularlyusefulindesigns

408

Space-Filling Designs
Fast Flexible Filling Designs

Chapter 14
Design of Experiments Guide

withalargenumberoffactorsorwheredisallowedcombinationsrestrictthedistributionof
pointsusedintheclusteringalgorithm.
Note: DependingonthenumberoffactorsandthespecifiedvalueforNumberofRuns,you
mightwanttoincreasetheaveragenumberofinitialpointsperdesignpointbyselecting
Advanced Options > Set Average Cluster Size.

Constraints
OnceyoucompletetheFactorsoutline,clickContinue.TheDefineFactorConstraintsoutline
appears.Usethisoutlinetorestrictthedesignregion.Fordetailsabouttheoutline,see
DefineFactorConstraintsonpage 386.
YoucanusetheUseDisallowedCombinationsFilterandUseDisallowedCombinationsScript
optionstospecifydisallowedfactorlevelcombinations.Or,youcanusetheSpecifyLinear
Constraintsoptiontospecifyboundsintermsoflinearinequalities.However,thedesignis
generateddifferentlyforthesetwomethods.
UseDisallowedCombinationsFilterandUseDisallowedCombinationsScript
Whendisallowedcombinationsarespecified,therandompointsthatformthebasisforthe
clusteringalgorithmarerandomlydistributedwithintheunconstraineddesignregion.Then
disallowedpointsareremovedandclusteringproceedswiththeremainingpoints.
Note: DependingonthenatureoftheconstraintsandthespecifiedNumberofRuns,the
defaultcoverageoftheunconstraineddesignspacebytheinitialrandomlygeneratedpoints
mightnotbesufficienttoproducetherequiredNumberofRuns.Inthiscase,youmight
obtainaJMPAlertindicatingthatthealgorithmCouldnotfindsufficientnumberofpoints.
Toincreasetheinitialnumberofpointsthatformthebasisfortheclusteringalgorithm,
specifyalargeraveragenumberofinitialpointsperdesignpointbyselectingAdvanced
Options > Set Average Cluster Size. (SeeSetAverageClusterSizeonpage 407).
SpecifyLinearConstraints
WhenyouusetheSpecify Linear Constraintsoption,therandompointsthatformthebasisfor
theclusteringalgorithmarerandomlydistributedwithintheconstraineddesignregion.The
clusteringalgorithmusesthesepoints.

Creating and Viewing a Constrained Fast Flexible Filling Design


ConstructingtheDesign
1. SelectDOE > Space Filling Design.

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Fast Flexible Filling Designs

2. EnterValuesof0and1forbothX1andX2.
3. ClickContinue.
4. IntheDefineLinearConstraintsoutline,selectSpecify Linear Constraints.
NoticethatFastFlexibleFillingistheonlyavailableSpaceFillingDesignMethod.
5. SelectAdd.
6. Enterthefollowingcoefficientsandbound:
1forX1
1forX2
0.8forthebound
Figure 14.23LinearConstraint

7. Type200nexttoNumber of Runs.
8. SelectFast Flexible Filling.
JMPcreatesadesignthatsatisfiestheconstraints.OpentheDesignoutlinetoviewthe
design.
9. SelectMake Table toconstructthedatatable.
ConstructingthePlot
1. Withthedatatableactive,selectGraph > Graph Builder.
2. DragX1tothedropzonelabeledX.
3. DragX2tothedropzonelabeledY.
4. RemovetheSmootherbyclickingthesmoothericon.
5. IntheGraphBuilderredtrianglemenu,clickShow Control Paneltodeselectit.
YoushouldseeagraphsimilartotheoneinFigure 14.24.Notethatthepointssatisfythe
linearconstraint X1 + X2 0.8 .

409

410

Space-Filling Designs
Borehole Model: A Sphere-Packing Example

Chapter 14
Design of Experiments Guide

Figure 14.24FastFlexibleFillingDesignwithOneLinearConstraint

Borehole Model: A Sphere-Packing Example


Worley(1987)presentedamodeloftheflowofwaterthroughaboreholethatisdrilledfrom
thegroundsurfacethroughtwoaquifers.Theresponsevariableyistheflowratethroughthe
boreholeinm3/yearandisdeterminedbythefollowingequation:
2T u H u H l
y = --------------------------------------------------------------------------------------------2LT u
Tu
ln r r w 1 + ----------------------------------------- + -----2
Tl
ln r r w r w K w

Thereareeightinputstothismodel:
rw=radiusofborehole,0.05to0.15m
r=radiusofinfluence,100to50,000m
Tu=transmissivityofupperaquifer,63,070to115,600m2/year
Hu=potentiometricheadofupperaquifer,990to1100m
Tl=transmissivityofloweraquifer,63.1to116m2/year
Hl=potentiometricheadofloweraquifer,700to820m

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Borehole Model: A Sphere-Packing Example

411

L=lengthofborehole,1120to1680m
Kw=hydraulicconductivityofborehole,9855to12,045m/year
Thisexampleisatypicalofmostcomputerexperimentsbecausetheresponsecanbeexpressed
asasimple,explicitfunctionoftheinputvariables.However,thissimplicityisusefulfor
explainingthedesignmethods.

Create the Sphere-Packing Design for the Borehole Data


TocreateaSpherePackingdesignfortheboreholeproblem:
1. SelectDOE > Space Filling Design.
2. ClicktheredtriangleiconontheSpace Filling DesigntitlebarandselectLoad Factors.
3. SelectHelp > Sample Data LibraryandopenDesign Experiment/Borehole Factors.jmp
(Figure 14.25).
Figure 14.25FactorsPanelwithFactorValuesLoadedforBoreholeExample

Note: Thelogarithmofrandrwareusedinthefollowingdiscussion.
4. ClickContinue.
5. Specifyasamplesize(NumberofRuns)of32asshowninFigure 14.26.

412

Space-Filling Designs
Borehole Model: A Sphere-Packing Example

Chapter 14
Design of Experiments Guide

Figure 14.26SpaceFillingDesignMethodPanelShowing32Runs

6. ClicktheSphere Packingbuttontoproducethedesign.
7. ClickMake Tabletomakeatableshowingthedesignsettingsfortheexperiment.
Toseeacompleteddatatableforthisexample,selectHelp > Sample Data Libraryandopen
Design Experiment/Borehole Sphere Packing.jmp.Becausethedesignsaregeneratedfroma
randomseed,thesettingsthatyouobtainwilldifferfromthoseshowninthecompletedtable.
TheBorehole Sphere Packing.jmpdatatablecontainsaFitModelscriptthatyoucanuseto
analyzethedata.Columnscontainingthetruemodel,thepredictionformula,andthe
predictionbiasareincludedinthedatatable.

Guidelines for the Analysis of Deterministic Data


Itisimportanttorememberthatdeterministicdatahavenorandomcomponent.Asaresult,
pvaluesfromfittedstatisticalmodelsdonothavetheirusualmeanings.AlargeFstatistic
(lowpvalue)isanindicationofaneffectduetoamodelterm.However,youcannotmake
validconfidenceintervalsaboutthesizeoftheeffectsoraboutpredictionsmadeusingthe
model.
Residualsfromanymodelfittodeterministicdataarenotameasureofnoise.Instead,a
residualshowsthemodelbiasforthecurrentmodelatthecurrentpoint.Distinctpatternsin
theresidualsindicatenewtermstoaddtothemodeltoreducemodelbias.
Results of the Borehole Experiment
Theexampledescribedintheprevioussectionsproducedthefollowingresults:

Astepwiseregressionoftheresponse,log y,versusthefullquadraticmodelintheeight
factors,ledtotheprediction formulacolumn.

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Borehole Model: A Sphere-Packing Example

413

Theprediction biascolumnisthedifferencebetweenthetrue modelcolumnandthe


prediction formulacolumn.

Thepredictionbiasisrelativelysmallforeachoftheexperimentalpoints.Thisindicates
thatthemodelfitsthedatawell.

Inrealworldexamples,thetruemodelisgenerallynotavailableinasimpleanalyticalform.
Asaresult,itisimpossibletoknowthepredictionbiasatpointsotherthantheobserveddata
withoutdoingadditionalruns.
Inthiscase,the true modelcolumncontainsaformulathatallowsprofilingthepredictionbias
tofinditsvalueanywhereintheregionofthedata.Tounderstandthepredictionbiasinthis
example:
1. SelectGraph > Profiler.
2. Highlighttheprediction biascolumnandclicktheY, Prediction Formulabutton.
3. ChecktheExpand Intermediate Formulasbox,asshownatthebottomontheProfiler
dialoginFigure 14.27.The prediction biasformulaisafunctionofcolumnsthatarealso
createdbyformulas.
4. ClickOK.
TheprofileplotsatthebottominFigure 14.27showthepredictionbiasatthecenterofthe
designregion.Iftherewerenobias,theprofiletraceswouldbeconstantbetweenthevalue
rangesofeachfactor.Inthisexample,thevariablesHuandHlshownonlineareffects.

414

Space-Filling Designs
Borehole Model: A Sphere-Packing Example

Chapter 14
Design of Experiments Guide

Figure 14.27ProfilerDialogandProfileofthePredictionBiasintheBoreholeSpherePacking
Data

Therangeofthepredictionbiasonthedataissmallerthantherangeofthepredictionbias
overtheentiredomainofinterest.Toseethis,lookatthedistributionanalysis(Analyze >
Distribution)ofthepredictionbiasinFigure 14.28.Notethatthemaximumbiasis1.826and
theminimumis0.684(therangeis2.51).

Chapter 14
Design of Experiments Guide

Space-Filling Designs
Borehole Model: A Sphere-Packing Example

415

Figure 14.28DistributionofthePredictionBias

ThetopplotinFigure 14.29showsthemaximumbias(2.91)overtheentiredomainofthe
factors.Theplotatthebottomshowsthecomparableminimumbias(4.84).Thisgivesarange
of7.75.Thisismorethanthreetimesthesizeoftherangeovertheobserveddata.
Figure 14.29PredictionPlotsShowingMaximumandMinimumBiasoverFactorDomains

416

Space-Filling Designs
Borehole Model: A Sphere-Packing Example

Chapter 14
Design of Experiments Guide

Keepinmindthat,inthisexample,thetruemodelisknown.Inanymeaningfulapplication,
theresponseatanyfactorsettingisunknown.Thepredictionbiasovertheexperimentaldata
underestimatesthebiasthroughoutthedesigndomain.
Therearetwowaystoassesstheextentofthisunderestimation:

Crossvalidationrefitsthedatatothemodelwhileholdingbackasubsetofthepointsand
looksattheerrorinestimatingthosepoints.

Verificationruns(newrunsperformed)atdifferentsettingstoassessthelackoffitofthe
empiricalmodel.

Chapter 15
Accelerated Life Test Designs
Designing Experiments for Accelerated Life Tests
TheAcceleratedLifeTestDesignplatformcanbeusedtodesignexperimentalplansfor
acceleratedlifetesting.Youcandesigninitialexperiments,oraugmentexistingexperiments.
Figure 15.1AcceleratedLifeTestDesign

Contents
OverviewofAcceleratedLifeTestDesigns.......................................... 419
UsingtheALTDesignPlatform ................................................... 419
PlatformOptions ................................................................ 424
Example ....................................................................... 424

Chapter 15
Design of Experiments Guide

Accelerated Life Test Designs


Overview of Accelerated Life Test Designs

419

Overview of Accelerated Life Test Designs


Ofteninreliabilitystudies,theproductreliabilityatuseconditionsissohighthatthetime
requiredtotesttheproductuntilitfailsisprohibitive.Asanalternative,youcantestthe
productinconditionsthataremoreextremethannormaluseconditions.Theextreme
conditionsenabletheproducttodegradeandfailsooner,makingareliabilitystudypossible.
Resultsareusedtopredictproductreliabilityatnormaluseconditions.
TheAccelerated Life Testing Designplatformcanbeusedtodesignexperimentalplansfor
acceleratedlifetesting(ALT)experiments.TheALTDesignplatformcanbeusedtodesign
initialexperiments,oraugmentexistingexperiments.Augmentingdesignsisusefulifyou
wanttoobtainmoredata,sothatyoucandecreasethevarianceassociatedwithpredicting
productreliability.
TheALTDesignplatformcancreatedesignsforsituationsinvolvingoneortwoaccelerating
factors.Fortwoacceleratingfactors,youcanchoosetoincludetheinteraction.Youcanuse
DoptimalityortwotypesofIoptimalitycriterion.
Theprocessrequiresestimatesofaccelerationmodelparameters.Sincethoseparameters
mightnotbeknowninadvance,youcanspecifypriordistributionstoaccountforthe
uncertainty.DesignscanbecreatedforeitherLognormalorWeibulllifedistributions.

Using the ALT Design Platform


1. TolaunchtheALTDesignplatform,selectDOE>Accelerated Life Test Design.
Figure 15.2InitialALTDesignWindow

2. Selectoneortwoacceleratingfactors.
Fortwofactors,youcanchoosetoincludetheinteractionbetweenthefactors.
3. SelecteitherMonitoring at IntervalsorContinuous Monitoring.
ChooseMonitoring at Intervals ifyoucanestimatewhentheexperimentwillfail.Enterthe
numberofinspections,thetimeofthefirstinspection,andthetimebetweeninspections.

420

Accelerated Life Test Designs


Using the ALT Design Platform

Chapter 15
Design of Experiments Guide

ChooseContinuous Monitoringifyouareunsureofwhentheexperimentwillfail.
4. ClickContinue.
Awindowappearsforspecifyingdetailsoftheacceleratingfactororfactors.
Figure 15.3AcceleratingFactorDetailsWindow

5. Fillintheseoptions:
Factor Name Enteranamefortheacceleratingfactor.
Number of Levels Enterthenumberoflevelsofthefactortoincludeintheexperiment.

Selectatransformationforthefactor.TheoptionsareArrhenius
Celsius,Reciprocal,Log,SquareRoot,andLinear.

Factor Transformation

Low Usage Condition Enteravalueforthelowusageconditions.


High Usage Conditions

Enteravalueforthehighusageconditions.

6. ClickContinue.
Awindowappearsforspecifyingadditionalinformationabouttheassumeddistribution
anddesiredexperimentalconditions.

Chapter 15
Design of Experiments Guide

Accelerated Life Test Designs


Using the ALT Design Platform

421

Figure 15.4DistributionDetails

7. Fillintheseoptions:
Factors Enterthevaluesoftheacceleratingfactorlevels.
Distribution Choice

Selectthefailuredistribution,eitherWeibullorLogNormal.

Entertheaccelerationmodelparameters.Thesevaluescanbeeitherabestguess
ortheestimatesoftheparametersfromananalysisofpreviouslyobtaineddata.

Prior Mean

Prior Variance Matrix Entervariancesandcovariancesfortheaccelerationmodelparameters.

Thesevaluescanbeeitherabestguessortheestimatedvariancematrixfromananalysisof
previouslyobtaineddata.
Ignore prior variance Selectthisoptiontoignorevariancesandcovariancesformodel

parameters.Whenthevariancesandcovariancesareignored,thedesigniscreatedforthe
specificfixedparametersenteredunderPriorMean.Theresultingdesignissaidtobea
locallyoptimaldesign.Thisdesignwillbegoodifthepriormeanparametersarecloseto
thetruevalues.However,thedesignwillnotberobusttomisspecifiedparameters.When
thevariancesandcovariancesareused,amultivariatenormalpriordistributionis
assumedfortheaccelerationmodelparameters.Thisisusefulwhenthevaluesentered

422

Accelerated Life Test Designs


Using the ALT Design Platform

Chapter 15
Design of Experiments Guide

underPriorMeanareestimatesorguesses,andyouwantthedesigntoreflectthe
associateduncertainty.
Diagnostic Choices Entervaluesforthefollowing:

Time range of interestarevaluesforwhichyouwantanestimatedprobabilityoffailure.


Forexample,ifyouareinterestedintheprobabilityoffailureby100,000hours,thenenter
100,000forboththelowerandupperranges.
Probability of interestisthevalueforwhichyouwantanestimatedtimeoffailure.For
example,ifyouaremostinterestedinobtainingthetimeuntil10%ofunitsfail,thenenter
0.1.
Design Choices Entervaluesforthefollowing:

Length of Testisthelengthoftimetoruntheexperiment.
Number of Units Under Testisthenumberofunitsintheexperiment.Ifaugmentinga
previousexperiment,enterthenumberofunitsfromthepreviousexperimentplusthe
numberofunitsthatyouwanttorunforthenextexperiment.Ifdesigninganinitial
experiment,enterthenumberofunitsthatyouwanttorun.

8. ClickContinue.
NewoutlinenodesappearasshowninFigure 15.5.
Figure 15.5AdditionalOutlineNodes

Chapter 15
Design of Experiments Guide

Accelerated Life Test Designs


Using the ALT Design Platform

423

Entertheminimumandmaximumnumberofrunsallowedateachlevelof
theaccelerationfactor.Ifaugmentingapreviousexperiment,enterthenumberofunits
alreadyrunateachlevelfortheMinimumUnits.

Candidate Runs

Parameter Variance for Balanced Design Givestheexpectedvariancesandcovariancesforthe

accelerationmodelparametersafterrunningandanalyzingthebalanceddesign(same
numberofrunsateachleveloftheaccelerationfactor).Thesevaluesarevalidunderthe
assumptionthatthevaluesforthepriormeanandvariancearecorrect.
ThesevaluescanbecomparedtotheonesenteredunderPriorVarianceMatrix,tosee
whetherthebalanceddesigncanimprovethevariancesoftheparameterestimates.They
canalsobecomparedtothefinalparametervariancesfortheoptimaldesign,afterclicking
Make Design.
Usetheprofilertovisualizetheprobabilitythataunitwillfailat
differentvaluesoftheaccelerationfactorandtime.

Distribution Profiler

9. ClickUpdate Profilertoupdatetheprofilerifchangesaremadetothedistributionchoice,
means,variances,designchoices,orcandidateruns.
10. ClickMake Designtocreatetheoptimaldesignanddisplaytheresults.
Figure 15.6DesignResults

TheinformationbelowdescribestheresultsyougetafterclickingMake Design.
TheDesign reportgivestheexpectednumberoffailuresforeachleveloftheacceleration
factor.Alsogivenistheprobabilitythatnoneoftheunitsatthissettingwillfail.
TheParameter Variance for Optimal Designreportgivesthevariancesandcovariancesforthe
accelerationmodelparametersfortheoptimaldesign.Thesevaluesarevalidunderthe
assumptionthatthevaluesforthepriormeanandvariancearecorrect.Thesevaluescanbe

424

Accelerated Life Test Designs


Platform Options

Chapter 15
Design of Experiments Guide

comparedtothoseunderParameterVarianceforBalancedDesigntodeterminewhetherthe
optimaldesignisabletoreducetheparametervariancesmorethanthebalanceddesign.
TheOptimality Criteriareportgivesthevaluesoftheoptimalitycriterionfortheoptimal
design.Formoreinformationabouttheoptimalitycriterion,seePlatformOptionson
page 424.
TheMake Designbuttonupdatestheoptimaldesignifanychangesaremadetothe
distributionchoice,priormeansorvariances,designchoices,orcandidateruns.
TheMake Test Planbuttoncreatesadatatablewiththeaccelerationfactorlevelsandthe
numberofunitstoincludeintheexperimentforeachlevel.
TheMake Tablebuttoncreatesatablethatcanbeusedfordatacollectionduringthe
experiment.

Platform Options
TheredtrianglemenuforAcceleratedLifeTestPlanhasthefollowingoptions:
Simulate Responses

AddssimulatedresponsestothetablewhenyouclickMake Table.

ALT Optimality Criterion

Givesthreechoicesfordesignoptimality:

Make D-Optimal Designcreatesadesignthatminimizesthevarianceofthemodel

coefficients.
Make Time I-Optimal Designcreatesadesignthatminimizesthepredictionvariancewhen

predictingthetimetofailurefortheprobabilitygiveninDiagnosticChoiceson
page 422.
Make Probability I-Optimal Designcreatesadesignthatminimizesthepredictionvariance

whenpredictingthefailureprobabilityforthetimesgiveninDiagnosticChoiceson
page 422.
Advanced Options GivestheNMonteCarloSpheresoption,whichaffectsthespeedand

accuracyofnumericalintegration.Formoreinformation,seeAdvancedOptionsforthe
NonlinearDesigneronpage 445intheNonlinearDesignschapter.

Example
ThisexampleshowshowtousetheAcceleratedLifeTestDesigntoaugmentanexisting
design.
Anacceleratedlifetestwasperformed,andtheresultsareintheCapacitor ALT.jmpsample
datatable(intheDesign Experimentfolder).Fiftyunitsweretestedateachofthree

Chapter 15
Design of Experiments Guide

Accelerated Life Test Designs


Example

temperatures(85o,105o,and125oCelsius)for1500hours.Theresultingmodelisusedto
predicttheprobabilityoffailureat100,000hoursatnormaluseconditionsof25o.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Capacitor ALT.jmp.
2. RuntheFit Life by Xtablescript.
3. IntheDistributionProfiler,enter25forTempand100,000forHours.
TheprofilerisshowninFigure 15.7.
Figure 15.7DistributionProfilerforCapacitorModel

Thepredictedprobabilityoffailureat100,000hoursat25ois0.00358,withaconfidence
intervalof0.00056to0.0227.Theanalystwantstodecreasethewidthoftheconfidence
interval.Todoso,theexperimentneedstobeaugmentedwithadditionaldata.
Toaugmentthedesignintheoptimalway,usetheAcceleratedLifeTestDesignplatform.
Followthestepsbelowtousetheplatform:
1. SelectDOE>Accelerated Life Test Design.
2. SelectDesign for one accelerating factorandclickContinue.
3. EnterTemperatureforFactor Name.
4. Enter5forNumber of Levels.
5. Enter25forbothLow Usage ConditionandHigh Usage Condition.
6. ClickContinue.
7. Enter85,95,105,115,and125fortheTemperature Level Values.
8. SelectWeibullforDistribution Choice.
9. UnderPrior Mean,entertheaccelerationmodelparametersfromtheFitLifebyX
Estimatesreport.SeeFigure 15.8.
Enter35.200forIntercept.
Enter1.389forTemperature.
Enter1.305forscale.

425

426

Accelerated Life Test Designs


Example

Chapter 15
Design of Experiments Guide

Figure 15.8FitLifebyXEstimates

IntheFitLifebyXoutput,undertheEstimatesreport,istheCovarianceMatrixreport.Note
thevariancesfortheaccelerationmodelparametersare22,0.025,and0.013.Thesevalueswill
becomparedtoourfinalresultsattheend.
10. Enter100,000forbothboxesforTime range of interest.
11. Enter1500forLength of Test.
12. Enter300forNumber of Units Under Test.Thepreviousexperimentused150units,andthe
nextexperimentuses150units,foratotalof300.
ThecompletedwindowisshowninFigure 15.9.
Figure 15.9CompletedWindow

Chapter 15
Design of Experiments Guide

Accelerated Life Test Designs


Example

427

13. ClickContinue.
14. Toaccountfortheunitsinthepreviousexperiment,enterthefollowingunderCandidate
Runs.
Enter50forMinimumUnitsfor85o.
Enter50forMinimumUnitsfor105o.
Enter50forMinimumUnitsfor125o.
15. FromtheredtrianglemenuforAcceleratedLifeTestPlan,selectALT Optimality Criterion>
Make Probability I-Optimal Design.
16. ClickMake Design.
Theoptimalexperimentaldesignisreturned,alongwithotherresults.SeeFigure 15.10.
Figure 15.10OptimalDesign

TheoptimaldesigniscomputedbasedontheNumberofUnitsUnderTest,CandidateRuns,
andotherinformationthatyouspecifiedearlier.Theoptimaldesignconsistsofthefollowing
numberofunitsateachtemperaturelevel:

184unitsat85o.Sincethepreviousexperimentused50units,134additionalunitsare
needed.

0unitsat95o.Thenextexperimentwillnotutilizeanyunitsatthislevel.

50unitsat105o.Sincethepreviousexperimentalreadyused50units,noadditionalunits
areneeded.

0unitsat115o.Thenextexperimentwillnotutilizeanyunitsatthislevel.

66unitsat125o.Sincethepreviousexperimentused50units,16additionalunitsare
needed.

Asweenteredearlier,atotalof134+16=150unitsareusedforthenewexperiment.

428

Accelerated Life Test Designs


Example

Chapter 15
Design of Experiments Guide

Anestimateoftheaccelerationmodelparametersvariancesisgiven.Notethat,duetothe
additionaldata,allthreevariancesaresmallerthanbeforefromtheoriginalFitLifebyX
report.
IntheProfiler,enter25forTemperatureand100,000forTime.Theestimatedprobabilityof
failureis0.00357,withanestimatedconfidenceintervalof0.00106to0.01201.Thisintervalis
narrowerthantheonefromthepreviousexperiment,asaresultoftheadditionalunitstobe
tested.
Todecreasetheintervalfurther,tryenteringmorethan300unitstobetested.

Chapter 16
Nonlinear Designs
Designofexperimentswithmodelsthatarenonlinearintheirparametersisavailableusing
eithertheDOEmenuortheJMPStarterDOEcategory.
Nonlineardesignsofferbothadvantagesanddisadvantagescomparedtodesignsforlinear
models.
Onthepositiveside,predictionsusingawellchosenmodelarelikelytobegoodoverawider
rangeoffactorsettings.Itisalsopossibletomodelresponsesurfaceswithmorecurvatureand
withasymptoticbehavior.
Onthenegativeside,theresearcherneedsagreaterunderstandingofboththesystemandof
thenonlineardesigntool.

Contents
ExamplesofNonlinearDesigns................................................... 431
UsingNonlinearFittoFindPriorParameterEstimates............................ 431
CreatingaNonlinearDesignwithNoPriorData ................................. 438
CreatingaNonlinearDesign ...................................................... 442
IdentifytheResponseandFactorColumnwithFormula........................... 443
SetUpFactorsandParametersintheNonlinearDesignDialog ..................... 443
EntertheNumberofRunsandPreviewtheDesign............................... 444
MakeTableorAugmenttheTable.............................................. 445
AdvancedOptionsfortheNonlinearDesigner...................................... 445

Chapter 16
Design of Experiments Guide

Nonlinear Designs
Examples of Nonlinear Designs

431

Examples of Nonlinear Designs


TheNonlinearDesignerallowsscientiststogenerateoptimaldesignsandoptimallyaugment
dataforfittingmodelsthatarenonlinearintheirparameters.Suchmodels,whentheyare
descriptiveoftheunderlyingprocess,canyieldmoreaccuratepredictionofprocessbehavior
thanispossiblewiththestandardpolynomialmodels.
TousetheNonlinearDesigner,youfirstneedadatatablethathas

onecolumnforeachfactor

onecolumnfortheresponse

acolumnthatcontainsaformulashowingthefunctionalrelationshipbetweenthefactor(s)
andtheresponse.

Thisisthesameformatforatableyouwouldsupplytothenonlinearplatformformodeling.
Thefirstexampleinthissectiondescribeshowtoapproachcreatinganonlineardesignwhen
thereispriordata.Thesecondexampledescribeshowtoapproachcreatingthedesign
withoutdata,butwithreasonablestartingvaluesfortheparameterestimates.

Using Nonlinear Fit to Find Prior Parameter Estimates


SupposeyouhavealreadycollectedexperimentaldataandplaceditinaJMPdatatable.That
tablecanbeusedtocreateanonlineardesignforimprovingtheestimatesofthemodels
parameters.
Tofollowalongwiththisexample,openChemical Kinetics.jmpfromtheNonlinear Examples
folderfoundinthe sampledatainstalledwithJMP.
Chemical Kinetics.jmp(Figure 16.1)containsacolumn(Model (x))whosevaluesareformedbya

formulawithapoorguessoftheparametervalues.

432

Nonlinear Designs
Examples of Nonlinear Designs

Chapter 16
Design of Experiments Guide

Figure 16.1ChemicalKinetics.jmp

First,fitthedatatothemodelusingnonlinearleastsquarestogetbetterparametervalues.
1. SelectAnalyze > Modeling > Nonlinear.
2. SelectVelocity (y)andclickY, Responseonthenonlinearlaunchdialog.
3. SelectModel (x)andclickX, Predictor Formula(seeFigure 16.2).Notethattheformula
givenbyModel (x)showsinthelaunchdialog.
Figure 16.2InitialNonlinearAnalysisLaunchDialog

Chapter 16
Design of Experiments Guide

Nonlinear Designs
Examples of Nonlinear Designs

433

4. Click OK onthelaunchdialogtoseetheNonlinearFitControlPanel.
5. ClickGointheControlPaneltoobtaintheestimatesshowninFigure 16.3.
Figure 16.3NonlinearFitResults

6. ClicktheConfidence LimitsbuttontoaddconfidenceintervalstotheSolutionreport.
TherangesforLowerCLandUpperCLaretheintervalsforVMaxandk.Theyare
asymptoticallynormal.UsetheselimitstocreateanonlineardesigninJMP.
7. ClickSave EstimatestoaddthenewfittedparametervaluesintheModel (x) columninthe
Chemical Kinetics.jmp datatable.
Clickthe+signnexttoModel (x)intheColumnspaneltoviewtheformula.Select
Parametersfromthemenuintheupperleftoftheformulaeditortoviewthenew
parameterestimates.

434

Nonlinear Designs
Examples of Nonlinear Designs

Chapter 16
Design of Experiments Guide

Figure 16.4NewParameterEstimates

Note: LeavethenonlinearanalysisreportopenbecausetheseresultsareneededintheDOE
nonlineardesigndialogdescribednext.
Nowcreateadesignforfittingthemodelsnonlinearparameters.
1. WiththeChemical Kinetics.jmp datatableopen,selectDOE > Nonlinear Design.
2. CompletethelaunchdialogthesamewayastheNonlinearAnalysislaunchdialogshown
previously.Thatis,SelectVelocity (y)andclickY, Response.SelectModel (x)andclickX,
Predictor Formula.Figure 16.5showsthecompleteddialog.
Figure 16.5InitialNonlinearDesignLaunchDialog

3. ClickOKtoseethecompletedDesignpanelsforfactorsandparameters,asshownin
Figure 16.6.

Chapter 16
Design of Experiments Guide

Nonlinear Designs
Examples of Nonlinear Designs

435

Figure 16.6NonlinearDesignPanelsforFactorsandParameters

NotethatinChemical Kinetics.jmp(Figure 16.1),therangeofdataforConcentrationgoes


from0.417to6.25.Therefore,thesevaluesinitiallyappearasthehighandlowvaluesin
theFactorscontrolpanel.
4. ChangethefactorrangeforConcentration toabroaderintervalfrom0.1to7
(Figure 16.7).
NotethattheaprioridistributionoftheparametersVMaxandkisNormal,whichiscorrect
forthisexample.Changethecurrentlevelofuncertaintyinthetwoparametersusingthe
analysisresults.
5. LookbackattheanalysisreportinFigure 16.3afteryouaddedtheConfidenceLimits.
LocatetheupperandlowerconfidencelimitsforVMaxandk intheSolutiontable.Change
thevaluesforVMaxandktocorrespondtothoselimits,asshowninFigure 16.7.
Nowyouhavedescribedthecurrentlevelofuncertaintyofthetwoparameters.

436

Nonlinear Designs
Examples of Nonlinear Designs

Chapter 16
Design of Experiments Guide

Figure 16.7ChangeValuesforFactorandParameters

UsecommandsfromthemenuontheNonlinearDesigntitlebartogetthebestpossible
design:
6. Enter100inthetextboxforNumber of RunsintheDesignGenerationpanel.
7. SelectAdvanced Options>Number of Monte Carlo Samplesandenter2inthetextbox.
8. ClickMake Designtopreviewthedesign(Figure 16.8).Yourresultsmightdifferfrom
thoseshownfortheadditionalruns.

Chapter 16
Design of Experiments Guide

Nonlinear Designs
Examples of Nonlinear Designs

437

Figure 16.8SelectingtheNumberofRuns

9. ClickMake Table.
ThiscreatesanewJMPdesigntable(Figure 16.9)whoserowsaretherunsdefinedbythe
nonlineardesign.
Note: ThisexamplecreatesanewtabletoavoidalteringthesampledatatableChemical
Kinetics.jmp.Inmostcases,however,youcanaugmenttheoriginaltableusingthe
Augment Table option intheNonlinearDesignerinsteadofmakinganewtable.This
optionaddsthenewrunsshownintheDesigntotheexistingdatatable.

438

Nonlinear Designs
Examples of Nonlinear Designs

Chapter 16
Design of Experiments Guide

Figure 16.9MakingaTablewiththeNonlinearDesigner

Thenewrunsusethewiderintervalofallowedconcentration,whichleadstomoreprecise
estimatesofkandVmax.

Creating a Nonlinear Design with No Prior Data


Thisnextexampledescribeshowtocreateadesignwhenyouhavenotyetcollecteddata,but
haveaguessfortheunknownparameters.
Tofollowalongwiththisexample,openReaction Kinetics Start.jmp,foundintheDesign
Experiment folderinthesampledatainstalledwithJMP.Noticethatthetableisatemplate.
Thatis,thetablehascolumnswithpropertiesandformulas,buttherearenoobservationsin
thetable.Thedesignhasnotyetbeencreatedanddatahavenotbeencollected.
Thistableisusedtosupplytheformulaintheyield modelcolumntotheNonlinearDOE
platform.Theformulaisusedtocreateanonlineardesignforfittingthemodelsnonlinear
parameters.
Figure 16.10YieldModelFormula

Chapter 16
Design of Experiments Guide

Nonlinear Designs
Examples of Nonlinear Designs

439

ThismodelisfromBoxandDraper(1987).Theformulaarisesfromthefractionalyieldofthe
intermediateproductinaconsecutivechemicalreaction.Itiswrittenasafunctionoftimeand
temperature.
1. WiththeReaction Kinetics Start.jmpdatatableopen,selectDOE > Nonlinear Designtosee
theinitiallaunchdialog.
2. Selectobserved yieldandclickY, Response.
3. Select yield model(thecolumnwiththeformula) andclickX, Predictor Formula.
ThecompleteddialogshouldlookliketheoneinFigure 16.11.
Figure 16.11NonlinearDesignlaunchDialog

4. ClickOKtoseethenonlineardesignFactorsandParameterspanelsinFigure 16.12.
5. Changethetwofactorsvaluestobeareasonablerangeofvalues.(Inyourexperiment,
thesevaluesmighthavetobeaneducatedguess.)Forthisexample,usethevalues510and
540forReaction Temperature.Usethevalues0.1and0.3forReaction Time.
6. Changethevaluesoftheparametert1to25and50,andt3to30and35.
7. ClickontheDistributionofeachparameterandselectUniformfromthemenutochange
thedistributionfromthedefaultNormal (seeFigure 16.12).
8. Changethenumberofrunsto12intheDesignGenerationpanel.

440

Nonlinear Designs
Examples of Nonlinear Designs

Chapter 16
Design of Experiments Guide

Figure 16.12ChangeFactorValues,ParameterDistributions,andNumberofRuns

9. ClickMake Design,then Make Table.Yourresultsshouldlooksimilartothosein


Figure 16.13.
Figure 16.13DesignTable

10. Toanalyzedatathatcontainsvaluesfortheresponse,observed yield,openReaction


Kinetics.jmpfromtheDesign ExperimentfolderinthesampledatainstalledwithJMP
(Figure 16.14).

Chapter 16
Design of Experiments Guide

Nonlinear Designs
Examples of Nonlinear Designs

441

Figure 16.14ReactionKinetics.jmp

First,examinethedesignregionwithanoverlayplot.
11. SelectGraph > Overlay Plot.
12. Removeallexistingcolumnassignments.
13. SelectReaction TemperatureandclickY
14. SelectReaction TimeandclickX asshownintheOverlayPlotlaunchdialogin
Figure 16.15.
15. ClickOKtoseetheoverlayplotinFigure 16.15.
Figure 16.15CreateanOverlayPlot

Noticethatthepointsarenotatthecornersofthedesignregion.Inparticular,thereareno
pointsatlowtemperatureandhightimethelowerrightcornerofthegraph.
16. SelectAnalyze > Modeling > Nonlinear.
17. Removeallexistingcolumnassignments.

442

Nonlinear Designs
Creating a Nonlinear Design

Chapter 16
Design of Experiments Guide

18. Selectobserved yieldandclickY, Response.


19. Selectyield modelandclicktheX, Predictor Formula,thenclick OK.
20. ClickGoontheNonlinearcontrolpanel.
21. Now,chooseProfilers > Profiler fromtheredtrianglemenuontheNonlinearFittitlebar.
22. Tomaximizetheyield,chooseMaximize Desirabilityfromtheredtrianglemenuonthe
PredictionProfilertitlebar.
Themaximumyieldisapproximately63.5%atareactiontemperatureof540degreesKelvin
andareactiontimeof0.1945minutes.
Figure 16.16TimeandTemperatureSettingsforMaximumYield

Creating a Nonlinear Design


Tobegin,openadatatablethathasacolumnwhosevaluesareformedbyaformula(for
detailsaboutformulas,seetheUsingJMP).Thisformulamusthaveparameters.
SelectDOE > Nonlinear Design,orclicktheNonlinear Design buttonontheJMPStarterDOE
page.Then,followthestepsbelow:

IdentifytheResponseandFactorColumnwithFormulaonpage 443

SetUpFactorsandParametersintheNonlinearDesignDialogonpage 443

EntertheNumberofRunsandPreviewtheDesignonpage 444

MakeTableorAugmenttheTableonpage 445

Chapter 16
Design of Experiments Guide

Nonlinear Designs
Creating a Nonlinear Design

443

Identify the Response and Factor Column with Formula


1. Openadatatablethatcontainsacolumnwhosevaluesareformedbyaformulathathas
parameters.ThisexampleusesCorn.jmpfromtheNonlinear Examplesfolderinthesample
datainstalledwithJMP.
2. SelectDOE > Nonlinear Designtoseetheinitiallaunchdialog.
3. SelectyieldandclickY, Response.Theresponsecolumncannothavemissingvalues.
4. Select quadandclickX, Predictor Formula.Thequadvariablehasaformulathatincludes
nitrateandthreeparameters(Figure 16.17).
5. ClickOKonthelaunchdialogtoseetheNonlinearDesignDOEpanels.
Figure 16.17IdentifyResponse(Y)andtheColumnwiththeNonlinearFormula(X)

Set Up Factors and Parameters in the Nonlinear Design Dialog


First,lookattheformulaforquad,showninFigure 16.18,andnoticetherearethree
parameters.TheseparametersshowintheParameterspaneloftheNonlineardesigndialog,
withinitialparametervalues.
Figure 16.18Formulafor quadhasParametersa,b,andc

UseFigure 16.19tounderstandhowtosetupfactorandparameternamesandvalues.

Theinitialvaluesforthefactorandtheparametersarereasonableanddonotneedtobe
changed.

Ifnecessary,changetheDistributionoftheparameterstoUniform,asshowninFigure 16.19.

444

Nonlinear Designs
Creating a Nonlinear Design

Chapter 16
Design of Experiments Guide

Figure 16.19ExampleofSettingUpFactorsandParameters
Double-click to edit the factor or
parameter name.

Click to enter or change factor values.

Click to edit the distribution: Uniform, Normal,


Lognormal, or Exponential.

Enter the Number of Runs and Preview the Design


1. TheDesignGenerationpanelshows150asthedefaultnumberofruns.Thisnumber
includesobservationsinthecurrentdata.147runsaredesired.Sincethereareoriginally
144rows,3additionalrunsneedtobeadded.Enter147intheNumber of Runseditbox.
2. ClickMake Designbeforecreatingthedatatabletopreviewthedesign.Figure 16.20shows
apartiallistingofthedesign.

Chapter 16
Design of Experiments Guide

Nonlinear Designs
Advanced Options for the Nonlinear Designer

445

Figure 16.20ExamplePreviewDesign

Make Table or Augment the Table


3. ThelaststepistoclickeitherMake Table or Augment Table.TheMake Tablecommand
createsanewtable(Figure 16.21)withallrunsincluded.TheAugment Tablecommand
addsthenewrunstotheexistingtable.
Figure 16.21PartialListingofanExampleNonlinearDesignTable

Advanced Options for the Nonlinear Designer


Foradvancedusers,theNonlinearDesignerhasthetwoadditionaloptions,asshownin
Figure 16.22.TheseadvancedoptionsareincludedbecausefindingnonlinearDOEsolutions
involvesminimizingtheintegralofthelogofthedeterminantoftheFisherinformationmatrix

446

Nonlinear Designs
Advanced Options for the Nonlinear Designer

Chapter 16
Design of Experiments Guide

withrespecttothepriordistributionoftheparameters.Theseintegralsarecomplicatedand
havetobecalculatednumerically.
ThewaytheintegrationisdoneforNormaldistributionpriorsusesanumericalintegration
techniquewheretheintegralisreparameterizedintoaradialdirection,andthenumberof
parametersminusoneangulardirections.Theradialpartoftheintegralishandledusing
RadauGaussLaguerrequadraturewithanevaluationatradius=0.Arandomized
Mysovskikhquadratureisusedtocalculatetheintegraloverthesphericalpart,whichis
equivalenttointegratingoverthesurfaceofahypersphere.
Note: IfsomeofthepriordistributionsarenotNormal,thentheintegralisreparameterizedso
thatthenewparametershavenormaldistribution,andthentheradialsphericalintegration
methodisapplied.However,ifthepriordistributionsetfortheparametersdoesnotlenditself
toasolution,sometimestheprocessfailsandgivesthemessagethattheFisherinformationis
singularinaregionoftheparameterspace,andadviseschangingthepriordistributionorthe
rangesoftheparameters.
Figure 16.22AdvancedOptionsfortheNonlinearDesigner

Thefollowingisatechnicaldescriptionforthesetwoadvancedoptions:
Number of Monte Carlo Samples setsthenumberofoctahedrapersphere.Becauseeach

octahedronisafixedunit,thisoptioncanbethoughtofassettingthenumberofoctahedra
persphere.
arethenumberofnonzeroradiusvaluesused.Thedefaultistwo
spheresandonecenterpoint.Eachradialvaluerequiresintegrationovertheangular
dimensions.Thisisdonebyconstructingacertainnumberofhyperoctahedra(the
generalizationofanoctagoninarbitrarydimensions),andrandomlyrotatingeachofthem.

N Monte Carlo Spheres

Technical Thereasonfortheapproachgivenbytheseadvancedoptionsistogetgoodintegral
approximationsmuchfasterthanusingstandardmethods.Forinstance,withsixparameters,
usingtworadiiandonesamplepersphere,thesemethodsgiveageneralizedfivepointrule
thatneedsonly113observationstogetagoodapproximation.Usingthemostcommon
approach(Simpsonsrule)wouldneed56=15,625evaluations.ThestraightMonteCarlo
approachalsorequiresthousandsoffunctionevaluationstogetthesamelevelofqualityin
theanswer.Formoredetails,seeGotwalt,Jones,andSteinberg(2009).

Chapter 16
Design of Experiments Guide

Nonlinear Designs
Advanced Options for the Nonlinear Designer

447

Keepinmindthatifthenumberofradiiissettozero,thenjustthecenterpointisused,which
givesalocaldesignthatisoptimalforaparticularvalueoftheparameters.Forsomepeople
thisisgoodenoughfortheirpurposes.Thesedesignsarecreatedmuchfasterthanifthe
integrationisperformed.

448

Nonlinear Designs
Advanced Options for the Nonlinear Designer

Chapter 16
Design of Experiments Guide

Chapter 17
Taguchi Designs
Qualitywasthewatchwordofthe1980s,andGenichiTaguchiwasaleaderinthegrowthof
qualityconsciousness.OneofTaguchistechnicalcontributionstothefieldofqualitycontrol
wasanewapproachtoindustrialexperimentation.ThepurposeoftheTaguchimethodwasto
developproductsthatworkedwellinspiteofnaturalvariationinmaterials,operators,
suppliers,andenvironmentalchange.Thisisrobustengineering.
MuchoftheTaguchimethodistraditional.Hisorthogonalarraysaretwolevel,threelevel,and
mixedlevelfractionalfactorialdesigns.Theuniqueaspectsofhisapproacharetheuseof
signalandnoisefactors,innerandouterarrays,andsignaltonoiseratios.
ThegoaloftheTaguchimethodistofindcontrolfactorsettingsthatgenerateacceptable
responsesdespitenaturalenvironmentalandprocessvariability.Ineachexperiment,
Taguchisdesignapproachemploystwodesignscalledtheinnerandouterarray.TheTaguchi
experimentisthecrossproductofthesetwoarrays.Thecontrolfactors,usedtotweakthe
process,formtheinnerarray.Thenoisefactors,associatedwithprocessorenvironmental
variability,formtheouterarray.Taguchissignaltonoiseratiosarefunctionsoftheobserved
responsesoveranouterarray.TheTaguchidesignersupportsallthesefeaturesoftheTaguchi
method.Youchoosefrominnerandouterarraydesigns,whichusethetraditionalTaguchi
orthogonalarrays,suchasL4,L8,andL16.
Dividingsystemvariablesaccordingtotheirsignalandnoisefactorsisakeyingredientin
robustengineering.Signalfactorsaresystemcontrolinputs.Noisefactorsarevariablesthat
aretypicallydifficultorexpensivetocontrol.
Theinnerarrayisadesigninthesignalfactorsandtheouterarrayisadesigninthenoise
factors.Asignaltonoiseratioisastatisticcalculatedoveranentireouterarray.Itsformula
dependsonwhethertheexperimentalgoalistomaximize,minimizeormatchatargetvalue
ofthequalitycharacteristicofinterest.
ATaguchiexperimentrepeatstheouterarraydesignforeachrunoftheinnerarray.The
responsevariableinthedataanalysisisnottherawresponseorqualitycharacteristic;itisthe
signaltonoiseratio.
TheTaguchidesignerinJMPsupportssignalandnoisefactors,innerandouterarrays,and
signaltonoiseratiosasTaguchispecifies.

Contents
TheTaguchiDesignApproach.................................................... 451
TaguchiDesignExample......................................................... 451
AnalyzetheData ............................................................. 454
CreatingaTaguchiDesign........................................................ 456
DetailtheResponseandAddFactors ........................................... 456
ChooseInnerandOuterArrayDesigns ......................................... 457
DisplayCodedDesign........................................................ 458
MaketheDesignTable ........................................................ 458

Chapter 17
Design of Experiments Guide

Taguchi Designs
The Taguchi Design Approach

451

The Taguchi Design Approach


TheTaguchimethoddefinestwotypesoffactors:controlfactorsandnoisefactors.Aninner
designconstructedoverthecontrolfactorsfindsoptimumsettings.Anouterdesignoverthe
noisefactorslooksathowtheresponsebehavesforawiderangeofnoiseconditions.The
experimentisperformedonallcombinationsoftheinnerandouterdesignruns.A
performancestatisticiscalculatedacrosstheouterrunsforeachinnerrun.Thisbecomesthe
responseforafitacrosstheinnerdesignruns.Table 17.1liststherecommendedperformance
statistics.
Table 17.1RecommendedPerformanceStatistics
Goal

S/N Ratio Formula

nominalisbest

2
S--------
= 10 log Y
N
s2

largerisbetter(maximize)

S1
--= 10 log --1- ------2
n
N
i Y
i

S- = 10 log --12
-- Yi
n
N
i

smallerisbetter
(minimize)

Taguchi Design Example


ThefollowingexampleisanexperimentdoneatBaylockManufacturingCorporationand
describedbyByrneandTaguchi(1986).Theobjectiveoftheexperimentistofindsettingsof
predeterminedcontrolfactorsthatsimultaneouslymaximizetheadhesiveness(pulloffforce)
andminimizetheassemblycostsofnylontubing.
Tofollowalongwiththisexample,opentheByrne Taguchi Data.jmptablefoundintheDesign
ExperimentfolderoftheSampleDatainstalledwithJMP.Or,generatetheoriginaldesigntable
onyourownusingDOE > Taguchi Arrays.
Table 17.2showsthesignalandnoisefactorsintheByrneTaguchiDataforthisexample.
Table 17.2SignalandNoiseFactors
Factor Name

Type

Levels

Comment

Interfer

control

tubingandconnectorinterference

Wall

control

thewallthicknessoftheconnector

452

Taguchi Designs
Taguchi Design Example

Chapter 17
Design of Experiments Guide

Table 17.2SignalandNoiseFactors (Continued)


Factor Name

Type

Levels

Comment

Depth

control

insertiondepthofthetubingintothe
connector

Adhesive

control

percentadhesive

Time

noise

theconditioningtime

Temperature

noise

temperature

Humidity

noise

therelativehumidity

Tostartthisexample:
1. SelectDOE > Taguchi Arrays.
2. ClicktheredtriangleiconontheTaguchiDesigntitlebarandselectLoad Factors.
3. WhentheOpenFiledialogappears,openthefactorstable,Byrne Taguchi Factors.jmp
foundintheDesign Experiment sampledatafolderinstalledwithJMP.
Thefactorspanelthenshowsthefourthreelevelcontrol(signal)factorsandthreenoise
factors,asshowninFigure 17.1.
Figure 17.1Response,andSignalandNoiseFactorsfortheByrneTaguchiExample

4. HighlightL9-TaguchitogivetheL9orthogonalarrayfortheinnerdesign.
5. HighlightL8togiveaneightrunouterarraydesign.

Chapter 17
Design of Experiments Guide

Taguchi Designs
Taguchi Design Example

453

6. ClickContinue.
Theouterdesignhasthreetwolevelfactors.Afullfactorialineightrunsisgenerated.
However,itisonlyusedasaguidetoidentifyanewsetofeightcolumnsinthefinalJMPdata
tableoneforeachcombinationoflevelsintheouterdesign.
7. ClickMake TabletocreatethedesigntableshowninFigure 17.2.
Figure 17.2TaguchiDesignBeforeDataEntry

Now,supposethepulloffadhesiveforcemeasuresarecollectedandenteredintothe
columnscontainingmissingdata,asshowninFigure 17.3.Themissingdatacolumn
namesareappendedwiththeletterYbeforethelevels(+or)ofthenoisefactorsforthat
run.Forexample, Y--- isthecolumnofmeasurementstakenwiththethreenoisefactorsset
attheirlowlevels.
8. Toseethecompletedexperiment,openthedatatable,Byrne Taguchi Data.jmpfoundinthe
Design Experiment sampledatafolderinstalledwithJMP.Figure 17.3showsthecompleted
design.
Figure 17.3CompleteTaguchiDesignTable(ByrneTaguchiData.jmp)

ThecolumnnamedSN Ratio Yistheperformancestatisticcomputedwiththeformulashown


below.Inthiscase,itisthelargerthebetter(LTB)formula,whichis10timesthecommon
logarithmoftheaveragesquaredreciprocal:

454

Taguchi Designs
Taguchi Design Example

10Log10

Chapter 17
Design of Experiments Guide

[Mean[(

,
1
1
1
1
1
,
,
,
,
2
2
2
2 (Y+ )2
Y ) (Y +) (Y + ) (Y ++)

1
1
,
, 1
(Y+ +)2 (Y+ + )2 (Y+++)2

]]

Thisexpressionislargewhenalloftheindividualyvaluesarelarge.

Analyze the Data


ThedatainByrne Taguchi Data.jmparenowreadytoanalyze.Thegoaloftheanalysisistofind
factorsettingsthatmaximizeboththemeanandthesignaltonoiseratio.
1. ClicktheredtriangleiconnexttoModelontheupperleftofthedatatableandselectRun
Script.TheModelscriptproducestheFitModeldialog showninFigure 17.4.
TheFitModeldialogthatappearsautomaticallyhastheappropriateeffects.Itincludesthe
maineffectsofthefoursignalfactors.Thetworesponsesarethemean(Mean Y)and
signaltonoiseratio(SN Ratio Y)overtheouterarray.
Figure 17.4FitModelDialogforTaguchiData

2. ClickRunontheFitModeldialog.
Thepredictionprofilerisaquickwaytofindsettingsthatgivethehighestsignaltonoise
ratioforthisexperiment.
3. ToopenthePredictionProfiler,clicktheredtriangleontheResponseMeanYtitlebarand
selectFactor Profiling > Profiler.

Chapter 17
Design of Experiments Guide

Taguchi Designs
Taguchi Design Example

455

Theprofiletraces(Figure 17.5)indicatethatdifferentsettingsofthefirstthreefactors
wouldincreaseSN Ratio Y.
Figure 17.5ThePredictionProfiler

4. Tofindoptimalsettings,clicktheredtriangleonthePredictionProfilertitlebarandselect
Desirability Functions.Thisaddstherowoftracesandacolumnoffunctionsettingstothe
profiler,asshowninFigure 17.6.Thedefaultdesirabilityfunctionsaresetto
largerisbetter,whichiswhatyouwantinthisexperiment.SeetheProfilersbookformore
detailsaboutthepredictionprofiler.
5. AgainclicktheredtriangleonthePredictionProfilertitlebarandselectMaximize
Desirabilitytoautomaticallysetthepredictiontracesthatgivethebestresultsaccordingto
thedesirabilityfunctions.
Inthisexample,thesettingsforInterferandWallchangedfrom1to2.(SeeFigure 17.5and
Figure 17.6).TheDepthsettingchangedfrom1to3.ThesettingsforAdhesivedidnotchange.
Thesenewsettingsincreasedthesignaltonoiseratiofrom24.0253to26.9075.
Figure 17.6BestFactorSettingsforByrneTaguchiData

456

Taguchi Designs
Creating a Taguchi Design

Chapter 17
Design of Experiments Guide

Creating a Taguchi Design


TostartaTaguchidesign,select DOE>Taguchi Arrays,orclicktheTaguchi Arrays buttononthe
JMPStarterDOEpage.Then,followthestepsbelow:

DetailtheResponseandAddFactorsonpage 456

ChooseInnerandOuterArrayDesignsonpage 457

DisplayCodedDesignonpage 458

MaketheDesignTableonpage 458

Detail the Response and Add Factors


TheResponsespanelhasasingledefaultresponse.Thestepsforsettingupthedetailsofthis
responseareoutlinedinFigure 17.7.Forinformationonimportanceweightsandlowerand
upperlimits,seeUnderstandingImportanceWeightsonpage 243intheScreening
Designschapter.
1. Doubleclicktoedittheresponsename.
2. Clicktochangetheresponsegoal:LargerIsBetter,NominalisBest,SmallerisBetter,or
None.
3. Clicktoenterlowerandupperlimitsandimportanceweights.
Figure 17.7SettingUptheResponse
3

AddfactorsintheFactorsoutline.
Specifyoneormore2or3levelsignalfactors.Signalfactorsaresystemcontrol
inputs.Thesearefactorsthatyoucancontrolinproduction.

Signal

Noise Specifyoneormorenoisefactors.Noisefactorsarevariablesthataredifficultor

expensivetocontrolinproduction.However,youmustbeabletocontrolnoisefactors
duringtheexperiment.

Chapter 17
Design of Experiments Guide

Taguchi Designs
Creating a Taguchi Design

457

Remove Removestheselectedfactors.

ThestepsforspecifyingfactorsaregiveninFigure 17.8.
1. Clicktoaddasignal,thenselectasignaltype:2 Level,or3 Level.
Orclicktoaddanoise.
2. Doubleclicktoeditthefactorname.
3. Tochangethevalueofasignalornoise,clickandthentypethenewvalue.
Figure 17.8EnteringFactors
1

Whenyoufinishaddingfactors,clickContinue.

Choose Inner and Outer Array Designs


Yourchoiceforinnerandouterarraysdependsonthenumberandtypeoffactorsyouhave.
Figure 17.9showstheavailableinnerarraychoiceswhenyouhaveeightsignalfactors.Ifyou
alsohavenoisefactors,choicesincludedesignsfortheouterarray.Tofollowalong,entereight
twolevelSignal factorsandclickContinue.Thenhighlightthedesignyouwantandagain
clickContinue.ThisexampleusestheL12design.
Figure 17.9SelectingaDesignforEightSignalFactors

458

Taguchi Designs
Creating a Taguchi Design

Chapter 17
Design of Experiments Guide

Ifyoudidnotspecifyanoisefactor,afteryouclickContinue,adialogappearsthatasksyouto
specifyhowmanytimesyouwanttoperformeachinnerarrayrun.Specifytwo(2)forthis
example.

Display Coded Design


Afteryouselectadesigntype,theCodedDesign(Figure 17.10)isshownbelowtheFactors
panel.
Figure 17.10CodingforEightFactorL12Design

TheCodedDesignshowsthepatternofhighandlowvaluesforthefactorsineachrun.For
moredetailsonthecodeddesign,seeUnderstandingDesignCodesonpage 251inthe
ScreeningDesignschapter.

Make the Design Table


WhenyouclickMake Table,atablesimilartothatshowninFigure 17.11appears.Inthedata
table,eachrowrepresentsarun.InthevaluesforthePatternvariable,plussignsdesignate
highlevelsandminussignsrepresentlowlevels.

Chapter 17
Design of Experiments Guide

Figure 17.11TaguchiDesignTableforEightFactorL12Design

Taguchi Designs
Creating a Taguchi Design

459

460

Taguchi Designs
Creating a Taguchi Design

Chapter 17
Design of Experiments Guide

Chapter 18
Evaluate Designs
Explore Properties of Your Design
UsingtheEvaluateDesignplatform,youcan:

seethestrengthsandlimitationsofyourexistingexperimentaldesign

determineyourdesignsabilitytodetecteffectsassociatedwithmeaningfulchangesinthe
response

addresspredictionvarianceandtheprecisionofyourestimates

gaininsightonaliasing

obtainefficiencymeasures

TheEvaluateDesignplatformgeneratestheresultsthatappearintheDesignEvaluation
outlinesprovidedbyseveralDOEplatforms.DiagnosticsprovidedbybothEvaluateDesign
andtheDesignEvaluationoutlinesincludethefollowing:

poweranalysis

apredictionvarianceprofilerandsurfaceplot

afractionofdesignspaceplot,showinghowmuchofthedesignspacehasprediction
varianceaboveagivenvalue

estimationefficiencymeasuresforparameterestimates

thealiasmatrix,showingthebiasstructureformodeleffects

acolormapshowingabsolutecorrelationsamongeffects

designefficiencyvalues

Figure 18.1ComparisonofTwoFractionofDesignSpacePlots

Contents
OverviewofEvaluateDesign..................................................... 463
ExampleofEvaluateDesign...................................................... 464
AssessingtheImpactofLostRuns .............................................. 464
EvaluatingPowerRelativetoaSpecifiedModel.................................. 471
EvaluateDesignLaunchWindow ................................................. 473
EvaluateDesignWindow......................................................... 473
Factors ...................................................................... 475
Model ...................................................................... 475
AliasTerms.................................................................. 476
Design ...................................................................... 476
DesignEvaluation ............................................................ 476
PowerAnalysis .............................................................. 477
PredictionVarianceProfile .................................................... 483
FractionofDesignSpacePlot .................................................. 484
PredictionVarianceSurface .................................................... 485
EstimationEfficiency ......................................................... 487
AliasMatrix................................................................. 488
ColorMaponCorrelations .................................................... 490
DesignDiagnostics........................................................... 491
EvaluateDesignOptions......................................................... 493
TechnicalDetails................................................................ 494
PowerCalculations ........................................................... 494
RelativePredictionVariance................................................... 497

Chapter 18
Design of Experiments Guide

Evaluate Designs
Overview of Evaluate Design

463

Overview of Evaluate Design


TheEvaluateDesignplatformprovidespowerfultoolsthatenableyoutoassesstheproperties
ofyourdesign,whetheritiscreatedbyJMPoranothertool.Youcanusetheplatformbefore
conductinganexperimenttochoosefromseveraldesigns.Youcanalsoassesstheimpactof
incorrectsettingsorlostrunsinadesignthatyouhaveconducted.Youcanmodifytheterms
inyourassumedmodeltoseetheimpactofestimatingamodifiedmodel.Youcanalsomodify
thetermsthatappearintheAliasTermsoutlinetoseetheimpactontheAliasMatrix.
Youstartbyenteringinformationaboutthedesigninthelaunchwindow.Thenyoucan
modifytheassumedmodelandspecifywhicheffectsnotincludedinthemodelareof
potentialinterest.Basedonyourspecifications,theDesignEvaluationplatformthenprovides
anumberofwaystoevaluatethepropertiesofthegenerateddesign:
Power Analysis Enablesyoutoexploreyourabilitytodetecteffectsofgivensizes.
Prediction Variance Profile Showsthepredictionvarianceovertherangeoffactorsettings.
Fraction of Design Space Plot

Showshowmuchofthemodelpredictionvarianceliesbelow

oraboveagivenvalue.
Prediction Variance Surface Showsasurfaceplotofthepredictionvarianceforanytwo

continuousfactors.
Estimation Efficiency Foreachparameter,givesthefractionalincreaseinthelengthofa

confidenceintervalcomparedtothatofanideal(orthogonal)design,whichmightnot
exist.Alsogivestherelativestandarderroroftheparameters.
Givescoefficientsthatindicatethedegreetowhichthemodelparametersare
biasedbyeffectsthatarepotentiallyactive,butnotinthemodel.

Alias Matrix

Color Map on Correlations Showstheabsolutecorrelationsbetweeneffectsonaplotusingan

intensityscale.
Design Diagnostics Givesefficiencymeasuresforyourdesign.

Note: InseveralDOEplatforms,whenyouconstructadesign,aDesignEvaluationoutline
appears.ThisoutlineshowsresultsprovidedbytheEvaluateDesignplatform.Theplatforms
thatprovideaDesignEvaluationoutlineare:CustomDesign,DefinitiveScreeningDesign,
ScreeningDesign,ResponseSurfaceDesign,andMixtureDesignwithOptimaldesigntype.

464

Evaluate Designs
Example of Evaluate Design

Chapter 18
Design of Experiments Guide

Example of Evaluate Design


Thissectionpresentstwoexamples.Thefirstexampleassessestheimpactoflostruns.The
secondexampleevaluatesthepowertodetectaquadraticeffectinaspecifiedmodel.

Assessing the Impact of Lost Runs


Anexperimentwasconductedtoexploretheeffectofthreefactors(Silica,Sulfur,andSilane)
ontennisballbounciness(Stretch).Thegoaloftheexperimentistodevelopapredictive
modelforStretch.A15runBoxBehnkendesignwasselectedusingtheResponseSurface
Designplatform.Aftertheexperiment,theresearcherlearnedthatthetworunswhere
Silica = 0.7andSilane = 50werenotprocessedcorrectly.Theserunscouldnotbeincludedin
theanalysisofthedata.
UsetheEvaluateDesignplatformtoassesstheimpactofnotincludingthosetworuns.Obtain
diagnosticsfortheintended15rundesignandcomparethesetotheactual13rundesignthat
ismissingthetworuns.
Construct the Intended and Actual Designs
IntendedDesign
1. SelectHelp > Sample Data Library andopenDesign Experiment/Bounce Data.jmp.
2. SelectDOE > Evaluate Design.
3. SelectSilica,Sulfur,andSilaneandclickX, Factor.
YoucanaddStretch asY, Responseifyouwish.Butspecifyingtheresponsehasnoeffect
onthepropertiesofthedesign.
4. ClickOK.
LeaveyourEvaluateDesignwindowfortheintendeddesignopen.
Tip: PlacetheEvaluateDesignwindowfortheintendeddesignintheleftareaofyourscreen.
Afterthenextsteps,youwillplacethecorrespondingwindowfortheactualdesigntoits
right.
ActualDesignwithMissingRuns
Inthissection,youwillexcludetherunswhereSilica = 0.7andSilane = 50.Thesearerows1
and2inthedatatable.
1. InBounce Data.jmp,selectrows1and2,rightclickinthehighlightedarea,andselectHide
and Exclude.
2. SelectDOE > Evaluate Design.

Chapter 18
Design of Experiments Guide

Evaluate Designs
Example of Evaluate Design

465

3. ClickRecall.
4. ClickOK.
LeaveyourEvaluateDesignwindowfortheactualdesignopen.
Tip: PlacetheEvaluateDesignwindowfortheactualdesigntotherightoftheEvaluate
Designwindowfortheintendeddesigntofacilitatecomparingthetwodesigns.
Comparison of Intended and Actual Designs
Youcannowcomparethetwodesignsusingthesemethods:

PowerAnalysisonpage 465

PredictionVarianceProfileonpage 466

FractionofDesignSpacePlotonpage 468

EstimationEfficiencyonpage 469

ColorMaponCorrelationsonpage 470

DesignDiagnosticsonpage 471

PowerAnalysis
Ineachwindow,dothefollowing:
1. OpenthePowerAnalysisoutline.
Theoutlineshowsdefaultvaluesof1forallAnticipatedCoefficients.Thesevalues
correspondtodetectingachangeintheanticipatedresponseof2unitsacrossthelevelsof
thecorrespondingterms.Thepowercalculationsassumeanerrorterm(Anticipated
RMSE)of1.
Frompreviousstudies,youbelievethattheRMSEisapproximately2.
2. Type2nexttoAnticipated RMSE.
Whenyouclickoutsidethetextbox,thepowervaluesareupdated.
Youareinterestedindetectingdifferencesintheanticipatedresponsethatareontheorder
of6unitsacrossthelevelsofthecorrespondingterms.Thisdifferencerequiresthe
AnticipatedCoefficientstobe3.Tosettheseuniformly,usearedtriangleoption.
3. FromtheredtrianglemenunexttoEvaluateDesign,selectAdvanced Options > Set Delta
for Power.
4. Type6asyourvaluefordelta.
5. ClickOK.
Figure 18.2showsbothoutlines,withtheDesignandAnticipatedResponsesoutlineclosed.

466

Evaluate Designs
Example of Evaluate Design

Chapter 18
Design of Experiments Guide

Figure 18.2PowerAnalysisOutlines,IntendedDesign(Left)andActualDesign(Right)

Thepowervaluesfortheactualdesignareuniformlysmallerthanfortheintendeddesign.For
SilicaandSulfur,thepowerofthetestsintheactualdesignisalmosthalfthepowerinthe
intendeddesign.FortheSilica*Sulfurinteraction,thepowerofthetestintheactualdesignis

0.231,comparedto0.672intheintendeddesign.Theactualdesignresultsinsubstantiallossof
powerincomparisonwiththeintendeddesign.
PredictionVarianceProfile
1. Ineachwindow,openthePredictionVarianceProfileoutline.
2. Inthewindowfortheactualdesign,placeyourcursoronthescalefortheverticalaxis.
Whenyourcursorbecomesahand,rightclick.Select Edit > Copy Axis Settings.
Thisactioncreatesascriptcontainingtheaxissettings.Next,applytheseaxissettingsto
thePredictionVarianceProfileplotfortheintendeddesign.
3. IntheEvaluateDesignwindowfortheintendeddesign,locatethePredictionVariance
Profileoutline.Whenyourcursorbecomesahand,rightclick.Select Edit > Paste Axis
Settings.
TheplotsareshowninFigure 18.5,withtheplotfortheintendeddesignatthetopandfor
theactualdesignatthebottom.

Chapter 18
Design of Experiments Guide

Evaluate Designs
Example of Evaluate Design

467

Figure 18.3PredictionVarianceProfile,IntendedDesign(Top)andActualDesign(Bottom)

ThePredictionVarianceProfileplotsareprofilerviewsoftherelativepredictionvariance.
Youcanexploretherelativepredictionvarianceinvariousregionsofdesignspace.
Bothplotsshowthesamerelativepredictionvarianceinthecenterofthedesignspace.
However,thevarianceforpointsneartheedgesofthedesignspaceappearsgreaterthan
forthesamepointsintheintendeddesign.Explorethisphenomenonbymovingallthree
verticallinestopointsneartheedgesofthefactorsettings.
4. Inbothwindows,selectMaximize DesirabilityfromthePredictionVarianceProfilered
trianglemenu.
Figure 18.4showsthemaximumrelativepredictionvariancefortheintendedandactual
designs.

468

Evaluate Designs
Example of Evaluate Design

Chapter 18
Design of Experiments Guide

Figure 18.4PredictionVarianceProfileMaximized,IntendedDesign(Top)andActualDesign
(Bottom)

Forbothdesigns,theprofilersidentifythesamepointasoneofthedesignpointswhere
themaximumpredictionvarianceoccurs:Silica=0.7,Sulfur=1.8,andSilane=40.The
maximumpredictionvarianceis1.396fortheintendeddesign,and3.021fortheactual
design.Notethatthereareotherpointswherethepredictionvarianceismaximized.The
largermaximumpredictionvariancefortheactualdesignmeansthatpredictionsinparts
ofthedesignspacearelessaccuratethantheywouldhavebeenhadtheintendeddesign
beenconducted.
FractionofDesignSpacePlot
1. Ineachwindow,opentheFractionofDesignSpacePlotoutline.
2. Inthewindowfortheintendeddesign,rightclickintheplotandselectEdit > Copy Frame
Contents.
3. Inthewindowfortheactualdesign,locatetheFractionofDesignSpacePlotoutline.
4. RightclickintheplotandselectEdit > Paste Frame Contents
Figure 18.5showstheplotwithannotations.EachFractionofDesignSpacePlotshowsthe
proportionofthedesignspaceforwhichtherelativepredictionvariancefallsbelowa
specificvalue.

Chapter 18
Design of Experiments Guide

Evaluate Designs
Example of Evaluate Design

469

Figure 18.5FractionofDesignSpacePlots

Therelativepredictionvariancefortheactualdesignisgreaterthanthatoftheintended
designovertheentiredesignspace.Thediscrepancyincreaseswithlargerdesignspace
coverage.
EstimationEfficiency
Ineachwindow,opentheEstimationEfficiencyoutline.
Figure 18.6EstimationEfficiencyOutlines,IntendedDesign(Left)andActualDesign(Right)

Intheactualdesign(right),therelativestandarderrorsforallparameterseitherexceedor
equalthestandarderrorsfortheintendeddesign(left).Forallexceptthreeofthe
noninterceptparameters,therelativestandarderrorsintheactualdesignexceedthoseinthe
intendeddesign.
TheFractionalIncreaseinCILengthcomparesthelengthofaparametersconfidenceinterval
asgivenbythecurrentdesigntothelengthofsuchanintervalgivenbyanidealdesignofthe
samerunsize.Thelengthoftheconfidenceinterval,andconsequentlytheFractionalIncrease
inCILength,isaffectedbythenumberofruns.SeeFractionalIncreaseinCILengthon
page 487.Despitethereductioninrunsize,fortheactualdesign,thetermsSilane,
Silica*Silane,andSulfur*Silanehaveasmallerincreasethanfortheintendeddesign.Thisis

470

Evaluate Designs
Example of Evaluate Design

Chapter 18
Design of Experiments Guide

becausethetworunsthatwereremovedtodefinetheactualdesignhadSilanesettoitscenter
point.Byremovingtheseruns,thewidthsoftheconfidenceintervalsfortheseparameters
morecloselyresemblethoseofanidealorthogonaldesign,whichhasnocenterpoints.
ColorMaponCorrelations
Ineachreport,dothefollowing:
1. OpentheColor Map On Correlationsoutline.
Theplotsshowduplicationofthetwowayinteractionscausedbythefactthattheseare
includedintheAliasTermsoutline.Next,youremovetheinteractionsintheAliasTerms
outlinetoshowplotsthatincludeonlytheeffectsintheModeloutline.
2. OpentheAliasTermsoutlineandselectallthreetwowayinteractions.
3. ClickRemove Term.
4. GobacktotheColorMaponCorrelationsoutline.
Thetwocolormaps,showninFigure 18.7,areupdatedtoshowonlytheeffectsinthe
Modeloutline.Eachplotshowstheabsolutecorrelationsbetweeneffectscoloredusinga
bluetoredintensityscale.Ideally,youwouldlikezeroorverysmallcorrelationsbetween
effects.
Figure 18.7ColorMaponCorrelations,IntendedDesign(Left)andActualDesign(Right)

Chapter 18
Design of Experiments Guide

Evaluate Designs
Example of Evaluate Design

471

Theabsolutevaluesofthecorrelationsrangefrom0(blue)to1(red).Hoveroveracelltosee
thevalueoftheabsolutecorrelation.Thecolormapfortheactualdesignshowsmoreabsolute
correlationsthatarelargethandoesthecolormapfortheintendeddesign.Forexample,the
correlationbetweenSulfurandSilica*Sulfuris< .0001fortheintendeddesign,and0.5774for
theactualdesign.
DesignDiagnostics
Ineachreport,opentheDesignDiagnosticsoutline.
Figure 18.8DesignDiagnostics,IntendedDesign(Left)andActualDesign(Right)

Theintendeddesign(left)hashigherefficiencyvaluesandaloweraverageprediction
variancethantheactualdesign(right).TheresultsoftheDesignEvaluationanalysisindicate
thatthetwolostrunshavehadanegativeimpactonthedesign.
Notethatboththenumberofrunsandthemodelmatrixfactorintothecalculationof
efficiencymeasures.Inparticular,theD,G,andAefficienciesarecalculatedrelativetothe
idealdesignfortherunsizeofthegivendesign.Itisnotnecessarilytruethatlargerdesigns
aremoreefficientthansmallerdesigns.However,foragivennumberoffactors,largerdesigns
tendtohavesmallerAverageVarianceofPredictionvaluesthandosmallerdesigns.For
detailsonhowefficiencymeasuresaredefined,seeDesignDiagnosticsonpage 491.

Evaluating Power Relative to a Specified Model


Forthisexample,youhaveconstructedadefinitivescreeningdesigntodeterminewhichofsix
factorshaveaneffectontheyieldofanextractionprocess.ThedataaregivenintheExtraction
Data.jmpsampledatatable,locatedintheDesignExperimentfolder.Becausethedesignisa
definitivescreeningdesign,eachfactorhasthreelevels.SeetheDefinitiveScreeningDesigns
chapteronpage 195.
Youareinterestedinthepowerofteststodetectastrongquadraticeffect.Youconsidera
strongeffecttobeonewhosemagnitudeisatleastthreetimesaslargeastheerrorvariation.
Althoughtheexperimentstudiessixfactors,effectsparsitysuggeststhatonlyasmallsubset
offactorsisactive.Consequently,youfeelcomfortableinvestigatingpowerinamodelbased
onasmallernumberoffactors.Also,paststudiesonarelatedprocessprovidestrong
evidencetosuggestthatthreeofthefactors,Propanol,Butanol,andpH,havenegligiblemain
effects,donotinteractwithotherfactors,anddonothavequadraticeffects.Thisleadsyouto

472

Evaluate Designs
Example of Evaluate Design

Chapter 18
Design of Experiments Guide

believethatthelikelymodelcontainsmain,interaction,andquadraticeffectsonlyfor
Methanol,Ethanol,andTime.Youdecidetoinvestigatepowerinthecontextofathreefactor
responsesurfacemodel.
UsetheEvaluateDesignplatformtodeterminethepowerofyourdesigntodetectstrong
quadraticeffectsforMethanol,Ethanol,orTime.
1. SelectHelp > Sample Data Library andopenDesign Experiment/Extraction Data.jmp.
2. SelectDOE > Evaluate Design.
3. SelectMethanol,Ethanol,andTimeandclickX, Factor.
YoucanaddYield asY, Responseifyouwish.Butspecifyingtheresponsehasnoeffecton
thepropertiesofthedesign.
4. ClickOK.
5. IntheModeloutline,clickRSM.
Thisaddstheinteractionandquadratictermsforthethreefactors.
6. OpenthePowerAnalysisoutline.
NotethattheAnticipatedRMSEissetto1bydefault.Althoughyouhaveanestimateof
theRMSEfrompaststudies,youneednotenterit.Thisisbecausethemagnitudeofthe
effectofinterestisthreetimestheerrorvariation.
7. UnderAnticipated Coefficient,type3nexttoMethanol*Methanol,Ethanol*Ethanol,and
Time*Time.
8. ClickApply Changes to Anticipated Coefficients.
Figure 18.9PowerAnalysisOutlineafterApplyingChangestoCoefficients

Thepowerofdetectingaquadraticeffectwhosemagnitudeisthreetimestheerror
variationis0.737.Thisassumesafinalmodelthatisaresponsesurfaceinthreefactors.It
alsoassumesa0.05significancelevelforthetest.

Chapter 18
Design of Experiments Guide

Evaluate Designs
Evaluate Design Launch Window

473

Evaluate Design Launch Window


TolaunchtheEvaluateDesignplatform,openthedatatableofinterestandselectDOE>
Evaluate Design.TheexampleinFigure 18.10usestheBounce Data.jmpsampledatatable,
locatedintheDesignExperimentfolder.
Figure 18.10EvaluateDesignLaunchWindow

Thelaunchwindowcontainsthefollowingbuttons:
Y, Response Entertheresponsecolumnorcolumns.Enteringaresponseisoptional.

Responsevaluesarenotusedinevaluatingthedesign.Responsesmustbenumeric.
X, Factor Enterthefactorcolumns.FactorscanbeofanyDataTypeorModelingType.

Evaluate Design Window


TheEvaluateDesignwindowconsistsoftwoparts.SeeFigure 18.11,wherealloutlinenodes
areclosed.

TheFactors,Model,AliasTerms,andDesignoutlinesdefinethemodelanddesign.

TheDesignEvaluationoutlineprovidesresultsthatdescribethepropertiesofyourdesign.

474

Evaluate Designs
Evaluate Design Window

Chapter 18
Design of Experiments Guide

Figure 18.11EvaluateDesignWindowShowingAllPossibleOutlines

TheFactors,Model,AliasTerms,andDesignoutlinescontaininformationthatyouenter
aboutthefactors,assumedmodel,potentiallyaliasedeffectsofinterest,andtheactualdesign.
JMPpopulatestheseoutlinesusingyourselectionsinthelaunchwindowandthedesign
table.However,youcanmodifytheeffectsintheModelandAliasTermsoutlines.These
outlinesaredescribedinthefollowingsections:

Factorsonpage 475

Modelonpage 475

AliasTermsonpage 476

Designonpage 476

Onceyouhavemadeyourspecifications,theDesignEvaluationoutlinesareupdated.Youcan
opentheseoutlinestoseereportsorcontrolwindowsthatprovideinformationaboutyour
design.Theseoutlinesaredescribedinthefollowingsections:

PowerAnalysisonpage 477

PredictionVarianceProfileonpage 483

FractionofDesignSpacePlotonpage 484

PredictionVarianceSurfaceonpage 485

EstimationEfficiencyonpage 487

AliasMatrixonpage 488

ColorMaponCorrelationsonpage 490

DesignDiagnosticsonpage 491

Chapter 18
Design of Experiments Guide

Evaluate Designs
Evaluate Design Window

475

Factors
Thefactorsoutlineliststhefactorsenteredinthelaunchwindow.Youcanselectfactorsto
constructeffectsintheModeloutline.

Model
IfthedatatablecontainsascriptcalledModelorFitModel,theModeloutlinecontainsthe
effectsspecifiedinthatscript.Otherwise,theModeloutlinecontainsonlymaineffects.
Figure 18.12showstheModeloutlinefortheBounce Data.jmp datatable,foundintheDesign
Experimentfolder.TheModelscriptinthedatatablecontainsresponsesurfaceeffectsforthe
threefactorsSilica,Silane,andSulfur.Consequently,theModeloutlinecontainsthemain
effects,twowayinteractions,andquadraticeffectsforthesethreefactors.
Figure 18.12ModelOutlineforBounceData.jmp

YoucanaddeffectstotheModeloutlineusingthefollowingbuttons:
Main Effects Addsmaineffectsforallfactorsinthemodel.
Interactions Addsinteractioneffects.IfnofactorsareselectedintheFactorsoutline,select

2nd,3rd,4th,or5thtoaddallappropriateinteractionsuptothatorder.Addinteractions
uptoagivenorderforspecificfactorsbyselectingthefactornamesintheFactorsoutline,
selectingInteractions,andthenspecifyingtheappropriateorder.Interactionsbetween
nonmixtureandmixturefactors,andinteractionswithblockingandconstantfactors,are
notadded.
RSM Addsinteractionandquadratictermsuptothesecondorder(responsesurfacemodel

terms)forcontinuousfactors.CategoricalfactorsarenotincludedinRSMterms.Main
effectsfornonmixturefactorsthatinteractwithallthemixturefactorsareremoved.
Addsspecificinteractionterms.SelectfactornamesintheFactorsoutlineandeffect
namesintheModeloutline.ClickCrosstoaddthecrossedtermstotheModeloutline.

Cross

476

Evaluate Designs
Evaluate Design Window

Chapter 18
Design of Experiments Guide

Addspolynomialterms.IfnofactornamesareselectedintheFactorsoutline,adds
polynomialtermsforallcontinuousfactors.IffactornamesareselectedintheFactors
outline,addspolynomialtermsforonlythosefactors.Select2nd,3rd,4th,or5thtoadd
polynomialtermsofthatorder.

Powers

Scheff Cubic AddsScheffcubictermsforallmixturefactors.Thesetermsareusedto

specifyamixturemodelwiththirddegreepolynomialterms.
Remove Term Removesselectedeffects.

Alias Terms
Itispossiblethateffectsnotincludedinyourassumedmodelareactive.IntheAliasTerms
outline,listpotentiallyactiveeffectsthatarenotinyourassumedmodelbutmightbiasthe
estimatesofmodelterms.TheAliasMatrixentriesrepresentthedegreeofbiasimpartedto
modelparametersbytheeffectsthatyouspecifiedintheAliasTermsoutline.Fordetails,see
TheAliasMatrixonpage 601intheTechnicalDetailsappendix.
Bydefault,theAliasTermsoutlineincludesalltwowayinteractioneffectsthatarenotinyour
Modeloutline(withtheexceptionoftermsinvolvingblockingfactors).Addorremoveterms
usingthebuttons.ForadescriptionofhowtousethesebuttonstoaddeffectstotheAlias
Termstable,seeModelonpage 475.
IntheEvaluateDesignplatform,theAliasMatrixoutlineisimmediatelyupdatedtoreflect
changestoAliasMatrixeffects.IntheCustomDesignplatform,youmustclickMakeDesign
aftermodifyingtheeffectsintheAliasTermsoutline.WithinotherDOEplatformsthat
constructdesigns,thereisnoAliasTermsoutline.However,theAliasMatrixoutline,
containingappropriateeffects,appearsunderDesignEvaluationafteryouconstructthe
design.

Design
TheDesignoutlineshowsthedesignrunsforthefactorsthatyouhavespecifiedinthelaunch
window.YoucaneasilyviewthedesignasyouexploreitspropertiesintheDesignEvaluation
outline.

Design Evaluation
DesignEvaluationwithintheEvaluateDesignplatformisbasedonyourdesignandthe
specificationsthatyoumakeintheModelandAliasTermsoutlines.SeveralDOEDesign
platformsprovideaDesignEvaluationoutline:Custom,DefinitiveScreening,Screening,
ResponseSurface,andMixturewithOptimaldesigntype.DesignEvaluationwithinthese
platformsisbasedonthedesignthatyouconstruct.

Chapter 18
Design of Experiments Guide

Evaluate Designs
Evaluate Design Window

477

TheDesignEvaluationoutlinecontainseightheadings:

PowerAnalysisonpage 477

PredictionVarianceProfileonpage 483

FractionofDesignSpacePlotonpage 484

PredictionVarianceSurfaceonpage 485

EstimationEfficiencyonpage 487

AliasMatrixonpage 488

ColorMaponCorrelationsonpage 490

DesignDiagnosticsonpage 491

Power Analysis
ThePowerAnalysisoutlinecalculatesthepoweroftestsfortheparametersinyourmodel.
Poweristheprobabilityofdetectinganactiveeffectofagivensize.ThePowerAnalysis
outlinehelpsyouevaluatetheabilityofyourdesigntodetecteffectsofpracticalimportance.
Powerdependsonthenumberofruns,thesignificancelevel,andtheestimatederror
variation.Inparticular,youcandetermineifadditionalrunsarenecessary.
Thissectioncoversthefollowingtopics:

PowerAnalysisOverviewonpage 477

PowerAnalysisDetailsonpage 478

TestsforIndividualParametersonpage 479

TestsforCategoricalEffectswithMoreThanTwoLevelsonpage 480

DesignandAnticipatedResponsesOutlineonpage 480

PowerAnalysisforCoffeeExperimentonpage 481

Power Analysis Overview


PoweriscalculatedfortheeffectslistedintheModeloutline.Theseincludecontinuous,
discretenumeric,categorical,blocking,covariate,mixture,andcovariatefactors.Thetestsare
forindividualmodelparametersandforwholeeffects.Fordetailsonhowpoweriscalculated,
seePowerCalculationsonpage 494.
Poweristheprobabilityofrejectingthenullhypothesisofnoeffectatspecifiedvaluesofthe
modelparameters.Inpractice,yourinterestisnotinthevaluesofthemodelparameters,but
indetectingdifferencesinthemeanresponseofpracticalimportance.InthePowerAnalysis
outline,youcancomputeAnticipatedResponsesforspecifiedvaluesoftheAnticipated
Coefficients.Thishelpsyoutodeterminethecoefficientvaluesassociatedwiththedifferences
youwanttodetectinthemeanresponse.

478

Evaluate Designs
Evaluate Design Window

Chapter 18
Design of Experiments Guide

Figure 18.13showsthePowerAnalysisoutlineforthedesignintheCoffee Data.jmpsample


datatable,foundintheDesignExperimentfolder.ThemodelspecifiedintheModelscriptisa
maineffectsonlymodel.
Figure 18.13PowerAnalysisforCoffeeData.jmp

InthePowerAnalysisoutline,youcan:

Specifycoefficientvaluesthatreflectdifferencesthatyouwanttodetect.Youentertheseas
AnticipatedCoefficientsinthetoppartoftheoutline.

Specifyanticipatedresponsevaluesandapplythesetodeterminethecorresponding
AnticipatedCoefficients.YouspecifyAnticipatedResponsesintheDesignand
AnticipatedResponsespanel.

Power Analysis Details


SpecifyvaluesfortheSignificanceLevelandAnticipatedRMSE.Theseareusedtocalculate
thepowerofthetestsforthemodelparameters.
Theprobabilityofrejectingthehypothesisofnoeffect,ifitistrue.The
powercalculationsupdateimmediatelywhenyouenteravalue.

Significance Level

Anticipated RMSE Anestimateofthesquarerootoftheerrorvariation.Thepower

calculationsupdateimmediatelywhenyouenteravalue.

Chapter 18
Design of Experiments Guide

Evaluate Designs
Evaluate Design Window

479

ThetopportionofthePowerAnalysisreportopenswithdefaultvaluesfortheAnticipated
Coefficients.SeeFigure 18.13.ThedefaultvaluesarebasedonDelta.Fordetails,see
AdvancedOptions>SetDeltaforPoweronpage 493.
Figure 18.14showsthetopportionofthePowerAnalysisreportwherevalueshavebeen
specifiedfortheAnticipatedCoefficients.Thesevaluesreflectthedifferencesyouwantto
detect.
Figure 18.14PossibleSpecificationofAnticipatedCoefficientsforCoffeeData.jmp

TestsforIndividualParameters
TheTermcolumncontainsalistofmodelterms.Foreachterm,theAnticipatedCoefficient
columncontainsavalueforthatterm.ThevalueinthePowercolumnisthepowerofatest
thatthecoefficientforthetermis0ifthetruevalueofthecoefficientisgivenbythe
AnticipatedCoefficient.
Term

Themodeltermassociatedwiththecoefficientbeingtested.

Note: TheorderinwhichmodeltermsappearinthePowerAnalysisreportmaynotbe
identicaltotheirorderintheParameterEstimatesreportobtainedusingStandardLeast
Squares.Thisdifferencecanonlyoccurwhenthemodelcontainsaninteractionwithmore
thanonedegreeoffreedom.
Anticipated Coefficient Avalueforthecoefficientassociatedwiththemodelterm.Thisvalue

isusedinthecalculationsforPower.Thesevaluesarealsousedtocalculatethe
AnticipatedResponsecolumnintheDesignandAnticipatedResponsesoutline.Whenyou
setanewvalueintheAnticipatedCoefficientcolumn,clickApply Changes to Anticipated
CoefficientstoupdatethePowerandAnticipatedResponsecolumns.

480

Evaluate Designs
Evaluate Design Window

Chapter 18
Design of Experiments Guide

Note: Theanticipatedcoefficientshavedefaultvaluesof1forcontinuouseffects.They
havealternatingvaluesof1and1forcategoricaleffects.YoucanspecifyavalueforDelta
beselectingAdvanced Options > Set Delta for Powerfromtheredtrianglemenu.Ifyou
changethevalueofDelta,thevaluesoftheanticipatedcoefficientsareupdatedsothat
theirabsolutevaluesareonehalfofDelta.Fordetails,seeAdvancedOptions>SetDelta
forPoweronpage 493.
Power Probabilityofrejectingthenullhypothesisofnoeffectwhenthetruecoefficientvalue

isgivenbythespecifiedAnticipatedCoefficient.Foracoefficientassociatedwitha
numericfactor,thechangeinthemeanresponse(basedonthemodel)istwicethe
coefficientvalue.Foracoefficientassociatedwithacategoricalfactor,thechangeinthe
meanresponse(basedonthemodel)acrossthelevelsofthefactorequalstwicethe
absolutevalueoftheanticipatedcoefficient.
CalculationsusethespecifiedSignificanceLevelandAnticipatedRMSE.Fordetailsofthe
powercalculation,seePowerforaSingleParameteronpage 494.
Apply Changes to Anticipated Coefficients WhenyousetanewvalueintheAnticipated

Coefficientcolumn,clickApply Changes to Anticipated CoefficientstoupdatethePower


andAnticipatedResponsecolumns.
TestsforCategoricalEffectswithMoreThanTwoLevels
Ifyourmodelcontainsacategoricaleffectwithmorethantwolevels,thenthefollowing
columnsappearbelowtheApplyChangestoAnticipatedCoefficientsbutton:
Effect Thecategoricaleffect.
Power Thepowercalculationforatestofnoeffect.Thenullhypothesisforthetestisthatall

modelparameterscorrespondingtotheeffectarezero.Thedifferencetobedetectedis
definedbythevaluesintheAnticipatedCoefficientcolumnthatcorrespondtothemodel
termsfortheeffect.Thepowercalculationreflectsthedifferencesinresponsemeans
determinedbytheanticipatedcoefficients.
CalculationsusethespecifiedSignificanceLevelandAnticipatedRMSE.Fordetailsofthe
powercalculation,seePowerforaCategoricalEffectonpage 495.
DesignandAnticipatedResponsesOutline
TheDesignandAnticipatedResponsesoutlineshowsthedesignprecededbyanAnticipated
Responsecolumn.EachentryinthefirstcolumnistheAnticipatedResponsecorresponding
tothedesignsettings.TheAnticipatedResponseiscalculatedusingtheAnticipated
Coefficients.
Figure 18.15showstheDesignandAnticipatedResponsesoutlinecorrespondingtothe
specificationofAnticipatedCoefficientsgiveninFigure 18.14.

Chapter 18
Design of Experiments Guide

Evaluate Designs
Evaluate Design Window

481

Figure 18.15AnticipatedResponsesforCoffeeData.jmp

IntheAnticipatedResponsecolumn,youcanspecifyavalueforeachsettingofthefactors.
Thesevaluesreflectthedifferencesyouwanttodetect.
ClickApply Changes to Anticipate ResponsestoupdateboththeAnticipatedCoefficientand
Powercolumns.
Anticipated Response TheresponsevalueobtainedusingtheAnticipatedCoefficientvalues

ascoefficientsinthemodel.Whentheoutlinefirstappears,thecalculationofAnticipated
ResponsevaluesisbasedonthedefaultvaluesintheAnticipatedCoefficientcolumn.
WhenyousetnewvaluesintheAnticipatedResponsecolumn,clickApply Changes to
Anticipated ResponsestoupdatetheAnticipatedCoefficientandPowercolumns.
ThecolumnstotherightoftheAnticipatedResponsecolumnshowthefactor
settingsforallrunsinyourdesign.

Design

WhenyousetnewvaluesintheAnticipated
Responsecolumn,clickApply Changes to Anticipated Responsestoupdatethe
AnticipatedCoefficientandPowercolumns.

Apply Changes to Anticipated Responses

Power Analysis for Coffee Experiment


ConsiderthedesignintheCoffee Data.jmpdatatable.Supposethatyouareinterestedinthe
powerofyourdesigntodetecteffectsofvariousmagnitudesonStrength.RecallthatGrindisa
twolevelcategoricalfactor,Temperature,Time,andChargearecontinuousfactors,andStation
isathreelevelcategorical(blocking)factor.
Inthisexample,ignoretheroleofStationasablockingfactor.Youareinterestedintheeffect
ofStationonStrength. SinceStationisathreelevelcategoricalfactor,itisrepresentedbytwo
termsintheParameterslist:Station1andStation2.
Specifically,youareinterestedtheprobabilityofdetectingthefollowingchangesinthemean
Strength:

Achangeof0.10unitsasyouvaryGrindfromCoarsetoMedium.

482

Evaluate Designs
Evaluate Design Window

Chapter 18
Design of Experiments Guide

Achangeof0.10unitsormoreasyouvaryTemperature,Time,andChargefromtheirlow
tohighlevels.

AnincreaseduetoeachofStations1and2of0.10unitsbeyondtheoverallanticipated
mean.ThiscorrespondstoadecreaseduetoStation3of0.20unitsfromtheoverall
anticipatedmean.

Youset0.05asyourSignificanceLevel.YourestimateofthestandarddeviationofStrengthfor
fixeddesignsettingsis0.1andyouenterthisastheAnticipatedRMSE.
Figure 18.16showsthePowerAnalysisnodewiththesevaluesentered.Specifically,you
specifytheSignificanceLevel,AnticipatedRMSE,andthevalueofeachAnticipated
Coefficient.
WhenyouclickApplyChangestoAnticipatedCoefficients,theAnticipatedResponsevalues
areupdatedtoreflectthemodelyouhavespecified.
Figure 18.16PowerAnalysisOutlinewithUserSpecificationsinAnticipatedCoefficients
Panel

RecallthatTemperatureisacontinuousfactorwithcodedlevelsof1and1.Considerthetest
whosenullhypothesisisthatTemperaturehasnoeffectonStrength.Figure 18.16showsthat
thepowerofthistesttodetectadifferenceof0.10(=2*0.05)unitsacrossthelevelsof
Temperatureisonly0.291.

Chapter 18
Design of Experiments Guide

Evaluate Designs
Evaluate Design Window

483

NowconsiderthetestforthewholeStation effect,whereStationisathreelevelcategorical
factor.ConsiderthetestwhosenullhypothesisisthatStationhasnoeffectonStrength.Thisis
theusualFtestforacategoricalfactorprovidedintheEffectTestsreportwhenyourun
Analyze > Fit Model.(SeetheFittingLinearModelsbook.)
ThePowerofthistestisshowndirectlybeneaththeApplyChangestoAnticipated
Coefficientsbutton.TheentriesunderAnticipatedCoefficientsforthemodeltermsStation1
andStation2areboth0.10.Thesesettingsimplythattheeffectofbothstationsistoincrease
Strengthby0.10unitsabovetheoverallanticipatedmean.ForthesesettingsoftheStation1
andStation2coefficients,theeffectofStation3onStrength istodecreaseitby0.20unitsfrom
theoverallanticipatedmean.Figure 18.16showsthatthepowerofthetesttodetecta
differenceofatleastthismagnitudeis0.888.

Prediction Variance Profile


ThePredictionVarianceProfileoutlineshowsaprofileroftherelativevarianceofprediction.
SelecttheMaximize DesirabilityoptionfromtheredtrianglenexttoPredictionVarianceProfile
tofindthemaximumvalueoftherelativepredictionvarianceoverthedesignspace.For
details,seeMaximizeDesirabilityonpage 484.
ThePredictionVarianceProfileplotstherelativevarianceofpredictionasafunctionofeach
factoratfixedvaluesoftheotherfactors.Figure 18.17showsthePredictionVarianceProfile
fortheBounce Data.jmpdatatable,locatedintheDesignExperimentfolder.
Figure 18.17PredictionVarianceProfiler

RelativePredictionVariance
Forgivensettingsofthefactors,thepredictionvarianceistheproductoftheerrorvariance
andaquantitythatdependsonthedesignandthefactorsettings.Beforeyourunyour
experiment,theerrorvarianceisunknown,sothepredictionvarianceisalsounknown.
However,theratioofthepredictionvariancetotheerrorvarianceisnotafunctionoftheerror
variance.Thisratio,calledtherelativepredictionvariance,dependsonlyonthedesignandthe
factorsettings.Consequently,therelativevarianceofpredictioncanbecalculatedbefore
acquiringthedata.Fordetails,seeRelativePredictionVarianceonpage 497.

484

Evaluate Designs
Evaluate Design Window

Chapter 18
Design of Experiments Guide

Afteryourunyourexperimentandfitaleastsquaresmodel,youcanestimatetheerror
varianceusingthemeansquarederror(MSE)ofthemodelfit.Youcanestimatetheactual
varianceofpredictionatanysettingbymultiplyingtherelativevarianceofpredictionatthat
setting.
Itisidealforthepredictionvariancetobesmallthroughoutthedesignspace.Generally,the
errorvariancedropsasthesamplesizeincreases.Incomparingdesigns,youmaywantto
placethepredictionvarianceprofilersfortwodesignssidebyside.Adesignwithlower
predictionvarianceonaverageispreferred.
MaximizeDesirability
Youcanalsoevaluateadesignorcomparedesignsintermsofthemaximumrelative
predictionvariance.SelecttheMaximize Desirabilityoptionfromtheredtrianglenextto
PredictionVarianceProfile.JMPusesadesirabilityfunctionthatmaximizestherelative
predictionvariance.ThevalueoftheVariancedisplayedinthePredictionvarianceProfileis
theworst(leastdesirablefromadesignpointofview)valueoftherelativeprediction
variance.
Figure 18.18showsthePredictionVarianceProfileafterMaximizeDesirabilitywasselected.
TheplotisfortheBounce Data.jmpsampledatatable,locatedintheDesignExperimentfolder.
Thelargestvalueoftherelativepredictionvarianceis1.395833.Theplotalsoshowsvaluesof
thefactorsthatgivethisworstcaserelativevariance.However,keepinmindthatmany
settingscanleadtothissamerelativevariance.SeePredictionVarianceSurfaceonpage 485.
Figure 18.18PredictionVarianceProfileShowingMaximumVariance

Fraction of Design Space Plot


TheFractionofDesignSpacePlotshowstheproportionofthedesignspaceoverwhichthe
relativepredictionvarianceliesbelowagivenvalue.Figure 18.19showstheFractionof
DesignSpaceplotforthefortheBounce Data.jmpsampledatatable,locatedintheDesign
Experimentfolder.

Chapter 18
Design of Experiments Guide

Evaluate Designs
Evaluate Design Window

485

Figure 18.19FractionofDesignSpacePlot

TheXaxisintheplotrepresentstheproportionofthedesignspace,rangingfrom0to100%.
TheYaxisrepresentsrelativepredictionvariancevalues.Forapoint x y thatfallsonthe
bluecurve,thevaluexistheproportionofdesignspacewithvariancelessthanorequaltoy.
Reddottedcrosshairsmarkthevaluethatboundstherelativepredictionvariancefor50%of
designspace.
Figure 18.19showsthattheminimumrelativepredictionvarianceisslightlylessthan0.3,
whilethemaximumisbelow1.4.(Theactualmaximumis1.395833,asshowninFigure 18.18.)
Thereddottedcrosshairsindicatethattherelativepredictionvarianceisabout0.34.Youcan
usethecrosshairstooltofindthemaximumrelativepredictionvariancethatcorrespondsto
anyFractionofSpacevalue.UsethecrosshairstoolinFigure 18.19toseethat90%ofthe
predictionvariancevaluesarebelowapproximately0.55.
Note: MonteCarlosamplingofthedesignspaceisusedinconstructingtheFractionofDesign
SpacePlot.Therefore,plotsforthesamedesignmayvaryslightly.

Prediction Variance Surface


ThePredictionVarianceSurfacereportplotstherelativepredictionvariancesurfaceasa
functionofanytwodesignfactors.Figure 18.20showsthePredictionVarianceSurfaceoutline
forthefortheBounce Data.jmpsampledatatable,locatedintheDesignExperimentfolder.
ShoworhidethecontrolsbyselectingControl Panelontheredtrianglemenu.SeeControl
Panelonpage 486.

486

Evaluate Designs
Evaluate Design Window

Chapter 18
Design of Experiments Guide

Figure 18.20PredictionVarianceSurface

Whentherearetwoormorefactors,thePredictionVarianceSurfaceoutlineshowsaplotof
therelativepredictionvarianceforanytwovariables.ThePredictionVarianceSurfaceoutline
plotstherelativepredictionvarianceformula.Dragontheplottorotateandchangethe
perspective.
ControlPanel
TheControlPanelconsistsofthefollowing:
Response Grid Slider TheGridcheckboxsuperimposesagridthatshowsconstantvaluesof

Variance.ThevalueoftheVarianceisshowninthetextbox.Thesliderenablesyouto
adjusttheplacementofthegrid.Alternatively,youcanenteraVariancevalueinthetext
box.Clickoutsidetheboxtoupdatetheplot.
Independent Variables Thispanelenablesyoutoselectwhichtwofactorsareusedasaxesfor

theplotandtospecifythesettingsforfactorsnotusedasaxes.Selectafactorforeachofthe
XandYaxesbyclickingintheappropriatecolumn.Usetheslidersandtextboxesto
specifyvaluesforeachfactornotselectedforanaxis.Theplotshowsthethreedimensional
sliceofthesurfaceatthespecifiedvaluesofthefactorsthatarenotusedasaxesintheplot.
Movethesliderstoseedifferentslices.
Eachgridcheckboxactivatesagridforthecorrespondingfactor.Usethesliderstoadjust
theplacementofeachgrid.
LockZScalelocksthezaxistoitscurrentvalues.Thisisusefulwhenmovingthesliders
thatarenotonanaxis.
Appearance TheResolutionslideraffectshowmanypointsareevaluatedforaformula.Too

coarsearesolutionmeansthatafunctionwithasharpchangemightnotberepresented

Chapter 18
Design of Experiments Guide

Evaluate Designs
Evaluate Design Window

487

verywell.Butsettingtheresolutionhighcanmakeevaluatinganddisplayingthesurface
slower.
TheOrthographic projectioncheckboxshowsaprojectionoftheplotintwodimensions.
TheContourmenucontrolstheplacementofcontourcurves.Acontourcurveisasetof
pointswhoseResponsevaluesareconstant.YoucanselecttoturnthecontoursOff(the
default)orplacethemcontoursBelow,Above,orOnSurface.

Estimation Efficiency
ThisreportgivestheFractionalIncreaseinCI(ConfidenceInterval)LengthandRelativeStd
(Standard)ErrorofEstimateforeachparameterestimateinthemodel.Figure 18.21showsthe
EstimationEfficiencyoutlinefortheBounce Data.jmpsampledatatable,locatedintheDesign
Experimentfolder.
Figure 18.21EstimationEfficiencyOutline

Fractional Increase in CI Length


TheFractionalIncreaseinCILengthcomparesthelengthofaparameterssconfidenceinterval
asgivenbythecurrentdesigntothelengthofsuchanintervalgivenanidealdesign.
Specifically,thelengthoftheidealconfidenceintervalfortheparameterissubtractedfromthe
lengthofitsactualconfidenceinterval.Thisdifferenceisthendividedbythelengthofthe
idealconfidenceinterval.
Theidealdesignisanorthogonaldesign,butanorthogonaldesignmaynotexist.Foran
orthogonaldesign,thefractionalincreaseiszero.Inselectingadesign,youwouldlikethe
fractionalincreaseinconfidenceintervallengthtobeassmallaspossible.
Fortheithparameter,theFractionalIncreaseinConfidenceIntervalLengthisdefinedas
follows:
FI =

n X'X ii 1

488

Evaluate Designs
Evaluate Design Window

Chapter 18
Design of Experiments Guide

where
XisthemodelmatrixdefinedinTheModelMatrixonpage 601intheTechnical
Detailsappendix,
1 istheithdiagonalentryof X'X 1 ,and
X'X ii

nisthenumberofruns.
Notethatthestandarderrorforaparameterestimateinanorthogonaldesign,ifoneexists,is:

SE Orth = ------- I n
n
where I n isthenbynidentitymatrixandistheerror.
Relative Std Error of Estimate
TheRelativeStdErrorofEstimategivestheratioofthestandarddeviationofaparameters
estimatetotheerrorstandarddeviation.Thesevaluesindicatehowlargethestandarderrors
ofthemodelsparameterestimatesare,relativetotheerrorstandarddeviation.Fortheith
parameterestimate,theRelativeStdErrorofEstimateisdefinedasfollows:
SE =

1
X'X ii

where
XisthemodelmatrixdefinedinTheModelMatrixonpage 601intheTechnical
Detailsappendix,and
1 istheithdiagonalentryof X'X 1 .
X'X ii

Alias Matrix
TheAliasMatrixaddressestheissueofhowtermsthatarenotincludedinthemodelaffectthe
estimationofthemodelterms,iftheyareindeedactive.IntheAliasTermsoutline,youlist
potentiallyactiveeffectsthatarenotinyourassumedmodelbutthatmightbiastheestimates
ofmodelterms.TheAliasMatrixentriesrepresentthedegreeofbiasimpartedtomodel
parametersbytheAliasTermseffects.SeeAliasTermsonpage 476.
TherowsoftheAliasMatrixarethetermscorrespondingtothemodeleffectslistedinthe
Modeloutline.ThecolumnsaretermscorrespondingtoeffectslistedintheAliasTerms
outline.Theentryinagivenrowandcolumnindicatesthedegreetowhichthealiasterm
affectstheparameterestimatecorrespondingtothemodelterm.
Inevaluatingyourdesign,youideallywantoneoftwosituationstooccurrelativetoanyentry
intheAliasMatrix.Eithertheentryissmallor,ifitisnotsmall,theeffectofthealiastermis
smallsothatthebiaswillbesmall.Ifyoususpectthatthealiastermmayhaveasubstantial

Chapter 18
Design of Experiments Guide

Evaluate Designs
Evaluate Design Window

489

effect,thenthattermshouldbeincludedinthemodeloryoushouldconsideranaliasoptimal
design.
FordetailsonhowtheAliasMatrixiscomputed,seeTheAliasMatrixonpage 601inthe
TechnicalDetailsappendix.
Note: Dependingonthecomplexityofthedesign,itispossibletohavealiasmatrixentries
greaterthan1orlessthan1.
Alias Matrix Examples
ConsidertheCoffee Data.jmpsampledatatable,locatedintheDesignExperimentfolder.The
designassumesamaineffectsmodel.YoucanseethisbyrunningtheModelscriptinthedata
table.Consequently,intheEvaluateDesignwindowsModeloutline,onlytheInterceptand
fivemaineffectsappear.TheAliasTermsoutlinecontainsthetwowayinteractions.TheAlias
MatrixisshowninFigure 18.22.
Figure 18.22AliasMatrixforCoffeeData.jmp

TheAliasMatrixshowstheModeltermsinthefirstcolumndefiningtherows.Thetwoway
interactionsintheAliasTermsarelistedacrossthetop,definingthecolumns.Considerthe
modeleffectTemperatureforexample.IftheGrind*Timeinteractionistheonlyactivetwoway
interaction,theestimateforthecoefficientofTemperatureisbiasedby0.333timesthetrue
valueoftheGrind*Time effect.Ifotherinteractionsareactive,thenthevalueintheAliasMatrix
indicatestheadditionalamountofbiasincurredbytheTemperaturecoefficientestimate.
ConsidertheBounce Data.jmpsampledatatable,locatedintheDesignExperimentfolder.The
Modelscriptcontainsalltwowayinteractions.Consequently,theEvaluateDesignwindow
showsallmaineffectsandtwowayinteractionsintheModeloutline.Thethreetwoway
interactionsareautomaticallyaddedtothelistofAliasTerms.Therefore,theAliasMatrix
showsacolumnforeachofthesethreeinteractions(Figure 18.23).Noticethattheonly
nonzeroentriesinthealiasmatrixcorrespondtothebiasimpactofthetwowayinteractions
onthemselves.Theseentriesare1s,whichisexpectedbecausethetwowayinteractionsare
alreadyinthemodel.

490

Evaluate Designs
Evaluate Design Window

Chapter 18
Design of Experiments Guide

Figure 18.23AliasMatrixforBounceData.jmp

Color Map on Correlations


TheColorMaponCorrelationsshowstheabsolutevalueofthecorrelationbetweenanytwo
effectsthatappearineithertheModelortheAliasTermsoutline.Thecellsofthecolormap
areidentifiedabovethemap.ThereisacellforeacheffectintheModeloutlineandacellfor
eacheffectintheAliasTermsoutline.
Bydefault,theabsolutemagnitudesofthecorrelationsarerepresentedbyabluetograytored
intensitycolortheme.Ingeneralterms,thecolormapforagooddesignshowsalotofblueoff
thediagonal,indicatingorthogonalityorsmallcorrelationsbetweendistinctterms.Large
absolutecorrelationsamongeffectsinflatethestandarderrorsofestimates.
Toseetheabsolutevalueofthecorrelationbetweentwoeffects,hoveryourcursoroverthe
correspondingcell.Tochangethecolorthemefortheentireplot,rightclickintheplotand
selectColorTheme.
Note: TermsthatappearinboththeModelandAliasTermsoutlinesappeartwiceintheColor
MaponCorrelations.
Color Map Example
Figure 18.24showstheColorMaponCorrelationsfortheBounce Data.jmpsampledatatable,
foundintheDesignExperimentfolder.Thedeepredcoloringindicatesabsolutecorrelations
ofone.Notethatthereareredcellsonthediagonal,showingcorrelationsofmodeltermswith
themselves.ThreeredcellsoffthemaindiagonalshowthecorrelationsoftheAliasTerms
withthemselves.ThosethreetermsappearbothintheModeloutlineandintheAliasTerms
list.Toseehowtoremovethesetermsfromthecolormap,seeColorMaponCorrelations
onpage 470.
Allothercellsareeitherdeepblueorlightblue.Thelightbluesquarescorrespondto
correlationsbetweenquadraticterms.Toseethis,hoveryourcursorovereachofthelightblue
squares.Theabsolutecorrelationsofquadratictermswitheachotheraresmall,0.0714.

Chapter 18
Design of Experiments Guide

Evaluate Designs
Evaluate Design Window

491

Fromtheperspectiveofcorrelation,thisisagooddesign.Wheneffectsarehighlycorrelated,
itismoredifficulttodeterminewhichisresponsibleforaneffectontheresponse.
Figure 18.24ColorMaponCorrelations

Design Diagnostics
TheDesignDiagnosticsreportshowsD,G,andAefficienciesandtheaveragevarianceof
prediction.ThesediagnosticsarenotshownfordesignsthatincludefactorswithChangesset
toHardorVeryHardoreffectswithEstimabilitydesignatedasIfPossible.
WhenEvaluateDesignisaccessedfromaDOEplatformotherthanEvaluateDesign,the
DesignCreationTimegivestheamountoftimerequiredtocreatethedesign.WhenDesign
DiagnosticsisaccessedfromtheEvaluateDesignplatform,DesignCreationTimegivesthe
amountoftimerequiredfortheEvaluateDesignplatformtocalculateresults.
Figure 18.25showstheDesignDiagnosticsoutlinefortheBounce Data.jmpsampledatatable,
foundintheDesignExperimentfolder.
Figure 18.25DesignDiagnosticsOutline

492

Evaluate Designs
Evaluate Design Window

Chapter 18
Design of Experiments Guide

Caution: Theefficiencymeasuresshouldnotbeinterpretedontheirown.Buttheycanbe
usedtocomparedesigns.Giventwodesigns,theonewiththehigherefficiencymeasureis
better.Whilethemaximumefficiencyis100foranycriterion,anefficiencyof100%is
impossibleformanydesignproblems.
Notation
Thedescriptionsoftheefficiencymeasuresgivenbelowusethefollowingnotation:

Xisthemodelmatrix

nisthenumberofrunsinthedesign

pisthenumberofterms,includingtheintercept,inthemodel

Var y x istherelativepredictionvarianceatthepoint x .SeeRelativePrediction

Varianceonpage 497.

Var y x max isthemaximumrelativepredictionvarianceoverthedesignregion

D Efficiency
TheefficiencyofthedesigntothatofanidealorthogonaldesignintermsoftheDoptimality
criterion.AdesignisDoptimalifitminimizesthevolumeofthejointconfidenceregionfor
thevectorofregressioncoefficients:
Defficiency= 100 --1- XX 1 / p
n

G Efficiency
TheefficiencyofthedesigntothatofanidealorthogonaldesignintermsoftheGoptimality
criterion.AdesignisGoptimalifitminimizesthemaximumpredictionvarianceoverthe
designregion:
Gefficiency= 100 p nVar y x max

LettingDdenotethedesignregion,
Var y x max = maximum x XX

x inD

Note: GEfficiencyiscalculatedusingMonteCarlosamplingofthedesignspace.Therefore,
calculationsforthesamedesignmayvaryslightly.

Chapter 18
Design of Experiments Guide

Evaluate Designs
Evaluate Design Options

493

A Efficiency
TheefficiencyofthedesigntothatofanidealorthogonaldesignintermsoftheAoptimality
criterion.AdesignisAoptimalifitminimizesthesumofthevariancesoftheregression
coefficients:
Aefficiency=100p nTrace XX 1
Average Variance of Prediction
Atapoint x inthedesignspace,therelativepredictionvarianceisdefinedas:

Var y x = x XX x

Notethatthisisthepredictionvariancedividedbytheerrorvariance.Fordetailsofthe
calculation,seeSection4.3.5inGoosandJones,2011.
Design Creation Time
DesignCreationTimegivestheamountoftimerequiredfortheEvaluateDesignplatformto
calculateresults.

Evaluate Design Options


TheEvaluateDesignredtrianglemenucontainsthefollowingoptions:
Advanced Options > Split Plot Variance Ratio Specifytheratioofthevarianceoftherandom

wholeplotandthesubplotvariance(ifpresent)totheerrorvariance.Beforesettingthis
value,youmustdefineahardtochangefactorforyoursplitplotdesign,orhardand
veryhardtochangefactorsforyoursplitsplitplotdesign.Thenyoucanenteroneortwo
positivenumbersforthevarianceratios,dependingonwhetheryouhavespecifieda
splitplotorasplitsplitplotdesign.
Specifyavalueforthedifferenceyouwanttodetect
thatisappliedtoAnticipatedCoefficientsinthePowerAnalysisreport.TheAnticipated
CoefficientsvaluesaresettoDelta/2forcontinuouseffects.Forcategoricaleffects,theyare
alternatingvaluesofDelta/2andDelta/2.Foradditionaldetailsonpoweranalysis,see
PowerAnalysisonpage 477

Advanced Options > Set Delta for Power

Bydefault,Deltaissettotwo.Consequently,theAnticipatedCoefficientdefaultvaluesare
1forcontinuouseffectsandalternatingvaluesof1and1forcategoricaleffects.The
defaultvaluesthatareenteredasAnticipatedCoefficientswhenDeltais2ensurethese
properties:

494

Evaluate Designs
Technical Details

Chapter 18
Design of Experiments Guide

ThepowercalculationforanumericeffectassumesachangeofDeltaintheresponse
meanduetolinearmaineffectsasthefactorchangesfromthelowestsettingtothe
highestsettinginthedesignregion.
Thepowercalculationfortheparameterassociatedwithatwolevelcategoricalfactor
assumesachangeofDeltaintheresponsemeanacrossthelevelsofthefactor.
Thepowercalculationforacategoricaleffectwithmorethantwolevelsisbasedonthe
multipledegreeoffreedomFtestforthenullhypothesisthatalllevelshavethesame
responsemean.Poweriscalculatedatthevaluesoftheresponsemeansthatare
determinedbytheAnticipatedCoefficients.VariousconfigurationsoftheAnticipated
CoefficientscandefineadifferenceinlevelsaslargeasDelta.However,thepower
valuesforsuchconfigurationswilldifferbasedontheAnticipatedCoefficientsforthe
otherlevels.
Save Script to Script Window CreatesascriptthatreproducestheEvaluateDesignwindow

andplacesitinanopenscriptwindow.

Technical Details
Thissectioncontainstechnicaldetailsforthefollowingareas:

PowerCalculationsonpage 494

RelativePredictionVarianceonpage 497

Power Calculations
ThePowerAnalysisreportgivespowercalculationsforsingleparametervaluesand,when
thedesignincludesacategoricalfactorwiththreeormorelevels,forwholeeffects.This
sectiondescribesthecalculationsinthetwocases:

PowerforaSingleParameteronpage 494

PowerforaCategoricalEffectonpage 495

Power for a Single Parameter


Thissectiondescribeshowpowerforthetestofasingleparameteriscomputed.Usethe
followingnotation:
X Themodelmatrix.SeetheFittingLinearModelsbookforinformationonthecodingfor
nominaleffects.Also,seeTheModelMatrixonpage 601intheTechnicalDetails
appendix.
Note: YoucanviewthemodelmatrixbyrunningFitModel.ThenselectSave Columns >
Save Coding Tablefromtheredtrianglemenuforthemainreport.

Chapter 18
Design of Experiments Guide

Evaluate Designs
Technical Details

495

?i Theparametercorrespondingtothetermofinterest.

i
A
i

Theleastsquaresestimatorofi
A

TheAnticipatedCoefficientvalue.Thedifferenceyouwanttodetectis 2 i .
1

Thevarianceof i isgivenbytheithdiagonalentryof XX ,where2istheerror


1
1
variance.Denotetheithdiagonalentryof XX by XX ii .
2

Theerrorvariance,2,isestimatedbytheMSE,andhas n p 1 degreesoffreedom,wheren
isthenumberofobservationsandpisthenumberoftermsotherthantheinterceptinthe
model.
Thetestof H 0 : i = 0 isgivenby:

i
----------------------------------------MSE XX ii

orequivalentlyby:
2
i
F 0 = -------------------------------------1
MSE XX ii

Underthenullhypothesis,theteststatisticF0hasanFdistributionon1and n p 1 degrees
offreedom.
A

Ifthetruevalueof i is i ,thenF0hasanoncentralFdistributionwithnoncentrality
parametergivenby:
A 2

i
= -------------------------2
1
XX ii
Tocomputethepowerofthetest,firstsolveforthelevelcriticalvalueFc:
= 1 FDist F c 1 n p 1
Thencalculatethepowerasfollows:
Power = 1 FDist F c 1 n p 1
Power for a Categorical Effect
Thissectiondescribeshowpowerforthetestforawholecategoricaleffectiscomputed.Use
thefollowingnotation:

496

Evaluate Designs
Technical Details

Chapter 18
Design of Experiments Guide

Modelmatrix.SeeTheModelMatrixonpage 601intheTechnicalDetails
appendix.

Vectorofparameters

Leastsquaresestimateof

VectorofAnticipatedCoefficientvalues
Matrixthatdefinesthetestforthecategoricaleffect.ThematrixLidentifiesthe
valuesoftheparametersincorrespondingtothecategoricaleffectandsets
themequalto0.Thenullhypothesisforthetestofthecategoricaleffectisgiven
by:
H 0 :L = 0

RankofL.Alternatively,risthenumberoflevelsofthecategoricaleffectminus
one.

Note: YoucanviewthedesignmatrixbyrunningFitModel.ThenselectSave Columns > Save


Coding Tablefromtheredtrianglemenuforthemainreport.
2

Thecovariancematrixof isgivenby XX

,where2istheerrorvariance.

Theerrorvariance,2,isestimatedbytheMSE,andhas n p 1 degreesoffreedom,wheren
isthenumberofobservationsandpisthenumberoftermsotherthantheinterceptinthe
model.
Thetestof H 0 :L = 0 isgivenby:
1
1
F 0 = L L XX L L rMSE

Underthenullhypothesis,theteststatisticF0hasanFdistributiononrand n p 1 degrees
offreedom.
A

Ifthetruevalueofis ,thenF0hasanoncentralFdistributionwithnoncentrality
parametergivenby:
A
1
= L L XX L

A
2
L

Tocomputethepowerofthetest,firstsolveforthelevelcriticalvalueFc:
= 1 FDist F c r n p 1

Chapter 18
Design of Experiments Guide

Evaluate Designs
Technical Details

Thencalculatethepowerasfollows:
Power = 1 FDist F c r n p 1

Relative Prediction Variance


Considerthefollowingnotation:
X

Modelmatrix.SeeTheModelMatrixonpage 601intheTechnicalDetails
appendix.

Errorvariance

Vectorofleastsquaresestimatesoftheparameters

xi

TheithrowofX

Usingthisnotation,thepredictedresponsefortheithrowofXisgivenby:
= x
Y
i
Therelativepredictionvarianceatthesettingsdefinedby x i isgivenby:
x i var Y x i
x i var X x i
1
----------------------------- = --------------------------------- = x i XX x i
2
2

497

498

Evaluate Designs
Technical Details

Chapter 18
Design of Experiments Guide

Chapter 19
Augmented Designs
Experimentaldesignisbesttreatedasasequentialprocess.Ambiguitiesthatresultfroma
singledesigncanberesolvedbyconductingfurtherexperimentalruns.
Foranexistingdesigntable,theAugmentDesignplatformconstructsadditionalrunsinaway
thatoptimizestheoveralldesignprocess.Youcanaddrunstoaccomplishthefollowing
objectives:

replicatethedesignaspecifiednumberoftimes

addcenterpoints

createafoldoverdesign

addaxialpointstogetherwithcenterpointstotransformascreeningdesigntoaresponse
surfacedesign

addspacefillingpointstoadesign

addrunstothedesignusingamodelthatcanhavemoretermsthantheoriginalmodel

ThischapterprovidesanoverviewoftheAugmentDesignplatform.Italsopresentsacase
studyofdesignaugmentation.

Contents
ADOptimalAugmentationoftheReactorExample................................. 501
AnalyzetheAugmentedDesign................................................ 504
Factors ......................................................................... 510
AugmentationChoices ........................................................... 510
ReplicateaDesign ............................................................ 511
AddCenterPoints............................................................ 514
CreatingaFoldoverDesign .................................................... 515
AddingAxialPoints .......................................................... 516
SpaceFilling ................................................................. 517
AddingNewRunsandTerms.................................................. 518
DefineFactorConstraints ........................................................ 521
SpecialAugmentDesignOptions.................................................. 525
SavetheDesign(X)Matrix .................................................... 525
ModifytheDesignCriterion(DorIOptimality)................................. 525
SelecttheNumberofRandomStarts ............................................ 525
DesignSearchTime .......................................................... 526
SpecifytheSphereRadiusValue................................................ 526

Chapter 19
Design of Experiments Guide

Augmented Designs
A D-Optimal Augmentation of the Reactor Example

501

A D-Optimal Augmentation of the Reactor Example


Thisexample,adaptedfromMeyer,etal.(1996),demonstrateshowtousetheaugment
designerinJMPtoresolveambiguitiesleftbyascreeningdesign.Inthisstudy,achemical
engineerinvestigatestheeffectsoffivefactorsonthepercentreactionofachemicalprocess.
Tobegin,openReactor 8 Runs.jmp foundintheDesign Experiment sampledatafolderinstalled
withJMP.ThenselectAugment DesignfromtheDOEmenu.Whentheinitiallaunchdialog
appears:
1. SelectPercent ReactedandclickY, Response.
2. SelectallothervariablesexceptPatternandclickX, Factor.
3. ClickOKonthelaunchdialogtoseetheAugmentDesigndialoginFigure 19.1.
Note: YoucancheckGroup new runs into separate blocktoaddablockingfactortoany
design.However,thepurposeofthisexampleistoestimatealltwofactorinteractionsin16
runs,whichcannotbedonewhenthereistheadditionalblockingfactorinthemodel.
Figure 19.1AugmentDesignDialogfortheReactorExample

4. NowclickAugmentontheAugmentDesigndialogtoseethedisplayinFigure 19.2.
ThismodelshowninFigure 19.2istheresultofthemodelstoredwiththedatatablewhenit
wascreatedbytheCustomdesigner.However,theaugmenteddesignistohave16runsin
ordertoestimatealltwofactorinteractions.

502

Augmented Designs
A D-Optimal Augmentation of the Reactor Example

Chapter 19
Design of Experiments Guide

Figure 19.2InitialAugmentedModel

Tocontinuewiththeaugmentedreactordesign:
5. Choose 2ndfromtheInteractionsmenuasshowninFigure 19.3.Thisaddsallthe
twofactorinteractionstothemodel.TheMinimumnumberofrunsgivenforthespecified
modelis16,asshownintheDesignGenerationtexteditbox.

Chapter 19
Design of Experiments Guide

Augmented Designs
A D-Optimal Augmentation of the Reactor Example

503

Figure 19.3AugmentedModelwithAllTwoFactorInteractions

6. ClickMake Design.
JMPnowcomputesDoptimallyaugmentedfactorsettings,similartothedesignshownin
Figure 19.4.
Figure 19.4DOptimallyAugmentedFactorSettings

Note: Theresultingdesignisafunctionofaninitialrandomnumberseed.Toreproducethe
exactfactorsettingstableinFigure 19.4,(orthemostrecentdesignthatyougenerated),
chooseSet Random SeedfromthepopupmenuontheAugmentDesigntitlebar.Adialog
showsthemostrecentlyusedrandomnumber.ClickOKtousethatnumberagain,orCancel
togenerateadesignbasedonanewrandomnumber.ThedialoginFigure 19.5showsthe
randomnumber(12834729)usedtogeneratetherunsinFigure 19.4.

504

Augmented Designs
A D-Optimal Augmentation of the Reactor Example

Chapter 19
Design of Experiments Guide

Figure 19.5SpecifyingaRandomNumber

7. ClickMake TabletogeneratetheJMPtablewithDOptimallyaugmentedruns.

Analyze the Augmented Design


Supposeyouhavealreadyruntheexperimentontheaugmenteddataandrecordedresultsin
thePercent Reactedcolumnofthedatatable.
1. Toseetheseresults,openReactor Augment Data.jmp foundintheDesignExperiment
sampledatafolderinstalledwithJMP.
ItisdesirabletomaximizePercent Reacted.However,thecolumnsResponseLimits
columnpropertyinthissampledatatableissettoMinimize.
2. ClicktheasterisknexttothePercent ReactedcolumnnameintheColumnspanelofthe
datatableandselectResponse Limits,asshownontheleftinFigure 19.6.
3. IntheColumnInfodialogthatappears,changetheresponselimittoMaximize,asshown
ontherightinFigure 19.6.
Figure 19.6ChangetheResponseLimitsColumnPropertyforthePercentReactedColumn

Youarenowreadytoruntheanalysis.
4. Tostarttheanalysis,selectRun ScriptfromtheModelredtrianglemenuintheupperleft
cornerofthedatatable(Figure 19.7).

Chapter 19
Design of Experiments Guide

Augmented Designs
A D-Optimal Augmentation of the Reactor Example

505

Figure 19.7CompletedAugmentedExperiment(ReactorAugmentData.jmp)

TheModelscript,storedasatablepropertywiththedata,containstheJSLcommandsthat
displaytheFitModeldialogwithallmaineffectsandtwofactorinteractionsaseffects.
5. ChangethefittingpersonalityontheFitModeldialogfromStandard Least Squaresto
Stepwise,asshowninFigure 19.8.
Figure 19.8FitModelDialogforStepwiseRegressiononGeneratedModel

506

Augmented Designs
A D-Optimal Augmentation of the Reactor Example

Chapter 19
Design of Experiments Guide

6. WhenyouclickRun,thestepwiseregressioncontrolpanelappears.Clickthecheckboxes
forallthemaineffectterms.
Note: SelectP-value ThresholdfromtheStopping Rulemenu,Mixed fromtheDirection
menu,andmakesureProb to Enteris0.050andProb to Leaveis0.100.Thesearenotthe
defaultvalues.FollowthedialogshowninFigure 19.9.
Figure 19.9InitialStepwiseModel

7. ClickGotostartthestepwiseregression.Theprocesscontinuesuntilalltermsareentered
intothemodelthatmeettheProb to EnterandProb to LeavecriteriaintheStepwise
RegressionControlpanel.
Figure 19.10showstheresultofthisexampleanalysis.NotethatFeed Rateisoutofthe
modelwhiletheCatalyst*Temperature,Stir Rate*Temperature,andthe
Temperature*Concentrationinteractionshaveenteredthemodel.

Chapter 19
Design of Experiments Guide

Augmented Designs
A D-Optimal Augmentation of the Reactor Example

507

Figure 19.10CompletedStepwiseModel

8. AfterStepwiseisfinished,clickMake ModelontheStepwisecontrolpaneltogeneratethis
reducedmodel,asshowninFigure 19.11.
9. ClickRun andfitthereducedmodeltodoadditionaldiagnosticwork,makepredictions,
andfindtheoptimalfactorsettings.

508

Augmented Designs
A D-Optimal Augmentation of the Reactor Example

Chapter 19
Design of Experiments Guide

Figure 19.11NewPredictionModelDialog

TheAnalysisofVarianceandLackofFitTestsinFigure 19.12,indicateahighlysignificant
regressionmodelwithnoevidenceofLackofFit.
Figure 19.12PredictionModelAnalysisofVarianceandLackofFitTests

TheSortedParameterEstimatestableinFigure 19.13showsthatCatalysthasthelargest
maineffect.However,thesignificanceofthetwofactorinteractionsisofthesameorderof
magnitudeasthemaineffects.Forthisreason,theinitialscreeningexperimentinA

Chapter 19
Design of Experiments Guide

Augmented Designs
A D-Optimal Augmentation of the Reactor Example

509

StandardDesignforFiveContinuousFactorsonpage 237intheScreeningDesigns
chapterhadambiguousresults.
Figure 19.13PredictionModelEstimatesPlot

10. ChooseMaximize DesirabilityfromthemenuonthePredictionProfilertitlebar.


ThepredictionprofileplotinFigure 19.14showsthatmaximumoccursatthehighlevels
ofCatalyst,Stir Rate,andTemperatureandthelowlevelofConcentration.Attheseextreme
settings,theestimateofPercent Reactedincreasesfrom65.17to98.38.
Figure 19.14MaximumPercentReacted

Tosummarize,comparetheanalysisof16runswiththeanalysesofreactordatafrom
previouschapters:

InAStandardDesignwithTwoContinuousFactorsandOneCategoricalFactoron
page 234intheScreeningDesignschapter,ascreeningdesignwithonly8runswas
analyzed.Theanalysisproducedamodelwiththefivemaineffectsandtwointeraction
effectswithconfounding.Noneofthefactorseffectsweresignificant,althoughthe
Catalystfactorwaslargeenoughtoencouragecollectingdataforfurtherruns.

InTheFiveFactorReactorExampleonpage 295,afullfactorialofthefivetwolevel
reactorfactors,32runs,wasfirstsubjectedtoastepwiseregression.Thisapproach
identifiedthreemaineffects(Catalyst,Temperature,andConcentration)andtwo
interactions(Temperature*Catalyst,Concentration*Temperature)assignificanteffects.

510

Augmented Designs
Factors

Chapter 19
Design of Experiments Guide

ByusingaDoptimalaugmentationof8runstoproduce8additionalruns,astepwise
analysisreturnedthesameresultsastheanalysisof32runs.Thebottomlineisthatonly
halfasmanyrunsyieldedthesameinformation.Thus,usinganiterativeapproachtoDOE
cansavetimeandmoney.

Factors
WhentheCustomDesignwindowopens,theFactorsoutlineshowsthefollowing:
AllfactorslistedasX,Factor,intheAugmentDesignlaunchwindowexceptfor
factorswiththeRandomBlockdesignrolecolumnproperty.

Name

Role IfthefactorhasaDesignRolecolumnpropertyspecifiedinthedatatable,thatroleis

shownintheRolecolumn.IfthefactordoesnothaveaDesignRolecolumnpropertyand
isconstant,thenConstantappearsintheRolecolumn.Otherwise,thefactorsmodeling
typeappearsintheRolecolumn.
Changes IfthefactorhasaFactorChangescolumnpropertyspecifiedinthedatatable,that

valueisshownintheChangescolumn.IfthefactordoesnothaveaFactorChanges
columnproperty,thenChangesisspecifiedasEasy.
Note: IfafactorhasaFactorChangescolumnpropertythatissettoHardorVeryHard,
thenthecorrespondingwholeplotfactormustbeincludedintheX,Factorlistinthe
AugmentDesignlaunchwindow.
Forcontinuousfactors,showstheminimumandmaximumvalues.Forcategorical
factors,showsthelevels.

Values

Tip: FactorsthathavearoleofCategoricalorConstantappearintheNamecolumnwitha
downarrowicon.Clickonthedownarrowtoaddlevels.IfthefactorisConstantandhasa
categoricalmodelingtype,multiplelevelscanbeadded.IfthefactorisConstantandhasa
continuousmodelingtype,onlyonelevelcanbeadded.

Augmentation Choices
TheAugmentDesignplatformrequiresanexistingdesigndatatable.Itgivesthefollowing
fivechoices:
Replicate replicatesthedesignaspecifiednumberoftimes.SeeReplicateaDesignon

page 511.
Add Centerpoints Addscenterpoints.Specifyhowmanyadditionalrunsyouwanttoaddas

centerpointstothedesign.Acenterpointisarunwhosesettingforeachcontinuousfactor

Chapter 19
Design of Experiments Guide

Augmented Designs
Augmentation Choices

511

ismidwaybetweenthehighandlowsettings.SeeCenterPoints,ReplicateRuns,and
Testingonpage 60intheStartingOutwithDOEchapter.
Ifadesigncontainsbothcontinuousandothertypesoffactors,centerpointsmightnotbe
balancedrelativetothelevelsoftheotherfactors.AugmentDesignchoosesthecenter
pointstomaximizetheD,I,oraliasefficiencyofthedesign.
SeeAddCenterPointsonpage 514.
Fold Over

createsafoldoverdesign.SeeCreatingaFoldoverDesignonpage 515.

Add Axial addsaxialpointstogetherwithcenterpointstotransformascreeningdesigntoa

responsesurfacedesign.SeeAddingAxialPointsonpage 516.
Addsadditionalrunstoanydesignconsistingofcontinuousfactors.Additional
runsareconstructedusingthefastflexiblefillingmethodology.SeeSpaceFillingon
page 517.

Space Filling

addsrunstothedesign(augment)usingamodel,whichcanhavemoretermsthan
theoriginalmodel.SeeAddingNewRunsandTermsonpage 518.

Augment

Replicate a Design
Replicationprovidesadirectcheckontheassumptionthattheerrorvarianceisconstant.It
alsoreducesthevariabilityoftheregressioncoefficientsinthepresenceoflargeprocessor
measurementvariability.
Toreplicatethedesignaspecifiednumberoftimes:
1. Openadatatablethatcontainsadesignthatyouwanttoaugment.Thisexampleuses
Reactor 8 Runs.jmp fromtheDesignExperimentsampledatafolderinstalledwithJMP.
2. SelectDOE > Augment Designtoseetheinitialdialogforspecifyingfactorsandresponses.
3. SelectPercent ReactedandclickY, Response.
4. Selectallothervariables(exceptPattern)andclickX, Factortoidentifythefactorsthatyou
wanttousefortheaugmenteddesign(Figure 19.15).
Figure 19.15IdentifyResponseandFactors

512

Augmented Designs
Augmentation Choices

Chapter 19
Design of Experiments Guide

5. ClickOK toseetheAugmentDesignpanelshowninFigure 19.16.


6. Ifyouwanttheoriginalrunsandtheresultingaugmentedrunstobeidentifiedbya
blockingfactor,selectGroup New Runs into Separate BlockontheAugmentDesignpanel.
Figure 19.16ChooseanAugmentationType

7. ClicktheReplicatebuttontoseethedialogshownontheleftinFigure 19.17.Enterthe
numberoftimesyouwantJMPtoperformeachrunandthenclickOK.
Note: Entering2specifiesthatyouwanteachruntoappeartwiceintheresultingdesign.
Thisisthesameasonereplicate(Figure 19.17).
8. Viewthedesign,shownontherightinFigure 19.17.
Figure 19.17ReactorDataDesignAugmentedwithTwoReplicates

Chapter 19
Design of Experiments Guide

Augmented Designs
Augmentation Choices

9. IntheDesignEvaluationsection,clickthedisclosureiconsnexttoPredictionVariance
ProfileandPredictionVarianceSurfacetoseetheprofileandsurfaceplotsshownin
Figure 19.18.
Figure 19.18PredictionProfilerandSurfacePlot

10. ClickMake TabletoproducethedesigntableshowninFigure 19.19.

513

514

Augmented Designs
Augmentation Choices

Chapter 19
Design of Experiments Guide

Figure 19.19TheReplicatedDesign

Add Center Points


Addingcenterpointsisusefultocheckforcurvatureandreducethepredictionerrorinthe
centerofthefactorregion.Centerpointsareusuallyreplicatedpointsthatallowforan
independentestimateofpureerror,whichcanbeusedinalackoffittest.
Toaddcenterpoints:
1. Openadatatablethatcontainsadesignthatyouwanttoaugment.Thisexampleuses
Reactor 8 Runs.jmp foundintheDesign Experiment sampledatafolderinstalledwithJMP.
2. SelectDOE > Augment Design.
3. IntheinitialAugmentDesigndialog,identifytheresponseandfactorsthatyouwantto
usefortheaugmenteddesign(seeFigure 19.15)andclickOK.
4. Ifyouwanttheoriginalrunsandtheresultingaugmentedrunstobeidentifiedbya
blockingfactor,checktheboxbesideGroup new runs into separate block.(Figure 19.16
showsthecheckboxlocationdirectlyundertheFactorspanel.)
5. ClicktheAdd Centerpointsbuttonandenterthenumberofcenterpointsthatyouwantto
add.Forthisexample,addtwocenterpoints,andclickOK.
6. ClickMake TabletoseethedatatableinFigure 19.20.
Thetableshowstwocenterpointsappendedtotheendofthedesign.

Chapter 19
Design of Experiments Guide

Augmented Designs
Augmentation Choices

515

Figure 19.20DesignwithTwoCenterPointsAdded

Creating a Foldover Design


Afoldoverdesignremovestheconfoundingoftwofactorinteractionsandmaineffects.This
isespeciallyusefulasafollowuptosaturatedornearsaturatedfractionalfactorialor
PlackettBurmandesigns.
Tocreateafoldoverdesign:
1. Openadatatablethatcontainsadesignthatyouwanttoaugment.Thisexampleuses
Reactor 8 Runs.jmp,foundintheDesign Experiment sampledatafolderinstalledwithJMP.
2. SelectDOE > Augment Design.
3. IntheinitialAugmentDesigndialog,identifytheresponseandfactorsthatyouwantto
usefortheaugmenteddesign(seeFigure 19.15)andclickOK.
4. ChecktheboxtotheleftofGroup new runs into separate block.(Figure 19.16showsthe
checkboxlocationdirectlyundertheFactorspanel.)Thisidentifiestheoriginalrunsand
theresultingaugmentedrunswithablockingfactor.
5. ClicktheFold Overbutton.Adialogappearsthatlistsallthedesignfactors.
6. Selectthefactorstofold.Thedefault,ifyouselectnofactors,istofoldonalldesignfactors.
Ifyouchooseasubsetoffactorstofoldover,theremainingfactorsarereplicatesofthe
originalruns.TheexampleinFigure 19.21foldsonallfivefactorsandincludesablocking
factor.
7. ClickMake Table.Thedesigndatatablethatresultsliststheoriginalsetofrunsasblock1
andthenew(foldover)runsareblock2.

516

Augmented Designs
Augmentation Choices

Chapter 19
Design of Experiments Guide

Figure 19.21ListingofaFoldoverDesignonAllFactors

Adding Axial Points


Youcanaddaxialpointstogetherwithcenterpoints,whichtransformsascreeningdesigntoa
responsesurfacedesign.Followthesesteps:
1. Openadatatablethatcontainsadesignthatyouwanttoaugment.Thisexampleuses
Reactor 8 Runs.jmp,fromtheDesign ExperimentsampledatafolderinstalledwithJMP.
2. SelectDOE > Augment Design.
3. IntheinitialAugmentDesigndialog,identifytheresponseandfactorsthatyouwantto
usefortheaugmenteddesign(seeFigure 19.15)andclickOK.
4. Ifyouwanttheoriginalrunsandtheresultingaugmentedrunstobeidentifiedbya
blockingfactor,checktheboxbesideGroup New Runs into Separate Block(Figure 19.16).
5. ClickAdd Axial.
6. Entertheaxialvaluesinunitsofthefactorsscaledfrom1to+1,andthenenterthe
numberofcenterpointsthatyouwant.WhenyouclickOK,theaugmenteddesign
includesthenumberofcenterpointsspecifiedandconstructstwoaxialpointsforeach
variableintheoriginaldesign.
Figure 19.22EnteringAxialValues

Chapter 19
Design of Experiments Guide

Augmented Designs
Augmentation Choices

517

7. ClickMake Table.Thedesigntableappears.Figure 19.23showsatableaugmentedwith


twocenterpointsandtwoaxialpointsforfivevariables.
Figure 19.23DesignAugmentedwithTwoCenterandTenAxialPoints

center points

axial points

Space Filling
TheSpaceFillingaugmentationchoiceaddspointstoadesignconsistingofcontinuous
factorsusingthefastflexiblefillingmethodwiththeMaxProcriterion.TheSpaceFilling
choiceaccommodatesconstraintsonthedesignspace.Youcanspecifylinearconstraintsor
disallowedcombinations.
Thealgorithmthatisusedtoaugmentdesignsbeginsbygeneratingalargenumberof
randompointswithinthespecifieddesignregion.ThesepointsarethenclusteredusingaFast
WardalgorithmintoanumberofclustersthatequalstheNumberofAdditionalRunsthatyou
specify.
ThefinaldesignpointsareobtainedbyoptimizingtheMaxPro(maximumprojection)criterion
overtheexistingandadditionalruns.Forpfactorsandnequaltothenumberofexistingand
additionalruns,theMaxProcriterionstrivestofindpointsintheclustersthatminimizethe
followingcriterion:
C MaxPro =

n1

j = i+1

x ik x jk

k=1

TheMaxProcriterionmaximizestheproductofthedistancesbetweendesignpointsinaway
thatinvolvesallfactors.Thissupportsthegoalofprovidinggoodspacefillingpropertieson
projectionsoffactors.SeeJosephetal.(2014,forthcoming).

518

Augmented Designs
Augmentation Choices

Chapter 19
Design of Experiments Guide

Adding New Runs and Terms


Apowerfuluseoftheaugmentdesigneristoaddrunsusingamodelthatcanhavemore
termsthantheoriginalmodel.Forexample,youcanachievetheobjectivesofresponsesurface
methodologybychangingalinearmodeltoafullquadraticmodelandaddingthenecessary
numberofruns.Supposeyoustartwithatwofactor,twolevel,fourrundesign.Ifyouadd
quadratictermstothemodelandfivenewpoints,JMPgeneratesthe3by3fullfactorialasthe
optimalaugmenteddesign.
Doptimalaugmentationisapowerfultoolforsequentialdesign.Usingthisfeatureyoucan
addtermstotheoriginalmodelandfindoptimalnewtestrunswithrespecttothisexpanded
model.Youcanalsogroupthetwosetsofexperimentalrunsintoseparateblocks,which
optimallyblocksthesecondsetwithrespecttothefirst.
Toaddnewrunsandtermstotheoriginalmodel:
1. Openadatatablethatcontainsadesignthatyouwanttoaugment.Thisexampleuses
Reactor Augment Data.jmp,fromtheDesign Experimentsampledatafolder.
2. SelectDOE > Augment Design.
3. IntheinitialAugmentDesigndialog,identifytheresponseandfactorsthatyouwantto
usefortheaugmenteddesign(seeFigure 19.15)andclickOK.
4. Ifyouwanttheoriginalrunsandtheresultingaugmentedrunstobeidentifiedbya
blockingfactor,selectGroup New Runs into Separate Block(notusedinthisexample).
5. ClicktheAugmentbutton.Theoriginalnumberofruns(Figure 19.24)appearsinthe
FactorDesignpanel.

Chapter 19
Design of Experiments Guide

Augmented Designs
Augmentation Choices

519

Figure 19.24ViewingtheExistingDesign

6. IntheDesignGenerationpanel,enterthenumberoftotalrunsthatyouwantthisdesignto
contain.Thenumberthatyouenteristheoriginalnumberofrunsplusthenumberof
additionalrunsthatyouwant.
7. ClicktheMake Designbutton.Theeightnewnumberofruns(Figure 19.25)appearinthe
Designpanel.

520

Augmented Designs
Augmentation Choices

Chapter 19
Design of Experiments Guide

Figure 19.2524TotalRuns

8. Ifdesired,viewthepredictionvarianceprofileandthepredictionvariancesurface.
9. ClickMake TabletocreatetheaugmenteddesignJMPtable(Figure 19.26)withthe
additionalruns.

Chapter 19
Design of Experiments Guide

Augmented Designs
Define Factor Constraints

521

Figure 19.26TheAugmentedDesignTablewithNewRuns

additional
runs

Define Factor Constraints


IfyouaugmentadesignusingtheSpaceFillingorAugmentoptions,youcandefine
restrictionsonthedesignspacefortheaddedruns.
UseDefineFactorConstraintstorestrictthedesignspace.Unlessyouhaveloadedaconstraint
orincludedoneaspartofascript,theNoneoptionisselected.Tospecifyconstraints,select
oneoftheotheroptions:
Specify Linear Constraints Specifiesinequalityconstraintsonlinearcombinationsoffactors.

OnlyavailableforfactorswithaRoleofContinuousorMixture.SeeSpecifyLinear
Constraints.
Use Disallowed Combinations Filter Definessetsofconstraintsbasedonrestrictingvaluesof

individualfactors.YoucandefinebothANDandORconstraints.SeeUseDisallowed
CombinationsFilter.
Use Disallowed Combinations Script Definesdisallowedcombinationsandotherconstraints

asBooleanJSLexpressionsinascripteditorbox.SeeUseDisallowedCombinations
Script.

522

Augmented Designs
Define Factor Constraints

Chapter 19
Design of Experiments Guide

Specify Linear Constraints


Incaseswhereitisimpossibletovarycontinuousfactorsindependentlyoverthedesign
space,youcanspecifylinearinequalityconstraints.Linearinequalitiesdescribefactorlevel
settingsthatareallowed.
ClickAddtoenteroneormorelinearinequalityconstraints.
Add Addsatemplateforalinearexpressioninvolvingallthecontinuousfactorsinyour

design.Entercoefficientvaluesforthefactorsandselectthedirectionoftheinequalityto
reflectyourlinearconstraint.Specifytheconstrainingvalueintheboxtotherightofthe
inequality.Toaddmoreconstraints,clickAddagain.
Note: TheAddoptionisdisabledifyouhavealreadyconstrainedthedesignregionby
specifyingaSphereRadius.
Remove Last Constraint Removesthelastconstraint.

Checkstheconstraintsforconsistency.Thisoptionremovesredundant
constraintsandconductsfeasibilitychecks.AJMPalertappearsifthereisaproblem.If
constraintsareequivalenttoboundsonthefactors,aJMPalertindicatesthattheboundsin
theFactorsoutlinehavebeenupdated.

Check Constraints

Use Disallowed Combinations Filter


ThisoptionusesanadaptationoftheDataFiltertofacilitatespecifyingdisallowed
combinations.FordetailedinformationaboutusingtheDataFilter,seetheUsingJMPbook.
SelectfactorsfromtheAddFilterFactorslistandclickAdd.Thenspecifythedisallowed
combinationsbyusingtheslider(forcontinuousfactors)orbyselectinglevels(forcategorical
factors).
TheredtriangleoptionsfortheAddFilterFactorsmenuarethosefoundintheSelect
Columnspanelofmanyplatformlaunchwindows.SeetheUsingJMPbookforadditional
detailsaboutthecolumnselectionmenu.
WhenyouclickAdd,theDisallowedCombinationscontrolpanelshowstheselectedfactors
andprovidesoptionsforfurthercontrol.Factorsarerepresentedasfollows,basedontheir
modelingtypes:
Continuous Factors Foracontinuousfactor,adoublearrowsliderthatspanstherangeof

factorsettingsappears.Anexpressionthatdescribestherangeusinganinequalityappears
abovetheslider.Youcanspecifydisallowedsettingsbydraggingthesliderarrowsorby
clickingontheinequalityboundsintheexpressionandenteringyourdesiredconstraints.
Intheslider,asolidbluehighlightrepresentsthedisallowedvalues.
Categorical Factor Foracategoricalfactor,thepossiblelevelsaredisplayedeitheraslabeled

blocksor,whenthenumberoflevelsislarge,aslistentries.Selectaleveltodisallowit.To

Chapter 19
Design of Experiments Guide

Augmented Designs
Define Factor Constraints

523

selectmultiplelevels,holdtheControlkey.Theblockorlistentriesarehighlightedto
indicatethelevelsthathavebeendisallowed.Whenyouaddacategoricalfactortothe
DisallowedCombinationspanel,thenumberoflevelsofthecategoricalfactorisgivenin
parenthesesfollowingthefactorname.
DisallowedCombinationsOptions
Thecontrolpanelhasthefollowingcontrols:
Clearsalldisallowedfactorlevelsettingsthatyouhavespecified.Thisdoesnotclear
theselectedfactors.

Clear

Start Over Removesallselectedfactorsandreturnsyoutotheinitiallistoffactors.


AND OpenstheAddFilterFactorslist.SelectedfactorsbecomeanANDgroup.Any

combinationoffactorlevelsspecifiedwithinanANDgroupisdisallowed.
ToaddafactortoanANDgrouplateron,clickthegroupsoutlinetoseeahighlighted
rectangle.SelectANDandaddthefactor.
Toremoveasinglefactor,selectDeletefromitsredtrianglemenu.
OR OpenstheAddFilterFactorslist.SelectedfactorsbecomeaseparateANDgroup.For

ANDgroupsseparatedbyOR,acombinationisdisallowedifitisspecifiedinatleastone
ANDgroup.
RedTriangleOptionsforFactors
AfactorcanappearinseveralORgroups.AnoccurrenceofthefactorinaspecificORgroupis
referredtoasaninstanceofthefactor.
Delete RemovestheselectedinstanceofthefactorfromtheDisallowedCombinationspanel.
Clear Selection

Clearsanyselectionforthatinstanceofthefactor.

Deselectstheselectedvaluesandselectsthevaluesnotpreviouslyselected
forthatinstanceofthefactor.

Invert Selection

Availableonlyforcategoricalfactors.Changestheappearanceofthedisplay.
Optionsinclude:

Display Options

Blocks Displayshowseachlevelasablock.
List Displayshowseachlevelasamemberofalist.
Single Category Display showseachlevel.
Check Box Display addsacheckboxnexttoeachvalue.
Availableonlyforcategoricalfactors.Providesatextboxbeneaththefactornamewhere
youcanenterasearchstringforlevelsofthefactor.PresstheEnterkeyorclickoutsidethe
textboxtoperformthesearch.OnceFindisselected,thefollowingFindoptionsappearin
theredtrianglemenu:

Find

524

Augmented Designs
Define Factor Constraints

Chapter 19
Design of Experiments Guide

Clear FindclearstheresultsoftheFindoperationandreturnsthepaneltoitsoriginal
state.
Match Caseusesthecaseofthesearchstringtoreturnthecorrectresults.
Containssearchesforvaluesthatincludethesearchstring.
Does not containsearchesforvaluesthatdonotincludethesearchstring.
Starts withsearchesforvaluesthatstartwiththesearchstring.
Ends withsearchesforvaluesthatendwiththesearchstring.
Use Disallowed Combinations Script
UsethisoptiontodisallowparticularcombinationsoffactorlevelsusingaJSLscript.This
optioncanbeusedwithcontinuousfactorsormixedcontinuousandcategoricalfactors.
Thisoptionopensascriptwindowwhereyouinsertascriptthatidentifiesthecombinations
thatyouwanttodisallow.ThescriptmustevaluateasaBooleanexpression.Whenthe
expressionevaluatesastrue,thespecifiedcombinationisdisallowed.
Whenformingtheexpressionforacategoricalfactor,usetheordinalvalueofthelevelinstead
ofthenameofthelevel.Ifafactorslevelsarehigh,medium,andlow,specifiedinthatorder
intheFactorsoutline,theirassociatedordinalvaluesare1,2,and3.Forexample,supposethat
youhavetwocontinuousfactors,X1andX2,andacategoricalfactorX3withthreelevels:L1,
L2,andL3,inorder.Youwanttodisallowlevelswherethefollowingholds:
e

X1

+ 2X 2 0andX 3 = L2

Entertheexpression(Exp(X1) + 2*X2 < 0) & (X3 == 2)intothescriptwindow.


Figure 19.27ExpressioninScriptEditor

(Inthefigure,unnecessaryparentheseswereremovedbyparsing.)Noticethatfunctionscan
beenteredaspartoftheBooleanexpression.

Chapter 19
Design of Experiments Guide

Augmented Designs
Special Augment Design Options

525

Special Augment Design Options


TheAugment Designredtrianglemenuhasseveraloptions.Manyoptionsareforsavingand
loadinginformationaboutvariables.Theyareavailableinalldesigns.SeeCustomDesign
Optionsonpage 102fordetails.
ThefollowingsectionsdescribecommandsfoundintheAugmentDesignredtrianglemenu
thatarespecifictoaugmentdesigns.

Save the Design (X) Matrix


TocreateascriptandsaveitasatablepropertyintheJMPdesigndatatable,selectSave X
Matrix fromthe AugmentDesignredtrianglemenu.Twoorthreescriptsaresavedtothe
table.Moments MatrixandDesign Matrixscriptsarealwayssaved.Ifthedesignisasplitplot
design,anadditionalV Inversescriptisalsosaved.

WhenyouruntheMoments Matrixscript,JMPcreatesamatrixcalledMomentsand
displaysitsnumberofrowsinthelog.

WhenyouruntheDesign Matrixscript,JMPcreatesamatrixcalledXanddisplaysits
numberofrowsinthelog.

WhenyouruntheV Inversescript,JMPcreatestheinverseofthevariancematrixofthe
responses,anddisplaysitsnumberofrowsinthelog.

Ifthelogisnotopen,selectView > Log(onWindows)orWindow>LogontheMacintosh.

Modify the Design Criterion (D- or I- Optimality)


Tomodifythedesignoptimalitycriterion,selectOptimalityCriterionfromtheAugment
DesignredtrianglemenuandthenselectMake D-Optimal Design,Make I-Optimal Design,or
Make Alias Optimal Design.ThedefaultcriterionforRecommended isDoptimalforalldesign
typesunlessyouclickedtheRSMbuttonintheModelpaneltoaddeffectsthatmakethe
modelquadratic.

Select the Number of Random Starts


TheNumberofStartsoptionappliesonlytotheAugmentchoice.TheNumberofStartsisthe
numberoftimesthatthecoordinateexchangealgorithminitiateswithanewdesign.See
CoordinateExchangeAlgorithmonpage 125intheCustomDesignschapter.Youcan
specifyyourownvalueusingtheNumber of Startsoption.Increasingthenumberofrandom
startstendstoimprovetheoptimalityoftheresultingdesign.
UnlessyouspecifyavalueforNumberofStartsandclickOK,thenumberofstartsis
controlledbyDesignSearchTime.Toseehowmanystartswereusedtoconstructadesign,

526

Augmented Designs
Special Augment Design Options

Chapter 19
Design of Experiments Guide

clickMakeDesign.ThenselectNumberofStarts.Thevalueinthetextboxisthenumberof
startsusedtoconstructthespecificdesign.
Tip: Toreproduceaspecificdesign,youneedtospecifytheNumberofStartsandtheRandom
Seedoriginallyusedtoproducethedesign.Obtainthesevaluesfromtheredtriangleoptions
afteryouclickMakeDesign.

Design Search Time


TheDesignSearchTimeoptionappliesonlytotheAugmentchoice.TheDesignSearchTime
isthemaximumnumberofsecondsspentsearchingforadesign.Thedefaultsearchtimeis
basedonthecomplexityofthedesign.Iftheiterationsofthealgorithmrequiremorethana
fewseconds,aComputingDesignprogresswindowappears.IfyouclickCancelinthe
progresswindow,thecalculationstopsandgivesthebestdesignfoundatthatpoint.The
progresswindowalsodisplaysDefficiencyforDoptimaldesignsthatdonotincludefactors
withChangessettoHardorVeryHardorwithEstimabilitysettoIfPossible.
Note: YoucansetapreferenceforDesignSearchTime.SelectFile > Preferences > Platforms >
DOE.CheckDesignSearchTimeandenterthemaximumnumberofseconds.Incertain
situationswheremoretimeisrequired,JMPextendsthesearchtime.
TheAugmentoptionusesCustomDesignscoordinateexchangealgorithmtofind
nearoptimaldesignsbasedonrandomstartingdesigns.SeeCoordinateExchange
Algorithmonpage 125intheCustomDesignschapter.TheDesignSearchTime
determineshowmanydesignsareconstructedbasedonrandomstartingdesigns.
YoucanspecifyyourownvalueusingtheDesign Search Time option.Increasingthesearch
timetendstoimprovetheoptimalityoftheresultingdesign.
Keepinmindthatdesignsproducedbyrerunningthealgorithmcandiffer.Evenwiththe
samerandomseed,thenumbersofstartingdesignsusedtoconstructthefinaldesignmight
differbecauseofvariationsincomputingspeedandotherfactors.
Note: ThenumberofstartingdesignsisgivenbythevalueintheNumberofStartstextbox.
However,thisvalueisnotupdateduntilafteryouconstructyourdesignbyclickingMake
Design.

Specify the Sphere Radius Value


Augmentdesignscanbeconstrainedtoahypersphere.Toeditthesphereradiusforthe
designinunitsofthecodedfactors(1,1),selectSphere RadiusfromtheAugmentDesignred
trianglemenu.EntertheappropriatevalueandclickOK.

Chapter 19
Design of Experiments Guide

Augmented Designs
Special Augment Design Options

Or,useJSLandsubmitthefollowingcommandbeforeyoubuildacustomdesign:
DOE Sphere Radius = 1.0;

Inthisstatementyoucanreplace1.0withanypositivenumber.

527

528

Augmented Designs
Special Augment Design Options

Chapter 19
Design of Experiments Guide

Chapter 20
Prospective Sample Size and Power
UsetheDOE > Sample Size and PowercommandtoanswerthequestionHowmanyrunsdo
Ineed?Theimportantquantitiesaresamplesize,power,andthemagnitudeoftheeffect.
Thesedependonthesignificancelevel,alpha,ofthehypothesistestfortheeffectandthe
standarddeviationofthenoiseintheresponse.Youcansupplyeitheroneortwoofthethree
values.Ifyousupplyonlyoneofthesevalues,theresultisaplotoftheothertwo.Ifyou
supplytwovalues,thethirdvalueiscomputed.
TheSample Size and Powerplatformcananswerthequestion,WillIdetectthegroup
differencesIamlookingfor,givenmyproposedsamplesize,estimateofwithingroup
variance,andalphalevel?Inthistypeofanalysis,youmustapproximatethegroupmeans
andsamplesizesinadatatableaswellasapproximatethewithingroupstandarddeviation
().
Thesamplesizeandpowercomputationsdeterminethesamplesizenecessaryforyieldinga
significantresult,giventhatthetrueeffectsizeisatleastacertainsize.Itrequiresthatyou
entertwooutofthreepossiblequantities;differencetodetect,samplesize,andpower.The
thirdquantityiscomputedforthefollowingcases:

differencebetweenaonesamplemeanandahypothesizedvalue

differencebetweentwosamplemeans

differencesinthemeansamongksamples

differencebetweenastandarddeviationandahypothesizedvalue

differencebetweenaonesampleproportionandahypothesizedvalue

differencebetweentwosampleproportions

differencebetweencountsperunitinaPoissondistributedsampleandahypothesized
value.

Thecalculationsassumethatthereareequalnumbersofunitsineachgroup.Youcanapply
thisplatformtomoregeneralexperimentaldesigns,iftheyarebalancedandanadjustment
forthenumberofparametersisspecified.
Youcanalsocomputetherequiredsamplesizesneededforreliabilitystudiesand
demonstrations.

Contents
LaunchingtheSampleSizeandPowerPlatform ..................................... 531
OneSampleandTwoSampleMeans .............................................. 531
SingleSampleMean .......................................................... 533
SampleSizeandPowerAnimationforOneMean................................. 536
TwoSampleMeans........................................................... 537
kSampleMeans ................................................................ 539
OneSampleStandardDeviation................................................... 540
OneSampleStandardDeviationExample ....................................... 541
OneSampleandTwoSampleProportions .......................................... 542
ActualTestSize.............................................................. 543
OneSampleProportion....................................................... 543
TwoSampleProportions...................................................... 545
CountsperUnit ................................................................. 548
CountsperUnitExample...................................................... 549
SigmaQualityLevel............................................................. 550
SigmaQualityLevelExample .................................................. 550
NumberofDefectsComputationExample ....................................... 551
ReliabilityTestPlanandDemonstration ............................................ 552
ReliabilityTestPlan........................................................... 552
ReliabilityDemonstration ..................................................... 555

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


Launching the Sample Size and Power Platform

531

Launching the Sample Size and Power Platform


TheSample Size and Powerplatformhelpsyouplanyourstudyforasinglemeanor
proportioncomparison,atwosamplemeanorproportioncomparison,aonesamplestandard
deviationcomparison,aksamplemeanscomparison,oracountsperunitcomparison.
Dependinguponyourexperimentalsituation,yousupplyoneortwoquantitiestoobtaina
thirdquantity.Thesequantitiesinclude:

requiredsamplesize

expectedpower

expectedeffectsize

WhenyouselectDOE > Sample Size and Power,thepanelinFigure 20.1appearswithbutton


selectionsforexperimentalsituations.Thefollowingsectionsdescribeeachoftheseselections
andexplainhowtoenterthequantitiesandobtainthedesiredcomputation.
Figure 20.1SampleSizeandPowerChoices

One-Sample and Two-Sample Means


AfteryouclickeitherOne Sample Mean,orTwo Sample MeansintheinitialSampleSize
selectionlist(Figure 20.1),aSampleSizeandPowerwindowappears.(SeeFigure 20.2.)

532

Prospective Sample Size and Power


One-Sample and Two-Sample Means

Chapter 20
Design of Experiments Guide

Figure 20.2InitialSampleSizeandPowerWindowsforSingleMean(left)andTwoMeans
(right)

ThewindowsarethesameexceptthattheOneMeanwindowhasabuttonatthebottomthat
accessesananimationscript.
TheinitialSampleSizeandPowerwindowrequiresvaluesforAlpha,Std Dev (theerror
standarddeviation),andoneortwooftheotherthreevalues:Difference to detect,Sample
Size,andPower.TheSampleSizeandPowerplatformcalculatesthemissingitem.Ifthereare
twounspecifiedfields,aplotisconstructed,showingtherelationshipbetweenthesetwo
values:

powerasafunctionofsamplesize,givenspecificeffectsize

powerasafunctionofeffectsize,givenasamplesize

effectsizeasafunctionofsamplesize,foragivenpower.

TheSampleSizeandPowerwindowasksforthesevalues:
Alpha istheprobabilityofatypeIerror,whichistheprobabilityofrejectingthenull

hypothesiswhenitistrue.Itiscommonlyreferredtoasthesignificancelevelofthetest.
Thedefaultalphalevelis0.05.Thisimpliesawillingnesstoaccept(ifthetruedifference
betweengroupsiszero)that,5%(alpha)ofthetime,asignificantdifferenceisincorrectly
declared.
istheerrorstandarddeviation.Itisameasureoftheunexplainedrandomvariation
aroundthemean.Eventhoughthetrueerrorisnotknown,thepowercalculationsarean
exerciseinprobabilitythatcalculateswhatmighthappenifthetruevalueistheoneyou
specify.Anestimateoftheerrorstandarddeviationcouldbetherootmeansquareerror
(RMSE)fromapreviousmodelfit.

Std Dev

Extra Parameters isonlyformultifactordesigns.Leavethisfieldzeroinsimplecases.Ina

multifactorbalanceddesign,inadditiontofittingthemeansdescribedinthesituation,

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


One-Sample and Two-Sample Means

533

thereareotherfactorswithextraparametersthatcanbespecifiedhere.Forexample,ina
threefactortwoleveldesignwithallthreetwofactorinteractions,thenumberofextra
parametersisfive.(Thisincludestwoparametersfortheextramaineffects,andthree
parametersfortheinteractions.)Inpractice,theparticularvaluesenteredarenotthat
important,unlesstheexperimentalrangehasveryfewdegreesoffreedomforerror.
isthesmallestdetectabledifference(howsmalladifferenceyouwantto
beabletodeclarestatisticallysignificant)totestagainst.Forsinglesampleproblemsthisis
thedifferencebetweenthehypothesizedvalueandthetruevalue.

Difference to Detect

Sample Size isthetotalnumberofobservations(runs,experimentalunits,orsamples)in

yourexperiment.Samplesizeisnotthenumberpergroup,butthetotaloverallgroups.
Power istheprobabilityofrejectingthenullhypothesiswhenitisfalse.Alargepowervalue

isbetter,butthecostisahighersamplesize.
Continue evaluatesattheenteredvalues.
Back returnstothepreviousSampleSizeandPowerwindowsothatyoucaneitherredoan

analysisorstartanewanalysis.
Animation Script runsaJSLscriptthatdisplaysaninteractiveplotshowingpowerorsample

size.Seethesection,SampleSizeandPowerAnimationforOneMeanonpage 536,for
anillustrationoftheanimationscript.

Single-Sample Mean
UsingtheSampleSizeandPowerwindow,youcantestifonemeanisdifferentfromthe
hypothesizedvalue.
Fortheonesamplemean,thehypothesissupportedis
H 0 : = 0
andthetwosidedalternativeis
H a : 0
whereisthepopulationmeanandisthenullmeantotestagainstoristhedifferenceto
detect.Itisassumedthatthepopulationofinterestisnormallydistributedandthetruemean
iszero.Notethatthepowerforthissettingisthesameasforthepowerwhenthenull
hypothesisisH0:=0andthetruemeanis0.
Supposeyouareinterestedintestingtheflammabilityofanewfabricbeingdevelopedby
yourcompany.Previoustestingindicatesthatthestandarddeviationforburntimesofthis
fabricis2seconds.Thegoalistodetectadifferenceof1.5secondswhenalphaisequalto0.05,

534

Prospective Sample Size and Power


One-Sample and Two-Sample Means

Chapter 20
Design of Experiments Guide

thesamplesizeis20,andthestandarddeviationis2seconds.Forthisexample,isequalto
1.5.Tocalculatethepower:
1. SelectDOE > Sample Size and Power.
2. ClicktheOne Sample MeanbuttonintheSampleSizeandPowerWindow.
3. LeaveAlphaas0.05.
4. LeaveExtra Parametersas0.
5. Enter2forStd Dev.
6. Enter1.5asDifference to detect.
7. Enter20forSample Size.
8. LeavePowerblank.(SeetheleftwindowinFigure 20.3.)
9. ClickContinue.
Thepoweriscalculatedas0.8888478174andisroundedto0.89.(Seerightwindowin
Figure 20.3.)Theconclusionisthatyourexperimenthasan89%chanceofdetectinga
significantdifferenceintheburntime,giventhatyoursignificancelevelis0.05,the
differencetodetectis1.5seconds,andthesamplesizeis20.
Figure 20.3AOneSampleExample

Power versus Sample Size Plot


ToseeaplotoftherelationshipofSample SizeandPower,leavebothSample SizeandPower
emptyinthewindowandclickContinue.
TheplotsinFigure 20.4,showarangeofsamplesizesforwhichthepowervariesfromabout
0.1toabout0.95.TheplotontherightinFigure 20.4showsusingthecrosshairtoolto
illustratetheexampleinFigure 20.3.

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


One-Sample and Two-Sample Means

Figure 20.4AOneSampleExamplePlot

Power versus Difference Plot


WhenonlySample Sizeisspecified(Figure 20.5)andDifference to DetectandPowerare
empty,aplotofPowerbyDifferenceappears,afterclickingContinue.
Figure 20.5PlotofPowerbyDifferencetoDetectforaGivenSampleSize

535

536

Prospective Sample Size and Power


One-Sample and Two-Sample Means

Chapter 20
Design of Experiments Guide

Sample Size and Power Animation for One Mean


ClickingtheAnimation ScriptbuttonontheSampleSizeandPowerwindowforonemean
showsaninteractiveplot.Thisplotillustratestheeffectthatchangingthesamplesizehason
power.AsanexampleofusingtheAnimation Script:
1. SelectDOE > Sample Size and Power.
2. ClicktheOne Sample MeanbuttonintheSampleSizeandPowerWindow.
3. Enter2forStd Dev.
4. Enter1.5asDifference to detect.
5. Enter20forSample Size.
6. LeavePowerblank.
TheSampleSizeandPowerwindowappearsasshownontheleftofFigure 20.6.
7. ClickAnimation Script.
Theinitialanimationplotshowstwotdensitycurves.Theredcurveshowsthe
tdistributionwhenthetruemeaniszero.Thebluecurveshowsthetdistributionwhen
thetruemeanis1.5,whichisthedifferencetobedetected.Theprobabilityofcommittinga
typeIIerror(notdetectingadifferencewhenthereisadifference)isshadedblueonthis
plot.(Thisprobabilityisoftenrepresentedasintheliterature.)Similarly,theprobability
ofcommittingatypeIerror(decidingthatthedifferencetodetectissignificantwhenthere
isnodifference)isshadedastheredareasundertheredcurve.(Theredshadedareas
underthecurvearerepresentedasintheliterature.)
Selectanddragthesquarehandlestoseethechangesinstatisticsbasedonthepositionsof
thecurves.TochangethevaluesofSample SizeandAlpha,clickontheirvaluesbeneath
theplot.

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


One-Sample and Two-Sample Means

537

Figure 20.6ExampleofAnimationScripttoIllustratePower

Two-Sample Means
TheSampleSizeandPowerwindowsworksimilarlyforoneandtwosamplemeans;the
Difference to Detectisthedifferencebetweentwomeans.Thecomparisonisbetweentwo
randomsamplesinsteadofonesampleandahypothesizedmean.
Fortestingthedifferencebetweentwomeans,thehypothesissupportedis
H 0 : 2 = D 0
1
andthetwosidedalternativeis
H a : 2 D 0
1
whereandarethetwopopulationmeansandD0isthedifferenceinthetwomeansor
thedifferencetodetect.Itisassumedthatthepopulationsofinterestarenormallydistributed
andthetruedifferenceiszero.Notethatthepowerforthissettingisthesameasforthepower
whenthenullhypothesisisH0: = 0andthetruedifferenceisD0.
Supposethestandarddeviationis2(asbefore)forbothgroups,thedesireddetectable
differencebetweenthetwomeansis1.5,andthesamplesizeis30(15pergroup).Toestimate
thepowerforthisexample:
1. SelectDOE > Sample Size and Power.

538

Prospective Sample Size and Power


One-Sample and Two-Sample Means

Chapter 20
Design of Experiments Guide

2. ClicktheTwo Sample Means buttonintheSampleSizeandPowerWindow.


3. LeaveAlphaas0.05.
4. Enter2forStd Dev.
5. LeaveExtra Parametersas0.
6. Enter1.5asDifference to detect.
7. Enter30forSample Size.
8. LeavePowerblank.
9. ClickContinue.
ThePoweriscalculatedas0.51.(SeetheleftwindowinFigure 20.7.)Thismeansthatyou
havea51%chanceofdetectingasignificantdifferencebetweenthetwosamplemeans
whenyoursignificancelevelis0.05,thedifferencetodetectis1.5,andeachsamplesizeis
15.
Plot of Power by Sample Size
Tohaveagreaterpowerrequiresalargersample.Tofindouthowlarge,leavebothSample
SizeandPowerblankforthissameexampleandclickContinue.Figure 20.7showsthe
resultingplot,withthecrosshairtoolestimatingthatasamplesizeofabout78isneededto
obtainapowerof0.9.
Figure 20.7PlotofPowerbySampleSizetoDetectforaGivenDifference

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


k-Sample Means

539

k-Sample Means
Usingthe k-Sample Meansoption,youcancompareupto10means.Considerasituation
where4levelsofmeansareexpectedtobeintherangeof10to13,thestandarddeviationis
0.9,andyoursamplesizeis16.
Thehypothesistobetestedis:
H0:===versusHa:atleastonemeanisdifferent
Todeterminethepower:
1. SelectDOE > Sample Size and Power.
2. Clickthek Sample Means buttonintheSampleSizeandPowerWindow.
3. LeaveAlphaas0.05.
4. Enter0.9forStd Dev.
5. LeaveExtra Parametersas0.
6. Enter10,11,12,and13asthefourlevelsofmeans.
7. Enter16forSample Size.
8. LeavePowerblank.
9. ClickContinue.
ThePoweriscalculatedas0.95.(SeetheleftofFigure 20.8.)Thismeansthatthereisa95%
chanceofdetectingthatatleastoneofthemeansisdifferentwhenthesignificancelevelis
0.05,thepopulationmeansare10,11,12,and13,andthetotalsamplesizeis16.
IfbothSample SizeandPowerareleftblankforthisexample,thesamplesizeandpower
calculationsproducethePowerversusSample Size curve.(SeetherightofFigure 20.8.)
Thisconfirmsthatasamplesizeof16looksacceptable.
Noticethatthedifferenceinmeansis2.236,calculatedassquarerootofthesumof
squareddeviationsfromthegrandmean.Inthiscaseitisthesquarerootof(1.5)2+
(0.5)2+(0.5)2+(1.5)2,whichisthesquarerootof5.

540

Prospective Sample Size and Power


One Sample Standard Deviation

Chapter 20
Design of Experiments Guide

Figure 20.8ProspectivePowerforkMeansandPlotofPowerbySampleSize

One Sample Standard Deviation


UsetheOne-Sample Standard Deviation optionontheSampleSizeandPowerwindow
(Figure 20.1)todeterminethesamplesizeneededfordetectingachangeinthestandard
deviationofyourdata.Theusualpurposeofthisoptionistocomputealargeenoughsample
sizetoguaranteethattheriskofatypeIIerror,,issmall.(Thisistheprobabilityoffailingto
rejectthenullhypothesiswhenitisfalse.)
IntheSampleSizeandPowerwindow,specify:
Alpha isthesignificancelevel,usually0.05.Thisimpliesawillingnesstoaccept(ifthetrue

differencebetweenstandarddeviationandthehypothesizedstandarddeviationiszero)
thatasignificantdifferenceisincorrectlydeclared5%ofthetime.
Hypothesized Standard Deviation isthehypothesizedorbaselinestandarddeviationtowhich

thesamplestandarddeviationiscompared.
canselect LargerorSmallerfromthemenutoindicatethe
directionofthechangeyouwanttodetect.

Alternative Standard Deviation

isthesmallestdetectabledifference(howsmalladifferenceyouwantto
beabletodeclarestatisticallysignificant).Forsinglesampleproblemsthisisthedifference
betweenthehypothesizedvalueandthetruevalue.

Difference to Detect

Sample Size ishowmanyexperimentalunits(runs,orsamples)areinvolvedinthe

experiment.

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


One Sample Standard Deviation

541

Power istheprobabilityofdeclaringasignificantresult.Itistheprobabilityofrejectingthe

nullhypothesiswhenitisfalse.
InthelowerpartofthewindowyouentertwooftheitemsandtheSampleSizeandPower
calculationdeterminesthethird.
SomeexamplesinthischapteruseengineeringexamplesfromtheonlinemanualofThe
NationalInstituteofStandardsandTechnology(NIST).YoucanaccesstheNISTmanual
examplesathttp://www.itl.nist.gov/div898/handbook.

One Sample Standard Deviation Example


OneexamplefromtheNISTmanualstatesaproblemintermsofthevarianceanddifference
todetect.Thevarianceforresistivitymeasurementsonalotofsiliconwafersisclaimedtobe
100ohmcmsquared.Thebuyerisunwillingtoacceptashipmentifthevarianceisgreater
than155ohmcmsquaredforaparticularlot(55ohmcmsquaredabovethebaselineof100
ohmcmsquared).
IntheSampleSizeandPowerwindow,theOneSampleStandardDeviationcomputationsuse
thestandarddeviationinsteadofthevariance.Thehypothesistobetestedis:
H0:=0,where0isthehypothesizedstandarddeviation.Thetruestandarddeviationis
0plusthedifferencetodetect.
Inthisexamplethehypothesizedstandarddeviation,0,is10(thesquarerootof100)andis
12.4499(thesquarerootof100+55=155).Thedifferencetodetectis12.449910=2.4499.
Youwanttodetectanincreaseinthestandarddeviationof2.4499forastandarddeviationof
10,withanalphaof0.05andapowerof0.99.Todeterminethenecessarysamplesize:
1. SelectDOE > Sample Size and Power.
2. ClicktheOne Sample Standard Deviation buttonintheSampleSizeandPowerWindow.
3. LeaveAlphaas0.05.
4. Enter10forHypothesized Standard Deviation.
5. SelectLargerforAlternate Standard Deviation.
6. Enter2.4499asDifference to Detect.
7. Enter0.99forPower.
8. LeaveSample Sizeblank.(SeetheleftofFigure 20.9.)
9. ClickContinue.
TheSample Size iscalculatedas171.(SeetherightofFigure 20.9.)Thisresultisthesample
sizeroundeduptothenextwholenumber.

542

Prospective Sample Size and Power


One-Sample and Two-Sample Proportions

Chapter 20
Design of Experiments Guide

Note: Sometimesyouwanttodetectachangetoasmallerstandarddeviation.Ifyouselect
SmallerfromtheAlternative Standard Deviation menu,enteranegativeamountinthe
Difference to Detectfield.
Figure 20.9WindowToCompareSingleDirectionOneSampleStandardDeviation

One-Sample and Two-Sample Proportions


TheSampleSizewindowsandcomputationstotestsamplesizesandpowerforproportions
aresimilartothosefortestingmeans.YouenteratrueProportionandchooseanAlphalevel.
Then,fortheonesampleproportioncase,entertheSample SizeandNull Proportiontoobtain
thePower. Or,enterthePowerandNull ProportiontoobtaintheSample Size.Similarly,to
obtainavalueforNull Proportion,entervaluesforSample SizeandPower.Forthetwosample
proportioncase,eitherthetwosamplesizesorthedesiredPowermustbeentered.(See
Figure 20.10andFigure 20.11.)
Thecomputationstodeterminesamplesizeandnullproportionsuseexactmethodsbasedon
thebinomialdistribution.Suchmethodsaremorereliablethanusingthenormal
approximationtothebinomial,whichcanprovideerroneousresultsforsmallsamplesor
proportionscloseto0or1.
Forasingleproportion,resultsarebasedonexactpowercalculationsusedinconjunctionwith
oneofthefollowing:

TheAddtwosuccessesandtwofailuresadjustedWaldteststatisticdescribedinAgresti
andCoull(1998).SeealsoSection3.3inthewhitepaperbyBarkerontheJMPwebsite:
http://www.jmp.com/blind/whitepapers/wp_jmp_powersample_104887.pdf.

TheClopperPearsonexactconfidenceintervalmethod(ClopperandPearson,1934;
AgrestiandCoull,1998,Section1)

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


One-Sample and Two-Sample Proportions

543

Fortwoproportions,resultsarebasedonexactpowercalculationsfortheadjustedWald
statisticproposedbyAgrestiandCaffo(2000).

Actual Test Size


TheresultsalsoshowtheActualTestSize.ThisistheactualTypeIerrorrateforagiven
situation.Sincethebinomialdistributionisdiscrete,theactualtestsizecandiffersignificantly
fromthestatedAlphalevelforsmallsamplesorproportionsnear0or1.

One Sample Proportion


ClickingtheOne Sample Proportion optionontheSampleSizeandPowerwindowyieldsa
OneProportionwindow.Inthiswindow,youcanspecifythealphalevelandthetrue
proportion.Thesamplesize,power,orthehypothesizedproportioniscalculated.Ifyou
supplytwoofthesequantities,thethirdiscomputed,orifyouenteranyoneofthequantities,
youseeaplotoftheothertwo.
Forexample,ifyouhaveahypothesizedproportionofdefects,youcanusetheOne Sample
Proportionwindowtoestimatealargeenoughsamplesizetoguaranteethattheriskof
acceptingafalsehypothesis()issmall.Thatis,youwanttodetect,withreasonablecertainty,
adifferenceintheproportionofdefects.
Fortheonesampleproportion,thehypothesissupportedis
H 0 :p = p 0
andthetwosidedalternativeis
H a :p p 0
wherepisthepopulationproportionandp0isthenullproportiontotestagainst.Notethatif
youareinterestedintestingwhetherthepopulationproportionisgreaterthanorlessthanthe
nullproportion,youuseaonesidedtest.Theonesidedalternativeiseither
H a :p p 0
or
H a :p p 0
One-Sample Proportion Window Specifications
InthetopportionoftheSampleSizewindow,youcanspecifyorentervaluesfor:
Alpha isthesignificancelevelofyourtest.Thedefaultvalueis0.05.

544

Prospective Sample Size and Power


One-Sample and Two-Sample Proportions
Proportion

Chapter 20
Design of Experiments Guide

isthetrueproportion,whichcouldbeknownorhypothesized.Thedefaultvalue

is0.1.
Method isthemethodtodeterminetheexactconfidenceinterval.ChoicesareExact

AgrestiCoullorExactClopperPearson.Formoredetails,seeOneSampleand
TwoSampleProportionsonpage 542.
One-Sided or Two-Sided Specifyeitheraonesidedoratwosidedtest.Thedefaultsettingis

thetwosidedtest.
Inthebottomportionofthewindow,entertwoofthefollowingquantitiestoseethethird,
orasinglequantitytoseeaplotoftheothertwo.
Null Proportion istheproportiontotestagainst(p0)orisleftblankforcomputation.The

defaultvalueis0.2.
Sample Size isthesamplesize,orisleftblankforcomputation.IfSample Sizeisleftblank,

thenvaluesforProportionandNull Proportionmustbedifferent.
Power isthedesiredpower,orisleftblankforcomputation.

OneSampleProportionExample
Asanexample,supposethatanassemblylinehasahistoricalproportionofdefectsequalto
0.1,andyouwanttoknowthepowertodetectthattheproportionisdifferentfrom0.2,given
analphalevelof0.05andasamplesizeof100.
1. SelectDOE>Sample Size and Power.
2. ClickOne Sample Proportion.
3. LeaveAlphaas0.05.
4. Leave0.1asthevalueforProportion.
5. LeavetheMethodasExactAgrestiCoull.
6. AcceptthedefaultoptionofTwo-Sided.(Aonesidedtestisselectedifyouareinterested
intestingiftheproportioniseithergreaterthanorlessthantheNull Proportion.)
7. Leave0.2asthevalueforNull Proportion.
8. Enter100astheSample Size.
9. ClickContinue.
ThePoweriscalculatedandisshownasapproximately0.7(seeFigure 20.10).NotetheActual
TestSizeis0.0467,whichisslightlylessthanthedesired0.05.

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


One-Sample and Two-Sample Proportions

545

Figure 20.10PowerandSampleWindowforOneSampleProportions

Two Sample Proportions


TheTwo Sample Proportions optioncomputesthepowerorsamplesizesneededtodetectthe
differencebetweentwoproportions,p1andp2.
Forthetwosampleproportion,thehypothesissupportedis
H 0 :p 1 p 2 = D 0
andthetwosidedalternativeis
H a :p 1 p 2 D 0
wherep1andp2arethepopulationproportionsfromtwopopulations,andD0isthe
hypothesizeddifferenceinproportions.
Theonesidedalternativeiseither
H a : p 1 p 2 D 0
or
H a : p 1 p 2 D 0
Two Sample Proportion Window Specifications
SpecificationsfortheTwoSampleProportionswindowinclude:
Alpha isthesignificancelevelofyourtest.Thedefaultvalueis0.05.

546

Prospective Sample Size and Power


One-Sample and Two-Sample Proportions

Chapter 20
Design of Experiments Guide

Proportion 1 istheproportionforpopulation1,whichcouldbeknownorhypothesized.The

defaultvalueis0.5.
Proportion 2 istheproportionforpopulation2,whichcouldbeknownorhypothesized.The

defaultvalueis0.1.
One-Sided or Two-Sided Specifyeitheraonesidedoratwosidedtest.Thedefaultsettingis

thetwosidedtest.
Null Difference in Proportion istheproportiondifference(D0)totestagainst,orisleftblank

forcomputation.Thedefaultvalueis0.2.
Sample Size 1 isthesamplesizeforpopulation1,orisleftblankforcomputation.
Sample Size 2 isthesamplesizeforpopulation2,orisleftblankforcomputation.
Power isthedesiredpower,orisleftblankforcomputation.

Ifyouenteranytwoofthefollowingthreequantities,thethirdquantityiscomputed:

Null Difference in Proportion

Sample Size 1 andSample Size 2

Power

ExampleofDeterminingSampleSizeswithaTwoSidedTest
Asanexample,supposeyouareresponsiblefortwosiliconwaferassemblylines.Basedonthe
knowledgefrommanyruns,oneoftheassemblylineshasadefectrateof8%;theotherline
hasadefectrateof6%.Youwanttoknowthesamplesizenecessarytohave80%powerto
rejectthenullhypothesisofequalproportionsofdefectsforeachline.
Toestimatethenecessarysamplesizesforthisexample:
1. SelectDOE>Sample Size and Power.
2. ClickTwo Sample Proportions.
3. AcceptthedefaultvalueofAlphaas0.05.
4. Enter0.08forProportion 1.
5. Enter0.06forProportion 2.
6. AcceptthedefaultoptionofTwo-Sided.
7. Enter0.0forNull Difference in Proportion.
8. Enter0.8forPower.
9. LeaveSample Size 1andSample Size 2blank.
10. ClickContinue.
TheSampleSizewindowshowssamplesizesof2554.(seeFigure 20.11.)Testingfora
onesidedtestisconductedsimilarly.SimplyselecttheOne-Sidedoption.

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


One-Sample and Two-Sample Proportions

547

Figure 20.11DifferenceBetweenTwoProportionsforaTwoSidedTest

ExampleofDeterminingPowerwithTwoSampleProportionsUsingaOneSidedTest
Supposeyouwanttocomparetheeffectivenessofatwochemicaladditives.Thestandard
additiveisknowntobe50%effectiveinpreventingcrackinginthefinalproduct.Thenew
additiveisassumedtobe60%effective.Youplanonconductingastudy,randomlyassigning
partstothetwogroups.Youhave800partsavailabletoparticipateinthestudy(400partsfor
eachadditive).Yourobjectiveistodeterminethepowerofyourtest,givenanulldifferencein
proportionsof0.01andanalphalevelof0.05.Becauseyouareinterestedintestingthatthe
differenceinproportionsisgreaterthan0.01,youuseaonesidedtest.
1. SelectDOE>Sample Size and Power.
2. ClickTwo Sample Proportions.
3. AcceptthedefaultvalueofAlphaas0.05.
4. Enter0.6forProportion 1.
5. Enter0.5forProportion 2.
6. SelectOne-Sided.
7. Enter0.01astheNull Difference in Proportion.
8. Enter400forSample Size 1.
9. Enter400forSample Size 2.
10. LeavePowerblank.

548

Prospective Sample Size and Power


Counts per Unit

Chapter 20
Design of Experiments Guide

11. ClickContinue.
Figure 20.12showstheTwoProportionswindowswiththeestimatedPowercalculationof
0.82.
Figure 20.12DifferenceBetweenTwoProportionsforaOneSidedTest

Youconcludethatthereisaboutan82%chanceofrejectingthenullhypothesisatthe0.05
levelofsignificance,giventhatthesamplesizesforthetwogroupsareeach400.Notethe
ActualTestSizeis0.0513,whichisslightlylargerthanthestated0.05.

Counts per Unit


Youcanusethe Counts per UnitoptionfromtheSampleSizeandPowerwindow(Figure 20.1)
tocalculatethesamplesizeneededwhenyoumeasuremorethanonedefectperunit.Aunit
canbeanareaandthecountscanbefractionsorlargenumbers.
Althoughthenumberofdefectsobservedinanareaofagivensizeisoftenassumedtohavea
Poissondistribution,itisunderstoodthattheareaandcountarelargeenoughtosupporta
normalapproximation.
Considerthefollowingquestions:

Isthedefectdensitywithinprescribedlimits?

Isthedefectdensitygreaterthanorlessthanaprescribedlimit?

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


Counts per Unit

549

IntheCountsperUnitwindow,optionsinclude:
Alpha isthesignificancelevelofyourtest.Thedefaultvalueis0.05.
Baseline Count per Unit isthenumberoftargeteddefectsperunit.Thedefaultvalueis0.1.
Difference to detect isthesmallestdetectabledifferencetotestagainstandisspecifiedin

defectsperunit,orisleftblankforcomputation.
Sample Size isthesamplesize,orisleftblankforcomputation.
Power isthedesiredpower,orisleftblankforcomputation.

IntheCountsperUnitwindow,enterAlphaandtheBaseline Count per Unit.Thenentertwo


oftheremainingfieldstoseethecalculationofthethird.Thetestisforaonesided
(onetailed)change.EntertheDifference to DetectintermsoftheBaseline Count per Unit
(defectsperunit).Thecomputedsamplesizeisexpressedasthenumberofunits,roundedto
thenextwholenumber.

Counts per Unit Example


Asanexample,considerawafermanufacturingprocesswithatargetof4defectsperwafer.
Youwanttoverifythatanewprocessmeetsthattargetwithinadifferenceof1defectper
waferwithasignificancelevelof0.05.IntheCountsperUnitwindow:
1. LeaveAlphaas0.05(thechanceoffailingthetestifthenewprocessisasgoodasthe
target).
2. Enter4astheBaseline Counts per Unit,indicatingthetargetof4defectsperwafer.
3. Enter1astheDifference to detect.
4. Enterapowerof0.9,whichisthechanceofdetectingachangelargerthan1(5defectsper
wafer).Inthistypeofsituation,alphaissometimescalledtheproducersriskandbetais
calledtheconsumersrisk.
5. ClickContinuetoseetheresultsinFigure 20.13,showingacomputedsamplesizeof38
(roundedtothenextwholenumber).
Theprocessmeetsthetargetiftherearelessthan190defects(5defectsperwaferinasample
of38wafers).

550

Prospective Sample Size and Power


Sigma Quality Level

Chapter 20
Design of Experiments Guide

Figure 20.13WindowForCountsPerUnitExample

Sigma Quality Level


TheSigmaQualityLevelfeatureisasimplestatisticthatputsagivendefectrateona
sixsigmascale.Forexample,onascaleofonemillionopportunities,3.397defectsresultina
sixsigmaprocess.ThecomputationthatgivestheSigmaQualityLevelstatisticis
Sigma Quality Level = NormalQuantile(1 defects/opportunities) + 1.5

TwoofthreequantitiescanbeenteredtodeterminetheSigmaQualityLevelstatisticinthe
SampleSizeandPowerwindow:

Number of Defects

Number of Opportunities

Sigma Quality Level

WhenyouclickContinue,thesigmaqualitycalculatorcomputesthemissingquantity.

Sigma Quality Level Example


Asanexample,usetheSampleSizeandPowerfeaturetocomputetheSigmaQualityLevelfor
50defectsin1,000,000opportunities:
1. SelectDOE > Sample Size and Power.
2. ClicktheSigma Quality Levelbutton.
3. Enter50fortheNumber of Defects.
4. Enter1000000astheNumber of Opportunities.(SeewindowtotheleftinFigure 20.14.)
5. ClickContinue.
TheresultsareaSigmaQualityLevelof5.39.(SeerightwindowinFigure 20.14.)

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


Sigma Quality Level

551

Figure 20.14SigmaQualityLevelExample1

Number of Defects Computation Example


IfyouwanttoknowhowmanydefectsreducetheSigmaQualityLeveltosixsigmafor
1,000,000opportunities:
1. SelectDOE > Sample Size and Power.
2. ClicktheSigma Quality Levelbutton.
3. Enter6asSigma Quality Level.
4. Enter1000000astheNumber of Opportunities.(SeeleftwindowinFigure 20.14.)
5. LeaveNumber of Defectsblank.
6. ClickContinue.
ThecomputationshowsthattheNumber of Defectscannotbemorethanapproximately
3.4.(SeerightwindowinFigure 20.15.)
Figure 20.15SigmaQualityLevelExample2

552

Prospective Sample Size and Power


Reliability Test Plan and Demonstration

Chapter 20
Design of Experiments Guide

Reliability Test Plan and Demonstration


Youcancomputerequiredsamplesizesforreliabilitytestsandreliabilitydemonstrations
usingtheReliability Test PlanandReliability Demonstrationfeatures.

Reliability Test Plan


TheReliability Test Planfeaturecomputesrequiredsamplesizes,censortimes,orprecision,
forestimatingfailuretimesandfailureprobabilities.
TolaunchtheReliabilityTestPlancalculator,selectDOE>Sample Size and Power,andthen
selectReliability Test Plan.Figure 20.16showstheReliabilityTestPlanwindow.
Figure 20.16ReliabilityTestPlanWindow

TheReliabilityTestPlanwindowhasthefollowingoptions:
Alpha isthesignificancelevel.Itisalso1minustheconfidencelevel.

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


Reliability Test Plan and Demonstration

553

Distribution istheassumedfailuredistribution,withtheassociatedparameters.
Precision Measure istheprecisionmeasure.Inthefollowingdefinitions,UandLcorrespond

totheupperandlowerconfidencelimitsofthequantitybeingestimated(eitheratimeor
failureprobability),andTcorrespondstothetruetimeorprobabilityforthespecified
distribution.
Interval Ratioissqrt(U/L),thesquarerootoftheratiooftheupperandlowerlimits.
Two-sided Interval Absolute WidthisUL,thedifferenceoftheupperandlowerlimits.
Lower One-sided Interval Absolute WidthisTL,thetruevalueminusthelowerlimit.
Two-sided Interval Relative Widthis(UL)/T,thedifferencebetweentheupperandlower

limits,dividedbythetruevalue.
Lower One-sided Interval Relative Widthis(TL)/T,thedifferencebetweenthetruevalue
andthelowerlimit,dividedbythetruevalue.
Objective istheobjectiveofthestudy.Theobjectivecanbeoneofthefollowingtwo:

estimatethetimeassociatedwithaspecificprobabilityoffailure.
estimatetheprobabilityoffailureataspecifictime.
isaplotoftheCDFofthespecifieddistribution.Whenestimatingatime,thetrue
timeassociatedwiththespecifiedprobabilityiswrittenontheplot.Whenestimatinga
failureprobability,thetrueprobabilityassociatedwiththespecifiedtimeiswrittenonthe
plot.

CDF Plot

Sample Size istherequirednumberofunitstoincludeinthereliabilitytest.


Censor Time

istheamountoftimetorunthereliabilitytest.

Precision isthelevelofprecision.ThisvaluecorrespondstothePrecisionMeasurechosen

above.
givestheapproximatevariancesandcovariance
forthelocationandscaleparametersofthedistribution.

Large-sample approximate covariance matrix

Continue clickheretomakethecalculations.
Back clickheretogobacktothePowerandSampleSizewindow.

AftertheContinuebuttonisclicked,twoadditionalstatisticsareshown:
Expected number of failures istheexpectednumberoffailuresforthespecified

reliability test.
Probability of fewer than 3 failures istheprobabilitythatthespecifiedreliabilitytestwill

resultinfewerthanthreefailures.Thisisimportantbecauseaminimumofthreefailuresis
requiredtoreliablyestimatetheparametersofthefailuredistribution.Withonlyoneor
twofailures,theestimatesareunstable.Ifthisprobabilityislarge,yourisknotbeingable
toachieveenoughfailurestoreliablyestimatethedistributionparameters,andyoushould

554

Prospective Sample Size and Power


Reliability Test Plan and Demonstration

Chapter 20
Design of Experiments Guide

considerchangingthetestplan.Increasingthesamplesizeorcensortimearetwowaysof
loweringtheprobabilityoffewerthanthreefailures.
Example
Acompanyhasdevelopedanewproductandwantstoknowtherequiredsamplesizeto
estimatethetimetill20%ofunitsfail,withatwosidedabsoluteprecisionof200hours.In
otherwords,whenaconfidenceintervaliscreatedfortheestimatedtime,thedifference
betweentheupperandlowerlimitsneedstobeapproximately200hours.Thecompanycan
runtheexperimentfor2500hours.Additionally,fromstudiesdoneonsimilarproducts,they
believethefailuredistributiontobeapproximatelyWeibull(2000,3).
Tocomputetherequiredsamplesize,dothefollowingsteps:
1. SelectDOE>Sample Size and Power.
2. SelectReliability Test Plan.
3. SelectWeibullfromtheDistributionlist.
4. Enter2000fortheWeibullparameter.
5. Enter3fortheWeibullparameter.
6. SelectTwo-sided Interval Absolute WidthfromthePrecisionMeasurelist.
7. SelectEstimate time associated with specified failure probability.
8. Enter0.2forp.
9. Enter2500forCensor Time.
10. Enter200forPrecision.
11. ClickContinue.Figure 20.17showstheresults.
Figure 20.17ReliabilityTestPlanResults

Therequiredsamplesizeis217unitsifthecompanywantstoestimatethetimetill20%
failureswithaprecisionof200hours.Theprobabilityoffewerthan3failuresissmall,sothe
experimentwilllikelyresultinenoughfailurestoreliablyestimatethedistribution
parameters.

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


Reliability Test Plan and Demonstration

555

Reliability Demonstration
Areliabilitydemonstrationconsistsoftestingaspecifiednumberofunitsforaspecified
periodoftime.Iffewerthankunitsfail,youpassthedemonstration,andconcludethatthe
productreliabilitymeetsorexceedsareliabilitystandard.
TheReliability Demonstrationfeaturecomputesrequiredsamplesizesandexperimental
runtimesfordemonstratingthataproductmeetsorexceedsaspecifiedreliabilitystandard.
TolaunchtheReliabilityDemonstrationcalculator,selectDOE>Sample Size and Power,and
thenselectReliability Demonstration.Figure 20.18showstheReliabilityDemonstration
window.
Figure 20.18ReliabilityDemonstrationWindow

TheReliabilityDemonstrationwindowhasthefollowingoptions:
Alpha isthealphalevel.
Distribution istheassumedfailuredistribution.Afterselectingadistribution,specifythe

associatedscaleparameterinthetextfieldundertheDistributionmenu.
isthemaximumnumberoffailuresyouwanttoallowduringthe
demonstration.Ifweobservethismanyfailuresorfewer,thenwesaywepassedthe
demonstration.

Max Failures Tolerated

Time isthetimecomponentofthereliabilitystandardyouwanttomeet.
Probability of Surviving istheprobabilitycomponentofthereliabilitystandardyouwantto

meet.

556

Prospective Sample Size and Power


Reliability Test Plan and Demonstration

Chapter 20
Design of Experiments Guide

Time of Demonstration istherequiredtimeforthedemonstration.


Number of Units Tested istherequirednumberofunitsforthedemonstration.
Continue clickheretomakethecalculations.
Back clickheretogobacktothePowerandSampleSizewindow.

AftertheContinuebuttonisclicked,aplotappears(seeFigure 20.19).
Figure 20.19ReliabilityDemonstrationPlot

Thetrueprobabilityofaunitsurvivingtothespecifiedtimeisunknown.TheYaxisofthe
plotgivestheprobabilityofpassingthedemonstration(concludingthetruereliabilitymeets
orexceedsthestandard)asafunctionofthetrueprobabilityofaunitsurvivingtothe
standardtime.Noticethelineisincreasing,meaningthatthefurtherthetruthisabovethe
standard,themorelikelyyouaretodetectthedifference.
Example
Acompanywantstogettherequiredsamplesizeforassessingthereliabilityofanewproduct
againstanhistoricalreliabilitystandardof90%survivalafter1000hours.Frompriorstudies
onsimilarproducts,itisbelievedthatthefailuredistributionisWeibull,withaparameterof
3.Thecompanycanaffordtorunthedemonstrationfor800hours,andwantstheexperiment
toresultinnomorethan2failures.
Tocomputetherequiredsamplesize,dothefollowingsteps:
1. SelectDOE>Sample Size and Power.
2. SelectReliability Demonstration.
3. SelectWeibullfromtheDistributionlist.

Chapter 20
Design of Experiments Guide

Prospective Sample Size and Power


Reliability Test Plan and Demonstration

557

4. Enter3fortheWeibull.
5. Enter2forMax Failures Tolerated.
6. Enter1000forTime.
7. Enter0.9forProbability of Surviving.
8. Enter800forTime of Demonstration.
9. ClickContinue.Figure 20.20showstheresults.
Figure 20.20ReliabilityDemonstrationResults

Thecompanyneedstorun118unitsinthedemonstration.Furthermore,iftheyobserve2or
fewerfailuresby800hours,wecanconcludethatthenewproductreliabilityisatleastas
reliableasthestandard.

558

Prospective Sample Size and Power


Reliability Test Plan and Demonstration

Chapter 20
Design of Experiments Guide

Appendix A
Column Properties
Understanding Column Properties Assigned by DOE
WhenyouconstructadesignusingtheDOEplatforms,columnpropertiesaresavedtothe
datatablethatcontainstheresultingdesign.Thisappendixprovidesdetailaboutonlythose
columnpropertiesthataresavedtodesignsthattheDOEplatformconstructs.Examples
illustratehoweachcolumnpropertyisassignedandusedbytheDOEplatforms.Descriptions
ofcolumnpropertiesnotassignedbytheDOEplatformsareprovidedinUsingJMP.
Someofthecolumnpropertiesdescribedinthisappendixareusefulingeneralmodeling
situations.Tousethepropertiesmoregenerally,youcanspecifythemyourself.Thisabilityis
particularlyusefulwhenyourdesignhasnotbeencreatedbyaDOEplatform.Someofthe
examplesinthisappendixillustratesituationswhereyouaddacolumnpropertyonyour
own.
Figure A.1ColumnPropertyAsterisksandColumnInfoWindow

Contents
AddingandViewingColumnProperties........................................... 561
ResponseLimits................................................................. 562
ResponseLimitsExample ..................................................... 564
EditingResponseLimits ...................................................... 567
DesignRole .................................................................... 570
DesignRoleExample......................................................... 570
Coding......................................................................... 573
LowandHighValues ......................................................... 573
CodingColumnPropertyandCenterPolynomials................................ 574
CodingExample ............................................................. 574
AssigningCoding............................................................ 577
Mixture ........................................................................ 579
MixtureExample ............................................................. 582
FactorChanges ................................................................. 585
FactorChangesExample...................................................... 586
ValueOrdering ................................................................. 588
ValueOrderingExample...................................................... 589
AssigningValueOrdering ..................................................... 591
ValueLabels .................................................................... 591
ValueLabelsExample......................................................... 592
RunsPerBlock ................................................................... 594
RunsPerBlockExample ....................................................... 594
ConstraintState ................................................................. 595
ConstraintStateExample...................................................... 595

Appendix A
Design of Experiments Guide

Column Properties
Adding and Viewing Column Properties

561

Adding and Viewing Column Properties


TheDOEplatformsautomaticallysavecertaincolumnpropertiestothedesigntablesthat
theyconstruct.However,someofthecolumnpropertiesassociatedwithdesigned
experimentsareusefulingeneralmodelingsituations.Tousethesecolumnpropertieswith
datatablesthathavenotbeencreatedusingDOEplatforms,youcanaddthemyourself.
AddingaColumnProperty
Toassignacolumnpropertytooneormorecolumns,dothefollowing:
1. Selectthecolumnorcolumnstowhichyouwanttoassignaproperty.
2. Dooneofthefollowing:
Rightclicktheheaderarea,selectColumn Properties,andselecttheproperty.
Rightclicktheheaderarea,selectColumn Info,andselectthepropertyfromthe
ColumnPropertiesmenu.
SelectCols > Column InfoandselectthepropertyfromtheColumnPropertiesmenu.
3. Inthecolumnpropertypanelthatappears,specifyvaluesandselectoptionsas
appropriate.
4. ClickApplytoaddthecolumnpropertyorclickOKtoaddthecolumnpropertyandclose
thecolumnpropertieswindow.
Tip: Acolumnmightalreadycontainapropertythatyouwanttoapplytoothercolumns.Use
theStandardizeAttributescommandtoapplythatpropertytoothercolumns.Fordetails,see
UsingJMP.
ViewingaColumnProperty
Toviewthepropertiesassignedtoaspecificcolumn,inthecolumnspanel,clickthecolumn
propertyasteriskicon .Clickapropertytoseeitssettingsortoeditit.Figure A.2showsthe
columnpropertiesassignedtoStretchintheBounce Data.jmpsampledatatable,locatedinthe
DesignExperimentfolder.

562

Column Properties
Response Limits

Appendix A
Design of Experiments Guide

Figure A.2AsteriskIconforStretchRevealingTwoColumnProperties

YoucanalsoviewcolumnpropertiesbyaccessingtheColumnPropertieslistintheColumn
Infomenu.Selectthecolumnorcolumnswhosecolumnpropertiesyouwanttoviewanddo
oneofthefollowing:

Rightclicktheheaderarea,selectColumn Info,andselectthepropertyfromtheColumn
Propertieslist.

SelectCols > Column InfoandselectthepropertyfromtheColumnPropertieslist.

Response Limits
UsingtheResponseLimitscolumnproperty,youcanspecifythefollowing:

boundsontherangeofvariationforaresponse

adesirabilitygoal

ameasureoftheimportanceoftheresponse

desirabilityvalues

TheResponseLimitscolumnpropertydefinesadesirabilityfunctionfortheresponse.The
ProfilerandContourProfilerusedesirabilityfunctionstofindoptimalfactorsettings.Seethe
ProfilerchapterintheProfilersbook.
Figure A.3showstheResponseLimitspanelintheColumnInfowindowfortheresponse
StretchintheBounce Data.jmpsampledatatable,foundintheDesignExperimentfolder.

Appendix A
Design of Experiments Guide

Column Properties
Response Limits

563

Figure A.3ExampleoftheResponseLimitsPanel

TheResponseLimitspanelconsistsofthefollowingareas:
Selectyourresponsegoalfromthemenu.AvailablegoalsareMaximize,MatchTarget,
Minimize,andNone.JMPdefinesadesirabilityfunctionfortheresponsetomatchthe
selectedgoal.Ifyouspecifylimits,thedesirabilityfunctionisdefinedusingtheselimits.If
youdonotspecifylimits,JMPbasesthedesirabilityfunctiononconservativelimitvalues
derivedfromthedistributionoftheresponse.IfNoneisselectedasthegoal,thenall
responsevaluesareconsideredequallydesirable.Forfurtherdetails,seeResponseson
page 83intheCustomDesignschapter.

Goal

Importance Enterarelativeweightingforeachofseveralresponsesincomputingtheoverall

desirabilityfunction.TheImportancevaluecanbeanypositivenumber.Whenno
Importancevalueisspecified,JMPtreatsallresponsesinagivenanalysisashavingequal
Importancevalues.Ifthereisonlyoneresponse,itreceivesImportance1.
Value SpecifyLowerandUpperlimitsandaMiddlevalueforyourresponse.JMPusesthese

valuestoconstructadesirabilityfunctionfortheresponse.Ifyoudonotspecifylimits,JMP
basesthedesirabilityfunctiononconservativelimitvalues.IfyourgoalisMatchTarget
andnoMiddlevalueisspecified,thenthetargetisdefinedtobethemidpointoftheLower
andUpperlimits.
Desirability SpecifyvaluesthatreflectthedesirabilityofyourLower,Middle,andUpper

values.Desirabilityvaluesshouldbebetween0and1.IfyoudonotspecifyDesirability
values,JMPassignsvaluesinaccordancewiththeselectedGoal.
Show as graph reference lines ShowshorizontalreferencelinesfortheLower,Middle,and

UppervaluesintheActualbyPredictedPlotandthePredictionProfiler.Thisoption
appliesonlyiflimitsarespecified.

564

Column Properties
Response Limits

Appendix A
Design of Experiments Guide

Response Limits Example


TheCoffee Data.jmpsampledatatable(locatedintheDesignExperimentfolder)containsthe
resultsofanexperimentthatwasperformedtooptimizetheStrengthofcoffee.Foracomplete
descriptionoftheexperimentaldesignandanalysis,seeTheCoffeeStrengthExperimenton
page 40intheStartingOutwithDOEchapter.
Yourgoalistofindfactorsettingsthatenableyoutobrewcoffeewithatargetstrengthof1.3,
whichisconsideredtobethemostdesirablevalue.Valueslessthan1.2andgreaterthan1.4
arecompletelyundesirable.Thedesirabilityofvaluesbetween1.2and1.4decreasesastheir
distancefrom1.3increases.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Coffee Data.jmp.
2. SelectRun ScriptfromtheredtrianglenexttoDOEDialog.
TheDOEDialogscriptrecreatestheCustomDesigndialogthatwasusedtocreatethe
experimentaldesigninCoffee Data.jmp.
3. OpentheResponsesoutline.
Figure A.4ResponsesOutlineinCustomDesignWindow

Whenyoudesignedthisexperiment,youspecifiedaresponseGoalofMatchTargetwitha
LowerLimitof1.2andanUpperLimitof1.4.Sincethereisonlyoneresponse,youdidnot
specifyavalueforImportance,becauseitis1bydefault.Whenyouconstructedthedesign
table,JMPassignedtheResponseLimitscolumnpropertytoStrength.
4. ClosetheCustomDesignwindow.
5. IntheCoffee Data.jmpsampledatatable,selecttheStrengthcolumnandselectCols >
Column Info.
6. SelectResponseLimitsintheColumnPropertieslist.

Appendix A
Design of Experiments Guide

Column Properties
Response Limits

565

Figure A.5ResponseLimitsColumnPropertyforStrength

Noticethefollowing:
TheGoalissettoMatch Target.
Importanceismissing.WhenImportanceismissing,JMPtreatsallresponsesinagiven
analysisashavingequalImportancevalues.SoJMPassignsStrengthanImportance
valueofone.
TheLowerlimitis1.2.
TheUpperlimitis1.4.
NoMiddlevalueisspecified.
BecausenoMiddlevalueisspecified,thetargetisdefinedtobethemidpointofthe
LowerandUpperlimits,whichis1.3.
NoDesirabilityvaluesarespecified.
7. SelecttheShow as graph reference linesoption.
ThisoptionshowshorizontalreferencelinesfortheLower,Middle,andUppervaluesin
theActualbyPredictedPlotandthePredictionProfiler.
8. ClickOK.
9. IntheCoffee Data.jmpdatatable,selectRun ScriptfromtheredtrianglenexttoReduced
Model.
10. ClickRun.
ThePredictionProfilerappearsatthebottomofthereport.

566

Column Properties
Response Limits

Appendix A
Design of Experiments Guide

Figure A.6ProfilerShowingDesirabilityFunctionforStrength

ThedesirabilityfunctionforStrengthappearsintheplotattherightaboveDesirability.
ThisplotappearsbecausethedatatablecontainsaResponseLimitscolumnpropertyfor
Strength.ThePredictionProfileralsoshowsreferencelinesfortheLowerandUpperlimits
forStrength.
11. HolddowntheCtrlkeyandclicktheStrengthplotforDesirability.
Figure A.7ResponseGoalWindowforStrength

Noticethefollowing:
JMPdeterminestheMiddlevaluetobethemidpointoftheHighandLowlimitsthat
youspecifiedintheResponseLimitscolumnproperty.
BecausetheGoalissettoMatchTarget,JMPsetstheDesirabilityfortheMiddlevalue
to1.
JMPsetstheDesirabilityfortheHighandLowvaluestoverysmallnumbers,0.0183.
TheDesirabilityplotinFigure A.6showshowJMPusestheDesirabilityvaluesshown
inFigure A.7.TheDesirabilityfunctionforStrengthisessentially0beyondtheLow
andHighvaluesanditincreasesto1graduallyasStrengthapproachesthetargetof1.3.
TheImportancevalueissetto1sincethereisonlyoneresponseinthemodel.

Appendix A
Design of Experiments Guide

Column Properties
Response Limits

567

12. ClickCanceltoexitthewindow.
13. SelectMaximize DesirabilityfromthePredictionProfilerredtrianglemenu.
ThesettingsforTimeandChargeareupdatedtoshowsettingsforthefactorsthat
maximizethedesirabilityfunctionforStrength.However,manyothersettingsalso
maximizethedesirabilityfunction.SeetheContourProfilerchapterintheProfilersbook
forinformationabouthowtoidentifyothersettingsthatmaximizethedesirability
function.

Editing Response Limits


IntheVinyl Data.jmp sampledatatable,aResponseLimitscolumnpropertyisalready
assignedtotheresponsethickness.Thepropertyhasagoalofmaximizingthickness.Suppose
thatinsteadofmaximizingthickness,youwantthesheetsofvinyltohaveathicknessbetween
6and10,withatargetthicknessof8.5.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Vinyl Data.jmp.
2. SelectthethicknesscolumnandselectCols > Column Info.
TheResponseLimitspropertyappearsintheColumnPropertieslistastheonlyproperty
assignedtothickness.TheResponseLimitspanelappearstotherightofthelist.
3. ClickMaximizeandselectMatch Target.
4. Type1fortheImportancevalue.
5. UnderValue,type6fortheLowervalue,8.5fortheMiddlevalue,and10fortheUpper
value.
Thisisanexampleofasymmetricresponselimits.Valuesofthicknessassmallas6oras
largeas10areacceptable.However,thetargetforthicknessis8.5.
6. SelectShow as graph reference lines.
ThisoptionshowshorizontalreferencelinesfortheLower,Middle,andUppervaluesin
theActualbyPredictedPlotandthePredictionProfiler.

568

Column Properties
Response Limits

Appendix A
Design of Experiments Guide

Figure A.8CompletedResponseLimitsPanel

7. ClickOK.
8. IntheVinyl Data.jmpdatatable,selectRun ScriptfromtheredtrianglenexttoModel.
Notethatm1,m2,andm3aremixturefactors.Also,thedesigninvolvesarandom
Whole Plotsfactor.Becauseofthis,thedefaultMethodisREML(Recommended).
9. ClickRun.
10. FromtheredtrianglenexttoResponsethickness,selectRow Diagnostics > Plot Actual by
Predicted.
ThereferencelinesfortheLower,Middle,andUpperlimitsappearontheActualby
PredictedPlot.
11. FromtheredtrianglenexttoResponsethickness,selectFactor Profiling > Profiler.

Appendix A
Design of Experiments Guide

Column Properties
Response Limits

569

Figure A.9PredictionProfilerShowingAsymmetricDesirabilityFunction

TheplotattherightaboveDesirabilityshowsthedesirabilityfunctionthatJMPhas
constructedforthickness.Thedesirabilityis1attheMiddlelimitof8.5.Thedesirabilityis
essentially0forthicknessvaluesbelow6andabove10.
12. HolddowntheCtrlkeyandclickthethicknessplotforDesirability.
Figure A.10ResponseGoalWindowforThickness

ThiswindowshowsyoursettingsfortheHigh,Middle,andLowValues.Italsoshowsthe
DesirabilityvaluesthatJMPassigns,basedonyourgoalofMatchTarget.TheDesirability
functionshowninFigure A.9isacontinuouscurvethatmatchestheDesirabilitysettings
inFigure A.10attheHigh,Middle,andLowValues.Atothervalues,theDesirability
functionassignsdesirabilitiesthatareconsistentwiththeselectedgoal.
13. ClickCancel.
14. SelectMaximize DesirabilityfromthePredictionProfilerredtrianglemenu.
Thesettingsforthefactorsareupdatedtoshowvaluesthatmaximizethedesirability
functionforthickness.Keepinmindthatmanyothersettingsalsomaximizethe
desirabilityfunction.Thepredictedresponseattheseoptimalsettingsis8.28.Recallthat
youset8.5asthetargetsetting,withlimitsof6and10.
15. ClosetheVinyl Data.jmpsampledatatablewithoutsavingthechanges.

570

Column Properties
Design Role

Appendix A
Design of Experiments Guide

Design Role
Factorsindesignedexperiments,aswellasinmoregeneralmodels,canbehaveinvarious
ways.JMPusesthedesignrolecolumnpropertytodescribethesebehaviors.Thesearethe
possibledesignroles:

Continuous

DiscreteNumeric

Categorical

Blocking

Covariate

Mixture

Constant

Uncontrolled

RandomBlock

Signal

Noise

InmanyoftheJMPDOEplatforms,youcanspecifyfactorswithdifferentdesignroles.In
someplatforms,yourdesignrequirementscauseJMPtodefinefactors.Forexample,
Whole PlotsandSubplotsarefactorsthatJMPcreateswhenyouspecifyveryhardtochange
andhardtochangefactors.Inplatformswherevariousdesignrolescanoccur,whenJMP
createsthedesigntableforyourdesign,eachfactorisassignedtheDesignRolecolumn
property.

FordescriptionsofthedesignrolesotherthanRandomBlock,Signal,andNoise,see
FactorTypesonpage 87intheCustomDesignschapter.

ForadescriptionoftheRandomBlockdesignrole,seeChangesandRandomBlockson
page 88intheCustomDesignschapter.

FordescriptionsoftheSignalandNoisedesignroles,seeDetailtheResponseandAdd
Factorsonpage 456intheTaguchiDesignschapter.

Design Role Example


TheexperimentintheOdor Control Original.jmp sampledatatablestudiestheeffectofthree
factorsonodor.Youdesignedthe15runexperimentanditwasconducted.However,when
theresultswerereportedtoyou,youlearnedthattheexperimentwasconductedoverthree
days.Thefirst5runswereconductedonDay1,thesecond5runsonDay2,andtheremaining
5runsonDay3.

Appendix A
Design of Experiments Guide

Column Properties
Design Role

571

Sincevariationsintemperatureandhumiditymighthaveaneffectontheresponse,youwant
toincludeDayasarandomblockingfactor.ItiseasytoaddacolumnforDaytothedesign
table.ButyouwanttousetheEvaluateDesignplatformtocomparethedesignwiththe
unexpectedblocktoyouroriginaldesign.YoualsowanttheabilitytousetheAugment
Designplatformincaseyouneedtoaugmentthedesign.TousetheEvaluateDesignand
AugmentDesignplatforms,youneedtoaddtheDesignRolecolumnpropertytoyournew
Daycolumn.
1. SelectHelp > Sample Data LibraryandopenOdor Control Original.jmp.
2. SelectCols > Add Multiple Columns.
3. NexttoColumnprefix,typeDay.
4. UnderAddWhere,selectAfter selected column.
5. SelectRunfromthelistofcolumnnames.
6. FromtheInitialDataValueslist,selectSequence Data.
7. Enterthefollowing:
1forFrom
3forTo
1forStep
5forRepeateachvalueNtimes

572

Column Properties
Design Role

Appendix A
Design of Experiments Guide

Figure A.11CompletedAddMultipleColumnsWindow

8. ClickOK.
TheDaycolumnisaddedasthesecondcolumninthedatatable.
9. SelecttheDaycolumn.
10. SelectCols > Column Info.
11. FromtheColumnPropertieslist,selectDesign Role.
12. IntheDesignRolepanel,clickContinuousandselectRandom Block.
13. ClickOK.
Inthecolumnspanel,anasteriskappearsnexttoDay.
14. ClicktheasterisknexttoDaytoverifythattheDesignRolecolumnpropertyhasbeen
assigned.
15. ClosetheOdor Control Original.jmpsampledatatablewithoutsavingthechanges.

Appendix A
Design of Experiments Guide

Column Properties
Coding

573

Coding
TheCodingcolumnpropertyappliesonlytocolumnswithanumericdatatype.Itappliesa
lineartransformationtothedatainthecolumn.IntheCodingcolumnpropertywindow,you
specifyaLowValueandaHighValue.TheLowValueandHighValueinyouroriginaldata
aretransformedto1and+1.JMPusesthetransformeddatavalueswheneverthecolumnis
enteredasamodeleffectintheFitModelplatform.
Thecodingpropertyisusefulforthefollowingreasons:

Codedpredictorsleadtoparameterestimatesthataremoreeasilyinterpretedand
compared.

Codedpredictorshelpreducemulticollinearityinmodelswithinteractionand
higherorderterms.

WhenanyDOEplatformotherthanAcceleratedLifeTestDesigncreatesadesign,JMP
definesaCodingcolumnpropertyforeachnonmixturefactorwithanumericdatatype.
Figure A.12showstheCodingcolumnpropertypanelforthecolumnFeed Rate inthe
Reactor 20 Custom.jmpsampledatatable,foundintheDesignExperimentfolder.
Figure A.12CodingPropertyPanelforFeedRate

Low and High Values


WhentheCodingpropertyisappliedaspartofdesignconstructioninaDOEplatform,the
LowValueisinitiallysettotheminimumsettingofthefactorandtheHighValueisinitially
settothemaximumsetting.

574

Column Properties
Coding

Appendix A
Design of Experiments Guide

WhenyouapplytheCodingpropertytoacolumnthatdoesnotcontainthatproperty,JMP
insertstheminimumvalueastheLowValueandthemaximumvalueastheHighValue.You
canchangethesevaluesasneeded.
Caution: AftertheCodingcolumnpropertyisassignedtoacolumn,JMPdoesnot
automaticallyupdateitwhenyoumakechangestothevaluesinthecolumn.Ifyouchangethe
valuesinacolumnthathasaCodingcolumnproperty,reviewtheHighValueandLowValue
toensurethattheyarestillappropriate.
TheCodingcolumnpropertycenterseachvalueinacolumnbysubtractingthemidpointof
theHighValueandLowValue.Itthendividesbyhalftherange.SupposethatHistheHigh
ValueandListheLowValue.TheneveryXinthecolumnistransformedtothefollowing:
X H + L 2
-----------------------------------H L 2
Foreachfactor,thetransformedvalueshaveamidpointequalto0andrangefrom1to+1.

Coding Column Property and Center Polynomials


TheCenterPolynomialsoptionislocatedintheFitModellaunchwindow,withintheModel
Specificationredtrianglemenu.CenterPolynomialscentersacontinuouscolumninvolvedin
apolynomialtermbysubtractingthemeanofeachvalueinthecolumn.Formoredetails,see
theFittingLinearModelsbook.
IftheCodingcolumnpropertyisassignedtoacolumn,thentheCenterPolynomialsoption
hasnoeffectonthatcolumn.Inapolynomialterminvolvingthatcolumn,thevaluesare
centeredandscaledasspecifiedbytheirCodingproperty.Supposethatanothercolumninthe
modeldoesnothavetheCodingpropertyandthatyouselectCenterPolynomials.Thenthat
columniscenteredbyitsmeaninanypolynomialtermwhereitappears.

Coding Example
TheReactor 20 Custom.jmpsampledatatablecontainsdatafroma20rundesignthatwas
constructedusingtheCustomDesignplatform.Theexperimentinvestigatestheeffectsoffive
factorsonayieldresponse(Percent Reacted)forachemicalprocess.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Reactor 20 Custom.jmp.
2. SelectRun ScriptfromtheDOE Dialogredtrianglemenu.
3. OpentheFactorsoutline.

Appendix A
Design of Experiments Guide

Column Properties
Coding

575

Figure A.13FactorsOutlineforDesignUsedinReactor 20 Custom.jmp

NoticethatthesettingsforTemperaturerangefrom140to180.Whenthedesignwas
generated,theCodingcolumnpropertywasassignedtoTemperature.TheLowValueisset
to140andtheHighValueissetto180.
4. ClosetheCustomDesignwindow.
5. IntheReactor 20 Custom.jmpsampledatatable,clicktheasterisknexttoTemperaturein
thecolumnspanelandselectCoding.
TheColumnInfowindowappearsandshowstheCodingcolumnpropertypanel.Youcan
seethatJMPaddedthecolumnproperty,specifyingtheLowValueandHighValue,when
itconstructedthedesigntable.Infact,byrepeatingthisstep,youcanverifythatJMP
addedtheCodingpropertyforallfivefactors.
Figure A.14CodingPanelforTemperature

6. ClickCanceltoclosetheColumnInfowindow.
7. IntheReactor 20 Custom.jmpsampledatatable,selectRun ScriptfromtheReduced Model
redtrianglemenu.
Thisscriptfitsamodelthatcontainsonlythefiveeffectsdeterminedtobesignificant
basedonananalysisofthefullmodel.

576

Column Properties
Coding

Appendix A
Design of Experiments Guide

8. ClickRun.
Figure A.15EffectSummaryReportforReducedModel

IntheSourcelist,theHighandLowvaluesusedintheCodingcolumnpropertyappearin
parenthesestotherightofthemaineffects,Catalyst, Temperature,andConcentration.The
rangesimposedbytheCodingpropertyarenotshownfortheinteractioneffects.
Tip: Noticethe^symbolstotherightofthePValuesforTemperatureandConcentration.
Thesesymbolsindicatethatthesemaineffectsarecomponentsofinteractioneffectswith
smallerpvalues.Ifaninteractioneffectisincludedinthemodel,thentheprincipleof
effectheredityrequiresthatallcomponenteffectsarealsointhemodel.SeeEffect
Heredityonpage 59intheStartingOutwithDOEchapter.
9. SelectEstimates > Show Prediction ExpressionfromtheredtrianglenexttoResponse
PercentReacted.
LookatthePredictionExpressionoutlinetoseehowcodingaffectsthepredictionformula.
Figure A.16PredictionExpressionforReducedModel

Appendix A
Design of Experiments Guide

Column Properties
Coding

577

EachfactoristransformedasspecifiedbytheCodingcolumnproperty.Forexample,for
Temperature,noticethefollowing:
TheLowValueintheCodingpropertywassetto140.TheTemperaturevalueof140is
transformedto1.
TheHighValueintheCodingpropertywassetto180.TheTemperature valueof180is
transformedto+1.
ThemidpointoftheLowandHighvaluesis160.TheTemperature valueof160is
transformedto0.
Thetransformedvalueshelpyoucomparetheeffects.TheestimatedcoefficientforCatalystis
9.942andtheestimatedcoefficientforConcentrationis3.077.Itfollowsthatthepredicted
effectofCatalystonPercent Reactedismorethanthreetimesaslargeastheeffectof
ConcentrationonPercent Reacted.Also,thecoefficientsindicatethatpredicted
Percent ReactedincreasesasCatalystincreasesanddecreasesasConcentrationincreases.
Thetransformedvalueshelpyouinterpretthecoefficients:

Whenallfactorsareattheirmidpoints,theirtransformedvaluesare0.Thepredicted
Percent Reactedistheintercept,whichis65.465.

WhenCatalystandConcentrationareattheirmidpoints,a20unitincreaseinTemperature
increasesthePercent Reactedby5.558units.

SupposethatConcentrationisatitsmidpoint,sothatitstransformedvalueis0:
WhenCatalystisatitsmidpoint,a20unitincreaseinTemperatureincreasesthePercent
Reactedby5.558units.
WhenCatalystisatitshighsetting,a20unitincreaseinTemperatureincreasesthe
Percent Reactedby5.558+6.035=11.593units.

Itfollowsthatthecoefficientoftheinteractionterm,6.035,istheincreaseintheslopeofthe
modelforpredictedPercent Reactedfora0.5unitchangeinCatalyst.

Assigning Coding
TheexperimentaldataintheTiretread.jmpsampledatatableresultsfromanexperimentto
studytheeffectsofSILICA,SILANE,andSULFURonfourmeasuresoftiretreadperformance.
Inthisexample,youwillconsideronlyoneoftheresponses,ABRASION.
Youwillfirstfitamodelusingtheuncodedfactors.Thenyouwillassignthecodingproperty
tothefactorsandrerunthemodeltoobtainmeaningfulparameterestimates.
1. SelectHelp > Sample Data LibraryandopenTiretread.jmp.
2. SelectAnalyze > Fit Model.
3. SelectABRASIONandclickY.
4. SelectSILICA,SILANE,andSULFURandclickMacros > Response Surface.

578

Column Properties
Coding

Appendix A
Design of Experiments Guide

5. CheckKeep dialog open.


6. ClickRun.
7. SelectEstimates > Show Prediction ExpressionfromtheResponseABRASIONredtriangle
menu.
Figure A.17PredictionExpressionforModelwithUncodedFactors

Thecoefficientsdonothelpyoucompareeffectsizes.Thesizesofthecoefficientsdonot
reflecttheimpactoftheeffectsonABRASIONovertherangeoftheirsettings.Also,the
coefficientsarenoteasilyinterpreted.Forexample,thecoefficientsdonotfacilitateyour
understandingofthepredictedresponsewhenSILICAisatthemidpointofitsrange.
ApplytheCodingcolumnpropertytothethreefactorstoseehowcodingmakesthe
coefficientsmoremeaningful.
8. IntheTiretread.jmpdatatable,selectSILICA,SILANE,andSULFURintheColumnspanel.
RightclickthehighlightedareaandselectStandardize Attributes.
9. SelectColumn Properties > CodingintheStandardizePropertiespanel.
10. ClickOK.
AnasteriskappearsintheColumnspanelnexttoSILICA,SILANE,andSULFURindicating
thatthesehavebeenassignedacolumnproperty.
11. IntheFitModelwindow,clickRun.
12. SelectEstimates > Show Prediction ExpressionfromtheResponseABRASIONredtriangle
menu.

Appendix A
Design of Experiments Guide

Column Properties
Mixture

579

Figure A.18PredictionExpressionforModelwithCodedFactors

Thecoefficientsforthecodedfactorsenableyoutocompareeffectsizes.SILANEhasthe
largesteffectonABRASIONovertherangeofdesignsettings.TheeffectsofSILICAandthe
SILANE*SULFURinteractionarelargeaswell.
Thecoefficientsforthecodedfactorsarealsomoreeasilyinterpreted.Forexample,when
allfactorsareatthecenteroftheirranges,thepredictedvalueofABRASIONisthe
intercept,139.12.
13. ClosetheTiretread.jmpsampledatatablewithoutsavingthechanges.

Mixture
TheMixturecolumnpropertyisusefulwhenacolumninadatatablerepresentsacomponent
ofamixture.Thecomponentsofamixtureareconstrainedtosumtoaconstant.Becauseof
this,theydifferfromnonmixturefactors.TheMixturecolumnpropertyservestwopurposes:

Itidentifiesacolumnasamixturecomponent.

580

Column Properties
Mixture

Appendix A
Design of Experiments Guide

IfyouaddacolumnwiththeMixturecolumnpropertyasamodeleffectinthe
Analyze > FitModelwindow,JMPautomaticallygeneratesanointerceptmodel.

Itdefinesthecodingforamixturecomponent.
Codingformixturecomponentsdiffersfromthatfornonmixturefactors.However,as
withnonmixturefactors,abenefitofcodingformixturefactorsisthatithelpsyou
interpretparameterestimates.SeePseudoComponentCodingonpage 581.

Figure A.19showstheMixturecolumnpropertypanelforthefactorm1intheVinyl Data.jmp


sampledatatable,foundintheDesignExperimentfolder.
Figure A.19MixtureColumnPropertyPanel

IntheMixturecolumnpropertypanel,youcanspecifythefollowing:
Lower Limit SpecifiesthelowvalueusedinPseudoComponentCoding.WhentheMixture

propertyisappliedaspartofdesignconstructioninaDOEplatform,theLowerLimitisset
totheminimumsettingofthefactor.WhenyouapplytheMixturepropertytoacolumn
thatdoesnotcontainthatproperty,JMPinsertstheminimumvalueastheLowerLimit.
Youcanchangethisvalueasneeded.
Upper Limit SpecifiesthehighvalueusedinPseudoComponentCoding.WhentheMixture

propertyisappliedaspartofdesignconstructioninaDOEplatform,theUpperLimitisset
tothemaximumsettingofthefactor.WhenyouapplytheMixturepropertytoacolumn
thatdoesnotcontainthatproperty,JMPinsertsthemaximumvalueastheUpperLimit.
Youcanchangethisvalueasneeded.

Appendix A
Design of Experiments Guide

Column Properties
Mixture

581

Sum of Terms Specifiesthesumofthemixturecomponents.WhenyouapplytheMixture

propertytoacolumnthatdoesnotcontainthatproperty,JMPinsertsadefaultvalueof1
fortheSumofTerms.
L PseudoComponent Coding

TransformsdatavaluessothattheLowerLimitcorrespondsto

0.
U PseudoComponent Coding TransformsdatavaluessothattheUpperLimitcorrespondsto

0.
PseudoComponentCoding
Apseudocomponentisalineartransformation.LetSdenotethesumofthemixture
components.Supposethaticolumns X 1 X 2 X q havebeenassignedtheMixturecolumn
property.Supposethatthecolumnsandeffectsconstructedfromthesecolumnsareenteredas
effectsintheFitModelwindow.
Definethefollowing:
q

L =

L i ,whereLiistheLowerLimitforXi

i=1
q

U =

U i ,whereUiistheUpperLimitforXi

i=1

LetxidenoteavalueofthecolumnXi.TheL PseudoComponentatxiisdefinedasfollows:
L

xi = Xi Li S L
TheU PseudoComponentatxiisdefinedasfollows:
U

xi = Ui Xi U S
IfyouselectbothL PseudoComponent CodingandU PseudoComponent Coding,theFit
ModelplatformusestheLcodingif(SL)<(US).Otherwise,theUcodingisused.
InFitModel,mixturefactorsaretransformedusingpseudocomponentsbeforecomputing
parameterestimates.Thishelpsmakeparameterestimatesmoremeaningful.Inreports
dealingwithparameterestimates,themixturemaineffectsaregivenbythecoding
transformation.Otherreports,suchastheprofilers,arebasedontheuncodedvalues.

582

Column Properties
Mixture

Appendix A
Design of Experiments Guide

Mixture Example
ThedataintheDonev Mixture Data.jmpsampledatatable,foundintheDesignExperiment
folder,arebasedonanexamplefromAtkinsonandDonev(1992).Thedesignincludesthree
mixturefactorsandonenonmixturefactor.Theresponseandfactorsareasfollows:

TheresponseistheelectromagneticDampingofanacrylonitrilepowder.

Thethreemixtureingredientsarecoppersulphate(CuSO4),sodiumthiosulphate
(Na2S2O3),andGlyoxal.

ThenonmixtureenvironmentalfactorofinterestistheWavelengthoflight.

ThoughWavelengthistheoreticallycontinuous,theresearcherswereinterestedonlyin
predictionsatthreediscretewavelengths.Asaresult,Wavelengthistreatedasacategorical
factorwiththreelevels.
FordetailsaboutusingCustomDesigntoconstructadesignforthissituation,seeMixture
Experimentsonpage 163intheExamplesofCustomDesignschapter.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Donev Mixture Data.jmp.
2. ClicktheasterisknexttoCuSO4 inthecolumnspanelandselectMixture.
Figure A.20MixtureColumnPropertyPanelforCuSO4

Noticethefollowing:
TheLowerLimitis0.2,theminimumdesignsettingforCuSO4.
TheUpperLimitis0.8,themaximumdesignsettingforCuSO4.
TheSumofTermsissetto1.Thisisthesumofthethreemixturefactors.

Appendix A
Design of Experiments Guide

Column Properties
Mixture

583

TheL PseudoComponent Codingoptionisselected.SeePseudoComponentCoding


onpage 581.
3. ClickCancel.
4. ClicktheasterisknexttoGlyoxal inthecolumnspanelandselectMixture.
Forthisfactor,notethefollowing:
TheLowerLimitis0,theminimumdesignsettingforGlyoxal.
TheUpperLimitis0.6,themaximumdesignsettingforGlyoxal.
5. ClickCancel.
6. IntheDonev Mixture Data.jmp datatable,selectRun Script fromtheModel redtriangle
menu.
Themodelcontainsthemaineffectsofthemixturefactorsandtwowayinteractionsforall
fourfactors.
7. ClickRun.
IntheFitModelreports,themixturefactorsappearintheirpseudocomponentcoded
form.Whenthemixturefactorsappearininteractions,theyarenotdenotedincoded
form.Nevertheless,themodelfittingisbasedonthepseudocomponents.Figure A.21
showstheParameterEstimatesreport,wherethefirstthreetermsshowthecodedformfor
themixturefactors.
Figure A.21ParameterEstimatesReport

8. SelectEstimates > Show Prediction ExpressionfromtheResponse Dampingredtriangle


menu.
ThePredictionExpressionreportshowsthemodelthatwasfit.Notethatthemixture
factorsaretransformedusingtheL PseudoComponentcoding.

584

Column Properties
Mixture

Appendix A
Design of Experiments Guide

Figure A.22PredictionExpressionforDampingModel

SupposethatyouareinterestedinpredictionsatWavelengthL2.Supposealsothat
Na2S2O3andGlyoxalaresettotheirlowvalues,0.2and0respectively,andthatCuSO4is
settoitshighvalue,0.8.Inthiscase,thepredictedDampingequalstheparameterestimate
forCuSO4 (6.191) plustheparameterestimateforCuSO4*Wavelength[L2](1.878).Youcan
verifythisinthePredictionProfiler.
9. SelectSave Columns > Save Coding TablefromtheResponseDampingredtrianglemenu.

Appendix A
Design of Experiments Guide

Column Properties
Factor Changes

585

Figure A.23FirstThreeColumnsofCodingTableShowingCodedMixtureFactors

Forthisparticulardesign,theL PseudoComponentcodingtransformsthemixturefactors
torangebetween0and1.Notethatthisdoesnothappeningeneral.

Factor Changes
TheFactorChangescolumnpropertyindicateshowdifficultitistochangefactorsettingsina
designedexperiment.ThepossiblespecificationsforFactorChangesareEasy,Hard,andVery
Hard.Forexample,Figure A.24showstheFactorChangescolumnpropertypanelforthe
factorA1intheBattery Data.jmpsampledatatable,locatedintheDesignExperimentfolder.
Figure A.24FactorChangesColumnPropertyPanel

586

Column Properties
Factor Changes

Appendix A
Design of Experiments Guide

Whenadesigncontainsfactorsthatarehardtochangeandveryhardtochange,itmust
alsoincludeasubplotandawholeplotfactor:
Thelevelsofthewholeplotfactordefinethegroupsofrunsforwhichthelevelsofthe
veryhardtochangefactorsareheldconstant.
Thelevelsofthesubplotfactordefinethegroupsofrunsforwhichthelevelsofthe
hardtochangefactorsareheldconstant.

Whenadesigncontainsonlyfactorsthatarehardtochange,butnofactorsthatare
veryhardtochange,itshouldincludeawholeplotfactor.Thelevelsofthewholeplot
factordefinethegroupsofrunsforwhichthelevelsofthehardtochangefactorsareheld
constant.Formoredetails,seeChangesandRandomBlocksonpage 88intheCustom
Designschapter.

AugmentandEvaluateDesign
FortheEvaluateDesignandAugmentDesignplatforms,theFactorChangescolumnproperty
identifiesfactorswithChangesspecifiedasHardorVeryHard.However,theseplatformsalso
requirethatthewholeplotandsubplotfactorsbeenteredasmodeleffectsinthelaunch
windows.Thisisbecausethewholeplotandsubplotfactorsarepartofthedesignstructure.
CustomDesign
TheCustomDesignplatformenablesyoutocreatedesignswhereallfactorchangesareEasy.
Youcanalsoconstructsplitplot,splitsplitplot,ortwowaysplitplot(stripplot)designs.
Whenconstructingthesedesigns,youneedtoidentifythefactorswhosevaluesare
hardtochangeorveryhardtochange.IntheFactorsoutline,youcanidentifyfactorsas
havingChangesthatareEasy,Hard,orVeryHard.WhentheCustomDesignplatform
constructsthedesigntable,theFactorChangespropertyisassignedtoeveryfactorthat
appearsintheFactorsoutline.
TheCustomDesignplatformistheonlyplatformthatconstructsdesignsforfactorswith
ChangesthatareHardorVeryHard.OtherDOEplatformsalsoassigntheFactorChanges
columnpropertytofactorsthattheyconstruct,butthevalueofthecolumnpropertyissetto
Easyfortheirfactors.
IfyouLoadFactorsintheCustomDesignwindowusingatableoffactors,youcanassignthe
FactorChangescolumnpropertytocolumnsinthattable.WhenyouLoadFactorsusingthat
table,yourFactorChangesspecificationsappearintheFactorsoutline.

Factor Changes Example


TheBattery Data.jmpsampledatatable,foundintheDesignExperimentfolder,containsdata
fromanexperimentthatstudiestheopencurrentvoltageofbatteries(OCV).Thedesignisa

Appendix A
Design of Experiments Guide

Column Properties
Factor Changes

587

twowaysplitplotdesign.Forfurtherbackground,seeExamplesofCustomDesigns
chapteronpage 186.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Battery Data.jmp.
2. ClicktheasterisktotherightofthefactorC1 inthecolumnspanel.
3. SelectFactor Changes.
Figure A.25FactorChangesPanelforC1

ThevalueofFactorChangesforC1isHard.Figure A.24showsthatthevalueofFactor
ChangesforA1isVeryHard.
4. ClickOK.
5. Inthedatatable,clicktheredtrianglenexttoDOE DialogandselectRun Script.
6. OpentheFactorsoutline.
Figure A.26FactorsOutlineforBatteryExperiment

ThefactorsA1,A2,A3,andA4haveChangessettoVeryHard,andthefactorsC1andC2
haveChangessettoHard.WhentheCustomDesignplatformconstructsthedesigntable,
itsavesthesespecificationstotheappropriatecolumnsasFactorChangescolumn
properties.

588

Column Properties
Value Ordering

Appendix A
Design of Experiments Guide

IntheDesignoutline,noticetheWhole PlotsandSubplotsfactors.
Figure A.27DesignOutlinePartialView

ToaccountforthefactorchangesthatareHardandVeryHard,twofactorsarecreatedby
theCustomDesignplatform.TheWhole Plots factorgroupstherunswheretheVeryHard
factorlevelsareconstantandtheSubplotsfactorgroupstherunswheretheHardfactors
levelsareconstant.Thesefactorsneedtobeincludedasmodeleffectswhenyouenter
columnswiththeFactorChangescolumnpropertyintheEvaluateDesignandAugment
Designplatforms.

Value Ordering
TheValueOrderingcolumnpropertyassignsanordertothevaluesinacolumn.Thatorderis
thenusedinplotsandanalyses.Youcanspecifytheorderinwhichyouwantvaluestoappear
inreports.
Note: Forcertainvaluesthathaveanaturalordering,suchasdaysoftheweek,JMP
automaticallyorderstheseintheappropriatewayinreports.SeetheUsingJMPbook.
Figure A.28showstheValueOrderingpanelfortheTypecolumnintheCar Physical Data.jmp
sampledatatable.ReportsthatinvolvethevaluesofTypeplacetheselevelsintheorder
Sporty,Small,Compact,Medium,andLarge.UsethebuttonstotherightoftheValue
Orderinglisttospecifyyourdesiredorderingforthevalues.

Appendix A
Design of Experiments Guide

Column Properties
Value Ordering

589

Figure A.28ValueOrderingColumnPropertyforType

IndesignscreatedusingmostDOEplatforms,categoricalfactors,includingtheconstructed
factorsWhole PlotsandSubplots,andblockingfactorsareassignedtheValueOrdering
property.Thispropertyordersthelevelsaccordingtotheorderinwhichtheyappearinthe
Factorsoutline.ThelevelsofconstructedfactorsareconsecutiveintegersandtheValue
Orderingpropertyspecifiesthisnaturalordering.YoucanmodifytheValueOrdering
specificationforanyfactortomeetyourneeds.
TheValueOrderingpropertyisnotassignedbytheCoveringArrayorTaguchiArrays
platforms.TheCoveringArrayplatformassignstheValueLabelscolumnproperty.SeeValue
Labelsonpage 591.

Value Ordering Example


SupposethatyouwantthevaluesforafactortoappearinadifferentorderinthePrediction
Profiler.Consideranexampleofawinetastingexperiment,constructedusingCustom
Design.Wineisratedbyfiveexperts,eachlistedasaRaterintheWine Data.jmpsampledata
table.Raterisafixedblockingfactor.Ninefactorsarestudied.Ratingistheresponse.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Wine Data.jmp.
2. SelectRun Script from theReduced Model redtrianglemenu.
3. ClickRun.
ThePredictionProfilerappearsatthebottomofthereport.

590

Column Properties
Value Ordering

Appendix A
Design of Experiments Guide

Figure A.29ProfilerwithOriginalValueOrdering

NoticethatthevaluesforDe-StemandFilteringappearintheorderNofollowedbyYes.
Youwanttoreversethese,sothattheYeslevelappearsfirst.
4. ClosetheResponseRatingreport.
5. Inthedatatable,clicktheasterisknexttoDe-SteminthecolumnspanelandselectValue
Ordering.
6. ClickReverse.
7. ClickOK.
8. ClicktheasterisknexttoFilteringinthecolumnspanelandselectValue Ordering.
9. ClickReverse.
10. ClickOK.
11. Again,clicktheredtrianglenexttoReduced ModelandselectRun Script.
12. ClickRun.
Figure A.30ProfilerwithNewValueOrdering

ThelevelsforDe-StemandFilteringnowappearintheorderYesfollowedbyNo.

Appendix A
Design of Experiments Guide

Column Properties
Value Labels

591

13. ClosetheWine Data.jmpsampledatatablewithoutsavingthechanges.

Assigning Value Ordering


ConsidertheCandy Bars.jmpsampledatatable.Ofthe18brandslistsunderBrand,Hershey
andM&M/MarshavethelargestnumbersoftypesofcandyaslistedintheNamecolumn.You
wantthesetwobrandstoappearfirstinreports.
1. SelectHelp > Sample Data LibraryandopenCandy Bars.jmp.
2. SelecttheBrandcolumn.
3. SelectCols > Column Info.
4. UnderColumnProperties,selectValue Ordering.
5. IntheValueOrderinglist,selectHershey.
6. ClickMove Upfivetimes.
HersheyisnowfirstintheValueOrderinglist.
7. IntheValueOrderinglist,selectM&M/Mars.
8. ClickMove Upseventimes.
M&M/MarsisnowsecondintheValueOrderinglist.
9. ClickOK.
AnasteriskindicatingtheValueOrderingcolumnpropertyappearsnexttoBrand inthe
columnspanel.JMPnowlistsHersheyandM&M/MarsfirstinreportsinvolvingBrand.
10. SelectAnalyze > Distribution.
11. SelectCaloriesandclickY, Columns.
12. SelectBrandandclickBy.
13. ClickOK.
14. WhileholdingdowntheCtrlkey,fromtheredtrianglenexttoCaloriesselect
Display Options > Horizontal Layout.
NotethattheDistributionreportsforHersheyandM&M/Marsappearfirstamongthe18
brands.
15. ClosetheCandy Bars.jmpsampledatatablewithoutsavingthechanges.

Value Labels
TheValueLabelscolumnpropertyrepresentsvaluesinacolumnwithspecifiedlabels.These
labelsaredisplayedinthedatatableandareusedinplotsandreports.Inthedatatable,you
canviewtheoriginalvaluesbydoubleclickingwithinacell.Fordetailsabouthowtoassign
andworkwiththeValueLabelscolumnproperty,seetheUsingJMPbook.

592

Column Properties
Value Labels

Appendix A
Design of Experiments Guide

TheCoveringArraysplatformistheonlyDOEplatformthatassignstheValueLabelscolumn
property.TheCoveringArraysplatformsavesfactorstothedatatablewithaNominal
modelingtype.Theunderlyingvaluesareconsecutiveintegersrangingfrom1tothenumber
oflevelsthatyouspecifyintheCoveringArrayFactorsoutline.TheValuesthatyouspecifyin
theFactorsoutlinearetheValueLabelsthatareassignedtotheunderlyingintegers.

Value Labels Example


Youwanttotestaninternetbasedsoftwareapplicationtodetectissuesarisingfrom
componentsintheoperatingenvironment.Thefourcomponentsofinterestconsistofa
browser,theoperatingsystem,thecomputersRAM,andtheconnectionspeed.Tominimize
testingtime,yourestrictyourselftotestingtwowayinteractions.
ConstructaStrength2coveringarraytotesttherequiredcombinationsoffactorlevels.
1. SelectDOE > Covering Array.
2. SelectLoad Factorsfromtheredtrianglemenu.
3. SelectHelp > Sample Data LibraryandopenDesign Experiment/Software Factors.jmp.
ThefactorsandtheirlevelsappearintheFactorsoutline.
Figure A.31FactorsOutlineforSoftwareFactors

NoticethattheRoleofthefourfactorsisdescribedasCategorical.
4. ClickContinue.
TheRestrictFactorLevelCombinationsoutlineopens.Sinceallcombinationsofsettings
arepossible,leavethissettoNone.
5. ClickMake Design.
6. ClickMake Table.
7. Inthecolumnspanel,clicktheasterisknexttoWeb Browser andselectValue Labels.

Appendix A
Design of Experiments Guide

Column Properties
Value Labels

593

Figure A.32ColumnInfoWindowforFactorA

NoticethatWeb Browser hasaNumericdatatypeandaNominalmodelingtype.The


underlyingvaluesofWeb Browseraretheintegers1,2,3,4,and5.Thesevaluesare
assignedvaluelabelscorrespondingtothevaluesthatyouenteredwhenyouconstructed
thedesign.
Changethevaluelabelfor2fromIEtoInternetExplorer.
8. Select2 = IEintheValueLabelslist.
Figure A.33ValueLabelsPanelwithSelection

9. TypeInternet Explorer nexttoLabel.

594

Column Properties
RunsPerBlock

Appendix A
Design of Experiments Guide

10. ClickChange.
Thechangeappearsinthedatatable.
Note: Tousethenumericvaluesandnotthelabels,deselectUse Value Labels.

RunsPerBlock
WhenyouusetheDOEplatformstoconstructadesigncontainingablockingfactor,thefactor
isassignedtheDesignRolecolumnpropertywiththevalueBlocking.JMPalsoassignsthe
RunsPerBlockcolumnpropertytoeachBlockingfactor.TheRunsPerBlockpropertyindicates
themaximumallowablenumberofrunsineachblock.ThispropertyisusedbytheEvaluate
DesignandAugmentDesignplatformstoindicatetheblockingstructureforthefactor.For
moredetails,seeBlockingonpage 87intheCustomDesignschapter.
Note: TheRunsPerBlockcolumnpropertyisassignedbyJMPaspartofdesignconstruction.
Youcannotdirectlyassignthiscolumnproperty.

RunsPerBlock Example
ConsiderthewinetastingexperimentdescribedinExampleofaCustomDesignonpage 66
intheCustomDesignschapter.Winesamplesaretastedbyfiveraters(Rater)andeachrater
tasteseightsamples.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Wine Data.jmp.
2. ClicktheasterisknexttoRater inthecolumnspanelandselectDesign Role.
NoticethattheDesignRoleissettoBlocking.
3. ClickCancel.
4. ClicktheasterisknexttoRater inthecolumnspanelandselectRunsPerBlock.

Appendix A
Design of Experiments Guide

Column Properties
ConstraintState

595

Figure A.34RunsPerBlockColumnPropertyPanelforRater

NoticethatthevalueofRunsPerBlockis8.ThedesignconstructedbytheDOEDialog
scripthas40runs.Sincetherearefiveraters,JMPconstructsadesignwith40/5=8runsfor
eachrater.

ConstraintState
IntheCustomandMixtureDesignplatforms,youcanSaveConstraintsthatyouspecifyfora
design.WhenyouselectSaveConstraints,thecoefficientsofeachlinearconstraintappearina
columninadatatable.Thevaluethatboundstheinequalityisgiveninthelastrowofthe
table.
EachconstraintcolumnisassignedtheConstraintStatecolumnproperty.Thisproperty
specifiesthedirectionoftheinequalitythatdefinestheconstraint.WhenyouselectLoad
Constraintsfromadesignplatform,theConstraintStatecolumnpropertytellsJMPthe
directionoftheinequality.
Note: TheConstraintStatecolumnpropertyisassignedbyJMPaspartofdesignconstruction.
Youcannotdirectlyassignthiscolumnproperty.

ConstraintState Example
ThesampledatatablePiepel.jmp,locatedintheDesignExperimentfolder,containsamixture
designwiththreecontinuousfactors.ThedesignisbasedonanexperimentpresentedinSnee
(1979)andPiepel(1988),wherethereareboundaryconstraintsoneachfactorandthree
additionallinearconstraints.Inthefollowingexample,youdothefollowing:
1. Changeoneofthethreeadditionalconstraints

596

Column Properties
ConstraintState

Appendix A
Design of Experiments Guide

2. Savetheconstraintstoatable
3. ObservehowtheConstraintStatecolumnpropertydescribesthedirectionoftheinequality
intheconstraint
Forfurtherdevelopmentofthisexample,seeAnExtremeVerticesExamplewithLinear
Constraintsonpage 318intheMixtureDesignschapter.
1. SelectHelp > Sample Data LibraryandopenDesign Experiment/Piepel.jmp.
2. SelectRun ScriptfromtheDOE Dialogredtrianglemenu.
NoticethethreelinearconstraintsbelowtheFactorsoutline.Tomaketheconstraintsmore
interpretable,youwanttoreformulatethefirstconstraintintermsofagreaterthanor
equaltoinequality.
Figure A.35LinearConstraintsbeneathFactorsOutline

3. Inthefirstconstraint,dothefollowing:
Type85nexttoX1.
Type90nexttoX2.
Type100nexttoX3.
Selectfromtheinequalitymenu.
Type90totherightoftheinequalitysign.
4. SelectSave ConstraintsfromtheMixtureDesignredtrianglemenu.
Atablecontaininginformationabouttheconstraintsappears.
Figure A.36ConstraintTable

EachcolumncontainsthecoefficientsofthefactorsX1,X2,andX3inrows1through3.
Row4containsthevaluethatappearedtotherightoftheinequalitysign.

Appendix A
Design of Experiments Guide

Column Properties
ConstraintState

597

5. ClicktheasterisknexttoConstraint 1.
6. ClickConstraintState.
Figure A.37ConstraintStateColumnPropertyPanel

TheConstraintStatepanelforX1indicatesthatthedirectionoftheinequalityisgreater
thanindicatinggreaterthanorequalto.
7. ClickCancel.

598

Column Properties
ConstraintState

Appendix A
Design of Experiments Guide

Appendix B
Technical Details
The Model and Alias Matrices
TheModelMatrixrepresentsthecodedsettingsfortheeffectsthatyouincludeinyourmodel.
TheModelMatrixisusedindefiningthefollowing:

Optimalityandefficiencymeasures.SeeOptimalityCriteriaonpage 120intheCustom
DesignschapterandDEfficiencyonpage 124intheCustomDesignschapter.

Powercalculations.SeePowerCalculationsonpage 494intheEvaluateDesigns
chapter.

Relativepredictionvariance.SeeRelativePredictionVarianceonpage 497inthe
EvaluateDesignschapter.

ThisappendixshowshowtheModelMatrixisdefinedandpresentstwowaystoviewthis
matrix.
TheAliasMatrixgivescoefficientsthatindicatethedegreetowhichthemodelparametersare
biasedbyeffectsthatarepotentiallyactive,butnotinthemodel.Forthisreason,itisrelatedto
theModelMatrix.TheAliasMatrixisalsousedindefiningaliasoptimality.SeeAlias
Optimalityonpage 124intheCustomDesignschapter.
ThisappendixshowshowtheAliasMatrixisdefined.Inparticular,itpresentsthedefinition
forsituationswherethereareHardorVeryHardfactorchangesandwherethereareIf
Possibleeffects.

Contents
TheModelMatrix............................................................... 601
TheAliasMatrix ................................................................ 601
DesignswithHardorVeryHardFactorChanges ................................. 602
DesignswithIfPossibleEffects................................................. 602

Appendix B
Design of Experiments Guide

Technical Details
The Model Matrix

601

The Model Matrix


Themodelmatrixforadesigndescribesthesettingsforalleffectsinthemodel:

Themodelmatrixhasarowforeachrunandacolumnforeachtermofthemodel
specifiedintheModeloutline.

Foreachrun,thecorrespondingrowofthemodelmatrixcontainsthecodedvaluesofthe
modelterms.

Continuoustermsarecodedtorangefrom1to1.Nominaltermsarecodedbyapplying
theGramSchmidtorthogonalizationproceduretoJMPscodingfornominaleffects.Find
additionalinformationaboutcodingfornominaleffectsintheFittingLinearModelsbook.

Youcanviewadesignsmodelmatrixintwoways:
1. IfyoucreatethedesignusingCustomDesign,selectSave X Matrixfromtheredtriangle
menuintheCustomDesignwindow.InthedesigntablethatCustomDesigncreates,click
theredtrianglenexttotheModelMatrixscriptandselectEdit.Themodelmatrixisgiven
asX.
2. Foranarbitrarydesigntable,selectAnalyze > Fit Model.Entereffectstodescribeyour
model.ClickRun.Fromthereportsredtrianglemenu,selectSave Columns > Save Coding
Table.Themodelmatrixisdefinedbythecolumnscorrespondingtotheinterceptand
modeleffects.

The Alias Matrix


TheAliasMatrixentriesrepresentthedegreeofbiasimpartedtomodelparametersbythe
effectsthatyouspecifiedintheAliasTermsoutline.CalculationsfortheAliasMatrixare
basedonthemodelmatrix.SeeTheModelMatrixonpage 601.
LetX1bethemodelmatrixcorrespondingtothetermsintheModeloutline.Denotethematrix
ofmodeltermsfortheeffectsspecifiedintheAliasTermsoutlinebyX2.
Theassumedmodelisgivenasfollows:
Y = X1 1 +
Supposethatsomeofthealiastermsareactiveandthatthetruemodelisgivenasfollows:
Y = X1 1 + X2 2 +
Theleastsquaresestimatorof1isgivenby:
1
1 = X 1 X 1 X 1 Y

602

Technical Details
The Alias Matrix

Appendix B
Design of Experiments Guide

Undertheusualregressionassumptions,theexpectedvalueof 1 isgivenby:
E 1 = 1 + A 2
where A = X 1'X 1 1 X 1'X 2 .
ThematrixAiscalledthealiasmatrix.

Designs with Hard or Very Hard Factor Changes


Fordesignswithhardtochangeorveryhardtochangefactors,thealiasmatrixisgivenas
follows:
A = X 1 V

X1

X1 V

X2

whereVistheblockdiagonalcovariancematrixoftheresponses.

Designs with If Possible Effects


FordesignswithIfPossibleeffects(BayesianDandIoptimaldesigns),thealiasmatrixis
givenasfollows:
2 1

A = X 1 X 1 + K

X 1 X 2

whereKisadiagonalmatrixwiththesevalues:

k=0forNecessaryterms

k=1forIfPossiblemaineffects,powers,andinteractionsinvolvingacategoricalfactor
withmorethantwolevels

k=4forallotherIfPossibleterms

IntheBayesiancase,thealiasmatrixgivesthealiasingofeffectscorrespondingtoaridge
1
regressionwithapriorvarianceof K .ForadditionaldetailonBayesiandesigns,see
BayesianDOptimalityonpage 121intheCustomDesignschapterandBayesian
IOptimalityonpage 123intheCustomDesignschapter.
IntheCustomDesignplatform,youcancontroltheweightsusedforIfPossibletermsby
selectingAdvanced Options > Prior Parameter Variancefromtheredtrianglemenu.Thereyou
cansetpriorvariancesforallmodeltermsbyspecifyingthediagonalelementsofK.The
optionupdatestoshowthedefaultweightswhenyouclickMakeDesign.

Appendix C
References

Agresti,A.,andCoull,B.A.(1998),ApproximateIsBetterthanExactforIntervalEstimation
ofBinomialProportions,TheAmericanStatistician,52,2,119126.
Agresti,A.,andCaffo,B.N.(2000),SimpleandEffectiveConfidenceIntervalsfor
ProportionsandDifferencesofProportionsResultfromAddingTwoSuccessesandTwo
Failures,TheAmericanStatistician,54,4,280288.
Atkinson,A.C.andDonev,A.N.(1992),OptimumExperimentalDesigns,ClarendonPress,
Oxfordp.148.
Barker(2011),C.,PowerandSampleSizeCalculationsinJMP,SASInstitute.Retrieved
November12,2013from
http://www.jmp.com/blind/whitepapers/wp_jmp_powersample_104887.pdf.
Bose,R.C.,(1947),MathematicalTheoryoftheSymmetricalFactorialDesignSankhya:The
IndianJournalofStatistics,Vol.8,Part2,pp.107166.
Box,G.E.P.(1988),SignaltoNoiseRatio,PerformanceCriteria,andTransformations,
Technometrics30,140.
Box,G.E.P.andBehnken,D.W.(1960),SomeNewThreeLevelDesignsfortheStudyof
QuantitativeVariables,Technometrics2,455475.
Box,G.E.P.andDraper,N.R.(1987),EmpiricalModelBuildingandResponseSurfaces,NewYork:
JohnWileyandSons.
Box,G.E.P.,Hunter,W.G.,andHunter,J.S.(1978),StatisticsforExperimenters,NewYork:John
WileyandSons,Inc.
Box,G.E.P.,Hunter,W.G.,andHunter,J.S.(2005),StatisticsforExperimenters:Design,Innovation,
andDiscovery,2ndedition,NewYork:JohnWileyandSons,Inc.
Box,G.E.P.andMeyer,R.D.(1986),AnAnalysisofUnreplicatedFractionalFactorials,
Technometrics28,1118.
Box,G.E.P.andWilson,K.B.(1951),OntheExperimentalAttainmentofOptimum
Conditions,JournaloftheRoyalStatisticalSociety,SeriesB,13,145.
Byrne,D.M.andTaguchi,G.(1986),ASQC40thAnniversaryQualityControlCongress
Transactions,Milwaukee,WI:AmericanSocietyofQualityControl,168177.
Chen,J.,Sun,D.X.,andWu,C.F.J.(1993),ACatalogueofTwolevelandThreeLevel
FractionalFactorialDesignswithSmallRuns,InternationalStatisticalReview,61,1,
p131145,InternationalStatisticalInstitute.
Clopper,C.,Pearson,E.S.(1934),Theuseofconfidenceorfiduciallimitsillustratedinthe
caseofthebinomial,Biometrika26,404413.

604

References

Appendix C
Design of Experiments Guide

Cochran,W.G.andCox,G.M.(1957),ExperimentalDesigns,SecondEdition,NewYork:John
WileyandSons.
Cohen,M.B.,Gibbons,P.B.,Mugridge,W.B.,Colbourn,C.J.(2003),ConstructingTestSuites
forInteractionTesting,Proceedings25thInternationalConferenceonSoftwareEngineering,
3848.
Cohen,M.B.,Dwyer,M.B.,andShi,J.(2007)InteractionTestingofHighlyConfigurable
SystemsinthePresenceofConstraints,Proceedingsofthe2007InternationalSymposiumon
SoftwareTestingandAnalysis,129139.
Colbourn,C.(2004),CombinatorialAspectsofCoveringArrays,LeMatematiche,58,
121167.
Colbourn,C.andDinitz,J.,eds.(2010),HandbookofCombinatorialDesigns,2ndEdition,CRC
Press.
Cornell,J.A.(1990),ExperimentswithMixtures,SecondEditionNewYork:JohnWiley&Sons.
Cook,R.D.andNachtsheim,C.J.(1990),LettertotheEditor:ResponsetoJamesM.Lucas,
Technometrics32,363364.
Dalal,S.R.andMallows,C.L.(1998),FactorCoveringDesignsforTestingSoftware,
Technometrics40,234243.
Daniel,C.(1959),UseofHalfnormalPlotsinInterpretingFactorialTwolevelExperiments,
Technometrics,1,311314.
DanielC.andWood,F.(1980),FittingEquationstoData,RevisedEdition,NewYork:John
WileyandSons,Inc.
Derringer,D.andSuich,R.(1980),SimultaneousOptimizationofSeveralResponse
Variables,JournalofQualityTechnology,Oct.1980,12:4,214219.
DuMouchel,W.andJones,B.(1994),ASimpleBayesianModificationofDOptimalDesigns
toReduceDependenceonanAssumedModel,Technometrics,36,3747.
Fang,K.T.andSudfianto,A.(2006),DesignandModelingforComputerExperiments,Chapman
andHallCRC,BocaRatan.Florida
Gotwalt,C.M.,Jones,B.A.,andSteinberg,D.M.,(2009)FastComputationofDesignsRobust
toParameterUncertaintyforNonlinearSettings,Technometrics,51:1,8895.
Goos,P.(2002)TheOptimalDesignofBlockedandSplitPlotExperiments,NewYork:Springer.
Goos,P.andJones,B.(2011),OptimalDesignofExperiments:ACaseStudyApproach,JohnWiley
andSons.
Haaland,P.D.(1989),ExperimentalDesigninBiotechnology,NewYork:MarcelDekker,Inc.
Hahn,G.J.,Meeker,W.Q.,andFeder,P.I.,(1976),TheEvaluationandComparisonof
ExperimentalDesignsforFittingRegressionRelationships,JournalofQualityTechnology,
8:3,pp.140157.
Hamada,M.andWu,C.F.J.(1992),AnalysisofDesignedExperimentswithComplex
Aliasing,JournalofQualityTechnology,24:3,130137.
Hartman,A.andRaskin,L.(2004),ProblemsandAlgorithmsforCoveringArrays,Discrete
Mathematics284,149156.

Appendix C
Design of Experiments Guide

References

605

Hartman,A.andRaskin,L.(2004),ProblemsandAlgorithmsforCoveringArrays,Discrete
Mathematics,284:1,149156.
John,P.W.M.(1972),StatisticalDesignandAnalysisofExperiments,NewYork:Macmillan
PublishingCompany,Inc.
Johnson,M.E.andNachtsheim,C.J.(1983),SomeGuidelinesforConstructingExact
DOptimalDesignsonConvexDesignSpaces,Technometrics25,271277.
Jones,B.(1991),AnInteractiveGraphForExploringMultidimensionalResponseSurfaces,
1991JointStatisticalMeetings,Atlanta,Georgia.
Jones,B.andGoos,P.(2007),ACandidatesetfreeAlgorithmforGeneratingDoptimal
Designs,AppliedStatistics,56,Part3,pp118.Availableat
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3001117/.
Jones,B.andGoos,P.(2014),OptimalDesignofBlockedExperimentsinthePresenceof
SupplementaryInformationabouttheBlocks,toappearinTechnometrics.
Jones,B.,Lin,D.K.J.,andNachtsheim,C.J.(2008),BayesianDOptimalSupersaturated
Designs,JournalofStatisticalPlanningandInference,138,8692.
Jones,B.andNachtsheim,C.J.(2011),AClassofThreeLevelDesignsforDefinitiveScreening
inthePresenceofSecondOrderEffects,JournalofQualityTechnology,43,115.Availableat
http://www.jmp.com/software/pdf/definitive_screening.pdf.
Jones,B.andNachtsheim,C.J.(2011),EfficientDesignswithMinimalAliasing,
Technometrics,53:1,6271.
Jones,B.andNachtsheim,C.J.(2013),DefinitiveScreeningDesignswithAddedTwoLevel
CategoricalFactors,JournalofQualityTechnology,45,121129.
Jones,B.andNachtsheim,C.J.(2014),BlockingSchemesforDefinitiveScreeningDesigns,
Technometrics,forthcoming.
Joseph,V.R.,Gul,E.,andBa,S.(2014),MaximumProjectionDesignsforComputer
Experiments,forthcoming.
Khuri,A.I.andCornell,J.A.(1987),ResponseSurfaces:DesignandAnalysis,NewYork:Marcel
Dekker.
Kowalski,S.M.,Cornell,J.A.,andVining,G.G.(2002)SplitPlotDesignsandEstimation
MethodsforMixtureExperimentswithProcessVariables,Technometrics44:7279.
Lenth,R.V.(1989),QuickandEasyAnalysisofUnreplicatedFractionalFactorials,
Technometrics,31,469473.
Lekivetz,R.,Sitter,R.,Bingham,D.,Hamada,M.S.,Moore,L.M.,andWendelberger,J.R.
(2014),OnAlgorithmsforObtainingOrthogonalandNearOrthogonalArraysforMain
EffectsScreening.ToappearinJournalofQualityTechnology.
Lin,D.K.J.(1993),ANewClassofSupersaturatedDesign,Technometrics,35,2831.
Lucas,J.M.,(1990),LettertotheEditor:CommentsonCookandNachtsheim(1989),
Technometrics,32,363364.
Mahalanobis,P.C.(1947),Sankhya,TheIndianJournalofStatistics,Vol8,Part2,April.

606

References

Appendix C
Design of Experiments Guide

Martirosyan,S.(2003),PerfectHashFamilies,IdentifiableParentPropertyCodesand
CoveringArrays,Ph.D.thesis,UniversitatDuisburgEssen,FakultatfurMathematik.
Meyer,R.K.andNachtsheim,C.J.(1995),TheCoordinateExchangeAlgorithmfor
ConstructingExactOptimalDesigns,Technometrics,Vol37,pp.6069.
Meyer,R.D.,Steinberg,D.M.,andBox,G.(1996),FollowupDesignstoResolveConfounding
inMultifactorExperiments,Technometrics,38:4,p307.
Mitchell,T.J.(1974),AnalgorithmfortheConstructionofDOptimalExperimentalDesigns,
Technometrics,16:2,pp.203210.
Montgomery,D.C.(2009),DesignandAnalysisofExperiments,SeventhEdition,Hoboken:John
Wiley&Sons,Inc.
Morgan,J.(2009),ConstrainedCoveringArrays:ResolvingInvalidLevelCombination
Constraints,TechnicalReport,CaryNC:SASInstituteInc.,alsoinSupplementalProceedings
ofthe20thInternationalSymposiumonSoftwareReliabilityEngineering.
Morgan,J.(2014),ComputingCoverageandDiversityMetricsforConstrainedCovering
Arrays,TechnicalReport,CaryNC:SASInstituteInc.
Morris,M.D.,Mitchell,T.J.,andYlvisaker,D.(1993),BayesianDesignandAnalysisof
ComputerExperiments:UseofDerivativesinSurfacePrediction,Technometrics35:2,
243255.
Myers,R.H.(1976)ResponseSurfaceMethodology,Boston:AllynandBacon.
Myers,R.H.(1988),ResponseSurfaceMethodology,VirginiaPolytechnicandStateUniversity.
Myers,R.H.,Montgomery,D.C.,andAndersonCook,C.M.(2009),ResponseSurface
Methodology,ProcessandProductOptimizationUsingDesignedExperiments,ThirdEdition,
Hoboken:JohnWiley&Sons,Inc.
Mylona,K.,Goos,P.,andJones,B.(2014),OptimalDesignofBlockedandSplitplot
ExperimentsforFixedEffectsandVarianceComponentEstimation,Technometrics,56:2,
132144.
Nayeri,P.,Colbourn,C.,andKonjevod,G.(2013),RandomizedPostoptimizationofCovering
Arrays,EuropeanJournalofCombinatorics,34,91103.
Peipel,G.F.(1988),ProgramsforGeneratingExtremeVerticesandCentroidsofLinearly
ConstrainedExperimentalRegions,JournalofQualityTechnology20:2,125139.
Plackett,R.L.andBurman,J.P.(1947),TheDesignofOptimumMultifactorialExperiments,
Biometrika,33,305325.
Santner,T.B.,Williams,B.,andNotz,W.(2003),TheDesignandAnalysisofComputer
Experiments,Springer,NewYork.
Schoen,E.D.(1999),DesigningFractionalTwolevelExperimentswithNestedError
Structures,JournalofAppliedStatistics26:495508.
Shannon,C.E.andWeaver,W.(1949),TheMathematicalTheoryOfCommunication,
UniversityOfIllinoisPress,Urbana,Illinois.
Scheff,H.(1958)ExperimentswithMixtures,JournaloftheRoyalStatisticalSocietyBv20,
344360.

Appendix C
Design of Experiments Guide

References

607

Shewry,M.C.andWynn,H.P.(1987),MaximumEntropySampling,JournalofApplied
Statistics14,165170.
Snee,R.D.andMarquardt,D.W.(1974),ExtremeVerticesDesignsforLinearMixture
Models,Technometrics,16,391408.
Snee,R.D.(1975),ExperimentalDesignsforQuadraticModelsinConstrainedMixture
Spaces,Technometrics,17:2,149159.
Snee,R.D.(1979),ExperimentalDesignsforMixtureSystemswithMulticomponent
Constraints,Commun.Statistics:TheoryandMethods,8(4),303326.
Snee,RonaldD.(1985),ComputerAidedDesignofExperimentsSomePractical
Experiences,JournalofQualityTechnology,17,222236.
St.John,R.C.andDraper,N.R.(1975),DOptimalityforRegressionDesigns:AReview,
Technometrics,17,523.
Taguchi,G.(1976),AnIntroductiontoQualityControl,Nagoya,Japan:CentralJapan
QualityControlAssociation.
Vivacqua,C.A.,andBisgaard,S.(2004),StripBlockExperimentsforProcessImprovement
andRobustness,,QualityEngineering,16,495500.
Welch,W.J.(1984),ComputerAidedDesignofExperimentsforResponseEstimation,
Technometrics,26,217224.
Wu,C.F.J.,andHamada,M.S.(2000),Experiments:Planning,Analysis,andOptimization,second
edition,Wiley.
Xiao,L.,Lin,D.K.J.,andBai,F.(2012),ConstructingDefinitiveScreeningDesignsUsing
ConferenceMatrices,JournalofQualityTechnology,44,28.
Yilmaz,C.,Fouche,S.,Cohen,M.B.,Porter,A.,Demiroz,G.,andKoc,U.(2014),Moving
ForwardwithCombinatorialInteractionTesting,Computer47,3745.
Zahran,A.,AndersonCook,C.M.,andMyers,R.H.(2003),FractionofDesignSpaceto
AssessthePredictionCapabilityofResponseSurfaceDesigns,JournalofQualityTechnology,
35,377386.
Zhang,Z.andZhang,J.(2011),CharacterizingFailureCausingParameterInteractionsby
AdaptiveTesting,Proceedingsofthe2011InternationalSymposiumonSoftwareTestingand
Analysis,331341.

608

References

Appendix C
Design of Experiments Guide

Index
Design of Experiments Guide
A
ABCDdesigns 320
acceleratedlifetestdesign 35
acceptablevaluesSeelowerlimitsandupper
limits
ActualbyPredictedplots 269
AddFactorbutton 8687
adding
centerpointsinaugmentdesigns 514,516
factors 157
linearconstraints 315
runsandtermsinaugmentdesigns 518
additionalruns 99,255,290,302
advancedoptions(nonlineardesigner) 445
Aefficiency 493
AliasMatrix 488,601
explanation 132
hardorveryhardfactors 602
Aliasoptimaldesigns 124,134
aliasingeffects 249
Alpha 532
animationscripts 533
Anovareports 325
anticipatedcoefficients 104,226,392,479
AnticipatedRMSE 478
Appearance 486
ApplyChangestoAnticipated
Responses 480481
assigningimportance(ofresponses) 242,456
assumedmodel 39,65
asterisk 561
attribute,discretechoicedesigns 366
augmentnonlineardesigntable 445
AugmentedDesigns 499
addcenterpoints 510,514
addnewrunsandterms 511,518
addingaxialpoints 511,516
description 36

Doptimal 518
extendingexperiments 510
foldover 511,515
modifyDorIoptimalitycriterion 525
replicate 510511
saveddesign(X)matrix 525
specialcommands 525
specifysphereradiusvalue 526
averagevarianceofprediction 493
axial
points 277
scaling,centralcompositedesigns 288

B
BayesianDoptimaldesigns 121
BayesianIoptimaldesigns 123
blocksizes 145
Blockingfactor 87
Borehole Sphere Packing.jmp 412
Bounce Data.jmp 279
Bounce Factors.jmp 279280
BoxBehnkendesigns 277,279,288
SeealsoResponseSurfacedesigns
Byrne Taguchi Factors.jmp 452453

C
Categoricalfactor 87,220,244,386
CCDSeecentralcompositedesigns
centerpoints
augmentdesigns 514,516
centralcompositedesigns 277
responsesurfacedesigns 277
simplexcentroiddesigns 309
centerpolynomials 574
centralcompositedesigns 277,288
Seealsoresponsesurfacedesigns
centroidpoints 315

610

Chakravarty 247
ChemicalKinetics.jmp 431
chemicalmixture,examples 326
choicedesigns
description 35
example 359
purpose 359
choiceset,discretechoicedesigns 366
ClusterFillingdesign
SpaceFillingdesigns
ClusterFilling 407
coding 573579
assigning 577
centerpolynomials 574
example 574
lowandhighvalues 573
ColorMaponCorrelations 470,490
columnproperty
about 559
adding 561
coding 573579
ConstraintState 103,226,391,595
designrole 570572
designroles 570
factorchanges 585
factorsformixtureexperiments 579
mixture 579585
mixtureexperiments 579
responselimits 562569
runsperblock 594
valuelabels 591
valueordering 588591
viewing 561
combinations,disallowing 109
CONAEVmethod 319
confounding 250
pattern 250
resolutionnumbers 246
Constantfactor 88
constraints
adding 315
disallowingcombinations 109
linear 318
constraintstate 595
Continuousfactor 87,220,243,386
Contourmenu 487

Index
Design of Experiments Guide

Contrast 265
controlfactors 449,451
CONVRTmethod 319
coordinateexchangealgorithm 125
Corn.jmp 443
Cotterdesigns 247
countsperunit(powerandsamplesize) 548
covariateexamples 171181
Covariatefactor 88
coveringarray 34
customdesign
aliastermsoutline 96
commands 102
datatables 101
definefactorconstraintsoutline 91
description 33
designevaluationoutline 100
designgenerationoutline 97
designoutline 100
example 6682
factorsoutline 8591,384,510
modeloutline 95
options 102110
responsesoutline 83
splitplot 111
splitsplitplot 112
stripplot 115

D
DEfficiencyWeight 105
defects 548
Defficiency 124,492
definitivescreening
advantages 227
blocking 221
designevaluationoutline 223
designoutline 223,390
designs 33,198
examples 199216
experimentaldata 228
factorsoutline 219
options 225,391
orthogonalblockingoptions 221
outputoptions 224
overview 197
platform 199

Index
Design of Experiments Guide

responsesoutline 217,347
structureofdesigns 227
window 216390
describingmodels 309
design
matrixtableproperties 106
MomentsMatrix 106
resolutions 245
SaveXMatrix 106
DesignDiagnostics 471,491
AEfficiency 493
AverageVarianceofPrediction 493
DEfficiency 492
GEfficiency 492
table 390,401
DesignEvaluation 476
DesignGeneration 252
Designoutline 476
designrolecolumnproperty 570572
DesignSearchTime 104
designs
ABCD 320
aberration 246
augment 510
BayesianDoptimal 121
BayesianIoptimal 123
BoxBehnken 277,279,288
centralcomposite 277
discretechoice 359
foldover 515
fractionalfactorial 245
fullfactorial 233,301
fullfactorials 245
GaussianprocessIMSEoptimalspace
filling 406
Ioptimal 122
Latinhypercubespacefilling
design 396399
maximumentropyspacefilling 404
minimumaberration 246
minimumpotentialspacefilling 402
mixedlevel 247
mixture 305,326
nonlinear 35,431
orthogonal
screeningdesigns 245

611

screeningexperiments 305
surfacedesigns 288
orthogonalarrays 247
PlackettBurman 246
replicating 511512
responsesurface 277
saturated 99
screening 231
simplexcentroid 309
simplexcentroids 309
simplexlattice 312
spacefilling 320,381416
spherepackingspacefilling 393
splitplot 111
splitsplitplot 112
stripplot 115
uniformprecision 288
uniformspacefilling 399
desirability
functions 283,455
maximizing 283
traces 283
values 242
diagnosticsforcustomdesigns 525
Difference to Detect option 532533,537,540
DisallowedCombinations 105,109,526
discretechoicedesigns
analysis 370,374
attribute 366
attributespanel 368
choiceset 366
definition 359
designgenerationpanel 368
dialog 367
example 367368
priorinformation 372
profile 366
survey 366
DiscreteNumericfactor 87,386
DOE
simpleexamples 234
workflow 39,54
workflowexample 40
DOE Sphere Radius 527
Donev Mixture Factors.jmp 164,169
Doptimal

612

Index
Design of Experiments Guide

augmentation 518
designs 120121

E
effect
aliasing 250
eigenvalue 282
eigenvector 282
nonestimable 245
orthogonal 289,449
sparsity 233,247,263
efficiencies
D,G,andA 491
eigenvalueofeffect 282
eigenvectorofeffect 282
errorstandarddeviation 532
EstimationEfficiency 469,487
EvaluateDesign
AliasTerms 476
Crossbutton 475
description 35
DesignCreationTime 493
example 464472
Factorsoutline 475
Interactionsbutton 475
launchwindow 473
lostruns 464
MainEffectsbutton 475
Modeloutline 475
powercalculations 494497
Powersbutton 476
relativepredictionvariancecalculation 497
RSMbutton 475
ScheffeCubicbutton 476
window 473
X,Factor 473
Y,Response 473
excludingfactorcombinations 109
experimentaldesign 39,59
extraparameters 532
extremevertices 314
algorithms 319
findingoptimalsubsets 316
rangeconstraints 316

F
factorchanges 585
factorcombinations,disallowing 109
Factor Profiling option 282,284,300,329,454
factorialdesigns
fractional 245
full 233,245,301
threelevel 247
factors
adding 87,157
categorical 87,220,244,386
continuous 243
controlfactors 449,451
covariate 171
keyfactors 231
mixtureexperiments 579
tables,creating 103,225,356,391
types 87,220,386
falsenegatives 247
FastFlexibleFillingdesigns
SetAverageClusterSize 407
findingoptimalsubsets(extremevertices) 316
fittingmixturedesigns 324
fixedcovariatefactors 171
fixedcovariatesexample 172
foldingthecalculation 325
foldoverdesigns 515
FractionofDesignSpacePlot 468,484
fractionalfactorialdesigns 245
FractionalIncreaseinCILength 487
FullFactorialDesigns 245,293303
description 34
examples 295
functions,desirability 283,455

G
GaussianprocessIMSEoptimaldesign 406
Gefficiency 492
goaltypes 242
matchingtargets 242
minimizingandmaximizing 242
Group New Runs into Separates
Blockoption 514

613

Index
Design of Experiments Guide

H
HalfNormalplot 265,268
hiddenintercepts 325
hyperspheres 104,526

I
identifyingkeyfactors 231
Importancecolumn 102,225,391
importanceofresponses 242,456
IndependentVariables 486
industrialexperimentation 359
innerarrays,innerdesigns 449,451
Inscribe option 289
interactions 247
highorder 246
intercepts,hidden 325
Ioptimal
designs 122123
Ioptimaldesigns 122

J
JMPStarter 31
JSL(JMPScriptingLanguage)
animationscripts 533
augmenteddesigns 505
sphereradius 527

K
Keep the Same 101,224

kSampleMeans(powerandsamplesize) 539

L
L18Chakravarty 247
L18Hunter 247
L18John 247
L36 247
L9Taguchi 452
Labelcolumn 256,291
largerthebetterformulas(LTB) 453
Latinhypercubespacefillingdesign 396399
LenthsPSE 265,275
linearconstraints 103,226,315,318,391
LoadConstraints 103,226,391

LoadFactors 103,225,356,391
LoadResponses 102,225,391
Lock Z Scale 486
LowerLimit 102,225,391

M
maineffectsdesign 129
Make Model 265
matchingtargetgoals 242
matrices
alias 601
model 601
matrix,design 106
maximize
desirability 283,483484
goals 242
responses 242
maximumentropyspacefillingdesign 404
means,oneandtwosample(powerand
samplesize) 531
menutips 30
methods
CONAEV 319
minimize
goals 242
responses 242
minimum
aberrationdesigns 246
potentialdesign 402
mixedleveldesigns 247
mixturecolumnproperty 579585
example 582585
LPseudoComponentCoding 581
LowerLimit 580
PseudoComponentCoding,about 581
SumofTerms 581
UPseudoComponentCoding 581
UpperLimit 580
MixtureDesigns 305332,359
ABCDdesign 320
comparedtoscreeningdesigns 305
definition 305
description 34
examples 163171,326328
tutorialexamples

614

Index
Design of Experiments Guide

mixture designs

326

extremevertices 314
fitting 324
linearconstraints 318
optimal 308
optimalsubsets 316
responsesurfaces 329
SetAverageClusterSize 321
simplexcentroids 309
simplexlattice 312
spacefilling 320
ternaryplots 323
Mixturefactor 88
mixtureofmixtures 168
MixtureSum 105
modelmatrix 601
Modelscript
ModelSpecificationdialog 266,280
models
describing 309
MonteCarlosimulation 263

N
NMonteCarloSpheres(nonlineardesign
option) 446
N Responsesbutton 242
nointerceptmodel 580
noisefactors 449,451
nonestimableeffect 245
nonlineardesign 429447
advancedoptions 445
augmenttable 437,445
createusingpriorparameterestimates 434
creating 442
creatingwithnopriordata 438
description 35
distributionofparameters 439
examples 35,431
fittingtofindpriorparameterestimates 431
introduction 429
launchdialog 434,443
numberofMonteCarlosamples 436
numberofstarts 436
overlayplotofdesignpoints 441
usingpriorparameterestimates 434

NumberofCenterPointsoption 99
NumberofMonteCarloSamples(nonlinear
designoption) 446
NumberofReplicatesoption 99
numberofruns,screeningdesigns 245
NumberofStarts 104,108
numberofstarts 104
NumberofSubplots 120
NumberofWholePlots 120

O
On Faceoption 289

onesampleandtwosamplemeans(power
andsamplesize) 531
onesampleandtwosampleproportion
(powerandsamplesize) 542
onesamplevariance(powerandsample
size) 540
optimalsubsets(mixturedesigns) 316
OptimalityCriterion 104,525
orderofruns 101,224,255,290,302,310,315,320
orthogonalarraydesigns 247,449
orthogonalblockingoptions 221
orthogonaldesigns
screeningdesigns 245
screeningexperiments 305
surfacedesigns 288
Orthogonal option 289
Orthographicprojection 487
outerarrays,outerdesigns 449,451

P
parameters,extra 532
Patterncolumn 236,256,291,303
patterns,confounding 250
performancestatistics 451
PlacketBurmandesigns 256
PlackettBurmandesigns 246
Plastifactors.jmp 326
platformoverviews 33
plots
ActualbyPredicted 269
Scatterplot3D 286
ternary 305,323
points

615

Index
Design of Experiments Guide

axial 277
centerSeecenterpoints
centroid 315
PowerAnalysis 465,477483
calculations 494
categoricaleffect 495
singleparameter 494
powerandsamplesizecalculations 529551
analyses 531
animation 536
countsperunit 548
instatisticaltestsonmeans 541
ksamplemeans 539
onesampleandtwosample
proportions 542
onesamplemean 532533
onesamplevariance 540,543,545
Sigmaqualitylevel 550
twosamplemeans 537
prediction
profilers 160161
traces 282
variances 288
predictionformulas,saving 328
predictionprofiler 282
PredictionVarianceProfile 466,483
PredictionVarianceSurface 485
predictionvariancesurfaceplot 486
PriorParameterVariance 105
profile,discretechoicedesigns 366
profilers
mixtureresponsesurface 329
predictionprofilers 282
predictionVarianceprofiler 160161
proportions(powerandsamplesize) 542
prospectivepowerandsamplesize 529
prospectivepowerandsamplesize
calculations(seepowerandsample
size) 551
pureerror 514

Q
quadraticmodel 150

R
radius,sphere 104,526
randomblockdesigns 110
randomstarts 108
randomizationrestrictions 110
examples 181
RandomizewithinBlocks 101,224
randomizingruns 101,224
rangeconstraints 314
ReactionKineticsStart.jmp 438439
ReactionKinetics.jmp 440
Reactor 8 Runs.jmp 501
Reactor Factors.jmp 295296
Reactor Response.jmp 295
regressorcolumns 248
relativepredictionvariance 483,497
relativeproportionsSeemixturedesigns
RelativeStdErrorofEstimate 488
relativevarianceofprediction 483
replicating
designs 512
replicatingdesigns 511
requestingadditionalruns 99,255,290,302
rescalingdesigns 289
resolutionnumbers 246
Resolutionslider 486
resolutionsofdesigns 245
ResponseGoal 102,225,391
ResponseGridSlider 486
responselimits 562569
Desirability 563
editing 567
example 564567
Goal 563
Importance 563
Showasgraphreferencelines 563
Value 563
ResponseSurfaceDesigns 277291
description 34
examples 150,279285
introduction 286
purpose 277
reports 281
withcategoricalfactors 156
responsesurfaceeffects 325
ResponseSurfaceMethodology(RSM) 286

616

responsesurfaces
mixturedesigns 329
responses
customdesigns 242,287
desirabilityvalues 242
goals 242
goals,desirabilityfunctions 283
lowerlimits 242
upperlimits 242
RMSE 269,299
robustdesign 178
robustengineering 449
roles,design 570
Rotatableoption 289
RSM(ResponseSurfaceMethodology) 286
Run Model 265
RunOrder 101,224
runs
additional 99,255,290,302
ordertheyappearintable 101,224,255,290,
302,310,315,320
requestingadditional 99,255,290,302
screeningdesigns 245
runsperblock 594

S
samplemeans(powerandsamplesize) 531
samplesizeandpower 36
samplesizes
examplecomparingsingledirection
onesamplevariances 540,543
examplewithcountsperunit 548
oneandtwosamplemeans 533
prospectivepoweranalysis 540
screeningdesigns 293
saturateddesigns 99
SaveConstraints 103,226,356,391
SaveFactors 103,225,356,391
SaveResponses 102,225,391
SaveScripttoScriptWindow 105,227,392
SaveXMatrix 104,106
saving
predictionformulas 328
XMatrix 525
scaling
axial 288

Index
Design of Experiments Guide

designs 289
Scatterplot3D
BoxBehnkendesigns 286
Scheffpolynomial 324
screening
examples 129
standarddesigns 197
screeningdesign
about 231
ChooseScreeningType 244
description 34
DesignGeneration 252
designtypes 245
dialogs 237,256
examples 237290
NearOrthogonaldesigns 252
NumberofColumnStarts 253
NumberofStarts 253
scripts
animation 533
generatingtheanalysismodel 266,280
ModelscriptSeeModeltableproperty
scriptingSeeJSL
SetAverageClusterSize 321,407
SetDeltaforPower 105,227,493
SetRandomSeed 103,226,391
sigmaqualitylevel(powerandsample
size) 550
signalfactors 449
signaltonoiseratios 449
SignificanceLevel 478
simplex 305
centroiddesigns 309
latticedesigns 312
SimulateResponses 103,226,392
singlesamplemeans(powerandsample
size) 533
Sort Left to Rightoptions 101,224
Sort Right to Leftoption 101,224
SpaceFillingdesigns 381416
boreholeproblem,spherepacking
example 411
description 35
GaussianprocessIMSEoptimal 406
Latinhypercube 396399
maximumentropy 404

617

Index
Design of Experiments Guide

minimumpotential 402
SetAverageClusterSize 407
spherepacking 379,393
uniform 399
SpaceFillingMixturedesigns 320323
SetAverageClusterSize 321
sparsity,effect 233,247
spherepackingdesign 379,393
sphereradius 104,526
SphereRadiusoption 104
splitplotdesigns 111
SplitPlotVarianceRatio 105,493
splitplot
designs 111
example 181
splitsplitplotdesigns 112
starpoints 277
starts,numberof 104
starts,random 108
statistics,performance 451
stripplotdesigns 115
subsets,findingoptimal 316
supersaturateddesigns 138163
surfacedesignsSeeresponsesurfacedesigns
survey,discretechoicedesigns 366

T
tables
factorstable,creating 103,225,356,391
makingincustomdesigns 101
taguchiarrays
description 35
Taguchidesigns 449455
description 449
methods 449
targetvalues 84,218,243,384
Term 479
ternaryplots 305,323
threedimensionalscatterplot
BoxBehnkendesigns 286
tooltips 30
traces,desirability 283
tradeoffinscreeningdesigns 245
tutorialexamples
augmentdesigns 501510
DOE 234

fullfactorialdesigns 295
mixturedesigns 326328
responsesurfacedesigns 279,284285
screeningdesigns 237
tutorials 29
twofactorinteractions 132137
twolevelfractionalfactorials 245
twolevelfullfactorials 245
twosampleandonesamplemeans 537
twosamplemeans(powerandsample
size) 531
twosampleproportion(powerandsample
size) 542
twowaysplitplot
designs 115
example 186

U
Uncontrolledfactor 88
Uniform(spacefillingdesign) 399
uniformprecisiondesigns 288
UpperLimit 102,225,391
User Definedoption 289

V
valuelabels 591
valueordering 588591
values
target 84,218,384
varianceofprediction 289
vertices
extreme 314,316

W-Z
weight,importanceofresponse 242,456
Weld-Repaired Castings.jmp 271
wholemodeltest 325
XMatrix,saving 106,525
XVERTmethod 319

618

Index
Design of Experiments Guide

You might also like