Sigma Vibracoustic (I) Pvt. Ltd.

GAUGE LINEARITY STUDY

Gauge No: C-7106
PARTS: 5
PARTS: 5
DIM. SPECIFICATION
1
2
3
4
5
6
7
8
9
10
11
12
REFERENCE VALUE
GAGE N0:
No of Parts: g=5
Observations :- m=12
PARTS
REFERENCE VALUE(X)
1
2
3
4
5
6
7
8
9
10
11
12

Master Gage Description

GAGE RANGE:0-600 mm
CHECKED BY
Date:- 08/01/07

3D CMM
Gage L.C. 0.0001 mm
SHIV SINGH

104-0.2

720.4

50.40.1

250.2

12.20.15

103.890
103.890
103.880
103.885
103.880
103.890
103.890
103.890
103.890
103.890
103.890
103.890

72.350
72.350
72.340
72.340
72.340
72.340
72.350
72.350
72.350
72.350
72.350
72.350

50.417
50.418
50.420
50.420
50.420
50.419
50.419
50.419
50.418
50.418
50.417
50.419

23.880
23.880
23.880
23.890
23.880
23.880
23.880
23.880
23.890
23.890
23.890
23.890

12.300
12.290
12.280
12.280
12.280
12.300
12.290
12.290
12.280
12.280
12.290
12.280

103.888

72.347

50.419

23.884

12.287

Description of Gauge Under Study VERNIER CALLIPER(VC-SP-05)

GAGE RANGE:0-200 mm
Gage L.C. 0.01 mm
CHECKED BY
SHIV SINGH
Date:1
2
3
4
5
103.888
72.347
50.419
23.884
12.287
103.88
72.35
50.42
23.89
12.29
103.89
72.34
50.42
23.87
12.29
103.87
72.35
50.41
23.89
12.29
103.88
72.35
50.42
23.87
12.28
103.89
72.35
50.41
23.87
12.28
103.89
72.36
50.41
23.87
12.29
103.87
72.34
50.42
23.87
12.29
103.89
72.34
50.41
23.88
12.28
103.90
72.35
50.42
23.89
12.29
103.89
72.35
50.42
23.88
12.27
103.89
72.35
50.42
23.88
12.29
103.87
72.35
50.42
23.89
12.28

PART AVERAGE
BIAS(Y)
RANGE

103.88
-0.004
0.030

72.35
0.002
0.020

50.417
-0.002
0.010

23.88
-0.005
0.020

12.29
-0.002
0.020

Bias Average ( y )

-0.0018

-0.0009

-0.0004

0.0003

0.0006

Sigma Vibracoustic (I) Pvt. Ltd.

GAUGE LINEARITY STUDY

SUM (S)
x
y
x*y
x*x
y*y
(xi-x)
(xi-x)
y/n

103.888

72.347

50.419

23.884

12.287

262.824

-0.004

0.002

-0.002

-0.005

-0.002

-0.011

-0.398

0.121

-0.101

-0.119

-0.020

-0.518

10792.699

5234.040

2542.042

570.453

150.962

19290.197
0.0000

0.0000

0.0000

0.00000

0.0000

0.00000

51.323

19.7819

-2.14615

-28.6807

-40.27815

2634.0606

391.3216

4.60596

822.5797

1622.32937

5474.897

-0.001

0.000

0.000

-0.001

-0.0003

-0.002

-0.0009

-0.0004

0.0003

0.0006

-0.0022

-0.000026

0.0009

BIAS ( y )

-0.0018

For a given x0, the a level confidence bands are

Where s =

0.000889

The values of lower and upper band at given x0 values are as follows
At x0 = 103.888 Lower Band
At x0 = 72.347 Lower Band
At x0 = 50.419 Lower Band
At x0 = 23.884 Lower Band
At x0 = 12.287 Lower Band

-0.00302
-0.00148
-0.00061
-0.00042
-0.00038

Upper Band
Upper Band
Upper Band
Upper Band
Upper Band

-0.00051
-0.00042
-0.00014
0.00104
0.00161

Acceptance criteria for linearity

For linearity to be acceptable the following hypothesis Should be true:
H0 : a=0, slope=0 do not reject if
t=
t

-2.160
2.160

For linearity to be acceptable the following hypothesis should be true:

H0 : b=0, slope=0 do not reject if
t=
t

1.450
1.450

Putting the values ta and tb both are less than tgm - 2, 1-a/2 that is 2.00172
Since both the hypothesis are true, Linearity is acceptable
Result: Instrument is acceptable.

(y/n)/n

52.565

0.000

Sigma Vibracoustic (I) Pvt. Ltd.

GAUGE LINEARITY STUDY

Reference value
103.888
72.347
50.419
23.884
12.287

Lower Band
-0.00302
-0.00148
-0.00061
-0.00042
-0.00038

Bias
-0.0018
-0.0009
-0.0004
0.0003
0.0006

Upper Band
-0.0005
-0.0004
-0.0001
0.0010
0.0016

GAUGE LINEARITY
0.00200
0.00100

Bias

0.00000
103.888

72.347

50.419

-0.00100

23.884

12.287

Lower Band
Bias

Upper Band

-0.00200
-0.00300
-0.00400
Ref. Value

Sigma Vibracoustic (I) Pvt. Ltd.

GAUGE LINEARITY STUDY

Formula Used
1
Bias (y) = Part Average Value - Reference Value
2 Bias Average (y) = ax+b
Sxy-((1/gm)*SxSy)
3
a=
Sx-((1/gm)*(Sx))
4

b = y - ax

s = SQRT ((Sy-bSy-aSxy)/(gm-2))

6
7

Lower Band = ((b+axo) - tgm-2,1 - a/2 * (SQRT(1/gm+(xo - x)/S(xi - x))*s)

Upper Band = ((b+axo) + tgm-2,1 - a/2 * (SQRT(1/gm+(xo - x)/S(xi - x))*s)

t at 'a' or ta =

t at 'b' or tb =

10

a
SQRT ( s / S(xi - x))
b
( SQRT (1/gm) + x / S (xi - x) )*s

tgm - 2, 1 - a / 2 ] = Taking the default a=.05 and gm-2=58 degree of freedom

and a proportion of 0.975, the value of tgm-2, 1 - a / 2 comes
out to be :
t58, 0.975 = 2.00172