h lng

nh l Nghin
N hi C
Cu Khoa
Kh H Hc
Hong Trang
hoangtrang@hcmut.edu.vn
h @h d
mr.hoangtrang@gmail.com

1 2012
 Mc tiu ng lc

1. Chia s thng tin, trao i thm

-> gp 1 phn
vo s pht trin
hn na ca
b mn, khoa, nh trng

2. T cc bui trao i vi cc ng nghip, t kinh

nghim bn thn

Hong Trang 2012 2

 Ni dung

1. Nghin cu khoa hc
2. Cc ch s
3. Ch s trch dn c im bnh lun
4 Ch s nh hng IF c im bnh lun
4.
5. Ch s H c im bnh lun
6 Kt lun
6. l

Hong Trang 2012 3

 Ti liu tham kho chnh
1. Robert Adler, John Ewing, Peter Taylor, Citation Statistics, Joint Committee on
Quantitative Assessment of Research, June 2008
2. nh gi nh lng kt qu nghin cu khoa hc, H T Bo, Trng Khoa hc Tri
thc, Vin Khoa hc v Cng ngh Tin tin Nht Bn
3. Kulkarni A.V et al, Comparisons of Citations in Web of Science, Scopus, and Google
Scholar for Articles Published in General Medical Journals
Journals , The Journal of the American
Medical Association.
4. Althouse B.M et al Differences in Impact Factor Across Fields and Over Time,
Journal of the American Society for Information Science and Technology, 2008
5 Eugene
5. E Garfield,
G fi ld Th
The A
Agony and
d th
the E
Ecstasy-
t Th History
The Hi t anddMMeaning
i off th
the
Journal Impact Factor, Chairman Emeritus, Thomson ISI (International Congress on
Peer Review And Biomedical Publication Chicago, September 16, 2005)
6. Cc b
6 bi trnh by ca GS
GS.Nguyn
guy Vn Tun:
u hi ngh
g ti
TP.HCM,
C , 2010
0 0 do WB2 ti

tr, cc trnh by ti HQG TP.HCM, website: nguyenvantuan.net
7. http://isiwebofknowledge.com, http://wokinfo.com/about/whoweare/
8. Google
g scholar http://scholar.google.com/
p g g

Hong Trang 2012 4

 Nghin Cu Khoa Hc?
1. Nghin cu c bn: tm tri thc Sn phm: ch
khoa hc nn tng yu:
n phm
h
V d: cng trnh ca GS Ng Bo Chu
khoa hc:
2. Nghin cu ng dng: tm tri thc cc bi bo
bo, bo
khoa hc mi, cn cho nhu cu thc co k thut, gio
tin trnh, bng sng
V d: cch o nhit trong mi trng c
ch,

hi (t trng cao, phng x), cch xem xt
ung th tuyn tin lit m khng cn sinh
thit
thit,

3. Nghin cu pht trin: tm tri thc Sn phm: nm

mi to ra cc sn phm c th trong sn phm
V d: Iphone4,. ca doanh
Hong Trang 2012 nghip, 5
 Nghin Cu Khoa Hc?
3. Nghin cu pht trin: tm tri thc Sn phm: nm
mi to ra cc sn phm c th trong sn phm
V d: Iphone4,.
ca doanh
nghip,
g p,

nh lng, nh gi?
S quan tm ca ngi tiu dng,
Bng sng ch
ch, s hu tr tu
Doanh thu,
..

Hong Trang 2012 6

 Nghin Cu Khoa Hc?
1. Nghin cu c bn: tm tri thc Sn phm: ch
khoa hc nn tng yu: n phm
2. Nghin cu ng dng: tm tri thc khoa hc: cc bi
khoa hc mi
mi, cn cho nhu cu thc bo, bo co k
tin thut, gio trnh,
bng sng ch

nh gi????

Hong Trang 2012 7

 nh g
gi 1 nghin
g cu khoa hc?
Qua n phm khoa hc

1. nh gi qua s lng
2. nh gi qua cht lng:
+ nh gi nh tnh: peer review
nh lng Nghin Cu Khoa Hc
=> u: phn tch su
Nhc: tn thi gian, ch quan (ph thuc
vo hiu bit ca reviewer)
+ nh gi nh lng:
=> nhanh chng,
chng khch quan hn
vn cn sai st!
Hong Trang 2012 8
Cc cch o (metrics)

+ Ch s trch dn (citation index)

+ Ch s nh hng (impact factor)
+ Ch s H (H
(H-index)
index)

.
+ Ch s
G (G-index)
+ Ch s ring (eigen value)
..

Hong Trang 2012 9

 Cch o: o cho ai/ci g? & o g?

+ Ch s trch dn (citation index)

+ Ch s nh hng (impact factor) + 1 n phm khoa hc

+ Ch s H (H-index) + 1 tp ch
.
+ Ch s G (G-index) + 1 tc gi

+ Ch s ring (eigen value)

..

Hong Trang 2012 10

Bt u vi ch s no?

+ Ch s trch dn (citation index)

+ Ch s nh hng (impact factor)

+ Ch s H (H-index)
Ch s
.
trch dn (citation index)
+ Ch s G (G-index)

+ Ch s ring (eigen value)

..

Hong Trang 2012 11

 Ch s
ttrch
h dn-
d phn
h t
tch
h
nh ngha: Phn tch ch s trch dn (Citation Analysis)
-> tn
t khc
kh C
Counting
ti citation
it ti qu
ttrnh
h xem xt
t
nh
hhhng/
/
cht lng ca 1 n phm (publication) bng cch M s
ln m cc tc g
gi (n
( p phm khc)) cp. p

Lch s: do Eugene Garfield xut nm 1955

Dng nh gi hu x t nhin hng

Source: google scholar http://scholar.google.com/

Hong Trang 2012 12
 Ch s
ttrch
h dn-
d lu
l
1. Lu 1: ch c tnh cht trong tng ngnh khoa hc

Source: Robert Adler, John Ewing, Peter Taylor, Citation Statistics, Joint Committee on
QuantitativeHong
Assessment
Trang of Research, June2012
2008 13
 Ch s
ttrch
h dn-
d lu
l

1 Lu 1: ch c tnh cht trong tng ngnh khoa hc

1.

Ti sao?
d c
do im
i tng
t ngnh h ring
i bit
bit:
V d:
+ Computer: do nhiu ngi nghin cu (-> nhiu n
phm khoa hc), tham kho: m khng cng b
+ c ngnh c nh hng nhiu nm sau , hoc ch
trong 1 thi gian ngn
+ .

=> So snh trong cng 1 ngnh

Hong Trang 2012 14

 Ch s trch dn
dn- Lu : tnh ton ??
Lu 2: Ch s trch dn: cng 1 n phm khoa hc
-> ch s trch dn khc nhau
Q: Ti
sao?
=> A: Lm sao tnh ton?
m: d ? => !???

+ Da
D t cc
trn c s
d liu
li kh
khc nhau:
h
Web of Science (ISI) / Scopus / Google Scholar /
PubMed / MathSciNet / EBSCO databases / ScienceDirect /
U.S. Patent and Trademark Office Databases
Hong Trang 2012 15
 Ch s trch dn- C s d liu:
ISI (Web of Science)
1. Web of Science (ISI)
+SCI (Science Citation Index): t 1964,
1964 3773 tp ch ca 100
ngnh; SCIE (SCI m rng, Science Citation Index
Expanded) vi 8060 tp ch chnh ca 173 ngnh.
+SSCI (Social Sciences Citation Index): t 1973,
1973 hin c 2697
tp ch v 3500 cng trnh ca 55 ngnh;
+A&HCI (Arts & Humanities Citation Inde): t 1978, hin c
1470 tp ch v 6000 cng trnh khc.
+ CPCI (Conference Proceedings Citation Index): 110,000
tuyn tp 256 ngnh khoa hc t nhin, x hi nhn vn
+ Index Chemicus:> 2.6 triu compounds (to 1993).
+ Current Chemical Reactions:> 1 triu reactions
+ Chuyn ln mng (1997): Web of Science,
Science Web of Knowledge
Source: nh gi nh lng kt qu nghin cu khoa hc, H T Bo, Trng Khoa hc Tri thc, Vin Khoa
hc v Cng ngh Tin tin Nht Bn (c chnh sa, cp nht)
http://isiwebofknowledge.com,
Hong Trang http://wokinfo.com/about/whoweare/ 16
2012
Ch s trch dn-
dn C s d liu:
Scopus
2. Scopus
p
2.1 + Gn 18,000 titles t hn 5,000 nh xut bn quc t:
. 16,500 peer-reviewed journals ( > 1,200 Open Access journals)
. 600 n phm ngh nghip (trade publications)
. 350 lot sch chuyn kho (book series)
. 3.6 triu bi bo hi ngh
+ 40 triu records

2.2. Cho kt qu, c xem xt:

+ 435 triu scientific web pages
+ 23 triu patents t 5 patent offices (US Patent and Trademark Office,
Office
European Patent Office, Japan Patent Office, World Intellectual Property
Organization and UK Intellectual Property Office)
+ "Articles-in-Press"
Articles in Press t hn 3,000
3 000 journals.
journals

http://www.info.sciverse.com/scopus/about
Hong Trang 2012 17
Ch s trch dn-
dn C s d liu:
Google Scholar
3. Google
g Scholar
http://scholar.google.com
Khng thy cng b c s d liu

ch
quan: rt
nhiu,
nhiu
hn Web off S
Science, S
Scopus

http://scholar.google.com
Hong Trang 2012 18
 Ch s trch dn- s khc nhau do C s d
liu- lu 2
2. Ch s trch dn: cng 1 n phm khoa hc
->
> ch s trch dn khc nhau
V d: source *
Objective To compare the citation count profiles of articles published in general medical journals
among the citation databases of Web of Science, Scopus, and Google Scholar.
Design Cohort study of 328 articles published in JAMA, Lancet, or the New England Journal of
Medicine between October 1, 1999, and March 31, 2000. Total citation counts for each article up to
June 2008 were retrieved from Web of Science, Scopus, and Google Scholar
T Web of Science: 68.088
68 088 trch dn
dn, T Scopus: 82.076
82 076 trch dn
T Google Scholar: 83.538 trch dn (gp 1,23 ln so vi Web of
Science).
Conclusion Web of Science, Scopus, and Google Scholar
produced quantitatively and qualitatively different citation counts
for articles p
published in 3 g
general medical jjournals.
* Kulkarni A.V et al, Comparisons of Citations in Web of Science, Scopus, and Google Scholar
for Articles Published in General Medical Journals, The Journal of the American Medical
Association. Hong Trang 2012 19
 Ch s trch dn
dn- tng kt c im
1. So snh: ch trong cng 1 ngnh
2 Khc nhau khi dng cc c s d liu khc nhau
2.
3. Khng phn bit c self citation (t trch dn)
4. Khng phn bit c tng tc gi khc nhau (do trng tn,
h
h,.).
) V d:
d L Vn
V TTun,
L Vn
V Tun,
T L Vn V TTun,

. Do nh dng h& tn: Hoang Trang, Trang Hoang

V d
d t bn
b thn:
th
http://delab.csd.auth.gr: khng tm ra citation ca 1 bi v M2M
http://scholar.google.com:
p g g tm ra citation ca 1 bi v M2M

Hong Trang 2012 20

 Ch s nh hng (impact factor IF)
=> nh gi tp ch
IF ca
1 ttp ch
h trong
t nm
N:
N IF = A/B
A: tng s trch dn trong nm N n bi ca tp ch trong hai
nm ngay trc N. N
B: tng s cc bi ng trn tp ch trong hai nm ngay trc
N.
V d:
IF2010_tp ch ABC= (s trch dn trong nm 2010 n cc bi
trong tp ch ABC trong 2008, 2009) / (tng s bi trong tp ch
ABC trong 2 nm 2008, 2009) = 2 (v d)
=> Trung bnh, 1 bi trong nm 2008, 2009 c trch dn 2 ln
trong nm 2010.
2010

Source: http://thomsonreuters.com/products_services/science/free/essays/impact_factor/
Hong Trang 2012 21
IF phn tch
IF-

Phn t
Ph tch:
h xem thm
th ttrong
Althouse B.M et al Differences in Impact Factor Across Fields and
Over Time,, Journal of the American Societyy for Information
Science and Technology, 2008

Eugene Garfield,
Garfield The
The Agony and the Ecstasy- The History
and Meaning of the Journal Impact Factor, Chairman
Emeritus, Thomson ISI (International Congress on Peer Review
A d Bi
And Biomedical
di l P
Publication
bli ti ChiChicago, S
September
t b 16 16, 2005)

Kumar M.J, Evaluatingg Scientits: Citations, Impact

p Factor, h-
Index, Online Hits and What Else?, IETI Technical Review, 2009.

Hong Trang 2012 22

IF phn tch
IF-
+ Mang nhng c im ca Citation index
+ Khc nhau g
gia cc nm

Althouse B.M et al Differences in Impact Factor Across Fields and Over Time,
Journal of the American Society for Information Science and Technology, 2008
Hong Trang 2012 23
IF phn tch
IF-
+ Gi tr trung bnh v nh hng ca cc bi trong tp ch (*)
Theo th t trch dn:
15% bi u gp 50% s trch dn,

50% bi u gp 90% s trch dn,
cc bi nhm 50% ng g u c trch dn khong g 10 ln hn
cc bi nhm 50% cui.
=> Suy ngh: bi bo trong tp ch uy tn (IF ln): cha chc phi
l cht lng tt
+ IF trong 2 nm sau cng b: ngn v sm i vi mt s ngnh
JCR thm IF tnh trong 5 nm (**)
+ Khng tnh bi c dng nhng khng ghi r, hoc khng xut
hin (***)
(*) nh gi nh lng kt qu nghin cu khoa hc, H T Bo, Trng Khoa hc Tri thc
Vin Khoa hc v Cng ngh Tin tin Nht Bn
(**) http://thomsonreuters.com/products_services/science/free/essays/impact_factor/
(***) Kumar M.J, Evaluating Scientits: Citations, Impact Factor, h-Index, Online Hits and What
Else?, IETI Technical Review, 2009.
Hong Trang 2012 24
IF phn tch
IF-
+ Khc nhau trong tng ngnh

Althouse B.M et al Differences in Impact Factor Across Fields and Over Time, Journal of
the American Society for Information Science and Technology, 2008
Hong Trang 2012 25
 kin v IF (*): Philip
Phili Campbell,
C b ll Edit
Editor-in-chief
i hi f off Nature
N t
+ Natures IF for 2004 was 32,2 89% of our impact factor
generated
t d by
b jjustt 25% off our papers.
+ I am concerned by the tendency within academic administrations
to focus on a journals impact factor when judging the worth of
scientific contributions by researchers, affecting promotions,
recruitment and, in some countries, financial bonuses for each
paper
paper.
+ Although the current system may be effective at measuring
merit on national and institutional scales, the most effective
f i analysis
fair l i off a persons
contribution
t ib ti d derives
i ffrom a di
directt
assessment of individual papers, regardless of where they
were published.
Escape from the Impact Factor, Ethics in Science & Env. Politics, 8, 5-7, 2008)
(*) nh gi nh lng kt qu nghin cu khoa hc, H T Bo, Trng Khoa hc Tri thc
Vin Khoa hcHong
v Cng ngh Tin tin Nht Bn
Trang 2012 26
 Ch s H (H
(H-index)
index)
2005: Jorge Hirsch (Univ. of California at San Diego) ngh
h i d (*)
h-index

Nhiu cch din t nh ngha khc nhau

+ Mt ngi c H-index l N nu c N bi bo vi ch s trch dn
t nht l N.

=> Cn bng s lng v cht lng

Mang
M nhng
h c
i
im ca
citation
it ti iindex
d

(*): Kumar M.J, Evaluating Scientits: Citations, Impact Factor, h-Index, Online Hits and What
Else?, IETI Technical Review, 2009
Hong Trang 2012 27
 Ch s H (H
(H-index)
index) c im
+ Dng so snh cng 1 ngnh

+ Khng phn bit c cng sc khc nhau ca cc tc gi

trong cng mt cng trnh (=> th t tc gi? : nh th no?:
khng nht thng: thng khong 2-3 kiu khc nhau, ty theo
vn ha)

+ Khng phn bit c l do trch dn:

. Th hin s knh trng tc gi
. Ni v
phng
h php
h lin
li quan
. Cung cp kin thc c bn
. Trch dn ph phn

Hong Trang 2012 28

 Ch s H (H
(H-index)
index) c im
+ Cc nh khoa hc xut sc: H-index cha hn l cao
(GS Ng
N B
Bo Ch
Chu: HH-index:
i d 6 ?!? ((source: H T Bo)
B )
Gii Nobel: H-index: 35-40 (*)

+ Tnh ton: kh cng phu do vn trng tn.

V d: bn thn: key word Hoang

Hoang Trang:
Trang : hn 140 cng trnh c
trng tn
=> lc

(*): Kumar M.J, Evaluating Scientits: Citations, Impact Factor, h-Index, Online Hits and What
Else?, IETI Technical Review, 2009
Hong Trang 2012 29
 Ch s H (H
(H-index)
index) c im
+ Tnh ton: kh cng phu do vn trng tn.
V d: bn thn: key word Hoang
Hoang Trang
Trang:: hn 140 cng trnh c
trng tn => lc
Phn tch, trao i t bn thn ngi trnh by
http://delab csd auth gr: khng tm ra 2 citation
http://delab.csd.auth.gr:
Google scholar: tm y hn
Cites
7

6 6

4 4
Cites
3 3

2 2

1 1 1 1 1

0 0 0 0 0 0 0 0
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Hong Trang 2012 30

 Cc ch s khc
+ H-index: da trn citation => khuyt im

TRANH LUN
+ Normalized H-index: H-index: thng tng theo thi gian
=> normalized H
H-index
index (m index): H/s nm
+ Standarized H-index: cc ngnh: khc nhau
Ngnh khoa hc Hsiuchnhchung
Vt l
Vtl 1
Nngnghip 1.27
Sinhhcvsinhha 0.6
Hahc 0.92
Y hc
Yhc 0 76
0.76
Khoahcmytnh 1.75
Kinht 1.32
Kthut 1.7
Khoa hc vt liu
Khoahcvtliu 1 36
1.36
Tonhc 1.83
Tmthnvtmlhc 0.88
Khoa hc x hi 1.6
Hong Trang 2012 31
 Kt lun
1. Khch q
quan: nh
lng:
g cn cha chnh
xc
->
> nhanh
Khi cn thm: p
peer review
2. Khi nh gi, so snh,: cn cn thn
3. Xem xt trong cc nh gi, khen thng:
=> chnh sch!

Hong Trang 2012 32