人文社會學者學術評鑑指標之探討

Performance Indicators for Evaluation of Humanities and Social Sciences Researchers

10.6182/jlis.2006.4(1.2).017

黃慕萱(Mu-Hsuan Huang)；張郁蔚(Yu-Wei Chang)

學術評鑑 ； 人文社會科學 ； 書目計量 ； 專家評鑑 ； 學術評鑑指標 ； Research Evaluation ； Humanities and Social Science, Bibliometrics ； Peer Review ； Research Indicators

圖書資訊學刊

4卷1&2期（2006 / 12 / 01）

17 - 47

繁體中文

本文的主要目的在研究人文社會學者之學術評鑑指標，探討各種學術評鑑指標之意義及其在人文社會學者學術評鑑之適用性，並提出對人文社會學者學術評鑑方法與指標上之建議。本文首先分析同儕評鑑方法用於人文社會學科之適用性，並指出書目計量分析運用於人文社會學科之客觀性與適用性。其次分析人文社會學科使用之學術評鑑指標，並針對出版品之評鑑方法進行討論，最後提出對人文社會學者學術評鑑方法與指標上之建議。為符合人文社會學科出版品多元的特性，本文提出以出版品分類之做法，破除所有出版品等值之觀念，並建議以期刊排序破除所有期刊均同等重要之假設，強調同一種類之出版品亦存有品質差異之事實。另在人文社會科學具有區域性研究之特性下，國際性之發表亦應受到鼓勵，才能讓研究成果有更大的影響力。

This article discusses the performance indicators for the evaluation of humanities and social sciences (H&SS) researchers. First, this article discusses the use and the problems of peer review methods in evaluating H&SS research and argues that bibliometric methods are both an objective and appropriate methodology for the evaluation. Second, it reviews and compares existing research evaluation indicators and discusses the characteristics of H&SS research which an ideal set of indicators should address, in particular, the diverse publication types in H&SS research output. The authors argue for the need to assign different weightings to different types of publications in order to counterbalance the bias embedded in previous bibliometric measures which assumes all publications are of equal importance. Likewise, it argues that journal ranking can be used to differentiate journals of different levels of importance for each specific field in order to correct the previously flawed assumption that all journals are equally important. This article concludes that H&SS research evaluation requires indicators different from natural science research evaluation and that, although H&SS research often focuses on regional issues, indicators can be designed to encourage the internationalization of the local H&SS research in order to enhance its global visibility and impact.

1. 黃慕萱、張郁蔚(2005)。從研究產出探討人文社會學者學術評鑑之特性。圖書資訊學刊，2(3/4)，1-19。
   連結：
2. Research performance criteria for promotion to senior lecturer
3. Research assessment exercise 1999 guidance notes
4. Peer evaluation
5. A guide to the 2001 research assessment exercise
6. Aksnes, Dag W,Taxt, Randi Elisabeth.(2004).Peer reviews and bibliometric indicators: A comparative study at a Norwegian university.Research Evaluation,13(1),33-41.
7. Andersen, Heine.(2000).Influence and reputation in the social sciences: how much do researchers agree?.Journal of Documentation,56(6),674-692.
8. Archambault, E.,Vignola-Gange, E.,Cote. G.,Lariviere, V.,Gingras, Y.(2006).Benchmarking scientific output in the social sciences and humanities: the limits of existing databases.Scientometrics,68(3),329-342.
9. The use of bibliometircs in the social sciences and humanities
10. Assessing research performance: implication for selection and motivation
11. Bannister, Barry.(1991).Valuing academic research towards a policy for Hong Kong future universities.Assessment & Evaluation in Higher Education,16(3),215-224.
12. Bourke, P.,Bulter, Linda.(1996).Publication types, citation rates and evaluation.Scientometrics,37(3),473-494.
13. Carotenuto, Gianfranco,Lapegna, Mariagloria, Zollo,Giuseppe, Donato, Alberto Di,Nicholais, Luigi.(2001).Evaluating research performance: the strategy of the university of Naples Federico II.Higher Education Policy,14,75-90.
14. Chung, Yeon-Kyoung.(1995).Characteristics of references in international classification systems literature.Library Quarterly,65(2),200-215.
15. Colman, A. M.,Dhillon, Debra,Coulthard, B.(1995).A bibliometric evaluation of the research performance of British university politics departments: publications in leading journals.Scientometrics,32(1),49-66.
16. Cronin, Blaise,Snyder, Herbert.(1997).Comparative citation rankings of authors in monographic and journal literature: a study of sociology.Journal of Documentation,53(3),263-270.
17. Daniel, H.-D.,Fisch, R.(1990).Research performance evaluation in the German university sector.Scientometrics,19(5/6),349-361.
18. Elkin, Judith.(2002).The UK research assessment exercise 2001.Libri,52,204-208.
19. Finkenstaedt, T.(1990).Measuring research performance in the humanities.Scientometrics,19(5/6),409-417.
20. Fletcher, J.(1972).A view of the literature of economics.Journal of Documentation,28(4),283-295.
21. French, Nigel J.,Massy, William F.,Young, Kenneth.(2001).Research assessment in Hong Kong.Higher Education,42,35-46.
22. Garfield, Eugene,Welljams-Dorof, Alfred.(1992).Of Nobel class: part 2. forecasting Nobel prizes using citation data and the odds against it.Current Comments,35,127-136.
23. Garfield, Eugene,Welljams-Dorof, Alfred.(1992).Of Nobel class: part 1. an overview of ISI studies on highly cited authors and Nobel laureates.Current Comments,33,116-126.
24. Glanzel, Wolfgang,Schoepflin , Urs.(1999).A bibliometric study of reference literature in the sciences and social sciences.Information Processing and Management,35,31-44.
25. Harris, G. T.(1988).Research output in Australian university economics department, 1974-83.Australian Economic Papers,27(50),102-110.
26. Harris, G. T.(1990).Research output in Australian university economics departments : update for 1984-88.Australian Economic Papers,29(55),249-259.
27. Hicks, Diana.(1999).The difficulty of achieving full coverage of international social science literature and the bibliometric consequences.Scientometrics,44(2),193-215.
28. Ho, Kwok Keung.(1998).Research output among the three faculties of business, education, humanities & social sciences in six Hong Kong universities.Higher Education,36,195-208.
29. Hodges, Sally,Hodges, B.,Meadows, A.J.,Beaulieu , Micheline,Law, D.(1996).The use of an algorithmic approach for the assessment of research quality.Scientometrics,35(1),3-13.
30. Ingwersen, P.(2000).The international visibility and citation impact of Scandinavian research articles in selected social science fields the decay of a myth.Scientometrics,49(1),39-61.
31. Jauch, Lawrence R.,Glueck, William F.(1975).Evaluation of university professors' research performance.Management Science,22(1),66-75.
32. Florida State University Law Review
33. Larviere,V.,Archambault, E.,Gingras, Y.,Vignola-Gagne, E.(2006).The place of serials in referencing practices: comparing natural sciences and engineering with social sciences and humanities.Journal of the American Society for Information Science and Technology,57(8),997-1004.
34. Liner, Gaines H.,Amin, Minesh.(2004).Methods of ranking economic journals.Atlantic Economic Journal,32(2),140-149.
35. Towards indicators of research performance in the social sciences and humanities: an exploratory study in the fields of law and linguistics at Flemish universities
36. Macharzina, Klaus,Oesterle, Michael-J.(1994).International comparative evaluation of North-American and German research output in business and management.Management Internal Review,34,255-265.
37. Makino, Junichiro.(1998).Productivity of research groups: relation between citation analysis and reputation within research communities.Scientometrics,43(1),87-93.
38. Martin, B. R.(1996).The use of multiple indicators in the assessment of basic research.Scientometrics,36(3),343-362.
39. Meho, Lokman I.,Sonnenwald, Diane H.(2000).Citation ranking versus peer evaluation of senior faculty research performance: a case study of Kurdish scholarship.Journal of the American Society for Information Science,51(2),123-138.
40. Nederhof, A. J.,Zwaan, R. A.,De Bruin, R. E.,Dekker, P. J.(1989).Assessing the usefulness of bibliographic indicators for the humanities and the social and behavioral sciences: A comparative study.Scientometrics,15(5/6),423-435.
41. Norris, Michael,Oppenheim, Charles.(2003).Citation counts and the research assessment exercise V: archaeology and the 2001 RAE.Journal of Documentation,59(6),709-730.
42. Oppenheim, Charles.(1995).The correlation between citation counts and the 1992 research assessment exercise ratings for British library and information science university department.Journal of Documentation,51(1),18-27.
43. Osca-Lluch, J.,Haba, J.(2005).Dissemination of Spanish social sciences and humanities journal.Journal of Information Science,31(3),230-237.
44. Peritz, B. C.(1988).The literature of demography; its characteristics and changes over time.Journal of Information Science,14,99-107.
45. Peritz, B. C.,Bar-Ilan, J.(2002).The sources used by bibliometrics-scientometrics as reflected in references.Scientometrics,54(2),269-284.
46. Australian Economic Papers
47. Print, Murray,Hattie, John.(1997).Measuring quality in universities: an approach to weighting research productivity.Higher Education,33,453-469.
48. Rinia, E. J.,Van Leeuwen, Th. N.,VanVuren, H. G.,Van Raan, A. F. J.(1998).Comparative analysis of a set of bibliometric indicators and central peer review criteria evaluation of condensed matter physics in the Netherlands.Research Policy,27,95-107.
49. Review of research assessment
50. Sinha, Dipendra,Macri, Joseph.(2002).Ranking of Australian economics departments, 1988-2000.The Economic Record,78(241),136-146.
51. Smith, Linda C.(1981).Citation analysis.Library Trends,30(1),83-106.
52. Towe, J. B.,Wright, D. J.(1995).Research Published by Australian economics and econometrics departments.The Economic Record,71,8-17.
53. Uctug, Yildirim,Koksal, Gulser.(2003).An academic performance measurement system and its impact on quality of engineering faculty work at middle east technical university.Assessment & Evaluation in Higher Education,28(3),251-262.
54. Bibliometric Study on FOM-Amolf (2000-2005) CTWS Report
55. Van Raan, A.(1996).Advanced bibliometric methods as quantitative core of peer review based evaluation and foresight exercises.Scientometrics,36(3),397-420.
56. Van Raan, A.(1999).Advanced bibliometric methods for the evaluation of universities.Scientometrics,45(3),417-423.
57. 反思台灣的（人文及社會）高教學術評鑑研討會
58. 師友月刊
59. 楊瑩(2006)。英國高等教育研究評鑑改革新趨勢。評鑑，3，47-50。
60. 羅於陵、洪文琪、蔡昊樺、國立政治大學圖書資訊編、檔案學研究所編(2004)。以國際共通指標衡量台灣學術研究。在引文分析與學衍評鑑研討會會議論文集，台北市:

1. 郭玲玲(Ling-Ling Kueh);許清芳(Ching-Fan Sheu)(2022)。引文？引文——大學學術發表影響力之初探：以成功大學為例。教育研究與發展期刊。18(4)。1-40。