科技大學校務評鑑之運用及其影響因素

The Uses and Their Influencing Factors of the Institutional Evaluation for University of Technology

10.3966/181665042018091403001

曾淑惠(Shu-Hui Tseng)；張仁傑(Jen-Chieh Chang)

評鑑運用 ； 影響評鑑運用的因素 ； 校務評鑑 ； evaluation use ； influence factors of evaluation use ； institutional evaluation

教育研究與發展期刊

14卷3期（2018 / 09 / 30）

1 - 31

繁體中文

校務評鑑在臺灣舉辦多年，而評鑑運用的議題近年才逐漸受到重視。本研究採問卷調查法探究科技大學教職員對評鑑運用的用途與影響因素的看法，以重要－表現分析法分析評鑑運用之用途的理想與實際運用的差異，並以結構方程模型驗證影響校務評鑑運用的因素與評鑑運用的用途間關係之假設模型。總計發放795份問卷，有效回收701份，有效回收率為88.17%，主要研究結論包括：一、評鑑運用的用途分為過程運用與成果運用兩構面；二、影響評鑑運用的因素則可分為評鑑實施、政策決策及評鑑人員三構面；三、評鑑運用的用途理想重要程度顯著高於實際符合程度；四、本研究所提出之科技大學校務評鑑運用影響因素與用途模式架構為一適配模型。

The institutional evaluation has been held in Taiwan for many years, and the evaluation use has gradually gained attention in recent years. The main purpose of this study is to explore the views of the faculty and staff of a University of Technology on the use and influencing factors of evaluation. The questionnaire survey was conducted in this study. A total of 795 questionnaires were issued and 701 were effectively collected. The effective response rate was 88.17%. Firstly, performance analysis was used to analyze the difference between the ideal and the actual use of the school evaluation. Secondly, the structural equation model was used to verify the hypothetical model that influences the relationship between the use of evaluation and the evaluation use. The major findings are summarized as follows: (1) The evaluation use is divided into two aspects: the process use and the result use. Factors that influence the evaluation use can be divided into three aspects: evaluation implementation, policy decision-making and evaluators. (2) The importance degree of ideal evaluation use is significantly higher than the actual. (3) The factors that influences the evaluation use for university of science and technology and the usage model provided in this study is an adaptation model.

1. 黃嘉雄(2012)。影響小學對課程與教學評鑑發現利用之因素研究。課程與教學季刊，15(3)，1-26。
   連結：
2. 鄭淑惠(2016)。地方教育行政機關校務評鑑運用之研究。當代教育研究季刊，24(4)，33-69。
   連結：
3. 鄭淑惠(2009)。教育評鑑的效用性：促進組織學習的觀點。新竹教育大學教育學報，26(2)，57-88。
   連結：
4. Alkin, M. C.(1985).A guide for evaluation decision makers.Beverly Hills, CA:Sage.
5. Alkin, M. C.(Ed.)(2013).Evaluation roots: A wider perspective of theorists' views and influence.Thousand Oaks, CA:Sage.
6. Alkin, M. C.,Daillak, R.,White, P.(1979).Using evaluations: Does evaluation make a difference?.Beverly Hills, CA:Sage.
7. Alkin, M. C.,King, J. A.(2017).Definitions of evaluation use and misuse, evaluation influence, and factors affecting use. Unbundling evaluation use.American Journal of Evaluation,38(3),434-450.
8. Alkin, M. C.,Taut, S.(2003).Unbundling evaluation use.Studies in Educational Evaluation,29,1-12.
9. Alkin, M.(Ed.)(2004).Evaluation roots: Tracing theorists' views and influences.Thousand Oaks, CA:Sage.
10. Amo, C.,Cousins, J. B.(2007).Going through the process: An examination of the operationalization of process use in empirical research on evaluation.New Directions for Evaluation,116,5-26.
11. Beurgeois, I.,Whynot, J.(2018).The influence of evaluation recommendations on instrumental and conceptual uses: A preliminary analysis.Evaluation and Program Planning,68,13-18.
12. Bollen, K. A.(1989).Structural equations with latent variables.New York. NY:John Wiley and Sons.
13. Christie, C. A.(2007).Reported influence of evaluation data on decision maker's actions.American Journal of Evaluation,28(1),8-25.
14. Christie, C. A.(Ed.),Vo, A. T.(Ed.)(2015).Evaluation use and decision making in society: A tribute to Marvin C. Alkin.Charlotte, NC:Information Age.
15. Cousins, J. B.,Leithwood, K. A.(1986).Current empirical research on evaluation utilization.Review of Educational Research,56(3),331-64.
16. de Freitas, Sheizi Calheira(2016).The impact of evaluation use on accounting programs' performance: An exploratory study.National Association of Postgraduation and Research in Administration,20(6),733-752.
17. Devellis, R.(2012).Scale development theory and applications.New York, NY:Sage.
18. D'Ostie-Racine, L.,Dagenais, C.,Ridde, V.(2016).A qualitative case study of evaluation use in the context of a collaborative program evaluation strategy in Burkina Faso.Health Research Policy and System,14(37),1-16.
19. D'Ostie-Racine, L.,Dagenais, C.,Ridde, V.(2016).A qualitative case study of evaluation use in the context of a collaborative program evaluation strategy in Burkina Faso.Health Research Policy and Systems,14(37),1-16.
20. Fleischer, D. N.,Christie, C. A.(2009).Evaluation use: Results from a survey of U.S. American Evaluation Association members.American Journal of Evaluation,30(2),158-175.
21. Greene, J. C.(1988).Stakeholder utilization and participation in program evaluation.Evaluation Review,18,574-591.
22. Henry, G. T.,Mark, M. M.(2003).Beyond use: Understanding evaluation's influence on attitudes and actions.American Journal of Evaluation,23(3),293-314.
23. Højlund, S.(2015).Evaluation use in evaluation systems: The case of the European commission.Copenhagen, Denmark:Copenhagen business school.
24. Højlund, S.(2014).Evaluation use in the organizational context-changing focus to improve theory.Evaluation,20(1),26-43.
25. Huberman, M.(1987).Steps toward an integrated model of research utilization.Knowledge: Creation, Diffusion, Utilization,8,586-611.
26. Johnson, K.,Greenseid, L. O.,Toal, S. A.,King, J. A.,Lawrenz, F.,Volkov, B.(2009).Research on evaluation use: A review of the empirical literature from 1986 to 2005.American Journal of Evaluation,30(3),377-410.
27. Kellaghan, T.(Ed.),Stufflebeam, D. L.(Ed.),Wingate, L.(Ed.)(2003).International handbook of education evaluation.Boston, MA:Kluwer.
28. Kline, R. B.(1998).Principles and practice of structural equation modeling.New York, NY:Guilford Press.
29. Leviton, L. C.,Hughes, E. F. X.(1981).Research on the utilization of evaluations: A review and synthesis.Evaluation Review,5,525-549.
30. Mathison, S.(Ed.)(2005).Encyclopedia of evaluation.Thousand Oaks, CA:Sage.
31. McCormick, E. R.(1997).Factors influencing the use of evaluation results.Dissertation Abstracts International: Section A: The Humanities and Social Sciences,58,4187.
32. Owen, J. M.(1992).Toward a meta-model of evaluation utilization.Annual Meeting of the American Evaluation Association,Seattle, WA:
33. Patton, M. Q.(2007).Process use as a usefulism.New Directions for Evaluation,116,99-112.
34. Patton, M. Q.(2008).Utilization-focused evaluation.Thousand Oaks, CA:Sage.
35. Peck, L.,Gorzalski, L.(2009).An evaluation use framework and empirical assessment.Journal of MultiDisciplinary Evaluation,6(12),139-156.
36. Rebora, G.,Turri, M.(2011).Critical factors in the use of evaluation in Italian universities.Higher Education,61(5),531-544.
37. Rossi, P. H.,Lipsey, M. W.,Freeman, H. E.(2004).Evaluation: A systematic approach.Thousand Oaks, CA:Sage.
38. Saunders, M.(2012).The use and usability of evaluation outputs: A social practice approach.Evaluation,18(4),421-436.
39. Shadish, W. R.,Cook, T. D.,Leviton, L. C.(1991).Foundations of program evaluation: Theories of practices.Newbury Park, CA:Sage.
40. Shulha, L. M.,Cousins, J. B.(1997).Evaluation use: Theory, research and practice since 1986.American Journal of Evaluation,18,195-208.
41. Spector, P.(1992).Summated rating scale construction.Thousand Oaks, CA:Sage.
42. Weiss, C. H.(1979).The many meanings of research utilization.Public Administration Review,39(5),426-431.
43. Weiss, C. H.(Ed.)(1977).Using social research in policy making.Lexington, MA:Lexington.
44. Weiss, C. H.(Ed.)(1977).Using social research in public policy making.Lexington, MA:Lexington.
45. Weiss, C.,Murphy-Graham, E.,Birkeland, S.(2005).An alternate route to policy influence: Evidence from a study of the Drug Abuse Resistance Education (D.A.R.E.) program.American Journal of Evaluation,26,12-31.
46. 吳明隆(2009)。結構方程模式方法與實務應用。高雄市:麗文。
47. 技專校院基本資料庫（2016）。104 學年度技專校院概況。取自http://www.tvedb.yuntech.edu.tw/tvedb/index/social/report/StatisticsQueryDataFrame.asp?table_name=report1
48. 技專校院評鑑資訊網。107 學年度科技校院評鑑實施計畫。取自http://tve-eval.twaea.org.tw/DLFile/107學年度科技校院評鑑實施計畫(公告版).pdf
49. 林原宏(2009)。規則評量方法論。教育研究月刊，185，108-111。
50. 侯永琪、陳慧蓉(2016)。高等教育品質保證及其結果之運用對於大學校院之影響及意涵。評鑑雙月刊，61，21-24。
51. 陳錦玉(2016)。碩士論文(碩士論文)。臺北市，國立臺灣師範大學教育政策與行政研究所。
52. 曾淑惠(2010)。使用評鑑促進高職學校革新。「新世紀學校革新之挑戰與展望」國際研討會論文集，臺北市:
53. 潘慧玲(2004)。邁向下一代的教育評鑑：回顧與前瞻。「教育評鑑：回顧與前瞻」學術研討會，臺北市:
54. 凃金堂(2012)。量表編製與SPSS。臺北市:五南。