科技大學教師評鑑影響性評估量表發展之研究

A Study on the Development of Faculty Evaluation Influence Assessment Scale for Universities of Science and Technology

10.3966/181665042013090903001

張媛甯(Yuan-Ning Chang)

教師評鑑 ； 評鑑影響性 ； 驗證性因素分析 ； confirmatory factor analysis ； evaluation influence ； faculty evaluation

教育研究與發展期刊

9卷3期（2013 / 09 / 30）

1 - 30

繁體中文

本研究旨在發展科技大學教師評鑑影響性之評估量表，透過文獻探討分析國內外有關教師評鑑與評鑑影響性的理論與實務，以建立構念和發展題項，經過專家學者修正與項目分析來進行題項的篩選與確認，建立初步的量表結構與測量題項。本研究立意抽樣七所科技大學之教師為施測對象，有效問卷共247份，首先運用探索性因素分析以純化測量工具，再透過驗證性因素分析進行競爭模式的比較以選擇最簡效模式，繼而進行該模式的信效度檢定。研究結果發現，本量表證實具有二階層模式的因素結構，其整體模式適配度評估皆符合建議水準，評鑑投入、評鑑活動與評鑑影響性三個分量表分別包含三個潛在變項，總計35個測量題項。最後，根據研究結果對科技大學及後續研究提出建議。

The purpose of this study was to develop faculty evaluation influence assessment scale for universities of science and technology. The construct and measuring items were developed according to the literature review of faculty evaluation and evaluation influence. After experts' modifications and item analysis, the factor structure and items of the preliminary scale were confirmed. After collecting 247 samples from seven universities of science and technology, exploratory factor analysis was first conducted to purify the dimensions and measuring items of faculty evaluation influence. Secondly, confirmatory factor analysis was employed to choose the best model by comparisons of model fits, and further its reliability and validity was tested. Results showed that the two-hierarchical factor structure of the scale was verified, and its goodness-of-fitness conformed to standard. The 35 items were divided into three subscales which included evaluation input, evaluation activity and evaluation influence, and each subscale had 3 latent variables. Lastly, suggestions were offered for universities of science and technology and future research.

1. 王振世,陳芃婷(2005)。大學教師績效評量模型之建立：以新竹某國立大學為例。科技管理學刊，10(3)，121-152。
   連結：
2. 孫志麟(2007)。績效控制或專業發展？大學教師評鑑的兩難。教育實踐與研究，20(2)，95-128。
   連結：
3. 游森期,余民寧(2006)。網路問卷與傳統問卷之比較：多樣本均等性方法學之應用。測驗學刊，53(1)，103-128。
   連結：
4. 潘世尊(2009)。大學教師教學評鑑－一所私立科技大學的實踐之反思與探究。弘光學報，57，24-45。
   連結：
5. 潘慧玲,陳文彥(2010)。教師專業發展評鑑促進組織學習之個案研究。教育研究集刊，56(3)，29-65。
   連結：
6. 鄭淑惠(2009)。教育評鑑的效用性：促進組織學習的觀點。新竹教育大學教育學報，26(2)，57-88。
   連結：
7. Alkin, M. C.,Taut, S. M.(2003).Unbundling evaluation use.Studies in Educational Evaluation,29,1-12.
8. Amo, C.,Cousins, J. B.(2007).Going through the process: An examination of The operationalization of process use in empirical research on evaluation.New Directions for Evaluation,116,5-26.
9. Arreola, R. A.(2006).Developing a comprehensive faculty evaluation system: A guide to designing, building, and operating large-scale faculty evaluation systems.Bolton, MA:Anker.
10. Bagozzi, R. P.,Yi, Y.(1988).On the evaluation for structural equation models.Journal of The Academy of Marketing Science,16(1),74-94.
11. Brett, B.,Hill-Mead, L.,Wu, S.(2000).Perspectives on evaluation use and demand by users: The case of City Year.New Directions for Evaluation,88,71-83.
12. Bullock, A. A.,Hawk, P.(2005).Developing a teaching portfolio: A guide for pre-service and practicing teachers.Upper Saddle River, NJ:Pearson Prentice Hall.
13. Byrne, B. B.(2010).Structural equation modeling using AMOS: Basic concepts, applications, and programming.New York, NY:Routledge.
14. Christie, C. A.(2007).Reported influence of evaluation data on decision maker´s actions.American Journal of Evaluation,28(1),8-25.
15. Danielson, C.,McGreal, T.(2000).Teacher evaluation: To enhance professional practice.Alexandria, VA:Association for Supervision and Curriculum Development.
16. Fornell, C.,Larcker, D. F.(1981).Evaluating structural equation models with unobservable and measurement errors.Journal of Marketing Research,18(1),39-50.
17. Greenberg, D.,Mandell, M.,Onstott, M.(2000).The dissemination and utilization of welfare-to-work experiments in state policymaking.Journal of Policy Analysis & Management,19,367-382.
18. Hachtmann, F.,Signal, S.(2005).The peer review of teaching portfolio as scholarship assessment in higher education.International Journal of Learning,12(5),31-40.
19. Hair, J. F.,Black, W. C.,Babin, B. J.,Anderson, R. E.(2010).Multivariate data analysis.Upper Saddle River, NJ:Pearson Prentice Hall.
20. Henry, G. T.(2000).Why not use?.New Directions for Evaluation,88,85-98.
21. Henry, G. T.,Gordon, C. S.(2001).Tracking issue attention: Specifying the dynamics of The public agenda.Public Opinion Quarterly,65,157-177.
22. Henry, G. T.,Mark, M. M.(2003).Beyond use: Understanding evaluation´s influence on attitudes and actions.American Journal of Evaluation,24(3),293-314.
23. Huberty, C.(2000).An approach to annual assessment and evaluation of university faculty.Journal of Personnel Evaluation in Education,14(3),241-251.
24. Joint Committee on Standards for Educational Evaluation=JCSEE(1994).The program evaluation standards: How to assess evaluations of educational programs.Thousand Oaks, CA:Sage.
25. Joint Committee on Standards for Educational Evaluation=JCSEE(2009).The personnel evaluation standards: How to assess systems for evaluating educators.Newbury Park, CA:Corwin.
26. Jöreskog, K. G.,Sörbom, D.(1996).Lisrel 8: User’s reference guide.Chicago, IN:Scientific Software International.
27. Kellaghan, T.(Ed.),Stufflebeam, D. L.(Ed.),Wingate, L. A.(Ed.)(2003).International handbook of educational evaluation: Practice.Dordrecht, Netherlands:Kluwer.
28. King, J. A.(2002).Building the evaluation capacity of a school district.New Directions for Evaluation,66,27-34.
29. Kirkhart, K. E.(2000).Reconceptualizing evaluation use: An integrated theory of influence.New Directions for Evaluation,88,5-23.
30. Kirkhart, K. E.(2011).Culture and influence in multisite evaluation.New Directions for Evaluation,129,73-85.
31. Klenowski, V.,Askew, S.,Carnell, E.(2006).Portfolio for learning, assessment and professional development in higher education.Assessment & Evaluation in Higher Education,31(3),267-286.
32. Kline, R. B.(2005).Principles and practice of structural equation modeling.New York, NY:Guilford.
33. Lawrenz, F.,King, J. A.,Ooms, A.(2011).The role of involvement and use in multisite evaluations.New Directions for Evaluation,129,49-57.
34. Little, T. D.(1997).Mean and covariance structures(MACS) analysis of cross-cultural data: Practice and theoretical issues.Multivariate Behavioral Research,32,53-76.
35. Mark, M. M.(2011).Toward better research on-and thinking about-evaluation influence, especially in multisite evaluation.New Directions for Evaluation,129,107-119.
36. Mark, M. M.,Henry, G. T.(2004).The mechanisms and outcomes of evaluation influence.Evaluation,10(1),35-57.
37. Marsh, H. W.,Hocevar, D.(1985).Application of confirmatory factor analysis to the study of self-concept: First and higher order factor models and their invariance across groups.Psychological Bulletin,97(3),562-582.
38. Mathison, S.(Ed)(2005).Utilization Encyclopedia of evaluation.Thousand Oaks, CA:Sage.
39. Milllman, J.(Ed.),Darling-Hammond, L.(Ed.)(1990).The new handbook of teacher Evaluation: Assessing elementary and secondary school teachers.Newbury Park, CA:Sage.
40. Millman, J.(Ed.),Darling-Hammond, L.(Ed.)(1990).The new handbook of teacher evaluation: Assessing elementary and secondary teachers.Newbury Park, CA:Sage.
41. Monroe, A.(1998).Public opinion and public policy: 1980-1993.Public Opinion Quarterly,62,6-27.
42. Morabito, S. M.(2002).Evaluation roles and strategies for expanding evaluation process influence.American Journal of Evaluation,23(2),321-330.
43. Noar, S. M.(2003).The role of structural equation modeling in scale development.Structural Equation Modeling,10(4),622-647.
44. Patton, M. Q.(2008).Utilization-focused evaluation.Thousand Oaks, CA:Sage.
45. Patton, M. Q.(1978).Utilization-focused evaluation.Beverly Hills, CA:Sage.
46. Patton, M. Q.(2007).Process use as a usefulism.New Directions for Evaluation,116,99-112.
47. Peterson, K. D.,Peterson, C. A.(2006).Effective teacher evaluation: A guide for principals.Thousand Oaks, CA:Corwin.
48. Preskill, H.,Zuckerman, B.,Matthews, B.(2003).An exploratory study of process use: Findings and implications for future research.American Journal of Evaluation,24(4),423-442.
49. Rebolloso, E.,Fernández-Ramirez, B.,Canton P.,Pozo, C.(2005).The influence of evaluation on changing management systems in educational institutions.Evaluation,11(4),463-479.
50. Rossi, P. H.,Lipsey, M. W.,Freeman, H. E.(2004).Evaluation: A systematic approach.Thousand Oaks, CA:Sage.
51. Seldin, P.(1997).The teaching portfolio: A practical guide to improved performance and promotion/tenure decisions.Bolton, MA:Anker.
52. Shulha, L. M.(2000).Evaluation inquiry in university–school professional learning partnerships.New Directions for Evaluation,88,39-53.
53. Shulha, L. M.,Cousins, J. B.(1997).Evaluation use: Theory, research, and practice since 1986.Evaluation Practice,18(3),195-208.
54. Stockdill, S. H.,Baizerman, M.,Compton, D. W.(2002).Toward a definition of the ECB process: A conversation with the ECB literature.New Directions for Evaluation,93,7-26.
55. Stronge, J. H.(1995).Balancing individual and institutional goals in educational personnel evaluation: A conceptual framework.Studies in Educational Evaluation,21,131-151.
56. Stronge, J. H.,Tucker P. D.(2003).Handbook on teacher evaluation: Assessing and improving performance.Larchmont, NY:Eye On Education.
57. Torres, R. T.,Preskill, H.(2001).Evaluation and organizational learning: Past, present, and future.American Journal of Evaluation,22(3),387-395.
58. Tucker, P. D.,Stronge, J. H.(2005).Linking evaluation and student learning.Alexandria, VI:ASCD.
59. Weick, K. E.,Quinn, R. E.(1999).Organizational change and development.Annual Review of Psychology,50,361-386.
60. Weiss, C. H.(1981).Measuring the use of evaluation.Utilizing evaluation: Concepts and measurement techniques,Beverly Hills, CA:
61. Weiss, C. H.(1972).Evaluating educational and social action programs: A treeful of owls.Evaluating action programs: Readings in social action and education,Boston, MA:
62. Weiss, C. H.(Ed.)(1977).Using social research in public policy making.Lexington, MA:Lexington Books.
63. Weiss, C. H.,Murphy-Graham, E.,Birkeland, S.(2005).An alternate route to policy influence: Evidence from a study of the drug abuse resistance education program.American Journal of Evaluation,26(1),12-30.
64. 成群豪(2007)。我國新設大學校院教師評鑑機制功能之研究。「教師評鑑：挑戰、因應與展望」研討會論文集，臺北市:
65. 江惠真(2009)。臺北市，國立臺灣師範大學。
66. 吳佩真,張民杰(2007)。國內大學教師教學評鑑現況分析。評鑑雙月刊，9，9-15。
67. 吳武典（編）,高強華（編）(2006).優質、創新與前瞻.臺北市:學富.
68. 邱皓政(2010).量化研究與統計分析.臺北市:五南.
69. 施俊名,吳裕益(2008)。「大學生身心健康量表」構念效度驗證之研究。教育研究與發展期刊，4(4)，201-229。
70. 高熏芳,張寒菱(2010)。從教師發展到學校發展：利用教師專業發展評鑑促進學校改進的個案研究。新世紀學校革新之挑戰與展望國際研討會，臺北市:
71. 張媛甯(2010)。大學教師對教師評鑑態度之研究－以S科技大學為例。南臺學報，35(2)，93-116。
72. 張德銳(2000).師資培育與教師評鑑.臺北市:師大書苑.
73. 教育部高教司(2006).獎勵大學教學卓越計畫九十五年度計畫作業手冊.臺北市:教育部高教司.
74. 陳佩如(2007)。臺北市，國立臺灣師範大學。
75. 彭森明(2006)。教育部委託專案研究計畫成果報告教育部委託專案研究計畫成果報告,新竹市:國立清華大學高等教育研究中心。
76. 曾淑惠(2010)。使用評鑑促進高職學校革新。新世紀學校革新之挑戰與展望國際研討會，臺北市:
77. 黃玉幸(2009)。以產學合作為績效的大學教師評鑑制度之評析。2009年大專校院評鑑制度學術研討會，臺南市:
78. 黃芳銘(2007).結構方程模式：理論與應用.臺北市:五南.
79. 黃嘉雄(2010).課程評鑑.臺北市:心理.
80. 黃綉雲(2008)。高雄市，國立中山大學。
81. 潘慧玲(2010)。驅動學校革新的評鑑機制。新世紀學校革新之挑戰與展望國際研討會，臺北市:
82. 鄭淑惠(2007)。探究評鑑如何影響教師的專業成長－以個案研究為例。教師評鑑與專業成長，臺北市:
83. 蘇錦麗,黃曙東(2009)。美國大學教師評鑑制度之探討。教育政策論壇，12(2)，1-44。