管理才能發展訓練方案成效評估：以公部門教育訓練機構為例

Training Evaluation of Management Development Training Program: A Case Study of Public Sector Training Institution

10.6147/JHRM.2011.1103.01

黃佳純(Jie-Tsuen Huang)；謝慧賢(Hui-Hsien Hsieh)

訓練評估 ； Kirkpatrick四階層評估模式 ； 效用分析 ； 公部門教育訓練 ； 管理發展 ； training evaluation ； Kirkpatrick's four-level evaluation model ； utility analysis ； public sector training ； management development

人力資源管理學報

11卷3期（2011 / 09 / 01）

1 - 26

繁體中文

隨著強調實際貢獻的課責要求及結果導向績效管理制度之興起，人力資源發展乃由過去的活動導向轉為成果導向，而訓練評估的焦點也應延伸至更高層次的評估，如訓練效用與投資報酬率。因此，本研究乃以一結合Kirkpatrick四階層評估模式與效用分析的訓練評估架構，透過個案研究方式針對公部門訓練專責機構所舉辦之管理才能發展訓練方案進行系統化的訓練成效衡量與評估。結果顯示，受訓者在反應、學習、行為、成果等四個評估層級中皆有良好的訓練成效，且經由效用分析得知此管理才能發展訓練方案能夠產生3,233,385（元）的淨經濟效益，整體訓練方案的投資報酬率為718%。最後，結論乃針對人力資源發展人員、組織管理者、公部門訓練機構等三方面與未來研究方向提出相關建議。

Accompanying the rise of accountability demands and outcome-based performance management, Human Resource Development will move from activity-based in the past toward more results-based. In addition, the focus of training evaluation should extend to higher levels such as the utility and return on investment of training program. Therefore, for building a both activity-based and result-based model, this study proposes a training evaluation framework combining Kirkpatrick's four-level evaluation model and utility analysis and conducts a case study on a management development training program implemented by a public sector training institution. The results indicate that the trainees have satisfactory outcomes in the four evaluation levels of reaction, learning, behavior, and results. Meanwhile, through utility analysis, the net benefits of the management development training program is NT$ 3,233,385, and the program's return on investment is 718%. In conclusion, suggestions towards human resource development professionals, organization managers, public sector training institutions, and future research are provided.

1. 蘇偉業(2009)。公共部門事前定向績效管理：反思與回應。公共行政學報，30，105-130。
   連結：
2. Brogden, H. E. 1949. When testing pays off. Personnel Psychology, 2: 171-183.
3. Brogden, H. E. 1946. On the interpretation of the correlation coefficient as a measure of predictive efficiency. Journal of Educational Psychology, 37: 65-76.
4. Alliger, G. M.,Janak, E. A.(1989).Kirkpatrick's levels of training criteria: Thirty years later.Personnel Psychology,42,331-342.
5. Alvarez, K.,Salas, E.,Garofano, C. M.(2004).An integrated model of training evaluation and effectiveness.Human Resource Development Review,3,385-416.
6. American Society for Training and Development(2003).,Alexandria, VA:ASTD.
7. Anderson, P. A.(1983).Decision making by objection and the Cuban missile crisis.Administrative Science Quarterly,28,201-222.
8. Arthur, W., Jr.,Bennett, W., Jr.,Edens, P. S.,Bell, S. T.(2003).Effectiveness of training in organizations: A meta-analysis of design and evaluation features.Journal of Applied Psychology,88,234-245.
9. Becker, B. E.,Huselid, M. A.,Ulrich, D.(2001).The HR scorecard: Linking people, strategy and performance.Cambridge, MA:Harvard Business School Press.
10. Boudreau, J. W.(1991).Utility analysis for decisions in human resource management.Handbook of industrial and organizational psychology,Palo Alto, CA:
11. Boudreau, J. W.(1983).Effects of employee flows on utility analysis of human resource productivity improvement programs.Journal of Applied Psychology,68,396-406.
12. Boudreau, J. W.,Berger, C. J.(1985).Decision-theoretic utility analysis applied to employee separations and acquisition.Journal of Applied Psychology,70,581-612.
13. Boudreau, J. W.,Rynes, S. L.(1985).Role of recruitment in staffing utility analysis.Journal of Applied Psychology,70,354-366.
14. Brinkerhoff, R. O.(1987).Achieving results from training: How to evaluate human resource development to strengthen programs and increase impact.San Francisco:Jossey-Bass.
15. Cascio, W. F.(2000).Costing human resources: The financial impact of behavior in organizations.Boston:Kent.
16. Cascio, W. F.,Ramos, R. A.(1986).Development and application of a new method for assessing job performance in behavioral/economic terms.Journal of Applied Psychology,71,20-28.
17. Cronbach, L. J.,Gleser, G. C.(1965).Psychological tests and personnel decision.Urbana, IL:University of Illinois Press.
18. Cronshaw, S. F.(1986).The utility of employment testing for clerical/administrative trades in the Canadian military.Canadian Journal of Administrative Sciences,3,376-385.
19. Cronshaw, S. F.,Alexander, R. A.(1985).One answer to the demand for accountability: Selection utility as an investment decision.Organizational Behavior and Human Decision Processes,35,102-118.
20. Eisenhardt, K. M.(1989).Building theories from case study research.Academy of Management Review,14,532-550.
21. Fandt, P. M.(1991).The relationship of accountability and interdependent behavior to enhancing team consequences.Group & Organization Managment,16,300-312.
22. Florin-Thuma, B. C.,Boudreau, J. W.(1987).Performance feedback utility in a small organization: Effects on organizational outcomes and managerial decision processes.Personnel Psychology,40,693-713.
23. Gersick, C. J. G.(1988).Time and transition in work teams: Toward a new model of group development.Academy of Management Journal,31,9-41.
24. Hamblin, A. C.(1974).Evaluation and control of training.New York:McGraw-Hill.
25. Hazer, J. T.,Highhouse, S.(1997).Factors influencing managers' reactions to utility analysis: Effects of SDy method, information frame, and focal intervention.Journal of Applied Psychology,82,104-112.
26. Heinrich, C. J.(2002).Outcome-based performance management in the public sector: Implications for government accountability and effectiveness.Public Administration Review,62,712-725.
27. Highhouse, S.(1996).The utility estimate as a communication device: Practical questions and research directions.Journal of Business and Psychology,11,85-100.
28. Holton, E. F., III.(1996).The flawed four-level evaluation model.Human Resource Development Quarterly,7,5-21.
29. Honeycutt, E. D., Jr.,Karande, K.,Attia, A.,Maurer, S. D.(2001).An utility based framework for evaluating the financial impact of sales force training programs.The Journal of Personal Selling & Sales Management,21,229-238.
30. Judiesch, M. K.,Schmidt, F. L.,Hunter, J. E.(1993).Has the problem of judgment in utility analysis been solved?.Journal of Applied Psychology,78,903-911.
31. Kaufman, R.,Keller, J. M.(1994).Levels of evaluation: Beyond Kirkpatrick.Human Resource Development Quarterly,5,371-380.
32. Kearns, P.(2005).Evaluating the ROI from learning: How to develop value-based training.London:Chartered Institute of Personnel and Development.
33. Kearns, P.(2005).Form return on investment to added value evaluation: The foundation for organizational learning.Advances in Developing Human Resource,7,135-145.
34. Kidder, T.(1981).The soul of a new machine.New York:Avon.
35. Kim, H.,Cervero, R. M.(2007).How power relations structure the evaluation process for HRD programmes.Human Resource Development International,10,5-20.
36. Kirkpatrick, D. L.(1960).Techniques for evaluating programs: Part 3-Behavior.Journal of the American Society of Training Directors,14,13-18.
37. Kirkpatrick, D. L.(1959).Techniques for evaluating programs: Part 2-Learning.Journal of the American Society of Training Directors,13,21-26.
38. Kirkpatrick, D. L.(1959).Techniques for evaluating training programs.Journal of the American Society of Training Directors,13,3-9.
39. Kirkpatrick, D. L.(1960).Techniques for evaluating programs: Part 4-Results.Journal of the American Society of Training Directors,14,28-32.
40. Kirkpatrick, D. L.(1998).Evaluating training programs: The four levels.San Francisco:Berrett-Koehler.
41. Kirkpatrick, D. L.(1994).Evaluating training programs: The four levels.San Francisco:Berrett-Koehler.
42. Kraiger, K.,Ford, J. K.,Salas, E.(1993).Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation.Journal of Applied Psychology,78,311-328.
43. Landy, F. J.,Farr, J. L.,Jacobs, R. R.(1982).Utility concepts in performance measurement.Organizational Behavior and Human Performance,30,15-40.
44. Macan, T. H.,Foster, J.(2004).Managers' reactions to utility analysis and perceptions of what influences their decisions.Journal of Business and Psychology,19,241-253.
45. Mathieu, J. E.,Leonard, R. L., Jr.(1987).Applying utility concepts to a training program in supervisory skills: A time-based approach.Academy of Management Journal,30,316-335.
46. Morgan, R. B.,Casper, W. J.(2000).Examining the factor structure of participant reactions to training: A multidimensional approach.Human Resource Development Quarterly,11,301-317.
47. Morrow, C. C.,Jarrett, M. Q.,Rupinski, M. T.(1997).An investigation of the effect and economic utility of corporate-wide training.Personnel Psychology,50,91-119.
48. Moynihan, D. P.,Ingraham, P. W.(2003).Look for the silver lining: When performance-based accountability systems work.Journal of Public Administration Research and Theory,13,469-490.
49. Mulgan, R.(2000).Comparing accountability in the public and private sectors.Australian Journal of Public Administration,59,87-97.
50. Nickols, F. W.(2005).Why a stakeholder approach to evaluating training.Advances in Developing Human Resources,7,121-134.
51. Niiranen, V.(2008).The many purposes of performance evaluation.International Journal of Public Administration,31,1208-1222.
52. Noe, R. A.(2005).Employee training & development.New York:McGraw-Hill.
53. Phillips, J. J.(2003).Return on investment in training and performance improvement programs.Boston:Butterworth-Heinemann.
54. Phillips, J. J.(1997).Handbook of training evaluation and measurement methods.Houston, TX:Gulf Publishing.
55. Phillips, J. J.(Ed.),Phillips, P. P.(Ed.)(2005).ROI at work.Alexandria, VA:ASTD Press.
56. Phillips, J. J.,Phillips, P. P.,Hodges, T. K.(2004).Make training evaluation work.Alexandria, VA:ASTD Press.
57. Pineda, P.(2010).Evaluation of training in organizations: A proposal for an integrated model.Journal of European Industrial Training,34,673-693.
58. Pinfield, L. T.(1986).A field evaluation of perspectives on organizational decision making.Administrative Science Quarterly,31,365-388.
59. Praslova, L.(2010).Adaptation of Kirkpatrick's four level model of training criteria to assessment of learning outcomes and program evaluation in higher education.Educational Assessment, Evaluation, and Accountability,22,215-225.
60. Raju, N. S.,Burke, M. J.,Normand, J.(1990).A new approach for utility analysis.Journal of Applied Psychology,75,3-12.
61. Raju, N. S.,Burke, M. J.,Normand, J.,Lezotte, D. V.(1993).What would be if what is wasn't? A rejoinder to Judiesch, Schmidt and Hunter (1993).Journal of Applied Psychology,78,912-916.
62. Rauschenberger, J. M.,Schmidt, F. L.(1987).Measuring the economic impact of human resource programs.Journal of Business and Psychology,2,50-59.
63. Rivera, R. J.,Paradise, A.(2006).2006 state of the industry in leading enterprises: ASTD's annual review of trends in workplace learning and performance,Alexandria, VA:
64. Russ-Eft, D.,Preskill, H.(2005).In search of the holy grail: Return on investment evaluation in human resource development.Advances in Developing Human Resources,7,71-85.
65. Salas, E.,Cannon-Bowers, J. A.(2001).The science of training: A decade of progress.Annual Review of Psychology,52,471-499.
66. Schmidt, F. L.,Hunter, J. E.,McKenzie, R. C.,Muldrow, T. W.(1979).Impact of valid selection procedures on work-force productivity.Journal of Applied Psychology,64,609-626.
67. Schmidt, F. L.,Hunter, J. E.,Pearlman, K.(1982).Assessing the economic impact of personnel programs on workforce productivity.Personnel Psychology,35,333-347.
68. Sturman, M. C.(2003).Utility analysis: A tool for quantifying the value of hospitality human resource interventions.Cornell Hotel and Restaurant Administration Quarterly,44,106-116.
69. Swanson, R. A.(1998).Demonstrating the financial benefit of human resource development: Status and update on the theory and practice.Human Resource Development Quarterly,9,285-295.
70. Swanson, R. A.,Holton, E. F., III.(2001).Foundations of human resource development.San Francisco:Berrett-Koehler.
71. Swanson, R. A.,Holton, E. F., III.(1999).Results: How to assess performance, learning and perceptions in organizations.San Francisco:Berrett-Koehler.
72. Tsui, A. S.,Pearce, J. L.,Porter, L. W.,Tripoli, A. M.(1997).Alternative approaches to the employee-organization relationship: Does investment in employees pay off?.Academy of Management Journal,40,1089-1121.
73. Ulrich, D.,Smallwood, N.(2005).HR's new ROI: Return on intangibles.Human Resource Management,44,137-142.
74. Ulrich, Dave、李芳齡〈譯〉(2001)。人力資源最佳實務。台北:商周。
75. Van Buren, M. E.,Erskine, W.(2002).,Alexandria, VA:American Society of Training and Development.
76. Wang, G. G.,Wang, J.(2005).Human resource development evaluation: Emerging market, barriers, and theory building.Advances in Developing Human Resources,7,22-36.
77. Werner, J. M.,DeSimone, R. L.(2009).Human resource development.Mason, OH:Thomson South-Western.
78. Yang, K.,Hsieh, J. Y.(2007).Managerial effectiveness of government performance measurement: Testing a middle-range model.Public Administration Review,67,861-879.
79. Yin, R. K.(1994).Case study research: Design and methods.Thousand Oaks, CA:Sages.
80. 吳秉恩(1984)。博士論文(博士論文)。國立政治大學企業管理研究所。
81. 蔡錫濤(2000)。訓練評鑑的焦點與模式。人力資源發展月刊，156，1-12。

1. 劉淑芬,吳國鳯(2020)。人力資源管理領域訓練移轉模式之介紹。新臺北護理期刊，22(1)，1-7。
2. 薛榮棠,鄭賢仁,王茹薏(2019)。教育訓練成效、個人環境適配與工作績效關係之研究-以通過人才發展品質管理系統(TTQS)之企業為例。績效與策略研究，16(2)，45-72。
3. 趙志揚、楊主恩、洪麗淇(2017)。訓練成效評估模式之發展─以個案B公司為例。管理實務與理論研究，11(4)，1-20。
4. (2014)。社會工作專業人力繼續教育的訓練成效評鑑：訓練成效與經濟效用之評鑑建構。社區發展季刊，148，303-324。
5. (2024)。後疫情時代如何促進公務人員數位學習動機與學習效能之研究：工作熱情之調節效果。數位學習科技期刊，16(1)，57-84。