整合數據驅動方法以進行稽核績效最佳化之稽核指派

An Integrated Data-Driven Methodology for Auditor Performance Appraisals and Auditor Assignment Optimization

10.6226/NTUMR.202304_33(1).0001

王子騫(Tzu-Chien Wang)

決策模型 ； 稽核績效評估 ； 稽核任務規劃 ； 派工法則 ； 二階段數據分析模型 ； decision-making model ； auditors performance appraisals ； audit-task scheduling ； dispatching rules ； integrated data-driven models

臺大管理論叢

33卷1期（2023 / 04 / 01）

1 - 37

繁體中文;英文

近年來，隨著金融業相關事業群擴張及產業數位化，金控公司常會因稽核人力調度的困難，而造成內部監督管理疏失，導致裁罰案之發生。本研究探討績效評估方法論與產業稽核績效評估模式，並進一步整合隨機森林和差分進化技術，提出二階段數據分析模型；透過分析金控稽核數據來最佳化稽核人員績效值，並解決稽核績效評估與任務規劃問題。驗證結果顯示：（1）二階段數據分析模型準確地評估稽核人員在不同工作下稽核表現，指派合適稽核任務，強化運營決策；（2）建構專業課程、稽核資歷、稽核任務等構面的多目標決策模型，分類最佳方案及有應用價值的派工法則，對稽核人力管理極有助益；（3）稽核數據專案的實地運用中，啟發式方法會較傳統規劃法更具可執行性。

With the expansion of related business groups and impact of digitization on financial industry in Taiwan, in recent years, financial holding companies often fail to provide adequate internal supervision and management due to problems of audit-staff scheduling, which frequently leads to adjudication and penalization. The study aims to solve the problem and find better performance evaluation method of auditors beginning by reviewing past performance appraisal models in prior literature. We then integrate the random forest and differential evolution technology and propose a two-stage data analysis method. Applying this method, we analyze audit data collected from the financial information system; optimize the internal audit performance; and resolve issues related to audio performance evaluation and task planning. The verification results show this two-stage model can accurately evaluate the audit performance of high-level audits under different tasks; smoothly assign appropriate audit tasks; and strengthen operational decisions. Secondly, we prove the construction of a multi-objective mathematical model based on provision of professional courses, audit qualification system, task auditing, etc. can optimally classify the most applicable action plan and dispatch rules, which are extremely helpful to the management of audit-staff scheduling. Lastly, with the practical application of this audit data project, we demonstrate the heuristic method suggested would be more feasible in execution than the conventional planning method.

1. 王儷玲, Jennifer L.,彭金隆, Jin-Lun,張義宏, Yi-Huang(2006)。我國壽險業銀行保險業務參與度與經營效率分析。臺大管理論叢，17(1)，59-90。
   連結：
2. 吳東憲, Tung-Hsien,黃劭彥, Shaio-Yan,康照宗, Chao-Chung(2019)。資訊科技稽核品質，資訊科技內部控制與資訊科技治理之關聯性研究。管理與系統，26(2)，179-207。
   連結：
3. 李建然, Jan-Zan,陳信吉, Hsin-Chi,蔡宗益, Tsung-Yi(2020)。責任分攤式查核意見與集團企業合併財務報表審計品質關聯性：以會計師調整數為衡量基礎。臺大管理論叢，30(2)，37-70。
   連結：
4. 李貴富, Kuei-Fu(2018)。查核品質屬性、財務報表可比性與投資效率。臺大管理論叢，28(2)，129-164。
   連結：
5. 張碩毅, She-I,游勝宇, Sheng-Yu,張益誠, I-Cheng(2008)。企業資源規劃系統績效評估—「平衡」計分卡模式與進行方式。資訊管理學報，15(2)，109-133。
   連結：
6. 郭俐君, Li-Chun,廖懿屏, Yi-Ping(2020)。揭露內部控制缺失之效益：臺灣銀行業之實證。臺大管理論叢，30(2)，175-210。
   連結：
7. 黃政仁, Cheng-Jen,蕭逸強, Yi-Chiang(2017)。中華郵政公司績效管理制度之研究—以平衡計分卡為架構。當代會計，18(2)，121-153。
   連結：
8. 鄭桂蕙, Kuei-Hu,林宛瑩, Wan-Ying(2017)。稽核特性與財務報導品質。會計評論，64，113-146。
   連結：
9. 薛敏正, Min-Jeng,葉淑玲, Shu-Ling,陳靜宜, Ching-Yi(2021)。會計師簽證網絡與審計獨立性：來自繼續經營疑慮審計意見的實證分析。臺大管理論叢，31(3)，203-236。
   連結：
10. Abbott, D. W.(1999).Combining models to improve classifier accuracy and robustness.Proceedings of the International Conference on Information Fusion (Fusion’99),Sunnyvale, CA.:
11. Abboud, N.,Inuiguchi, M.,Sakawa, M.,Uemura, Y.(1998).Manpower allocation using genetic annealing.European Journal of Operational Research,111(2),405-420.
12. Abdolmohammadi, M.,Wright, A.(1987).An examination of the effects of experience and task complexity on audit judgments.Accounting Review,62(1),1-13.
13. Adeva, J. J. G.,Beresi, U.,Calvo, R.(2005).Accuracy and diversity in ensembles of text categorisers.CLEI Electronic Journal,9(1),1-12.
14. Aggarwal, A.,Thakur, G. S. M.(2013).Techniques of performance appraisal-a review.International Journal of Engineering and Advanced Technology (IJEAT),2(3),617-621.
15. Ahmed, I.,Sultana, I.,Paul, S. K.,Azeem, A.(2013).Employee performance evaluation: A fuzzy approach.International Journal of Productivity and Performance Management,62(7),718-734.
16. Alissa, W.,Capkun, V.,Jeanjean, T.,Suca, N.(2014).An empirical investigation of the impact of audit and auditor characteristics on auditor performance.Accounting, Organizations and Society,39(7),495-510.
17. Asare, S. K.,McDaniel, L. S.(1996).The effects of familiarity with the preparer and task complexity on the effectiveness of the audit review process.Accounting Review,71(2),139-159.
18. Balakrishnan, R.,Lin, H.,Sivaramakrishnan, K.(2020).Screening talent for task assignment: Absolute or percentile thresholds?.Journal of Accounting Research,58(4),831-868.
19. Bănărescu, A.(2015).Detecting and preventing fraud with data analytics.Procedia Economics and Finance,32,1827-1836.
20. Bedard, J.(1989).Expertise in auditing: Myth or reality?.Accounting, Organizations and Society,14(1-2),113-131.
21. Blum, E. S.,Hatfield, R. C.,Houston, R. W.(2022).The effect of staff auditor reputation on audit quality enhancing actions.The Accounting Review,97(1),75-97.
22. Bonner, S.(1991).Is experience necessary in cue measurement? The case of auditing tasks.Contemporary Accounting Research,8(1),253-269.
23. Bonner, S. E.(1994).A model of the effects of audit task complexity.Accounting, organizations and society,19(3),213-234.
24. Boskou, G.,Kirkos, E.,Spathis, C.(2019).Classifying internal audit quality using textual analysis: the case of auditor selection.Managerial Auditing Journal,34(8),924-950.
25. Breiman, L.(2001).Random forests.Machine Learning,45(1),5-32.
26. Brown, S. P.,Leigh, T. W.(1996).A new look at psychological climate and its relationship to job involvement, effort, and performance.Journal of Applied Psychology,81(4),358-368.
27. Campbell, D. J.(1988).Task complexity: A review and analysis.Academy of Management Review,13(1),40-52.
28. Caramanis, C.,Lennox, C.(2008).Audit effort and earnings management.Journal of Accounting and Economics,45(1),116-138.
29. Chen, X.,Cho, Y. H.,Dou, Y.,Lev, B.(2022).Predicting future earnings changes using machine learning and detailed financial data.Journal of Accounting Research,60(2),467-515.
30. Chen, X.,Wang, F.(2010).Application of data mining on enterprise human resource performance management.2010 3rd International Conference on Information Management, Innovation Management and Industrial Engineering,Kunming, China:
31. Chen, Y.,Xie, W.,Zou, X.(2015).A binary differential evolution algorithm learning from explored solutions.Neurocomputing,149,1038-1047.
32. Choi, J. H.,Choi, S.,Hogan, C. E.,Lee, J.(2013).The effect of human resource investment in internal control on the disclosure of internal control weaknesses.Auditing: A Journal of Practice & Theory,32(4),169-199.
33. Chychyla, R.,Leone, A. J.,Minutti-Meza, M.(2019).Complexity of financial reporting standards and accounting expertise.Journal of Accounting and Economics,67(1),226-253.
34. Clement, M. B.,Koonce, L.,Lopez, T. J.(2007).The roles of task-specific forecasting experience and innate ability in understanding analyst forecasting performance.Journal of Accounting and Economics,44(3),378-398.
35. Cloyd, C. B.(1997).Performance in tax research tasks: The joint effects of knowledge and accountability.Accounting Review,72(1),111-131.
36. Dahmen, S.,Rekik, M.,Soumis, F.,Desaulniers, G.(2020).A two-stage solution approach for personalized multi-department multi-day shift scheduling.European Journal of Operational Research,280(3),1051-1063.
37. Dodin, B.,Elimam, A. A.(1997).Audit scheduling with overlapping activities and sequence-dependent setup costs.European Journal of Operational Research,97(1),22-33.
38. Fayyad, U.,Piatetsky-Shapiro, G.,Smyth, P.(1996).From data mining to knowledge discovery in databases.AI Magazine,17(3),37-37.
39. Francis, J. R.(2011).A framework for understanding and researching audit quality.Auditing: A Journal of Practice & Theory,30(2),125-152.
40. Francis, J. R.(2004).What do we know about audit quality?.The British Accounting Review,36(4),345-368.
41. Francis, J. R.,Yu, M. D.(2009).Big 4 office size and audit quality.The Accounting Review,84(5),1521-1552.
42. Gimbar, C.,Jenkins, J. G.,Saucedo, G.,Wright, N. S.(2018).Shifting styles: Do auditor performance levels influence the review process?.International Journal of Auditing,22(3),554-567.
43. Hirst, D. E.(1994).Auditor sensitivity to earnings management.Contemporary Accounting Research,11(1),405-422.
44. Hochreiter, S.,Schmidhuber, J.(1997).Long short-term memory.Neural Computation,9(8),1735-1780.
45. Hwang, S. M.,Kao, C. Y.,Horng, J. T.(1994).On solving rectangle bin packing problems using genetic algorithms.Proceedings of IEEE International Conference on Systems, Man and Cybernetics,San Antonio, TX.:
46. Islami, X.,Mulolli, E.,Mustafa, N.(2018).Using management by objectives as a performance appraisal tool for employee satisfaction.Future Business Journal,4(1),94-108.
47. Kirimi, J. M.,Moturi, C. A.(2016).Application of data mining classification in employee performance prediction.International Journal of Computer Applications,146(7),28-35.
48. Kokina, J.,Davenport, T. H.(2017).The emergence of artificial intelligence: How automation is changing auditing.Journal of Emerging Technologies in Accounting,14(1),115-122.
49. Krogh, P. S. A.(1996).Learning with ensembles: How over-fitting can be useful.Proceedings of the 1995 Conference on Neural Information Processing Systems,Denver, CO:
50. L’heureux, A.,Grolinger, K.,Elyamany, H. F.,Capretz, M. A.(2017).Machine learning with big data: Challenges and approaches.IEEE Access,5,7776-7797.
51. Lim, C. Y.,Tan, H. T.(2009).Does auditor tenure improve audit quality? Moderating effects of industry specialization and fee dependence.Contemporary Accounting Research,27(3),923-957.
52. Lin, C. M.,Gen, M.(2008).Multi-criteria human resource allocation for solving multistage combinatorial optimization problems using multiobjective hybrid genetic algorithm.Expert Systems with Applications,34(4),2480-2490.
53. Maynard, D. C.,Hakel, M. D.(1997).Effects of objective and subjective task complexity on performance.Human Performance,10(4),303-330.
54. Mohd‐Sanusi, Z.,Mohd‐Iskandar, T.(2007).Audit judgment performance: Assessing the effect of performance incentives, effort and task complexity.Managerial Auditing Journal,22(1),34-52.
55. More, A. S.,Rana, D. P.(2017).Review of random forest classification techniques to resolve data imbalance.2017 1st International Conference on Intelligent Systems and Information Management (ICISIM),Aurangabad, India:
56. Morris, J. G.,Showalter, M. J.(1983).Simple approaches to shift, days-off and tour scheduling problems.Management Science,29(8),942-950.
57. Pace, R. W.(2002).The organizational learning audit.Management Communication Quarterly,15(3),458-465.
58. Petasis, A.,Christodoulou, S.,Louca, A.(2020).Employees perception on performance appraisal effectiveness in the Cyprus public sector (EAC).International Journal of Human Capital Management,4(1),26-41.
59. Proell, C. A.,Zhou, Y. D.,Nelson, M. W.(2022).It’s not only what you say... How communication style and team culture affect audit issue follow-up and auditor performance evaluations.The Accounting Review,97(2),373-395.
60. Qiao, G.(2020).Application research of big data technology in audit field.Theoretical Economics Letters,10(5),1093-1102.
61. Roussy, M.,Barbe, O.,Raimbault, S.(2020).Internal audit: From effectiveness to organizational significance.Managerial Auditing Journal,35(2),322-342.
62. Schleicher, D. J.,Baumann, H. M.,Sullivan, D. W.,Levy, P. E.,Hargrove, D. C.,Barros-Rivera, B. A.(2018).Putting the system into performance management systems: A review and agenda for performance management research.Journal of Management,44(6),2209-2245.
63. Shearer, C.(2000).The CRISP-DM model: The new blueprint for data mining.Journal of Data Warehousing,5(4),13-22.
64. Strobl, C.,Malley, J.,Tutz, G.(2009).An introduction to recursive partitioning: Rationale, application, and characteristics of classification and regression trees, bagging, and random forests.Psychological Methods,14(4),323-348.
65. Tan, H. T.,Ng, T. B. P.,Mak, B. W. Y.(2002).The effects of task complexity on auditors’ performance: The impact of accountability and knowledge.Auditing: A Journal of Practice & Theory,21(2),81-95.
66. Ulmer, M. W.,Thomas, B. W.,Campbell, A. M.,Woyak, N.(2021).The restaurant meal delivery problem: Dynamic pickup and delivery with deadlines and random ready times.Transportation Science,55(1),75-100.
67. Wang, Y. R.,Kong, S. L.(2012).Applying genetic algorithms for construction quality auditor assignment in public construction projects.Automation in Construction,22,459-467.
68. Wu, T. H.,Huang, S. M.,Huang, S. Y.,Yen, D. C.(2017).The effect of competencies, team problem-solving ability, and computer audit activity on internal audit performance.Information Systems Frontiers,19(5),1133-1148.
69. 李華, Huwa(2001)。努力、誘因機制與審計決策績效。臺大管理論叢，11(2)，259-294。
70. 邱志洲, Chih-Chou,簡德年, Te-Nien,高淩菁, Ling-Jing(2004)。演化式類神經網路在企業危機診斷上之應用—智慧資本指標的考量。臺大管理論叢，14(2)，1-22。
71. 楊正甫, Cheng-Fu(1995)。軟體開發之差異分析與績效評估模式。臺大管理論叢，6(1)，101-128。