Tyler Ratts, Paul M. Pedersen

Abstract: Given the role and influence of head coaches within the student-athlete experience, high school athletic directors must ensure that the most effective individuals are leading the sports in their athletic department. To provide a more thorough understanding of the coaching evaluation process, this study analyzed interscholastic athletic directors’ utilization of the performance appraisal process to evaluate the effectiveness of head coaches. Athletic directors (N=25) across school classification (i.e., 1A, 2A, 3A, and 4A) and school type (i.e., public and private) participated in the study, with saturation achieved through this sample size. The data were collected through semi-structured interviews and examined through thematic analysis. Three main themes emerged (i.e., elements of the coaching evaluation process, coaching evaluation form, and challenges in maximizing coaching evaluations) that provide deeper context into the key shared elements present within coaching appraisals in high school sports and describe how athletic directors engage in this evaluation process.

Keywords: performance appraisal, interscholastic athletics, high school sports, athletic director, head coach

Citation: Ratts, T., & Pedersen, P. M. (2023). Evaluating the evaluation: An analysis of how high school athletic directors engage in the performance appraisal process to determine coaching success. International Journal of Sport Management, 24(4), 342-375.

References

Atieno, O.P. (2009). An analysis of the strengths and limitation of qualitative and quantitative research paradigms. Problems of Education in the 21st Century, 13, 13-18.

Badau, D., Camarda, A., Serbanoiu, S., Virgil, T., Bondoc-Ionescu, D., & Badau, A. (2010). Performance management in sports for all. International Journal of Education and Information Technologies, 2(4), 83-90.

Barbieri, M., Micacchi, L., Vidè, F., & Valotti, G. (2023). The performance of performance appraisal systems: A theoretical framework for public organizations. Review of Public Personnel Administration, 43(1), 104-129.

Bayon, S. (2013). The origin, concept and value of performance appraisal. International Journal of Economics, Commerce and Management, 1(2), 1-17.

Bergen, N., & Labonté, R. (2020). “Everything is perfect, and we have no problems”: Detecting and limiting social desirability bias in qualitative research. Qualitative Health Research, 30(5), 783-792.

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77-101.

Brown, M., Hyatt, D., & Benson, J. (2010). Consequences of the performance appraisal experience. Personnel Review, 39(3), 375-396.

Conant, E.B. (2017). The impact of role conflict on job satisfaction of independent school athletic directors. Journal of Amateur Sport, 3(1), 1-26.

Creswell, J.W., & Guetterman, T.C. (2019). Educational research: Planning,
conducting, and evaluating quantitative and qualitative research (6th ed.). Pearson. 

Epstein, T.L. (2008). Prep plus: Evaluating the motivations for and effects of enrollment multipliers and other measures in high school sports. Texas Review of Entertainment and Sports Law, 10(1), 1-22.

Forsyth, E. (2021). Athletic director. In P. M. Pedersen (Ed.), Encyclopedia of sport management (pp. 40-42). Edward Elgar.

Forsyth, E.W., Martin, T.G., & Whisenant, W.A. (2022). Interscholastic athletics. In P.M. Pedersen & L. Thibault (Eds.), Contemporary sport management (7th ed., pp. 173-196). Human Kinetics.

Forsyth, E.W., Whisenant, W.A., Fraina, M., Johnson, J.E., & Stoffer, G. W. (2020). A mixed-methods approach to identifying administration issues pertinent to interscholastic sports. Journal of Amateur Sport, 6(1) 1-31.

Fraina, M., Forsyth, E., Johnson, J., & Whisenant, W. (2022, June 2-4). Current issues in interscholastic sport [Conference presentation]. 2022 North American Society for Sport Management Conference, Atlanta, GA.

Grant, S. (2021). Interscholastic athletics. In P.M. Pedersen (Ed.), Encyclopedia of sport management (pp. 266-268). Edward Elgar.

Grote, D., & Grote, R.C. (1996). The complete guide to performance appraisal. AMACOM.

Ha, J.P., Hums, M.A., & Greenwell, T.C. (2011). Dual role of physical education teacher-athletic directors in Korean secondary schools. Physical Educator, 68(4), 221-233.

Hill, G., & Pluschke, M. (2005). Criteria for evaluating high school coaches. Interscholastic Athletic Administration, 23(1), 14-15.

Hoch, D.A. (1989). The perceptions of Pennsylvania high school athletic directors and high school boys’ basketball coaches relative to the performance appraisal of the coach [Doctoral dissertation, Temple University].

Iqbal, M.Z., Akbar, S., & Budhwar, P. (2015). Effectiveness of performance appraisal: An integrated framework. International Journal of Management Reviews, 17(4), 510-533.

Johnson, J.E., Giannoulakis, C., & Scott, B.F. (2017). Interscholastic competitive balance: An examination of state athletic association administrators. Journal of Sport Management, 31(3), 256-274.

Johnson, J.E., Pierce, D.A., & Matz, D. (2023). Are we punishing success? An evaluation of the Indiana Tournament Success Factor and implications for interscholastic policy. Sports Innovation Journal, 1, 36-54.

Johnson, J.E., Scott, B.F., & Manwell, A.K. (2019). An examination of competitive balance and dominance within interscholastic football. Journal of Amateur Sport, 5(1), 21-49. 

Johnson, J.E., Tracy, D.R., & Pierce, D A. (2015). National review of interscholastic competitive balance solutions related to the public-private debate. Journal of Amateur Sport, 1(1), 29-51.

Judge, L.W., & Judge, I.L. (2009). Understanding the occupational stress of interscholastic athletic directors. ICHPER-SD Journal of Research, 4(2), 37-44.

Lin, Y.C., & Kellough, J.E. (2019). Performance appraisal problems in the public sector: Examining supervisors’ perceptions. Public Personnel Management, 48(2), 179-202.

MacLean, J.C. (2001). Performance appraisal for sport and recreation managers. Human Kinetics.

Merriam, S.B., & Tisdell, E.J. (2016). Qualitative research: A guide to design and implementation (4th ed.). Jossey-Bass.

Miracle, A.W.D., & Rees, C R. (2010). Lessons of the locker room: The myth of school sports. Prometheus Books.

Murphy, K.R., & Cleveland, J.N. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives. Sage.

NFHS. (2022). High school athletics participation survey. National Federation of State High School Associations. https://www.nfhs.org/media/5989280/2021-22_participation_survey.pdf

Nitika, N.K., & Arora, P. (2020). Performance appraisal in the era of new normal. Journal of Technology Management for Growing Economies, 11(1), 11-15.

O’Boyle, I. (2014). Determining best practice in performance monitoring and evaluation of sport coaches: Lessons from the traditional business environment. International Journal of Sports Science & Coaching, 9(1), 233-246.

Pichler, S. (2019). Performance appraisal reactions: A review and research agenda. In L.A. Steelman & J R. Williams (Eds.), Feedback at work (pp. 75-96). Springer.

Queirós, A., Faria, D., & Almeida, F. (2017). Strengths and limitations of qualitative and quantitative research methods. European Journal of Education Studies, 3(9), 369-387.

Shank, Z. & Brown, T. (Hosts). (2020, Oct. 11). End of season meetings (No. 9) [Audio podcast episode]. In The winning way.Anchor. https://anchor.fm/thewinningway/episodes/9–End-of-Season-Meetings-ekt357

Smith, B. (2018). Generalizability in qualitative research: Misunderstandings, opportunities and recommendations for the sport and exercise sciences. Qualitative Research in Sport, Exercise and Health, 10(1), 137-149. 

Smith, W.J., Harrington, K.V., & Houghton, J. D. (2000). Predictors of performance appraisal discomfort: A preliminary examination. Public Personnel Management, 29(1), 21-32.

Sullivan, G. S., Lonsdale, C., & Taylor, I. (2014). Burnout in high school athletic directors: A self-determination perspective. Journal of Applied Sport Psychology, 26(3), 256-270.

Surujlal, J. (2013). Appraising coach performance: A qualitative analysis of coaches’ perceptions. African Journal for Physical, Health Education, Recreation and Dance, 19(1), 30-43.

Taylor, T., Doherty, A., & McGraw, P. (2015). Performance management. In T. Taylor, A. Doherty, & P. McGraw (Eds.), Managing people in sport organizations: A strategic human resource management perspective (2nd ed., pp. 112-130). Routledge.

Thielges, B.A. (2015). Athletic director’s perceptions of evaluation and supervision practices in North Dakota [Master’s thesis, North Dakota State University]. 

Whisenant, W.A., & Pedersen, P.M. (2004). Traditional managerial activities and interscholastic athletic directors: Examining the differences, similarities, and connections between engagement, gender, and success of high school sports administrators. Public Organization Review, 4(1), 75-84.

Wiese, D.S., & Buckley, M.R. (1998). The evolution of the performance appraisal process. Journal of Management History, 4(3), 233-249.