Design and Fuzzy Delphi Validation of an Augmented Reality Ergonomics Training Module for Manual Material Handling Workers
Main Article Content
Abstract
Background: Manual material handling (MMH) workers are at high risk of developing work-related musculoskeletal disorders (WMSDs) resulting from repetitive lifting, awkward postures, and physically demanding tasks. Traditional ergonomics training methods are less engaging and may not effectively translate knowledge into safe workplace practices. This study aimed to develop and validate an Augmented Reality Physical Ergonomics (ARPE) training module to improve ergonomics knowledge, self-prevention behaviours, and self-evaluation skills among MMH workers.
Methods: The ARPE module was structured around three domains (knowledge, self-prevention, and self-evaluation), comprising 25 subdomains identified through a systematic review of ergonomics guidelines and relevant studies. Content validation was performed using the fuzzy Delphi method with a panel of 10 multidisciplinary experts. The relevance and clarity of each item were evaluated by the experts on a 7-point Likert scale. Responses were converted into triangular fuzzy numbers and analysed using consensus criteria of threshold values (d) ≤ 0.20, ≥ 75% expert agreement and α-cut ≥ 0.50.
Results: All 25 subdomains achieved expert consensus, confirming their relevance for ergonomics training among MMH workers. The validated framework emphasises knowledge of WMSDs and risk factors, proactive ergonomic practices, and workers’ ability to assess and adjust handling techniques.
Conclusion: The content validity of the ARPE module was confirmed, and a comprehensive foundation for immersive ergonomics training was established. Pilot trials and long-term studies are needed to evaluate the module’s usability among MMH workers and to assess its practicality, user acceptance, and effectiveness in improving workplace ergonomic practices.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Greggi C, Visconti VV, Albanese M, Gasperini B, Chiavoghilefu A, Prezioso C, et al. Work-related musculoskeletal disorders: a systematic review and meta-analysis. J Clin Med. 2024;13(13):3964. https://doi.org/10.3390/jcm13133964
Suganthirababu P, Parveen A, Mohan Krishna P, Sivaram B, Kumaresan A, Srinivasan V, et al. Prevalence of work-related musculoskeletal disorders among health care professionals: a systematic review. Work. 2023;74(2):455–467. https://doi.org/10.3233/WOR-211041
Dawad NA, Yasin SM, Darus A, Jamil AT, Naing NN. Modification of the Revised National Institute for Occupational Safety and Health (NIOSH) Lifting Equation to determine the individual manual lifting risk in Malaysia’s manufacturing industry. Cureus. 2024;16(4):e57747. https://doi.org/10.7759/cureus.57747
Shamsudin MZ, Vijayakumar V, Daud MYM, Adman MA, Arshad MA, Mustaffa MJ. Work-related musculoskeletal disorders among industrial packaging workers in Malaysia. Proc UNISEL Bestari Res Projects. 2016;2016:142–147.
Black NL. Human factors and ergonomics in an interconnected world: promising directions for the future—introduction to the IEA2021 special issue. Work. 2022;73(S1):S1–S3. https://doi.org/10.3233/WOR-223646
Joshi S, Hamilton M, Warren R, Faucett D, Tian W, Wang Y, et al. Implementing virtual reality technology for safety training in the precast/prestressed concrete industry. Appl Ergon. 2021;90:103286. https://doi.org/10.1016/j.apergo.2020.103286
Jaafar R, Libasin Z, Razali W. Knowledge of ergonomics among technical staff in University Technology of Mara Penang Malaysia. J Eng Technol (JET). 2019;10(2):220–226.
Jirapongsuwan A, Klainin-Yobas P, Songkham W, Somboon S, Pumsopa N, Bhatarasakoon P. The effectiveness of ergonomic intervention for preventing work-related musculoskeletal disorders in agricultural workers: a systematic review protocol. PLoS One. 2023;18(7):e0288131. https://doi.org/10.1371/journal.pone.0288131
Brown C, Hicks J, Rinaudo CH, Burch R. The use of augmented reality and virtual reality in ergonomic applications for education, aviation, and maintenance. Ergon Des. 2023;31(4):23–31. https://doi.org/10.1177/10648046211003469
Gong P, Lu Y, Lovreglio R, Lv X, Chi Z. Applications and effectiveness of augmented reality in safety training: a systematic literature review and meta-analysis. Saf Sci. 2024;178:106624. https://doi.org/10.1016/j.ssci.2024.106624
Mohamed MA, Dzulkifli SNM, Said AMM. Assessing the effectiveness of manual handling training in reducing forceful exertion for workers in a medical device manufacturing company. Prog Eng Appl Technol. 2025;6(1):658–667.
Zerguine H, Healy GN, Goode AD, Zischke J, Abbott A, Gunning L, et al. Online office ergonomics training programs: a scoping review examining design and user-related outcomes. Saf Sci. 2023;158:106000. https://doi.org/10.1016/j.ssci.2022.106000
Diego-Mas JA, Alcaide-Marzal J, Poveda-Bautista R. Effects of using immersive media on the effectiveness of training to prevent ergonomics risks. Int J Environ Res Public Health. 2020;17(7):2592. https://doi.org/10.3390/ijerph17072592
Sohrabi MS, Babamiri M. Effectiveness of an ergonomics training program on musculoskeletal disorders, job stress, quality of work-life and productivity in office workers: a quasi-randomized controlled trial study. Int J Occup Saf Ergon. 2022;28(3):1664–1671. https://doi.org/10.1080/10803548.2021.1918930
Kaufmann A, Gupta MM. Fuzzy mathematical models in engineering and management science. New York: Elsevier Science Inc.; 1988.
Hasim MA, Jabar J, Sufian A, Ibrahim NF, Khalid FA. Employing fuzzy Delphi techniques to validate the components and contents of e-learning antecedents and usage behavior towards e-learning performance. Eur J Educ Res. 2023;12(1):467–478. https://doi.org/10.12973/eu-jer.12.1.467
Abdollahpour N, Helali F. Implementing practical ergonomics knowledge transfer using ergonomic checkpoints to support the participatory ergonomics process in an industrially developing country. IISE Trans Occup Ergon Hum Factors. 2022;10(2):59–70. https://doi.org/10.1080/24725838.2022.2054880
Khoshakhlagh AH, Majdabadi MA, Yazdanirad S. The impact of ergonomic-educational interventions on reduction of musculoskeletal symptoms among employees of oil and gas installations in Iran. Work. 2022;71(3):651–660. https://doi.org/10.3233/WOR-205231
Chen CT. Extensions of the TOPSIS for group decision-making under fuzzy environment. Fuzzy Sets Syst. 2000;114(1):1–9. https://doi.org/10.1016/S0165-0114(97)00377-1
Hsieh TY, Lu ST, Tzeng GH. Fuzzy MCDM approach for planning and design tenders selection in public office buildings. Int J Proj Manag. 2004;22(7):573–584. https://doi.org/10.1016/j.ijproman.2004.01.002
Alias N, DeWitt D, Siraj S. Design and development of web-based learning environment using the fuzzy Delphi method. Asian Soc Sci. 2013;9(1):17–25.
Van de Wijdeven B, Visser B, Daams J, Kuijer PP. A first step towards a framework for interventions for individual working practice to prevent work-related musculoskeletal disorders: a scoping review. BMC Musculoskelet Disord. 2023;24:87. https://doi.org/10.1186/s12891-023-06155-w
European Agency for Safety and Health at Work. Work-related musculoskeletal disorders: prevalence, costs and demographics in the EU. Luxembourg: Publications Office of the European Union; 2022.
Nur NM, Rahman NAA, Majid ZA, Zulkefli NF, Zuhudi NZM. Ergonomics risk factors in manual handling tasks: a vital piece of information. In: Ismail A, Nur Zulkipli F, Jaafar J, Ochsner A, editors. Industrial Revolution in knowledge management and technology. Cham: Springer; 2023. p. 1–8. https://doi.org/10.1007/978-3-031-29265-1_1
Department of Occupational Safety and Health Malaysia. Guidelines for ergonomics risk assessment at workplace. Putrajaya (Malaysia): Ministry of Human Resources Malaysia; 2017.
Almaiah MA, Hajjej F, Lutfi A, Al-Khasawneh A, Alkhdour T, Almomani O, et al. A conceptual framework for determining quality requirements for mobile learning applications using Delphi method. Electronics. 2022;11(5):788. https://doi.org/10.3390/electronics11050788
Jamil M, Siraj S, Hussin Z, Nordin N. Application of fuzzy Delphi method in educational research: Recent trends and methodological considerations. Educ Sci. 2023;13(4):372.
Hoe VCW, Urquhart DM, Kelsall HL, Zamri EN, Sim MR. Ergonomic interventions for preventing work-related musculoskeletal disorders of the upper limb and neck among office workers. Cochrane Database Syst Rev. 2018;2018(10):CD008570. https://doi.org/10.1002/14651858.CD008570.pub3
Adler M, Ziglio E. Gazing into the oracle: the Delphi method and its application to social policy and public health. London: Jessica Kingsley Publishers; 1996.
Akbari R, Yazdanmehr E. A critical analysis of the selection criteria of expert teachers in ELT. Theory Pract Lang Stud. 2014;4(8):1653–1658. https://doi.org/10.4304/tpls.4.8.1653-1658
Department of Statistics Malaysia. Big Data Analytics: National Occupational Accident and Disease Statistics 2021 [Internet]. Putrajaya (Malaysia): Department of Statistics Malaysia; 2022 [Retrieved 2026 May 6]. Available at: https://www.dosm.gov.my/uploads/content-downloads/file_20221011121810.pdf
Mani K, Provident I, Eckel E. Evidence-based ergonomics education: promoting risk factor awareness among office computer workers. Work. 2016;55(4):913–922. https://doi.org/10.3233/WOR-162457
Tang KHD. The prevalence, causes and prevention of occupational musculoskeletal disorders. Glob Acad J Med Sci. 2022;4(2):56–68. https://doi.org/10.36348/gajms.2022.v04i02.004
Hsu CC, Hsieh CL. Applying fuzzy Delphi method to evaluate the criteria of health education websites. Expert Syst Appl. 2004;36(1):141–148.
Habibi A, Sarafrazi A, Izadyar S. Delphi technique theoretical framework in qualitative research. Int J Eng Adv Technol. 2021;10(1):254–260.
Thomaidis NS, Nikitakos N, Dounias G. The evaluation of logistics services using a fuzzy Delphi method. Int J Logist Syst Manag. 2006;2(2):170–184.
Murry JW, Hammons JO. Delphi: a versatile methodology for conducting qualitative research. Rev High Educ. 1995;18(4):423–436. https://doi.org/10.1353/rhe.1995.0008
Sossa JWZ, Henao JAM, Manuel J, Montes H, Juan C, Palacio P, et al. Delphi method in emerging technologies. Int J Innov Creat Change. 2020;14(10):1210–1230.
Hogan DA, Greiner BA, O’Sullivan L. The effect of manual handling training on achieving training transfer, employees’ behaviour change and subsequent reduction of work-related musculoskeletal disorders: a systematic review. Ergonomics. 2014;57(1):93–107. https://doi.org/10.1080/00140139.2013.862307
Hignett S. Intervention strategies to reduce musculoskeletal injuries associated with handling patients: a systematic review. Occup Environ Med. 2003;60(9):e6. https://doi.org/10.1136/oem.60.9.e6
Santos W, Rojas C, Isidoro R, Lorente A, Dias A, Mariscal G, et al. Efficacy of ergonomic interventions on work-related musculoskeletal pain: a systematic review and meta-analysis. J Clin Med. 2025;14(9):3034. https://doi.org/10.3390/jcm14093034
Zhao YS, Jaafar MH, Mohamed ASA, Azraai NZ, Amil N. Ergonomic risk assessment for manual material handling in warehouse activities involving high- and low-shelf binning processes: application of marker-based motion capture. Sustainability. 2022;14(10):5767. https://doi.org/10.3390/su14105767
Hilmi AH, Hamid ARA, Ibrahim WARAW. Recent advances in ergonomic posture research: assessing innovations in occupational health and musculoskeletal disorder prevention. Malays J Ergon. 2024;6(1):76–89. https://doi.org/10.58915/mjer.v6.2024.1310
Van Eerd D, Irvin E, Le Pouésard M, Butt A, Nasir K. Workplace musculoskeletal disorder prevention practices and experiences. Inquiry. 2022;59:00469580221092132. https://doi.org/10.1177/00469580221092132
Rahman IBA. Usability evaluation of manual material handling equipment used by manufacturing industries in warehouse operation. Batu Pahat (Malaysia): Universiti Tun Hussein Onn Malaysia; 2023.
Bower M, Howe C, McCredie N, Robinson A, Grover D. Augmented reality in education: cases, places and potentials. Educ Media Int. 2014;51(1):1–15. https://doi.org/10.1080/09523987.2014.889400
Kobayashi M, Ueno K, Ise S. The effects of spatialized sounds on the sense of presence in auditory virtual environments: a psychological and physiological study. Presence Teleoperators Virtual Environ. 2015;24(2):163–174. https://doi.org/10.1162/PRES_a_00226
George G, Lal AM. Review of ontology-based recommender systems in e-learning. Comput Educ. 2019;142:103642. https://doi.org/10.1016/j.compedu.2019.103642
Radianti J, Majchrzak TA, Fromm J, Wohlgenannt I. A systematic review of immersive virtual reality applications for higher education: design elements, lessons learned, and research agenda. Comput Educ. 2020;147:103778. https://doi.org/10.1016/j.compedu.2019.103778
Lind CM. Effectiveness of sensors-based augmented feedback in ergonomics to reduce adverse biomechanical exposure in work-related manual handling: a rapid review of the evidence. Sensors. 2024;24(21):6977. https://doi.org/10.3390/s24216977