Contemporary Hybrid Laboratory Pedagogy: Construction of A Simple Spectrophotometer with STEM Project-Based Learning to Introduce Systems Thinking Skills

Main Article Content

Ari Syahidul Shidiq
Anna Permanasari
Hernani
Sumar Hendayana

Abstract

Hands-on laboratory activities are a vital aspect of chemistry education that can help students strengthen their understanding of chemistry’s core concepts and applications. Nevertheless, during the COVID-19 pandemic, students and teachers could not access laboratories. Thus, innovative pedagogical approaches are required to meet these challenges. The current study, therefore, examines the use of contemporary hybrid laboratory pedagogy to construct a simple spectrophotometer by implementing Science, Technology, Engineering, and Mathematics (STEM) project-based learning to introduce systems thinking skills and measure the effectiveness of improving attitude. A quantitative approach, with one group pre-post design, was employed in this study. The subjects were 33 chemistry students from a state university in Bandung, Indonesia. A simple Atomic Absorption Spectrophotometer (AAS) was chosen as the topic of an engineering project given to students. The project was implemented over fourteen meetings designed in a hybrid laboratory activity. The students’ worksheets, questionnaires on students’ attitudes toward systems thinking skills, and a questionnaire on student attitudes toward STEM-project-based learning were used as research instruments. Additionally, interviews with selected students further supported the quantitative data. Following the intervention, a RASCH: racking and stacking analysis revealed that two of the eight systems thinking skills indicators showed noticeable results. Other results uncovered that the student-made simple AAS had an accuracy of 95.3% compared to commercial AAS. This study also demonstrated that students had a negative attitude toward implementing STEM project-based learning. In contrast, students’ attitudes towards systems thinking skills indicated positive results. Challenges and opportunities for further research are also discussed in this paper.

Article Details

Section
Articles

References

Acar Sesen, B., & Tarhan, L. (2013). Inquiry-based laboratory activities in electrochemistry: High school students’ achievements and attitudes. Research in Science Education, 43(1), 413–435. https://doi.org/10.1007/s11165-011-9275-9

Adams, D., Chuah, K. M., Mohamed, A., & Sumintono, B. (2022). Bricks to clicks: Students’ engagement in e-learning during the COVID-19 pandemic. Asia Pacific Journal of Educators and Education, 36(2), 99–117. https://doi.org/10.21315/apjee2021.36.2.6

Aiken, L. R. (1980). Content validity and reliability of single items or questionnaires. Educational and Psychological Measurement, 40(4), 955–959.

Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–141. https://doi.org/10.1177/0013164485451012

Albert, D. R., Todt, M. A., & Davis, H. F. (2012). A low-cost quantitative absorption spectrophotometer. Journal of Chemical Education, 89(11), 1432–1435.

Arnold, R. D., & Wade, J. P. (2015). A definition of systems thinking: A systems approach. Procedia Computer Science, 44(C), 669–678. https://doi.org/10.1016/j.procs.2015.03.050

Assaraf, O. B.-Z., & Orion, N. (2005). Development of system thinking skills in the context of earth system education. Journal of Research in Science Teaching, 42(5), 518–560. https://doi.org/10.1002/tea.20061

Assaraf, O. B.-Z., & Orion, N. (2010). Four case studies, six years later: Developing system thinking skills in junior high school and sustaining them over time. Journal of Research in Science Teaching, 47(10), 1253–1280. https://doi.org/10.1002/tea.20383

Basham, J. D., & Marino, M. T. (2013). Understanding STEM Education and supporting students through universal design for learning. TEACHING Exceptional Children, 45(4), 8–15. https://doi.org/10.1177/004005991304500401

Basilaia, G., & Kvavadze, D. (2020). Transition to online education in schools during a SARS-CoV-2 Coronavirus (COVID-19) Pandemic in Georgia. Pedagogical Research, 5(4), em0060. https://doi.org/10.29333/pr/7937

Beier, M. E., Kim, M. H., Saterbak, A., Leautaud, V., Bishnoi, S., & Gilberto, J. M. (2019). The effect of authentic project-based learning on attitudes and career aspirations in STEM. Journal of Research in Science Teaching, 56(1), 3–23. https://doi.org/10.1002/tea.21465

Bernard, P., Bro?, P., & Migda?-Mikuli, A. (2017). Influence of blended learning on outcomes of students attending a general chemistry course: Summary of a five-yearlong study. Chemistry Education Research and Practice, 18(4), 682–690. https://doi.org/10.1039/c7rp00040e

Blotnicky, K. A., Franz-odendaal, T., French, F., & Joy, P. (2018). A study of the correlation between STEM career knowledge, mathematics self- efficacy, career interests, and career activities on the likelihood of pursuing a STEM career among middle school students. International Journal of STEM Education, 5(22), 1–15.

Boschmann, E. (2003). Teaching chemistry via distance education. Journal of Chemical Education, 80(6), 704–708. https://doi.org/10.1021/ed080p704

Burmeister, M., Rauch, F., & Eilks, I. (2012). Education for Sustainable Development (ESD) and chemistry education. Chemistry Education Research and Practice, 13(2), 59–68. https://doi.org/10.1039/c1rp90060a

Burrows, A., & Slater, T. (2015). A proposed integrated STEM framework for contemporary teacher preparation. Teacher Education and Practice, 28(2), 318–330.

Capraro, R. M., Capraro, M. M., & Morgan, J. R. (Eds.) (2013). STEM project-based learning: An integrated science, technology, engineering, and mathematics (STEM) approach. Sense Publisher. https://doi.org/10.1007/978-94-6209-143-6

Capraro, R. M., & Corlu, M. S. (2013). Changing views on assessment for STEM projectbased learning. In R. M. Capraro, M. M. Capraro, & J. R. Morgan, J. R. (Eds.), STEM project-based learning: An integrated science, technology, engineering, and mathematics (STEM) approach (pp. 109–118). Sense Publisher. https://doi.org/10.1007/978-94-6209-143-6_12

Chaiwongsa, P., Kinboon, N., & Yanasarn, N. (2019). STEM – Play, learn and work: STEM education in academic club based on community and local products to improve a positive attitude towards STEM. Journal of Physics: Conference Series, 1340(1), 012004. https://doi.org/10.1088/1742-6596/1340/1/012004

Chan, S. W., Looi, C. K., & Sumintono, B. (2021). Assessing computational thinking abilities among Singapore secondary students: a Rasch model measurement analysis. Journal of Computers in Education, 8(2), 213–236. https://doi.org/10.1007/s40692-020-00177-2

Chiu, M. H., Mamlok-Naman, R., & Apotheker, J. (2019). Identifying systems thinking components in the school science curricular standards of four countries. Journal of Chemical Education, 96(12), 2814–2824. https://doi.org/10.1021/acs.jchemed.9b00298

Clippard, C. M., Hughes, W., Chohan, B. S., & Sykes, D. G. (2016). Construction and characterization of a compact, portable, low-cost colorimeter for the chemistry lab. Journal of Chemical Education, 93(7), 1241–1248. https://doi.org/10.1021/acs.jchemed.5b00729

Connor, A. M., Karmokar, S., & Whittington, C. (2015). From STEM to STEAM: Strategies for enhancing engineering & technology education. International Journal of Engineering Pedagogy (IJEP), 5(2), 37. https://doi.org/10.3991/ijep.v5i2.4458

Constable, D. J. C., Jiménez-González, C., & Matlin, S. A. (2019). Navigating complexity using systems thinking in chemistry, with implications for chemistry education. Journal of Chemical Education, 96(12), 2689–2699. https://doi.org/10.1021/acs.jchemed.9b00368

Destino, J. F., Gross, E. M., Niemeyer, E. D., & Petrovic, S. C. (2021). Hands-on experiences for remotely taught analytical chemistry laboratories. Analytical and Bioanalytical Chemistry, 413(5), 1237–1244. https://doi.org/10.1007/s00216-020-03142-1

Diawati, C., Liliasari, Setiabudi, A., & Buchari. (2018). Using project-based learning to design, build, and test student-made photometer by measuring the unknown concentration of colored substances. Journal of Chemical Education, 95(3), 468–475. https://doi.org/10.1021/acs.jchemed.7b00254

Enneking, K. M., Breitenstein, G. R., Coleman, A. F., Reeves, J. H., Wang, Y., & Grove, N. P. (2019). The evaluation of a hybrid, general chemistry laboratory curriculum: Impact on students’ cognitive, affective, and psychomotor learning. Journal of Chemical Education, 96(6), 1058–1067. https://doi.org/10.1021/acs.jchemed.8b00637

Evans, N. S., Stevenson, R. B., Lasen, M., Ferreira, J. A., & Davis, J. (2017). Approaches to embedding sustainability in teacher education: A synthesis of the literature. Teaching and Teacher Education, 63, 405–417. https://doi.org/10.1016/j.tate.2017.01.013

Fabian, K., Topping, K. J., & Barron, I. G. (2016). Mobile technology and mathematics: Effects on students’ attitudes, engagement, and achievement. Journal of Computers in Education, 3(1), 77–104. https://doi.org/10.1007/s40692-015-0048-8

Flynn, A. B., Orgill, M., Ho, F. M., York, S., Matlin, S. A., Constable, D. J. C., & Mahaffy, P. G. (2019). Future directions for systems thinking in chemistry education: Putting the pieces together. Journal of Chemical Education, 96(12), 3000–3005. https://doi.org/10.1021/acs.jchemed.9b00637

Frank, M., Zwikael, O., & Boasson, M. (2007). Jobs requiring a Capacity for Engineering Systems Thinking (CEST): Selection using an interest inventory. Project Management Journal, 38(3), 36–44. https://doi.org/10.1002/pmj.20004

Fuad, M., Ariyani, F., Suyanto, E., & Shidiq, A. S. (2020). Exploring eachers’ TPCK: Are Indonesian language teachers ready for online learning during the COVID-19 outbreak? Universal Journal of Educational Research, 8(11B), 6091–6102. https://doi.org/10.13189/ujer.2020.082245

Gero, A., & Zach, E. (2014). High school programme in electro-optics: A case study on interdisciplinary learning and systems thinking. International Journal of Engineering Education, 30(5), 1190–1199.

Gordon, R. A., Peng, F., Curby, T. W., & Zinsser, K. M. (2021). An introduction to the many-facet Rasch model as a method to improve observational quality measures with an application to measuring the teaching of emotion skills. Early Childhood Research Quarterly, 55, 149–164. https://doi.org/10.1016/j.ecresq.2020.11.005

Gravano, D. M., Chakraborty, U., Pesce, I., & Thomson, M. (2021). Solutions for shared resource lab remote quality control and instrument troubleshooting during a pandemic. Cytometry Part A, 99(1), 51–59. https://doi.org/10.1002/cyto.a.24266

Günter, T., Akkuzu, N., & Alpat, ?. (2017). Understanding ‘green chemistry’ and ‘sustainability’: An example of problem-based learning (PBL). Research in Science and Technological Education, 35(4), 500–520. https://doi.org/10.1080/02635143.2017.13 53964

Hammond, D. (2002). Exploring the genealogy of systems thinking. Systems Research and Behavioral Science, 439( June), 429–439.

Han, S., Rosli, R., Capraro, M. M., & Capraro, R. M. (2016). The effect of science, technology, engineering and mathematics (STEM) project based learning (PBL) on students’ achievement in four mathematics topics. Journal of Turkish Science Education, 13(Special Issue), 3–30. https://doi.org/10.12973/tused.10168a

Hascher, T., Cocard, Y., & Moser, P. (2004). Forget about theorypractice is all? Student teachers’ learning in practicum. Teachers and Teaching: Theory and Practice, 10(6), 623– 637. https://doi.org/10.1080/1354060042000304800

Hoole, D., & Sithambaresan, M. (2003). Analytical chemistry labs with kits and CD-based instructions as teaching aids for distance learning. Journal of Chemical Education, 80(11), 1308–1310. https://doi.org/10.1021/ed080p1308

Huang, S., Muci-Kuchler, K. H., Bedillion, M. D., Ellingsen, M. D., & Degen, C. M. (2015). Systems thinking skills of undergraduate engineering students. Paper presented at 2015 IEEE Frontiers in Education Conference, FIE 2015, 21–24 October. ASEE Educational Research and Methods Division; IE. https://doi.org/10.1109/FIE.2015.7344341

Huri, N. H. D., & Karpudewan, M. (2019). Evaluating the effectiveness of Integrated STEM-lab activities in improving secondary school students’ understanding of electrolysis. Chemistry Education Research and Practice, 20(3), 495–508. https://doi.org/10.1039/c9rp00021f

Irby, S. M., Borda, E. J., & Haupt, J. (2018). Effects of implementing a hybrid wet lab and online module lab curriculum into a general chemistry course: Impacts on student performance and engagement with the chemistry triplet. Journal of Chemical Education, 95(2), 224–232. https://doi.org/10.1021/acs.jchemed.7b00642

Jegstad, K. M., & Sinnes, A. T. (2015). Chemistry teaching for the future: A model for secondary chemistry education for sustainable development. International Journal of Science Education, 37(4), 655–683. https://doi.org/10.1080/09500693.2014.1003988

Juanda, A., Shidiq, A. S., & Nasrudin, D. (2021). Teacher learning management: Investigating biology teachers’ TPACK to conduct learning during the covid-19 outbreak. Jurnal Pendidikan IPA Indonesia, 10(1), 48–59. https://doi.org/10.15294/jpii.v10i1.26499

Karpudewan, M., Hj Ismail, Z., & Mohamed, N. (2009). The integration of green chemistry experiments with sustainable development concepts in pre?service teachers’ curriculum. International Journal of Sustainability in Higher Education, 10(2), 118–135. https://doi.org/10.1108/14676370910945936

Karpudewan, M., Ismail, Z., & Roth, W. M. (2012a). Fostering pre-service teachers’ selfdetermined environmental motivation through green chemistry experiments. Journal of Science Teacher Education, 23(6), 673–696. https://doi.org/10.1007/s10972-012-9298-8

Karpudewan, M., Ismail, Z., & Roth, W. M. (2012b). Promoting pro-environmental attitudes and reported behaviors of Malaysian pre-service teachers using green chemistry experiments. Environmental Education Research, 18(3), 375–389. https://doi.org/10.1080/13504622.2011.622841

Karpudewan, M., Ismail, Z., & Roth, W. M. (2012c). The efficacy of a green chemistry laboratory-based pedagogy: changes in environmental values of malaysia pre-service teachers. International Journal of Science and Mathematics Education, 10(3), 497–529. https://doi.org/10.1007/s10763-011-9295-y

Karpudewan, M., & Kulandaisamy, Y. (2018). Malaysian teachers’ insights into implementing green chemistry experiments in secondary schools. Current Opinion in Green and Sustainable Chemistry, 13, 113–117. https://doi.org/10.1016/j.cogsc.2018.06.015

Karpudewan, M., Michael Roth, W., & Sinniah, D. (2016). The role of green chemistry activities in fostering secondary school students’ understanding of acid-base concepts and argumentation skills. Chemistry Education Research and Practice, 17(4), 893–901. https://doi.org/10.1039/c6rp00079g

Karpudewan, M., Roth, W. M., & Abdullah, M. N. S. (2015). Enhancing primary school students’ knowledge about global warming and environmental attitude using climate change activities. International Journal of Science Education, 37(1), 31–54. https://doi.org/10.1080/09500693.2014.958600

Karpudewan, M., Roth, W. M., & Ismail, Z. (2015). The effects of “green chemistry” on secondary school students’ understanding and motivation. Asia-Pacific Education Researcher, 24(1), 35–43. https://doi.org/10.1007/s40299-013-0156-z

Karpudewan, M., Ismail, Z. H., & Mohamed, N. (2011). Green chemistry: Educating prospective science teachers in education for sustainable development at School of Educational Studies, USM. Journal of Social Sciences, 7(1), 42–50. https://doi.org/10.3844/jssp.2011.45.53

Kartimi, Shidiq, A. S., & Nasrudin, D. (2021). The elementary teacher readiness toward stem-based contextual learning in 21st century era. Elementary Education Online, 20(1), 145–156. https://doi.org/10.17051/ilkonline.2021.01.019

Katehi, L., Pearson, G., & Feder, M. (Eds.) (2009). Engineering in K-12 education: Understanding the status and improving the prospects. National Academy of Engineering and National Research Council. https://doi.org/10.17226/12635

Kelley, E. W. (2021). LAB theory, HLAB pedagogy, and review of laboratory learning in chemistry during the Covid-19 pandemic. Journal of Chemical Education, 98(8), 2496–2517. https://pubs.acs.org/doi/abs/10.1021/acs.jchemed.1c00457

Kennepohl, D. (2001). Using computer simulations to supplement teaching laboratories in chemistry for distance delivery. International Journal of E-Learning & Distance Education, 16(2), 58–65.

Kennepohl, D. (2021). Laboratory activities to support online chemistry courses: A literature review. Canadian Journal of Chemistry, 99(11), 851–859. https://doi.org/10.1139/cjc2020-0506

Khanlari, A. (2014). Effects of educational robots on learning STEM and on students’ attitude toward STEM. 2013 IEEE 5th International Conference on Engineering Education: Aligning Engineering Education with Industrial Needs for Nation Development, ICEED 2013, 1, 62–66. https://doi.org/10.1109/ICEED.2013.6908304

Khatri, R., Henderson, C., Cole, R., Froyd, J. E., Friedrichsen, D., & Stanford, C. (2017). Characteristics of well-propagated teaching innovations in undergraduate STEM. International Journal of STEM Education, 4(1), Article No. 2. https://doi.org/10.1186/s40594-017-0056-5

Kidd, W., & Murray, J. (2020). The Covid-19 pandemic and its effects on teacher education in England: How teacher educators moved practicum learning online. European Journal of Teacher Education, 43(4), 542–558. https://doi.org/10.1080/02619768.2020.1820480

Kilinc, A. (2007). The opinions of Turkish high school pupils on inquiry based laboratory activities. The Turkish Online Journal of Educational Technology, 6(4), 56–71.

King, S. M., Zhou, N., Fischer, C., Rodriguez, F., & Warschauer, M. (2019). Enhancing student learning and retention in organic chemistry: Benefits of an online organic chemistry preparatory course. In S. K. Hartwell, & T. Gupta (Eds.), From general to organic chemistry: Courses and curricula to enhance student retention (pp. 119–128). American Chemical Society. https://doi.org/10.1021/bk-2019-1341.ch009

Kolopajlo, L. (2017). Green chemistry pedagogy. Physical Sciences Reviews, 2(2), 1–17. https://doi.org/10.1515/psr-2016-0076

Lafratta, C. N., Jain, S., Pelse, I., Simoska, O., & Elvy, K. (2013). Using a homemade flame photometer to measure sodium concentration in a sports drink. Journal of Chemical Education, 90(3), 372–375. https://doi.org/10.1021/ed3004758

Laliyo, L. A. R., Sumintono, B., & Panigoro, C. (2022). Measuring changes in hydrolysis concept of students taught by inquiry model: stacking and racking analysis techniques in Rasch model. Heliyon, 8(3), e09126. https://doi.org/10.1016/j.heliyon.2022.e09126

Lewis, E., Mansfield, C., & Baudains, C. (2014). Ten Tonne plan: Education for sustainability from a whole systems thinking perspective. Applied Environmental Education and Communication, 13(2), 128–141. https://doi.org/10.1080/1533015X.2014.950890

Mahaffy, P. G., Brush, E. J., Haack, J. A., & Ho, F. M. (2018). Journal of Chemical Education call for papers – Special Issue on Reimagining Chemistry Education: Systems Thinking, and Green and Sustainable Chemistry. Journal of Chemical Education, 95(10), 1689–1691. https://doi.org/10.1021/acs.jchemed.8b00764

Mahaffy, P. G., Ho, F. M., Haak, J. A., & Brush, E. J. (2019). Can chemistry be a central science without systems thinking? [Editorial]. Journal of Chemical Education, 96(December), 2679–2681. https://doi.org/10.1021/acs.jchemed.9b00991

Mahaffy, P. G., Krief, A., Hopf, H., Mehta, G., & Matlin, S. A. (2018). Reorienting chemistry education through systems thinking. Nature Reviews Chemistry, 2(4), 1–3. https://doi.org/10.1038/s41570-018-0126

Mammino, L. (2019). Roles of systems thinking within green chemistry education: Reflections from identified challenges in a disadvantaged context. Journal of Chemical Education, 96(12), 2881–2887. https://doi.org/10.1021/acs.jchemed.9b00302

Manunure, K., Delserieys, A., Castéra, J., Manunure, K., & Delserieys, A. (2019). The effects of combining simulations and laboratory experiments on Zimbabwean students’ conceptual understanding of electric circuits understanding of electric circuits. Research in Science & Technological Education, 38(3), 289–307. https://doi.org/10.1080/02635143.2019.1629407

Marvin, M. C. (2020). Microsoft OneNote provides continuity for undergraduate biochemistry lab during a pandemic. Biochemistry and Molecular Biology Education, 48(5), 523–525. https://doi.org/10.1002/bmb.21437

Moraes, E. P., Da Silva, N. S. A., De Morais, C. D. L. M., Das Neves, L. S., & De Lima, K. M. G. (2014). Low-cost method for quantifying sodium in coconut water and seawater for the undergraduate analytical chemistry laboratory: Flame test, a mobile phone camera, and image processing. Journal of Chemical Education, 91(11), 1958– 1960. https://doi.org/10.1021/ed400797k

Murphy, M. P. A. (2020). Contemporary security policy COVID-19 and emergency eLearning: Consequences of the securitization of higher education for post-pandemic pedagogy. Contemporary Security Policy, 41(3), 492–505. https://doi.org/10.1080/13523260.2020.1761749

Nasution, A. K. P. (2022). Education technology research trends in Indonesia during the Covid-19 pandemic. Asia Pacific Journal of Educators and Education, 36(2), 65–76. https://doi.org/10.21315/apjee2021.36.2.4

Néel, B., Crespo, G. A., Perret, D., Cherubini, T., Bakker, E., Ne?el, B., Crespo, A. G., Perret, D., Cherubini, T., & Bakker, E. (2014). Camping burner-based flame emission spectrometer for classroom demonstrations. Journal of Chemical Education, 91(10), 1655–1660. https://doi.org/10.1021/ed4008149

Niaz, M. (2005). How to facilitate students ’ conceptual understanding of chemistry ? A history and philosophy of science perspective. Chemical Education International, 6(1), 1–5.

Patterson, M. J. (2000). Developing an internet-based chemistry class. Journal of Chemical Education, 77(5), 554–555. https://doi.org/10.1021/ed077p554

Pazicni, S., & Flynn, A. B. (2019). Systems thinking in chemistry education: Theoretical challenges and opportunities. Journal of Chemical Education, 96(12), 2752–2763. https://doi.org/10.1021/acs.jchemed.9b00416

Pinasa, S., & Srisook, L. (2019). STEM education project-based and robotic learning activities impacting on creativity and attitude of grade 11 students in Khon Kaen Wittayayon School. Journal of Physics: Conference Series, 1340(1), 012038. https://doi.org/10.1088/1742-6596/1340/1/012038

Porter, L. A. (2018). 3D printable resources for engaging STEM students in laboratory learning activities and outreach programs: Inexpensive and user-friendly instrument kits for educators. Materials Research Society (MRS) Advances, 3(49), 2937–2942. https://doi.org/10.1557/adv.2018.441

Purnami, W., Ashadi, Suranto, Sarwanto, Sumintono, B., & Wahyu, Y. (2021). Investigation of person ability and item fit instruments of eco critical thinking skills in basic science concept materials for elementary pre-service teachers. Jurnal Pendidikan IPA Indonesia, 10(1), 127–137. https://doi.org/10.15294/jpii.v10i1.25239

Ramos, S., Pimentel, E. P., Marietto, M. das G. B., & Botelho, W. T. (2016). Hands-on and virtual laboratories to undergraduate chemistry education: Toward a pedagogical integration. Paper presented at the 2016 IEEE Frontiers in Education Conference (FIE), November, 1–8. https://doi.org/10.1109/FIE.2016.7757580

Reid, N., & Shah, I. (2007). The role of laboratory work in university chemistry. Chemistry Education Research and Practice, 8(2), 172–185. https://doi.org/10.1039/B5RP90026C

Rezayat, F., & Sheu, M. (2020). Attitude and readiness for stem education and careers: A comparison between American and Chinese students. International Journal of Educational Management, 34(1), 111–126. https://doi.org/10.1108/IJEM-07-2018- 0200

Richmond, B. (1994). Systems thinking/system dynamics: Let’s just get on with it. System Dynamics Review, 10(2–3), 135–157. https://doi.org/10.1002/sdr.4260100204

Sampson, D., Ifenthaler, D., Spector, J. M., & Isaías, P. (2018). Digital technologies: Sustainable innovations for improving teaching and learning. Springer International Publishing AG. https://doi.org/10.1007/978-3-319-73417-0

Saptarani, D., Widodo, A., & Purwianingsih, W. (2019). Biology teachers and high school students perceptions about STEM learning. Journal of Physics: Conference Series, 1157(4), 0–6. https://doi.org/10.1088/1742-6596/1157/4/042007

Scruggs, A. W., Leamy, K. A., Cravens, S. L., & Siegel, S. J. (2020). Adapting a biochemistry lab course for distance-learning during the Covid-19 pandemic. Journal of Chemical Education, 97(9), 2981–2986. https://doi.org/10.1021/acs.jchemed.0c00699

Shidiq, A. S., Permanasari, A., & Hernani. (2020a). Chemistry teacher’s perception toward STEM learning. ACM International Conference Proceeding Series, 40–43. https://doi.org/10.1145/3392305.3396901

Shidiq, A. S., Permanasari, A., & Hernani. (2020b). Pre-Service and in-service chemistry teachers’ views on teaching spectrometry in senior high school. Journal of Engineering Science and Technology, Special Issue on AASEC2019, 80–88.

Shidiq, A. S., Permanasari, A., & Hernani, H. (2020c). Simple, portable, and inexpensive spectrophotometers for high schools lab activity. In Advances in Social Science, Education and Humanities Research Series (vol. 438, pp. 150–154). Atlantis Press. https://doi.org/10.2991/assehr.k.200513.034

Shidiq, A. S., Permanasari, A., Hernani, H., & Hendayana, S. (2021a). The use of simple spectrophotometer in STEM education: A bibliometric analysis. Moroccan Journal of Chemistry, 9(2), 290–300. https://doi.org/10.48317/IMIST.PRSM/morjchemv9i2.27581

Shidiq, A. S., Permanasari, A., Hernani, & Hendayana, S. (2021b). Chemistry teacher responses to learning in the COVID-19 outbreak: Challenges and opportunities to create innovative lab-work activities. Journal of Physics: Conference Series, 1806(1), 012195. https://doi.org/10.1088/1742-6596/1806/1/012195

Shin, S., Rachmatullah, A., & Roshayanti, F. (2018). Career motivation of secondary students in STEM: A cross-cultural study between Korea and Indonesia. International Journal for Educational and Vocational Guidance, 18(2), 203–231. https://doi.org/10.1007/s10775-017-9355-0

Sumintono, B., & Widhiarso, W. (2014a). Aplication of Rasch model for social research. Trim Komunikata Publishing House.

Sumintono, B., & Widhiarso, W. (2014b). Aplikasi model Rasch untuk penelitian ilmu-ilmu sosial. Trim Komunikata Publishing House.

Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan RASCH pada assessment pendidikan. Trum Komunikata Publishing House.

Sunjaya, Deni K., Herawati, D. M. D., Puteri, D. P., & Sumintono, B. (2021). Development and sensory test of eel cookies for pregnant women with chronic energy deficiency using many facet Rasch model: A preliminary study. Progress in Nutrition, 23(2), e2021054. https://doi.org/10.23751/pn.v23i2.10040

Sunjaya, Deni K.,Herawati, D. M. D., Indraswari, N., Megawati, G., & Sumintono, B. (2021). Training and assessing model for the ability of community health volunteers in anthropometric measurement using the rasch stacking and racking analyses. Journal of Environmental and Public Health, 2021, 1–11. https://doi.org/10.1155/2021/5515712

Sunjaya, Deni K., Sumintono, B., Gunawan, E., Herawati, D. M. D., & Hidayat, T. (2022). Online mental health survey for addressing psychosocial condition during the Covid-19 pandemic in indonesia: Instrument evaluation. Psychology Research and Behavior Management, 15, 161–170. https://doi.org/10.2147/PRBM.S347386

Talanquer, V. (2019). Some insights into assessing chemical systems thinking. Journal of Chemical Education, 96(12), 2918–2925. https://doi.org/10.1021/acs.jchemed.9b00218

Tan, L., Balakrishnan, N., & Varma, N. (2022). Teaching ST concepts during a pandemic: Modes for engaging learners. Asia Pacific Journal of Educators and Education, 37(1), 157–179. https://doi.org/10.21315/apjee2022.37.1.8

Tarhan, L., & Sesen, B. A. (2010). Investigation the effectiveness of laboratory works related to “acids and bases” on learning achievements and attitudes toward laboratory. Procedia Social and Behavioral Sciences, 2, 2631–2636. https://doi.org/10.1016/j.sbspro.2010.03.385

Togou, M. A., Lorenzo, C., Cornetta, G., & Muntean, G.-M. (2020). Assessing the effectiveness of using fab lab-based learning in schools on K-12 students’ attitude toward STEAM. IEEE Transactions on Education, 63(1), 56–62. https://doi.org/10.1109/TE.2019.2957711

Wahono, B., & Chang, C. Y. (2019). Development and validation of a survey instrument (AKA) towards attitude, knowledge and application of STEM. Journal of Baltic Science Education, 18(1), 63–76.

Wakabayashi, F., & Hamada, K. (2006). Cost-effective teacher a DVD spectroscope: A simple , high-resolution classroom spectroscope. Journal of Chemical Education, 83(1), 56–58.

Wigton, B. T., Chohan, B. S., McDonald, C., Johnson, M., Schunk, D., Kreuter, R., & Sykes, D. (2011). A portable, low-cost, LED fluorimeter for middle school, high school, and undergraduate chemistry labs. Journal of Chemical Education, 88(8), 1182– 1187. https://doi.org/10.1021/ed200090r

Works, C., Fukuto, J., Lares, M., Negru, B., & Lillig, J. (2020). Teaching upper division chemistry and biochemistry capstone lab courses during a pandemic. Journal of Chemical Education, 97(9), 2987–2991. https://doi.org/10.1021/acs.jchemed.0c00669

Wu, H. K., & Hsieh, C. E. (2006). Developing sixth graders’ inquiry skills to construct explanations in inquiry-based learning environments. International Journal of Science Education, 28(11), 1289–1313. https://doi.org/10.1080/09500690600621035

Yildirim, I. (2017). The effects of gamification-based teaching practices on student achievement and students’ attitudes toward lessons. Internet and Higher Education, 33, 86–92. https://doi.org/10.1016/j.iheduc.2017.02.002

York, S., Lavi, R., Dori, Y. J., & Orgill, M. K. (2019). Applications of systems thinking in STEM education. Journal of Chemical Education, 96(12), 2742–2751. https://doi.org/10.1021/acs.jchemed.9b00261

Zhang, M. ( John), Newton, C., Grove, J., Pritzker, M., & Ioannidis, M. (2020). Design and assessment of a hybrid chemical engineering laboratory course with the incorporation of student-centred experiential learning. Education for Chemical Engineers, 30, 1–8. https://doi.org/10.1016/j.ece.2019.09.003