The Development of a Service-Learning Outcomes Measurement Scale (S-LOMS)

Authors

  • Robin Stanley SNELL Department of Management, Lingnan University
  • Ka Hing Lau Office of Service-Learning, Lingnan University

DOI:

https://doi.org/10.18060/23258

Keywords:

Hong Kong, validation, scale development, exploratory factor analysis

Abstract

Service-learning as a transformative pedagogy has been adopted within Hong Kong’s tertiary education sector for over a decade; however, the lack of a standardized and validated measurement instrument to assess its student learning outcomes has been an obstacle to its further development. The current research study, collaboratively conducted by Lingnan University, The Hong Kong Polytechnic University, Hong Kong Baptist University, and The Education University of Hong Kong, therefore aims to develop such a measurement instrument named the “Service-Learning Outcomes Measurement Scale (S-LOMS),” taking consideration of the unique features of service-learning in Hong Kong. The scale development and validation work, with exploratory factor analysis and reliability test, has thus far demonstrated that the student-perceived learning outcomes after service-learning can be measured and assessed through 56 items. These items cover 11 domains under four major categories, namely: a) knowledge application; b) personal and professional skills, including relationship and team skills, creative problem solving skills, self-reflection skills, and critical thinking skills, c) civic orientation and engagement, including sense of social responsibility, community commitment and understanding, and caring and respect, and d) self-awareness, including self-efficacy, self-understanding, and commitment to self-improvement. Several additional insights arising from the validation results are discussed.

Author Biographies

Robin Stanley SNELL, Department of Management, Lingnan University

Robin Stanley SNELL is a professor in the department of Management of Lingnan University in Hong Kong. His research interests include service-learning, service leadership education and practice, qualitative approaches to organizational behaviour research, organizational learning, business ethics, corporate social responsibility, and creating shared value. He has completed several competitively-funded research projects. Prof. SNELL has also conducted consultancy projects in public sector organizations, and he has run workshops on business ethics for senior managers in the private sector.

Ka Hing Lau, Office of Service-Learning, Lingnan University

Ka Hing LAU majored in M. Phil psychology and is working for Office of Service-Learning of Lingnan University. He has years of experience conducting both academic and business research, on various topics including social psychology, human capital, market research, scale development, public opinion polls, and service-learning. His current projects include establishing service-learning impact measurement instruments, promoting STEM education in service-learning, and facilitating innovation and entrepreneurship in liberal arts education.

References

Astin, A. W. & Sax, L. J. (1998). How undergraduates are affected by service participation. Journal of College Student Development, 39 (3), 251–263.

Astin, A., Vogelgesang, L., Ikeda, E., & Yee, J. (2000). How service-learning affects students. Los Angeles, CA: Higher Education Research Institute, UCLA.

Ash, S. L., Clayton, P. H. (2009). Generating, deepening, and documenting learning: The power of critical reflection for applied learning. Journal of Applied Learning in Higher Education, 1, 25–48.

Boyle-Baise, M. (2002). Multicultural service learning: Educating teachers in diverse communities. Teachers College Press, New York (2002).

Bonnette, R. (2006). Out of the classroom and into the community: Service learning reinforces classroom instruction. Technology Teacher 65(5), 6–11.

Bringle, R. G., & Hatcher, J. A. (1999). Reflection in service-learning: Making meaning of experience. Educational Horizons, 179–185.

Celio, C. I., Durlak, J., & Dymnicki, A. (2011). A meta-analysis of the impact of service-learning on students. Journal of Experiential Education, 34(2), 164–181. DOI: 10.5193/JEE34.2.164

Chan, A. C. M. (2011, June). Outcome measures for service-learning in Hong Kong. Paper presented at the 3rd Asia-Pacific Regional Conference on Service-Learning: Theory and Practice of Service-Learning: Cross-Cultural Service-Learning Programme in Asia-Pacific Region, Hong Kong.

Chan, S. C. F., & Ngai, G. (2014), Service-Learning as a core academic component in undergraduate programmes: A brief introduction to the Hong Kong Polytechnic University model. The Journal of Development Communication, 84–99.

Conway, J. M., Amel, E. L., & Gerwien, D. P. (2009). Teaching and learning in the social context: A meta-analysis of service learning's effects on academic, personal, social, and citizenship outcomes. Teaching of Psychology, 36(4), 233–245. DOI: 10.1080/00986280903172969

Driscoll, A., Holland, B., Gelmon, S., & Kerrigan, S. (1996). An assessment model for service-learning: Comprehensive case studies of impact on faculty, students, community and institutions. Michigan Journal of Community Service Learning, 3, 66–71.

Einfeld, A., & Collins, D. (2008). The relationships between service-learning, social justice, multicultural competence, and civic engagement. Journal of College Student Development, 49(2), 95–109. DOI: 10.1353/csd.2008.0017

Eyler, J. S., & Giles, D. E. (1999). Where's the learning in service learning? San Francisco: Jossey-Bass.

Eyler, J. S., Giles, D. E., Stenson, C. M., and Gray, C. J., (2001) At a glance: What we know about the effects of service-learning on college students, faculty, institutions and communities, 1993–2000. (3rd ed.) Nashville, Tenn.: Vanderbilt University Press.

Felten, P., & Clayton, P. H. (2011). Service-Learning. New Directions for Teaching and Learning, 128, 75–84. DOI: 10.1002/tl.470

Godfrey, P. C., Illes, L. M., & Berry, G. (2005). Creating breadth in business education through service-learning. Academy of Management Learning & Education 4(3), 309–323. DOI: 10.5465/amle.2005.18122420

Giles, D. E., & Eyler, J. (1994). The theoretical roots of service-learning in John Dewey: Toward a theory of service-learning. Michigan Journal of Community Service Learning, 1(1), 77–85.

Hatcher, J., Bringle, R., & Muthiah, R. (2004). Designing effective reflection: What matters to service- learning? Michigan Journal of Community Service Learning, 11(1), 38–46.

Jacoby, B. (1996). Service-Learning in higher education: concepts and practices. San Francisco: Jossey-Bass.

Keup, J. R. (2005). The impact of curricular interventions on intended second year re-enrollment. Journal of College Student Retention, 7(1-2), 61–89. DOI: 10.2190/2dcu-kaby-wvqh-2f8j

Lundy, B. L. (2007). Service learning in life-span developmental psychology: Higher exam scores and increased empathy. Teaching of Psychology, 34(1), 23–27. DOI: 10.1207/s15328023top3401_5

Ma, C. H. K., & Chan, A. C. M. (2013). A Hong Kong university first: Establishing service-learning as an academic credit-bearing subject. Gateways: International Journal of Community Research and Engagement, 6, 178–198. DOI: 10.5130/ijcre.v6i1.3286

Ma, H. K. C., Chan, C. W. F., Tse, P. H., & Chan, C. M. A. (2016). A common outcomes measurement for service-learning in Hong Kong. Unpublished manuscript.

O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers, 32(3), 396–402. DOI: 10.3758/bf03200807

Prentice, M. (2007). Service learning and civic engagement. Academic Questions, 20, 135–145. DOI: 10.1007/s12129-007-9005-y

Rama, D. V. (1998). Learning by doing: Concepts and models for service-learning in accounting. AAHE's series on service-learning in the disciplines. Washington, D.C.: American Association for Higher Education.

Richard, D., Keen, C., Hatcher, J. A., & Pease, H. A. (2017). Pathways to adult civic engagement: Benefits of reflection and dialogue across difference in higher education service-learning programs. Michigan Journal of Community Service Learning, 23(1), 60–74. DOI: 10.3998/mjcsloa.3239521.0023.105

Rosenberg, M. (1965). Society and the Adolescent Self Image, Princeton. NJ: Princeton University Press.

Ramsay, W. R. (2017). Service-Learning: Memories and perspectives. In Robert Shumer (Ed.) Where’s the Wisdom in Service-Learning? NC: Information Age Publishing.

Shek, D. & Chan, S. (2013) Service-learning from the views of university teachers: a qualitative study based on focus groups. International Journal of Adolescent Medicine and Health, 25(4), 385–393. DOI: 10.1515/ijamh-2013-0036

Shumer, R., Stanton, T. K. and Giles D. E., Jr. (2017), History and precursors of service-learning theory, development and research. In Robert Shumer (Ed.) Where’s the Wisdom in Service-Learning? NC: Information Age Publishing.

Simons, L., & Cleary, B. (2006). The influence of service learning on students’ personal and social development. College Teaching, 54(4), 307–319. DOI: 10.3200/ctch.54.4.307-319

Snell, R. S., Chan, M. Y. L., Ma, C. H. K., & Chan, C. K. M. (2015). Developing civic-mindedness in undergraduate business students through service-learning projects for civic engagement and service leadership practices for civic improvement. Asian Journal of Business Ethics, 4(1), 73–99. DOI: 10.1007/s13520-015-0044-0

Stevens, J. P. (2009). Applied Multivariate Statistics for the Social Sciences (5th ed.). New York: Routledge. DOI: 10.4324/9780203843130

Warren, J. L. (2012). Does service-learning increase student learning?: A meta-analysis. Michigan Journal of Community Service Learning, 18(2), 56–61.

Yorio, P. L., & Ye, F. (2012). A meta-analysis on the effects of service-learning on the social, personal, and cognitive outcomes of learning. Academy of Management Learning & Education, 11(1), 9–27. DOI: 10.5465/amle.2010.0072

Cover Image Thumbanil

Downloads

Published

2020-02-21

Issue

Vol. 31 No. 1 (2020)

Section

Research Articles