Using Contextualized Assessment to Measure the Energy Literacy of Middle and High School Students
Author: Kuan-Li Chen(Science Education Center, National Taiwan Normal University), Shiang-Yao Liu(Graduate Institute of Science Education, National Taiwan Normal University), Po-Hsi Chen(Department of Educational Psychology and Counseling, National Taiwan Normal University), Su-Han Huang(Graduate Institute of Science Education, National Taiwan Normal University)
Vol.&No.：Vol. 60, No. 2
Date：June 2015
Pages：167-196
DOI：10.6209/JORIES.2015.60(2).06
Abstract：
Energy literacy is multidimensional, comprising broad content knowledge as well as affect and behavior. In this study, an assessment was designed using six contextualized test units to examine student energy literacy. A total of 2,066 secondary students participated in the survey. The results indicated that student energy literacy is low, particularly with respect to the dimension of “reasoning on energy controversies”. Qualitative analyses of student written responses to various question items revealed that students have misconceptions of biomass energy and misconstrue the sources of greenhouse gas. Inter-correlation among the dimensions of energy literacy indicated that energy knowledge and behavior are more closely correlated with each other than are affect and behavior. The students in southern Taiwan scored higher on energy literacy assessments than did the students in northern, central, as well as eastern Taiwan. These findings are a reference for developing energy-related curricula and educational materials to improve student energy literacy.
Keywords：energy literacy, energy education, contextualized test unit
《Full Text》
References：
- 王如哲、黃月純（2011）。節能減碳教育：國際觀點與案例。臺北市：高等教育。【Wang, R.-J., & Huang, Y.-C. (2011). Energy education: International perspectives. Taipei, Taiwan: Higher Education.】
- 宋曜廷、黃信樽、陳學志（2012）。能源與氣候變遷概念之內容分析─以自然與生活科技領域為例。教科書研究，5（2），1-30。【Sung, Y.-T., Huang, H.-T., & Chen, H.-C. (2012). Content analysis of energy and climate change concepts in elementary and middle school scientific textbooks. Journal of Textbook Research, 5(2), 1-30.】
- 林煥祥（2009）。科學素養的評量。科學發展，438，66-69。【Lin, H.-S. (2009). Assessment of scientific literacy. Science Development, 438, 66-69.】
- 林樹聲、黃柏鴻（2009）。國小六年級學生在社會性科學議題教學中之論證能力研究－不同學業成就學生間之比較。科學教育學刊，17（2），111-133。【Lin, S.-S., & Huang, P.-H. (2009). Students’ constructing argumentation about a socioscientific issue－The differences between sixth graders with different levels of academic achievement. Chinese Journal of Science Education, 17(2), 111-133.】
- 邱皓政（2005）。量化研究法（二）：統計原理與分析技術。臺北市：雙葉書廊。【Chiou, H. (2005). Qualitative research methods II: Statistical principles and analytic techniques. Taipei, Taiwan: Yeh Yeh Book Gallery.】
» More
- 王如哲、黃月純（2011）。節能減碳教育：國際觀點與案例。臺北市：高等教育。【Wang, R.-J., & Huang, Y.-C. (2011). Energy education: International perspectives. Taipei, Taiwan: Higher Education.】
- 宋曜廷、黃信樽、陳學志（2012）。能源與氣候變遷概念之內容分析─以自然與生活科技領域為例。教科書研究，5（2），1-30。【Sung, Y.-T., Huang, H.-T., & Chen, H.-C. (2012). Content analysis of energy and climate change concepts in elementary and middle school scientific textbooks. Journal of Textbook Research, 5(2), 1-30.】
- 林煥祥（2009）。科學素養的評量。科學發展，438，66-69。【Lin, H.-S. (2009). Assessment of scientific literacy. Science Development, 438, 66-69.】
- 林樹聲、黃柏鴻（2009）。國小六年級學生在社會性科學議題教學中之論證能力研究－不同學業成就學生間之比較。科學教育學刊，17（2），111-133。【Lin, S.-S., & Huang, P.-H. (2009). Students’ constructing argumentation about a socioscientific issue－The differences between sixth graders with different levels of academic achievement. Chinese Journal of Science Education, 17(2), 111-133.】
- 邱皓政（2005）。量化研究法（二）：統計原理與分析技術。臺北市：雙葉書廊。【Chiou, H. (2005). Qualitative research methods II: Statistical principles and analytic techniques. Taipei, Taiwan: Yeh Yeh Book Gallery.】
- 國家實驗研究院（2011）。中華民國科學技術年鑑。取自http://yearbook.stpi.narl.org.tw/【National Applied Research Laboratory. (2011). Science and technology yearbook. Retrieved from http://yearbook. stpi.narl.org.tw/】
- 教育部（2003）。國民中小學九年一貫課程綱要。臺北市：作者。【Ministry of Education. (2003). Guidelines for nine-year continuous curriculum at elementary and junior high level in Taiwan. Taipei, Taiwan: Author.】
- 陳新豐（2007）。臺灣學位電腦化測驗研究的回顧與展望。教育研究與發展，3（4），217-248。【Chen, S.-F. (2007). Review and expectation on the studies of computer-based tests in Taiwan. Journal of Educational Research and Development, 3(4), 217-248.】
- 黃國禎、朱蕙君、王榕榆（2008）。以答題信心度為基礎之線上診斷評量系統。師大學報：教育類，53（1），1-24。doi:10.3966/2073753X2008045301001【Hwang, G.-J., Chu, H.-C., & Wang, R.-Y. (2008). Development of an on-line learning-problem diagnostic system using a confidence-scoring mechanism. Journal of National Taiwan Normal University: Education, 53(1), 1-24. doi:10.3966/2073753X2008045301001】
- 經濟部能源局（2014）。輔導學校推動能源教育計畫。取自http://energy-en.mt.ntnu.edu.tw/ project.php【Bureau of Energy, Ministry of Economic Affair. (2014). Project of energy education. Retrieved from http://energy- en.mt.ntnu.edu.tw/project.php】
- 蔡清田（2010）。課程改革中的「素養」（competence）與「能力」（ability）。教育研究月刊，200，93-104。【Tsai, C.-T. (2010). Competence and ability in curricular reform. Journal of Education Research, 200, 93-104.】
- 羅綸新、張正杰、童元品、楊文正（2013）。高中生海洋科學素養及迷思概念評量分析。教育科學研究期刊，58（3），51-83。doi:10.6209/JORIES.2013.58(3).03【Lwo, L.-S., Chang, C.-C., Tung, Y.-P., & Yang, W.-C. (2013). Marine science literacy and misconceptions among senior high school students. Journal of Research in Education Science, 58(3), 51-83. doi:10.6209/JORIES. 2013.58(3).03】
- Adediwura, A. A., & Tayo, B. (2007). Perception of teachers’ knowledge, attitude and teaching skills as predictor of academic performance in Nigerian secondary schools. Educational Research and Review, 2(7), 165-171.
- Barrow, L. H., & Morrisey, J. T. (1989). Energy literacy of ninth-grade students: A comparison between Maine and New Brunswick. The Journal of Environmental Education, 20(2), 22-25. doi:10.1080/00958964.1989.9943027
- Blake, J. (1999). Overcoming the ‘value-action gap’ in environmental policy: Tensions between national policy and local experience. Local Environment: The International Journal of Justice and Sustainability, 4(3), 257-278. doi:10.1080/13549839908725599
- Boon, H. J. (2009). Climate change? When or where? The Australian Educational Researcher, 36(3), 43-64. doi:10.1007/BF03216905
- Bybee, R., McCrae, B., & Laurie, R. (2009). PISA 2006: An assessment of scientific literacy. Journal of Research in Science Teaching, 46(8), 865-883. doi:10.1002/tea.20333
- Chawla, L. (1999). Life paths into effective environmental action. The Journal of Environmental Education, 31(1), 15-26. doi:10.1080/00958969909598628
- Chedid, L. G. (2005). Energy, society, and education, with emphasis on educational technology policy for K-12. Journal of Science Education and Technology, 14(1), 75-85. doi:10.1007/s10956-005- 2735-0
- Chen, K.-L., Huang, S.-H., & Liu, S.-Y. (2013). Devising a framework for energy education in Taiwan using the analytic hierarchy process. Energy Policy, 55, 396-403. doi:10.1016/j.enpol. 2012.12.025
- Coyle, K. (2005). Environmental literacy in America: What ten years of NEETF/Roper research and related studies say about environmental literacy in the US. Retrieved from http://www.neefusa. org/pdf/ELR2005.pdf
- Darner, R. (2009). Self-determination theory as a guide to fostering environmental motivation. The Journal of Environmental Education, 40(2), 39-49.
- Department for Environment, Food, and Rural Affairs. (2002). Survey of public attitudes to quality of life and to the environment-2001. London, UK: Author.
- Department for Environment, Food, and Rural Affairs. (2007). Survey of public attitudes and behaviours toward the environment: 2007. London, UK: Author.
- DeWaters, J., & Powers, S. (2008). Energy literacy among middle and high school youth. Retrieved from https://www.clarkson.edu/highschool/k12/pdf/FIE08_EnergyLiteracy.pdf
- DeWaters, J., & Powers, S. (2011). Energy literacy of secondary students in New York State (USA): A measure of knowledge, affect, and behavior. Energy Policy, 39(3), 1699-1710. doi:10.1016/ j.enpol.2010.12.049
- DeWaters, J., & Powers, S. (2012). Establishing measurement criteria for an energy literacy questionnaire. The Journal of Environmental Education, 44(1), 38-55. doi:10.1080/00958964. 2012.711378
- DeWaters, J., Qaqish, B., Graham, M., & Powers, S. (2012). Designing an energy literacy questionnaire for middle and high school youth. The Journal of Environmental Education, 44(1), 56-78. doi:10.1080/00958964.2012.682615
- Dias, R. A., Mattos, C. R., & Balestieri, J. A. P. (2004). Energy education: Breaking up the rational energy use barriers. Energy Policy, 32(11), 1339-1347. doi:10.1016/S0301-4215(03)00100-9
- Directorate-General for Energy and Transport. (2006). Education on energy-teaching tomorrow’s energy consumers. Retrieved from http://www.managenergy.net/dowload/education2005/05- 0001-EN.pdf
- Dove, J. (1996). Student teacher understanding of the greenhouse effect, ozone layer depletion and acid rain. Environmental Education Research, 2(1), 89-100. doi:10.1080/1350462960020108
- Dwyer, C. (2011). The relationship between energy literacy and environmental sustainability. Low Carbon Economy, 2(3), 123-137. doi:10.4236/lce.2011.23016
- Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. doi:10.2307/ 3151312
- Gambro, J. S., & Switzky, H. N. (1999). Variables associated with American high school students’ knowledge of environmental issues related to energy and pollution. The Journal of Environmental Education, 30(2), 15-22. doi:10.1080/00958969909601866
- Guilford, J. P. (1954). Psychometric methods (2nd ed.). New York, NY: McGraw-Hill.
- Hair, J. F., Jr., Black, W. C., Babin, B. J., & Anderson, R. E., (2010). Multivariate data analysis (7th ed.). Upper Saddle River, NJ: Prentice Hall.
- Hanson, R. (1993). Long-term effects of the energy source education program. Studies in Educational Evaluation, 19(4), 363-381. doi:10.1016/S0191-491X(10)80002-1
- Harlen, W. (2001). The assessment of scientific literacy in the OECD/PISA project. Studies in Science Education, 36(1), 79-103. doi:10.1080/03057260108560168
- Intergovernmental Panel on Climate Change. (2007). Climate change 2007: The physical science basis. Intergovernmental panel on climate change. Retrieved from http://www.ipcc.ch/ publications_and_data/publications_ipcc_fourth_assessment_report_wg1_report_the_physical_science_basis.htm
- Jöreskog, K. G., & Sörbom, D. S. (1993). LISREL 8: A guide to the program and application. Chicago, IL: SPSS.
- Kandpal, T. C., & Garg, H. P. (1999). Energy education. Applied Energy, 64(1-4), 71-78. doi:10.1016/S0306-2619(99)00076-8
- Kaplowitz, M. D., & Levine, R. (2005). How environmental knowledge measures up at a big ten university. Environmental Education Research, 11(2), 143-160. doi:10.1080/1350462042000 338324
- Keser, O. F., Ozmen, H., & Akdeniz, F. (2003). Energy, environment, and education relationship in developing countries’ policies: A case study for Turkey. Energy Sources, 25(2), 123-133. doi:10. 1080/00908310303430
- Lane, J. (2012). Perception vs reality: The 8 most common biofuels myths. Retrieved from http://www.biofuelsdigest.com/bdigest/2012/06/08/perception-vs-reality-the-8-most-common-biofuels-myths/
- Lawrenz, F., & Dantchik, A. (1985). Attitudes toward energy among students in grades 4, 7 and high school. School Science and Mathematics, 85(3), 189-202. doi:10.1111/j.1949-8594.1985. tb09612.x
- Lay, Y.-F., Khoo, C.-H., Treagust, D. F., & Chandrasegaran, A. L. (2013). Assessing secondary school students’ understanding of the relevance of energy in their daily lives. International Journal of Environmental and Science Education, 8(1), 199-215.
- Lee, Y.-W. (2004). Examining passage-related local item dependence (LID) and measurement construct using Q3 statistics in an EFL reading comprehension test. Language Testing, 21(1), 74-100. doi:10.1191/0265532204lt260oa
- Monseur, C., Baye, A., Lafontaine, D., & Quittre, V. (2011). PISA test format assessment and the local independence assumption. Large-Scale Assessmentsin Education, IERI Monographs Series, 4, 131-155. Retrieved from http://www.ierinstitute.org/dissemination-area.html
- Mullis, I. V. S., Martin, M. O., Ruddock, G. J., O’Sullivan, C. Y., Arora, A., & Erberber, E. (2007). TIMSS 2007 assessment frameworks. Chestnut Hill, MA: Boston College.
- National Energy Education Development Project. (2006). Secondary energy poll. Retrieved from http://www.need.org/files/curriculum/guides/BlueprintforSuccess.pdf
- O’Brien, R. M. (2007). A caution regarding rules of thumb for variance inflation factors. Quality and Quantity, 41(5), 673-690. doi:10.1007/s11135-006-9018-6
- Organisation for Economic Co-operation and Development. (2002). PISA 2000 technical report. Paris, France: Author.
- Routitsky, A., & Turner, R. (2003, April). Item format types and their influence on cross-national comparisons of student performance. Paper presented at the Annual Meeting of the American Educational Research Association (AERA), Chicago, IL.
- Sadler, T. D. (2004). Informal reasoning regarding socioscientific issues: A critical review of research. Journal of Research in Science Teaching, 41(5), 513-536. doi:10.1002/tea.20009
- Schmidt, R., Lyytinen, K., Keil, M., & Cule, P. (2001). Identifying software project risks: An international Delphi study. Journal of Management Information Systems, 17(4), 5-36.
- Stern, P. C. (1992). What psychology knows about energy conservation. American Psychologist, 47(10), 1224-1232. doi:10.1037/0003-066X.47.10.1224
- Summers, M., Kruger, C., Childs, A., & Mant, J. (2000). Primary school teachers’ understanding of environmental issues: An interview study. Environmental Education Research, 6(4), 293-312. doi:10.1080/713664700
- Tanner, T. (1998). Choosing the right subjects in significant life experiences research. Environmental Education Research, 4(4), 399-417. doi:10.1080/1350462980040404
- Tsai, W.-T. (2005). Current status and development policies on renewable energy technology research in Taiwan. Renewable and Sustainable Energy Reviews, 9(3), 237-253. doi:10.1016/ j.rser.2004.03.003
- Tuncer, G., Tekkaya, C., Sungur, S., Cakiroglu, J., Ertepinar, H., & Kaplowitz, M. (2009). Assessing pre-service teachers’ environmental literacy in Turkey as a mean to develop teacher education programs. International Journal of Educational Development, 29(4), 426-436. doi:10.1016/j. ijedudev.2008.10.003
- Wainer, H. (1990). Computerized adaptive testing: A primer. Hillsdale, NJ: Lawrence Erlbaum Associates.
- Wang, W.-C. (2004). Direct estimation of correlation as a measure of association strength using multidimensional item response models. Educational and Psychological Measurement, 64(6), 937-955. doi:10.1177/0013164404268671
- Watson, R. T., Rodhe, H., Oeschger, H., & Siegenthaler, U. (1990). Greenhouse gases and aerosols. In J. T. Houghton, G. J. Jenkins, & J. J. Ephraums (Eds.), Climate change: The IPCC scientific assessment (pp. 1-40). Cambridge, UK: Cambridge University Press.
- Whitmarsh, L. (2009). Behavioural responses to climate change: Asymmetry of intentions and impacts. Journal of Environmental Psychology, 29(1), 13-23. doi:10.1016/j.jenvp.2008.05.003
- Whitmarsh, L., Seyfang, G., & O’Neill, S. (2011). Public engagement with carbon and climate change: To what extent is the public ‘carbon capable’? Global Environmental Change, 21(1), 56-65. doi:10.1016/j.gloenvcha.2010.07.011
- Wirth, J. (2008). Computer-based tests: Alternatives for test and item design. In J. Hartig, E. Klieme, & D. Leutner (Eds.), Assessment of competencies in educational contexts (pp. 235-252). Cambridge, MA: Hogrefe & Huber.
- Zografakis, N., Menegaki, A. N., & Tsagarakis, K. P. (2008). Effective education for energy efficiency. Energy Policy, 36(8), 3226-3232. doi:10.1016/j.enpol.2008.04.021