Using rubrics to assess information literacy: An examination of methodology and interrater reliability

Academic librarians seeking to assess information literacy skills often focus on testing as a primary means of evaluation. Educators have long recognized the limitations of tests, and these limitations cause many educators to prefer rubric assessment to test-based approaches to evaluation. In contrast, many academic librarians are unfamiliar with the benefits of rubrics. Those librarians who have explored the use of information literacy rubrics have not taken a rigorous approach to methodology and interrater reliability. This article seeks to remedy these omissions by describing the benefits of a rubric-based approach to information literacy assessment, identifying a methodology for using rubrics to assess information literacy skills, and analyzing the interrater reliability of information literacy rubrics in the hands of university librarians, faculty, and students. Study results demonstrate that Cohen's κ can be effectively employed to check interrater reliability. The study also indicates that rubric training sessions improve interrater reliability among librarians, faculty, and students.

Media Literacy Research Index

The purpose of this index is to bring together and promote international media literacy and media education research. The index is updated regularly, and you can also inform us about missing research via e-mail. Information presented here is all openly available in the Internet. Accessing full articles may require permission from the publisher.

Please, report to us if there is a malfunctioning link or if the information presented in the index is incorrect.

Medialukutaidon ja mediakasvatuksen viitetietokanta

Viitetietokannan tarkoituksena on tehdä näkyväksi medialukutaitoa ja mediakasvatusta käsittelevää tutkimusta. Tietokantaan on koottu yhteen kansainvälistä aiheita käsittelevää tutkimusta. Tietokantaa päivitetään säännöllisesti. Voit myös täydentää tietokantaa toimittamalla puuttuvan tutkimuksen tiedot sähköpostitse. Tietokannassa esitetyt tiedot ovat vapaasti saatavilla Internetissä. Kokonaisten artikkelien lukeminen saattaa edellyttää lupaa kustantajalta.

Ilmoitathan sähköpostitse, mikäli jokin linkki ei toimi tai esitetty tieto on väärin.