Bloom, M. (2019). Assessing the Impact of “Open Pedagogy” on Student Skills Mastery in First-Year Composition. Open Praxis, 11(4), 343–353. https://doi.org/10.5944/openpraxis.11.4.1025
“Does switching to ‘open’ assignments from ‘throwaway’ assignments have a significant impact on student skills mastery?” (Bloom 2019).
Ultimately this study found, that with all factors considered, minimal shifts to open pedagogy had no impact on skill mastery.
In his study Bloom compared the performance of students in five sections of English 101 where a control group was previously provided with “traditional assignments” and an experimental group was given “open assignments”.
- Bloom discovered several flaws with the experiment
- Moderate shifts toward open pedagogy had no impact on skill mastery, and no harm was done in disposing of the “disposable assignment”
While more challenging, the renewable rhetoric assignment nonetheless provided students the opportunity to use prior knowledge and extracurricular skills in the demonstration of their rhetorical prowess, which some students found exciting and others found frustrating.
Bloom’s own criticism of his study raises important points about the study of open educational practices and demonstrates a refreshing self-awareness that serves as a counterbalance to any issues with his methodology. His findings appear in a reputable publication with a peer-review process.
Gibson, D., Ifenthaler, D., & Orlic, D. (2017). 13. Open Assessment Resources for Deeper Learning. In P. Blessinger & T. Bliss (Eds.), Open Education: International Perspectives in Higher Education (pp. 257–279). Open Book. http://books.openedition.org/obp/3582 (N.d.).
Can an Open Assessment Resources (OAR) repository streamline and support formative assessment?
Using a six core operational services of higher education (content, interaction, assessment, credentialing, support, and technology) this essay proposes the Open Assessment Resources (OAR) model of free automated formative assessments.
Gibson and Orlic propose six core services of higher education, content, interaction, assessment, credentialing, support, and technology, and two trends of scale and uniqueness to consider when providing automated and semi-automated formative assessment. The goal of this model is to support future research topics including but not limited to assessment construct validity, predictive analytics for constructive feedback, modification an adaptation of assessment modules, effects of teaching to authentic tests, and equity of treatment for subgroups.
- Trends of scale and uniqueness are two interrelated components of the role of higher education. For example, the development of learning experiences that are unique to one institution but scalable to the world demonstrates quality of offerings, interactions, products, teaching excellence, and student satisfaction. Both scale and uniqueness have different impacts on the six dimensions of higher education services they define as content, interaction, assessment, credentialing, support, and technology.
- Their key findings are illustrated in this model:
The core idea proposed here is that an open assessment resources (OAR) approach has the potential to increase trust in and use of OER in formal educational systems by adding clarity about assessment purposes and targets in the open resources world. P. 260
One limitation of this study is that it does not address challenges of assessing deep learning processes. Many of the art history assignments I am considering align with higher level learning objectives related to collaboration, problem-solving, creativity, analysis, and metacognition. This source is credible in part because it has been included in a peer reviewed publication.