Transcript (PDF) 


Katrina Carbone Katrina Carbone, PhD student, talks about her research, how mental health, wellness, and assessment are intertwined – and how assessment can be used to support student flourishing. She also discusses research she completed during her Master of Education centred around assessment identity and how our own experiences as students can shape how we practice as teachers. 
 

Resources

Queen’s Assessment and Evaluation Group
Teacher Assessment Identity (Looney et al., 2018)
Katrina’s MEd Thesis
Seligman’s PERMA+ Model Explained: A Theory of Wellbeing
 

About Katrina 

Katrina Carbone is a doctoral student at Queen’s University and a member of the Ontario College of Teachers, certified to teach K-12. Her SSHRC-funded dissertation focuses on transforming assessment practices in higher education to promote student flourishing. Other research projects include investigating teacher assessment identity development, leveraging educational technology to enhance assessment practices, and the influence of experiential learning on teaching and learning.

Podcast Transcript

Intro: Talking about innovation in teaching and education, Popular Podagogy, discussions that are topical and sometimes philosophical. Popular Podagogy. Popular Podagogy.

CC: Hi there. Thanks for joining us, and welcome to another episode of Popular Podagogy, where we try to bring big ideas in teaching and education to life. I'm your host, Chris Carlton, and this podcast is being brought to you by the Faculty of Education at Queen's University. In this podcast, I am excited to be speaking with Katrina Carbone. Katrina is a PhD student here at Queen's University and her research area is in educational assessment and evaluation. Now, before you say no more assessment and evaluation, wait until you hear where her research is leading her and what our conversation is going to be all about. I promise you it will be interesting, so don't go anywhere. I'd like to introduce our guest to our podcast today, and that is PhD student through Queen's University, Katrina Carbone. Welcome to our podcast, Katrina.

KC: Thank you for having me.

CC: Katrina, I was looking over your bio and research concentrations, and I was interested to read that you are a member of the Ontario College of Teachers certified to teach K through 12. I always talk to my teacher candidates about how many amazing doors can open after you become a teacher. So I am curious as to why you pursued a PhD and why this particular research area of assessment.

KC: So I started at Queen's University in 2018 as a Bachelor of Education student. And throughout this program, the pivotal moment for me was actually the alternative practicum. So for this practicum, I was in the assessment and evaluation concentration and I had the opportunity to actually go to Switzerland. And I compared the assessment practices in Canada to what I was seeing in Switzerland. And from that moment, I realized how different assessment looked like in different contexts. And that in addition to the assessment and evaluation group, that's a research group at Queen's. I decided to pursue my master's. And then I just fell in love with research, everything to do with research. And so I ultimately decided to pursue a PhD.

CC: That is amazing. That's what I love the alt prac so much about is it allows you to do something different still in the education realm, but go out and test the waters in some other area. Switzerland. That's amazing. Now I must admit, when I hear the topic title of assessment and evaluation, I don't always get that excited because I often find it just to be a rehash of the same ideas that we as teachers have heard before. But when you add the idea of mental health and wellbeing of students to the mix, well, I'm all in. And that's what we were talking about, is that you are looking at this through your lens now. So from your research, Katrina, what is the dynamic between mental health, wellbeing and testing, and how are students affected by these things?

KC: So a core of my dissertation focuses on the relationship between mental health, wellbeing, and assessment. And so although I'm in the early phases, the goal is really to understand how assessment practices can be supported, developed, and enhanced by prioritizing student mental health and well-being. And for me specifically, it's really about how assessment can be used to support student flourishing. And so when I say flourishing, I mean the key to improving the quality of life per se. So it's very broad, but it's something that is being integrated into a lot of research, policy, and practice right now. And so when we think about flourishing, when we think about constructs of well-being, we think about strengths, growth, resilience. And so how can we use assessment to promote students to feel flourished in the classroom. And so something that I'm sort of drawing on is Martin Seligman's Perma Model. So thinking about positive emotion engagement, positive relationships, meaning, and accomplishment. And what I really like about this model is that the components are not discrete. So they are intermingling with one another to predict flourishing of the individual. And so from the assessment side, the goal for me is really to focus on assessment practices that might reverse. The distress that students feel. But at the same time, assessments can also be improved by incorporating these mental health and wellbeing aspects. So how are teachers constructing assessments rubrics and how are students affected by this. And so it can affect motivation, self perception, confidence, the relationships that they're having with peers, and the two sort of common ones that we traditionally will think about are test anxiety and performance anxiety. And so as educators, we need to consider the ways in which our assessment practices influence the students, because ultimately we want them to just succeed. And success for every student looks very different.

CC: I absolutely love the couple things you said there. You said prioritize student mental health and wellbeing, which is amazing, and then so that the individual can flourish. And isn't that what we're supposed to do as teachers is we want our kids to flourish. And then you talked about testing anxiety and stress, which we have all seen right from the youngest age, right through university, and we see it all the time. So what an incredible opportunity to look into how do we have that positive emotional and relationship building to help with assessment and testing? Just incredible. So that leads us to the next question of how do we as teachers play a role in assessment based on your research? And do you find that the teachers assessment identity influences how they assess their own students?

KC: This is also something that I love to talk about because my master's thesis focused on teacher assessment identity. And so I'll sort of bring us back for a moment to think about just the construct of what identity is. We're constantly developing. We're experiencing changes as we navigate and move through different interactions and contexts, and teachers are constantly interacting with their environment, with those around them. Their identities are continuously shaped and reinforced. And so a lot of this thinking of teacher identity is where teacher assessment identity comes into play. So the way in which a teacher perceives themselves as an educator, as an assessor, which is shaped by their experiences, interactions and the discussions that they're having in the classroom with colleagues. And so what I really like about teacher assessment identity is that it goes beyond just knowing and doing assessment. Teachers have the power to influence student learning and the way in which that they're approaching their assessment is heavily impacted by who they are as an assessor. So thinking about, you know, what a teacher might think of is what do I know about assessment? What do I believe assessment is or should look like? Am I confident in my assessment practices? What is my role as an assessor? How do I feel about assessment? They're all questions that we need to consider when we think about our assessment identity.

KC: And now these were derived from Looney and Colleagues framework, which is a resource that I'll share for listeners. But something that I really like about this model is that it acknowledges assessment identity as complex, responsive to context, continuously evolving. So, for example, I might believe assessment is meant to be high stakes and anxiety provoking because of my own educational experiences as a student and as educators that's why it's so important to think about how our personal and professional experiences shape the way we assess our students, because ultimately, the reason that a lot of us become teachers is the students. We want them to succeed. And so we need to be offering assessment practices, policies that meets their needs, providing them opportunities to demonstrate their learning in ways that are meaningful for them. CC: I couldn't agree more. And when you talk about shaped by their experiences and what they know about assessment a lot of teachers that are out there went through that paper and pencil testing that was just standard for everybody. I remember myself, even through university, that I never saw the relevance and real-life application of the assessment that was being given to me. So it's so important that as teachers, we look beyond what we're familiar with and sort of move towards the looking at the emotional, physical health and well-being of our students and attaching that to the assessment as well. So, Katrina, how do we how do we get past that? How do we get past the fact that a lot of teachers might still be using that assessment technique that is personally attached to them? How do we move forward and become better at assessment, but including that prioritizing student mental health and wellness into it?

KC: Yeah, that's a really great question. I think that. The dominant paradigm of education has shifted so much, and we see that in the literature. But what is not necessarily reflected in practice is that we should be moving away from those traditional tests the traditional notions of assessment, and not to say that they're not good. There is definitely a place for them. But we want to be incorporating more authentic, experiential learning opportunities for students. And so in terms of how to break the cycle of assessment identity, I think the number one thing is to just take the time to reflect and question what we're doing, what went well, what can I do better? Why did I approach assessment in this way? And then coming from the well-being side, as how did my students react to this assessment? What were the emotions that the students were giving off when they were completing it or when they finished the assessment? Thinking about the value and the accomplishments that students want as well out of a course. How did this assessment help provoke new ideas or bring them to understand and recognize sort of their own professional goals? And so an example of how we sort of provoked reflection in teacher candidates specifically was through a workshop with the community artists, integrating expert voices to facilitate reflection through art. But in terms of in-service teachers, I mean, the obvious might be to lean to professional development, additional qualifications, attending conferences, workshops, training. And while it's important, it's also not always feasible. Teachers are overworked and burnout is obviously a significant concern. So what I think I would say is have an open door policy. It's so easy to isolate yourself as a teacher, but connect with colleagues, chat with them in the lunch rooms, what's working, what's not working because at the end of the day, we are each other's best resources and we often gain new perspectives when we are speaking to others.

CC: And that's that collaboration that is so important within the teaching profession. Profession? I love that you said take the time to reflect and assess what you are doing, and then you took it even further and said, and ask your students. And it comes back to that student voice, student choice. Our students are very good at telling us how they are feeling, how that assessment went. And as teachers, I sometimes find that we're reluctant to ask the student when that's the best source of information as to how the assessment is going. I know that when I do an assessment piece, it's also assessing my own teaching skills. So was I providing enough information or do I need to go revisit something? And often the only way to find that out is through that student conferencing and going through that process of reflection and evaluation. Now we've come to our last exit question, Katrina, and you sort of answered it already. And I've got my notes here that I bet you I'm going to pick up on what you're going to say. But I always ask our guests one final tip from you. If you were to just in two short sentences, give teachers sort of the idea of what should teachers do to make a difference in assessment for their students. And I know you've told us a lot about it, but just to sort of two sentences to summarize that.

 

KC: My final piece of advice to teachers would be to try something new, go beyond the traditional ideas of what assessment looks like, and get creative with it. Involve your students in it. Teachers are no longer seen as the knowledge keepers, but facilitators. Lean on your students. Learn from your students and engage them in the assessment process.

CC: Wow, I love that. Learn from them, lean on them. And Katrina, what was the last one?

KC: Engage them in the assessment process.

CC: That is absolutely wonderful. What a way to end our conversation. Thank you so much, Katrina, for sharing your expertise, experience and passion because you can tell it's your passion with us today. It was a pleasure and very educational for me and hopefully for our listeners as well. We're going to include some information at the end that you've provided for us as well. So again, Katrina, thank you so much for taking the time to talk to us today.

KC: Thank you for having me.

CC: That does it for another episode of Popular Pedagogy. Again, thank you to our amazing guests, Katrina Carbone. I hope you take the time to visit our podcast website for additional resources from Katrina. Josh, as always, where can our listeners subscribe to make sure they don't miss any of our Popular Podagogy podcasts?

Outro: Yeah, you can find this podcast on Apple Podcasts, Google Podcasts, Spotify, the Faculty of Education website, and pretty much any other place you get your podcasts.

CC: Please don't forget to check out our Queen's Faculty of Education website and search for popular pedagogy for additional resources and information. Well, that's it from myself, Chris Carlton, and our incredibly talented and resourceful podcast team of Josh Vine and Erin York. Stay healthy, stay safe, and stay connected and we will see you next time for another amazing episode of Popular Podagogy.