Skip to content
Assessing & Evaluating Mentoring (7. Mentoring Mini-Series) episode artwork

Mar 12, 2024 22 min

Assessing & Evaluating Mentoring (7. Mentoring Mini-Series)

from Owl Pellets: Tips for Ag Teachers Hosted by Owl Pellets

How can we evaluate mentoring? Do you know what purpose you are serving as a mentor or mentee? In this week's episode Brian, Becky, and Mike discuss how to assess and evaluate mentoring. Tune in as the crew continues their mentoring mini-series.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Assessing & Evaluating Mentoring (7. Mentoring Mini-Series)

0:00 22:38
of matches

Transcript Auto-generated, may contain errors

I'm Brian Myers. I'm Mike Ritalik. I'm Becky Hiread. And this is Alpelitz, a podcast featuring tips for ag teachers.

We are your agricultural education resource across the web, sharing research-based tips and tackling the tough questions facing agriculture teachers every day. Hey Alpelitz, welcome back to another session of Alpelitz Tips for Ag Teachers podcast. This is Brian. I'm here with Becky and Mike and we are here by the Alpelitz continuing this great conversation that even though she denies it, Becky is guiding for us because she is our mentor.

She is the Obi-Wan Kenobi of Alpelitz. Do I have to be Obi-Wan Kenobi? If I have to be with dye a little bit, I wouldn't want that role, but there are many cooler characters. I was now sharing all of my- I shared all my Star Wars knowledge right now, so I have no more Star Wars knowledge.

She wanted you to go Harry Potter. Oh yeah. We could go Harry Potter. We definitely go Harry Potter.

So those of you that are listening, you need to put in your character in the comments as you're listening to this. I'm a little afraid of what we're gonna get in the comments. It's probably good we don't get live comments here. I kind of wish like yeah.

We did say we did say we have said before that you're not my mentor until you see me cry. So if you have live comments, we might be able to prompt that a little more quickly depending on what people are going to be doing. But whether she admits it or not, Becky has led us through some great conversations here around the idea of mentoring. Today we're going to be talking about assessment and evaluation of mentoring.

So we've had this long journey that we have talked all the way about the inception of picking mentors and how do we go through mentors and honestly in addition to this great conversation for this report we've been talking about. We've had some great guests on this year as well talking about mentoring. So I don't know. Becky, you got to get our conversation going here.

What do you want to talk about today around the idea of assessment and evaluation? Yeah, I think we were chatting a little bit before we actually started hitting a report about this idea of how do you measure a relationship? Because so much of what we talked about in terms of how we've actually in terms of how we've been conceptualized mentoring is really around this idea of the relationship that exists. And I think so often we're looking when we look at our mentoring programs, we have a different outcome than just having that relationship.

Like that relationship is a means to something else happening. If I think about for example, our teacher induction programs, you know, certainly we want that relationship, but that relationship is almost a means to retention. There's a means to something else. And I think maybe to situate us a little bit, this chapter starts with this quote that I just really, really love.

There's probably in hoping for a specific outcome if measures used to evaluate what's happening, focus on something else entirely. And so maybe the question we can start with just broadly is how do you measure a relationship? And neither of them know. So I think that's the hard part of that.

That's part of what we're doing here in the work that we do. So much of what we do in teaching is about relationships. And we have these various scales. And if in the report, there's all these different scales that are out there to try to approximate some sort of measurement around that is one of the challenges.

I mean, it's huge challenge. Even in the report, they talked about 35 different scales for measuring like validated scales for measuring mentorship 35. Well, I think that speaks to the challenge because we're talking about mentorship, which is a it is a relationship in it, but it's kind of a one on one type relationship. And earlier we've talked about, you know, you go to different people for different forms of mentorship.

And so it really does become really personal about what an individual would want out of this mentoring experience. And so to evaluate and assess it, you really probably need to backtrack a little bit and think about those traits and in what you really wanted out of it in the first place. We're not thinking about this topic for today. One of the notes I jotted down was why do we assess?

And I think that is the real question because there's so many ways of measuring this relationship. It's like, why are we assessing it? What do we want to do with it? And I think it's very different.

If I am the person in the mentoring relationship, I need to stop and assess where things are for a different reason than if I am the coordinator of the state ag teacher mentoring program, trying to assess the overall program to do those sort of things. And I got to work on me thinking about those different framing of assessing, but then also the fact that probably I don't do a good enough job of assessing my own relationships. We're talking about this external relationship assessment. It's like the people that I mentor and the people I am mentored by, did I really, when's the last time I took five minutes to really think about where that relationship is?

Am I putting into that relationship? Would I need to be? Am I getting out of that relationship? Would I need to be that to me?

I think as a former conversation we could have as well. Well, that brings in, again, some of the pieces that we've talked about earlier, I think, in terms of some of what's your responsibility in that mentoring relationship? And that on both sides, how do we think about what does this look like? I think we've talked a little bit before about what's that exit strategy?

Are you mentored for? I commit this mentoring relationship and I'm a mentor forever, I'm a mentee forever. Well, that misses the growth opportunity that's part of that mentoring relationship. And so thinking about how do we know that that relationship is continuing to evolve with the people who are mentoring and being mentored?

I think Brian's got a great point. And as we think about this, we really need to think about not only the micro level, I guess I would call it where it's kind of the one on one and it's the internal for each of us as individuals, but also that macro level. So what's happening at the state level, the national level, with some formal mentoring programs and how are they being evaluated and thinking about what the outcomes are, what the purposes of mentoring programs are, and trying to measure and evaluate that's important. Because if we don't, ultimately people are going to evaluate with their feet and they're not going to participate, they're not going to be engaged in, then we're going to be left scratching our head about what went wrong or we got this great program and people are using it.

And then the frustration builds then. So I think this whole idea of evaluation certainly helps us to come full circle when we think about mentoring. If I go by your mic, a bunch of things that you said in there, I think is so key. You mentioned the word purpose several times in what you're talking about.

And I think that goes back to not only now at the assessment department, but also ties back to one of our very first conversations is if you're going to have a mentoring program, and in this case, we're talking about the larger scale, even a one on one being crystal clear about what the purpose is. Because if it doesn't have a crystal clear purpose, you can't assess or evaluate it. But I think if we go back and from reading all this report and other experience we've had, if no one knows exactly why you're doing this, people get frustrated and it wanders away. And I mean, how many times have we done a new teacher program, we give this new teacher a mentor, they have no idea why.

And the only goal is maybe that they most survive by the end of the school year. I don't know. We don't always say what we want them to be able to accomplish during that time. I think that's that's made a key point to as we're trying to develop mentoring programs.

And so if people know, I personally am uninvolved in designing a future mentoring program right now, but I'm personally involved in defining mentoring programs for faculty here at UF. And I'm using this stuff now to be thinking about how we more clearly define those mentoring roles to help people because I think there's application there as well. If you don't know where you're going, how do you know when you get there? Right, I guess.

Everywhere we go. There we are. That's one of my, that's a quote that I live by. Right.

I know my husband doesn't listen to this, but like those are going to be father's day presence. I think this year that everywhere we go, there we are and the kids are all going to get there yet. Sure. It is the favorite road trip quote of the headad household.

Not from anyone else, but my husband. But that is the hallmark road trip quote. I love it. Do it this.

Well, I think kind of the what you two were saying, one of the things that I think really was kind of striking about where our conversation has already been is that we often focus so much on those outputs. So thinking about that performance of the mentee, their motivation, their persistence, their career, but that's only one of several domains that are really kind of thought about in these scales. And I think while we think about those like the number of validated scales around mentoring, just being a ton, there are pieces of that I think help us think about things like mentor matching and things like how do we start to really define our purpose? Because I think we can say, you got to have a purpose.

Well, that's all well and good. But how do I know where to start with defining that? And I think a couple things that those scales help us kind of start to think about are both are the inputs and the processes involved with mentoring. And so it's really kind of how do we leave those listening with some intention behind what am I doing here?

So like input, thinking about prior performance and motivation and the similarity and the formality of the relationships. So thinking about just how does that develop? But then also thinking about even back to our definition of mentoring, what career support are we providing? What psychosocial support are we providing?

When are we role modeling? What negative experiences are we trying to avoid? Or are we bringing to this relationship that may make it a little bit harder for us to get rolling with it? And I think all of those things tie into the relationship quality.

But really when we think about kind of those different domains, how do we get ourselves out of this output of just, well, we want to keep our teachers, we want to motivate them, we want them to be persistent to really think about what are those, what are those pieces of career support and psychosocial support going back to what mentoring really is that we need to think about more intentionally in how we set up mentoring opportunities. Absolutely. I mean, again, so much goes back to our own experience. As you're talking, I'm thinking back and back, we're designing for a quick development.

We need to be doing the same thing here with the inventory programs, understand about where we want to be and then building the structure then to get to those pieces. So again, I think that's the big takeaway. Hopefully one of the big takeaway people are getting from this is I'm beginning to try to design and define these programs. I don't need to start with where we're starting.

I need to start with where I want to end up. And I think as this program goes out, people hear this, a lot of state teacher association are going to be launching, new teacher going to be hired, probably the next several months, we're going to be starting new teacher programs. I think it's really important for them to go back and build that entire program and know where do you want to be a year from now, not just what you're going to do to kick off this new teacher program in July or August. And again, we're all busy.

We're all like, you're trying, if you're going to be organizing this for your state teacher association, this is not your full-time job. You're doing that on top of 87, other thing that I get that. But man, just building all those structures and looking at those inputs and the processes you mentioned, they're backing in there, I think it's going to be so critically thinking out of the whole process, not just in time delivery. And I think too, for those that are out in the state struggling and knowing that this isn't their full-time job, putting this process in place really does help provide some comfort, I think, knowing what needs to be done, what doesn't need to be done, and feel like you have a sense of accomplishment.

Because I think this can be kind of squishy at time or saying kind of running through our fingers and being able to put some parameters around it feels like, yeah, we've accomplished what we set out to do. And we did these few things and we were able to move the needle. It probably also helps us keep our programs from getting stale. When we think about how do we really how do we give ourselves some parameters to measure by and to structure our programs with so that it's not the same thing we did five years ago.

We have slightly different teachers and we did five years ago. We have different like they've been through a different world of teaching. Like how do we how are we maintaining adaptability and what we're doing that keeps keep what we're doing relevant and especially keeps our mentors relevant. I think one of the things that comes to mind is we're talking about especially our state level mentoring programs is how do we really support our mentors in some of this prop like we think a lot about the mentee and what we're trying to do for the mentee but thinking about where we're getting mentors from.

I had a note from earlier in our conversation just that that shortage of mentors is as real as our shortage of teachers. So what are we doing in our evaluation process to really make it a work while experience and help develop a mentor role as well. I think at the critical point you know my if you're talking my mind goes back to some conversation we had earlier in the season with some folks doing some work on cooperating teachers you know and being a cooperating teacher has more than just been a mentor but one of the things that that you know that very was finding was you know you got to provide training. For years we've kind of thrown a great teacher student teacher and say well you're a great teacher so you're going to be a good student you're going to be a good co-op teacher.

We know that there are some really good teachers out there phenomenal teachers that just aren't the greatest co-op teachers for a variety of reasons and part of it probably we never trained them on how to do it but I think the same thing here's happening with mentoring what can we be doing to help people understand what it is because I know one of the big problems a lot of us face or me I face is somebody comes up and once again in a mentoring relationship and I jump into fast saying well here's what I did or here's what you should do and that's not mentoring that's that's answering questions that is not mentoring important to people and so it takes time to develop those skills to truly mentor somebody through it through answering a problem. That's really highlighted for the end of this chapter in this report as far as what actually makes a difference in that mentoring relationship. Becoming and saying you know this is what I did this is how I'm modeling this for you this is like these things are happening didn't have a big difference on that relationship where things like having a shared pathway to that current role validating the mentees ability highlighting what they're doing well in the positives of like the positives of the work not just the like the tasks but like overall why this thing whatever thing we're mentoring in is great and offering those clear steps for improvement did and I think even thinking about where do we get value out of that like that's I think you make you make a great point how often do I say that Brian? only when you're on mute yeah obviously they're basking in the glory of the fact that Becky said I would decide something right you know like uh let it wash over me just when he thought he was speechless folks so Becky one of the we keep we talked about mentoring several times throughout this academic year and we've referenced this document so why don't we remind listeners what document we're talking about and where they might be able to find it if they needed as a resource yeah we're using the National Academy's press report on mentoring and just as a reminder that National Academy's press can be we talked about this way at the beginning but that National Academy's press report really those are put together by convening experts in the area really getting to a consensus about what these things are so rather than a bunch of individual studies or you know even necessarily just individual summaries or synthesis it really is a consensus from these experts on what constitutes these different areas of mentoring that we've been discussing over the season.

it's a great resource and I hope they know we'll post that there in the link with the websites and put in the podcast so they go there but they don't get a lot there and those are big reports and I'm sure my colleagues here have read every word of those reports I might have skimmed over a few sections but they're good at that right there and hope that our job here hopefully to kind of give some of those highlights because we think mentoring is so important so Becky is going to kind of wrap up and summarize this section around assessment and evaluation any final thoughts and what should we be doing to help make sure that we're doing this assessment evaluation in a productive way. Well I think we talked around it a couple times but knowing what you're trying to do with with that mentoring absolutely critical I think there's also a piece that we didn't talk a ton about and I don't want to necessarily introduce a new topic as we're trying to wrap up but I think in considering you know those outcomes and how do we measure progress toward those outcomes there's also a little bit of how do we make sure that happens efficiently and I think we've kind of talked around that too but thinking about I mean for you two seasoned mentors how many how many people are you mentoring at any one time? They're nodding right now since we're not only like if I think about even for myself as somebody who's probably more often in the mentee role like I'm being mentored by several people at a time and there's a there is a question in the report about really how do we implement those measures in a way that really help with probably the nuance that's across these different relationships recognizing that even if the program has the same goal the individual relationship may have a different like may need to have some different measures in place and so how do we do that efficiently and effectively and with with the people in mind because ultimately regardless of the outcome of our program we're still trying to measure a relationship yeah yeah yeah the big the big take home there for me is we're using the same word mentoring and we're using to talk about these mentoring programs and they were talking about this one-on-one relationship as well and yes it's all mentoring and I get that but it is so different and I think when you're assessing and evaluating what you're wanting to get out of those it's very very important as well because I would say just as we're trying to develop a program these those overall goals I go back and think about people I've talked to and I said I tied this person to learn about this specific aspect of my personal life professional life whatever else and I have to evaluate is that still a productive way of is that mentoring role still pretty being productive or is it time to evolve does it evolve more into just a friendship does it time to evolve in that we just kind of separate and don't mean us often or whatever else I think those are okay in both of those things but I think I think you're right we have to know whether it's like a group or individual well and we've had so many analogies and parallels to what we've done in in other educational settings and I think also it should be stating the obvious but we probably need to think about formative as well as summative assessments as we're ever as we're going through as well and so it can be formal it can be informal those those things and so thinking holistically about this assessment piece is important too. Well you say metaphor and I'll even going back to the co-pilot relationship some point definitely lands.

One way or another? One way or another? Like I've heard of the crash site. That's right.

How do you make sure you land it and don't crash it like this part of this is SVP? Right you know it is I think I think it's good and I think it's kind of going to wrap this up I know that in the next time we're going to be wrapping this thing up we're going to pack a little bit more but we're talking about the responsibilities of each person has here and I think yes there's responsibility of the person that is planning putting together the mentoring program to develop a good program that is based on a purpose and assess the pro way but the person in the mentoring relationship has responsibility as well and they can't just be receptive and have to be active and sorting some of these things out in both the design the purpose the assessment and evaluation to know you know when to grow when to stop each of these these are each of these relationships so very cool we hope that that you all out there have found this to be helpful whether or not you're in a where you are in the mentoring relationship whether you're the one being mentored the one doing the mentoring whether it's a formal program or informally I think it's important to make sure that you do have time to do the assessment as we talked about here both kind of at those in those ending points but also along the way so that you know where to adjust from there so hopefully you go in there look at this section of the report it's been a great conversation might be I appreciate the opportunity to have this and forgive us it's like a special little time just for us because I mean who's listening I was gonna say I'm glad we get to share with a broader audience but maybe no one's listening my dad is there you know shout out the becuase dad but hopefully you're fighting this to be be helpful it's been a great many series and if you have missed the previous episodes of this particular miniseries on mentoring please go back and take a look at all those so for all of us here by the outlet thanks a lot we hope you've enjoyed this episode of out pellets check out our website for more information on this topic and to learn more about our guests follow us on facebook twitter and instagram stay connected and be sure to subscribe to our podcast so you'll never miss an episode for my confetti this is brian here by the out pellets saying thank you and we look forward to seeing you again on another episode of out pellets tips for egg teachers

Frequently asked questions

How long is this episode of Owl Pellets: Tips for Ag Teachers?

This episode is 22 minutes long.

When was this Owl Pellets: Tips for Ag Teachers episode published?

This episode was published on March 12, 2024.

Is there a transcript available for this episode?

Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.

Can I download this Owl Pellets: Tips for Ag Teachers episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.