And so I was looking for things like, can I just skip through the material? So a lot of the classes just allow me to hit the next button as fast as I could, take the quiz at the end and be done. The fastest class that I finished, it was allegedly a one-hour class in about eight minutes, just because there's nothing forcing you to actually engage with the course material. You're listening to Tap Talk, the Drinking Water in Rural America podcast. We believe everyone has a role to play in protecting public health. And together, we're connecting water and health professionals with ideas to extend and enhance our work. Whether you operate, educate, or regulate, this show is for you.
Welcome to episode 52. In this episode, we're chatting about building a credible and effective online training program with Dr. Sydney InterEbner of Indigo Water Group, a Colorado-based training and consulting firm. So today we have Sydney Inner Ebner, who runs Indigo Water Group, which is a training service and much more, which you can explain that in a minute. We had you on the show today because of all the work that you've done in the industry, looking at training both online and otherwise, and all the experience you have, basically. So if you would, first of all, where do you work and what's your role there? So I work at Indigo Water Group, and Indigo Water Group is a very, very large group of one person. It's just me.
When I picked my company name back in 2007, when I formed my company, I didn't want to be limited and I didn't want to get turned into an alphabet soup. Like we have a lot of engineering firms that are named after their founders or have just like the acronym. And I didn't want to get turned into that. So that's why I picked the name that I picked. And Indigo is a little bit of a personal joke because Indigo is a color between blue, which is clean water, and purple, which is reuse water. And so I spend most of my time in wastewater, which is kind of in between that world. So I am the chief cook and bottle washer here at Indigo Water Group. I do all my own website design. I do my own accounting work. And I've developed, gosh, I don't even know how many training classes at this point in my career. Hundreds.
What do you love about your job? And can you tell us a tiny bit more about your background? How did you come to creating your own company and having it be in the sector? My first real job in college was to be an intern chemist for Rocky Flats. And Rocky Flats, if you're not familiar, is a nuclear weapons manufacturing facility outside of the Denver metro area. So I started working there in their environmental testing laboratories. So I did my first five years in the TCLP and trace metals analysis labs. And then they had a big layoff out there as they started to kind of wind that program down and move functions to other sites. So as part of that, they offered a voluntary layoff program. And if you volunteered to get laid off...
They paid for your first year of graduate school. You got to keep your medical for an extended period of time. And there was a big monetary severance. So I could not volunteer fast enough. I got out. But one of the things that I did when I was at Rocky Flats, as they started to lay off a bunch of the people who worked there, is I did training for laboratory technicians.
So when you got laid off at Rocky Flats, you didn't personally get laid off. Your position got eliminated. And so you would take your pink slip and then go bump somebody with less seniority and take their job. And so we had this cascade of people that were just kind of constantly bumping through these jobs. And the two highest paid positions were radiological technician and laboratory technician. And so we had a lot of people coming into the lab to work as technicians who had never held a beaker before. And so as the intern at the time, my job was to train all of these old steelworkers who'd been on the manufacturing side to come through and...
learn to be lab techs. So they had to sit through my chemistry class and basic laboratory techniques before they could go out onto the floor. What I loved about doing it is that first I was helping people get a new career, something they could do that was new to them they'd never seen before. But every single time you see somebody's face light up because they understand something that was confusing before is just an amazing thing. That's fantastic. I took my severance package and paid off my credit cards and put a down payment on a house, which meant I needed a job.
right away. I had to go find something to do. And so I was applying for all of these laboratory supervisor positions because that's what I did at Rocky Flats. I had a staff of 14 people out there. But when I left Rocky Flats, I was 22 and I was applying for these supervisor positions and people would, they basically, they thought I was lying about my credentials. You know, I'd been the supervisor for almost five years with a staff and a million and a half dollar budget. And they were like, yeah, that's not you. They just didn't buy it at all.
So I ultimately ended up taking a job as an entry-level chemist at the Littleton Englewood Wastewater Treatment Plant and then went back to school at night for engineering and just gradually got more and more into operations and more and more into my doctoral research. I don't know. I just kind of fell in love with the whole thing. Awesome. Well, you certainly had an opportunity to fall in love with teaching right at an early part of your career, which is, yeah, even mentioning that kind of helps explain where you're at today, I think. And I've been in that training position my whole career in one capacity or another.
So before we get into some of the issues we're going to talk about today, one thing we ask everyone is about a personal fun fact, something that, you know, the world doesn't necessarily know about you that you'd like to share and humanizes all this, I guess, in a little bit of a way. So something that a lot of people don't know about me is that I love ballroom dancing. And so I used to take a whole bunch of lessons for ballroom dancing. And my husband and I did competitions for ballroom dancing. That's terrific. That is before our last kid was born. We haven't done any since then. He just turned 15. Yeah, I used to do that too when I was young. That's a fun fact. I did not know about Steve.
Sydney, we also love to hear from our guests about their water hero. So someone whose work past or present has inspired your career. So I have thought about this and I have a couple of water heroes, but one of my first water heroes is James Bernard. He was the phosphorus and activated sludge and wastewater expert, God of all things. And not just because of his technical expertise, but James is, he's so smart and he's so good at explaining things in the simplest terms possible to people who don't necessarily even swim in our industry. He's volunteered his time to come and teach at our operator school.
for years. He can't anymore because of health issues, just because I asked him to come and for no other reason. So he's just amazing. He's contributed so much to the industry. And then another of my water heroes is Manuel Frere, who is the chief plant operator for the city of Northland. And he's also just a genuinely...
wonderful person. Like he's one of those people where you meet him and you just like instantly just feel like you're home in some way. But he's, I've been watching him through his career. So he's been kind of coming up behind me, but he freely shares everything that he knows and has learned with all of his operators. And it's telling that he's the chief plant operator of a 4MGD plant and he has five operators that work with him and he has gotten every single one of them to be a class A. That's awesome. And that's how you do it. Yeah. Yeah. So many operators are so worried about their own job security that they may not share things that they need to and especially smaller systems. Yeah.
And he's grown his own crop of Class A operators, and they are a fantastic team, and they're all very loyal to him. That's awesome. Those are great. Okay, so we're going to talk today about best practices and online training. And this all comes from, well, the last time that you and I met was in January of 24 at the WPI conference where you gave a presentation on this topic. And it was really telling. And you went to a lot of trouble and a lot of work to give a really inspiring talk, to be honest. And so it's a major theme for them, WPI, Water Professionals International. So could you share just a little about the training you do? How much is in person? How much is on demand? Just kind of a feel for where you sit.
Sure. So I offer three different kinds of training classes. I have online classes that are on demand. They're self-paced where people can log in and take those. I have classroom training that's open enrollment. So I schedule a bunch of those classes and people sign up for them like they would like a short school or any kind of training that you might go to in person. So those are open to anybody. And I also do a lot of on-site, more customized training for wastewater plants really all around the country, not just in Colorado. So how much of a training am I doing? I'm on the road. I'm doing a full-day training class somewhere.
roughly one every three days. That includes weekends. So I've done, yesterday I did, I think it was my 65th full-day training class for this calendar year. So that tells you how much I'm traveling around and being on the road. As far as revenue goes though, I think the online training is about two-thirds of my revenue and the in-person and seminars are the other third. And I also have some other engineering projects that kind of get mixed in there from time to time. I write manuals for WEF since 2017. I was writing textbooks for them almost full-time.
Full-time, in addition to all of this training that's happening in the background, I don't sleep. That's basically the bottom line there. Well, you know, while the fire's hot, right? Yeah, do while the fire's hot. I have done contract operations, although I mostly don't do that anymore just because I travel too much to make that really a reasonable thing to be doing. Now, did your business have that balance of two-thirds online, one-third in person pre-pandemic, or did that shift? I've been sort of moving in that direction for a long time. I've been doing the online training classes since 2012, the on-demand classes.
What made a bigger difference was not the pandemic, but a contract that I won for the state of Colorado. So the state of Colorado requires all operators to complete a regulatory training class. And they have to do it once every three years or every time that they test for certification or if they're asking for reciprocity. That's part of the process. So I worked with the state to implement their vision for what these regulatory classes were going to look like. And there's one for drinking water and wastewater, one for drinking water and one for wastewater, industrial wastewater and collection systems. So every single operator in the state has to take those. As part of the contract, it's a free class.
If I'm being perfectly honest, I actually lose money running that for the state. But that started in 2019. And it's been the best advertising in the world for the other things that I do. Because operators come to take that free regulatory class. And then they go, oh, that was decent. I like that. And then they close them into the other things that I have available. So I've been in that long process. And then two years ago, one of my best friends in the whole world, Paul Krauth, I think you knew Paul, Steve, passed away. Yeah, he had retired. And then he had a heart attack.
about six months after retirement and passed away. And it just really hit me hard. And I made a decision then that I was not going to work on any more projects that I didn't enjoy because life is just too short for that, which means I pretty much gave up doing utility planning and design work with big engineering firms because they're just difficult to work with. I bet. They like to give you the work and keep all the money. It's not a winning combination. Well, that's cool. I mean, thanks for the history, I guess, because I know you're in Colorado and a lot of your work is there.
In your talk that you gave at WPI last year, one of the things you said that caught my attention was, if it's done right, online training can be better than in-person training. And what we see in the industry, though, at least what I hear from regulators, they're all really skeptical of online training. They think it's really just the opposite. They're not, you can't prove they're paying attention, you know, all those other things. And that the pandemic really forced that on everybody. And there's no going back or no closing the box, if you will. What would you say to those folks? I guess is really my question. And, you know, I think you answered some of that in your presentation, but we want to talk about it a little bit here. One of the things that I would say is that they're right about a lot of online training. A lot of online training is terrible.
And engineers and managers are the worst for logging into a podcast or a class, a webinar, and then putting it on mute and going about their day. You can watch it. I see them on the camera. They're leaving the room. They're taking phone calls. People come in to talk to them. They aren't even remotely paying attention. And those are the same people that get mad when you tell them that they can't have their CEUs or their training units because you saw them leave. So one of the biggest problems, it's not the training itself. It's the accountability piece. So we have to have ways to show that people were interacting with the training.
So I think in the talk that I gave at WPI's conference, I was talking about one of the biggest reasons that webinars are so bad is you have a huge audience, typically, and all of those people are logged in. And it's just not an easy task for certainly the speaker. But even if you have a second person kind of watching everybody to keep track of that many people and whether or not they're even looking at their camera or if they are obviously doing other things on their computer while they're watching the webinar, there are some controls that we can put in place to make that better. We can build in polls. But even with polls, like if a webinar is giving like two or three polls during an hour long webinar, there's still a lot of room for not paying attention or doing other things or, you know, putzing around or playing solitaire, whatever it is you're doing that you're not paying attention. Webinars typically don't have any kind of a quiz at the end, which would be another way that we could sort of force some accountability. Quiz questions, though, should be questions that can't just be answered out of your general knowledge necessarily. So if I'm giving a...
you know, given a webinar about a wastewater topic, if somebody already knows everything about that topic, you know, we don't want them to just be logging in and taking that topic because they know they can pass the quiz at the end. So inside that quiz, we should have some questions that are specific to maybe anecdotes or stories or other things that were told in that webinar to demonstrate that, yeah, they were actually paying attention throughout that whole process. With webinars, that's really hard to do. And there aren't great tools available in the different webinar softwares. Like you can ask polls, but then the speaker or whoever's putting it on has to go back and sort of manually collate all of that information. There's some outside tools.
We use GoToWebinar for our private world class. Yeah, and it's hard. You end up with a bunch of garbage data and then people will be like, oh, I had technical difficulties. I couldn't answer that question. I really was paying attention. And you're like, oh, I'm sorry, but that's... I don't have any other way to judge but that. So that's what it is, right? Yeah, that's not good enough. You're welcome to take it again. There are some outside tools that work better. So I use Poll Everywhere. So Poll Everywhere lets you put polls and quiz questions into your...
PowerPoint presentations that can be answered by texting in the number. And so that's more independent of having technical issues with the webinar itself. Like, you know, if their internet connection is a little spotty and it collates everything into these nice reports. And so it makes it possible to ask questions like every 10 minutes. That also has a little bit of a downside because the, because it's showing up on your phone, you could theoretically leave the room, you know, and.
come back and if you see something pop up on your phone where you could tag in an answer or have somebody else in the class send you a text message that you need to answer this thing if you're going somewhere else. There's always going to be people who are trying to skirt the system and kind of, and there's no absolute fix for that. Now with on-demand classes, on-demand classes, it's a lot easier to put more controls in place. A couple of years ago, Ohio made a requirement that you have to have a positive interaction at least once every 15 minutes in any kind of online training. So a positive interaction would be hitting the next slide button.
A quiz, a poll, you know, some kind of engagement that is documented that you can show. So what I strive for in all of my online classes is no slide is longer than three minutes. So at least once every three minutes, you have to have a positive interaction with the class. If you wander away from the class and you have been in an attentive for more than 20 minutes, it'll just log you out. The polls, there's quiz questions. There's a quiz every 15 minutes. And if you don't pass the quiz...
70% or better, it resets you back to the beginning of that section. So there's a lot of stuff that we can do with on-demand that is better than webinars. And I don't know that webinars are ever going to get to the same level as on-demand training for that reason. Yeah, and see, that's just basically the opposite of what a lot of people feel because of the poor training providers. One of our state associations that does training in Illinois decided not to use on-demand training that was being offered. They had an opportunity to get involved with because when they took those classes, they found them terrible. But a lot of states do use that particular on-demand type of training.
And it's really telling that it comes back to kind of the integrity even of the trainer in some ways. All the things you're talking about, you've learned over time and made it better because you're interested in making sure the operators are actually learning and doing what they're supposed to do. I guess my question through all that is, what can we do about all the folks that are just out there to make a buck? And that's kind of one of the reasons why we're having this conversation. All right. So I'm going to get myself in trouble with a lot of people now. Oh, we don't have to do that. No, that's okay. That's okay. Well, I mean, this is hard. Like, it's hard to do this well. Right. And that's the point.
The existing tool set, as you said, doesn't necessarily make it easier unless you're using multiple tools and know how to do it well. Yeah, creating a training class is a gigantic time investment. So there's that. Incorporating all of the tools for trackability, traceability, compiling the data, keeping records is another just big time hurdle. And then the third thing is that once you have a course and you've got it created, then you have to go to all these different state agencies to get it approved.
So once you have a course and you've gone through all of the pain of getting it approved in different states, you don't really want to make changes to it. And this is a systemic problem that comes down to course approvals. So I have this issue with Maryland. Maryland is one of the most difficult states to get classes approved in. And if I change a class or make a new class, I have to go through their whole approval process again. And that approval process can take...
up to 90 days. So there's a pretty strong incentive for me to keep old, out-of-date classes on the books because DC Water is one of my big clients. They take a lot of my training. And if I take old classes off, then that diminishes opportunities for their operators. So if I want to update a class that doesn't have all of the required stuff in it, and I'm planning to do this for some classes before the end of the year, the first thing I have to do is remake the class, add these controls, and then I have to go through that approval process again. And then get it updated. So meanwhile, the old class is still going to sit there because if I take it away, then...
That starts to impact the operators in that state. So that's a systemic problem that we have. Some of these state agencies, like Ohio, they have implemented new requirements, right? Like you have to have a quiz every 15 minutes. And as far as I can tell, I am the only online course provider who is actually meeting.
their requirements. Colorado has some requirements for online training. And I know I'm the only course provider who is meeting those requirements. And yet the certification board here in Colorado is like, well, you know, these other providers aren't meeting the requirements, but we don't want to tell them no, because then our operators won't have as much choice. Now, in my opinion, that's terrible, right? Because you're just incentivizing bad training to be out there in the world. And it's not really meeting the spirit of continuing education, which is why we have this requirement for operators in the first place, right?
I don't think that a course provider who has a class where I can log in and just hit click, click, click, click as fast as I can and then wait for the timer to run out at the end of the class should be allowed to offer that class. So one of the things that states could do is they could enforce their own rules. And if they did that, some of that bad training would go away. Yeah, it's surprising that for all the talk that we have at any kind of meeting regarding certification or recertification or maintaining your license, everyone's like, we need to be tougher and we need to implement whatever. And then...
when you hear a story like this one, you know, they should at least have set a time limit. And one year, this is going to go away if you don't do this. And you'd think that they would step up. Well, I think it just points to that in a lot of ways, we are still early adopters. We're certainly unique in terms of both our program and yours that we are applying for approval in many states, if not trying to get as many as we can. And then it comes down to there are people.
in these agencies with various levels of expertise on training itself and even on the subject matter that are making the decisions for we're going to allow webinars, but not on demand or only get allowed on demand. And these are the requirements. And yeah, it's we're in a very interesting time, I guess. Sydney, for background, we put on a virtual conference for water operators. It's part of our deliverable with RCAP. And it's in February. We did the first one last February. It was three days, 12 hours total. And so we had to spend nearly three months, two people trying to get approval in all the states for that. And I think in the end, we ended up with 41 states.
Wow. And we have to do it all again for this coming February. Well, and because in some of the, you know, as you said, some of the requirements have changed. And so the research, you have to do it new again every year. And then we've also done it for on-demand in the past too, which you can be a little, it's not as time sensitive. You can be a little more patient on that, but still in order to provide the service to as many operators as possible, we want to be able to do well. So I can see why you guys connected over these conversations. Well, you know, it also leads to an equity in another way because, you know, so Sydney.
you're well-respected and people want to take your training, I'm sure there's states that you don't even try to get credit for because of how much of a pain that is. And so the operators in those states are missing out because there's no coordination among the states and there's all these weird rules and it makes it impossible. And some, it may be that they only want people in their state doing the training. And I believe that when you look at some of the rules. One of the things that makes it harder for me is I'm a for-profit company. You guys are a nonprofit company. But honestly, there isn't anything magical about being a nonprofit that makes your training any better or that should give you special privileges when you're getting stuff approved.
Which we don't. I mean, I think groups like RCAP and Real Water probably do, but they've got a long history in those states. And I mean, we're technically not even a nonprofit. We're part of the University of Illinois, but we operate like so. Well, we even had states tell us like, yeah, like if you were really doing this under RCAP, we just have like you just have to submit a list of, you know, who attended versus. But because you're not, even though all of the presenters are RCAP presenters, then you still have to go through all these hoops. Yeah. So, I mean, yeah, there are there are those relationships. Yeah. So some states like Texas, they charge a lot of money to get things approved in Texas.
if you're a for-profit company, but not if you're a non-profit company. And then they have different requirements for instructor credentials and whether or not you need to have something like an ISET certification. For-profit companies have to have all of that. So really they are, and Texas isn't the only state, so I don't want it to sound like I'm picking on Texas, but they're really trying to make it so that only their, I can't remember the name of the organization, but there's an organization in Texas that essentially provides 100% of the training for all operators in Texas. there's not really other options for them because of the requirements of their approvals. I looked at getting classes approved in Texas once, and I got stuck on the application where there was a line that said I had to certify that every single thing that was in my presentation was my own original idea and thought and everything. And I was like, well, that's not possible. How is that? Yeah. There are no original thoughts at this point. And I'm not sure if they were just trying to avoid copyright infringements or, like, it wasn't clear. So between the expense and the requirement for an ISET certification and some other things, like, I'll just never be in Texas, ever. And that's their loss, right? I mean, it's the same, you know, Florida.
I think even in their legislative language, it lists who can approve and do training. And it's like four entities. Yeah. And California is similar. Up until very recently, only nonprofit companies were allowed to give training in California. And so that is essentially University of California at Sac State and Rural Water and a couple of other NRCAP and a couple of other organizations and Wastewater Technology Trainers, which is Eric Wahlberg's company. And that's pretty much it for California. Yeah. I mean, this comes up since we started WaterOperator.org in like 2009. And the same conversation about all the problems with state.
approval have been going on almost the entire time. The needles barely moved. I mean, the big movement was to online stuff because of the pandemic. It's certainly a problem. On the flip side, there are states that cooperate with each other. So if I have classes that are approved in Colorado, New Mexico just blesses it. Wyoming just blesses it. If you have classes that are approved in, it's a bunch of different states, but if they're approved in any of those states, Montana just says it's also approved in our state. You just have to tell us which one of these other states blessed it for you. So that's nice. That makes it a little easier. That's the way it should be, right? Yeah.
I'd love to shift the conversation to more of your own experiences and looking at other classes and what are some of the best practices that we can share with our audience, which comprises both drinking water, wastewater, even the private well, public health professional sector as well. Because, you know, good training is good training, particularly when you're implementing certain tools and techniques. And so Steve told me that you had went above and beyond and took classes from 30 different online trainers to prepare for the presentation. Can you talk more about that process and how long it took you? What was the investment of money and time?
Yeah. So this is kind of crazy. So I was very curious about what other people were doing for online training because I had gotten feedback from operators, from really a bunch of different operators about different sources that they use to study and to get things from. And so I just wanted to kind of see what was out in the world. So the first thing I did was just sit down and do a Google search to see how many different companies I could find that offered online training for water and wastewater operators. And then I also went through the course catalogs, kind of the approved courses list for a couple of different states to see if I could find how many companies I could find. So I found about 30 different companies.
I went to every one of those websites and bought a course. And I tried to find a course that was about an hour long. And initially what I wanted to do was take a course in the same topic from every provider. And that was immediately not possible just because people offer different things. I thought, I'll just go take Activated Sledge from everybody. Couldn't do that. So I just started slogging through them. So I made a big spreadsheet for myself. And so I was looking for things like, can I just skip through the material? So a lot of the classes just allow me to hit the next button as fast as I could, take the quiz at the end and be done.
So I think the fastest class that I finished, it was allegedly a one hour class in about eight minutes, just because there's nothing forcing you to actually engage with the course material. So out of those 30 classes, you asked me about what my investment was. I spent about a thousand dollars buying classes from my competitors, these different ones. And there were a couple of free classes out there, like your Wells class. I took that one and I took a free class from Veolia. We should talk about Veolia separately because that was kind of an interesting experience for me. But I took all of these different classes, a lot of the material.
a lot of the material, I see the majority of the material was very, very outdated. So that was a little disappointing. I thought that it would be better than it was, but a lot of it wasn't very good just from a technical standpoint. And then most of the training did not have controls in place. Some of the classes that I took were very short. Like I took a BOD class that was basically three pages of text and then 50 questions. And a bunch of the questions weren't even in the three pages of material that they gave me. So that was also kind of a weird experience.
And so all of these classes were approved for CEUs in at least one state? Yes. Is that accurate? In many states. Yeah. Approved for credit in many states. There were some really pleasant surprises out there, though. I took a couple of classes from David H. Paul, Inc. I'd never heard of them before. And they only have a handful of classes. But they were really engaging, interesting classes. And they had some of the right controls in place to force you to kind of move through the whole time. So that was a good experience. Your Wells class I really enjoyed. Although...
There's a lot of printed material that you don't necessarily have to read. So like in the next iteration of it, I think I would have that narrated. I say that and I'm trying to go through and make transcripts for all of my own classes, partly for ADA accessibility, because that's also a concern. Transcripts are so, so time consuming to try to get that out on paper. And when you start transcribing your own speech, you find out how many incomplete sentences you use on a daily basis. We don't talk like we write. And if you write it first and then try to read it, it doesn't sound right because people don't talk like you read.
I've started editing audios and videos with a tool called Descript because it allows you to edit the file and the transcript at the same time. So you're not trying to transcribe something weird that you said. You're cutting out the parts that were weird, if that makes sense. Yes, I also use Descript. That's a fantastic program, especially once you get the hang of it. It's not super user-friendly right out of the box. I agree.
Once you know how to use it, it's a fantastic tool. Yeah, so I sat down and took these 30 different online classes. Some of the providers didn't have any classes that were an hour long, so then I just picked one that was longer than an hour, and if it was a two-hour class, I would do half of it and then just kind of measure to see how long it would take me to get through. So things that were interesting. Like I said, most of the training was not great. So I understand where the regulators are coming from when they are not feeling very good about online training as a rule. Some of that has to come down to what they're approving.
They need to look at the technical content. Now, you don't have to get as crazy as Maryland. But if you submit something to Maryland to get an approval, you need to turn in the course handout and outline a minute-by-minute breakdown of how much time you're spending on each slide, your learning objectives for the course, the biography of the person teaching it, and your references that you use to create the course. So a regulator that has all of that information should be able to say, this course is going to be approved because it meets technical criteria and it's meeting traceability and accountability criteria. So getting back to best practices, you don't want anybody to be able to just turn on their computer.
and then walk away and then come back and get the quiz at the end. So a course shouldn't self-play for more than a couple minutes at a time. So you're forcing engagement. Three minutes is my limit for slides. If they get to be more than three minutes long, then I'll break it into two slides so that you don't have a long enough time to go do something else. Three minutes is too short to wander out of the room. And then having a quiz every 15 minutes. So before I had a quiz every 30 minutes. And then when Ohio changed their criteria, I had to go back through 80 online classes and add extra quizzes to every single class, which I did. And I'm glad that I did because the courses are better for it.
Of these 30 course providers that I looked at, I'm the only one. And yet most of these course providers are approved in that state. And they're approved in other states too. And I understand that state governments and regulatory agencies are very time limited, they're very personnel limited, that they don't have time to go through all of these courses. And so when you submit a course to a state, they ask you to more or less self-certify that you are complying with their stuff and that you're always at risk of having an audit, right? Where a regulator could just say, I want to take this class, show it to me, and then you would be done, right? If you weren't meeting all of those requirements.
But I've been doing online training since 2012, and nobody's ever asked to see a class from an approval agency or certification agency has never asked. Oh, interesting. We've had several take our classes in order to approve it. Yeah, that's why if you look at ours, some say one hour and some say two hours. And the ones that are one hour is because they're like, well, this only took us one hour to go through, so we're only going to give you one hour credit. I'm like, hey, that's great. Because we come at this from a different standpoint, right? We're trying to provide operators with opportunities to train. We don't even list online training on wateroperator.org. We only list events. He means on demand. We don't list on demand.
Well, we're not in that business. Yeah. And, you know, the only reason we have that groundwater and wells class is because EPA asked us to create something for non-community systems, which, you know, non-community systems are almost always groundwater systems, or at least around the country, the vast majority are groundwater systems. And so we'd already developed a private well class. And so they asked us to develop something that would work for non-community systems. So we did. And then when we started asking states for approval, some of them started going, well, why can't a community water operator take this? Well, I guess they can. And so, you know, we pivoted and made it available. You know, we're trying to help everybody else that does training like you, not train ourselves.
We think it's a pretty decent class too. And so does, you know, like Massachusetts DEPs ask us to help them with some classes because of that. You know, I think it's all worthwhile. They let them be available to anyone, even though that's only for credit in Massachusetts. But yeah, that's how that all, we weren't planning to go there is the bottom line. I'm curious how looking at taking all these classes, A, did you like actually come up with any like new strategies that you wanted to implement in your own training? Or was it like, okay, I'm, you've made you feel good that I'm great. And I'm implementing these in a more sophisticated and rigorous way so that you can feel confident that the learning objectives are being achieved.
So sort of separately from taking all of these 30 courses, I was aware previously that Royce CEU, they're another course provider. And now I can't think of the other one. And they have a free option. So like you can you take the class, you can take any other classes for free. And then if you want a certificate, then you pay for your certificate at the end.
And so that informed. So now I have a study-only option, a free option. So anybody who wanted to take any of my classes can take them for free. And then I have separately the purchase courses. And there's only two differences between the separation. With the free classes, you can move back and forth among the slides as willy-nilly as you want to. There's no requirement to watch every slide. And they're free. And you don't earn any CEUs or training units with the free versions.
But if you take the paid courses, your movement is restricted. You have to watch every single slide in order. You can't skip through the material in any way. And you earn CEUs, and I report to state agencies. So looking at Royce CEU and some other companies that have that free option, that definitely changed my business plan a little bit. And I'm glad for it. I have about maybe 60 operators on any given day that are using the free versions to study for certification exams. Well, that's awesome. That's terrific, yeah. Good for you. I mean, that's helping the industry so much, and I'm sure it's still advertising too.
And sometimes I think people log in and they go look at the free version first to see if it's one that they actually want to take before they buy it. So that's also been helpful. One of the classes that, and I don't remember who offered it. But one of them was, it was really interactive. They had a branching thing. So if you would get down and you would ask, they'd give you like a little scenario, a troubleshooting scenario. And they'd be like, what do you want to do? Like a choose your own adventure book. And then you could click on, you know, one of the four choices and it would take you. And then it would be like, oh, you know, that didn't work out. You know, would you like to try one of the different ones? And so I've been thinking about how to make some interactive classes like that, where I could build a decision tree to help operators with some troubleshooting scenarios. And I don't have time between now and the end of the year, but that's something that I would really, really like to do. And I saw that in one of the other classes.
That's awesome. Yeah. You know, we've heard all about things like pretty soon we're going to have VR classes that walk you through a plant. And I hope that day comes as long as it's done the right way, because especially online, it's, you know, if you're not in a plant and you're not actually seeing that equipment and what can go wrong or whatever. I know, like, are you familiar with ERTC, the Environmental Resources Training Center? And you at Southern Illinois University of Edwardsville. Yeah. Yeah. Actually, I went on a tour there. In fact, we may have been on that tour together with WEF. We were. I helped organize that. WEF was in St. Louis. Jennifer Ford, too, I think. No, I was not there. We went separately another time. They train four days a week.
for a full two semesters. But once the students have got to a point where they understand the equipment and all the different treatment trains and stuff, the professors will go in and muck it up and cause a problem so that when they come in on Monday morning, they've got to figure out what's wrong. That's exactly what you're talking about, I think, for helping with real scenarios of things that they're going to encounter when they get out, quote, in the real world, operating a plant. It's useful stuff. Their operators come out ready to go. So we started this discussion with my statement that online training can be better than.
classroom training or as good as classroom training. And I really believe that because one of the things that you get with online training that you don't necessarily get with classroom training is consistency. So the same message gets delivered again and again. So if you have an organization with 20 operators, they all go through the same thing. They all get the same message. It can be peer reviewed ahead of time. So you can weed out statements that are opinion.
versus the actual textbook answer for different things. And you force that engagement by including audio, by including quizzes. You know, I have taught classes that are short school here. We have three different short schools in Colorado where I've had 100 plus operators in the room for a math class and had the guy in the front row open up his newspaper, big and tall, to block the view of people behind him or people take naps in the room, right? They're on their phone or whatever it is that they're doing that is not engaging with the material. I think perfect scenario is the smaller classes that I do where I have maybe 12 or 15 people in an in-person class. That is the best possible training environment because they can ask questions about anything and I can help them kind of work through the reasoning. It's really hard to do that with an online class to have that give and take. But if you're comparing an online class to most training sessions that people go to at big conferences, that give and take doesn't happen.
And there's a lot of opportunities for distraction in those big groups. So I'm a believer in online training done well. Yeah, there's even tools for that, though. I know we decided, you know, we put on several private welcome conferences for professionals. And at the second one, we use Slido, which allows people to ask questions through their phone. And what we found, but when we use Slido for people to ask questions, we couldn't get to all the questions people asked. But whenever we asked them to come up to the microphone in the aisle.
you know, we might get one or two questions total. And so just because, you know, whatever that is, whatever psychology. It's personality too. That's what I mean. Yeah. It is. People don't want to get up in front of the crowd or they're afraid to ask a question whenever it's there, you know, they're going to, when you see their face, even in live training, there's opportunity to do things in better ways. You know, there's things that are coming up and out there. Cause I think in the end, you know, especially right at the beginning of the pandemic, all the discussion, and I was on, I was still on the board, I think for the LA section, AWWA, and all the discussion was about what things can't be done in person. Some things have to be done in person. You know what I mean? If you're gonna take apart a pump. Yeah, sure. Really be able to put your hands on it and take it apart.
That discussion doesn't seem to happen now. And maybe it's because it's kind of settled itself on its own as an industry. I think it's all those things. You know, there's places, depending on the topic, where there are advantages one way or the other. But I totally agree, I guess, that a small group in person where everyone feels like they can have a conversation is probably always going to be the best way to learn.
I'm curious. I was thinking about kind of the way you were describing things, almost like flipped classroom approach, where if you can get someone to focus the on-demand training and the supports in place to make sure that they are staying engaged can create a really great learning environment. And then you can supplement that with that in-person opportunity. So with that, I'm wondering, do you host any like live Q&A sessions for your maybe on-demand students that aren't in anywhere in Colorado or where you were training live? I don't. I haven't even considered doing it. It's been... Now that you have time to add something. It's a good question, though. I mean, because it's...
For our private well program, you know, we're trying to reach well owners. We actually do provide CEUs for environmental health professionals through NEHA, but that's not our focus. And so we're not really into it to provide CEU training. And what we do with our GoToWebinar webinars every month is we let people ask questions when they register. And we take a list of those and several of us sit in and answer 15 or 20 of those. And that's the second half of our slide deck. And so we're answering people's questions. Some of them, you know, we get some questions every month about like, what should I sample for? We always get some really interesting ones and we try to highlight those. And it keeps everyone's attention. It's really helped grow our number of folks that actually participate every month on the private well side.
One third lesson, one third answering pre-asked questions, and then one third answering live questions. Yeah, we also answer questions at the end. We let them put them in the question bar and we share a Google Doc that one of my staff is entering all that. So there might be two questions at the end that were asked during the webinar. There might be 15. And the webinar, we did one yesterday. And part of it's because I'm a talker, but it was supposed to be from one to three and it lasted to almost 3.30 answering the questions. But again, we don't care, if you will. It's not focused on trying to provide CEUs. It's focused on trying to help well owners understand how to take care of their well. Yeah. Different animal.
There is a way if somebody did an online class, I mean, they can send me a message through the online class system to ask a question and people do, but there isn't a scheduled direct Q&A. And it's funny that you guys have that a third, a third, a third, because I find that when I do, especially if it's on-site training for a municipality where they scheduled me to come up, we agree on an agenda ahead of time and I get that agenda approved for CEUs and it almost never survives first contact with the client because they're like, now that you're here. let's talk about all of these other things that we have questions about, which is great, right? Because my whole philosophy is that when you are getting the answer to a question that you want to know the answer to, that is when learning is at its absolute highest. For sure. And Colorado is thankfully a little lenient there when it comes to the CEU approvals, because that is what I plan to talk about if things go off the rails a little bit, as long as it's not underwater basket weaving or renaissance fair booths or something like that. As long as we're still, you know, in the water and wastewater wheelhouse, the CEUs can still be issued. Yeah. And, you know, and it's really worked for what we do. But again, our focus is much different than doing continued education credit for water and wastewater operators.
Although there's a couple of states now that are interested in letting their operators participate in our webinars and getting credit for it because they have groundwater systems and they think it'll be useful. We're not pushing that at all. They come to us, we don't go to anywhere. Yeah, and it's interesting because like your point about kind of consistency and messaging, you know, when we're answering questions live, yes, we do try to provide consistent answers, but still you do have a person sharing their perspective and their experiences and doing it. So there are certainly pros and cons to that. There's certainly times where we can't answer a question. I just don't know.
And so those folks, I just ask them to email us and then we find an answer and we end up, you know, calling US EPA or, you know, the Water Quality Association or whoever we need to, to try to figure out, you know, how to help that person. And, you know, we have luxury of doing that because we're grant funded. Yeah. And also trainers have bad days. Certainly. Sometimes you have a training session. I had a three-day class in Steamboat Springs last week and I was just on my game the whole time. Like it was an amazing class. Everything went just the way that it's supposed to. I gave a talk in Ohio.
at a conference and I was definitely not on my game that day. Like I did not feel real great about my talk that morning. The online class does not suffer from whether or not I'm hung over. Like it doesn't. No, that's true. That's true. Or anything else. So that's one of the reasons I just really like the online platform. It's also super convenient for people who are working swimming shift or graveyards because you're not pulling them off their shift to go to a training class. And so they're going to learn better if they're on their own time. Sure. You know, it comes down to the trainer being in the game and it comes down to the operator being in the game because there's certainly operators who, you know,
Like you mentioned the newspaper or they're there because they know if they're sitting there, they're going to get credit. You know, my sleep story is the last day of our only section AWA meeting, they always have our state primacy agency come and talk. And everybody shows up for that. There's four or 500 people in the room. And there's a guy that sat in the front row. This has been six or eight years ago who fell asleep and started snoring while the EPA folks were up there talking. And it was the funniest thing I've ever seen because he had no concept of how he looked in front of 500 people. Well, at least he wasn't the trainer, right?
No, he wasn't the trainer sleeping. He might have been on graveyard shift and come into days and, you know, that's just hard. Or a kid kept you up all night or, you know, whatever, whatever it is. So that consistency message is really important. I agree. And I have seen, sadly, you know, I've gone to short schools where the person gets up to teach their topic. And instead of their topic, you get a rant against the state or a rant against the regulatory agency or their story time. And there's no actual learning that is occurring. And you can't pre-bet that. It just happens sometimes. Or you have a complete sales pitch.
that is happening instead of education. And I don't have that problem because training is my sales pitch. That's what I do now is almost 100% of my business now is training. You mentioned short school several times, just out of curiosity. Ever do any of that work with Bill Hogrew? I haven't worked with Bill Hogrew directly. I've worked with Joy, his wife. Okay, maybe it was Joy. I can't remember. We know Bill and Joy, obviously they used to be with RCAP. And I just remember there was always a week or two where they weren't available because of short school.
Yeah, so I teach in the industrial track at what we used to call the Boulder Short School. It was the intermediate and advanced school. It was in Northland last year. I've been volunteering for that school, oh, I think for 25 years now. That's awesome. And the Leadville Short School, I was the coordinator for that school for five years in a row. I spoke at that school for a long time. And then when I was pregnant with my last child, who just turned 15, my doctor was not comfortable with me being up at altitude when I was seven and a half months along. He's like, no, you're not going this year. I was like, but no.
And so all of the things I was doing at the Leadville School, they found new volunteers for, which is great because, you know, like people should get their information from a variety of sources and a variety of trainers. And so that kind of got passed on to other people. And I really haven't done anything with the Leadville School since then. And then Joy and Bill ran the fundamental school. I don't know if they are still involved with that school or not. I don't know either. I don't think so. But when is that? We'll probably have time of year. It's usually like end of January, mid-February. Is that week-long short school? They're in Florida then, so. Okay, so they're not involved anymore.
Probably not, yeah. I've been a speaker at that school too. I used to teach the math class and the activated sludge class for that school. I did take a break from teaching at the short schools when I first started my business because it just seemed weird. It felt weird to me to ask clients to pay for something that I was giving to the short schools for free. And so I know I'm back to volunteering again, but it just felt awkward for a while there. It's not an issue anymore. Honestly, that just shows that you're a professional. So, I mean, that's a good thing. All the things you've shared today, there's a lot of really good information for not only trainers to hear, but certainly the states to hear.
It's really been enlightening today. So I really appreciate you being on with us today and talking about the work that you do. This has been a great conversation. Well, thank you. So I sent you the PDF of the presentation that I did over for the WPI conference. I know that this is a podcast, but you can share that with your podcast listeners. I don't mind at all. Oh, that'd be great, yeah. No, we'll link that up in the show notes. We can host it on our website, so. Yeah, I mean, you know, the website is drinkingwaterpodcast.org. And so when your episode goes up, we'll have a link to Indigo. And I guess we haven't asked that yet. Do you have a LinkedIn page, too, or any of those social media things? We'll link to those.
So I don't. I'm the worst consultant in the world. I forget to bring business cards everywhere I go. And I don't maintain a social media presence. I am pretty involved in a Facebook group, Water and Wastewater Operators of the World Unite. That's a very large group of people. It's been a little quiet lately, that particular group. But it's a fantastic group for operators to just go and ask questions about anything. My favorite questions are where people post and they're like, I have equipment piece X. How do I get this part off? Or how do I find a replacement piece for this thing? And there's a lot of really helpful people in that group who will respond to almost any question that you ask. It's like 20,000 people or more.
Yeah, it's huge. It's a huge group. No, yeah, it's really interesting. And for me, I would look at that every so often or whatever, but now our social media folks have asked me to start getting more involved with LinkedIn. And I even have it on my calendar to post on LinkedIn just so that I'm showing a presence there and I basically let everything else go. There's always choices for sure. Well, there's a lot of things I realized I probably should be posting in that group that are worthwhile about what's going on in the world. I do have a LinkedIn account and I have about 5,000 connections on LinkedIn and I never look at it. Sure. I really used it as a Rolodex. Sure.
Because when people move, it updates automatically. But yeah, I'm not really much for social media at all. I've never had a Twitter account, so I'm completely out of the loop there. Which makes me sound like an old cranky person. I'm only 53. Well, you know, I don't think that's the case, especially on the Twitter side. That's a whole other conversation that could be a whole podcast episode. And not on ours. What I found that was LinkedIn.
I actually like it because it's really just about professional folks where, you know, on Facebook, so I have them separate completely. Facebook is really when I get on there, it's to look at stuff from my family, my friends. And LinkedIn is where I only have connections most. I mean, I don't think I have any family connections there or anything. It's just for people I work with or I've worked with or have some interest in what they're doing. Yeah. The people that I am trying to engage with the most, operators, tend to be on Facebook rather than on LinkedIn. Utility directors and city council people and other engineers and professionals tend to be on LinkedIn, but not a lot of boots on the ground operators have LinkedIn accounts.
My best connection, and in fact, it's really the only reason I haven't left Facebook entirely and just shut my account, is that water wastewater operator of the world group. If you're already a genuinely helpful person, being genuinely helpful in a place where you can potentially reach new customers is a great way to do authentic marketing. And to see the kind of the quote goodness in the industry. Everyone is trying to help each other out. Yeah. So if we have time, I'd like to talk about two things that I saw at the WPI conference. If I could throw these in. Oh, sure. So there were two companies there. Watora was one of them. So Watora is a French company.
that's getting into online training for water and wastewater professionals in the European market. And maybe over here too, we'll see. And so because of this talk that I gave at WPI's conference, Watora gave me a login to go and look at all of their classes. And they are implementing all of the best practices that I covered in my talk. So it was really, yeah, it was really nice to go and see another company kind of starting from the ground up and doing everything the right way. They've hired professional actors to do the voiceovers for all of the technical equipment, for all the technical talk.
And that's a little more engaging because, you know, as we all know, not all people who are technical experts are great public speakers, although they write great text. So that was pretty interesting. I was really glad to have the opportunity to look at their stuff. And I look forward to having them as another place where people can go for training in the market. And then there was another company there that had a booth that kind of terrified me. So they have a software program that's AI-based that will make a training class for you. And so I was talking to them and I was like, well, how does it make a class? And they're like, well, you say I want a class about activated sludge. And then it just goes out into the web.
and makes the class for you. And it even puts all the pictures in. And I said, oh, well, so you have a library of pictures that it's pulling from. And they're like, oh, no, it just gets them from the internet. And I'm like, that's terrifying. Like how the AI doesn't know what's real and what's not real and who's not a recognized expert. And it's just going to steal everybody's pictures. And then you're going to try to put this on or sell it and be in all kinds of copyright violation.
That was shocking to me. That's scary. Like, it's one thing to say, like, take, you know, I know, for example, RCAP has, they have their library. These are our trainings that we've approved. And to say, OK, I need a 30 minute training with slides on these three topics, only pull from this existing, you know, section of slides to give you a place to start. Like that, I think, would be something that was really helpful. But just pulling from the Internet at large is, as you said, scary. We now run a private well hotline and help center funded to EPA. It's on their website. And so we developed about 150 common questions.
We put all that in a knowledge base so people can go to this help center and they can go to chat and there's a chat bot and it can ask a question. It actually is an AI, but it only goes to the things we put in there. So we put in like all the transcripts for the 120 or so webinars that we've done, the class lessons for our private well class, and then all the answers we've given through blog posts and other things. But they're our answers. So we're consistent in our message. And then the AI goes in and looks at all that and comes up with an answer. But people can also go directly to the questions and the knowledge base and get an answer there, or they can call us.
and we can help them directly. And getting that all set up, we looked at various levels of how AI goes out and searches for things. You know, there's some through Microsoft and some through other companies. We looked at a number of those things. And if it used anything outside, we disagreed with some of the wording that was in it or whatever. It's just, it doesn't work. You know, you have to have, all the content has to be yours to start with in order for the AI to provide answers that you're happy with and like, in my opinion. Even people aren't great at deciding what is a reputable source.
And there are areas even within Activated Sludge where experts have different opinions. And I just don't know how you would make the AI sort through that. And what's even scarier to me is that a lot of the free blogs and things that are out there are just loaded with so much misinformation, even on the technical side, that I just can't imagine what kind of a class would come out of an AI pulling things from the internet. Well, especially when so many of those companies are using the AI to write the blog post now. And then so it's like it's creating junk from junk.
One of the questions we had for our webinar yesterday was about as PVC ages, how much PFAS is that releasing? And they said they found on the internet, you know, that this is a problem. So I researched it over the last few days and, you know, PVC doesn't have any PFAS in it. It's approved still and all, I mean, it's even approved for sampling for PFAS. I did find several sites that said just the opposite, that it's a problem and, you know, as it ages, blah, blah, blah, but they weren't reputable sources. The California Water Board is a source I used in my answer because they're definitely a very reputable source in my opinion. If you aren't careful, you're going down the wrong path really quick and it looks real and it looks right. And it's really a problem for sure.
And now we're even getting directives here. You know, we do a lot of applied research that we really need to start considering how we're going to use AI in our research. And I think, you know, there has to be a lot of guardrails there or you're going to see a lot more research that's certainly inaccurate, but maybe blatantly wrong. We kind of made it through everything. There's a lot of good information here that people need to hear. So if they go look at the presentation, they'll find some other tools that maybe that they don't know about. Kahoot, a bunch of these tools I discovered during the pandemic because my kid's Spanish teacher was doing all this stuff online. That's how I know about Kahoot.
Yeah, so I use Kahoot and GimKit and Quizlet now and Poll Everywhere I learned about from Pulse. I was actually using that long before. But all of those tools can make your online classes and your in-person classes a lot more engaging, a lot more enriched. And it really drives the point home. I find, especially with Poll Everywhere, that it's made me a better trainer because when I get mixed responses from the audience to a question, I know that I did not explain something well. So that feedback loop goes both ways. Yeah, and like I mentioned Slido, same thing. I think that's what we're going to have at a private wall conference in May next year in person.
And we're definitely going to use that service because it certainly creates more engagement among the people that are there, which is the whole point, right? Yeah. Well, this has been an exciting conversation for me because I love to talk to people who kind of speak my state language and do similar things. So I appreciate getting to know you, Sydney. Thank you so much. I appreciate it. TAP Talk is a collaboration between the Rural Community Assistance Partnership and the University of Illinois with funding from the U.S. Environmental Protection Agency. The show is hosted by Steve and Jennifer Wilson of the Illinois State Water Survey. You can visit drinkingwaterpodcast.org to find the full show notes for this episode.