Skip to content
Episode 29: ERM at DOJ OJP episode artwork

Mar 18, 2020 31 min

Episode 29: ERM at DOJ OJP

from AFERM Risk Chats Hosted by Association for Federal Enterprise Risk Management

This week we chat with Lucy Mungle from the Department of Justice’s Office of Justice Programs (OJP). We discuss OJPs ERM journey, starting with grants and moving into all aspects of the organization!

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Episode 29: ERM at DOJ OJP

0:00 31:54
of matches

Transcript Auto-generated, may contain errors

Hello, welcome to RISC-Cats, the firm, on your host, Paul Marshall. Today we're speaking with Lucy Mungold, Department of Justice's Office of Justice Programs, and we'll talk about their ERM journey. We started off primarily with grants and it's stated into all aspects of the organization. Hello, and welcome to the podcast.

I'm happy to have you here with us Lucy Mungold back again. How are you doing this morning? I'm doing well, how are you? Very good.

So, yeah, Lucy joined us on an AGA podcast, and now we brought her on to the Affirm podcast, because we want to talk about their ERM program over at the Department of Justice, Office of Justice Programs, OJP. Yeah, so let's start off. Lucy, why don't you give us a little bit about yourself, what you do over there at OJP? Sure, sure.

I am a RISC-Cats Management Analyst over at the Office of Justice Programs, and I am in the Office of Audit Assessment and Management, which is the oversight arm for OJP. And my background is actually audit and accounting. I've got about 25 years' experience in private sector and public sector, and my role over there is to manage their enterprise management program, and I'm also responsible for oversight of grants monitoring for OJP. Right, and that's a really huge thing there, right, the grants?

Yeah, so at any point, one point in time, we have anywhere between $12 and $15 billion in open awards, and about $5 to $7,000 in open awards, so it's a lot, and we have statutory requirements to monitor at least 10% of those. Right, well, we'll definitely get into that. Now, when we start off a little bit about how you all decided to kind of start your own ERM program, because I know DOJ has a program, but you're off, you know, OJP specifically kind of the history of that. Sure, so way back in 2010, we actually had an audit, an audit finding that we needed to do a, we needed to select our monitoring based on risk assessments, and so in 2010, we developed our first risk assessment for our grants, and that was kind of how it all got started, and it evolved from there.

So we started, and this was post-award, we started doing a risk assessment on several criteria for each open award, and then we would score it, and then that would help us determine our monitoring plan for the fiscal year. Well, then we realized, well, we probably needed to look at the entity level, so then we started scoring at the grantee level, and that gave us a good idea of which entities posed a greater risk, because we don't, so we have something to have one award with us, $50,000, but we have others that have millions and millions of multiple awards from multiple program offices, and so they're at a higher risk if they're not managing those awards properly. And then we realized, and again, this is over the course of years, then we realized, well, we have different programs, and those different programs pose different risks. So a new program is inherently riskier, because we don't know how it's going to roll out, we don't know what's going to happen, it's got new requirements, et cetera, and then we have other programs that just have a lot of money, and so they're inherently higher risk, and for example, the Crime Victims Fund, our appropriation from that increased significantly four or five years ago, and so that changed everything and how we were looking at those awards.

Right, okay, so just I mean the kind of work you all do is inherently, you know, a lot of money involved is a risky subject matter, so you have to kind of put more rig around this, just realize that. And I'm assuming as a firm and federal government started getting interested in this topic, you all just kind of said, hey, this is something we should do ourselves, and you started getting more guidance and things. Yeah, so it was interesting because the person who actually stood up our ERM, who's now our chief risk officer, we stood it up before it became a federal requirement. So we were very interested in what was going on in the private sector and enterprise risk management, and there have been some kind of some talk about enterprise risk management moving into the government sector, but we knew that it had a lot of success in the private sector, and we actually went down to North Carolina for some training on how to implement enterprise risk management.

It was actually kind of funny because we were the only government, and we were from the department of justice sitting in the room, and as soon as we introduced ourselves, things got very quiet. That's how I used to walk in the room and I used to be an auditor saying kind of thing. Yes, that's exactly the same thing, it was kind of funny. But yeah, so we stood it up probably about a year and a half before the April 23 requirement came out, and our intent was to, we knew we had good risk assessment process in our grants risk, but we also knew that we had all these administrative activities that were around at things like procurement, human resources, IT, all that kind of stuff and finance that we needed to make sure it was all coming together in one big package.

Right, so yeah, and that was something I wanted to get into a little bit later, but you know, I think grants is your biggest focus to start, but you move beyond that and you're really looking at the enterprise and other activities. Yes. So let's go back, so let's talk about your chief risk officer. I thought that was an interesting origin story too.

I wanted you all to decide who's going to be the CRO. So that was interesting and it was a big discussion and we looked at it and it could have been several possibilities in the organization. If you look across the government, it falls so many different places in each organization. For us, the way our agency is organized is we are headed by a political appointee and then underneath that political appointee, we have another political appointee who's responsible for policy and implementing the policy agenda and then we have a career SES who's responsible for administration and management.

And then the political appointee has all of the program office, political appointees reporting to that position and then the Deputy Assistant AEG for administration and management has like the business office reporting to it. So we knew we needed support from the top, you know, tone at the top is really important and that support just really just flows to the organization. So we originally, well, should it be the AEG, the Assistant Attorney General, the head of the agency and we thought, well, that would be great, that would be wonderful, but it is a political position. Right.

And then the other thing is that one on average political appointees turn over between 18 months in every two years and that's just a reality of government and then of course they will almost all the time turn over every four years when the administration changes and then there are risks associated with administration changes because policy changes, the agenda changes, you have to turn on a dime and implement that new policy agenda which means there's going to be changing and there are risks associated with all of that. There's changes in policies and procedures, et cetera. So we settled on, it was then going to be between the Deputy AEG for administration and management or my boss, the Director of the Office of Assessment Management and we really wanted it as high as possible, the organization. So we settled on that Deputy Assistant Attorney General and we felt it was best with the career position but what we did is we set the Chief Risk Officer there and then we have regular meetings with the Chief Risk Officer but we also have the Risk Management Council and that Risk Management Council includes the AEG and includes the Principal Deputy AEG, those political appointees and that's how we kind of pull it all together and it works very well for us.

Yeah, so you know, and give us a little bit about the fact that you know, you have the CRO position where it is, how that has helped to kind of spread the word in the culture and you know, any new initiatives that come up, you know, risks thought about or included in the process, you know, how has that helped? Well, it's interesting because you know, in that position, it's like all of our funding recommendations go through that role, all of the business support activities go through that role, so any new IT systems, any procurements, all of that, that's the engine that supports everything and by having the Chief Risk Officer there, so all these new initiatives that we do, like even if we have a new program which is coming from the program side, you have to put in place the process to do that and that's an administrative function. So having it in that role meant that every time we were doing something, she wanted to know what do we consider for the risk and mitigation associated with it. And so we put together like a multi-level education at Herba has, so I would go to the Senior Leadership Group and we would do these sessions called Risk Mitigation and Action.

And our first approach was to tell everyone, hey, you're really doing this every day, we just haven't labeled it like this. So we would take situations where they had, we identified where they had put in place all sorts of risk mitigation activities and we would do a presentation and say, well, in this program, here's what you did and this is mitigating this risk and this is mitigating this risk and here's how you identified this and we would show everyone how that was already happening because one of the biggest pushbacks that we thought we were going to get is I can't do any more work. Right. Right.

And that's a very real thing because it's true, everyone's stretched to the limit and you also, you want to bring value to the table and by reframing the way people were thinking about it, it really, it was interesting and fascinating to see it start kind of creep into the culture in the vernacular as we worked through it and I would be in meetings with staff and they're like, well, you know, I was looking at this and there's a risk of this is going to happen and we're going to do this to make sure that we don't end up going down that path. So it really was that role, making sure that we were just really thinking about risk at every level and just making it part of the culture. Right. That sounds like a, I mean, that's just a huge success story and a lot of folks struggle with where to put the CRO or, you know, it just happens, it basically dual hat sort of thing going on, right?

Yes. Or I'm sure this person has many hats. Perfect positioning because again, like you said, basically all these things have to go through her anyway so she's going to ask the question about risk and, you know, kind of like the way you kind of, you know, help people realize they're already looking at this is not a new thing. You're just kind of explicitly stating these are the mitigation activities.

Yeah. We saw the same kind of progression when we started doing the grant risk thing back years ago, people were, we know, pushback about it, you know, I don't want to do this and now it's like where are the risk scores, we need the risk scores to be able to do this because they realize it's a decision support tool. Right. And some of it is people look at risk and risk scoring and they're like, well, you know, I don't want you to take over my decision making and we're like, we're not.

All this is giving you is a landscape view and it supports your decision. In fact, one of the most important pieces that we try and get into our risk assessment is that qualitative assessment of what is going on. And that's a hard piece to get in, but it is really important. Yeah.

Well, I can imagine imagine those handing out millions of dollars without some kind of assessment of a risk or a SIP or a SIP. I mean, that's just, so that's good. You got to do that. So, well, let's talk a little bit about, you know, some of the, some just a little bit about the process of, you know, what, what are kind of some of the major roles and responsibilities for your ERM program and the council talk about that a little bit, how often you meet and what's more official activities as an operator.

So, operationally, it's, it's interesting because the actual ERM team is pretty small. Okay. So, it's me and one other person for the ERM team and we have contract support, which is absolutely great and fantastic. But what it is, is I'm in part of the Office of Audit Assessment Management and so we have the director and we have our little ERM team, but we have our audit review division, we have our program assessment division and we have our grants management division and our little risk management group kind of leverages those things.

Okay. So, we take the information from the audit and review division as a feedback loop. So we see what's been going on, we take those findings, we compare those findings to our monitoring and we adjust our risk assessments as necessary. So, that's kind of our feedback loop and we also will then feed that back into our monitoring.

So, we start seeing something going on, say we see a trend in some findings and then we'll say to our monitors, hey, you need to look at say sub recipient management, you need to look at that a little bit more closely. And or we'll then when we look at the program level risk, we'll go to our program assessment division and we'll say, hey, so we see some of these programs that are higher risk. Can you do an assessment on what's going on in those particular programs or we might take that program and we might work closely with the program office in what we call risk assessment management meetings and those are periodic. We work very closely on the program and the individual grantees and how we're managing the risk in those.

And then with our grants management division, they have like all the policy and the procedures and document all of that stuff. So, we leverage that in order to kind of move everything the way we need to move it. And then our A123 group is also on our review division. So again, that's a feedback mechanism and we can also say, hey, we think we might have a higher risk over here.

So, we think you need to look at these internal controls. So even though it's a little team of two, it really is a much bigger collaborative effort. And I think that's probably the story of ARM there. It's all about getting a collaborative effort going.

And it's all about getting people to talk to you about what's going on in their programs and how they're managing it and are they thinking down the line? Absolutely. Yeah, that's good. You had the right leadership, the culture and now you have a good solid process where you can kind of pick and grab from things that you already have in place and feedback loops is just a good thing.

You don't have to create this huge thing from scratch. Exactly. And I think that was one of the things that as I go to a lot of the firm events and everything, everyone struggles with, oh, do we have to put this in place and that in place and that's big infrastructure? And my suggestion would be to the extent that you can wiggle into what you already have in place and do it because it's going to make your life a lot easier and leverage what you have.

And everybody's different. What's at OJP might not work in another agency. And it's probably not going to be another grant agency. You have to work within your own environment.

And when I go, I do a lot of speaking at a conference's, and a lot of it's on subrecipient risk assessment and management and they're like, well, give us your risk assessment. And I'm like, well, but it's not going to work for you because the most important thing is to assess that environment and what's your environment and you build your risk assessment for your environment and as that environment changes, you have to adjust. Right. Right.

That makes sense. I mean, it's still the spirit or the approach to work for other agencies and other programs but it's also the specifics for sure. And that's what it is. It's the spirit of the approach versus the specifics.

And some people just, you know, and they're so unsure. They want to like have like a checkbox. And so I try and get them into a discussion level of what are you experiencing in your environment. And this is how we handled something that's similar.

And like, oh, we have this limitation. Okay. So, but once you get them talking and they get to that comfort level, that's where I think the light goes on. Right.

So something I was also interested in is a little bit about your journey. You know, when you started the ERM, what did you expect but then what did it really turn into? Where did you go? You know, how did things evolve over time?

It was interesting because we thought it was going to evolve into a more classic ERM environment and you know, with this big structure and everything around it. And it didn't do that. It evolved because for us, the risks associated with grants are by far a big risk. So it's interesting is, you know, ERM stood up across the government.

Of course, it also stood up in the department of justice and they developed their own ERM. And so we do a risk profile that we then send to the department. Well, what ends up going really is grant risk. So we have all these little risks under that, right?

You know, we're at a much more granular level, but we send to the department of grant risk. Right. That makes sense. And so it's really, very funny is that each layer that you look at it, it's different.

But for us, we thought it was going to be a lot more formalized process, but it's still not as formalized. It really kind of worked into what we already had going. And I thought we would end up with a little bit more formalized processes in our program offices, but we did not. But it works.

That's the main thing. Yeah, it still works. It doesn't have to be this, you know, perfect, whatever utopia. But you're in a program.

Right. You know, what actually works as a support grant. And what we found is that what works is a lot of talking to people and really getting in and trying to understand what they are facing on a daily basis because it's easy to sit at your desk and look at the spreadsheet and push something out to somebody. But until you're sitting down and getting that feedback from them, you know, well, I have this situation, what do you want me to do about it?

It doesn't fit into your box. And that's where we get the best interaction. So we've had, you know, we've had situations that we've really had to change course because you know, we're trying to take the time to talk to people and understand where they're coming from because it is unique. And that's where we've found that having these meetings and having these discussions, that's where the risk management is most effective.

So and I'm back from what I was going to mention earlier. Again, about the evolution, you all really just obviously started off really focusing on grants, but you have this has become more of an enterprise wide view now, right? Yes. Yes.

So we we focus on grants and we knew that we needed to get in place some of the other things that are around that because they affect our grants management. So our procurements affect our grants management. We can't care the systems we need, et cetera. We're going to fail.

Our cybersecurity affects our grants management. And actually that cybersecurity risk extends out to our recipients because to the extent that we are funding, say, victims assistance and they have a cybersecurity issue where victims names have been compromised, we have an issue. So it's been interesting to wrap all of that around because you start thinking in different ways. You know, we have finance risk for us, you know, just the whole process of the financial statements and, you know, processing grant payments, et cetera.

There's risks associated with that. We had never given that any thought. Even, you know, we had a new program where we we got a new appropriations, brands making a new program in FY 18 and this particular group of potential recipients, they weren't going to have enough time to put something together the way we needed to put together. So we did a two stage application process.

Our system was not designed to do that. Huge risk for us as we moved things in and out of the system and did what we call data change requests in order to get it where we needed to get it to go administratively through the system. So there's a lot of those types of things that as we bring those in and see those risks and even just a reputational risk. You know, you get something where somebody does something that hits the newspaper.

It could be something minor, like a cup of coffee or I think we were muffin, we were muffin gate. So that's a huge reputational risk. And no matter what happens online, it's just where does it hit the headline? Right.

And it could be a minor thing. But you know, that one muffin thing created a huge process that now, however many years later, things nine years later, everybody realizes that the costs are probably not worth the benefits in that process because it was a huge government-wide knee-jerk reaction. And while yes, it's very important to control those costs, the process itself that got put in was very costly. Right.

Right. Well, and I like the way you describe it because I mean it sounds like your rep program has kind of met exactly what the purpose of these things are. So you look at what's your primary, what's your biggest goals of your mission? Okay.

We start with that grants. Okay. Now what's the risk of awarding to these folks or whoever? Okay.

But then oh, how do I get those out? How do the applications come in? Well, that system has some issues. Or you know, what about information about these folks?

I might get leaked out through a cyber attack. I just love how all these things kind of start to pop up now that you're really looking at enterprise view. Yeah. And even like we even like brought it back into our program planning because we get the appropriations.

But when you play in your programs, you have to make sure that you're planning them to achieve your intended goals and objectives. And if you don't put into place the right grants and programs and make sure that you know, because we might get say a hundred million dollar appropriation, right, and we're supposed to achieve X, Y and Z. Well, that hundred million dollars is probably going to go to, you know, maybe a hundred recipients ish. But you have to make sure that as you distribute that money amongst 800 recipients that you're checking off everything you need to because some of them are only going to do X.

Right. So we're only going to do Y and some are only going to do Z. But if you only award for Y and Z and you skip X, your whole program fails. Right.

So it's all of that kind of planning and it's been really interesting to work with our performance people, work with our strategic planning people and be there right at the very beginning and to see it roll all the way through and then to take the results and then feed it right back into that loop. Yeah, that's great. So one kind of tangent here, but I was curious about fraud and you guys are tackling that. Obviously something we're talking a lot about these days, some of the fraud acts and things out there.

And how can you kind of fraud and come into play with your program? Well, it's interesting that you say that because obviously our risk assessment grew out of our grant risk assessment, which was post-award. We didn't incorporate pre-award risk assessment until 2014. But post-award, what a lot of the criteria that we are using in that risk assessment are criteria that might indicate a risk of fraud.

For example, we look for excess cash, which is has the grantee drawn more funds than they have reported as expenditures. And if they have, there's the possibility that their internal controls are not where they need to be, which if their internal controls are not where they need to be, then the risk of fraud goes up. And the same with we take a look at their expenditures to date and what they have put in their progress report, what they've written in the progress report. It should make sense together, right?

If it doesn't, then that risk of fraud goes up. And even things like, are they filing their progress reports on a timely basis? Are they filing their federal financial reports on a timely basis? If they are not, their internal controls might not be where they need to be in their management controls, which could indicate that the risk of fraud is higher.

And I'm not saying that fraud exists. It's the risk of fraud that we're dealing with. Now we've always had these kind of indicators going on in our risk assessments, but we've never articulated them as addressing the risk of fraud. And that's what we're working on now, is specifically saying this is how OJP is addressing the risk of fraud in our grant environment and also in the wider enterprise risk management, because the risk of fraud within the agency also.

So we have ethics trainings and we have all sorts of internal controls that address that risk. But we've never actually kind of articulated this is specifically how we're addressing the risk of fraud. We've been doing it, but we've never laid it down on a piece of paper and said, the risk of fraud is this and this is how we're addressing it. So that's something that we are working on right now and is kind of maturing at this point in time.

Okay, very good. Well, we're getting near the end here. I think I wanted to, my last question for you was going to be about what's next or what would you like to see in the future for your program to keep evolving and moving forward? Well, I'm actually really excited about what's next.

OJP is we're putting into place a new grant management system and a new financial management system. And so that is going to position us and give us an environment where we can take advantage of some of the better technology that's out there now. Artificial intelligence, bots, more and better data analytics. So we're really excited about that.

And I think it's going to just create an environment that one is going to help reduce the burden on the grant recipients, but also give us better information. So really excited about that. And there's also some government-wide efforts that are going on related to that. And then from, so our grant risk management process I think is fairly mature, but I want to see it go to that next level with the AI and the bots.

There's a lot of data out there that data analytics can do wonders on. For the other enterprise risk management, the pieces that wrap around that, the procurement, the HR and all that kind of stuff, I want to try and mature that up to the same maturation level as our grants risk. And so I'd like to see that get a little bit more integrated into that process and be a little bit more formalized and get it to the point where it's, I can go and just have a nice little risk profile that has all of those things in it and attachment button, but it's always time. Right.

Well, it just sounds like in general folks are trying to take advantage of these analytics and more advanced dashboards, visualizations, bots, even things that help make things easier, but just kind of bring things in more analytical age so you can use that data for even more in-depth risk assessments as well. And I think there's some exciting stuff going on at the government-wide level as well that's looking at that. And I think the next five, ten years, you're going to see a big change in federal government in terms of where they are from an information system perspective. Right.

Well, Lucy, thanks so much for coming out. We really enjoyed it today. I appreciate you coming on and talking about your program. Thank you for having me.

Thanks for joining us. Want to see more of our podcasts? Check us out on firm.org. We're trying to get these out every week or two.

A lot of good topics, so never run out of them. Of course, as always, if you have ideas, please let us know. And we'll soon be going to holidays here. So we'll be looking up a happy new year, happy holidays, and we'll get one or more of these in a minute.

Frequently asked questions

How long is this episode of AFERM Risk Chats?

This episode is 31 minutes long.

When was this AFERM Risk Chats episode published?

This episode was published on March 18, 2020.

Can I download this AFERM Risk Chats episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.