Data Warehousing Deep Dive

In this Deep Dive, Frank and Andy delve into the world of Data Warehousing, what is it and do they know things? Let's find out! Frank also shares that he has a new role at Microsoft. AI Generated Transcription Hello and welcome to data driven, the podcast where we explore the emerging field of data science. We bring the best minds in data, software, engineering, machine learning and artificial intelligence. Now hear your hosts Frank Lavigna and Andy Leonard. Hello and welcome back to data driven. The podcast where we explore the emerging fields of data science machine learning an artificial intelligence. If you like to think of data as the new oil then you could consider us like Car Talk. However, we can't go on a road trip because of the Corona virus lock down. So it's just Andy and I kind of stuck at home respectively. And thanks to the Magic of Technology we can be on the show at the same time. And, uh, how's it going? Andy? It's going well, Frank, how are you doing? Good, good, uh, you'll probably hear my kids in the background. We will, and you know what Frank, I think it's fine. You know I'm going to. I understand why you said the word stuck with you and I work remotely an awful lot. We usually record like this. There's there's less in the background. It's your place most of the time, but you have couple of young boys there and you need to be in the room with them when mom who's also working from home is you know is doing some of her work so kudos to you to both of you for finding a way to manage this. Everybody's going through these sorts of things and I'm sure that none of our listeners will mine here in your sons play in the background or hopefully won't start fighting so that's Well, I asked, I asked if they do I think a lot of folks can relate though. Yeah, oh absolutely, absolutely so. We're recording us on April 16th. We Speaking of kids, we had your son on which if the order of recording goes the way I planted in my head. That would have been released last week. And Uh, which I thought was a pretty good, uh, discussion on. How stem is taught? How stemmers perceived by quota quote policymakers? And how the actuality of it is? And some of the interesting stuff your son is doing with Raspberry Pi and stuff like that. Yeah, I was a I was first I was very proud of him. You know the work that he's doing and he's he's had his his hands in machine learning for really a couple of three years. Now I want to say he was 14 and I came into his room. You know just checking on say something or something I saw. A Mario Brothers playing in the background. Like what do you think you know he was? He he had done his school work? He was home schooled at the time he done his school work. So you know what he wants. But um, later talking to him about it, he said he actually came and got me and he said, OK, dad, it took, you know with I think it was like 6. You know neural nodes. Here he was able to, Mario was able to figure this out and something like 4 hours or something you know later he said I wonder what it would be if I added a note. I wonder what that would do to it and I'm kind of sitting there with my mouth hanging open. Going show dad more about that nice, but he's been doing it for awhile. I know your kids are interested in the same thing. They're younger Stevie 17 now and you know. and I know that your sons are coming up in this. In this age as well, they are mentioned Mark Tapatio in that show as he referred to digital natives. They are digital natives and yeah, that comes with some pretty interesting stuff. So I'm just glad we were able to record that show as he gets ready for his first sequel Saturday presentation here on that topic. So and that's all assuming that we were able to overcome the technical glitch. We we learned something, Frank, I'd learn something. Yeah, it's not a glitch. If you learn something. So if if for some reason. The you know what hit the fan then that episode will be recorded at a future date, so we'll see it will, but we've got. We've got a great topic today. You and I've been bad this around I want. I know it's been several weeks. It may have been a couple of months. We've been talking about doing this. Right absolutely, and part of what motivates this? An based on the release schedule that I anticipate this will have already happened. I'm changing jobs at Microsoft Woo. At your new job. I will be the data and the AI technology architect at the Reston MTC or Microsoft Technology Center, so congratulations. Thank you very much. It's an honor to join such a prestigious team. If you're not familiar with what the MTC is. MTC is a Microsoft Technology Center. There is about 80 of them around the world, and they basically are meant to provide specific experiences. Ends well as architecture design guidance for customers around the world and it's an honor to be kind of in that team. It's very rarely does an opening happen in an empty, so when one opened up in my neck of the Woods is like I have to take it. I have to at least try. Right right? So Fortunately I am super excited. And Uhm, 'cause That's what we say at Microsoft were super excited and it's a great team. Great stuff that they do. They do a lot of work with the community. They do a lot of work with customers. It's just an awesome gig. I'm really looking forward to it and. Yeah, I'm really excited about it. Congratulations brother. That's a great thing and I think you're perfect for that job. I know, I know, someone else in that job at an MTC in the northeast. And it's it's kind of a rare breed of person that has to walk into that role because. It optimally you have a smattering of exposure to all whole slew of enterprise architecture, an both both you and this other individual that I know fit that mold. You've got programming experience, software development experience, and you also have data experience, and it's just rare to be good at both of those things I know, but I know you're good at it, and I know my other friend is good at this as well, so I just I just think it's going to be a great fit for you, Frank. I'm I'm excited, you got it. Thank you. Thank you very much. So with that, one of the things that I've been ramping up on in anticipation for this job or whatever opportunity I was going to go to next. I was learning more about the quote Unquote traditional side of the data world, which let me move kind of explain my little worldview, which is twisted and as weird as it may be, it might actually be right. I see this alot in my current current or old roll current as of April 16th. Role is that we have data in the I cloud solution architects, but there's a very clear line of demarcation between the data scientist. Part of the data in the icy essays and the sequel veterans side of things. So I actually had a call this morning where it was. It was very, very much laid bare 'cause we were talking about that and that there's essentially kind of two types of data in AI folks at Microsoft for sure, probably everywhere else, to you have the RDBMS folks. These folks have been doing sequel since it was aside based joint venture, right, right? That's their world. Ann, you have kind of the big data open source kind of tooling world, right? The folks that are more comfortable in spark or Hadoop or with the crazy statistics and math around machine learning and AI, right? You kind of have those two. Rarely do the two. Rarely do you have a person who's. Comfort, Rible and happy in both. I am aiming to be happy and comfortable in both. Obviously I'm more in the data science kind of world. And part of my part of what I see is the opportunity in this new role is to grow into the kind of the sequel. RDBMS traditional database world. That makes sense. They are no. It makes perfect sense. and I mean coming at coming at this from, you know, we as we shared in each show the past few days that we've recorded. We've known each other for like 15 years. And most of that time you were a professional software developer. You are a Microsoft MVP in. I forget which discipline it was. Frank, I know it was software development related. I think the world has forgotten that this discipline never existed. tablet PC. Tablet PC right? OK and you did an awful lot in there and I know there's a lot of people out there working in what that evolved into mobile. That benefited from the blog post you shared, solutions. You shared an all of that, but yeah, that whole mobile thing turned out not to be such a, you know, it was a trend it and it evolved. To what it is now, and having that experience, I think you're going to...