Why Automated Validations Fail
Episode 9 of the Talking Tuesdays with Fancy Quant podcast, hosted by Dimitri, titled "Why Automated Validations Fail" was published on July 5, 2022 and runs 21 minutes.
July 5, 2022 ·21m · Talking Tuesdays with Fancy Quant
Summary
Send us Fan Mail Why does automating model validations fail? Goals/Plan: 1) Specify the model 2) Runs the development model for a replication check 3) Output of all possible analysis for that model type is produced including challenger models Reasons it Failed: 1) Data and their processes vary from department to department and change across time without warning. 2) Too much output is generated that needs to be manually reviewed. 3) When issues are found, manual output is still required. 4) ...
Episode Description
Why does automating model validations fail?
Goals/Plan:
1) Specify the model
2) Runs the development model for a replication check
3) Output of all possible analysis for that model type is produced including challenger models
Reasons it Failed:
1) Data and their processes vary from department to department and change across time without warning.
2) Too much output is generated that needs to be manually reviewed.
3) When issues are found, manual output is still required.
4) Anyone proficient in programming can conduct a full validation faster than the automated system.
5) Manually built models by true experts are still beating automated challenger models or development built models.
Video version:
https://youtu.be/H6kQ7e8whhE
Website:
https://www.FancyQuantNation.com
Quant t-shirts, mugs, and hoodies:
https://www.teespring.com/stores/fancy-quant
Connect with me:
https://www.linkedin.com/in/dimitri-bianco
https://twitter.com/DimitriBianco
Similar Episodes
Dec 9, 2017 ·41m
Dec 6, 2017 ·86m