Skip to content
Synthetic Data Generation Using Mimesis with Nikita Sobolev episode artwork

Apr 1, 2018 32 min

Synthetic Data Generation Using Mimesis with Nikita Sobolev

from The Python Podcast.__init__ Hosted by Tobias Macey

Summary Most applications require data to operate on in order to function, but sometimes that data is hard to come by, so why not just make it up? Mimesis is a library for randomly generating data of different types, such as names, addresses, and credit card numbers, so that you can use it for testing, anonymizing real data, or for placeholders. This week Nikita Sobolev discusses how the project got started, the challenges that it has posed, and how you can use it in your applications. Preface Hello and welcome to Podcast.__init__, the podcast about Python and the people who make it great. When you’re ready to launch your next app you’ll need somewhere to deploy it, so check out Linode. With private networking, shared block storage, node balancers, and a 40Gbit network, all controlled by a brand new API you’ve got everything you need to scale up. Go to podcastinit.com/linode to get a $20 credit and launch a new server in under a minute. To get worry-free releases download GoCD, the open source continous delivery server built by Thoughworks. You can use their pipeline modeling and value stream map to build, control and monitor every step from commit to deployment in one place. Go to podcastinit.com/gocd to learn more about their professional support services and enterprise add-ons. Visit the site to subscribe to the show, sign up for the newsletter, and read the show notes. And if you have any questions, comments, or suggestions I would love to hear them. You can reach me on Twitter at @Podcast__init__ or email [email protected]) Your host as usual is Tobias Macey and today I’m interviewing Nikita Sobolev about Mimesis, a library for quickly generating synthetic data Interview Introductions How did you get introduced to Python? What is mimesis and how does it compare to other projects such as faker and factory_boy? What was the motivation for creating it? One of the features that is advertised is the speed of Mimesis. What techniques are used to ensure that the data is generated quickly? What are the built in mechanisms for generating data? What options do users have for customizing the types of data that can get generated? What are some of the most complicated providers to write and maintain? What are some of the use cases outside of unit or integration tests where Mimesis could be beneficial? How would you use Mimesis to anonymize data from a production environment to be used for testing? What are the most challenging aspects of maintaining the Mimesis project? What are some of the plans that you have for the future of Mimesis? Keep In Touch sobolevn on GitHub @sobolevn on Twitter Email Picks Tobias Coco Nikita I Am A Mediocre Developer Links Mimesis Django Faker Factory Boy Internationalization (I18N) Unicode Enum Pipfile GeoJSON Mimesis Cloud Sanic GraphQL Impostor Syndrome Imposter Syndrome Disclaimer: Add this to all of your projects! Jacob Kaplan-Moss PyCon Keynote The intro and outro music is from Requiem for a Fish The Freak Fandango Orchestra / CC BY-SA

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Synthetic Data Generation Using Mimesis with Nikita Sobolev

0:00 32:37

Chapters

  1. 0:12 Introduction and Sponsor Messages
  2. 1:00 Interview with Nikita Sobolev
  3. 1:57 Nikita's Introduction to Python
  4. 3:02 Teaching Python and Meeting Isaac
  5. 3:52 Motivation for Creating Mimesis
  6. 4:33 Comparison with Other Libraries
  7. 6:25 Providers and Language Support
  8. 9:12 Speed and Performance Techniques
  9. 11:40 No External Dependencies
  10. 13:30 Customizing Data Generation
  11. 17:11 Use Cases Beyond Unit Testing
  12. 19:51 Schema Support and Anonymizing Data
  13. 23:00 Challenges in Building the Library
  14. 24:02 Future Plans for Mimesis
  15. 26:34 Maintaining External Libraries and Plugins
  16. 28:02 Community Contributions
  17. 29:06 Contact Information and Picks

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of The Python Podcast.__init__?

This episode is 32 minutes long.

When was this The Python Podcast.__init__ episode published?

This episode was published on April 1, 2018.

Is there a transcript available for this episode?

Yes, a full transcript is available for this episode. You can read the complete transcript on the episode page.

Can I download this The Python Podcast.__init__ episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.