0217 - Data Engineering with Julian Wiffen

EPISODE · Mar 12, 2024 · 43 MIN

0217 - Data Engineering with Julian Wiffen

from Design Talk (dot IE)

I am delighted to have Julian Wiffen to talk about some of the latest breakthroughs in generative AI and their application to data engineering.Julian is Director of Data Science for the Product team at Matillion.·       To start, Julian could you share a little about your background in Data Science and introduce us to Matillion and its mission?·       How does an independent services solutions company leverage while adding value to the models generated by the large LLM developers?·       Can you share your some of the learning and discoveries you’ve made by researching and applying Gen AI to data engineering? ·       Can you share your thoughts on its impact on the way data science is done? [·       What do you consider to be the entry-level skillset? ·       How do you approach teaching and learning skills in the area and what tips would you give a university educator?·       On the topic of regulation and ethics for data scientists working with Gen AI. There is talk of mandating the 'human in the loop' approach for safety, that may even become regulation. How you see ‘human in the loop’ working?·       Who are the key data science authors and media you refer to? [books, blogs, pods] ·       Is there anything you’d like add?Notes:Julian’s blogs at Matillion·       Matillion: The Data Engineer’s Guide to Prompt Engineering part 1 (link)·       Matillion: The Data Engineer’s Guide to Prompt Engineering part 2 (link)·       Matillion: The Data Engineer’s Guide to Prompt Engineering part 3 (link)·       Matillion: Evaluating the performance of different LLMs (link) Recommended to follow Andrew Ng, researcher-entrepreneur (homepage)AcknowledgementsMusic Title: The WorldArtist: Ben Prunty (2012)Source:  https://www.benpruntymusic.com/License: Non-transferable license. Permission granted by Ben PruntyCover Art Title: Complex collaboration for BAEFArtist: Nuno Machado and Allen HigginsSource: vignette_version.pptxLicense: CC BY-NC-SA 4.0Podcast LicenseDesign Talk (dot IE) CC BY-NC-SA 4.0 The license can be viewed at https://creativecommons.org/licenses/by-nc-sa/4.0By taking part you give permission for your voice to be recorded, for the recording to be edited, and for it to be posted and published as a podcast. Hosted on Acast. See acast.com/privacy for more information.

NOW PLAYING

0217 - Data Engineering with Julian Wiffen

0:00 43:04

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

No similar episodes found.

Managing Next Generation Energy Systems Cambridge University Background Stakeholders working with energy systems have to make complex decisions formulated from risk-based assessments about the future. The move towards more renewables in our energy systems complicates matters even further, requiring the development of an integrated power grid and continuous and steady transformation of the UK power system. Network flows must be managed reliably under uncertain demands, uncertain supply, emerging network technologies and possible failures and, further, prices in related markets can be highly volatile. Mathematicians working with engineers and economists, can make significant contributions to address such issues, by helping to develop fit-for-purpose models for next generation energy systems. These interdisciplinary approaches are looking to address a range of associated problems, including modelling, prediction, simulation, control, market and mechanism design and optimisation. This knowledge exchange workshop was part of the four months Res Sunday Morning Linux Review - MP3 Feed Tony Bemus, Mary Tomich, Phil Porada, and Tom Lawrence Sunday Morning Linux Review www.smlr.us is a podcast with Tony Bemus, Mary Tee , Phil Porada, and Tom Lawrence. We talk about the Linux and Open Source News. Edited episodes and show notes are found at www.smlr.us , We will be Live on IRC #SMLR and Video: youtube.com/c/SmlrUs Teen Taal Aaj Tak Radio Teen Taal is a witty, comedy oriented Hindi podcast where three musketeers Kamlesh Kishore Singh, Panini Anand and Kuldeep Mishra talk about various issues with a pinch of humour and fun. The topic of conversation varies from politics, Indian society, jokes, Viral stuff on social media, food, movies and many more. Catch your share of fun every Saturday.इस पॉडकास्ट के नायक और खलनायक हैं,तीन तिलंगे- कमलेश किशोर सिंह, पाणिनि आनंद और कुलदीप मिश्र. ये तीनों लोग हफ़्ते की घटनाओं पर अतरंगी अंदाज़ में बातें करते हैं, ठहाकों के साथ और अपने अपने biases के साथ. ये पॉडकास्ट सबके लिए नहीं है. जो घर फूंके आपना, सो चले हमारे साथ. यानी वही लोग सुनें जिनका आहत होने का पैरामीटर ज़रा ऊंचा हो. हर शनिवार, आज तक रेडियो पर. जय हो. Integrating Nutrition, Psychology and Neuroscience to Measure Infant Development in the UK & Gambia Talk by Dr Sarah Lloyd Fox, Birkbeck College, on infant brain imaging in The Gambia
URL copied to clipboard!