Creative Testing Campaigns May Be The Biggest Cost Center In Your Business episode artwork

EPISODE · Feb 20, 2024 · 35 MIN

Creative Testing Campaigns May Be The Biggest Cost Center In Your Business

from The Andrew Faris Podcast · host Andrew Faris

"Test creative until you have statistically significant results, then scale the winners based on that." That seems like good advice on first glance. How can you disagree with methodical testing that's attentive to good statistical principles? Because it's almost impossible to actually do without burning huge amounts of money on Meta, for one, and for two, it's unnecessary anyway, since Meta's machine learning can use better methods of forecasting your creative's performance than frequentist-style stat sig tests. Yes, this one is getting into the weeds. Hopefully it helps clarify more of why you absolutely positively should not run auto-bid creative testing campaigns on Meta. EPISODE HIGHLIGHTS [00:00:55] Creative testing strategies for meta ads. [00:05:10] Frustrations with new creative. [00:07:16] Creative testing campaigns on Meta. [00:11:15] Auto bidding creative tests. [00:14:25] Statistical significance in ad testing. [00:17:48] Ad Performance Analysis. [00:19:56] The pitfalls of ad testing. [00:24:41] Creative performance and optimization. [00:27:17] Meta's machine learning forecasting. [00:30:51] Creative testing in advertising. [00:33:19] Prediction at scale EPISODE SPONSOR Virtual assistants can be helpful. Virtual professionals can transform your business. Get connected to incredible ecommerce talent from the Philippines with More Staffing by visiting ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.morenow.co⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠. REFERENCED IN THIS EPISODE "My Exact Creative Testing Method For Meta Ads" (Spotify, Apple) My Twitter Conversation With Zach Stuck On This Topic: https://bit.ly/42JsbZ0 FOLLOW UP WITH ANDREW Follow Andrew on Twitter: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠@andrewjfaris⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ Email Andrew: [email protected] Work with Andrew: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.ajfgrowth.com⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ EPISODE MUSIC Music Intro: "⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Tell Me Mama⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠" by The Devious Means Music Outro: "⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Rusty Little Scissors⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠" by The Devious Means

"Test creative until you have statistically significant results, then scale the winners based on that." That seems like good advice on first glance. How can you disagree with methodical testing that's attentive to good statistical principles? Because it's almost impossible to actually do without burning huge amounts of money on Meta, for one, and for two, it's unnecessary anyway, since Meta's machine learning can use better methods of forecasting your creative's performance than frequentist-style stat sig tests. Yes, this one is getting into the weeds. Hopefully it helps clarify more of why you absolutely positively should not run auto-bid creative testing campaigns on Meta. EPISODE HIGHLIGHTS [00:00:55] Creative testing strategies for meta ads. [00:05:10] Frustrations with new creative. [00:07:16] Creative testing campaigns on Meta. [00:11:15] Auto bidding creative tests. [00:14:25] Statistical significance in ad testing. [00:17:48] Ad Performance Analysis. [00:19:56] The pitfalls of ad testing. [00:24:41] Creative performance and optimization. [00:27:17] Meta's machine learning forecasting. [00:30:51] Creative testing in advertising. [00:33:19] Prediction at scale EPISODE SPONSOR Virtual assistants can be helpful. Virtual professionals can transform your business. Get connected to incredible ecommerce talent from the Philippines with More Staffing by visiting ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.morenow.co⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠. REFERENCED IN THIS EPISODE "My Exact Creative Testing Method For Meta Ads" (Spotify, Apple) My Twitter Conversation With Zach Stuck On This Topic: https://bit.ly/42JsbZ0 FOLLOW UP WITH ANDREW Follow Andrew on Twitter: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠@andrewjfaris⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ Email Andrew: [email protected] Work with Andrew: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.ajfgrowth.com⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ EPISODE MUSIC Music Intro: "⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Tell Me Mama⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠" by The Devious Means Music Outro: "⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Rusty Little Scissors⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠" by The Devious Means

NOW PLAYING

Creative Testing Campaigns May Be The Biggest Cost Center In Your Business

0:00 35:18

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Frequently Asked Questions

How long is this episode of The Andrew Faris Podcast?

This episode is 35 minutes long.

When was this The Andrew Faris Podcast episode published?

This episode was published on February 20, 2024.

What is this episode about?

"Test creative until you have statistically significant results, then scale the winners based on that." That seems like good advice on first glance. How can you disagree with methodical testing that's attentive to good statistical...

Can I download this The Andrew Faris Podcast episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!