<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Collected Thoughts]]></title><description><![CDATA[Collected Thoughts is a no-nonsense newsletter about using AI to solve real-world challenges—no hype, no fluff, just practical advice.]]></description><link>https://thoughts.collected.fyi</link><image><url>https://substackcdn.com/image/fetch/$s_!cOgr!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff81a6055-af90-4820-b0ea-55d6d87da30a_1162x1162.png</url><title>Collected Thoughts</title><link>https://thoughts.collected.fyi</link></image><generator>Substack</generator><lastBuildDate>Mon, 20 Apr 2026 10:38:39 GMT</lastBuildDate><atom:link href="https://thoughts.collected.fyi/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Collected Company]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[collectedthoughts@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[collectedthoughts@substack.com]]></itunes:email><itunes:name><![CDATA[Teo Soares]]></itunes:name></itunes:owner><itunes:author><![CDATA[Teo Soares]]></itunes:author><googleplay:owner><![CDATA[collectedthoughts@substack.com]]></googleplay:owner><googleplay:email><![CDATA[collectedthoughts@substack.com]]></googleplay:email><googleplay:author><![CDATA[Teo Soares]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[A Doer’s Guide to AI Policy]]></title><description><![CDATA[To write an AI policy that works, start with the work.]]></description><link>https://thoughts.collected.fyi/p/a-doers-guide-to-ai-policy</link><guid isPermaLink="false">https://thoughts.collected.fyi/p/a-doers-guide-to-ai-policy</guid><dc:creator><![CDATA[Teo Soares]]></dc:creator><pubDate>Wed, 14 May 2025 15:54:14 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!gQSY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Last week, we gave a talk at the inaugural <a href="https://www.hackshackers.com/join-us-for-the-hacks-hackers-ai-x-journalism-summit-2025-may-7-8/">Hacks/Hackers AI Summit</a>, a 250-person gathering of professionals at the intersection of media, technology, and AI.</p><p>Across several conversations, one theme was clear: <strong>How do you move forward with AI without putting your organization at risk?</strong></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!gQSY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!gQSY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg 424w, https://substackcdn.com/image/fetch/$s_!gQSY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg 848w, https://substackcdn.com/image/fetch/$s_!gQSY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!gQSY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!gQSY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg" width="1456" height="1034" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1034,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1528888,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://thoughts.collected.fyi/i/163561471?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!gQSY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg 424w, https://substackcdn.com/image/fetch/$s_!gQSY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg 848w, https://substackcdn.com/image/fetch/$s_!gQSY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!gQSY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1353c06f-3051-469c-a876-0938c181b488_2814x1998.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">A guardrail. Get it?</figcaption></figure></div><p>Some teams are on pause. Others are deep in circular debates. Most are stuck asking the same questions: What&#8217;s allowed? What&#8217;s risky? Who decides? Efforts stall out&#8212;not because people don&#8217;t care, but because no one is quite sure where the lines are, or who gets to draw them.</p><ul><li><p><strong>If you&#8217;re in leadership, your caution is valid.</strong> Bad AI use can leak data, erode trust, or create real liabilities.</p></li><li><p><strong>If you&#8217;re doing the work, so is your frustration. </strong>You see opportunities every day, but without guidance, you&#8217;re either stuck or improvising without air cover.</p></li></ul><p><strong>The core problem is that most AI policies aren&#8217;t built on real concerns or real use cases.</strong> A good policy isn&#8217;t just a list of rules. It&#8217;s a map that makes clear what your organization wants to avoid, and what it&#8217;s ready to enable.</p><p>This piece is a framework for creating that map.</p><div><hr></div><h3><strong>The operational case for an AI policy</strong></h3><p>An AI policy isn&#8217;t just a safeguard. It&#8217;s an operational tool that dictates whether innovation moves forward or stalls out.</p><ul><li><p><strong>For leadership, a policy sets boundaries before something goes wrong.</strong> It protects the company&#8217;s data, IP, and reputation.</p></li><li><p><strong>For mid-level managers and operators, the policy is about permission. </strong>It answers the question: What are we allowed to try? Without clear guidance, people hesitate or, worse, build in the dark.</p></li></ul><p>Done well, a policy <em>enables</em> innovation. It removes the invisible tripwires that stop people from exploring what&#8217;s possible.</p><p>The shared truth across the org chart is that everyone wants to do the right thing. A clear policy gives people a place to stand and the confidence to move.</p><div><hr></div><h3><strong>Specificity is key to a workable policy</strong></h3><p>Most AI policy efforts get stuck in a weeks-long game of ping-pong between legal, IT, procurement, and anyone brave enough to propose a use case.</p><p>To avoid it, start with outcomes.</p><ul><li><p><strong>If you&#8217;re in leadership, your job is to define the non-negotiables</strong>. What are the scenarios you absolutely want to prevent? Data leakage? Public-facing hallucinations? Automation with no human oversight? These are the anchors for any effective policy.</p></li><li><p><strong>If you&#8217;re managing a team, make the value legible in terms of outcomes.</strong> Don&#8217;t just say, <em>&#8220;We want to use AI for content.&#8221;</em> Say: <em>&#8220;We&#8217;re trying to draft 80% of internal help articles automatically so support leads can focus on edge cases, and we&#8217;ll exclude any ticket involving account credentials or billing.&#8221;</em> That&#8217;s clear, bounded, and defensible.</p></li></ul><p>Focusing on outcomes does two things:</p><ol><li><p>It keeps the policy grounded in reality.</p></li><li><p>It gives everyone, from lawyers to line managers, something real to evaluate.</p></li></ol><p>Policies should be built around what actually matters: the consequences you want to avoid, and the value you want to unlock. The <em>&#8220;how&#8221;</em> can follow.</p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://thoughts.collected.fyi/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">To get more of our latest thinking, subscribe for free.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><h3><strong>Match the decision to the level of context</strong></h3><p>Not every part of an AI policy should be decided at the top. In fact, when too many decisions get centralized, the result is overcaution, underuse, and a document that&#8217;s impossible to apply in practice.</p><ul><li><p><strong>If you&#8217;re in leadership, your job is to draw the bright lines:</strong> no unreviewed model output in customer-facing channels, no automation in areas with regulatory or contractual risk, and no tools where data flows can&#8217;t be clearly audited. These aren&#8217;t feature-level decisions. They&#8217;re existential guardrails that protect the business.</p></li><li><p><strong>If you&#8217;re managing a team, your job is to apply those guardrails to the real context of your work. </strong>What kind of exposure would actually matter in your domain? Is it customer contact details? Strategic product planning? Internal conversations about deals in motion? What needs human review not just in theory, but in practice?</p></li></ul><p>Policies only work when they reflect how work actually happens. That means pushing implementation details down to the people who live in the specifics. They know the tradeoffs and the opportunities.</p><p>The further a policy is from the work, the more likely it is to say <em>&#8220;No&#8221;</em> to everything. Put decisions closer to the action, and <em>&#8220;Yes, as long as&#8230;&#8221;</em> becomes possible.</p><div><hr></div><h3><strong>Pilots are the path to progress</strong></h3><p>Almost every organization has someone waiting on someone else. Legal is waiting on product. Product is waiting on leadership. Teams are waiting on &#8220;the policy.&#8221; Meanwhile, nothing moves.</p><p>Pilots are how you break that loop. You don&#8217;t need a finished policy to get started. You need a way to learn safely and visibly.</p><ul><li><p><strong>If you&#8217;re in leadership, don&#8217;t wait for a perfect policy.</strong> Create a lightweight path for teams to propose and run AI pilots. Set the high-trust boundaries: what must be protected, what lines shouldn&#8217;t be crossed. Then invite teams to fill in the specifics. You can revise as you go. The important part is sending a clear signal: we&#8217;re willing to move.</p></li><li><p><strong>If you&#8217;re managing a team, don&#8217;t wait for permission. </strong>Propose something small, specific, and safe. For example: &#8220;<em>We want to use LLMs to generate first drafts of product copy. Anything referencing pricing, performance claims, or legal disclaimers will be written or reviewed by a human before publication.&#8221;</em> That kind of framing builds trust. It shows you&#8217;re being deliberate, and it gives leadership something concrete to react to.</p></li></ul><p>Pilots turn intent into insight. They transform theoretical risk debates into real-world feedback and give your organization a safe, visible way to learn its way into better policy.</p><div><hr></div><p>Every organization navigating AI is balancing two instincts: <em>protect</em> and <em>progress</em>. A good policy does both.</p><ul><li><p><strong>If you&#8217;re in leadership, your teams need guardrails, but they also need green lights.</strong> Set the boundaries that matter most, and then invite people to move within them. Trust doesn&#8217;t mean hands-off. It means being clear about what matters and letting others help figure out the <em>&#8220;how.&#8221;</em></p></li><li><p><strong>If you&#8217;re managing a team, don&#8217;t wait for top-down clarity. </strong>Start small. Define a use case, flag the risks, propose the boundaries. Show that it&#8217;s possible to move responsibly. That&#8217;s what policy needs more than anything right now: examples.</p></li></ul><p>AI policy shouldn&#8217;t be a tug-of-war between caution and ambition. It should be a shared conversation about what your organization actually values, and how it plans to act accordingly.</p><p>Policy follows progress. Start making both.</p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://thoughts.collected.fyi/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading Collected Thoughts. To get more of our latest thinking, subscribe for free.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[In Praise of Faster Horses]]></title><description><![CDATA[Give the people what they want.]]></description><link>https://thoughts.collected.fyi/p/in-praise-of-faster-horses</link><guid isPermaLink="false">https://thoughts.collected.fyi/p/in-praise-of-faster-horses</guid><dc:creator><![CDATA[Teo Soares]]></dc:creator><pubDate>Thu, 13 Feb 2025 18:55:47 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/0c45bc31-84e9-45b6-bbf7-0287645db071_5878x3908.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>We wouldn&#8217;t be serious about AI if we didn&#8217;t jump on the DeepSeek bandwagon.</p><p>It&#8217;s remarkable how it shook up the AI world. Not because it was the smartest model. Not because it was breaking records on academic leaderboards.</p><p>Because it was cheaper.</p><p>The DeepSeek moment signals a shift in AI. For years, the industry operated under a maximalist philosophy. Starting with GPT-1, each successive generation was orders of magnitude bigger (and more expensive) than the last. The logic became self-reinforcing: a model was considered better because it was bigger, and it had to be bigger because that&#8217;s what made it better.</p><p>To prove this was true, we relied on tests&#8212;esoteric benchmarks understood only by AI researchers, along with more familiar but equally dubious measures, like the SAT and the bar exam, which <a href="https://cdn.openai.com/papers/gpt-4.pdf#page=6">GPT-4 passed</a> (<a href="https://www.livescience.com/technology/artificial-intelligence/gpt-4-didnt-ace-the-bar-exam-after-all-mit-research-suggests-it-barely-passed">or did it?</a>).</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!8BL2!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F705897a9-6311-4280-8e7a-7376b45c4513_1562x910.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!8BL2!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F705897a9-6311-4280-8e7a-7376b45c4513_1562x910.png 424w, https://substackcdn.com/image/fetch/$s_!8BL2!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F705897a9-6311-4280-8e7a-7376b45c4513_1562x910.png 848w, https://substackcdn.com/image/fetch/$s_!8BL2!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F705897a9-6311-4280-8e7a-7376b45c4513_1562x910.png 1272w, https://substackcdn.com/image/fetch/$s_!8BL2!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F705897a9-6311-4280-8e7a-7376b45c4513_1562x910.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!8BL2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F705897a9-6311-4280-8e7a-7376b45c4513_1562x910.png" width="558" height="324.989010989011" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/705897a9-6311-4280-8e7a-7376b45c4513_1562x910.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:848,&quot;width&quot;:1456,&quot;resizeWidth&quot;:558,&quot;bytes&quot;:213371,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!8BL2!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F705897a9-6311-4280-8e7a-7376b45c4513_1562x910.png 424w, https://substackcdn.com/image/fetch/$s_!8BL2!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F705897a9-6311-4280-8e7a-7376b45c4513_1562x910.png 848w, https://substackcdn.com/image/fetch/$s_!8BL2!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F705897a9-6311-4280-8e7a-7376b45c4513_1562x910.png 1272w, https://substackcdn.com/image/fetch/$s_!8BL2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F705897a9-6311-4280-8e7a-7376b45c4513_1562x910.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Up and to the right!</figcaption></figure></div><p>But did any of this make AI meaningfully better for users? Arguably not. That&#8217;s not to say AI hasn&#8217;t improved since OpenAI launched ChatGPT in 2022&#8212;it has. But the real progress didn&#8217;t come from pushing intelligence to its theoretical limits through ever-bigger models. It came from making AI faster, cheaper, and more accessible.</p><h2><em>If I&#8217;d asked people what they wanted&#8230;</em></h2><p><em>&#8230;they&#8217;d have said a faster horse</em>, said Henry Ford <a href="https://hbr.org/2011/08/henry-ford-never-said-the-fast">(or did he?)</a>.</p><p>Depending on who you ask, that maxim is either an indictment of market research&#8212;a call for visionary inventors to ignore what consumers say to build what they need&#8212;or the opposite: a lesson in deep empathy, showing that true innovation comes from understanding the intent behind what people ask for, not just taking their words at face value.</p><p>Both interpretations, though, agree on one thing: faster horses are bad.</p><p>But what if they aren&#8217;t? What if the real breakthroughs&#8212;the ones that reshape industries and change how people live&#8212;come not from chasing the grandest vision, but from making things cheaper, easier, and well, faster?</p><p>Which AI development do you think made the bigger impact in users&#8217; lives&#8212;passing the bar exam or any of the following?</p><ul><li><p><strong>Longer context windows</strong> that improve memory in conversations.</p></li><li><p><strong>Lower inference costs</strong> that make AI commercially viable.</p></li><li><p><strong>Lower latency</strong> that makes responses feel instant.</p></li><li><p><strong>Higher reliability</strong> that makes models more dependable in production.</p></li><li><p><strong>Seamless integration</strong> into existing tools.</p></li></ul><p>This isn&#8217;t a dismissal of fundamental AI research&#8212;pushing the boundaries of what&#8217;s possible will always matter. And benchmarks aren&#8217;t without use&#8212;after all, the remarkable thing about DeepSeek is that it was cheap <em>and </em>performed just as well as proprietary models in industry benchmarks.</p><p>But when it comes to real-world impact, progress isn&#8217;t measured by leaderboard rankings or viral demos. It&#8217;s measured by whether AI makes people&#8217;s lives easier in tangible ways. A model that can pass the bar exam doesn&#8217;t change much for us. A cheaper model does.</p><p>At <strong>Collected Company</strong>, we call this <strong>Market-Aligned Product Development (MAP-D)</strong>&#8212;the idea that AI should be built not just for intelligence or hype, but for impact. That means two things:</p><ul><li><p><strong>Deep Technical Understanding</strong> &#8211; Knowing how AI works at a fundamental level to understand what it can do and what it can&#8217;t.</p></li><li><p><strong>Deep Business Understanding</strong> &#8211; Identifying where AI can <em>actually</em> move the needle for companies.</p></li></ul><div class="pullquote"><p>The biggest leaps don&#8217;t come from making something theoretically better; they come from making it practically useful.</p></div><p>This isn&#8217;t just a theory&#8212;it&#8217;s a pattern we&#8217;ve seen play out before. And history offers a clear example of what happens when companies mistake technical superiority for real-world impact.</p><h2>&#8220;Better&#8221; is an empty ideal. &#8220;Faster&#8221; is what the people want.</h2><p>A great example of a leader in market-aligned product development was Ford&#8217;s competitor, Alfred Sloan, who headed up GM in the 1920s.</p><p>As <a href="https://hbr.org/2011/08/henry-ford-never-said-the-fast">this HBR blog post</a> points out, GM ate half of Ford&#8217;s market share over the course of just 5 years. How? By selling cars &#8220;for every purse and purpose.&#8221; In other words: products that fit people&#8217;s actual needs.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!IGS8!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7bd6c9e8-58c9-4382-b974-6c36e85d4137_840x1200.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!IGS8!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7bd6c9e8-58c9-4382-b974-6c36e85d4137_840x1200.jpeg 424w, https://substackcdn.com/image/fetch/$s_!IGS8!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7bd6c9e8-58c9-4382-b974-6c36e85d4137_840x1200.jpeg 848w, https://substackcdn.com/image/fetch/$s_!IGS8!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7bd6c9e8-58c9-4382-b974-6c36e85d4137_840x1200.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!IGS8!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7bd6c9e8-58c9-4382-b974-6c36e85d4137_840x1200.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!IGS8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7bd6c9e8-58c9-4382-b974-6c36e85d4137_840x1200.jpeg" width="262" height="374.2857142857143" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7bd6c9e8-58c9-4382-b974-6c36e85d4137_840x1200.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1200,&quot;width&quot;:840,&quot;resizeWidth&quot;:262,&quot;bytes&quot;:193845,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!IGS8!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7bd6c9e8-58c9-4382-b974-6c36e85d4137_840x1200.jpeg 424w, https://substackcdn.com/image/fetch/$s_!IGS8!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7bd6c9e8-58c9-4382-b974-6c36e85d4137_840x1200.jpeg 848w, https://substackcdn.com/image/fetch/$s_!IGS8!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7bd6c9e8-58c9-4382-b974-6c36e85d4137_840x1200.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!IGS8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7bd6c9e8-58c9-4382-b974-6c36e85d4137_840x1200.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">&#8220;A car for every purse and purpose,&#8221; courtesy of, ironically, the <a href="https://www.thehenryford.org/collections-and-research/digital-collections/artifact/192114/#:~:text=Summary,%2Dfits%2Dall%20Model%20T.">Henry Ford Museum</a>.</figcaption></figure></div><p>Ford had the better car. The Model T was a marvel of engineering&#8212;efficient to produce, technically advanced, and built to last. But better is slippery. GM, on the other hand, made cars that were more practical, more customizable, and more accessible to different kinds of buyers. That&#8217;s what actually mattered.</p><p>The AI industry has the same problem. It chases better&#8212;models that score higher on benchmarks, pack in more parameters, and showcase flashier capabilities. But better is an abstraction, defined and redefined by whatever metric happens to be in vogue.</p><p>Faster, though? Faster is real. Faster is felt. It&#8217;s the difference between an AI tool that seamlessly integrates into a workflow and one that slows it down. Between something people rely on and something they abandon.</p><p>The biggest impact in AI won&#8217;t come from pushing intelligence to its theoretical limits. It&#8217;ll come from making AI work the way people actually need it to. And most of the time, that means not just making it better, but making it faster, cheaper, and easier to use.</p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://thoughts.collected.fyi/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading Collected Thoughts! Subscribe for free to receive new posts.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[AI in 2025]]></title><description><![CDATA[The bubble is about to burst (and that&#8217;s a good thing)]]></description><link>https://thoughts.collected.fyi/p/ai-in-2025</link><guid isPermaLink="false">https://thoughts.collected.fyi/p/ai-in-2025</guid><dc:creator><![CDATA[Teo Soares]]></dc:creator><pubDate>Thu, 23 Jan 2025 17:25:04 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/9c0151e8-4acd-43dd-b23e-8dd2d2653792_3311x4966.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>For an essay predicting the state of AI in 2025, we&#8217;re late.</p><p>Over the last two months, predictions about AI have flooded the internet. Most posts echo three themes:</p><ul><li><p><strong>Agentic systems:</strong> AI that doesn&#8217;t just advise or recommend&#8212;it takes action on the user&#8217;s behalf.</p></li><li><p><strong>Multi-agent systems:</strong> Picture a &#8220;creative director&#8221; agent and a &#8220;copywriter&#8221; agent collaborating to refine marketing copy.</p></li><li><p><strong>On-device models: </strong>Systems that can accomplish tasks based on your data without compromising privacy.</p></li></ul><p>These trends will likely prove correct if only because they have momentum: they&#8217;re tied to large investments from VCs, tech giants, and advisory firms. It&#8217;s no coincidence you see them in 2025 predictions from <a href="https://blog.google/products/google-cloud/ai-trends-business-2025/">Google</a>, <a href="https://www.snowflake.com/en/blog/ai-data-predictions-2025/">Snow Flake</a>, <a href="https://www.deloitte.com/global/en/about/press-room/deloitte-globals-2025-predictions-report.html">Deloitte</a>, <a href="https://www.pwc.com/us/en/tech-effect/ai-analytics/ai-predictions.html">PwC</a>, and <a href="https://www.salesforce.com/news/stories/future-of-ai-agents-2025/">Salesforce</a>.</p><p>Our chief prediction, though, is something you won&#8217;t find on those lists:</p><p><strong>The AI bubble is about to burst. And that&#8217;s a good thing.</strong></p><div><hr></div><p>It might seem odd for two people who started an AI firm to call their sector a bubble&#8212;even more so to welcome a burst.</p><p>But the reality is that most AI applications so far have been underwhelming. The hype has forced AI into awkward places&#8212;tacked onto existing products or bought in enterprise packages that nobody knows how to use. These are decisions made out of fear of missing out, not real need.</p><p>Once the froth subsides, people can focus on the actual problems these tools solve. And make no mistake, those problems exist. Zero interest rates are gone, and everywhere, teams are being asked to do more with less.</p><p>AI can help, but only if it&#8217;s used thoughtfully.</p><p>We believe that using AI effectively starts with <a href="https://thoughts.collected.fyi/p/practical-magic">identifying workflows that can be improved with models</a>. That&#8217;s how you free up teams to do the creative work that drives growth.</p><p>Here are four such workflows&#8212;ones we at Collected Company have seen teams tackle with real success.</p><div><hr></div><h3><strong>Workflow #1: Wrangling Data</strong></h3><h5><strong>Examples</strong></h5><ul><li><p>Pulling specific numbers from PDFs and converting them into a CSV</p></li><li><p>Categorizing files and cleaning up naming conventions</p></li><li><p>Extracting contacts or email addresses from messy text logs</p></li></ul><h5><strong>Why AI Helps</strong></h5><p>These tasks have clear, rule-based outputs&#8212;&#8220;find X and place it in Y&#8221;&#8212;which is where AI shines. But beware: AI can&#8217;t magically impose order. A human must design a taxonomy that fits your organization&#8217;s workflows, which is the real interesting part of the problem. By allowing AI to handle the busy work, like manually cleaning and formatting data, you free up your team to focus on strategic work.</p><div><hr></div><h3><strong>Workflow #2: Synthesizing Insights from Multiple Sources</strong></h3><h5><strong>Examples</strong></h5><ul><li><p>Gleaning common themes from dozens of user interview transcripts</p></li><li><p>Pulling out recurring pain points across multiple support tickets</p></li><li><p>Summarizing findings from a stack of market research reports</p></li></ul><h5><strong>Why AI Helps</strong></h5><p>LLMs excel at spotting patterns and highlighting key topics across large volumes of unstructured text. These tasks typically require sifting through hundreds of pages, which is both tedious and error-prone for humans. By removing this tedium, teams get to spend more time digging into the <em>why</em> and the<em> how</em>&#8212;the insights that will actually help your business grow.</p><div><hr></div><h3><strong>Workflow #3: Document Discovery and Tagging</strong></h3><h5><strong>Examples</strong></h5><ul><li><p>Automatically tagging documents with key metadata, like adding client names to contracts, or categorizing invoices by vendor</p></li><li><p>Building a &#8220;knowledge discovery&#8221; portal that lets users quickly locate relevant files</p></li><li><p>Continuously updating a knowledge base so important assets don&#8217;t get buried</p></li></ul><h5><strong>Why AI Helps</strong></h5><p>AI improves file discovery by analyzing content rather than relying solely on keywords. This means teams spend less time searching for the right document and more time driving projects forward. Whether you&#8217;re a film editor tracking down that perfect B-roll shot or a marketer hunting for a specific customer quote, AI minimizes bottlenecks and empowers you to focus on producing high-impact work, not finding the missing puzzle piece.</p><div><hr></div><h3><strong>Workflow #4: Refactoring and Repurposing Existing Information</strong></h3><h5><strong>Examples</strong></h5><ul><li><p>Turning a recording of business development meeting into a written draft of a proposal</p></li><li><p>Converting multiple meeting transcripts into a concise weekly executive update</p></li><li><p>Transforming long internal memos into bite-sized bullet points for a company-wide newsletter</p></li></ul><h5><strong>Why AI Helps</strong></h5><p>In professional settings, countless hours are wasted reformatting existing information to suit different audiences. AI streamlines this process, converting raw material into polished, audience-ready outputs. By automating this formatting work, teams can redirect their efforts toward creating original, high-value content that drives growth and innovation.</p><div><hr></div><p>Used thoughtfully, these four workflows unlock genuine efficiency gains&#8212;without diluting the human expertise that truly matters.</p>]]></content:encoded></item><item><title><![CDATA[AI in Marketing in 2024]]></title><description><![CDATA[What is it good for&#8212;and why?]]></description><link>https://thoughts.collected.fyi/p/ai-in-marketing-in-2024</link><guid isPermaLink="false">https://thoughts.collected.fyi/p/ai-in-marketing-in-2024</guid><dc:creator><![CDATA[Teo Soares]]></dc:creator><pubDate>Tue, 24 Dec 2024 17:21:34 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/75570e01-4255-43fd-b5b8-45342c8a13f2_4671x3740.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Most essays like this begin with a stat about AI spreading through the marketing industry like wildfire. Everywhere&#8212;in surveys from the <a href="https://www.databricks.com/sites/default/files/2023-07/ebook_mit-cio-generative-ai-report.pdf">MIT Technology Review</a>, <a href="https://www2.deloitte.com/content/dam/Deloitte/us/Documents/consulting/us-state-of-gen-ai-report.pdf">Deloitte</a>, <a href="https://www.salesforce.com/news/stories/generative-ai-statistics/#h-marketers-believe-generative-ai-will-transform-their-role-but-worry-about-accuracy">Salesforce</a>, <a href="https://www.bcg.com/publications/2023/generative-ai-in-marketing">BCG</a>, and <a href="https://www.statista.com/statistics/1388390/generative-ai-usage-marketing/">Statista</a>&#8212;marketers are &#8220;exploring,&#8221; &#8220;adopting,&#8221; and &#8220;utilizing&#8221; the &#8220;critical&#8221; technology that is AI.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!GLze!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b10d045-ab4f-4382-9965-b4dc9c38f652_1164x1062.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!GLze!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b10d045-ab4f-4382-9965-b4dc9c38f652_1164x1062.png 424w, https://substackcdn.com/image/fetch/$s_!GLze!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b10d045-ab4f-4382-9965-b4dc9c38f652_1164x1062.png 848w, https://substackcdn.com/image/fetch/$s_!GLze!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b10d045-ab4f-4382-9965-b4dc9c38f652_1164x1062.png 1272w, https://substackcdn.com/image/fetch/$s_!GLze!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b10d045-ab4f-4382-9965-b4dc9c38f652_1164x1062.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!GLze!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b10d045-ab4f-4382-9965-b4dc9c38f652_1164x1062.png" width="332" height="302.9072164948454" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8b10d045-ab4f-4382-9965-b4dc9c38f652_1164x1062.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1062,&quot;width&quot;:1164,&quot;resizeWidth&quot;:332,&quot;bytes&quot;:101598,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!GLze!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b10d045-ab4f-4382-9965-b4dc9c38f652_1164x1062.png 424w, https://substackcdn.com/image/fetch/$s_!GLze!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b10d045-ab4f-4382-9965-b4dc9c38f652_1164x1062.png 848w, https://substackcdn.com/image/fetch/$s_!GLze!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b10d045-ab4f-4382-9965-b4dc9c38f652_1164x1062.png 1272w, https://substackcdn.com/image/fetch/$s_!GLze!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b10d045-ab4f-4382-9965-b4dc9c38f652_1164x1062.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">What does this mean?</figcaption></figure></div><p>These studies are silly. Asking someone <em>whether</em> they&#8217;re using a tool is not nearly as useful as asking <em>whether that tool is any good</em>&#8212;and, most importantly, <em>why.</em></p><p>That&#8217;s where this essay comes in. We&#8217;re going to walk through the following marketing use cases and qualitatively evaluate how good AI is at each:</p><ul><li><p>Generating imagery</p></li><li><p>Naming products and features</p></li><li><p>Writing marketing copy</p></li><li><p>Validating marketing hypotheses</p></li><li><p>Analyzing data</p></li><li><p>Streamlining marketing operations</p></li></ul><p>Importantly, we&#8217;ll also dig into <em>why</em> AI fares well or poorly in these areas, focusing on the technical underpinnings that make it so.</p><p>We won&#8217;t be teaching you prompt engineering or telling you which specific tools are best for each task; rather, we&#8217;ll give you a framework for understanding why the technology shines in some contexts and flounders in others.</p><h4>Methodology</h4><p>Before we start, three notes on methodology:</p><ul><li><p><strong>A qualitative lens:</strong> There isn&#8217;t a simple metric for &#8220;good marketing,&#8221; so we rely on our experience&#8212;both authors started their tech careers as product marketing managers. To evaluate AI&#8217;s performance in each use case, we ask, &#8220;If an intern produced this work, would we think it&#8217;s any good?&#8221;</p></li><li><p><strong>Focus on models, not prompts: </strong>A skilled prompt engineer will, without question, get better results than what we provide below as examples. However, the underlying model constraints remain. Our examples highlight those baked-in limits, regardless of how expertly you phrase the request.</p></li><li><p><strong>Tools keep evolving:</strong> What&#8217;s true in December 2024 might be outdated six months from now. But by focusing on how these models fundamentally function, we hope to give you a clear lens for evaluating any new tools that come along.</p></li></ul><div><hr></div><h2>Generating Imagery</h2><h4>How it does</h4><p><strong>Hit-or-miss.</strong> Performance really depends on what you&#8217;re trying to generate. AI tools are good at softer, organic-looking visuals, like people and animals.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!RdLK!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e9a32b7-e901-43be-b170-ced1b4b55325_989x466.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!RdLK!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e9a32b7-e901-43be-b170-ced1b4b55325_989x466.png 424w, https://substackcdn.com/image/fetch/$s_!RdLK!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e9a32b7-e901-43be-b170-ced1b4b55325_989x466.png 848w, https://substackcdn.com/image/fetch/$s_!RdLK!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e9a32b7-e901-43be-b170-ced1b4b55325_989x466.png 1272w, https://substackcdn.com/image/fetch/$s_!RdLK!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e9a32b7-e901-43be-b170-ced1b4b55325_989x466.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!RdLK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e9a32b7-e901-43be-b170-ced1b4b55325_989x466.png" width="989" height="466" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2e9a32b7-e901-43be-b170-ced1b4b55325_989x466.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:466,&quot;width&quot;:989,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:961655,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!RdLK!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e9a32b7-e901-43be-b170-ced1b4b55325_989x466.png 424w, https://substackcdn.com/image/fetch/$s_!RdLK!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e9a32b7-e901-43be-b170-ced1b4b55325_989x466.png 848w, https://substackcdn.com/image/fetch/$s_!RdLK!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e9a32b7-e901-43be-b170-ced1b4b55325_989x466.png 1272w, https://substackcdn.com/image/fetch/$s_!RdLK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2e9a32b7-e901-43be-b170-ced1b4b55325_989x466.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">&#8220;Generate a photorealistic image of a happy couple checking in at a resort,&#8221; and, &#8220;Generate a photorealistic, 4K close up of a dog happily running through the rain.&#8221; Generated with DALL-E via ChatGPT 4o.</figcaption></figure></div><p>But they struggle with crisp, clean images with sharp contrasts and straight lines. This makes them bad at things like UI and logos. </p><p>In the logo below, the plane is asymmetrical, several lines are uneven, and there&#8217;s a smudge near the bottom edge&#8212;all of which detract from the precision needed for a polished logo. </p><p>And the UI is, well, bad.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Lb8j!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc99135a0-61b8-4ec2-8b09-b6609ab1afe1_989x466.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Lb8j!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc99135a0-61b8-4ec2-8b09-b6609ab1afe1_989x466.png 424w, https://substackcdn.com/image/fetch/$s_!Lb8j!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc99135a0-61b8-4ec2-8b09-b6609ab1afe1_989x466.png 848w, https://substackcdn.com/image/fetch/$s_!Lb8j!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc99135a0-61b8-4ec2-8b09-b6609ab1afe1_989x466.png 1272w, https://substackcdn.com/image/fetch/$s_!Lb8j!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc99135a0-61b8-4ec2-8b09-b6609ab1afe1_989x466.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Lb8j!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc99135a0-61b8-4ec2-8b09-b6609ab1afe1_989x466.png" width="989" height="466" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c99135a0-61b8-4ec2-8b09-b6609ab1afe1_989x466.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:466,&quot;width&quot;:989,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:329854,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Lb8j!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc99135a0-61b8-4ec2-8b09-b6609ab1afe1_989x466.png 424w, https://substackcdn.com/image/fetch/$s_!Lb8j!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc99135a0-61b8-4ec2-8b09-b6609ab1afe1_989x466.png 848w, https://substackcdn.com/image/fetch/$s_!Lb8j!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc99135a0-61b8-4ec2-8b09-b6609ab1afe1_989x466.png 1272w, https://substackcdn.com/image/fetch/$s_!Lb8j!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc99135a0-61b8-4ec2-8b09-b6609ab1afe1_989x466.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">&#8220;Create a minimalist, vector-based, black-and-white logo that's a circle with the outline of a plane flying in front of a sun. Make it simple so it's legible at small sizes,&#8221; and, &#8220;Generate a vector graphic of simple, minimalist UI for the balance screen of a mobile payments app.&#8221; Generated with DALL-E via ChatGPT 4o.</figcaption></figure></div><p>It also makes them bad at product imagery. While the plane in the example below is convincing, if I were a marketer at Boeing, I&#8217;d worry about whether details like the size of the wings or the position of the engines actually match a Boeing plane.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ZBb_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5c2971d-46d8-4b75-a4fb-773f975bd7dc_1600x1600.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ZBb_!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5c2971d-46d8-4b75-a4fb-773f975bd7dc_1600x1600.png 424w, https://substackcdn.com/image/fetch/$s_!ZBb_!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5c2971d-46d8-4b75-a4fb-773f975bd7dc_1600x1600.png 848w, https://substackcdn.com/image/fetch/$s_!ZBb_!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5c2971d-46d8-4b75-a4fb-773f975bd7dc_1600x1600.png 1272w, https://substackcdn.com/image/fetch/$s_!ZBb_!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5c2971d-46d8-4b75-a4fb-773f975bd7dc_1600x1600.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ZBb_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5c2971d-46d8-4b75-a4fb-773f975bd7dc_1600x1600.png" width="339" height="339" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b5c2971d-46d8-4b75-a4fb-773f975bd7dc_1600x1600.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1456,&quot;width&quot;:1456,&quot;resizeWidth&quot;:339,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ZBb_!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5c2971d-46d8-4b75-a4fb-773f975bd7dc_1600x1600.png 424w, https://substackcdn.com/image/fetch/$s_!ZBb_!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5c2971d-46d8-4b75-a4fb-773f975bd7dc_1600x1600.png 848w, https://substackcdn.com/image/fetch/$s_!ZBb_!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5c2971d-46d8-4b75-a4fb-773f975bd7dc_1600x1600.png 1272w, https://substackcdn.com/image/fetch/$s_!ZBb_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5c2971d-46d8-4b75-a4fb-773f975bd7dc_1600x1600.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">&#8220;Generate an image of a Boeing plane flying across a sunset.&#8221; Generated with DALL-E via ChatGPT 4o.</figcaption></figure></div><h4>The Technical &#8220;Why&#8221;</h4><ol><li><p><strong>Data matters</strong>: Most image generation models train on massive datasets of organic, everyday images. That&#8217;s great for generating &#8220;soft&#8221; visual content&#8212;natural lighting, fuzzy edges, and broad shapes&#8212;but less helpful for the vector-like precision or brand consistency needed for product imagery or logos.</p></li><li><p><strong>Model architecture</strong>: Many popular tools use diffusion models. These algorithms start with noise and iteratively refine the image. This means they excel at approximating complex, &#8220;messy&#8221; images but struggle with structured or rigid designs like infographics, product mockups, or logos&#8212;anything needing tight, consistent lines and proportions.</p></li></ol><h4>Tools to Try</h4><ul><li><p><strong><a href="https://openai.com/index/dall-e-3/">DALL-E in ChatGPT</a>:</strong> The easiest way to generate images.</p></li><li><p><strong><a href="https://www.adobe.com/products/photoshop/generative-fill.html">Adobe Photoshop (Generative Fill)</a>:</strong> Lets you easily add or remove elements in an image.</p></li><li><p><strong><a href="https://deepmind.google/technologies/imagen-2/">Imagen 2</a>: </strong>Has been tuned for background swaps.<strong> </strong><em>(Note: As of December 2024, Imagen 2 is only available via API, so implementation will require a technical team. <a href="https://www.collected.fyi/contact">We can help</a>.)</em></p></li></ul><div><hr></div><h2>Naming</h2><h4>How it does</h4><p><strong>Very badly. </strong>When it comes to naming, AI models usually return bland suggestions that are not ownable (&#8220;Stride&#8221; for a shoe brand) or awkwardly mashed-up hybrids (&#8220;UrbanAthlete&#8221; or &#8220;FusionStep&#8221;).</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fWHG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F844f5cc6-d011-4cda-b084-819ba2d7ecc2_818x1057.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fWHG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F844f5cc6-d011-4cda-b084-819ba2d7ecc2_818x1057.png 424w, https://substackcdn.com/image/fetch/$s_!fWHG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F844f5cc6-d011-4cda-b084-819ba2d7ecc2_818x1057.png 848w, https://substackcdn.com/image/fetch/$s_!fWHG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F844f5cc6-d011-4cda-b084-819ba2d7ecc2_818x1057.png 1272w, https://substackcdn.com/image/fetch/$s_!fWHG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F844f5cc6-d011-4cda-b084-819ba2d7ecc2_818x1057.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fWHG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F844f5cc6-d011-4cda-b084-819ba2d7ecc2_818x1057.png" width="500" height="646.0880195599022" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/844f5cc6-d011-4cda-b084-819ba2d7ecc2_818x1057.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1057,&quot;width&quot;:818,&quot;resizeWidth&quot;:500,&quot;bytes&quot;:81125,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!fWHG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F844f5cc6-d011-4cda-b084-819ba2d7ecc2_818x1057.png 424w, https://substackcdn.com/image/fetch/$s_!fWHG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F844f5cc6-d011-4cda-b084-819ba2d7ecc2_818x1057.png 848w, https://substackcdn.com/image/fetch/$s_!fWHG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F844f5cc6-d011-4cda-b084-819ba2d7ecc2_818x1057.png 1272w, https://substackcdn.com/image/fetch/$s_!fWHG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F844f5cc6-d011-4cda-b084-819ba2d7ecc2_818x1057.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Generated with ChatGPT 4o.</figcaption></figure></div><p>While this might be okay for initial brainstorming, it rarely yields the kind of fresh, memorable brand names that truly stand out.</p><h4>The technical &#8220;why&#8221;</h4><ul><li><p><strong>Tokenization limits creativity. </strong>Many names are wholly invented words (&#8220;Xerox,&#8221; &#8220;Expedia&#8221;) or altered versions of existing words (&#8220;Verizon&#8221;). Language models are technically incompatible with this type of thinking, since they work by predicting sequences of &#8220;tokens,&#8221; which are typically chunks of words (e.g., &#8220;strid&#8221; + &#8220;e&#8221;) rather than single letters or syllables. Because of this, the model cannot &#8220;invent&#8221; words at a granular, character-by-character level&#8212;an &#8220;X&#8221; followed by an &#8220;E&#8221; followed by an &#8220;R&#8221; followed by an &#8220;O,&#8221; etc. Instead, it rearranges existing pieces of language. That&#8217;s where we get the recycled feel of AI-generated names.</p></li></ul><h4>Tools to try</h4><p>Don&#8217;t expect magic&#8212;but if you want to see for yourself, you can test out <strong><a href="http://chat.openai.com">ChatGPT</a></strong>, <strong><a href="https://gemini.google.com/app">Gemini</a></strong>, or <strong><a href="https://claude.ai/">Claude</a></strong>.</p><div><hr></div><h2>Writing marketing copy</h2><h4>How it does</h4><p><strong>It depends. </strong>When tasked with writing marketing copy, AI models typically produce text that&#8217;s clear and coherent&#8212;but also bland and predictable.</p><p>This can be helpful for expressing something plainly, or adapting an existing message&#8212;shortening a paragraph, or modularly changing the highlighted features based on the audience.</p><p>What AI can&#8217;t deliver, however, is the kind of unique insight or compelling &#8220;hook&#8221; that makes your product stand out. Marketing copy isn&#8217;t just about clear writing&#8212;it&#8217;s about telling a story that highlights a product&#8217;s unique selling proposition. AI is optimized for what&#8217;s statistically common; &#8220;unique&#8221; is not its strong suit. </p><p>The copy below, for instance, could apply to <em>any</em> maker of athletic shoes.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!T0DE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdb219f1-1d08-422e-9af9-f6c6509f8e09_818x609.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!T0DE!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdb219f1-1d08-422e-9af9-f6c6509f8e09_818x609.png 424w, https://substackcdn.com/image/fetch/$s_!T0DE!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdb219f1-1d08-422e-9af9-f6c6509f8e09_818x609.png 848w, https://substackcdn.com/image/fetch/$s_!T0DE!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdb219f1-1d08-422e-9af9-f6c6509f8e09_818x609.png 1272w, https://substackcdn.com/image/fetch/$s_!T0DE!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdb219f1-1d08-422e-9af9-f6c6509f8e09_818x609.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!T0DE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdb219f1-1d08-422e-9af9-f6c6509f8e09_818x609.png" width="500" height="372.2493887530562" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cdb219f1-1d08-422e-9af9-f6c6509f8e09_818x609.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:609,&quot;width&quot;:818,&quot;resizeWidth&quot;:500,&quot;bytes&quot;:67761,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!T0DE!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdb219f1-1d08-422e-9af9-f6c6509f8e09_818x609.png 424w, https://substackcdn.com/image/fetch/$s_!T0DE!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdb219f1-1d08-422e-9af9-f6c6509f8e09_818x609.png 848w, https://substackcdn.com/image/fetch/$s_!T0DE!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdb219f1-1d08-422e-9af9-f6c6509f8e09_818x609.png 1272w, https://substackcdn.com/image/fetch/$s_!T0DE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdb219f1-1d08-422e-9af9-f6c6509f8e09_818x609.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Generated with ChatGPT 4o.</figcaption></figure></div><h4>The technical &#8220;why&#8221;</h4><ul><li><p><strong>Generative AI models are fundamentally designed to generate output that&#8217;s &#8220;likely,&#8221; not &#8220;original.&#8221;</strong> Language models predict text by choosing the most probable next word at each step. This probability-driven method means the final output avoids the unconventional phrases that make for unforgettable marketing. Consider taglines like &#8220;Think different&#8221; (Apple) or &#8220;Impossible is nothing&#8221; (Adidas). They break standard grammar or common phrasing to grab attention. Because AI picks what&#8217;s statistically likely, it usually steers clear of these bold, memorable choices.</p></li></ul><h4>Tools to try</h4><p>Language models like <strong><a href="http://chat.openai.com">ChatGPT</a></strong>, <strong><a href="https://gemini.google.com/app">Gemini</a></strong>, or <strong><a href="https://claude.ai/">Claude</a></strong>.</p><div><hr></div><h2>Validating marketing hypotheses</h2><h4>How it does</h4><p><strong>Surprisingly good&#8212;for now.</strong> Recent research from <a href="https://www.hbs.edu/ris/Publication%20Files/23-062_ed720ebc-ec4d-4bc3-a6ba-bad8cfbd9d51.pdf">HBS</a> and <a href="https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4241291">Haas/Columbia/University of Alberta</a> suggests that LLMs can mimic human survey responses with striking accuracy&#8212;up to 75% similarity. In theory, this means marketers might skip sending consumer surveys and simply ask an AI to review and validate concepts.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!BFS7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc405af72-8e7b-41bf-b784-b1d984465cb4_740x374.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!BFS7!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc405af72-8e7b-41bf-b784-b1d984465cb4_740x374.png 424w, https://substackcdn.com/image/fetch/$s_!BFS7!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc405af72-8e7b-41bf-b784-b1d984465cb4_740x374.png 848w, https://substackcdn.com/image/fetch/$s_!BFS7!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc405af72-8e7b-41bf-b784-b1d984465cb4_740x374.png 1272w, https://substackcdn.com/image/fetch/$s_!BFS7!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc405af72-8e7b-41bf-b784-b1d984465cb4_740x374.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!BFS7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc405af72-8e7b-41bf-b784-b1d984465cb4_740x374.png" width="494" height="249.67027027027027" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c405af72-8e7b-41bf-b784-b1d984465cb4_740x374.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:374,&quot;width&quot;:740,&quot;resizeWidth&quot;:494,&quot;bytes&quot;:31492,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!BFS7!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc405af72-8e7b-41bf-b784-b1d984465cb4_740x374.png 424w, https://substackcdn.com/image/fetch/$s_!BFS7!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc405af72-8e7b-41bf-b784-b1d984465cb4_740x374.png 848w, https://substackcdn.com/image/fetch/$s_!BFS7!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc405af72-8e7b-41bf-b784-b1d984465cb4_740x374.png 1272w, https://substackcdn.com/image/fetch/$s_!BFS7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc405af72-8e7b-41bf-b784-b1d984465cb4_740x374.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Li, Castelo, Katona, and Sarvary (December 2023)</figcaption></figure></div><p><strong>The technical &#8220;why&#8221;<br></strong>At their core, language models choose the most likely next words based on massive datasets and continual human feedback. In other words, they&#8217;ve learned to be &#8220;mid&#8221;&#8212;to converge around the average human response. So, if you ask these models what people think of a new product idea or marketing angle, they can provide a reasonable stand-in for an actual focus group.</p><p>However, there are a few important caveats:</p><ol><li><p><strong>Layered representation problem.</strong> Surveys are already a representation of real-world opinion. Using an AI (another layer of representation) on top of that can feel like you&#8217;re stacking abstractions&#8212;fine in theory, but it may not always capture genuine consumer sentiment.</p></li><li><p><strong>Panel selection still matters.</strong> While these studies show LLMs can &#8220;impersonate&#8221; certain demographics, niche groups are harder to emulate. If the model hasn&#8217;t seen enough data from a specific subset of people, its responses are less reliable.</p></li><li><p><strong>Changing data mix.</strong> As training data evolves&#8212;especially with more synthetic inputs&#8212;and as models shift toward machine-based fine-tuning methods, LLMs may drift further from the human &#8220;median.&#8221; Today&#8217;s near-accurate results could become less trustworthy tomorrow.</p></li></ol><h4>Tools to try</h4><p>If you&#8217;re curious, you can experiment with <strong><a href="http://chat.openai.com">ChatGPT</a>, <a href="https://gemini.google.com/app">Gemini</a>, </strong>or<strong> <a href="https://claude.ai/">Claude</a> </strong>for a quick &#8220;pseudo focus group.&#8221; Just remember you&#8217;re dealing with a statistical approximation, not a direct pipeline to collective human consciousness.</p><div><hr></div><h2>Data analysis</h2><h4>How it does</h4><p><strong>Pretty darn good. </strong>AI has powered data analysis for quite some time, though usually through quantitative methods like regression or clustering. Even so-called &#8220;qualitative&#8221; analysis still relied on quantitative methods, ignoring the actual semantic content of things like product reviews or interview transcripts.</p><p>But with LLMs, you can feed large sets of qualitative data into a model and get back meaningful insights&#8212;like recurring themes in user feedback or notable quotes from focus groups. Instead of simply grouping or ranking data objects, LLMs can actually interpret them, generating high-level summaries that capture the essence of what people are saying.</p><h4>The technical &#8220;why&#8221;</h4><ul><li><p><strong>Well represented in the data. </strong>A lot of content on the internet follows the same structure: data, then conclusion&#8212;think scientific papers, well-reasoned opinion pieces, or even Reddit threads (on a good day). LLMs have essentially &#8220;learned&#8221; this structure from massive training sets.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!3-W0!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2736f28-3117-4eb5-a3c8-29bcebe75d84_1763x1025.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!3-W0!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2736f28-3117-4eb5-a3c8-29bcebe75d84_1763x1025.png 424w, https://substackcdn.com/image/fetch/$s_!3-W0!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2736f28-3117-4eb5-a3c8-29bcebe75d84_1763x1025.png 848w, https://substackcdn.com/image/fetch/$s_!3-W0!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2736f28-3117-4eb5-a3c8-29bcebe75d84_1763x1025.png 1272w, https://substackcdn.com/image/fetch/$s_!3-W0!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2736f28-3117-4eb5-a3c8-29bcebe75d84_1763x1025.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!3-W0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2736f28-3117-4eb5-a3c8-29bcebe75d84_1763x1025.png" width="1456" height="847" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d2736f28-3117-4eb5-a3c8-29bcebe75d84_1763x1025.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:847,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:263968,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!3-W0!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2736f28-3117-4eb5-a3c8-29bcebe75d84_1763x1025.png 424w, https://substackcdn.com/image/fetch/$s_!3-W0!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2736f28-3117-4eb5-a3c8-29bcebe75d84_1763x1025.png 848w, https://substackcdn.com/image/fetch/$s_!3-W0!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2736f28-3117-4eb5-a3c8-29bcebe75d84_1763x1025.png 1272w, https://substackcdn.com/image/fetch/$s_!3-W0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2736f28-3117-4eb5-a3c8-29bcebe75d84_1763x1025.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Tools like Google&#8217;s <a href="https://notebooklm.google/">NotebookLM</a> can help quickly parse data from customer interviews.</figcaption></figure></div><h4>Tools to try</h4><p><strong><a href="https://notebooklm.google/">NotebookLM</a> and <a href="https://www.perplexity.ai/">Perplexity</a>. </strong>These platforms let you upload, query, and summarize your data, helping you move beyond raw numbers into more nuanced, qualitative insights.</p><div><hr></div><h2>Marketing operations</h2><h4>How it does</h4><p><strong>Good&#8212;</strong>though we&#8217;re using &#8220;operations&#8221; as a broad umbrella to mean all the small tasks that keep workflows humming. For instance:</p><ul><li><p>Getting help writing a clearer, more concise email</p></li><li><p>Using meeting transcripts to generate executive updates</p></li><li><p>Using AI to annotate assets so they&#8217;re easier to find later</p></li></ul><p>None of these tasks are especially glamorous, but they can have a noticeable impact on both productivity and output quality when aggregated over time.</p><h4>The technical &#8220;why&#8221;</h4><p>Large AI models excel at tasks that mirror how they&#8217;re trained: in discrete, narrowly defined steps with clear feedback. Breaking a real-world job into smaller pieces&#8212;like &#8220;extract themes from this data&#8221; or &#8220;polish this paragraph&#8221;&#8212;mimics that training process, making it easier for the model to perform well.</p><p>As a rule of thumb, if you can split a process into smaller, data-heavy components, an LLM can probably handle one or two of those steps effectively&#8212;whether that&#8217;s summarizing transcripts, labeling images, or writing short blurbs.</p><div><hr></div><h2>Final Thoughts</h2><p>Marketers should understand <em>why</em> AI works. These models aren&#8217;t magic; they excel at tasks that align with their technical underpinnings and struggle when we ask them to invent something genuinely new or nail the tiniest details.</p><p>Keep that in mind, and you&#8217;ll know exactly where AI can supercharge your workflows.</p>]]></content:encoded></item><item><title><![CDATA[The Great AI Dilemma: Build, Tune, or Buy?]]></title><description><![CDATA[For 90% of companies, the better answer isn&#8217;t hiding in some grand invention&#8212;it&#8217;s already out there, waiting to be used.]]></description><link>https://thoughts.collected.fyi/p/the-great-ai-dilemma-build-tune-or</link><guid isPermaLink="false">https://thoughts.collected.fyi/p/the-great-ai-dilemma-build-tune-or</guid><dc:creator><![CDATA[Teo Soares]]></dc:creator><pubDate>Mon, 09 Dec 2024 17:43:06 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/45f1eb74-d8fe-49b5-b90d-d6e1e6bbc7bd_4000x4000.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>There&#8217;s a Carl Sagan quote I like: &#8220;If you wish to bake an apple pie from scratch, you must first invent the universe.&#8221;</p><p>This is the logic many businesses fall into when building AI solutions: start from scratch, build a custom model, and sprinkle in proprietary magic. But for 90% of companies, the better answer isn&#8217;t hiding in some grand invention&#8212;it&#8217;s already out there, waiting to be used.</p><h3>The Siren Song of Custom AI</h3><p>I get why companies are tempted to build their own AI models. Every business is different, with unique challenges and proprietary data that could potentially create a game-changing AI solution. However, this approach comes with significant drawbacks:</p><ol><li><p><strong>Astronomical Costs:</strong> Training a large language model from scratch is an incredibly expensive endeavor. For context, it's estimated that training BloombergGPT cost <a href="https://superwise.ai/blog/considerations-best-practices-in-llm-training/">between $3-4 million and took 3-4 months</a>.</p></li><li><p><strong>Technical Complexity:</strong> Building an AI model requires extensive <a href="https://wandb.ai/wandb_fc/LLM%20Best%20Practices/reports/Should-You-Purchase-an-LLM-or-Train-Your-Own---VmlldzozNjU5NjYy">cross-domain knowledge</a> spanning NLP/ML, subject matter expertise, and software/hardware proficiency.</p></li><li><p><strong>Data Demands</strong>: Training an effective LLM requires massive amounts of high-quality, diverse data.</p></li></ol><h3>The Middle Ground: Tuning</h3><p>Many businesses hear about &#8220;tuning&#8221; an existing model and think it&#8217;s the perfect middle ground. Whether it&#8217;s full-scale fine-tuning with large datasets, self-implemented parameter-efficient techniques like LoRA, or a simple &#8220;fine-tuning&#8221; endpoint offered by a paid provider, the goal is the same: take something off-the-shelf and try to make it work better with your data.</p><p>Tuning has its advantages, such as improved task-specific performance and greater control over outputs. But it still presents challenges:</p><ol><li><p><strong>Data Quality Dependence</strong>: The success of fine-tuning <a href="https://www.sapien.io/blog/fine-tuning-pre-trained-models-for-industry-specific-ai-applications">heavily relies on the quality and relevance of your training data</a>, and as such, it risks <a href="https://geekyants.com/en-us/blog/the-contrast-between-rag-and-fine-tuning-models-for-tech-enthusiasts--ai-simplified">amplifying biases</a> present in your training data.</p></li><li><p><strong>Resource Intensive: </strong>Fine-tuning may sound simple, but it still demands significant expertise. Just because an AI provider offers a &#8220;tuning&#8221; endpoint doesn&#8217;t mean you&#8217;ll get high-quality results right away. Success depends entirely on your ability to align the right data with clear business objectives&#8212;and that&#8217;s far harder than it sounds.</p></li><li><p><strong>Ongoing Maintenance:</strong> Tuning locks you into a particular version of a model. When new versions are released&#8212;and they will be&#8212;you&#8217;ll need to re-tune to keep up, increasing overhead and slowing down updates.</p></li></ol><h3>The Pragmatic Approach: Off-the-Shelf Solutions</h3><p>For 98% of businesses, an off-the-shelf AI solution is the most practical and effective choice. Here's why:</p><ol><li><p><strong>Cost-Effective</strong>: Off-the-shelf solutions are significantly cheaper to implement than custom-built models.</p></li><li><p><strong>Rapid Deployment</strong>: These solutions can be deployed quickly, allowing you to start deriving value almost immediately.</p></li><li><p><strong>Reduced Risk</strong>: Off-the-shelf products are already proven in the marketplace, minimizing the risk of project failure.</p></li><li><p><strong>Ongoing Support</strong>: You benefit from the provider's continuous improvements and updates.</p></li></ol><h3>Start Smart, Scale Later</h3><p>While the idea of a bespoke AI model is enticing, the reality is that most businesses don't need&#8212;and can't afford&#8212;to build one from scratch. By starting with off-the-shelf solutions, you can quickly prototype, learn, and iterate.</p><p><a href="https://x.com/perplexity_ai/status/1600551871554338816">Even cutting-edge AI companies like Perplexity began their AI journeys with off-the-shelf models</a> before developing more custom solutions. The key is to start small, focus on solving specific problems, and let your AI strategy evolve based on real-world results and business needs.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!5ydf!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F364a241f-016b-4098-aa9c-59408c69b57f_1382x790.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!5ydf!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F364a241f-016b-4098-aa9c-59408c69b57f_1382x790.png 424w, https://substackcdn.com/image/fetch/$s_!5ydf!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F364a241f-016b-4098-aa9c-59408c69b57f_1382x790.png 848w, https://substackcdn.com/image/fetch/$s_!5ydf!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F364a241f-016b-4098-aa9c-59408c69b57f_1382x790.png 1272w, https://substackcdn.com/image/fetch/$s_!5ydf!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F364a241f-016b-4098-aa9c-59408c69b57f_1382x790.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!5ydf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F364a241f-016b-4098-aa9c-59408c69b57f_1382x790.png" width="519" height="296.6787264833575" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/364a241f-016b-4098-aa9c-59408c69b57f_1382x790.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:790,&quot;width&quot;:1382,&quot;resizeWidth&quot;:519,&quot;bytes&quot;:202658,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!5ydf!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F364a241f-016b-4098-aa9c-59408c69b57f_1382x790.png 424w, https://substackcdn.com/image/fetch/$s_!5ydf!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F364a241f-016b-4098-aa9c-59408c69b57f_1382x790.png 848w, https://substackcdn.com/image/fetch/$s_!5ydf!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F364a241f-016b-4098-aa9c-59408c69b57f_1382x790.png 1272w, https://substackcdn.com/image/fetch/$s_!5ydf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F364a241f-016b-4098-aa9c-59408c69b57f_1382x790.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Even Perplexity started with an off-the-shelf model.</figcaption></figure></div><h4>Prototyping: The Best First Step</h4><p>Before even considering building a custom model, it's crucial to prototype with off-the-shelf solutions. This approach offers several advantages:</p><ol><li><p><strong>Quick Validation</strong>: You can rapidly test whether AI can solve your specific problem without significant investment.</p></li><li><p><strong>Cost-Effective Experimentation:</strong> Off-the-shelf models allow you to experiment with different approaches at a fraction of the cost of custom development.</p></li><li><p><strong>Learning Opportunity:</strong> Working with existing models helps you understand the nuances of AI applications in your domain, informing future decisions about customization.</p></li></ol><p>At <strong><a href="http://collected.fyi">Collected Company</a></strong>, we specialize in helping businesses take this first step. We guide companies through prototyping, helping them explore the best tools and approaches to fit their needs. If you&#8217;re facing this challenge yourself, <strong><a href="https://www.collected.fyi/contact">reach out</a></strong>&#8212;we&#8217;d love to help you find the smartest path forward.</p>]]></content:encoded></item><item><title><![CDATA[Practical (AI) Magic]]></title><description><![CDATA[Scroll through LinkedIn for five minutes and you'll inevitably see some version of a post like, "If You're Not Using These 7 AI Tools, You're Already Irrelevant."&#160;Take it from someone who makes a living with AI tools: That&#8217;s snake oil.]]></description><link>https://thoughts.collected.fyi/p/practical-magic</link><guid isPermaLink="false">https://thoughts.collected.fyi/p/practical-magic</guid><dc:creator><![CDATA[Teo Soares]]></dc:creator><pubDate>Mon, 09 Dec 2024 16:38:53 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/de869955-7986-4b33-81ff-d1b176417750_3749x4662.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Scroll through LinkedIn for five minutes and you'll inevitably see some version of a post like, <em>"If You're Not Using These 7 AI Tools, You're Already Irrelevant."</em></p><p>Take it from someone who makes a living with AI tools: That&#8217;s snake oil.</p><p>Useful technology is not about the tool. It's about the problem you're solving.</p><p>At our firm, <a href="http://collected.fyi">Collected Company</a>, we&#8217;ve been integrating AI tools by first looking at our actual work&#8212;where we&#8217;re losing time, where processes feel clunky, where human energy is being wasted on repetitive tasks&#8212;and only <em>then</em> thinking up ways AI can help.</p><p>Here are three examples.</p><h3>Proposal Generation: Turning Conversation into Content</h3><p>To write a proposal, Nicole and I would spend an hour on a video call discussing the project. Then, one of us would spend at least another hour capturing all of those points in a document. Essentially, we were drafting the proposal twice&#8212;first verbally, then in written form.</p><p>We figured we could use AI to jumpstart the document-writing, allowing us to keep our energy and creativity for the live conversations and ideation. Now, our process involves recording and auto-transcribing our conversation, and then using language models to generate a first draft.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!7yHZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff7ffdfed-87fe-4d60-8ef4-a249230b3484_2841x1621.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!7yHZ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff7ffdfed-87fe-4d60-8ef4-a249230b3484_2841x1621.png 424w, https://substackcdn.com/image/fetch/$s_!7yHZ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff7ffdfed-87fe-4d60-8ef4-a249230b3484_2841x1621.png 848w, https://substackcdn.com/image/fetch/$s_!7yHZ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff7ffdfed-87fe-4d60-8ef4-a249230b3484_2841x1621.png 1272w, https://substackcdn.com/image/fetch/$s_!7yHZ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff7ffdfed-87fe-4d60-8ef4-a249230b3484_2841x1621.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!7yHZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff7ffdfed-87fe-4d60-8ef4-a249230b3484_2841x1621.png" width="502" height="286.5123626373626" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f7ffdfed-87fe-4d60-8ef4-a249230b3484_2841x1621.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:831,&quot;width&quot;:1456,&quot;resizeWidth&quot;:502,&quot;bytes&quot;:874498,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!7yHZ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff7ffdfed-87fe-4d60-8ef4-a249230b3484_2841x1621.png 424w, https://substackcdn.com/image/fetch/$s_!7yHZ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff7ffdfed-87fe-4d60-8ef4-a249230b3484_2841x1621.png 848w, https://substackcdn.com/image/fetch/$s_!7yHZ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff7ffdfed-87fe-4d60-8ef4-a249230b3484_2841x1621.png 1272w, https://substackcdn.com/image/fetch/$s_!7yHZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff7ffdfed-87fe-4d60-8ef4-a249230b3484_2841x1621.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">We use Grain.co to record the meetings where we discuss proposals</figcaption></figure></div><p>We happen to use <a href="https://grain.com/">Grain.co</a> for recording and transcribing our calls and ChatGPT or Gemini to generate the first draft, but the magic isn't in those specific tools&#8212;it's in recognizing the redundancy and finding a smarter path.</p><h3>Interview Insights: From Raw Conversation to Actionable Intelligence</h3><p>Stakeholder interviews are often a key part of our projects. Whether it&#8217;s talking to client teams to understand their processes or diving deep into customers&#8217; experiences, there&#8217;s no substitute for hearing from people fist-hand.</p><p>AI can never replace the role of a human interviewer, and it cannot generate the level of analysis and insight we want to deliver. But it <em>can </em>dramatically streamline the insight validation process&#8212;something that used to require hours of digging through interview transcripts in search of quotes.</p><p>Now, we can quickly cross-reference and validate our hypotheses with tools like Google's NotebookLM, which allows us to query up to 50 sources simultaneously. This means we can identify corroborating evidence or contradictions across multiple sources, transforming raw interview data into more robust, well-substantiated findings.</p><h3>Adaptive Messaging: Making AI <em>Actually </em>Useful in Marketing</h3><p>Most of the time, creating marketing content with AI doesn't reduce inefficiency; it multiplies it. Wrestling a language model into producing exactly what you want is time-consuming and bypasses the crucial strategic exercise of understanding your offering and positioning.</p><p>The real opportunity with language models isn't wholesale content generation, but adaptation. Marketing requires nuanced messaging: a pitch to an investor shouldn't sound like a pitch to a potential client. This is where AI truly shines.</p><p>At Collected Company, we use AI as a translation tool, not a content creator. We start with a carefully crafted, human-written narrative and use AI to subtly adjust tone, emphasis, and language for specific contexts. By harnessing AI's ability to refine and adapt, we communicate more precisely and efficiently.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!UzrG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F187ee842-9a2a-4de6-9847-00710dc98b8f_1439x1355.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!UzrG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F187ee842-9a2a-4de6-9847-00710dc98b8f_1439x1355.png 424w, https://substackcdn.com/image/fetch/$s_!UzrG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F187ee842-9a2a-4de6-9847-00710dc98b8f_1439x1355.png 848w, https://substackcdn.com/image/fetch/$s_!UzrG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F187ee842-9a2a-4de6-9847-00710dc98b8f_1439x1355.png 1272w, https://substackcdn.com/image/fetch/$s_!UzrG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F187ee842-9a2a-4de6-9847-00710dc98b8f_1439x1355.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!UzrG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F187ee842-9a2a-4de6-9847-00710dc98b8f_1439x1355.png" width="524" height="493.41209173036833" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/187ee842-9a2a-4de6-9847-00710dc98b8f_1439x1355.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1355,&quot;width&quot;:1439,&quot;resizeWidth&quot;:524,&quot;bytes&quot;:285673,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!UzrG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F187ee842-9a2a-4de6-9847-00710dc98b8f_1439x1355.png 424w, https://substackcdn.com/image/fetch/$s_!UzrG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F187ee842-9a2a-4de6-9847-00710dc98b8f_1439x1355.png 848w, https://substackcdn.com/image/fetch/$s_!UzrG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F187ee842-9a2a-4de6-9847-00710dc98b8f_1439x1355.png 1272w, https://substackcdn.com/image/fetch/$s_!UzrG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F187ee842-9a2a-4de6-9847-00710dc98b8f_1439x1355.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">The AI copy isn&#8217;t so different from what we started with&#8212;and that&#8217;s the point.</figcaption></figure></div><h3>The Real AI Revolution: Problem-Solving, Not Tool-Collecting</h3><p>AI, at its best, is an extension of human creativity and problem-solving. We shouldn&#8217;t start by asking, "What can this tool do?" We should start by asking, "What can we do better?"</p><p>Each AI integration is a custom solution, tailored to our specific challenges. It's less about adopting the latest shiny object and more about understanding the unique ecosystem of our work.</p><h4>Your Turn: A Challenge</h4><p>Map out your workflows. Where do things get stuck? Where are humans doing work that feels mechanical? Where is time mysteriously disappearing?</p><p>Those are your AI integration opportunities.</p><p>The future of work isn't about having the shiniest tools. It's about solving real problems with thoughtful, purposeful technology.</p>]]></content:encoded></item><item><title><![CDATA[Welcome to Collected Thoughts]]></title><description><![CDATA[Collected Thoughts is a no-nonsense newsletter from Collected Company about using AI to solve real-world challenges&#8212;no hype, no fluff, just practical advice.]]></description><link>https://thoughts.collected.fyi/p/coming-soon</link><guid isPermaLink="false">https://thoughts.collected.fyi/p/coming-soon</guid><dc:creator><![CDATA[Teo Soares]]></dc:creator><pubDate>Thu, 05 Dec 2024 20:44:06 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/fbd2297c-5b0a-4900-9ecc-096c1065eac2_1956x573.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong>Collected Thoughts</strong> is a no-nonsense newsletter from <a href="http://collected.fyi/">Collected Company</a> about using AI to solve real-world challenges&#8212;no hype, no fluff, just practical advice.</p><p>Whether you&#8217;re leading a team, running a business, or looking to work smarter with AI, we cut through the noise to focus on what actually works. From actionable tips to real-world examples, <strong>Collected Thoughts</strong> is your guide to making AI work where it matters most.</p><h3>About Collected Company</h3><p>Collected Company partners with organizations to bring AI into their product strategy. We turn ideas into reality to solve actual problems, fast.</p><p>Our founders, <a href="https://www.linkedin.com/in/teosoares/">Teo</a> and <a href="https://www.linkedin.com/in/nicolebleuel/">Nicole</a>, have a cumulative 20 years of experience building products and features in the tech industry. Most recently, Teo was a Senior Product Manager on the API for Gemini, Google's generative AI model; and Nicole was a Senior Product Manager on Google Search.</p><p>Now, they enable organizations to envision, build, and test efficiently and effectively. Whether running brainstorms conducting user research, or designing and developing prototypes, Teo and Nicole can help get AI on your roadmap.</p><p><em>To learn more about Collected Company, visit <a href="http://collected.fyi/">collected.fyi</a>.</em></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://thoughts.collected.fyi/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://thoughts.collected.fyi/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item></channel></rss>