<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Latent.Space: Latent Space: AI for Science]]></title><description><![CDATA[a dedicated channel for Latent Space's AI for Science essays that do not get sent to the broader engineering audience — opt in if high interest in AI for Science!]]></description><link>https://www.latent.space/s/cience</link><image><url>https://substackcdn.com/image/fetch/$s_!DbYa!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73b0838a-bd14-46a1-801c-b6a2046e5c1e_1130x1130.png</url><title>Latent.Space: Latent Space: AI for Science</title><link>https://www.latent.space/s/cience</link></image><generator>Substack</generator><lastBuildDate>Fri, 25 Sep 2026 16:49:22 GMT</lastBuildDate><atom:link href="https://www.latent.space/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Latent.Space]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[swyx@noreply.com]]></webMaster><itunes:owner><itunes:email><![CDATA[swyx@noreply.com]]></itunes:email><itunes:name><![CDATA[Latent.Space]]></itunes:name></itunes:owner><itunes:author><![CDATA[Latent.Space]]></itunes:author><googleplay:owner><![CDATA[swyx@noreply.com]]></googleplay:owner><googleplay:email><![CDATA[swyx@noreply.com]]></googleplay:email><googleplay:author><![CDATA[Latent.Space]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Foundries vs Navigators: Lowering the Cost of Science]]></title><description><![CDATA[Guest Post: In science, thinking has gotten cheap but doing has not. This asymmetry is reshaping how research companies operate, largely inconspicuously.]]></description><link>https://www.latent.space/p/foundries-vs-navigators-lowering</link><guid isPermaLink="false">https://www.latent.space/p/foundries-vs-navigators-lowering</guid><dc:creator><![CDATA[Adrian Sanborn]]></dc:creator><pubDate>Thu, 24 Sep 2026 15:03:16 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!-Em5!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em><span>What does the future of science look like in the world of AI? Anthropic has some </span><a href="https://www.nytimes.com/2026/09/17/technology/dario-amodei-anthropic-essays-ai.html"><span>lofty goals for science</span></a><span> and is even </span><a href="https://techcrunch.com/2026/09/18/anthropic-is-operating-a-lab-that-conducts-biology-experiments/"><span>opening a wet lab</span></a><span>. Meanwhile a </span><a href="https://ai.google/static/documents/AI-in-Science.pdf"><span>quiet transformation</span></a></em><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a><em><span>  is happening all across AI x Science.</span></em></p><p><em><span>In this guest post, </span><a href="https://x.com/AdrianSanborn"><span>Adrian Sanborn</span></a><span> talks about the less flashy but more immediate ways he sees AI transforming front-line scientific research in his own company, Endura Therapeutics.</span></em></p><p><em><span>Adrian did a CS PhD at Stanford and spent much of it running experiments at the bench, which makes him one of the rare people who can tell you what an LLM is doing to a codebase and to a wet lab. Enjoy!</span></em></p><div><hr></div><p>Language models have transformed how software gets built. Writing code, wrangling data, and architecting systems now move at a speed unthinkable three years ago.</p><p>When the product is software and the result is verifiable, cheaper coding turns directly into more software and more builders.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-2" href="#footnote-2" target="_self">2</a> But in science, everything is ultimately gated by physical experiments that take days or weeks to verify anything. Knowledge work around the experiment has become dramatically faster while AI has done little for the throughput of the experiment itself. <strong>Thinking got cheap and doing did not</strong>.</p><p>We think the biotech industry has adapted in two ways:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!-Em5!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!-Em5!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png 424w, https://substackcdn.com/image/fetch/$s_!-Em5!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png 848w, https://substackcdn.com/image/fetch/$s_!-Em5!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png 1272w, https://substackcdn.com/image/fetch/$s_!-Em5!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!-Em5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png" width="1456" height="758" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:758,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:128552,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://asanborn.substack.com/i/217022913?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!-Em5!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png 424w, https://substackcdn.com/image/fetch/$s_!-Em5!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png 848w, https://substackcdn.com/image/fetch/$s_!-Em5!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png 1272w, https://substackcdn.com/image/fetch/$s_!-Em5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc4f2dad0-1897-4b86-aa39-f4772f76e474_1591x828.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p><strong>Foundries</strong> <strong>shrink the cost of doing.</strong> They industrialize the measurement, using new technology to generate data an order of magnitude faster than before. Xaira, NewLimit, Octant, Tahoe, and Endura accomplish this with next-generation sequencing and multiplexing; Insitro, Eikon, and Noetik with high-throughput microscopy; Lila and Periodic Labs with physical automation, just to name a few. AI makes that data legible and predictive, but the differentiating asset is the experimental data itself.</p></li><li><p><strong>Navigators</strong> <strong>spend the surplus of thinking.</strong> The AI models sit in the ordinary machinery of the company, driving better decisions and faster processes. They increasingly govern how the work is conducted, what tools get built, and which questions are worth an experiment. A proprietary model or a massive dataset are not required, only a willingness to evolve how the company works.</p></li></ul><p>Building a foundry is a genuine strategic commitment that takes capital, years, and a bet on a particular technology. Foundries are easy to see: the technology captures the imagination, the connection to AI is immediate, and there is always some new model or dataset to announce. Navigators are invisible by comparison because the gains are operational and nobody issues a press release about a path they decided against. But navigation is available to every company. The prominent change is happening at a few dozen companies, while the inconspicuous one is happening at all of them.</p><p>Navigation runs fastest at early-stage startups, which have no legacy to shed: no history of software contracts, standardized processes, calcified org structure, or compliance regime. They are also under pressure to move fast with very little. When a better way to work appears, it simply becomes the new normal.</p><p>The impact shows up everywhere. Experiments iterate faster when analysis takes an hour instead of a week. A category of software that would have been licensed for six figures becomes a one-day build. Disease programs get chosen from 500 candidates where a team could ordinarily evaluate five. Here&#8217;s what it looks like from the inside.</p><h2><strong>Code now keeps pace with the science</strong></h2><p>There is a structural tension in experimental science that software engineering has no real equivalent for. In engineering, requirements that change every few weeks are a symptom of poor planning. In research, they are the objective. The purpose of an experiment is to learn something, and that learning changes what the next experiment should be.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-3" href="#footnote-3" target="_self">3</a> If an approach has not evolved in six months, it means nothing is being discovered.</p><p>A new experiment&#8217;s protocol will evolve a dozen times in the first year, and every one of those changes propagates into the analysis. Each measurement has to be processed, normalized, and interpreted with code that tracks the experiment closely. Historically this analysis was done by a second person, creating a seam between the person who understands what the experiment is measuring and the person who understands what the code is doing. From this friction arises the tendency to propose fewer experimental changes to avoid analysis rework, which compounds into options left unexplored.</p><p>Now that writing code is fast, adapting the analysis to a modified protocol is an afternoon&#8217;s work rather than a project. <strong>The experiment is no longer constrained by the burden of changing the analysis pipeline.</strong> Experiments can be agile when flexibility is cheap and problems can be easily fixed; in other words, <strong>science gets to &#8220;move fast and break things.&#8221;</strong></p><p>The same shift also applies one layer up, to interpretation. An interactive visualization dashboard can now be built in minutes, down from days.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!fXvB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6882dd6-1780-46dd-87e0-5c5bc7cb257f_2048x1863.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!fXvB!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6882dd6-1780-46dd-87e0-5c5bc7cb257f_2048x1863.png 424w, https://substackcdn.com/image/fetch/$s_!fXvB!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6882dd6-1780-46dd-87e0-5c5bc7cb257f_2048x1863.png 848w, https://substackcdn.com/image/fetch/$s_!fXvB!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6882dd6-1780-46dd-87e0-5c5bc7cb257f_2048x1863.png 1272w, https://substackcdn.com/image/fetch/$s_!fXvB!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6882dd6-1780-46dd-87e0-5c5bc7cb257f_2048x1863.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!fXvB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6882dd6-1780-46dd-87e0-5c5bc7cb257f_2048x1863.png" width="546" height="496.5" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d6882dd6-1780-46dd-87e0-5c5bc7cb257f_2048x1863.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1324,&quot;width&quot;:1456,&quot;resizeWidth&quot;:546,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!fXvB!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6882dd6-1780-46dd-87e0-5c5bc7cb257f_2048x1863.png 424w, https://substackcdn.com/image/fetch/$s_!fXvB!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6882dd6-1780-46dd-87e0-5c5bc7cb257f_2048x1863.png 848w, https://substackcdn.com/image/fetch/$s_!fXvB!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6882dd6-1780-46dd-87e0-5c5bc7cb257f_2048x1863.png 1272w, https://substackcdn.com/image/fetch/$s_!fXvB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6882dd6-1780-46dd-87e0-5c5bc7cb257f_2048x1863.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>An internal dashboard at Endura Therapeutics, built in a few hours.</em></figcaption></figure></div><p>The most visible consequence is access. Previously, when every experiment was analyzed by the computational person, results waited in a queue. Now the scientist who ran the experiment and has the context presents their own results. The data is no longer gatekept behind someone else&#8217;s Python notebooks.</p><h2><strong>Software can now express your opinion</strong></h2><p>Every software interface has an opinion. A data system decides which comparisons are one click away and which require hunting. Every lab needs somewhere to store and display its data, and the opinion embedded in that system ends up shaping what that lab notices.</p><p>For two decades that opinion was formed by someone else: a handful of vendors who build lab software that acts as the system of record. These vendors build one system for a thousand labs and necessarily design toward the lowest common denominator. Everyone accepted the approximation, because developing your own was more work than any lab could justify.</p><p>This is no longer true. A data portal built in-house accommodates the quirks of the data that no commercial product would have anticipated, and is exactly as complex as the team needs, growing as their questions do. Browsing and exploring become simple and effortless, which changes behavior. Consider how little time anyone would spend on social media if seeing the next post required switching tabs and copy-pasting. Patterns that have been sitting in separate slide decks start to surface.</p><p>Implementation takes just one day, but deciding what the portal should do can take weeks. Those design discussions turn out to be critical, because deciding what belongs on a single screen forces a team to articulate which comparisons actually drive its decisions. <strong>When you buy a software platform you outsource not only the engineering but the question of </strong><em><strong>how</strong></em><strong> you accomplish your goals.</strong></p><p>There are tradeoffs: an in-house portal is less polished and there is no support team to call. Larger organizations, with layers of validation requirements and contractual obligations, will still struggle to follow in these footsteps. But software companies have long understood that the best internal tools come from engineers embedded alongside the people who use them. Now every research team can be its own forward-deployed engineer.</p><p>The old rule was &#8220;never build what you can buy&#8221;. The new rule is <strong>build the tools that shape how you think.</strong></p><h2><strong>Expert-level depth now scales</strong></h2><p>Choosing which diseases to pursue is the most consequential decision a drug company makes. Everything is downstream of this decision and built to accommodate the specifics of the disease biology and its market. The choice is effectively irreversible, with a single successful program requiring about a decade and a billion dollars, so the decision gets diligenced carefully. A typical process convenes a group of internal and outside experts who gather, synthesize, and debate the scientific and market evidence for a month or more.</p><p>That process assumes you already know which five diseases you&#8217;re arguing about. We didn&#8217;t have this shortlist at my company, Endura, because of the unique mechanism of our medicines. We&#8217;re developing CRISPR in a pill: a drug, taken in the convenience of your home, that forms a chemical scar on one specific genetic message and shuts off production of a disease-causing protein.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-4" href="#footnote-4" target="_self">4</a> Finding these drugs required developing a new DNA sequencing method that reads those scars across every gene at once, so a single experiment returns candidate drugs across hundreds of diseases. Instead of starting from five diseases, we had to triage the entire map of disease.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-5" href="#footnote-5" target="_self">5</a></p><p>We built a two-stage triage and pointed a fleet of LLM research agents at it. The first pass covered about 500 disease targets, generating the equivalent of a three-page report on each and filtering on foundational questions: is the disease prevalent enough to justify our efforts, is the problem already addressed by existing drugs, and would the target-lowering effect of our drug actually relieve the disease. The second pass, on the roughly 100 remaining disease targets, produced the equivalent of thirty pages each, working through disease biology and the competitive landscape thoroughly. We wrote the second-pass prompts to behave like a skeptical expert rather than a summarizer: name the programs that failed, why each failed, and what would have to be true for us to succeed where they didn&#8217;t. This level of detail is necessary because, as in any market, the clearly good targets are crowded. Arriving at a defensible position means finding the specific disease and the specific reason our drug will do something that existing approaches cannot.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Jk3K!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d52ab82-6e2d-40c9-baa9-b617237383ff_2322x999.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Jk3K!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d52ab82-6e2d-40c9-baa9-b617237383ff_2322x999.png 424w, https://substackcdn.com/image/fetch/$s_!Jk3K!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d52ab82-6e2d-40c9-baa9-b617237383ff_2322x999.png 848w, https://substackcdn.com/image/fetch/$s_!Jk3K!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d52ab82-6e2d-40c9-baa9-b617237383ff_2322x999.png 1272w, https://substackcdn.com/image/fetch/$s_!Jk3K!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d52ab82-6e2d-40c9-baa9-b617237383ff_2322x999.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Jk3K!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d52ab82-6e2d-40c9-baa9-b617237383ff_2322x999.png" width="1456" height="626" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4d52ab82-6e2d-40c9-baa9-b617237383ff_2322x999.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:626,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:156253,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://asanborn.substack.com/i/217022913?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d52ab82-6e2d-40c9-baa9-b617237383ff_2322x999.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!Jk3K!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d52ab82-6e2d-40c9-baa9-b617237383ff_2322x999.png 424w, https://substackcdn.com/image/fetch/$s_!Jk3K!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d52ab82-6e2d-40c9-baa9-b617237383ff_2322x999.png 848w, https://substackcdn.com/image/fetch/$s_!Jk3K!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d52ab82-6e2d-40c9-baa9-b617237383ff_2322x999.png 1272w, https://substackcdn.com/image/fetch/$s_!Jk3K!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d52ab82-6e2d-40c9-baa9-b617237383ff_2322x999.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>At the old rate, the first stage would have required about one person-year of reading, and the second closer to a century of expert time. The second pass still gets checked against primary sources and selected programs receive the full human diligence it always would have.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-6" href="#footnote-6" target="_self">6</a> But a search this broad, at this depth, simply was not possible a year ago.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!X95l!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F895a8715-d9e6-41d6-8d5a-92bd41efe8a9_2143x776.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!X95l!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F895a8715-d9e6-41d6-8d5a-92bd41efe8a9_2143x776.png 424w, https://substackcdn.com/image/fetch/$s_!X95l!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F895a8715-d9e6-41d6-8d5a-92bd41efe8a9_2143x776.png 848w, https://substackcdn.com/image/fetch/$s_!X95l!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F895a8715-d9e6-41d6-8d5a-92bd41efe8a9_2143x776.png 1272w, https://substackcdn.com/image/fetch/$s_!X95l!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F895a8715-d9e6-41d6-8d5a-92bd41efe8a9_2143x776.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!X95l!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F895a8715-d9e6-41d6-8d5a-92bd41efe8a9_2143x776.png" width="1456" height="527" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/895a8715-d9e6-41d6-8d5a-92bd41efe8a9_2143x776.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:527,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:133147,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://asanborn.substack.com/i/217022913?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F895a8715-d9e6-41d6-8d5a-92bd41efe8a9_2143x776.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!X95l!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F895a8715-d9e6-41d6-8d5a-92bd41efe8a9_2143x776.png 424w, https://substackcdn.com/image/fetch/$s_!X95l!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F895a8715-d9e6-41d6-8d5a-92bd41efe8a9_2143x776.png 848w, https://substackcdn.com/image/fetch/$s_!X95l!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F895a8715-d9e6-41d6-8d5a-92bd41efe8a9_2143x776.png 1272w, https://substackcdn.com/image/fetch/$s_!X95l!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F895a8715-d9e6-41d6-8d5a-92bd41efe8a9_2143x776.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>In research, the expensive mistakes are the unknown ones. A team commits to a direction and finds out it was wrong months later when the experiment comes back negative. Often a specialist could have said so in a sentence: that pathway has been tried, this readout has never predicted anything, that company faltered on that patient population. Access to this kind of <strong>expert-level depth at scale is a game changer exactly because being told &#8220;no&#8221; early is so valuable in research.</strong></p><h2><strong>This is the shallow end</strong></h2><p>Everything above happened at Endura &#8212; flexible and dynamic analysis, internal tools built in a day, a search across 500 diseases &#8212; and it is just the beginner version of navigation. Each subsequent generation of language models removes constraints we had taken for granted. Soon we could entirely skip building an analysis pipeline or data dashboard. Instead, a scientist will ask the question she actually has and the analysis and interface to answer it will be assembled from scratch. Software stops being a work product and becomes something that appears around the question.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-7" href="#footnote-7" target="_self">7</a></p><p>Access to expertise at this scale opens work nobody could attempt before. One clear example is drug repurposing, where a drug already proven safe in humans turns out to act on a disease mechanism nobody was looking at. The published literature is enormous, and some number of useful conclusions are sitting in it right now, unfound because no single person has read the right combination of papers. But a model can digest it all and, with the right prompting, connect the dots. A whole ecosystem of companies is now forming around that bet, and pharma and investors are running their own versions.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-8" href="#footnote-8" target="_self">8</a> What remains to be seen is whether this produces three new drugs or 300.</p><p>The navigators are testimony that the most accelerating AI in science right now is not a model trained on scientific data at all. It is the one that helps a scientist or executive figure out what is worth doing every Monday morning.</p><div><hr></div><p><em><a href="https://www.linkedin.com/in/adrian-sanborn/">Adrian Sanborn</a> is CEO and co-founder of <a href="https://enduratx.com/">Endura Therapeutics</a>. He was a founding member of Atomic AI, where he led the biology side of the technology platform and defined the company&#8217;s therapeutic strategy. He holds a PhD in computer science from Stanford, most of which he spent at the bench in Roger Kornberg&#8217;s biochemistry lab. He is <a href="https://x.com/AdrianSanborn">@AdrianSanborn</a> on X.</em></p><p><em>Many thanks to Brandon Anderson, swyx, and Lauren Richardson for reviewing drafts of this post and providing critical feedback.</em></p><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p><span>While this blog was being polished, </span><a href="https://ai.google/static/documents/AI-in-Science.pdf"><span>this paper</span></a><span> came out that talks about early insights in AI x Science. We were excited to see many of our insights were observed empirically!</span></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-2" href="#footnote-anchor-2" class="footnote-number" contenteditable="false" target="_self">2</a><div class="footnote-content"><p>This is the Jevons paradox, named for the 1865 observation that more efficient steam engines increased coal consumption rather than reducing it. The software version: every drop in the cost of writing code has so far been followed by more software rather than fewer engineers.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-3" href="#footnote-anchor-3" class="footnote-number" contenteditable="false" target="_self">3</a><div class="footnote-content"><p>Software product development actually also has workflows that emphasize learning and borrow the word &#8220;experiment.&#8221; Product teams run A/B tests, ship behind feature flags, and treat a release as a hypothesis about what users want.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-4" href="#footnote-anchor-4" class="footnote-number" contenteditable="false" target="_self">4</a><div class="footnote-content"><p>Most genetic medicines like CRISPR are large molecules that cannot get into cells on their own. They reach only a few tissues, and getting them there means an infusion, an injection, or, for the brain, a needle into the spinal canal. Small molecule drugs in a pill format travel through the body on their own and can be swallowed. When Roche launched an oral drug for spinal muscular atrophy, families steadily switched to it from an injected medicine that already worked.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-5" href="#footnote-anchor-5" class="footnote-number" contenteditable="false" target="_self">5</a><div class="footnote-content"><p>Most companies have good reasons to set a therapeutic area first, dictated by their pre-existing scientific expertise, clinical relationships, and business priorities. Our approach allow us to start broad to find the most productive direction and then build that depth afterwards.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-6" href="#footnote-anchor-6" class="footnote-number" contenteditable="false" target="_self">6</a><div class="footnote-content"><p>Language models are not perfect, and at this scale some reports contained errors. This is tolerable because a mistake in the first pass only means a missed opportunity, not time lost chasing a bad idea.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-7" href="#footnote-anchor-7" class="footnote-number" contenteditable="false" target="_self">7</a><div class="footnote-content"><p>Analysis generated on demand has an unresolved problem: reproducibility. If the code behind a figure was assembled for one question, its provenance is weaker than a versioned pipeline&#8217;s.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-8" href="#footnote-anchor-8" class="footnote-number" contenteditable="false" target="_self">8</a><div class="footnote-content"><p>For example, Edison Scientific is built close to this premise, and the team behind Metsera engaged its AI Scientist system to generate new company ideas.</p></div></div>]]></content:encoded></item><item><title><![CDATA[The Scientist and the Simulator]]></title><description><![CDATA[LLMs (alone) won&#8217;t cure cancer]]></description><link>https://www.latent.space/p/scientist-simulator</link><guid isPermaLink="false">https://www.latent.space/p/scientist-simulator</guid><dc:creator><![CDATA[Melissa]]></dc:creator><pubDate>Tue, 10 Feb 2026 15:27:58 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/109042a7-6fe5-4155-9c9d-c857490fde4e_1023x569.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>Editor: The response to <a href="https://www.latent.space/p/science">our new AI for Science agenda</a> has been cautiously positive! We&#8217;ll also be featuring essays and approachable analysis for AI Engineers, in this dedicated feed &#8212;&nbsp;which you can <a href="https://support.substack.com/hc/en-us/articles/8914938285204-How-do-I-subscribe-to-or-unsubscribe-from-a-section-on-Substack">opt in/out</a> of on <a href="https://www.latent.space/account">your account</a>! </em></p><p><em>One struggle we&#8217;ve had: approximately NONE of us love the &#8220;AI for Science&#8221; moniker. We are excited to launch our <a href="https://www.latent.space/s/cience">Science</a> section with <a href="https://x.com/bearablylight">Melissa Du</a>, who proposed a useful taxonomy framework for thinking about how money and talent are funneling into 2-3 main approaches&#8230; and how they combine in a coherent plan for progress. By coincidence, she introduces many of our upcoming guests on the Science pod!</em></p><div><hr></div><p>We&#8217;ve witnessed the meteoric rise of LLMs over the past 5 years. Through scale alone, the models have grown from naive stochastic parrots into entities we credit with <a href="https://www-cdn.anthropic.com/bf10f64990cfda0ba858290be7b8cc6317685f47.pdf">agency</a> and <a href="https://www.forbes.com/sites/traceyfollows/2025/11/15/people-are-now-marrying-ai-inside-the-rise-of-synthetic-intimacy/">emotional depth</a>.  <a href="https://www.ama-assn.org/practice-management/digital-health/2-3-physicians-are-using-health-ai-78-2023">66% of physicians</a> use AI in the clinic; <a href="https://survey.stackoverflow.co/2025/ai">47% of software developers rely on AI coding assistants daily</a> (surprised this number isn&#8217;t  higher&#8230;). <a href="https://www.understandingai.org/p/ai-is-just-starting-to-change-the">79% of law firms</a> report AI adoption in document review. AI has nearly mastered language and humanity&#8217;s digitized knowledge.</p><p>When Dario Amodei published <a href="https://www.darioamodei.com/essay/machines-of-loving-grace">Machines of Loving Grace</a> in 2024, he promised that AI would eliminate all bodily and mental ailments, resolve economic inequality, and create material abundance. But these aren&#8217;t exclusively language problems. <strong>Curing cancer, designing new materials, and solving energy will require AI that can interface with and predict the physical world</strong>, not just reason about text. Modern day AI for science discourse largely conflates progress in language models with progress in scientific modeling more broadly. And while the former will certainly accelerate our capacity to understand the natural world, the field of scientific modeling has had its own tribulations and successes predating the launch of ChatGPT.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!G0s1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe45136d9-4361-48d6-9f74-204ec08807ef_2806x1450.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!G0s1!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe45136d9-4361-48d6-9f74-204ec08807ef_2806x1450.png 424w, https://substackcdn.com/image/fetch/$s_!G0s1!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe45136d9-4361-48d6-9f74-204ec08807ef_2806x1450.png 848w, https://substackcdn.com/image/fetch/$s_!G0s1!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe45136d9-4361-48d6-9f74-204ec08807ef_2806x1450.png 1272w, https://substackcdn.com/image/fetch/$s_!G0s1!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe45136d9-4361-48d6-9f74-204ec08807ef_2806x1450.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!G0s1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe45136d9-4361-48d6-9f74-204ec08807ef_2806x1450.png" width="724" height="373.9340659340659" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e45136d9-4361-48d6-9f74-204ec08807ef_2806x1450.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:752,&quot;width&quot;:1456,&quot;resizeWidth&quot;:724,&quot;bytes&quot;:1047608,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.latent.space/i/187321493?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe45136d9-4361-48d6-9f74-204ec08807ef_2806x1450.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!G0s1!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe45136d9-4361-48d6-9f74-204ec08807ef_2806x1450.png 424w, https://substackcdn.com/image/fetch/$s_!G0s1!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe45136d9-4361-48d6-9f74-204ec08807ef_2806x1450.png 848w, https://substackcdn.com/image/fetch/$s_!G0s1!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe45136d9-4361-48d6-9f74-204ec08807ef_2806x1450.png 1272w, https://substackcdn.com/image/fetch/$s_!G0s1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe45136d9-4361-48d6-9f74-204ec08807ef_2806x1450.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Dario himself gestures at this distinction in his manifesto. He writes that AI can accelerate the eradication of disease by &#8220;making connections between the vast amount of biological knowledge humanity possesses&#8221; and &#8220;developing better simulations that are more accurate in predicting what will happen in humans.&#8221; He&#8217;s describing two different types of AI models.</p><p>The first reviews literature, draws deep connections across studies, generates hypotheses, designs experiments, and updates its priors. It excels at reasoning, digesting large corpuses of knowledge, and keeping many ideas in working memory&#8212;precisely the areas where LLMs excel. With all due respect to the academics (I identify as one myself), we&#8217;ll call these models <strong>the scientists</strong>.</p><p>The second learns dynamics directly from data. It predicts outcomes within specific physical domains and learns structure that language alone cannot represent. We&#8217;ll call these models <strong>our simulators</strong>.</p><p>Scientists (LLMs) and simulators (domain models) are different programs within ML research that require distinct talent pools and data infrastructure, and they must work together to produce coherent models of the world. The full stack for AI-driven scientific discovery looks like this:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!raoX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec97db99-c1d3-48e4-acb5-8985dcc5de29_1496x662.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!raoX!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec97db99-c1d3-48e4-acb5-8985dcc5de29_1496x662.png 424w, https://substackcdn.com/image/fetch/$s_!raoX!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec97db99-c1d3-48e4-acb5-8985dcc5de29_1496x662.png 848w, https://substackcdn.com/image/fetch/$s_!raoX!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec97db99-c1d3-48e4-acb5-8985dcc5de29_1496x662.png 1272w, https://substackcdn.com/image/fetch/$s_!raoX!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec97db99-c1d3-48e4-acb5-8985dcc5de29_1496x662.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!raoX!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec97db99-c1d3-48e4-acb5-8985dcc5de29_1496x662.png" width="1200" height="530.7692307692307" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ec97db99-c1d3-48e4-acb5-8985dcc5de29_1496x662.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:644,&quot;width&quot;:1456,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" srcset="https://substackcdn.com/image/fetch/$s_!raoX!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec97db99-c1d3-48e4-acb5-8985dcc5de29_1496x662.png 424w, https://substackcdn.com/image/fetch/$s_!raoX!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec97db99-c1d3-48e4-acb5-8985dcc5de29_1496x662.png 848w, https://substackcdn.com/image/fetch/$s_!raoX!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec97db99-c1d3-48e4-acb5-8985dcc5de29_1496x662.png 1272w, https://substackcdn.com/image/fetch/$s_!raoX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec97db99-c1d3-48e4-acb5-8985dcc5de29_1496x662.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The capacity for LLMs to accelerate (and eventually replace) scientists cannot be overstated. OpenAI recently published a blog post demonstrating how ChatGPT could be plugged into a wet lab loop to <a href="https://openai.com/index/accelerating-biological-research-in-the-wet-lab/">accelerate a molecular cloning protocol</a>. Anthropic has rolled out a <a href="https://www.anthropic.com/news/claude-for-life-sciences">suite of features</a> for biologists that integrate Claude with existing platforms like Pubmed (paper repository), Benchling (experiment tracking), and 10x Genomics (single cell and spatial analysis).</p><p>These types of integrations are examples of giving LLMs tools for accomplishing real-world tasks, exactly the thesis undergirding the rise of agents. In these cases, OpenAI and Anthropic have provided their chatbots with hands to run wet lab experiments and access existing data platforms, but the past two years have seen the rise of magic blackboxes for search (Exa, Perplexity), document processing (Reducto), browser use (BrowserBase), etc, all of which are arguably more targeted towards agent than human use.</p><p>The blackbox tools that are necessary for LLMs to be effective in scientific discovery go beyond software. We&#8217;ll need abstractions for scientists to measure physical systems&#8211;automated laboratories, programmable in situ monitoring systems, and the like (data infrastructure). We&#8217;ll also need blackboxes for understanding and predicting the behavior of physical systems, which offer a fidelity to the world that language alone cannot capture (simulators).</p><p></p><h2><strong>Physics is simple, biology is complex</strong></h2><p>Why are simulators valuable? The core distinction between scientists and simulators, per our definition, is the reliance on text and reasoning as opposed to the reliance on domain-specific foundation models. Reasoning is sufficient when a domain has enough theoretical structure to support chain-of-thought derivation, but when theory is lacking, we require models that can learn directly from the data. The question of when this transition happens points to a deeper tension at the heart of scientific modeling: when can you derive predictions from theory and first principles, and when do you have to build models that pattern-match from empirics?</p><p>Silicon Valley loves &#8220;first-principles thinking,&#8221; and, as it happens, so do academics. Everything is derivable from first principles. Chemistry emerges from physics, biology from chemistry, cognition from biology. If you encode the fundamental laws and apply enough computation, everything can be simulated. </p><p>This is true! But unfortunately not as helpful for simulation as we&#8217;d like. Everything is atoms, but modeling atoms quickly becomes computationally intractable: </p><ul><li><p>The equations of quantum physics define how electrons interact, but our computers can only solve them on the order of <strong>tens of atoms</strong>. </p></li><li><p>The next layer up is density functional theory (DFT), an approximation for electron clouds that scales to <strong>hundreds of atoms</strong>. </p></li><li><p>Then, we replace our electron interactions altogether with force fields &#8212; the basis of classical molecular dynamics &#8212; which takes us to <strong>millions of atoms</strong>&#8230;</p></li></ul><p>Every time we&#8217;ve hit a wall of complexity, we&#8217;ve developed new ways to measure systems and new abstractions and rules that enable us to reason about them. Rule-based simulation has given us countless early successes. Numerical weather prediction extended reliable forecasts from one day to seven by relying solely on fluid dynamics. Every transistor on every chip is simulated from Maxwell&#8217;s equations before fabrication.</p><p>But theory-driven simulation only works when the system permits elegant compression. Physics discovered that you don&#8217;t need to track 10&#178;&#8309; individual molecules to predict how a gas behaves; temperature and pressure are sufficient for prediction. A handful of forces and symmetries are sufficient to parametrize the properties of gasses, the motion of planets, the behavior of circuits.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!DXTP!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0f1650a2-b3c3-4608-a93d-6cabf9f470dd_1488x486.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!DXTP!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0f1650a2-b3c3-4608-a93d-6cabf9f470dd_1488x486.png 424w, https://substackcdn.com/image/fetch/$s_!DXTP!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0f1650a2-b3c3-4608-a93d-6cabf9f470dd_1488x486.png 848w, https://substackcdn.com/image/fetch/$s_!DXTP!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0f1650a2-b3c3-4608-a93d-6cabf9f470dd_1488x486.png 1272w, https://substackcdn.com/image/fetch/$s_!DXTP!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0f1650a2-b3c3-4608-a93d-6cabf9f470dd_1488x486.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!DXTP!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0f1650a2-b3c3-4608-a93d-6cabf9f470dd_1488x486.png" width="1200" height="392.3076923076923" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0f1650a2-b3c3-4608-a93d-6cabf9f470dd_1488x486.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:476,&quot;width&quot;:1456,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" srcset="https://substackcdn.com/image/fetch/$s_!DXTP!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0f1650a2-b3c3-4608-a93d-6cabf9f470dd_1488x486.png 424w, https://substackcdn.com/image/fetch/$s_!DXTP!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0f1650a2-b3c3-4608-a93d-6cabf9f470dd_1488x486.png 848w, https://substackcdn.com/image/fetch/$s_!DXTP!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0f1650a2-b3c3-4608-a93d-6cabf9f470dd_1488x486.png 1272w, https://substackcdn.com/image/fetch/$s_!DXTP!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0f1650a2-b3c3-4608-a93d-6cabf9f470dd_1488x486.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The same is not true for biology. Or at least, we&#8217;ve yet to find an equivalent shortlist of parameters. The genome is three billion base pairs with complex regulatory logic. Expression patterns change depending on the cell cycle, tissue types, and the local chemical environment. A typical human cell contains roughly 10 billion protein molecules engaged in somewhere between 130,000 and 650,000 distinct types of protein-protein interactions. And unlike the molecules in a gas, the specific identities of the molecules matter. The specific transcription factors, regions of DNA, molecules, and interactions between them could determine whether a cell becomes cancerous. The microscopic details can't be averaged away.</p><div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;05f5c012-10e1-4a89-9dcf-be729c9be53d&quot;,&quot;duration&quot;:null}"></div><p><em>from: <a href="https://x.com/futurejurvetson/status/2017709010536042734">Steve Jurvetson</a>. Seriously&#8230; watch and realize this is happening in your body!</em></p><p></p><p>Biology has accepted certain theories&#8212;genetics, the Central Dogma, evolution&#8212;but these are descriptive, and lack the computational precision to power predictive engines. Thus, biology is traditionally taught as a dull exercise in memorization, the aggregation of never-ending <em>facts</em>, with very few unifying frameworks on which to perform inference or computation.</p><p>Chomsky, a linguist who spent his career developing the theory behind language, embodied the failure mode of theoreticians with respect to the field of linguistics. He wrote, <a href="https://www.nytimes.com/2023/03/08/opinion/noam-chomsky-chatgpt-ai.html">in criticism of the technology behind ChatGPT</a>, that the human mind is NOT &#8220;a lumbering statistical engine for pattern matching, gorging on hundreds of terabytes of data.&#8221; Maybe. But maybe the universe doesn&#8217;t owe us interpretable laws (and we are glorified pattern-matching machines after all).</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!wTTH!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ef623e2-ae70-487e-affa-3497b2e92167_1400x649.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!wTTH!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ef623e2-ae70-487e-affa-3497b2e92167_1400x649.png 424w, https://substackcdn.com/image/fetch/$s_!wTTH!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ef623e2-ae70-487e-affa-3497b2e92167_1400x649.png 848w, https://substackcdn.com/image/fetch/$s_!wTTH!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ef623e2-ae70-487e-affa-3497b2e92167_1400x649.png 1272w, https://substackcdn.com/image/fetch/$s_!wTTH!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ef623e2-ae70-487e-affa-3497b2e92167_1400x649.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!wTTH!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ef623e2-ae70-487e-affa-3497b2e92167_1400x649.png" width="1200" height="556.2857142857143" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5ef623e2-ae70-487e-affa-3497b2e92167_1400x649.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:649,&quot;width&quot;:1400,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" srcset="https://substackcdn.com/image/fetch/$s_!wTTH!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ef623e2-ae70-487e-affa-3497b2e92167_1400x649.png 424w, https://substackcdn.com/image/fetch/$s_!wTTH!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ef623e2-ae70-487e-affa-3497b2e92167_1400x649.png 848w, https://substackcdn.com/image/fetch/$s_!wTTH!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ef623e2-ae70-487e-affa-3497b2e92167_1400x649.png 1272w, https://substackcdn.com/image/fetch/$s_!wTTH!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ef623e2-ae70-487e-affa-3497b2e92167_1400x649.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>It&#8217;s underappreciated how far the humble neural network has come. After early theoretical critiques in the 1960s, neural approaches fell out of favor for nearly two decades; anyone working on machine learning was largely seen as a joke, dismissed for chasing a scientific dead end.</p><blockquote><p><em>I had a stormy graduate career, where every week we would have a shouting match. I kept doing deals where I would say, &#8216;Okay let me do neural nets for another six months and I will prove to you they work.&#8217; At the end of the six months, I would say, &#8216;Yeah, but I am almost there, give me another six months.&#8217;</em></p><p><em>&#8212; <a href="https://www.theglobeandmail.com/news/toronto/u-of-t-professor-geoffrey-hinton-hailed-as-guru-of-new-era-of-computing/article34639148/">Geoffrey Hinton, &#8220;Godfather of AI&#8221;</a></em></p></blockquote><p>The turning point came in 2012, when AlexNet, an image classification model, won an image classification benchmark known as ImageNet and became the watershed moment that convinced the broader ML community of the capacity for neural networks to scale. LLMs followed on as an even more prodigious success, exemplifying the necessity of data-driven learned simulators and launching the transformer architecture to well-deserved acclaim.</p><p></p><h2><strong>Attention is not all you need</strong></h2><p>The scaling laws transformed modeling in scientific domains as <strong>well&#8211;learned simulators are outperforming traditional physics-based methods</strong> in both accuracy and speed:</p><ul><li><p><strong>Weather forecasting</strong> relied on Numerical Weather Prediction for over 50 years&#8212;physics-based models simulating atmospheric dynamics. The European Centre for Medium-Range Weather Forecasts (ECMWF) refined this into the gold standard, and their models served as the backbone for <a href="http://weather.com">weather.com</a>, national weather services, and Google Weather. </p><ul><li><p>In 2023, Google DeepMind&#8217;s GraphCast, a graph neural network, <strong>exceeded ECMWF&#8217;s accuracy while making 10-day forecasts in under a minute</strong> on a single TPU, compared to hours on a supercomputer for traditional methods.</p></li></ul></li><li><p><strong>Protein structure prediction</strong> tells an analogous story. AlphaFold2, created in 2021, directly maps amino acid sequence to structure, incorporating insights from evolutionary history encoded in multiple sequence alignments. It has since predicted structures for over 200 million proteins, covering essentially all known sequences.</p></li><li><p><strong>Materials discovery</strong> was revolutionized when GNoME, DeepMind&#8217;s Graph Networks for Materials Exploration, discovered 2.2 million new crystal structures, a feat that previously required approximately 800 years of traditional experimental discovery.</p></li></ul><p>To be clear, none of these successes came from raw observation of data. GraphCast was trained on the output of fifty years of physics-based weather modeling. AlphaFold&#8217;s alignments encode evolutionary constraints as a biological prior. GNoME&#8217;s active learning loop uses density functional theory as the ground-truth oracle. In each case, ML learned to approximate or accelerate existing scientific knowledge; the theory came first. Moreover, progress along these alternative ML approaches isn&#8217;t necessarily bundled with the advances in ML that drove ChatGPT&#8211;the transformer architecture and its legacy. GraphCast is a graph neural network. Research has shown <a href="https://www.biorxiv.org/content/10.1101/2025.02.18.638918v1">hybrid architectures including state space models</a> to be most effective for large-scale DNA modeling. Different domains may have different inductive biases and data structures relative to language.</p><p><strong>TLDR: </strong>ChatGPT releases and Epoch evaluations are a spectacular horse race, but certainly not the only one to invest in. There&#8217;s a massive long tail of ML problems that the frontier labs (outside of DeepMind) have yet to invest in.</p><p></p><h2><strong>Slaves to the physical world</strong></h2><p>Biology is arguably where the simulator is both the most necessary and least developed. The accessibility of data in other domains is a largely solved problem. Weather had ERA5 reanalysis data&#8212;decades of global atmospheric observations, assimilated and quality-controlled, publicly available. For materials science, training data comes largely from DFT calculations, which are expensive but automatable.</p><p>But biology wet-lab data is slow, noisy, expensive, often proprietary, and has been historically impossible to translate to real world validity. Cell lines don&#8217;t reliably predict what will happen in humans and animal models fail constantly; <a href="https://pubmed.ncbi.nlm.nih.gov/36883244/">over 90% of drugs that work in mice fail in human trials</a>. Single experiments can cost millions of dollars over the course of months. Sequencing has become cheap, but sequencing is only one modality. Predicting gene expression from sequence is hard. Predicting protein function from structure is hard. Predicting drug efficacy from molecular interactions is very hard. Arguably, we don&#8217;t even know what the right data to collect looks like.</p><p>Noetik has distinguished themselves with a multimodal approach of training <a href="https://www.noetik.ai/octo">cancer world models</a> on multiplex protein staining, spatial gene expression, DNA sequencing, and structural markers. Biohub has been racing to build <a href="https://biohub.org/">diverse measurement tools across scales</a>, from individual proteins to whole organisms. Generating data across a plurality of modalities for a plurality of models is the strategy of having no strategy (and it applies to the entire field of biology).</p><p>It&#8217;s even possible that holistic theories of biology will continue to evade us. If so, progress will look less like physics and more like engineering&#8211;narrow focuses on particular diseases, particular organs, particular modalities. The work is unglamorous and the timelines are long. We remain slaves to the physical world.</p><p></p><h2><strong><s>AGI</s> AI for science timelines</strong></h2><p>So why not just wait for the LLMs to figure it out? There&#8217;s credible evidence that the big labs have invested direct effort into building AI scientists for ML research, a potential route towards recursive self improvement. But even if LLMs build or significantly accelerate the creation of accurate simulators, the scientist and simulator systems can still be distinguished on their technical basis, data requirements, and deployment timelines, which have tangible impacts on investment and policy. GPT-7 may very well have the cognitive capabilities to design digital twins that simulate human biology, but it will have been enabled by many other players already advancing the algorithms behind effective simulators and building automated data infrastructure. In the same way that ML for world models, voice, and image generation were pushed forward by ElevenLabs, Midjourney, and WorldLabs, among others, we should expect ML for science to be pushed forward by a plurality of efforts.</p><p><strong>The scientist</strong> (LLMs for reasoning and synthesis) is being built by the frontier labs.</p><p><strong>The simulator</strong> (domain-specific ML models) requires specialized architectures and domain expertise. DeepMind has done impressive work here, but it&#8217;s not their core business.</p><p><strong>Data infrastructure</strong> (automated labs, high-throughput assays, simulation pipelines) requires capital-intensive physical facilities and years of iteration.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!2Zqb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fceac9d4f-f84c-4dc2-9f9c-fa175c3dd482_1252x740.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!2Zqb!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fceac9d4f-f84c-4dc2-9f9c-fa175c3dd482_1252x740.png 424w, https://substackcdn.com/image/fetch/$s_!2Zqb!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fceac9d4f-f84c-4dc2-9f9c-fa175c3dd482_1252x740.png 848w, https://substackcdn.com/image/fetch/$s_!2Zqb!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fceac9d4f-f84c-4dc2-9f9c-fa175c3dd482_1252x740.png 1272w, https://substackcdn.com/image/fetch/$s_!2Zqb!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fceac9d4f-f84c-4dc2-9f9c-fa175c3dd482_1252x740.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!2Zqb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fceac9d4f-f84c-4dc2-9f9c-fa175c3dd482_1252x740.png" width="1252" height="740" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ceac9d4f-f84c-4dc2-9f9c-fa175c3dd482_1252x740.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:740,&quot;width&quot;:1252,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!2Zqb!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fceac9d4f-f84c-4dc2-9f9c-fa175c3dd482_1252x740.png 424w, https://substackcdn.com/image/fetch/$s_!2Zqb!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fceac9d4f-f84c-4dc2-9f9c-fa175c3dd482_1252x740.png 848w, https://substackcdn.com/image/fetch/$s_!2Zqb!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fceac9d4f-f84c-4dc2-9f9c-fa175c3dd482_1252x740.png 1272w, https://substackcdn.com/image/fetch/$s_!2Zqb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fceac9d4f-f84c-4dc2-9f9c-fa175c3dd482_1252x740.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">In 2024&#8211;2025, AI foundation model companies raised ~$111 billion&#8212;<a href="https://hai.stanford.edu/ai-index/2025-ai-index-report/economy">$31B in 2024</a> and <a href="https://news.crunchbase.com/ai/big-funding-trends-charts-eoy-2025/">$80B in 2025</a>, with <a href="https://news.crunchbase.com/venture/funding-data-third-largest-year-2025/">OpenAI and Anthropic alone capturing nearly 14%</a> of all global venture capital in 2025. Meanwhile, AI drug discovery totaled ~$7.6 billion (<a href="https://ustechtimes.com/openai-just-bet-130m-on-this-6-month-old-drug-company/">$3.8B in 2024</a>, <a href="https://www.drugpatentwatch.com/blog/how-ai-is-already-changing-drug-development/">$3.8B in 2025</a>), and AI for materials science and weather/climate together attracted roughly $500M-$1B in 2024-2025.</figcaption></figure></div><p>There are already a few companies that are betting on this thesis for AI-driven scientific discovery, but the funding landscape remains arid. <strong>Lila Sciences</strong>, backed by Flagship Pioneering, is building &#8220;AI Science Factories&#8221;&#8212;automated labs where AI designs experiments, robots execute them, and results feed directly back into model training. <strong>Periodic Labs</strong>, founded by former OpenAI and DeepMind researchers, combines AI models with automated synthesis to create new materials.</p><p>Unless Anthropic starts building protein folding models, we shouldn&#8217;t expect them to solve diseases. Unless OpenAI starts building geospatial models, we shouldn&#8217;t expect them to become frontier weather forecasters. The big labs are focused on intelligence&#8212;reasoning, long context, tool use. Domain-specific simulation and data collection are massive undertakings that lie outside their core competencies and business models.</p><p>The discourse is focused on AGI timelines and the scientist&#8217;s capacity to reason. The work that will cure diseases and discover materials is more specific, more pluralistic, and more bottlenecked by the physical world.</p><p></p><div><hr></div><p><strong><a href="https://x.com/bearablylight">Melissa Du</a> </strong>is a Research Engineer at <a href="https://www.radicalnumerics.ai/">Radical Numerics</a> and is <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;bearably light&quot;,&quot;id&quot;:3057397,&quot;type&quot;:&quot;pub&quot;,&quot;url&quot;:&quot;https://open.substack.com/pub/bearablylight&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/84ce83bd-3a1e-4345-8dc6-517c9bf7885c_468x468.png&quot;,&quot;uuid&quot;:&quot;45b28ae5-ea1b-44d4-9d0f-f79e4df4cc5a&quot;}" data-component-name="MentionToDOM"></span> on <a href="https://x.com/bearablylight">X</a> and on <a href="https://bearablylight.substack.com/">Substack</a>. Give her a follow!</p><p></p>]]></content:encoded></item></channel></rss>