Welcome to High Signal
The Podcast for Data Science, AI, and Machine Learning Professionals.
The 100-Year Lead: What Baseball Teaches Us About the Future of AI
Chris Fonnesbeck, veteran analyst for the Yankees and Mets and creator of the open-source Bayesian modeling library PyMC, joins to unpack why baseball has been a leading indicator for data science and analytics for over a century, and why builders and AI leaders need to pay attention now. The reason it has led is simple: huge incentives and a culture that treats decisions as quantifiable. With wins worth about eight to ten million dollars apiece and front offices built around probabilistic reasoning, baseball has had every reason to push the methods further and faster than industry. The skillset and culture that built this lead is what AI teams now need to adopt more of: probabilistic thinking, hierarchical models, integrating expert judgment, reasoning carefully under uncertainty, and increasingly causal inference. The conversation traces the throughline from those early statistical innovations to the decisions driving multi-million dollar contracts today, with concrete patterns AI builders can take back to their own work: how to handle small samples and high stakes, why outcomes are the wrong thing to measure, what changes when you push uncertainty all the way through your model, and why robust causal inference needs to be the next frontier.
Why AI Won't Fix Your Data Culture, It Will Only Amplify It (And What To Do About It)
Noah Bruegmann, President of Data CRT, joins High Signal to discuss how to move your data function from a cost center to a strategic "value center". He explains how AI amplifies your existing data culture, the importance of "no-assistance" reporting, and how rebranding documentation as "Context" can finally secure executive buy-in. Drawing on 15 years of experience spanning trading floors and Silicon Valley startups, Noah argues that for too long, data teams have been submerged under an "iceberg" of invisible data preparation. He details how the arrival of LLMs and agentic tools is fundamentally shifting this landscape, automating technical drudgery and allowing data professionals to transition into what he calls "Jack Ryan" mode: acting as high-level intelligence analysts rather than mere number crunchers.
Engineered Intelligence and The Data Science Problem in AI
Jordan Morrow, SVP of Data & AI Transformation at AgileOne and the "Godfather of Data Literacy," joins High Signal to discuss the shift from being "data-driven" to becoming "AI-enabled." Jordan warns that many organizations are walking into the same traps that derailed the data science era a decade ago: prioritizing expensive tooling and hype over the cultural change and literacy required to actually move the needle. The pattern is already visible: enterprise AI projects are failing at around 90%, while individuals doing shadow AI are quietly thriving. The catch is that shadow AI brings its own risks, with people feeding sensitive data into public models without governance. He argues that because AI is probabilistic rather than deterministic, the bottleneck for success has shifted from technical coding ability to a user's ability to apply "Engineered Intelligence," a blend of machine capability and human emotional intelligence.
AI and the Judgment Problem in Data Science
Dawn Woodward (LinkedIn), Andrés Bucchi (LATAM Airlines), and Jeremy Hermann (Delphina) join High Signal to examine how data science architecture is transforming in the AI era. The panel discusses shifting from static dashboards to conversational interfaces, emphasizing that foundational data practices—strict cataloging, verifiable outputs, and unified data sources—have become critical bottlenecks rather than optional governance measures. We dig into semantic ambiguity, upstream validation, AB testing platform limits, security architectures for AI agents, the shifting role of the analyst toward verification, and where LLMs still fall short on causal reasoning.
Beyond Online Experimentation: Generative Software That Optimizes Itself
Martin Tingley, Head of Windows Experimentation at Microsoft and former experimentation leader at Netflix, discusses why humans are the bottleneck in experimentation and how a five-level maturity framework points the way toward self-optimizing software.
Duolingo and the Future of Personalized Education with AI
Bozena Pajak, VP of Learning and Curriculum at Duolingo, discusses how AI has evolved from personalized difficulty models to generative AI characters enabling conversational language practice. The episode covers how AI addresses speaking anxiety—a primary obstacle in language learning—and explores agentic workflows for content scaling and the shift toward thematic personalization.
Why Your AI Product Will Be Obsolete in Six Months (And What To Do About It)
Benn Stancil, writer and co-founder of Mode, joins High Signal to ask some uncomfortable questions about the current AI moment. Is now actually a terrible time to start a company? If the tools you build on today are obsolete in six months, at what point does the head start stop mattering? Is all that context engineering you're doing a waste of time, destined to go the way of Boolean search syntax in the 90s?
The Post Coding-Era: What Happens When AI Writes the System?
Nicholas Moy, former Head of Research at Windsurf & now at Google DeepMind, joins High Signal to discuss the shift from "co-driving" to a truly "agentic" era of development. We discuss Windsurf's journey from early prototypes that struggled with compounding errors to the successful launch of their agentic coding product. Nick explains that building a startup in the current climate requires a strategy of "disrupting yourself" to avoid the innovator’s dilemma; companies must be ready to pivot as soon as a new frontier model makes previously impossible features viable. He argues that traditional technical moats are increasingly fragile, and true defensibility now comes from real-world usage data, brand reputation, and a deep intuition for what users need at the frontier of these capabilities.
.png?v=ffb19b24)
Why Data Governance In Your Org is Broken (And How to Fix It)
Cara Dailey, VP and Head of Data Strategy at Early Warning (the parent company of Zelle), joins High Signal to discuss the evolution of high-stakes data leadership and governance. From her early work in online advertising at DoubleClick to shaping data strategy at Nike and holding Chief Data Officer roles at Bank of the West and T. Rowe Price, Cara has seen every iteration of the data leader’s role. Now, she’s navigating her 'product era'—shaping the data strategy for Early Warning's Decisions Intelligence business, where she leverages rich financial data and data science to drive fraud monitoring and modeling. In this episode, Cara shares her pragmatic 'progress over perfection' approach to governance, why she’s abandoning monolithic platforms in favor of incremental data products, and her 80/20 rule for balancing operational rigor with innovation. We also discuss why 'loving' data isn't enough—you have to actually 'take care' of it—and why AI is finally shining a spotlight on the often-neglected fundamentals of data stewardship and conversational BI.
The AI Paradox: Why Your Data Team’s Workload is About to Explode
Chris Child, VP of Product, Data Engineering at Snowflake, joins High Signal to deliver a new playbook for data leaders based on his recent MIT report, revealing why AI is paradoxically creating more work for data teams, not less. He explains how the function is undergoing a forced evolution from back-office “plumbing” to the strategic core of the enterprise, determining whether AI initiatives succeed or fail. The conversation maps the new skills and organizational structures required to navigate this shift. We dig into why off-the-shelf LLMs consistently fail to generate useful SQL without a semantic layer to provide business context, and how the most effective data engineers must now operate like product managers to solve business problems. Chris provides a clear framework on the shift from writing code to managing a portfolio of AI agents, why solving for AI risk is an extension of existing data governance, and the counterintuitive strategy of moving slowly on foundations to unlock rapid, production-grade deployment.
Why AI Adoption Fails: A Behavioral Framework for AI Implementation
Lis Costa of the Behavioral Insights Team returns to High Signal to deliver a critical behavioral science playbook for the AI era focused on human and business impact. We discuss why the potential of AI can only be fulfilled by understanding a single bottleneck: human behavior. The conversation reveals why leaders must intervene now to prevent temporary adoption patterns from calcifying into permanent organizational norms, the QWERTY Effect, and how to move organizations past simply automating drudgery to achieving deep integration. We dig into why AI adoption is fundamentally a behavioral challenge, providing a diagnostic framework for leaders to identify stalled progress using the Motivation-Capability-Trust triad. Lis explains how to reframe AI deployment by leveraging Loss Aversion to bypass employee skepticism, and how to design workflows that improve human reasoning rather than replace it. The conversation provides clear guidance on intentional task offloading, the power of using AI to stress-test decisions, and why sanctioning employee experimentation is essential to discovering high-value use cases.
From Context Engineering to AI Agent Harnesses: The New Software Discipline
Lance Martin of LangChain joins High Signal to outline a new playbook for engineering in the AI era, where the ground is constantly shifting under the feet of builders. He explains how the exponential improvement of foundation models is forcing a complete rethink of how software is built, revealing why top products from Claude Code to Manus are in a constant state of re-architecture simply to keep up. We dig into why the old rules of ML engineering no longer apply, and how Rich Sutton's "bitter lesson" dictates that simple, adaptable systems are the only ones that will survive. The conversation provides a clear framework for leaders on the critical new disciplines of context engineering to manage cost and reliability, the architectural power of the "agent harness" to expand capabilities without adding complexity, and why the most effective evaluation of these new systems is shifting away from static benchmarks and towards a dynamic model of in-app user feedback.
Paras Doshi on Why Your Data Team Doesn't Have a Seat at the Table (And How to Earn It)
Paras Doshi (Head of Data, Opendoor; former data leader at Amazon) joins High Signal to unpack the playbook for building an indispensable data function. He shares his experience tackling the classic scaling challenge of fragmented data at Opendoor, where rapid growth led to inconsistent metrics across the business, and turning the data function into a centralized strategic asset. We dive deep into how to earn a true seat at the table, why he believes AI is creating the "100x individual contributor," and how the principles of agency, autonomy, and adaptability are the new essentials for data careers. The conversation also explores the pragmatic divide between batch and real-time ML, how to identify a truly data-led company, and why leaders must shield their top talent to unlock disproportionate impact.
.png&w=384&q=75&v=6f82e149)
Gen AI's True Cost: Why Today's Wins Are Tomorrow's Debts
Vishnu Ram Venkataraman (Generative AI Executive & Entrepreneur; former AI Leader at Credit Karma and Intuit) joins High Signal to unpack the true cost of generative AI. Having scaled AI solutions impacting over 140 million users, Vishnu reveals why the ease of shipping Gen AI prototypes often masks significant operational and engineering debts, challenging the conventional wisdom of rapid deployment.
Sergey Fogelson on How Data-Driven Growth Redefined a Media Giant
Sergey Fogelson (VP of Data Science, Televisa Univision) joins High Signal to reveal how the world’s largest Spanish-language media company built a sophisticated data engine from the ground up. This transformation fueled a tenfold expansion of its digital streaming business by redefining how the company connects with 300 million viewers worldwide. We dig into the journey from basic data unification to building production-ready recommendation engines, how his team uses embeddings on user behavior to uncover surprising connections in content consumption, and the trade-offs between investing in internal data tools versus direct revenue-driving products.
.png&w=384&q=75&v=b0a10f78)
Rebuilding an Airline for the 21st Century: LATAM's Data-Driven Transformation
Andres Bucchi (Chief Data Officer, LATAM Airlines) joins High Signal to unpack how a century-old airline reinvented itself with data and AI—and how that transformation is unlocking value from fuel efficiency to fraud detection. LATAM has built a massive data operation, experimenting across everything from pricing to operations, while customers benefit from a more reliable and secure travel experience. We dig into how LATAM fostered an experimentation culture, why existing data infrastructure is a critical asset, and how the biggest bottleneck in AI adoption isn't the technology itself, but human decision-making. The conversation also looks ahead to the future of generative AI as a software engineering problem, and the organizational changes needed to unlock its full potential.
Tomasz Tunguz on Why a Trillion Dollars of Market Cap Is Up for Grabs (and How AI Teams Will Win It)
Tomasz Tunguz (Theory Ventures) joins High Signal to unpack why a trillion dollars of market cap is up for grabs as AI reshapes enterprise software. He explains why workflows are now changing faster than packaged software can keep up, how “liquid software” is redefining CRM and marketing automation, and why background agents will require a new kind of “agent inbox.” We discuss the compounding errors that arise when tools are chained too finely, the hidden AI technical debt accumulating in today’s systems, and why modular stacks—mixing local and cloud models—will beat monolithic apps. The conversation also surfaces early memory architectures, what breaks when one IC manages 100 agents, and how these shifts change the real bottlenecks in scaling AI.
Why Great Data Still Leads to Bad Decisions (And How to Fix It)
Amy Edmondson (Harvard Business School) and Mike Luca (Johns Hopkins) join High Signal to unpack what actually drives good decisions in data‑rich organizations. Using contrasts like the Bay of Pigs vs. the Cuban Missile Crisis and product cases such as Airbnb’s work on measuring discrimination, they show how decision quality tracks conversation quality—framing options, surfacing uncertainty, and challenging assumptions. We cover common failure modes (correlation vs. causation, anchoring, hierarchy, false precision), practical meeting designs that raise the signal, and where algorithms and LLMs help or hinder human judgment.
Daragh Sibley on Incentives, Accountability, and the Data Leader’s Dilemma
Daragh Sibley, Chief Algorithms Officer at Literati and former data-science leader at Stitch Fix, joins High Signal to unpack how machine-learning moves from slide-deck promise to bottom-line impact. He walks through his shift from academic research on how kids learn to read to owning inventory and personalization algorithms that decide which five books land in every child’s box. We dig into the moment a data leader stops advising and starts owning P&L-critical calls, why some problems deserve simple analytics while others need high-dimensional models, and how to design workflows where human judgment and algorithmic predictions share accountability. Along the way we talk incentive design, balancing exploration and exploitation in inventory, and measuring success in dollars—not dashboards.
Defaults, Decisions, and Dynamic Systems: Behavioral Science Meets AI
HomeEpisodes Subscribe Episode 19 Defaults, Decisions, and Dynamic Systems: Behavioral Science Meets AI Lis Costa, Chief of Innovation and Partnerships at the Behavioural Insights Team, joins High Signal to explore how behavioral science is reshaping public policy, digital platforms, and machine learning. She explains how defaults influence behavior at scale, why personalization and chatbots are unlocking new kinds of interventions, and what happens when AI systems meet real-world complexity. We also discuss the limits of nudging, the promise of boosting, and why building for human decision-making requires more than just good models.
Sudarshan Seshadri on High-Stakes AI Systems and the Cost of Getting It Wrong
Sudarshan Seshadri—VP of AI, Data Science, and Foundations Engineering at Alto Pharmacy—joins us to explore what it takes to build high-stakes AI systems that people can actually trust. He shares lessons from deploying machine learning and LLMs in healthcare, where speed, safety, and uncertainty must be carefully balanced. We talk about designing AI to support pharmacist judgment, the shift from bottlenecks to decision backbones, and why great data leaders are really architects of how irreversible decisions get made.
The Incentive Problem in Shipping AI Products — and How to Change It
Roberto Medri, VP of Data Science at Instagram, explains why most experiments fail, how misaligned incentives warp product development, and what it takes to drive real impact with data science. He shares what teams get wrong about launches, why ego gets in the way of learning, and how Instagram turned Reels from a struggling product into a global success. A candid look at product, data, and decision-making inside one of the world’s most influential platforms.
How Human-Centered AI Actually Gets Built
Fei-Fei Li—co-director of Stanford’s Human-Centered AI Institute and one of the most respected voices in the field—reflects on AI’s evolution from the early days of ImageNet to the rise of foundation models. She explains why spatial intelligence may be the next major shift, how human-centered design applies in practice, and why AI should be understood as a civilizational technology—one that shapes individuals, communities, and society at large.
 (1).jpg?v=88640dbe)
Why Good Metrics Still Lead to Bad Decisions — and How to Fix It
Eoin O'Mahony—data science partner at Lightspeed, former Uber science lead, and one of the early architects of the system that kept NYC’s Citi Bikes available across the city—argues that positive metrics are meaningless if you don’t understand the mechanism behind them. At Uber, he was careful to make sure his launches both looked good on paper and made sense in practice. Now in venture, he’s applying that same rigor to unstructured data—using GenAI to scale a kind of work that’s long resisted systematization.
Why Most Companies Aren't AI Ready
Barr Moses—co-founder and CEO of Monte Carlo—thinks we’re headed for an AI reckoning. Companies are building fast, but most are still managing data like it’s 2015. In this episode, she shares high-stakes failure stories (like a $100M schema change), explains why full-stack observability is becoming essential, and breaks down how LLM agents are already transforming data debugging. From culture to tooling, this is a sharp look at what real AI readiness requires—and why so few teams have it.
The End of Programming As We Know It
Tim O’Reilly—founder of O’Reilly Media and one of the most influential voices in tech—argues we’re not witnessing the end of programming, but the beginning of something far bigger. He draws on past computing revolutions to explore how AI is reshaping what it means to build software, why real breakthroughs come from the edge—not incumbents—and what it takes to learn, teach, and build responsibly in the age of AI.
Your Machine Learning Solves The Wrong Problem
Stefan Wager—Professor at Stanford and expert on causal machine learning—has worked with leading tech companies including Dropbox, Facebook, Google, and Uber. He challenges the widespread assumption that better predictions mean better decisions. Traditional machine learning excels at prediction, but is prediction really what your business needs? Stefan explores why predictive models alone often fail to answer critical “what-if” questions, how causal machine learning bridges this gap, and provides practical advice for how you can start applying causal ML at work.
What Comes After Code? The Role of Engineers in an AI-Driven Future
Peter Wang—Chief AI Officer at Anaconda and a driving force behind PyData—challenges conventional thinking about AI’s role in software development. As AI reshapes engineering, are we moving beyond writing code to orchestrating intelligence? Peter explores why companies are fixated on models instead of integration, how AI is breaking traditional software workflows, and what this shift means for open source. He also shares insights on the evolving role of engineers, the commoditization of AI models, and the deeper questions we should be asking about the future of software.
AI Won't Save You But Data Intelligence Will
Ari Kaplan—Global Head of Evangelism at Databricks and a pioneer in sports analytics—explains why businesses fixated on AI often overlook the real advantage: making better decisions with their own data. He shares lessons from his work building analytics teams for Major League Baseball, advising McLaren’s F1 strategy, and helping companies apply AI where it actually works—without falling into hype-driven traps.
.png&w=384&q=75&v=f52203fb)
Why 90% of Data Science Fails—And How to Fix It
Eric Colson—former Chief Algorithms Officer at Stitch Fix and VP of Data Science and Machine Learning at Netflix—explains why most companies fail to fully leverage their data science teams. Drawing on his experience leading data functions at top tech companies, he shares how organizations can move beyond treating data science as a support function and instead empower data scientists to drive strategic impact through experimentation, iteration, and algorithmic decision-making.
From Zero to Scale: Lessons from Airbnb and Beyond
Elena Grewal—former Head of Data Science at Airbnb, political consultant, professor at Yale, and ice cream shop owner—shares her journey of building data teams that scale across vastly different contexts. Drawing on her experiences in tech, consulting, and brick-and-mortar, Elena offers practical lessons on leadership, trust, and experimentation.
.png&w=384&q=75&v=f4a5b4f4)
What Lies Beyond Machine Learning and AI: Decision Systems and the Future of Data Teams
In this episode of High Signal, Chris Wiggins—Chief Data Scientist at The New York Times and Professor at Columbia University—discusses moving beyond machine learning to build robust decision systems that drive real-world outcomes. Drawing on his experience scaling data science teams, Chris explores the shift from prediction to prescription, the role of interventions in understanding causality, and what it takes to integrate data science into large organizations.
.png&w=384&q=75&v=05535c64)
What Happens to Data Science in the Age of AI?
In this episode of High Signal, Hilary Mason—renowned data scientist, entrepreneur, and co-founder of Hidden Door—shares her unique insights into the evolving world of data science and generative AI. Drawing from her pioneering work at Fast Forward Labs, Bitly, and Hidden Door, Hilary explores how creativity, judgment, and empathy are reshaping the data landscape.
Data Science Meets Management: Teamwork, Experimentation, and Decision-Making
Harvard Business School's Chiara Farronato discusses how digital platforms like Airbnb and Uber have transformed industries. She explores the challenges of fostering collaboration between managers and data scientists, bridging communication gaps, and building data-driven cultures. Chiara also delves into the complexities of managing peer-to-peer marketplaces and the evolving role of data in decision-making. This episode offers key insights for business leaders working with technical teams and navigating platform-based innovation.
.png&w=384&q=75&v=dc91f0ce)
The Hard Truth About Building AI Systems and What Most Leaders Miss About AI
In this episode of High Signal, Gabriel Weintraub (the Amman Professor of Operations, Information, and Technology at Stanford Graduate School of Business), brings his expertise in market design, data science, and operations, enriched by his experience with global platforms like Uber and Mercado Libre, to a conversation that spans practical strategies, cultural insights, and global perspectives on data and AI.
.png&w=384&q=75&v=280b19f9)
Ramesh Johari on How to Build an Experimentation Machine and Where Most Go Wrong
Ramesh Johari (Stanford, Uber, Airbnb, and more) explores the art and science of online experimentation, especially in the context of marketplaces and tech companies. Ramesh shares insights on how organizations evolve from basic experimentation practices to becoming fast, adaptive, and self learning organizations. We dive into challenges like the risk aversion trap, the importance of learning from negative results, and how generative AI is reshaping the experimentation landscape. We also talk about common failure modes and the types of things you're probably doing wrong, along with strategies to avoid these pitfalls. Plus, we discussed the role of incentives, the necessity of data driven decision making, and what it means to experiment in high stakes environments.
.png&w=384&q=75&v=cfb1b79b)
Fooling Yourself Less: The Art of Statistical Thinking in AI
Columbia University's Andrew Gelman discusses the practical side of statistics and data science. He explores the importance of high-quality data, computational skills, and using simulation to avoid misleading results. Andrew dives into real-world applications like election predictions and highlights causal inference’s critical role in decision-making. This episode offers valuable insights for data practitioners and anyone interested in how statistics shapes our world.
.png&w=384&q=75&v=9d9259c6)
AI at Planetary Scale: What’s Next for Machine Learning?
UC Berkeley's Michael Jordan on the future of machine learning as it extends to a planetary scale in
