Key Moments

AI and the Future of Law: The 10 Year "Overnight" Success Story

Y CombinatorY Combinator
Science & Technology5 min read18 min video
Nov 15, 2023|38,616 views|1,061|44
Save to Pod
TL;DR

Casetext's AI legal tool, co-developed with GPT-4, condensed weeks of work into minutes, leading to a $650M acquisition, but its decade-long journey faced significant product-market fit challenges.

Key Insights

1

Casetext, originally a crowdsourced law library inspired by 'Wikipedia meets Reddit,' spent 10 years iterating before achieving significant success.

2

Early product-market fit attempts with enterprise firms by offering document analysis for $50,000-$150,000 per client failed to scale effectively.

3

Access to OpenAI's GPT-3 and especially GPT-4 was the critical breakthrough moment, enabling the creation of their 'mega product,' CoCounsel.

4

The 'golden demo' for Casetext's AI involved showing lawyers how 4-5 days of work (e.g., reviewing a million documents) could be done in minutes, eliciting a strong 'Okay, I get it' reaction.

5

The AI's capability to understand and act on complex legal information, even flagging sarcasm in Enron-era emails, demonstrated its advanced functionality.

6

Current LLM startups are compared to early cloud computing, with a base layer (models like GPT-4), a middle layer (tools like LangChain), and an application layer (end-user products).

The 10-year 'overnight' success of Casetext

Casetext's journey to a $650 million acquisition is framed as a decade-long "overnight success." Founded in 2013, it began as a crowdsourced law library, akin to "Wikipedia meets Reddit" for legal professionals. The core vision was to apply cutting-edge technology to the legal field, transforming arduous legal work, which could take weeks, into tasks completed in mere minutes or hours. This transformation, particularly amplified by recent advancements in large language models (LLMs), ultimately led to significant market traction and a substantial acquisition. The story highlights the common entrepreneurial experience of navigating the "trough of sorrow" and "wiggles of false hope" before finding true product-market fit.

Early struggles with product-market fit

In its early years, Casetext faced challenges in identifying and capturing market demand. An initial product developed with machine learning could ingest documents, suggest relevant reading, and identify missing information for law firms. This attracted significant interest, leading to pilot programs with enterprise clients paying between $50,000 and $150,000. However, the strategy of scaling through a large sales force targeting similar firms proved unsustainable, as not all firms were ready to adopt new technology quickly. Later, Casetext shifted focus to smaller law firms, where the need for efficiency due to limited staff resources created a stronger value proposition. This segment experienced rapid growth, with thousands of new customers daily, but even this channel eventually saturated, requiring further adaptation.

The breakthrough enabled by large language models

A pivotal moment for Casetext was gaining early access to OpenAI's GPT-4 model, approximately six to seven months before its public release. While Casetext had been experimenting with LLMs for years, including applications based on the BERT paper, GPT-4 provided unprecedented capabilities. This allowed them to build their flagship product, CoCounsel, an AI assistant capable of performing complex legal tasks with human-level understanding but at superhuman speed. The impact was immediate and profound: clients who had previously taken 9-18 months to make decisions began signing contracts within a month. This marked a clear realization of product-market fit, evidenced not only by rapidly increasing revenue, projected to triple within the year, but also by the visibly enthusiastic reactions of clients interacting with the product.

The power of the 'golden demo'

A recurring pattern identified in successful LLM-based startups is the effectiveness of a compelling "golden demo." Casetext's demo focused on showcasing the dramatic reduction in time for critical legal tasks. For instance, it could ingest and analyze a million documents, identifying relevant information and potential fraud indicators (like sarcasm in Enron-era emails) – work that would typically take a lawyer several days – within minutes. This tangible demonstration of compressing potentially days of work into mere minutes fundamentally shifted potential clients' understanding and acceptance of AI's utility in law. The "Okay, I get it" reaction from lawyers validated the demo's impact, proving that a clear, powerful demonstration of value was key to acquisition.

Building a robust AI product beyond the base model

While models like GPT-4 provide foundational capabilities, translating them into a usable, scalable product for legal professionals requires significant engineering. Casetext invested heavily in building the infrastructure to handle millions of documents, ensure accuracy, and mitigate "hallucinations" (inaccurate AI-generated information). They developed capabilities for large-scale document review, automated legal research, and contract analysis, addressing the "last mile" challenges. This process involved extensive internal development to ensure reliability and accuracy when users interact with the AI, suggesting that the development of supporting technologies and services around core LLMs presents substantial business opportunities, much like the ecosystem that grew around cloud computing.

LLMs as a new foundational layer

The advancement of LLMs like GPT-4 is seen as a new base layer of capability, comparable to the advent of cloud computing. This base layer enables a rich ecosystem of technologies, including platforms that help developers leverage LLMs more effectively (e.g., LangChain) and application layers that provide specific end-user solutions. The comparison to the cloud ecosystem suggests that many companies will integrate LLM capabilities to varying degrees, fostering innovation and creating new markets. The potential for these models to perform tasks at the level of a postgraduate professional, understanding and writing with nuance and logic, indicates a significant underhype, with vast opportunities for those who can harness this technology effectively.

The transformative impact on access to justice

The profound implications of this technology extend to critical areas like access to justice. For organizations like the California Innocence Project, faced with thousands of complex case files and limited resources, AI can drastically reduce review backlogs. Historically, these projects have had multi-year backlogs due to the sheer volume of manual review required for police reports, transcripts, and witness statements. AI capable of processing thousands of pages in minutes can shorten evaluation times from years to months or even one year, potentially freeing individuals unjustly incarcerated. This application underscores the life-changing potential of compressing labor-intensive, drudgery-filled work into efficient, scalable technological solutions.

An invitation to the next wave of innovation

The conversation concludes with an optimistic outlook on the current technological landscape, urging potential entrepreneurs to seize the moment. It is emphasized that there has likely never been a better time to start a company, particularly in the AI space. The perceived "underhyped" nature of technologies like GPT suggests significant untapped potential and "white space" for innovation. Founders are encouraged to move beyond casual hacking and seriously consider building companies that leverage these advanced AI capabilities. The potential rewards for developing and applying this technology are projected to be massive, positioning the current era as a transformative ride for those willing to embark on it.

Common Questions

CaseText combined Jake Heller's legal expertise with advanced AI technology, specifically large language models like GPT-4. They focused on solving the painstaking work of legal research, reducing weeks of effort to minutes, which led to significant revenue and acquisition.

Topics

Mentioned in this video

More from Y Combinator

View all 562 summaries

Found this useful? Build your knowledge library

Get AI-powered summaries of any YouTube video, podcast, or article in seconds. Save them to your personal pods and access them anytime.

Try Summify free