Epoch AI
October 27, 2025

AI can learn logic. But can it learn folklore knowledge? - Svetlana Jitomirskaya

Mathematical physicist Svetlana Jitomirskaya (UC Berkeley) explores the frontier where AI meets abstract mathematics, questioning if large language models can transcend logic and grasp the unwritten, intuitive "folklore knowledge" that defines expert human reasoning.

The Folklore Knowledge Gauntlet

  • "In order to solve my problem, the machine would really need to argue in a way that is not even written in any paper, although maybe understood by some people in the field."
  • "It is not a very difficult problem for someone who has certain knowledge, but this knowledge is not widespread... This is kind of a little bit of a folklore knowledge."

Svetlana submitted a problem to an AI challenge that is simple for a knowledgeable grad student but uniquely difficult for a machine. The problem’s solution relies on implicit, unwritten expertise—the kind of intuition experts share but don't publish. Current AI, trained on existing literature, has "no clue" how to approach it. She predicts it could take 10-20 years for AI to crack this type of reasoning.

From Logic Engine to Creative Partner

  • "I always thought that they were just regurgitating, but they developed logic right now... But how do you train them to be creative? I have no idea about human creativity, where it comes from."

Jitomirskaya admits she was wrong about LLMs; they have learned to extrapolate key ideas and demonstrate logic, not just repeat information. However, she draws a sharp line between logic and true creativity—the ability to try something completely new. While AI can now automate complex arguments and computations, the spark of human intuition, which can form abstract patterns from just two or three examples, remains a mysterious and unconquered frontier.

The New Job of a Mathematician

  • "The work of mathematicians will become kind of more creative, with less time spent on routine because this would be able to be delegated to the machines."

AI won’t make mathematicians obsolete; it will change their job description. By automating routine arguments and calculations, AI will free up human intellect for higher-level creative tasks. Her biggest hope is for a future where all mathematical papers are formally verified using tools like Lean, an automated process that would eliminate errors and shift the role of peer reviewers from verifying correctness to judging novelty and importance. An automatic translator from written text to Lean is seen as only a "couple of years away."

Key Takeaways:

  • Even if AI surpasses human ability, Jitomirskaya suggests math may become like a sport—we still run, even though cars are faster. The future of the field isn't about replacement, but a re-focus on creativity, problem formulation, and verification.
  • Folklore Knowledge is AI’s Next Frontier. The true test for advanced AI in abstract fields is not solving problems from a textbook but acquiring the unwritten, intuitive knowledge that experts possess.
  • Automated Proof Verification Will Reshape Research. Within years, tools like Lean, powered by AI translators, will create a verifiable database of all mathematics, fundamentally changing how papers are published and refereed.
  • Human + Machine is the New Paradigm. AI will become an indispensable assistant, automating routine work and pushing mathematicians to focus on what humans still do best: true creativity and formulating entirely new models.

For further insights and discussions, watch the full podcast: Link

This episode explores the collision of AI and advanced mathematics, questioning whether AI's newfound logical capabilities can ever replicate the "folklore knowledge" and abstract creativity that drive human discovery.

A Mathematician's Perspective on AI

The conversation features Svetlana Jitomirskaya, a mathematical physicist at UC Berkeley specializing in spectral theory. Jitomirskaya explains her presence at the AI event stems from a mix of fascination with AI's potential in mathematics and a professional concern about its long-term impact on her field. Her perspective provides a grounded, expert view on the current capabilities and future trajectory of AI in a domain built on pure logic and abstract reasoning.

The "Folklore Knowledge" Problem

  • Jitomirskaya submitted a problem designed to test AI's limits, rooted in an interplay of number theory and spectral theory. The problem's core challenge is that its solution requires "folklore knowledge"—a term for the unwritten, intuitive understanding and non-standard techniques shared among experts in a niche field but absent from formal literature. This type of knowledge is a significant hurdle for current AI models trained on existing text and data.
  • Jitomirskaya notes that the problem is not exceptionally difficult for a human expert with the right background.
  • She states, "This knowledge is not in the literature. This is kind of a little bit of a folklore knowledge."
  • Early tests on simpler versions of the problem showed the AI had "no clue," highlighting its current inability to reason beyond its training data.

Strategic Implication: For Crypto AI researchers, this "folklore knowledge" gap is a critical frontier. It parallels the challenge of building AI agents that can navigate the unwritten rules and emergent social dynamics of DAOs or DeFi protocols, where expert intuition often outweighs documented information.

From Skepticism to Surprise

Despite her skepticism, Jitomirskaya recounts a recent, powerful experience where an AI tool dramatically accelerated her work. She was impressed when the model executed lengthy, complex arguments and computations almost instantly—a task she had been avoiding due to its tedious nature. This moment marked a significant shift in her perception, moving her from a cautious observer to an active user.

Actionable Insight: Jitomirskaya's rapid shift from skepticism to adoption demonstrates the non-linear pace of AI advancement. Investors should recognize that expert opinions on AI's limitations can become outdated with a single model update, signaling a volatile but opportunity-rich environment where breakthroughs can emerge unexpectedly.

The Shifting Role of the Mathematician

Jitomirskaya predicts that AI will fundamentally reshape the field of mathematics. She anticipates that AI will automate routine and analogical work, potentially reducing the number of professional mathematicians. However, this shift will elevate the importance of human creativity, freeing researchers from tedious tasks to focus on more profound, innovative thinking.

Crypto AI Parallel: This trend mirrors the evolution of smart contract development and auditing. As AI tools increasingly handle routine code verification and bug detection, the most valuable human input will shift toward novel mechanism design, economic modeling, and architecting complex, multi-agent systems.

Can AI Learn Creativity?

Jitomirskaya admits she was wrong to assume Large Language Models were merely "regurgitating" information, acknowledging they have now developed genuine logical capabilities. However, she draws a sharp distinction between this logic and human creativity—the ability to form abstract patterns from very few examples or to pursue a path no one has tried before.

  • She questions the source of human creativity and how it could possibly be trained into a machine.
  • "How would AI try something that nobody has tried, right? And that's creativity, but who knows."

Research Insight: This distinction between learned logic and innate creativity is a central challenge for AGI development. For decentralized systems, it raises the question of whether an AI can be a true autonomous agent, capable of inventing novel governance proposals or economic strategies, rather than just optimizing existing ones.

The Future of Verifiable Proofs with Lean

Jitomirskaya expresses great hope for AI's role in formal verification, specifically with Lean, a proof assistant that allows mathematical statements to be formally checked for correctness by a computer. Her vision is a future where all mathematical papers are submitted with a Lean verification, ensuring their absolute correctness.

  • The current bottleneck is the immense effort required to translate human-written proofs into Lean's formal language.
  • She believes an automatic AI translator is only a "couple of years away," which would revolutionize the field by making formal verification standard practice.

Strategic Implication: An AI that can translate natural language or standard code into a formally verifiable format would be a monumental breakthrough for blockchain security. Such a tool could drastically reduce smart contract exploits, providing a level of assurance that is currently difficult and expensive to achieve.

The Value of Inhuman Proofs

The discussion touches on a philosophical question: If an AI were to solve a major problem like the Riemann Hypothesis but produce a proof too complex for any human to understand, is it still valuable mathematics?

  • Jitomirskaya compares this scenario to existing computer-assisted proofs, which are mathematical proofs that rely on extensive computations that a human cannot perform by hand.
  • While these proofs lack the elegance of a "proof from the book," they are accepted by the mathematical community. An AI-generated proof would fall into a similar category.

Predictions and Advice for the AI Era

  • Timeline: She expects her "folklore knowledge" problem to withstand AI for more than 10, perhaps 20, years.
  • Impact Scale (0-10):
    • Change to math research: 5/10 (significant, but not total replacement).
    • Change to the world: 10+/10 (exceeding the Industrial Revolution).
  • Advice: She urges students to learn the fundamentals "the old-fashioned way" but to embrace AI as a powerful assistant for experimentation, much like computers have been used for decades.

Investor Takeaway: The stark difference between her impact ratings for a specialized field (math) and the world at large is telling. It suggests that while AI may not fully automate deep expertise in the near term, its broad societal and economic impact will be transformative, creating immense market opportunities far beyond niche applications.

Math as a Sport in a Post-AI World

When asked what she would do if an AI could perform all mathematical tasks, including creative ones, Jitomirskaya speculates that humans would continue doing math for its own sake. She compares it to chess or running—activities humans pursue despite being outperformed by machines or animals. The nature of the field might simply evolve to a higher level of abstraction, such as "creating models that create new models." Her overall outlook on this progress is highly optimistic, rating it an 8 out of 10.

Conclusion

This discussion reveals that while AI is rapidly mastering logic, the frontier of uncodified "folklore knowledge" and abstract creativity remains a human domain. Investors and researchers should focus on systems that merge AI-driven verification with human-centric creative strategy, as this synergy will define the next wave of innovation.

Others You May Like