AI Engineer
December 19, 2025

From Arc to Dia: Lessons learned building AI Browsers – Samir Mody, The Browser Company of New York

Samir Mody, Head of AI Engineering at The Browser Company, unpacks their journey from Arc to Dia, an AI-native browser. He argues that AI isn't an incremental upgrade; it demands a fundamental re-architecture of product, process, and company culture. This is a playbook for building in the AI era.

AI Demands a New Iteration Velocity

  • “We're not going to win unless we build the tools, the process, the platform, and the mindset to iterate, build, ship, and learn faster than everyone else.”
  • Productized Internal Tools: The Browser Company embedded prompt editing, eval running, and data collection directly into their daily-use product. This democratized AI experimentation, allowing anyone from the CEO to a new hire to refine features.
  • Jeba for Prompt Optimization: They use a technique called Jeba for sample-efficient prompt improvement. Think of it like a self-improving recipe book: you seed it with initial instructions, it tries variations, scores them, and then uses an LLM to reflect and generate better prompts, accelerating quality "hill climbing."
  • Wider Funnel, Faster Ship: The goal is to widen the ideation funnel, allowing more people to contribute ideas, and accelerate the path to shipping high-quality AI features, recognizing the rapid pace of AI advancements.

Model Behavior as a Core Product Discipline

  • “Model behavior is turning principles into product requirements, prompts, and evals, and ultimately shaping the behavior and the personality of our LLM products.”
  • Behavior Design: This involves defining the desired product experience, style, tone, and response shape for LLMs. It's about intentionally crafting the "personality" of the AI assistant.
  • Unexpected Talent: The best people for shaping model behavior might not be engineers. A strategy and ops team member, using internal tools, rewrote prompts that significantly improved Dia's capabilities, leading to the formation of a dedicated "model behavior" team.
  • Evolution of Product Design: Just as web design evolved from functional to sophisticated, model behavior is moving from simple prompts to agent behaviors, goal-directed reasoning, self-correction, and personality shaping.

AI Security as an Emergent Property of Product Design

  • “Browsers sit at the middle of what we can call a lethal trifecta. It has access to your private data. It has exposure to untrusted content and it has the ability to externally communicate.”
  • Prompt Injection Risk: Prompt injections allow third parties to override LLM instructions, potentially leading to data exfiltration or malicious command execution. Browsers are uniquely vulnerable due to their "lethal trifecta" of data access, untrusted content exposure, and external communication.
  • Design-First Security: True AI security requires blending technology and user experience design from the ground up. For example, Dia's autofill tool requires user confirmation in plain text before writing data to a form, giving users control and building trust. This principle extends to features like scheduling events and writing emails.

Key Takeaways:

  • Strategic Implication: AI integration is a company-wide transformation, not a feature. Organizations must re-architect processes, tools, and culture to compete.
  • Builder/Investor Note: Prioritize internal tooling that democratizes AI experimentation. Look for companies establishing "model behavior" as a distinct, cross-functional discipline.
  • The "So What?": The next 6-12 months will reward builders who bake AI security and user control into product design from day one, recognizing that technical mitigations alone are insufficient.

Podcast Link: https://www.youtube.com/watch?v=o4scJaQgnFA

The Browser Company's Samir Mody dissects the profound organizational and technical shifts required to transition from a traditional browser (Arc) to an AI-native platform (Dia), revealing how AI demands a complete re-architecture of product development and security.

From Incremental Improvement to AI-Native Vision

  • The company launched Arc in 2022, an improvement over existing browsers, focusing on personalization and organization.
  • Arc, despite its success, represented only an incremental step, failing to fully realize the company's foundational vision.
  • Access to Large Language Models (LLMs) in 2022 prompted a new thesis: AI will fundamentally transform internet interaction and the browser itself.
  • This led to building Dia, an AI-native browser designed from the ground up for speed and security, featuring an integrated AI assistant.
  • Mody asserts: "We believe that AI is going to transform how people use the internet and in turn fundamentally change the browser itself."

Engineering for Hyper-Iteration in AI Products

  • The Browser Company prioritizes building tools, processes, and a mindset for faster iteration than competitors.
  • Key investment areas include prototyping AI features, building and running evaluations, collecting training and evaluation data, and automating "hill climbing" (iterative optimization).
  • Initial rudimentary prompt editors limited access and context, hindering iteration speed.
  • Integrating all AI development tools (prompts, models, parameters) directly into the internal product used daily amplified ideation and refinement speed tenfold.
  • Mody emphasizes: "Building these tools into our product has enabled so much creativity. It has enabled our PMs, our designers, customer service and strategy and ops to try out new ideas that are tailored to their use cases."

Jeba: Sample-Efficient Prompt Optimization

  • The company developed "Jeba," a nascent but critical mechanism for "hill climbing" (iterative optimization) and refining AI products.
  • Jeba offers a sample-efficient way to improve complex LLM systems without relying on Reinforcement Learning (RL) or extensive fine-tuning.
  • The process involves seeding prompts, executing them across tasks, scoring results, using PA selection to identify optimal prompts, and then leveraging an LLM for reflective prompt mutation.
  • This technique allows tuning text, not weights, and explores a broader prompt space, accelerating refinement.
  • Mody explains: "The key innovations here being around that reflective prompt mutation technique, the selection process which allows you to explore more of the space of prompting rather than one avenue and the ability to tune text and not weights."

Model Behavior as a Specialized Craft

  • "Model behavior" defines, evaluates, and ships desired model actions, translating principles into product requirements, prompts, and evaluations.
  • This discipline encompasses behavior design (defining style, tone, response shape), data collection for measurement, and model steering (prompting, model selection, context window definition).
  • The evolution mirrors internet product design: from functional websites to complex, crafted experiences, now moving from basic prompts to agent-like, goal-directed reasoning and self-correction.
  • A non-engineer on the strategy and operations team, using internal prompt tools, rewrote all prompts, unlocking significant capability and forming the dedicated model behavior team.
  • Mody highlights: "One thing I'd emphasize to you all is to think about who are those people at the company agnostic of their role who can help shape your product and help shape and steer the model itself."

AI Security: An Emergent Product Property

  • Prompt injection attacks override LLM instructions, potentially leading to data exfiltration, malicious command execution, or safety rule circumvention.
  • Browsers are a "lethal trifecta" for prompt injections due to access to private data, exposure to untrusted content, and external communication capabilities (e.g., opening websites, sending emails).
  • Technical mitigations like wrapping untrusted context in tags or separating data/instructions offer limited protection and are often escapable.
  • Effective prevention requires designing products with security in mind, blending technology and user experience; Dia's autofill tool, for instance, requires user confirmation before writing data to forms.
  • Mody states: "It's on us to design a product with that in mind. We have to blend technology approaches and user experience and design into a cohesive story that actually builds them from the ground up and solves it together."

Investor & Researcher Alpha

  • Internal Tooling as a Competitive Edge: Companies not investing heavily in internal, integrated AI development tools (prototyping, evaluation, data, automation) will fall behind in iteration speed and product quality. This represents a significant capital allocation shift.
  • The Rise of Model Behavior Specialists: The role of "model behavior" is emerging as a critical, specialized function, potentially drawing talent from non-engineering backgrounds (e.g., product strategy, design). This signals a new hiring frontier and a redefinition of AI product ownership.
  • UX-Centric AI Security: Purely technical solutions for AI security vulnerabilities like prompt injections are insufficient. The next wave of AI product security will integrate user experience design (e.g., explicit confirmation steps) as a primary defense mechanism, shifting research focus towards human-in-the-loop security protocols.

Strategic Conclusion

The Browser Company's pivot to Dia underscores a critical industry mandate: AI is not an additive feature but a foundational shift. Companies must embrace this technological inflection point with conviction, re-architecting not just products, but entire organizational structures, processes, and security paradigms to remain competitive. The Next Step: Integrate AI as a core company-wide transformation, not just a product enhancement.

Others You May Like