

Hey, i'm Marmik
welcome to my web eden.
i work on mechanistic interpretability research, which i like to think of as the biology of artificial neural nets. i'm very interested in understanding how deep learning algorithms gives rise to its own world of beautiful structure and elegant complexity and behaviors.
recently, i've been working on understanding feature manifolds (how and why do they form) and interpreting genomic language models like Evo2.
in the past, i worked on research on interpreting Mixture of Experts (MoEs) for expert specialization under Arcadia Research Team and also collaborated with Insight + Interaction Lab at Harvard.
apart from work, i enjoy reading books of various genres () and i've also been painting for a long time (my paintings). i've also been learning to play guitar, i like running and did a triathlon with my friends.
updates
- january 2026
- gave a talk on “Zooming into MoEs” at PopVax
- november 2025
- recevied a grant from Coefficient Giving (formerly Open Philanthropy) for research on understanding Chain of Thought using activation geometry
- september 2025
- sparsity and superposition in mixture of experts got published at NeurIPS'25 Mech Interp Workshop
- may 2025
- worked at groq on compound ai systems and fast model inference
- april 2025
- presented MoE Lens at ICLR'25
- summer 2024
- built densetex with friends — small image-to-latex model for math equations using CNNs and transformers
- 2024
- ml engineer at a startup working on ocr using vision transformers
- 2024
- co-led computer vision team for RoboMaster university league
bookshelf

The Structure of Scientific Revolutions
Thomas S. Kuhn

Love and Math
Edward Frenkel

Wetware
Dennis Bray

If cats disappeared from the world
Genki Kawamura

American Prometheus
Kai Bird & Martin J. Sherwin

Thinking in Systems
Donella H. Meadows

The Idea Factory: Bell Labs and the Great Age of American Innovation
Jon Gertner

The Trial
Franz Kafka

Murder on the Orient Express
Agatha Christie

Norwegian Wood
Haruki Murakami

A Brief History of Intelligence
Max Bennett

Do Androids Dream of Electric Sheep?
Philip K. Dick

Children of Dune
Frank Herbert

Surely You're Joking, Mr. Feynman!
Richard P. Feynman

Looking for Alaska
John Green

The Great Gatsby
F. Scott Fitzgerald

Dune Messiah
Frank Herbert

Dune
Frank Herbert

Foundation
Isaac Asimov

The Fellowship of the Ring
J.R.R. Tolkien

1984
George Orwell

The Lightning Thief
Rick Riordan

And Then There Were None
Agatha Christie

The Fault in Our Stars
John Green

Sapiens
Yuval Noah Harari

Steve Jobs
Walter Isaacson

Man's Search for Meaning
Viktor E. Frankl

21 Lessons for the 21st Century
Yuval Noah Harari

How Google Works
Eric Schmidt & Jonathan Rosenberg

The Innovators
Walter Isaacson

Einstein: His Life and Universe
Walter Isaacson

Atomic Habits
James Clear

Deep Work
Cal Newport

Bhagavad Gita
Ved Vyas
i like meeting new people and if anything from above is exciting to you, feel free to reach out to me on twitter or at marmik [at] berkeley [dot] edu