Marmik

Hey, i'm Marmik

welcome to my web eden.

i work on mechanistic interpretability research, which i like to think of as the biology of artificial neural nets. i'm very interested in understanding how deep learning algorithms gives rise to its own world of beautiful structure and elegant complexity and behaviors.

recently, i've been working on understanding feature manifolds (how and why do they form) and interpreting genomic language models like Evo2.

in the past, i worked on research on interpreting Mixture of Experts (MoEs) for expert specialization under Arcadia Research Team and also collaborated with Insight + Interaction Lab at Harvard.

apart from work, i enjoy reading books of various genres () and i've also been painting for a long time (my paintings). i've also been learning to play guitar, i like running and did a triathlon with my friends.

updates

january 2026
gave a talk on “Zooming into MoEs” at PopVax
november 2025
recevied a grant from Coefficient Giving (formerly Open Philanthropy) for research on understanding Chain of Thought using activation geometry
september 2025
sparsity and superposition in mixture of experts got published at NeurIPS'25 Mech Interp Workshop
may 2025
worked at groq on compound ai systems and fast model inference
april 2025
presented MoE Lens at ICLR'25
summer 2024
built densetex with friends — small image-to-latex model for math equations using CNNs and transformers
2024
ml engineer at a startup working on ocr using vision transformers
2024
co-led computer vision team for RoboMaster university league

bookshelf

The Structure of Scientific Revolutions by Thomas S. Kuhn

The Structure of Scientific Revolutions

Thomas S. Kuhn

Love and Math by Edward Frenkel

Love and Math

Edward Frenkel

Wetware by Dennis Bray

Wetware

Dennis Bray

If cats disappeared from the world by Genki Kawamura

If cats disappeared from the world

Genki Kawamura

American Prometheus by Kai Bird & Martin J. Sherwin

American Prometheus

Kai Bird & Martin J. Sherwin

Thinking in Systems by Donella H. Meadows

Thinking in Systems

Donella H. Meadows

The Idea Factory: Bell Labs and the Great Age of American Innovation by Jon Gertner

The Idea Factory: Bell Labs and the Great Age of American Innovation

Jon Gertner

The Trial by Franz Kafka

The Trial

Franz Kafka

Murder on the Orient Express by Agatha Christie

Murder on the Orient Express

Agatha Christie

Norwegian Wood by Haruki Murakami

Norwegian Wood

Haruki Murakami

A Brief History of Intelligence by Max Bennett

A Brief History of Intelligence

Max Bennett

Do Androids Dream of Electric Sheep? by Philip K. Dick

Do Androids Dream of Electric Sheep?

Philip K. Dick

Children of Dune by Frank Herbert

Children of Dune

Frank Herbert

Surely You're Joking, Mr. Feynman! by Richard P. Feynman

Surely You're Joking, Mr. Feynman!

Richard P. Feynman

Looking for Alaska by John Green

Looking for Alaska

John Green

The Great Gatsby by F. Scott Fitzgerald

The Great Gatsby

F. Scott Fitzgerald

Dune Messiah by Frank Herbert

Dune Messiah

Frank Herbert

Dune by Frank Herbert

Dune

Frank Herbert

Foundation by Isaac Asimov

Foundation

Isaac Asimov

The Fellowship of the Ring by J.R.R. Tolkien

The Fellowship of the Ring

J.R.R. Tolkien

1984 by George Orwell

1984

George Orwell

The Lightning Thief by Rick Riordan

The Lightning Thief

Rick Riordan

And Then There Were None by Agatha Christie

And Then There Were None

Agatha Christie

The Fault in Our Stars by John Green

The Fault in Our Stars

John Green

Sapiens by Yuval Noah Harari

Sapiens

Yuval Noah Harari

Steve Jobs by Walter Isaacson

Steve Jobs

Walter Isaacson

Man's Search for Meaning by Viktor E. Frankl

Man's Search for Meaning

Viktor E. Frankl

21 Lessons for the 21st Century by Yuval Noah Harari

21 Lessons for the 21st Century

Yuval Noah Harari

How Google Works by Eric Schmidt & Jonathan Rosenberg

How Google Works

Eric Schmidt & Jonathan Rosenberg

The Innovators by Walter Isaacson

The Innovators

Walter Isaacson

Einstein: His Life and Universe by Walter Isaacson

Einstein: His Life and Universe

Walter Isaacson

Atomic Habits by James Clear

Atomic Habits

James Clear

Deep Work by Cal Newport

Deep Work

Cal Newport

Bhagavad Gita by Ved Vyas

Bhagavad Gita

Ved Vyas

i like meeting new people and if anything from above is exciting to you, feel free to reach out to me on twitter or at marmik [at] berkeley [dot] edu