Hey, i'm Marmik
welcome to my web eden.
since the past few years, most of my time is spent working on problems in deep learning. precisely, i work on interpretability research, which i like to think of as the biology of artificial neural nets. i'm very interested in understanding how deep learning algorithms gives rise to its own world of beautiful structure and elegant complexity and behaviors.
recently, i've been very interested in the similarities in representations between the brain and neural networks. in terms of sidequests, i've been enjoying studying functional genomics and quantum field theory.
this past summer, i worked at groq on compound ai systems and fast model inference. in the past, i worked on independent research on interpreting Mixture of Experts (MoEs) for expert specialization.
i love working with my friends a lot so i worked on densetex with 3 of my best friends which is a fast and accurate model for image-to-latex for math equations using CNNs and transformers and also was a ml engineer at a startup working on ocr using vision transformers. at my uni, i worked on computer vision systems in battlebots for competitive robotics tournament for more than a year and learned a lot about optimizing algorithms in hardware constraints.
apart from work, i enjoy reading books of various genres () and i've also been painting for a long time (). i've also been learning to play guitar and am training for a triathlon.
updates
- september 2025
- superposition in mixture of experts got published at NeurIPS Mech Interp Workshop
- april 2025
- presented MoE Lens at ICLR'25
bookshelf

Wetware
Dennis Bray

If cats disappeared from the world
Genki Kawamura

American Prometheus
Kai Bird & Martin J. Sherwin

Thinking in Systems
Donella H. Meadows

The Idea Factory: Bell Labs and the Great Age of American Innovation
Jon Gertner

The Trial
Franz Kafka

Murder on the Orient Express
Agatha Christie

Norwegian Wood
Haruki Murakami

A Brief History of Intelligence
Max Bennett

Do Androids Dream of Electric Sheep?
Philip K. Dick

Children of Dune
Frank Herbert

Surely You're Joking, Mr. Feynman!
Richard P. Feynman

Looking for Alaska
John Green

The Great Gatsby
F. Scott Fitzgerald

Dune Messiah
Frank Herbert

Dune
Frank Herbert

Foundation
Isaac Asimov

The Fellowship of the Ring
J.R.R. Tolkien

1984
George Orwell

The Lightning Thief
Rick Riordan

And Then There Were None
Agatha Christie

The Fault in Our Stars
John Green

Sapiens
Yuval Noah Harari

Steve Jobs
Walter Isaacson

Man's Search for Meaning
Viktor E. Frankl

21 Lessons for the 21st Century
Yuval Noah Harari

How Google Works
Eric Schmidt & Jonathan Rosenberg

The Innovators
Walter Isaacson

Einstein: His Life and Universe
Walter Isaacson

Atomic Habits
James Clear

Deep Work
Cal Newport

Bhagavad Gita
Ved Vyas
paintings
i like meeting new people and if anything from above is interesting to you, feel free to reach out to me on twitter or at marmik [at] berkeley [dot] edu