Recent Exciting Things!

Transformer Circuits

Multimodal Neurons

On Distill

Circuits

On Distill


Neural Networks (General)


Neural Networks, Manifolds, and Topology

Deep Learning, NLP, and Representations

Calculus on Computational Graphs: Backpropagation

Neural Networks, Types, and Functional Programming


Recurrent Neural Networks


Understanding LSTM Networks

Attention and Augmented Recurrent Neural Networks

On Distill


Convolutional Neural Networks


Conv Nets

A Modular Perspective

Understanding Convolutions

Groups & Group Convolutions

Deconvolution and Checkerboard Artifacts

On Distill


Visualizing Neural Networks


Visualizing MNIST

An Exploration of Dimensionality Reduction

Visualizing Representations

Deep Learning and Human Beings

Inceptionism

Going Deeper into Neural Networks

On the Google Research Blog

Four Experiments in Handwriting with a Neural Network

On Distill

Feature Visualization

How neural networks build up their understanding of images

On Distill

The Building Blocks of Interpretability

On Distill

Differentiable Image Parameterizations

On Distill

Activation Atlases

On Distill

Circuits

On Distill

Understanding RL Vision

On Distill

Multimodal Neurons

On Distill

Transformer Circuits


Individual Circuits Articles


Zoom In: An Introduction to Circuits

On Distill

An Overview of Early Vision in InceptionV1

On Distill

Curve Detectors

On Distill

Naturally Occurring Equivariance in Neural Networks

On Distill

High-Low Frequency Detectors

On Distill

Curve Circuits

On Distill

Visualizing Weights

On Distill


Miscellaneous


Fanfiction, Graphs, and PageRank

Data.List Recursion Illustrated

Visual Information Theory

Research Debt

On Distill

The Paths Perspective on Value Learning

On Distill