attention, made visible

The Mind

I work on the models that learn from our faces and voices.

A transformer reads a sentence by letting every word attend to every other; the weights of that attention decide what matters to what.

Choose a word. The beams show where it looks.