All Posts

Published on
November 9, 2023
Monotonic Attention
ml speech
Write-up explaining my implementation of monotonic attention using a probabilistic graphical model.
Published on
September 16, 2023
Retentive Networks and RWKV
ml nlp
A short, hand-wavy explainer for the mathematical intuition behind faster attention mechanisms.
Published on
September 14, 2023
Miscellaneous Azure Notes
references
Miscellaneous notes about various Azure-related things.
Published on
September 13, 2023
Miscellaneous AWS Notes
references
Miscellaneous notes about various AWS-related things.
Published on
August 24, 2023
Streaming Convolutions
ml speech
Working out the math for streaming convolutions.

Monotonic Attention