Posts - Page 2

All Posts

Why K-Scale WinsMarch 1, 2024
A copy of the business plan I wrote for K-Scale Labs when I was initially raising money, outlining my thoughts about how the space would likely develop and how I felt I could build a company to take advantage of these developments.
robotics startups strategy product
Starting a Startup, ReloadedJanuary 22, 2024
My "Starting a Startup" post from a few months ago needed a refresh. This is a new version with my updated thoughts about what a successful startup looks like.
startups career strategy product
The Sand MandalaNovember 21, 2023
A vignette about purpose.
stories writing philosophy
Monotonic AttentionNovember 9, 2023
Write-up explaining my implementation of monotonic attention using a probabilistic graphical model.
machine-learning speech deep-learning algorithms
Retentive Networks and RWKVSeptember 16, 2023
A short, hand-wavy explainer for the mathematical intuition behind faster attention mechanisms.
machine-learning nlp deep-learning algorithms
Miscellaneous Azure NotesSeptember 14, 2023
Miscellaneous notes about various Azure-related things.
cloud dev-tools reference software-engineering
Miscellaneous AWS NotesSeptember 13, 2023
Miscellaneous notes about various AWS-related things.
cloud dev-tools reference software-engineering
Streaming ConvolutionsAugust 24, 2023
Working out the math for streaming convolutions.
machine-learning speech algorithms optimization
Diffusion verses Flow MatchingJuly 19, 2023
An accessible introduction to diffusion and flow matching models. This post aims to be both complete and easy-to-follow as a reference for implementing diffusion models yourself.
machine-learning generative-models math speech
Fast Attention ImplementationsJune 29, 2023
A reference collection of fast attention implementations.
machine-learning nlp optimization reference