All Posts
- Miscellaneous Azure NotesSeptember 14, 2023
Miscellaneous notes about various Azure-related things.
- Miscellaneous AWS NotesSeptember 13, 2023
Miscellaneous notes about various AWS-related things.
- Streaming ConvolutionsAugust 24, 2023
Working out the math for streaming convolutions.
- Diffusion verses Flow MatchingJuly 19, 2023
An accessible introduction to diffusion and flow matching models. This post aims to be both complete and easy-to-follow as a reference for implementing diffusion models yourself.
- Fast Attention ImplementationsJune 29, 2023
A reference collection of fast attention implementations.
- Starting a StartupJune 27, 2023
I left FAIR to start a startup a few weeks ago, and figured I should describe what we're actually doing.
- RWKV Language Model MathJune 16, 2023
In-depth explanation of the math behind the RWKV model, with PyTorch implementations, plus a discussion of numerical stability.
- Types of Electrical Connectors for BatteriesMarch 6, 2023
A collection of the different types of electrical connectors that might be relevant for robotics.
- Types of GearsMarch 6, 2023
A reference for the different types of gears that might be relevant for robotics applications.
- Possible Ideas for Robotics StartupsDecember 25, 2022
A list of ideas for robotics startups, focusing on things that are feasible right now and things that will likely become feasible in the next few years.