Published onJuly 19, 2023Diffusion verses Flow MatchingmlspeechAn accessible introduction to diffusion and flow matching models. This post aims to be both complete and easy-to-follow as a reference for implementing diffusion models yourself.
Published onJune 29, 2023Fast Attention ImplementationsmlnlpreferencesA reference collection of fast attention implementations.
Published onJune 27, 2023Starting a StartupstartupmusingsI left FAIR to start a startup a few weeks ago, and figured I should describe what we're actually doing.
Published onJune 16, 2023RWKV Language Model MathmlnlpmathIn-depth explanation of the math behind the RWKV model, with PyTorch implementations, plus a discussion of numerical stability.
Published onMarch 6, 2023Types of Electrical Connectors for BatteriesreferencesA collection of the different types of electrical connectors that might be relevant for robotics.