Tri Dao
Tri Dao is an Assistant Professor of Computer Science at Princeton University, where he leads the Dao AI Lab, and Co-founder and Chief Scientist of Together AI. He holds a PhD in Computer Science from Stanford University and works at the intersection of machine learning and systems, with research interests including hardware-aware algorithms and sequence models with long-range memory. He is best known for creating FlashAttention, a fast and memory-efficient exact attention algorithm widely adopted across major AI organizations and ML frameworks, and co-authoring Mamba, a linear-time sequence modeling architecture.
“"There are great people like Tri Dao who write excellent kernels and they form the bedrock of all of our modern deep learning is built on FlashAttention. Modern transformers are built on FlashAttention."”
Source→AI-extracted from podcast / newsletter / paper summaries. May contain errors.