Flashattention - Fast and Memory-Efficient Exact Attention with IO-Awareness

arXiv V1: FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness