InfiniTensor/include
xiaonans d1a90ba3e2
[feature] support kvcache with static graph (#209)
* [feature] support kvcache with static graph

* use workspace to optimize kvcache attention

---------

Co-authored-by: Haojie Wang <haojie0429@gmail.com>
2024-01-25 14:20:43 +08:00
..
bang support more data type on mlu (#211) 2024-01-24 13:33:33 +08:00
core Modify kernel registration & support fp16 (#205) 2024-01-15 11:02:13 +08:00
cuda [feature] support kvcache with static graph (#209) 2024-01-25 14:20:43 +08:00
ffi Add TVM codegen for MemboundOp (#35) 2022-09-22 18:06:45 +08:00
intelcpu Cpu backend2 (#77) 2023-04-17 12:15:23 +08:00
kunlun Xpu (#82) 2023-10-16 10:57:08 +08:00
nnet test: 支持编译 einnet 单元测试,但不是所有测试都能通过 (#174) 2023-11-03 13:21:49 +08:00
operators 解除前端对onnx infershape功能的依赖 (#206) 2024-01-12 14:54:27 +08:00
utils Modify kernel registration & support fp16 (#205) 2024-01-15 11:02:13 +08:00
test.h Add python interface for CUDA operator evaluation (#42) 2022-09-27 10:41:12 +08:00