InfiniTensor/examples
xiaonans d1a90ba3e2
[feature] support kvcache with static graph (#209)
* [feature] support kvcache with static graph

* use workspace to optimize kvcache attention

---------

Co-authored-by: Haojie Wang <haojie0429@gmail.com>
2024-01-25 14:20:43 +08:00
..
NNmodel@b896cec2db fix(perf.py): change NNmodel commit to fix perf.py (#203) 2023-12-28 21:31:39 +08:00
distributed Modify kernel registration & support fp16 (#205) 2024-01-15 11:02:13 +08:00
python [feature] support kvcache with static graph (#209) 2024-01-25 14:20:43 +08:00