InfiniTensor/examples/python
xiaonans d1a90ba3e2
[feature] support kvcache with static graph (#209)
* [feature] support kvcache with static graph

* use workspace to optimize kvcache attention

---------

Co-authored-by: Haojie Wang <haojie0429@gmail.com>
2024-01-25 14:20:43 +08:00
..
llama_kvcache_inference.py [feature] support kvcache with static graph (#209) 2024-01-25 14:20:43 +08:00
onnx_inference.py add python examples (#143) 2023-09-28 10:40:45 +08:00
paddle_densenet.py Add examples: inference of Paddle models (#192) 2023-12-14 19:42:43 +08:00
paddle_inception.py Add examples: inference of Paddle models (#192) 2023-12-14 19:42:43 +08:00
paddle_model_dev.md Add examples: inference of Paddle models (#192) 2023-12-14 19:42:43 +08:00
paddle_resnet.py Add examples: inference of Paddle models (#192) 2023-12-14 19:42:43 +08:00
resnet_inference.py add python examples (#143) 2023-09-28 10:40:45 +08:00