4 Commits

Author	SHA1	Message	Date
xiaonans	4a5b9572bb	add test scripts for llama2 and 9G models	2024-04-10 16:23:02 +08:00
xiaonans	d1a90ba3e2	[feature] support kvcache with static graph (#209) ... * [feature] support kvcache with static graph * use workspace to optimize kvcache attention --------- Co-authored-by: Haojie Wang <haojie0429@gmail.com>	2024-01-25 14:20:43 +08:00
learner2468	9a9587556c	Add examples: inference of Paddle models (#192) ... * Add paddle model and infer with InfiniTensor * Remove unused import --------- Co-authored-by: kilinchange <44265800+kilinchange@users.noreply.github.com> 【Hackathon No.106】Add paddle model and infer with InfiniTensor	2023-12-14 19:42:43 +08:00
Haojie Wang	f25bcca076	add python examples (#143) ... * add python examples * use copy*_numpy instead of copy*_float	2023-09-28 10:40:45 +08:00