2 Commits

Author	SHA1	Message	Date
xiaonans	d1a90ba3e2	[feature] support kvcache with static graph (#209) ... * [feature] support kvcache with static graph * use workspace to optimize kvcache attention --------- Co-authored-by: Haojie Wang <haojie0429@gmail.com>	2024-01-25 14:20:43 +08:00
xiaonans	965df4e294	[feature] add fused attention_kvcache operator support (#179) ... * [feature] add fused attention_kvcache operator support * add test to attention_kvcache op * Add space line at EOF --------- Co-authored-by: Haojie Wang <haojie0429@gmail.com>	2023-11-14 23:44:22 +08:00