InfiniTensor/include
zhangyue 985d0dee5f
Kunlun dist op (#225)
* kunlun dist inference fix

* kunlun distributed

* 添加昆仑芯分布式脚本以及解决运行llama遇到的问题

* set -j8

* format

* move run_pytorch.py int o cuda/

* update notes

---------

Co-authored-by: weijie01 <weijie01@baidu.com>
Co-authored-by: wanghailu <wanghailu0717@163.com>
Co-authored-by: Haojie Wang <haojie0429@gmail.com>
2024-04-23 15:46:25 +08:00
..
bang fix mlu some kernel registration & gather op (#210) 2024-02-01 15:02:02 +08:00
core Support kunlun new toolkit (#224) 2024-04-03 09:56:52 +08:00
cuda 针对bert和gpt2模型分布式推理的优化 (#221) 2024-04-01 14:04:28 +08:00
ffi Add TVM codegen for MemboundOp (#35) 2022-09-22 18:06:45 +08:00
intelcpu Cpu backend2 (#77) 2023-04-17 12:15:23 +08:00
kunlun Kunlun dist op (#225) 2024-04-23 15:46:25 +08:00
nnet test: 支持编译 einnet 单元测试,但不是所有测试都能通过 (#174) 2023-11-03 13:21:49 +08:00
operators Accelerate llama (#219) 2024-04-01 08:46:05 +08:00
utils XCCL support (#171) 2024-02-29 11:48:35 +08:00
test.h Add python interface for CUDA operator evaluation (#42) 2022-09-27 10:41:12 +08:00