InfiniTensor/examples/distributed
kilinchange 877db21021
Fix support kvcache (#142)
* - fix onnx.py

* - fix shard_concat
2023-09-27 11:08:44 +08:00
..
launch.py tensor parallel for transformer (#125) 2023-09-14 14:19:45 +08:00
launch_kvcache.py Support kvcache (#134) 2023-09-18 14:17:02 +08:00
parallel.py impl distributed launch with NCCL (#106) 2023-09-05 09:47:35 +08:00
parallel_opt.py Fix support kvcache (#142) 2023-09-27 11:08:44 +08:00
placement.py tensor parallel for transformer (#125) 2023-09-14 14:19:45 +08:00