p32581460
/
InfiniTensor
forked from jiuyuan/InfiniTensor
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
142 Commits 70 Branches 0 Tags 141 MiB
Commit Graph

57 Commits

Author SHA1 Message Date
wendy12022 c8b2c8ed32
Cpu backend2 (#77) 
fix review

change Device::MKL to Device::INTELCPU

fix mkl linkage

fix errors according to merge from master

now can call mkl backend

fix softmax/flatten with axis from onnx.

modify README.md

fix memory refree

add env_lotus_intelcpu.sh

fix compile

merge from branch cpu_backend

fix something add gather

fix something

FIX: directory rename from "mkl" to "intelcpu"

ADD: use oneMKL dpcpp interface to implement matmul kernel.

ADD: add dpcpp as compiler for mkl, and fix warnings for clang compiling.
add dpcpp kernel for pow.

ADD: mkl kernel for pad.

ADD: slice mkl kernel.

ADD: reshape/flatten/identity mkl kernel.

ADD: split mkl kernel.

fix compile error

FIX: fix flattenObj with axis.

ADD reduce_mean mkl kernel.

Add concat mkl kernel.

bathNorm for mkl kernel.

sigmoid mkl kernel.

ADD：add mkl kernel for pooling

add more tests for softmax

Now softmax cuda kernel supports any axises.

mkl kernel for softmax

softmax

add axis to softmax operator

add mkl kernel for abs tanh

ADD: relu kernel for mkl

fix binary mkl primitives.

add mkl kernel for binary operators

fix compiler error

move stream to runtime

clang format

add MemoryFormat for tensorObj.

use post_ops for fused conv/deconv

Distinguish mkl  op_timer from cuda op timer.

add act optype to conv and deconv

add operator timer

add mkl kernel for convTransposed

minor fix for group conv

do not use cblas_sgemm_batch

CpuRuntimeObj->NativeCpuRuntimeObj

add  matmul op for mkl
 2023-04-17 12:15:23 +08:00
YdrMaster aff2b538ce fix: 删除单独的拷贝函数 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-22 10:13:06 +08:00
wanghailu 64a5de51f3 fix 2023-03-22 10:08:31 +08:00
YdrMaster 5aeacedab3 fix: 从模板导出每个类型的 python 接口 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-22 09:46:40 +08:00
YdrMaster e1c976568d fix: 增加推理接口 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster c18845a2fd feat: 增加推理接口 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 6e1af09dd0 fix: remove print 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster e294e46436 feat: 导出 pool 到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 8a871c3773 feat: 导出 conv 到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster afed749b74 feat: 支持导出权重 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 40fb8390b1 feat: 导入时保存权重 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster a5e692baea feat: 导出 batchnorm 到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 5b6698bac7 feat: 导出全图的输出张量到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster cf9bdb0562 feat: 支持打印结果 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster f44a4daf70 feat: 导出未初始化的张量 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 6dce129cb3 fix: TensorObj::dataMalloc 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster dc79b72655 fix: 重新导出 cuda_runtime() 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 9ab78f13f7 feat: 导出 cuda_runtime 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster ed81861375 temp: 实现初始值导入，但 resnet 报错 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 4ffaa44c1e fix: Matmul 支持 2 维或以上的输入 
> 现在能导入 resnet18

Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster a27391fcdc fix: 修正 batchNorm 实现 
- onnx 和 pytorch 认为 batchNorm 的 4 个参数是 [c] 形状的，cuDNN 可能认为是 [1,c,1,...]。
优化已改为 [c]，但 cuDNN 推理没有改；

Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 62fd619987 fix: 移除中文注释 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:16:16 +08:00
YdrMaster 71a87c27d1 feat: 导出 ReduceMean 到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:09:12 +08:00
YdrMaster 2a23669394 feat: 导出 Reshape 到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:09:12 +08:00
YdrMaster ffd0473bd2 feat: check everything 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:09:12 +08:00
YdrMaster 9e0f8f21bf feat: 生成模型对象 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:09:12 +08:00
YdrMaster 6b7af7077b feat: 导出 Gather Concat 到 onnx 
- 并优化 python 代码

Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:09:12 +08:00
YdrMaster 9d9fbd44af feat: 导出 MatMul Concat 到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:09:12 +08:00
YdrMaster 32f6f02c81 feat: 导出 5 个单目算子到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:09:12 +08:00
YdrMaster 0517089dca feat: 导出输入张量到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:09:12 +08:00
YdrMaster eff4c14a85 feat: 封装上下文对象以复用建图代码 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:09:12 +08:00
YdrMaster 0833a2f779 feat: 导出加减乘除幂到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:09:12 +08:00
YdrMaster f2591edbb4 feat: 导出 OpType，为节点命名 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:09:12 +08:00
YdrMaster fe81fccf76 feat: 导出 OperatorObj 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 15:09:12 +08:00
YdrMaster 978269162a fix: 移除 c++ 中的中文注释，python TODO 改 FIXME 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 14:48:39 +08:00
YdrMaster d7e52054e6 fix: 修正 GlobalAveragePool 和 Reshape 导入 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-23 08:59:06 +08:00
YdrMaster 4c7fdf44c5 feat: 前端支持 Conv 及单元测试 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-22 15:05:44 +08:00
YdrMaster ce04177585 style: use __path__ to import 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-21 09:17:34 +08:00
YdrMaster 6a4de807e6 style: remove non-ascii comments from cpp 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-16 14:57:51 +08:00
YdrMaster c9fee3f667 feat: 前端支持 GlobalAveragePool 及单元测试 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-16 10:33:24 +08:00
YdrMaster afa90ec9c9 feat: 前端支持 gemm 及单元测试 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-15 13:20:34 +08:00
YdrMaster 315763a83a feat: 前端支持 pad 及单元测试 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-15 11:41:06 +08:00
YdrMaster 8fae67b4b4 feat: 前端支持 slice 及单元测试 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-14 17:35:18 +08:00
YdrMaster 341cf1f943 feat: 前端支持 pool 及单元测试 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-14 16:26:47 +08:00
YdrMaster 62ceb78ae3 feat: 前端支持 reduceMean 及单元测试 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-14 15:35:01 +08:00
YdrMaster d11fb0ad5f feat: 前端支持 gather 及单元测试 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-14 14:16:01 +08:00
YdrMaster 45aa0237da feat: 前端支持 concat 及单元测试 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-14 13:42:35 +08:00
YdrMaster a7e58bd8d0 feat: 补充 DataType 类型 
- 增加了 6 个代数类型，与 onnx 的序号对应
- 现在可以导入 reshape 了

Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-14 11:27:57 +08:00
YdrMaster d9e2953425 fix: 改正 reshap 导入 
- 从 initializer 拿到 reshape 的 shape 值
- 但 reshape 仍然无法导入，因为无法分辨 shape 其实不是一个后端张量

Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-14 10:14:55 +08:00
YdrMaster 7626efbfa8 feat: 前端支持 reshape 
- 无法测试，因为后端不支持 shape 的 INT64 类型

opt: ReshapeObj 构造改为全部传值并在内部 move
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-02-14 09:51:11 +08:00