p35189024
/
InfiniTensor
forked from jiuyuan/InfiniTensor
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
159 Commits 70 Branches 0 Tags 141 MiB
Commit Graph

159 Commits

Author SHA1 Message Date
Liyan Zheng 83d5842f56 Fix: specify runtime 2023-04-12 11:24:31 +08:00
Liyan Zheng 005c113948 Add: support TVM packed function 2023-04-12 11:24:31 +08:00
Liyan Zheng 0d70643867 Add: Random generator 2023-04-12 11:24:31 +08:00
Liyan Zheng f29f54687c Add: PRelu Expr and AsTVMVisitor 2023-04-12 11:24:31 +08:00
huangshuhong 67e9fb9632 Fix: test_memboundOp 2023-04-12 11:24:29 +08:00
huangshuhong af80830d56 Fix: membound_tvm 2023-04-12 11:24:25 +08:00
huangshuhong f19bd4d1d6 Fix: remove cuCtxCreate which makes TVM fails 2023-04-12 11:24:25 +08:00
huangshuhong 2e501de8db Add: PackedFunc (broken) 2023-04-12 11:24:13 +08:00
Liyan Zheng 31b1edc600 Add: CMake config 2023-04-12 11:24:13 +08:00
Liyan Zheng 69d894e003 Add: TVM headers and CMake include paths 2023-04-12 11:24:13 +08:00
Liyan Zheng e8b4e3f03f Add: expr simplication for TVM 2023-04-12 11:24:13 +08:00
Liyan Zheng 0d8685b1e0 Fix: graph OpList ctor 2023-04-12 11:24:13 +08:00
Liyan Zheng 04858012bf Add: Exception for checkCuError 2023-04-12 11:24:13 +08:00
Liyan Zheng 6aaf963f50 Fix: cuBLAS failure when codegen is enabled 2023-04-12 11:24:13 +08:00
Liyan Zheng 6441abb88f Fix: GraphObj ctor should use cloneTensor 2023-04-12 11:24:13 +08:00
huangshuhong 220b76f355 Add: matmul broadcast 2023-04-12 11:24:09 +08:00
Liyan Zheng aac4bd4650 Fix: [Intermediate] NMutator::expressionToGraph 
To be fix: matmul with implicit broadcast
 2023-04-12 11:24:09 +08:00
Liyan Zheng 7478b698dc Add: expression reader as a cmake target 2023-04-12 11:24:09 +08:00
huangshuhong 8e6fc4136e Add: cache and padding (bugs!!) 2023-04-12 11:24:01 +08:00
Liyan Zheng bd12b67ea3 Add: mutator InfoGAN minimum test 2023-04-11 20:44:08 +08:00
Hardy fe1afe38fa
fix code of bang conv (#76) 
* fix code of bang conv

* test: 向 master push 时也执行 ci

Signed-off-by: YdrMaster <ydrml@hotmail.com>

---------

Signed-off-by: YdrMaster <ydrml@hotmail.com>
Co-authored-by: wanghailu <wanghailu@qiyuanlab.com>
Co-authored-by: YdrMaster <ydrml@hotmail.com>
 2023-03-29 15:47:32 +08:00
Hardy 823e66a9ff
Support perf bang 1115 (#57) 
* support matmul

* add matmul

* add matmul

* add code for cnnl matmul operation and test

* add conv

* add code for conv test on mlu

* add code for test cnnl conv on mlu

* add code for perf conv and matmul on mlu

* clang format

* fix convolution operation

* fxi cmaklist

* code format

* fix code

* code format

---------

Co-authored-by: wanghailu <wanghailu@qiyuanlab.com>
Co-authored-by: wanghailu <wanghailu0717@163.com>
 2023-03-29 13:52:56 +08:00
wendy12022 86ec4036ce
ADD: add mkl runtime for intel cpu , and add mkl kernel for matmul/conv/convtransposed. (#61) 
* move memory format transformation to TensorObj

clang format

add MemoryFormat for tensorObj.

use post_ops for fused conv/deconv

Distinguish mkl  op_timer from cuda op timer.

add act optype to conv and deconv

add operator timer

add mkl kernel for convTransposed

minor fix for group conv

do not use cblas_sgemm_batch

CpuRuntimeObj->NativeCpuRuntimeObj

add  matmul op for mkl

* fix: fix bugs when rebasing from master

fix: fix bugs when rebasing from master

* fix: update api after rebasing

* fix: fix format; fix onnx import

* fix: fix clang-format

* [fix] fix conv_transpose test

* [fix] use stronger test case for transposed conv

* [fix] remove tensor memory format; fix mkl transpose conv

* [fix] add FIXME tag for op_timer python api

---------

Co-authored-by: whjthu <haojie0429@gmail.com>
 2023-03-27 21:28:49 +08:00
Haojie Wang 65a3abf5dc
feat: inference (#71) 
导出推理接口，支持通过 python 调用框架推理
 2023-03-25 12:09:22 +08:00
whjthu d9886e9de3 fix: remove inline keyword in class; rename getter and setter for inputOf and outputOf 2023-03-25 12:04:24 +08:00
YdrMaster aff2b538ce fix: 删除单独的拷贝函数 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-22 10:13:06 +08:00
wanghailu 64a5de51f3 fix 2023-03-22 10:08:31 +08:00
YdrMaster 5aeacedab3 fix: 从模板导出每个类型的 python 接口 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-22 09:46:40 +08:00
YdrMaster 73e895b8ce feat: 导出拷出张量值方法 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-21 14:40:13 +08:00
YdrMaster 9db97eb212 refactor: 整合操作张量数据的方法 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-21 14:00:04 +08:00
YdrMaster e1c976568d fix: 增加推理接口 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster c18845a2fd feat: 增加推理接口 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 6e1af09dd0 fix: remove print 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster e294e46436 feat: 导出 pool 到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 8a871c3773 feat: 导出 conv 到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster afed749b74 feat: 支持导出权重 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 40fb8390b1 feat: 导入时保存权重 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster a5e692baea feat: 导出 batchnorm 到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 71ca4459d9 fmt 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 5b6698bac7 feat: 导出全图的输出张量到 onnx 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 59bf59c10b docs: update README.md 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster fb3478bf3e build: update Makefile 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
wanghailu 514666591e add batch_norm 2023-03-15 17:23:32 +08:00
YdrMaster 3d122aebfe feat: 支持导出浮点向量 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster cf9bdb0562 feat: 支持打印结果 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster f44a4daf70 feat: 导出未初始化的张量 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 6dce129cb3 fix: TensorObj::dataMalloc 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster dc79b72655 fix: 重新导出 cuda_runtime() 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 9ab78f13f7 feat: 导出 cuda_runtime 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00
YdrMaster 60c5d6b5b8 fix: 先不在 cpu 上测试 
Signed-off-by: YdrMaster <ydrml@hotmail.com>
 2023-03-15 17:23:32 +08:00