Comments (2)
您好,请问310B是昇腾23年新出的芯片类型对吗?这个芯片类型Lite尚未适配,Lite会将此需求纳入需求池进行评审,感谢您的反馈!
from paddle-lite.
PartitionModel function => add another abstract partition interface to support user-specific features( such as partition model between same type device to enable parallelism )
for the following function ,maybe it's good to provide an abstract interface for user to make a specific device partition
int Compilation::PartitionModel( Context* context, Model* model, std::vector<std::pair< Context::DeviceContext*, std::tuple<core::Model*, bool, std::vector<int>, std::vector<int>>>>* models) { ... for (auto& operation : model->model_.operations) { if (_flags_[operation_index] && !flags[operation_index]) { <----- here may be provide another abstraction for user specificed partition and all way down into other revelant code (such as user specificed ModelPartitioner) flags[operation_index] = true; // Only the operations which are not supported by the previous devices // are added. supported_operations[i].second.insert(&operation); } operation_index++; } // For example we have <model> as follows: // conv2d_0 conv2d_1 // | | // batch_norm_0 batch_norm_1 // | | // relu_0 relu_1 // \ / // \ / // leave out ops(such as operator) // and two devices with support operators listed // <device_id=0, [conv2d_0,batch_norm_0,relu_0, conv2d_1,batch_norm_1,relu_1]> // <device_id=1, [conv2d_0,batch_norm_0,relu_0, conv2d_1,batch_norm_1,relu_1]> // we need to use a interface to partition the model into devices as follows // <device_id=0, {[conv2d_0,batch_norm_0,relu_0], false, [...], [...]}>> // <device_id=1, {[conv2d_1,batch_norm_1,relu_1], false, [...], [...]>>
- 版本、环境信息
1)Paddle Lite 版本:3c61295 (https://github.com/PaddlePaddle/Paddle-Lite/blob/3c61295edf66eb5c24e7c98b604c14a1bd4457d7/lite/backends/nnadapter/nnadapter/src/runtime/compilation.cc#L380C1-L386C18)
2)Host 环境:Not Revelant
3)预测后端信息:Not Revelant- 复现信息:Nor Relevant
- 建议描述:Nor Relevant
It's good idea, we will consider your suggestion in the future.
Now we provide another solution, please check https://www.paddlepaddle.org.cn/lite/v2.12/develop_guides/nnadapter.html
from paddle-lite.
Related Issues (20)
- predictor.run()之后无结果 HOT 2
- 树莓派4b上跑自己的nb模型结果图片没有识别框 HOT 7
- 使用经过paddle-lite-opt优化后的模型,在压测环境下报错(fread(dst, 1, size, file_) == size): 0!==262288 Failed to read 262288 bytes. HOT 4
- V4 OCR的检测模型,导出为atlas格式后,无法跑在atlas 300ipro上 HOT 1
- arm的推理结果正确,opencl的结果不正确,请问如何做逐层的精度对比分析? HOT 3
- Object Detection运行run脚本的时候报错 HOT 6
- 华为Atlas300I(3010,昇腾310)安装Paddle-Lite运行例程出错 HOT 4
- Paddle-Lite通过X2Paddle转化出的nb模型出错 HOT 2
- [BUG] sort_cpuid_by_max_freq()中的bubble sort代码逻辑错误 HOT 4
- 基于Paddle Lite框架下的编译问题 HOT 3
- Android端推理LightGlue模型crash了 HOT 1
- ubuntu 22.04 x64 编译paddle-lite x86出错 lite/CMakeFiles/publish_inference.dir/rule HOT 2
- .pdmodel转换.nb失败,报错Check failed: it != outputs_.end(): HOT 18
- 3399 编译with_opencl后运行示例mobilenetv1_light_api显示不支持opencl HOT 1
- 使用华为NPU推理pp-yoloe-r模型报错,提示cann版本不匹配 HOT 15
- could not create a descriptor for a pooling forward propagation primitive HOT 1
- "树莓派5 编译错误"- v2.13 编译报错、环境信息: (Linux raspberrypi 6.6.28+rpt-rpi-2712 #1 SMP PREEMPT Debian 1:6.6.28-1+rpt1 (2024-04-22) aarch64 GNU/Linux) HOT 21
- 预编译库的V2,12下载的压缩包里没有找到python,我要怎么继续下一步得到python--->install--->dist--->paddlelite-*.whl HOT 1
- "树莓派5 编译错误"- v2.13 编译报错 cd09a8e01、环境信息:(Debian arm64 ----armv8 ) ,经检查“cd09a8e01”是git describe --always 值 HOT 3
- 编译无法生成inference_lite_lib.armlinux.armv8.opencl包 HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from paddle-lite.