Comments (1)
To realize the performance / memory benefits, operators need to be implemented to support INT8 on specific hardware. For further information it would be helpful to open an issue in the microsoft/onnxruntime repository. Thanks. Closing the issue here for now. Please feel free to link the new issue here if you are creating one in microsoft/onnxruntime.
from onnx.
Related Issues (20)
- The model is converted to onnx format using dynamic batch precision collapse HOT 8
- Compatibility with numpy>=2.0
- version_converter can't convert model to opset21 HOT 4
- ONNX check SIGSEV when checking the attached model HOT 3
- Tensor and Integer Comparison Problem in ONNX Export HOT 4
- reporting a vulnerability of download_model function HOT 12
- How can "then_branch" and "else_branch" of "if-op" support input from out of subgraph? HOT 12
- ONNX checker does not validate C90 identifier compatibility. HOT 7
- onnx.reference: Cast to float8e4m3fnuz treats +/-inf wrong HOT 2
- Why Exporation into ONNX will cost way much higher RAM? HOT 1
- External Data Conversion is not saving most data with alignment support. Therefore, mmap support disabled for these initializers
- `numpy_helper.from_array` fails with `onnx._custom_element_types` `int4` and `uint4` HOT 3
- onnx.utils.extract_model failed to extract subgraph from whisper-tiny-decoder HOT 2
- pytorch2onnx CheckerError: Node .. input 0 is marked single but has an empty string in the graph
- Create 1.16.2 release? HOT 12
- ai.onnxruntime.OrtException: Unexpected number of requestedOutputs & pinnedOutputs, expected [1,1) found 2 HOT 1
- The `infer_node_outputs` can not handle the optional inputs.
- How to load multipart model multilingual-e5-large to Spring AI, how to combine .onnx and .onnx-data to single file/byte array? HOT 17
- Vague response from quantised onnx model HOT 1
- Shape inference for Reshape does not infer rank when it could HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from onnx.