Comments (3)
@jwanga, would you please install https://github.com/microsoft/onnxruntime-extensions and pass the get_library_path() as the arguments like?:
convert_onnx_models_to_ort.py --custom_op_library CUSTOM_OP_LIBRARY
Please let us know if it doesn't work.
from olive.
That worked. Thank you, @guotuofeng
from olive.
Hi @guotuofeng
I am trying similar thing using following code snippet
from transformers import WhisperProcessor from optimum.onnxruntime import ORTModelForSpeechSeq2Seq
model_name = "openai/whisper-large-v2"
processor = WhisperProcessor.from_pretrained(model_name)
model = ORTModelForSpeechSeq2Seq.from_pretrained(model_name, export=True)
model.save_pretrained('dir_path')
on the given dir path, some .onnx flles created. But how to make a single .onnx file.
Following command gives error
root@xyx:/workspace/Olive/examples/whisper# python -m olive.workflows.run --config whisper_gpu_fp32.json --setup
Traceback (most recent call last):
File "/opt/conda/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/opt/conda/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/opt/conda/lib/python3.8/site-packages/olive/workflows/run/main.py", line 16, in
run(**vars(args))
File "/opt/conda/lib/python3.8/site-packages/olive/workflows/run/run.py", line 129, in run
input_model = config.input_model.create_model()
File "/opt/conda/lib/python3.8/site-packages/olive/model.py", line 167, in create_model
return REGISTRYself.type.lower()
File "/opt/conda/lib/python3.8/site-packages/olive/model.py", line 558, in init
self.hf_config = validate_config(hf_config, HFConfig) if hf_config else None
File "/opt/conda/lib/python3.8/site-packages/olive/common/config_utils.py", line 242, in validate_config
config = instance_class(**config)
File "pydantic/main.py", line 406, in pydantic.main.BaseModel.init
pydantic.error_wrappers.ValidationError: 2 validation errors for HFConfig
components -> 0 -> io_config
value is not a valid dict (type=type_error.dict)
components -> 1 -> io_config
value is not a valid dict (type=type_error.dict)
from olive.
Related Issues (20)
- models_rank.json issue HOT 4
- Whisper model converted via onnxruntime 1.17.1 won't work HOT 5
- Whisper-medium conversion failed HOT 8
- Whisper model does not work If you add a flag --enable_timestamps HOT 7
- whisper pipeline corrupting the model, unable to run on DML EP HOT 1
- GenAIModelExporter Component - parameter mismatch HOT 3
- Missing dependency: psutil HOT 2
- [FR]: FlashAttention support for Whisper HOT 1
- pydantic.error_wrappers.ValidationError: 7 validation errors for RunConfig HOT 1
- Olive workflow for mistral model optimization does not work HOT 17
- Exception while running SD XL: Not enough memory resources are available to complete this operation HOT 1
- UnboundLocalError: local variable 'output_model_json' referenced before assignment HOT 9
- Error with search strategic.py 'Conversion Merged" has no output models for Llama2 optimization HOT 2
- NOT_IMPLEMENTED : Could not find an implementation for BeamSearch(1) node with name 'BeamSearch_node' HOT 6
- I don't have models/optimized/llama_v2 folder after I've run python llama_v2.py --optimize HOT 8
- [Bug] Optimization step for unet fails after 'Protobuf parsing failed' HOT 10
- SDXL crashing when trying to run HOT 3
- This is an invalid model HOT 4
- Conversion of some models are buggy
- Any workarounds to convert phi-2 model on Windows HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from olive.