Giter VIP home page Giter VIP logo

Comments (6)

yinfan98 avatar yinfan98 commented on July 27, 2024

是两个文件,具体是什么问题呢?

from ppl.pmx.

yinfan98 avatar yinfan98 commented on July 27, 2024

转换的目的是为了适配pmx自己的RoPE逻辑,然后后续会为了适配量化做这一步转换。

from ppl.pmx.

Flynn-Zh avatar Flynn-Zh commented on July 27, 2024

是两个文件,具体是什么问题呢?

怎么进一步转换成 onnx 或者 pmx 格式?用 ppl.llm.serving 启动,提升 pmx 或者 onnx 文件不存在

from ppl.pmx.

yinfan98 avatar yinfan98 commented on July 27, 2024

怎么进一步转换成 onnx 或者 pmx 格式?用 ppl.llm.serving 启动,提升 pmx 或者 onnx 文件不存在

继续Export.py导出模型,就能获得onnx格式的文件

from ppl.pmx.

Flynn-Zh avatar Flynn-Zh commented on July 27, 2024

怎么进一步转换成 onnx 或者 pmx 格式?用 ppl.llm.serving 启动,提升 pmx 或者 onnx 文件不存在

继续Export.py导出模型,就能获得onnx格式的文件
试过了,继续 Export 导出模型,有大量的警告, Warning: The shape interface of opmx::XX(如 ParallelEmbedding、ColumnParallelLinear、Reshape等) type is missing,用转出来的 onnx 格式的文件启动 ppl_llm_server,提示 unsupported op: domain[opmx], type[ParallelEmbedding]

from ppl.pmx.

yinfan98 avatar yinfan98 commented on July 27, 2024

@Flynn-Zh 更具体的可能需要问下 @Alcanderian or @Jzz24

from ppl.pmx.

Related Issues (10)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.