scaredyfish / blender-rhubarb-lipsync Goto Github PK
View Code? Open in Web Editor NEWBlender Rhubarb Lipsync is an addon for Blender integrating Rhubarb Lip Sync to automatically generate mouth-shape keyframes from a pose library.
Blender Rhubarb Lipsync is an addon for Blender integrating Rhubarb Lip Sync to automatically generate mouth-shape keyframes from a pose library.
Hello,
Is it possible to export a blender model with lip sync added to it as a GLTF file ?
Can I pass the Sound File and Dialog File from a different path to GLTF file
Please let me know the steps.
Regards
Shafi
点击生成的时候没有任何反应
Python: Traceback (most recent call last):
File "C:\Users\asus\AppData\Roaming\Blender Foundation\Blender\3.0\scripts\addons\blender-rhubarb-lipsync-master\op_blender_rhubarb.py", line 122, in invoke
os.chmod(executable, 0o744)
FileNotFoundError: [WinError 3] The system cannot find the path specified: 'C:\Users\asus\AppData\Roaming\Blender Foundation\Blender\3.0\scripts\addons/blender-rhubarb-lipsync/bin/rhubarb.exe'
location: :-1
this comes when I press Rhubarb lipsync. plz give solution
Python: Traceback (most recent call last):
File "C:\Users\chris\AppData\Roaming\Blender Foundation\Blender\2.93\scripts\addons\blender-rhubarb-lipsync-master\op_blender_rhubarb.py", line 122, in invoke
os.chmod(executable, 0o744)
FileNotFoundError: [WinError 2] The system cannot find the file specified: 'C:\Users\chris\Desktop\Design\3D\Blender\Sketches\Lip Sync\rhubarb.exe'
location: :-1
I have tried this addon on blender and it has worked well with clips of sound like less than10 seconds.
However,when I tried to apply a sound file like 30 seconds, it failed to generate the anime and stuck in the beginning process.
I looked into the system console (Window->Toggle System Console on Windows) and it showed me that a step seemed to be lost,which is:
Type progress value(from 0.00 to 1.00),log level trace message progress (om 0% to 100%)
I guess it failed because this process above didn't showed in my console, which showed on it when I use a short sound.
I open up the Blender Console and click "Rhubarb Lipsync" and watch the progress update until 99% and then it stops.
Outside of Blender I ran Rhubarb lipsync on the same audio file with no problem so it's likely the "all done" mesg that Rhubarb sends isn't being received by Blender, so Blender sits and waits.
I'm looking into the code to see if I can find anything beween the newest Rhubarb Version and this Addon, but I'm new to Python and don't expect to figure it out.
I have installed the version blender-rhubarb-lipsync-windows-3.0.2 but in blender 3.1 the button of Rhubarb Lipsync to start the lipsyn do nothing.... :(
Hi - I'm not sure is I should be asking this of you or the creator of Rhubarb...
I've installed your addon in Blender and downloaded and unzipped Rhubarb, but when I come to select the .exe file I can't find one! There's a batch file, but no .exe.
Do I have to use an older version of Rhubarb?
By the way, I'm currently in the middle of creating a series of tutorials on creating simple automated lipsinc in Blender called Lipsinc for the Lazy in Blender. If I can get this software working, it will make it obsolete! :S but I don't really mind. I want to get it working, and do a tutorial on it.
Hi, i have simple script to regenerate with new audio files, i want render all in backgroun but when i run bpy.ops.object.rhubarb_lipsync() blender closed but addon still work. If you can help me i will be very apretiate.
render lips start
render lips finish
{ "type": "progress", "value": 0.00, "log": { "level": "Trace", "message": "Progress: 0%" } }
Writing userprefs: 'C:\Users\root\AppData\Roaming\Blender Foundation\Blender\2.91\config\userpref.blend' ok
{ "type": "progress", "value": 0.01, "log": { "level": "Trace", "message": "Progress: 1%" } }
{ "type": "progress", "value": 0.02, "log": { "level": "Trace", "message": "Progress: 2%" } }
{ "type": "progress", "value": 0.03, "log": { "level": "Trace", "message": "Progress: 3%" } }
{ "type": "progress", "value": 0.04, "log": { "level": "Trace", "message": "Progress: 4%" } }
Blender quit
{ "type": "progress", "value": 0.05, "log": { "level": "Trace", "message": "Progress: 5%" } }
{ "type": "progress", "value": 0.06, "log": { "level": "Trace", "message": "Progress: 6%" } } (edited)
Good afternoon. You can help me, I did everything, and at the end when I click on the Rhubarb lipsync button, nothing happens. The bones are all highlighted, the text is loaded, and the audio is also loaded.
I thought something was wrong with my project, then I downloaded yours, the same thing. Thank you for your time.
Python: Traceback (most recent call last):
File "C:\Users\liaqu\AppData\Roaming\Blender Foundation\Blender\2.93\scripts\addons\blender-rhubarb-lipsync-master\op_blender_rhubarb.py", line 122, in invoke
os.chmod(executable, 0o744)
FileNotFoundError: [WinError 3] The system cannot find the path specified: 'C:\Users\liaqu\AppData\Roaming\Blender Foundation\Blender\2.93\scripts\addons/blender-rhubarb-lipsync/bin/rhubarb.exe'
location: :-1
it give error like this please help me
Failed to add relation "Transformation"
Could not find op_from: OperationKey(type: BONE, component name: 'ORG-CTR-Nose', operation code: B
Hi,
I'm new to blender but have a decent amount of python experience. I have a .blend file saved with pose library and all. I want to be able to run this add-on with a different audio file each time from the command line. Is there an easy way for your code to be extended for this to be done?
I notice that when I click on the 'Rhubarb lipsync' button in the properties window, a message is sent to the Rhubarb Lip sync Operator, like so:
"{ "type": "start", "file": "...416MECoutput.wav", "log": { "level": "Info", "message": "Application startup. Input file: "416MECoutput.wav"." } }"
Is there a way to send this kind of message over CLI?
Any help is deeply appreciated! Also major props for setting this up! It's super useful
Is it possible to use this addon with a model using shape keys for mouth animation instead of a pose library?
RuntimeError: class OBJECT_OT_rhubarb_lipsync, function modal: incompatible return value , str(, Function.result expected a set, not a NoneType)
location: :-1
When I press the button it processes for a bit but no keyframes are created.
This is not issue. I want to know lisence. I can't find lisence in the read me.
Can I use it to make a video to upload on YouTube? Does it matter if I make a profit from the advertisement?
Don't you have any plans to officially release it in the blender market?
Hello,
I've downloaded the blender rhubarb lipsync addon and trying to install it in Blender version 2.82, on Windows 10 (64 bit). I've downloaded Version 3.0.1, which bundles Rhubarb Lip Sync by Daniel S. Wolf.
I watched and followed the video by YOGYOG, where they're installing the rhubarb.exe via user preferences (though in blender 2.79). rhubarb.exe now is located in bin folder, but when I open the Blender preferences and try to install it, rhubarb.exe is not visible...
Please let me know what I'm doing wrong. I've attached the screen recording just in case... If this is not an appropriate place to ask this question, please direct me to the support, as I wasn't able to find any other support sections elsewhere.
Thanks in advance
rhubarb for blender 3 is not working. I followed a tutorial on you tube for stop motion style animation set up the rig it works. I got to the end of it and it still does nothing, even if I wait awhile for rhubarb to run. I used a short script about three sentences to make sure it worked. nothing happens. No error message. I exported 16 bit wav form using ableton studios. I am using microsoft word for the text. I am using blender 3. Why am I not smart. please help me.
This is not an issue, but an update request. Just wondering if you had plans on updating this addon for Blender 3.2 :)
I want to add more letters shapes for the mouth, Is that possible?
Hello, Thanks for your Support. I tried installing the Rhubarb LipSync for blender 2.8, but an error occurs, it says Upgrade to blender 2.8 Required, please, will you be Supporting the upgrade of rhubarb lipsync to blender 2.8
Nothing shows up in "info" or console, tried Rhubarb v1.10, and included 3.0.1, no luck
The new pose library in asset browser is reusable with other rigs. Can we update this amazing script
Hiya!
3.0.1 works, awesome!
I followed the tutorial and got a working animation https://photos.app.goo.gl/iNHVWmNCa9DURXca8
Problem is using 9 bones for each mouthshape(using grease pencil) the GP dots remain even when scale is zero. So I need to do it with one bone, hooking up time offset. I made the poselib and tested each pose, the bone swaps it perfectly between mouth shapes but when I run Rhubarb lipsync, the poses are not switching. I get the keyframes in action editor but the mouth is not animated 🤒
Im wondering if Rhubarb requires the 9 bones to work or where am I going wrong? Also, if scaling is what makes rhubarb function?
I have been following a Yogyog.org video on using Blender and Rhubarb to lipsync. It is titled "Free automated lipsync Blender, Makehuman + Rhubarb" if that matters.
Anyway
When I tried to run "Rhubarb lipsync" to sync the mouth movements to the text and wav files I uploaded I got the message in the image below.
(did I install Rhubarb incorrectly and how do I fix it, it looks like the error is worried about "locations' too but I am not sure what that means)
(the board said to give this a tag, so I chose addon, I couldn't find Rhubarb or lipsync, anyway, that is why I chose such a general descriptor)
Edit:
I looked at the 4 suggested readings but the error codes were different so I thought I should ask, I don't have a lot of technical expertise so I can't always translate one solution into a way to approach another problem
Windows 11, Blender 3.1.0, add on installed, zip file unzipped and put into a readable spot, sound and text files created, absolute paths used for all filenames but "Rhubarb lipsync" buttons remains grayed out. How can I troubleshoot this?
Hi!
First of all, thanks for such an amazing tool, it's a life saver for us animators ;)
I've been trying to rig a character's mouth in Blender as the one explained in this tutorial:
https://www.youtube.com/watch?v=pxy9gkCXPGc
Basically, it's a texture rig driven by a bone. I've setup the pose library and assigned the corresponding visemes in the rhubarb section of the armature, and when I run the script everything runs as supposed. But it seems like the visemes are not dected and applied correctly. The pacing of the speech does work, but it seems as it doesn't use some specific shapes. For example, there are no AI sounds.
I attach a link to a quick screen recording of my process and testing with different files so you can see if anything I do is not correct.
I'm using blender 3.0.1 and version 3.0.2 of your addon. Can you please help me detect the problem?
Thanks again for your effort and hope to hear soon from you,
I don't have the greatest confidence in my blender skills but I can't get the 3.0 version to install. I'm using blender 2.83 Alpha
When I select the addon to install, I get a splash that it installed but I cant find it in my addon list anywhere.
Hey guys. Can we get a fix for Blender 2.8. This is a really great tool but I cannot for the life of me get it working I just burnt a whole day trying everything I could think of but nothing has worked.
Basically all it does is just stay greyed out and I cannot click the 'run rhubarb' button after creating my pose library..
Thank you for any advise or time.
Please help
If anyone encounter this Typeerror: user_resource()takes 1 positional argument but 2 were given
I cant install rhubarb to 3.1
I followed the tutorial and for me it doesn't show the .exe file.
Hello,
I want to thank you in advance for working on this lipsync project. I am getting an error when I hit the Rhubarb lipsync button in the Blender Addon.
RuntimeError: class OBJECT_OT_rhubarb_lipsync, function modal: incompatible return value , str(, Function.result expected a set, not a NoneType)
location: :-1
I noticed that there is a closed issue with a similar problem. How was it resolved?
Thank you in advance,
Best,
David
Hello there,
I have got some 9 seconds long audio clip for baking but it's only doing starting file of it, maybe mere 2 seconds. Anyone could tell why?
I downloaded the zip file here and tried to run the addon on my blender file, however I keep getting a Import Error. The message reads:
Traceback (most recent call last):
File "C:\Program Files\Belnder Foundation\Blender\2.79\scripts\modules\addon_utils.py", line 331, in enable
mod =import(module_name)
File "C:\Program Files\Belnder Foundation\Blender\2.79\scripts\addons\blender-rhubarb-lipsync-master_init_.py", line 27, in
from . import op_blender_rhubarb, pnl_blender_rhubarb, prefs_blender_rhubarb
File "C:\Program Files\Belnder Foundation\Blender\2.79\scripts\addons\blender-rhubarb-lipsync-master\op_blender_rhubarb.py", line 7, in
import select
ImportError: DLL load failed: %1 is not a valid Win 32 application.
I am really hoping you can help me out! Thank you so much.
The addon is lovely and worked quite well in blender 2.9 but it does run into errors when we move over to 3.0. Could you please help me. I couldnt figure out how to add pictures but someone else did post this exact issue.
Error!!!
{ "type": "start", "file": "C:\Users\\u674e\u6d9b\Desktop\1.wav", "log": { "level": "Info", "message": "Application startup. Input file: C:\Users\\u674e\u6d9b\Desktop\1.wav." } }
{ "type": "progress", "value": 0.00, "log": { "level": "Trace", "message": "Progress: 0%" } }
{ "type": "progress", "value": 0.01, "log": { "level": "Trace", "message": "Progress: 1%" } }
{ "type": "progress", "value": 0.02, "log": { "level": "Trace", "message": "Progress: 2%" } }
{ "type": "progress", "value": 0.03, "log": { "level": "Trace", "message": "Progress: 3%" } }
{ "type": "progress", "value": 0.04, "log": { "level": "Trace", "message": "Progress: 4%" } }
{ "type": "progress", "value": 0.05, "log": { "level": "Trace", "message": "Progress: 5%" } }
{ "type": "progress", "value": 0.06, "log": { "level": "Trace", "message": "Progress: 6%" } }
Error!!!
{ "type": "start", "file": "C:\Users\\u674e\u6d9b\Desktop\1.wav", "log": { "level": "Info", "message": "Application startup. Input file: C:\Users\\u674e\u6d9b\Desktop\1.wav." } }
{ "type": "progress", "value": 0.00, "log": { "level": "Trace", "message": "Progress: 0%" } }
{ "type": "progress", "value": 0.01, "log": { "level": "Trace", "message": "Progress: 1%" } }
{ "type": "progress", "value": 0.02, "log": { "level": "Trace", "message": "Progress: 2%" } }
{ "type": "progress", "value": 0.03, "log": { "level": "Trace", "message": "Progress: 3%" } }
{ "type": "progress", "value": 0.04, "log": { "level": "Trace", "message": "Progress: 4%" } }
{ "type": "progress", "value": 0.05, "log": { "level": "Trace", "message": "Progress: 5%" } }
{ "type": "progress", "value": 0.06, "log": { "level": "Trace", "message": "Progress: 6%" } }
Error!!!
The current version of Rhubarb for Blender 2.0.1 is not compatible with the latest release fo Mac OS, Catalina. Is there a newer version of the Blender addon?
It should only run rhubarb if the audio or script file has changed. Otherwise, it should just update the key frames etc. based on the last rhubarb output.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.