Comments (5)
Hangz-nju-cuhk
commented on June 17, 2024
由于是多个stage分开训练，训练代码暂时还没有开放。在models/av_model.py中其实已经把训练的所有模块和loss列出来了，目前可以参考论文和这部分代码。直接复现会存在有一定难度。
from talking-face_pc-avs.
dourcer
commented on June 17, 2024
由于是多个stage分开训练，训练代码暂时还没有开放。在
models/av_model.py中其实已经把训练的所有模块和loss列出来了，目前可以参考论文和这部分代码。直接复现会存在有一定难度。
谢谢，希望早日开源训练代码细节。
from talking-face_pc-avs.
dourcer
commented on June 17, 2024
中文嘴巴抖动问题可否通过调参改善？
avconcat.mp4
from talking-face_pc-avs.
Hangz-nju-cuhk
commented on June 17, 2024
可能可以通过扩充中文数据集进行训练解决，我观察了一下主要问题是在英语中不常见的音，比如”曾是整个岳西县、产业“，"ceng, zheng, xian, chan" 都是英文训练数据很难cover的场景。
from talking-face_pc-avs.
dourcer
commented on June 17, 2024
十分感谢，我有另外一个问题，原始图片经过cv2.warpAffine仿射变换后得到224224的图像进行图片生成是可以的，但是如图我从原始图像上直接裁剪出224224与仿射变换后相似的图像生成的质量就很差。这样就有一个问题，经过仿射变换后生成的图像是否可以还原到原图？例
from talking-face_pc-avs.
Related Issues (20)
- stack expects a non-empty TensorList HOT 2
- 关于评价指标
- "Train your own model" Release date HOT 7
- Lip jitter(嘴唇频繁抖动)
- 找不到训练后的文件夹
- why embedding the audio features
- Does training procedure need any other py file or module that I have to make on my own?
- How to run the repo (inference) on CPU?
- Why start from 2?
- Code coming soon ？ HOT 1
- ffmpeg: not found
- demo_id.csv missing HOT 1
- TypeError: mel() takes 0 positional arguments but 2 positional arguments (and 3 keyword-only arguments) were given HOT 1
- 推理结果人脸模糊无五官
- 已创建中文的讨论组想加入的请添加微信xaaheng
- can this project run in real-time?
- ./checkpoints/demo_id/latest_net_A.pth not exists yet! HOT 1
- where is mapping function?
- About mouth_source
- 我们创建了一个中文讨论组，有需要的加我微信douzijun1999
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from talking-face_pc-avs.