talreiss / factor Goto Github PK

I want to use face-forgery and test two video , one is the real and other is fake.
So I use FaceX-Zoo to get the .npy files. But I don't know how to build the label.npy.
Should I use an array like [1, 2.....] and convert it to nparry and save as the .npy ?

My dataset like:

/content/output_data/
├── fakeobama
│   ├── frame0.jpg
│   ├── frame100.jpg
│   ├── frame101.jpg
│   ├── frame102.jpg
      └── frame9.jpg
└── realobama
    ├── frame0.jpg
    ├── frame100.jpg
    ├── frame101.jpg
    └── frame9.jpg

How can we test this model on a custom data(video) ? Is it necessary to download the whole FakeAV dataset to run the audio-visual model on a custom deepfake/real video ? I would be really thankful if you could guide me through.

Thanks
Shivin

Hello,

I tested the face_frogery method with the CelebDF Dataset. I used /Celeb_real for identity references and /Celeb_synthesis for the claimed identities. As in the paper I used 32 frames for each video. Unfortunnatly I cannot found the results I expected to obtain with the paper statistics and have around 50% AUC (so nothing done).

Can you give me some infos on what I didn't understand?

I am getting this error while running face_sdk/detect_and_align.py.

  File "/home//Downloads/FACTOR/FaceX-Zoo/face_sdk/detect_and_align.py", line 2, in <module>
    from core.model_handler.face_alignment.FaceAlignModelHandler import FaceAlignModelHandler
  File "/home//Downloads/FACTOR/FaceX-Zoo/face_sdk/core/model_handler/face_alignment/FaceAlignModelHandler.py", line 7, in <module>
    logging.config.fileConfig("config/logging.conf")
  File "/usr/lib/python3.10/logging/config.py", line 80, in fileConfig
    handlers = _install_handlers(cp, formatters)
  File "/usr/lib/python3.10/logging/config.py", line 135, in _install_handlers
    section = cp["handler_%s" % hand]
  File "/usr/lib/python3.10/configparser.py", line 965, in __getitem__
    raise KeyError(key)
KeyError: 'handler_fileHandlers'

can you tell me what python version you have used ??

I was trying to install the stuffs needed by running 'pip install -r requirements.txt' but im getting an error while installing faiss-gpu
" WARNING: Generating metadata for package faiss-gpu produced metadata for project name faiss-cpu. Fix your #egg=faiss-gpu fragments.
Discarding https://files.pythonhosted.org/packages/51/85/7a7490dbecaea9272953b88e236a45fe8c47571a069bc28b352f0b224ea3/faiss-gpu-1.7.1.tar.gz (from https://pypi.org/simple/faiss-gpu/): Requested faiss-cpu from https://files.pythonhosted.org/packages/51/85/7a7490dbecaea9272953b88e236a45fe8c47571a069bc28b352f0b224ea3/faiss-gpu-1.7.1.tar.gz (from -r requirements.txt (line 14)) has inconsistent name: expected 'faiss-gpu', but metadata has 'faiss-cpu'
ERROR: Could not find a version that satisfies the requirement faiss-gpu==1.7.1 (from versions: 1.5.3, 1.6.0, 1.6.1, 1.6.3, 1.6.4, 1.6.4.post2, 1.6.5, 1.7.0, 1.7.1, 1.7.1.post1, 1.7.1.post2)
ERROR: No matching distribution found for faiss-gpu==1.7.1"

This is the error, can you look into it?

发生异常: ConfigKeyError
Key 'input_modality' not in 'AVHubertPretrainingConfig'
full_key: input_modality
reference_type=Optional[AVHubertPretrainingConfig]
object_type=AVHubertPretrainingConfig
File "/work/liuzehua/task/DF/FACTOR/av_hubert/fairseq/fairseq/dataclass/utils.py", line 507, in merge_with_parent
merged_cfg = OmegaConf.merge(dc, cfg)
File "/work/liuzehua/task/DF/FACTOR/av_hubert/fairseq/fairseq/tasks/init.py", line 40, in setup_task
cfg = merge_with_parent(dc(), cfg, remove_missing=remove_missing)
File "/work/liuzehua/task/DF/FACTOR/av_hubert/avhubert/hubert_asr.py", line 465, in build_model
task_pretrain = tasks.setup_task(w2v_args.task)
File "/work/liuzehua/task/DF/FACTOR/av_hubert/fairseq/fairseq/models/init.py", line 106, in build_model
return model.build_model(cfg, task)
File "/work/liuzehua/task/DF/FACTOR/av_hubert/fairseq/fairseq/tasks/fairseq_task.py", line 355, in build_model
model = models.build_model(cfg, self, from_checkpoint)
File "/work/liuzehua/task/DF/FACTOR/av_hubert/fairseq/fairseq/checkpoint_utils.py", line 502, in load_model_ensemble_and_task
model = task.build_model(cfg.model, from_checkpoint=True)
File "/work/liuzehua/task/DF/FACTOR/av_hubert/avhubert/inference.py", line 131, in
models, saved_cfg, task = checkpoint_utils.load_model_ensemble_and_task([ckpt_path])
omegaconf.errors.ConfigKeyError: Key 'input_modality' not in 'AVHubertPretrainingConfig'
full_key: input_modality
reference_type=Optional[AVHubertPretrainingConfig]
object_type=AVHubertPretrainingConfig

in utils.py merged_cfg = OmegaConf.merge(dc, cfg)
how to fix this question