Able to load the editor from localhost:7680/openpose_editor_index and all features there seem to work as intended, but ControlNet preview won't show the Edit button to call the editor as a pop-in:

Checked HTML elements to be sure, nothing there, figured the wrapper is missing something

Environment:
-Firefox on Win11
-ControlNet v1.1.202
-Stable-diffusion-webui v1.3.0

Things tried so far:
-MS Edge instead of Firefox
-Light theme instead of dark theme
-Monitor browser console for obvious errors (none that I could see)
-Downgrade ControlNet to 1.1.195 (couldn't find exact v1.1.200 as seen in screenshots)
-Latest npm build (index-43d10c71.css / index-92e8b891.js) instead of package dist v0.0.3 (index-3970bfb1.js / index-e3a1963d.css)

Not too familiar with Vue/Gradio so not sure where to troubleshoot from there

Love the concept though, hope this extension goes far

Greetings, i don´t have have the buttons in the Preprossesor window to -send it to...

1. downld. as img.png
2. downld. pose.json
3. close
   i checked the dist. folder as mentioned, everything is there, i´m lost

autom.1111 v.1.3.2, phython 3.10.11, torch 2.0.1+cu118, xformers 0.0.17, gradio 3.32.0, checkpoint 33c9f6dfcb

Getting this error message at startup:

23:50:36-974230 ERROR    executing callback: C:\AI\automatic\extensions\sd-webui-openpose-editor\scripts\openpose_editor.py app_started_callback: RuntimeError
╭──────────────────────────────────────────────────────────────────────────── Traceback (most recent call last) ─────────────────────────────────────────────────────────────────────────────╮
│ C:\AI\automatic\modules\script_callbacks.py:134 in app_started_callback                                                                                                                    │
│                                                                                                                                                                                            │
│   133 │   │   │   t0 = time.time()                                                                                                                                                         │
│ ❱ 134 │   │   │   c.callback(demo, app)                                                                                                                                                    │
│   135 │   │   │   timer(t0, c.script, 'app_started')                                                                                                                                       │
│                                                                                                                                                                                            │
│ C:\AI\automatic\extensions\sd-webui-openpose-editor\scripts\openpose_editor.py:99 in mount_openpose_api                                                                                    │
│                                                                                                                                                                                            │
│    98 │   │   "/openpose_editor",                                                                                                                                                          │
│ ❱  99 │   │   StaticFiles(directory=DIST_DIR, html=True),                                                                                                                                  │
│   100 │   │   name="openpose_editor",                                                                                                                                                      │
│                                                                                                                                                                                            │
│ C:\AI\automatic\venv\lib\site-packages\starlette\staticfiles.py:57 in __init__                                                                                                             │
│                                                                                                                                                                                            │
│    56 │   │   if check_dir and directory is not None and not os.path.isdir(directory):                                                                                                     │
│ ❱  57 │   │   │   raise RuntimeError(f"Directory '{directory}' does not exist")                                                                                                            │
│    58                                                                                                                                                                                      │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
RuntimeError: Directory 'extensions/sd-webui-openpose-editor/dist' does not exist

Tested on Windows 11, SD Next (Version: 9726b4d2), ControlNet v1.1.217, Python 3.10.10

Build: c604d36

See discussion #20 (comment)

This feature should make the fabric canvas behaves like a photoshop window. The window size is fixed, while the canvas inside the window can be zoomed in/out, and change H/W ratio, change size, etc.

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

Openpose editor not found when it is installed and localhost webpage works,
edit button has strikethrough on controlnet and says
Openpose editor not found. Please make sure you have an openpose editor available on /openpose_editor_index. To hide the edit button, you can check "Disable openpose edit" in Settings.
Following extension(s) provide integration with ControlNet:

huchenlei/sd-webui-openpose-editor

Steps to reproduce the problem

1. Go to controlnet

2. Press edit

3. a page will pop up saying Openpose editor not found. Please make sure you have an openpose editor available on /openpose_editor_index. To hide the edit button, you can check "Disable openpose edit" in Settings.
   Following extension(s) provide integration with ControlNet:

   huchenlei/sd-webui-openpose-editor

What should have happened?

it shouldve worked

Commit where the problem happens

webui: most recent
controlnet: most recent
openpose-editor: most recent

What browsers do you use to access the UI ?

Mozilla Firefox

Command Line Arguments

--opt-sdp-attention --no-half --autolaunch --theme dark --no-half-vae --medvram --api

Console logs

Launching Web UI with arguments: --opt-sdp-attention --no-half --autolaunch --theme dark --no-half-vae --medvram --api
No module 'xformers'. Proceeding without it.
Additional Network extension not installed, Only hijack built-in lora
LoCon Extension hijack built-in lora successfully
[-] ADetailer initialized. version: 23.8.1, num models: 9
2023-08-31 00:10:04,854 - ControlNet - INFO - ControlNet v1.1.313
ControlNet preprocessor location: D:\STABLE\stable-diffusion-webui\extensions\sd-webui-controlnet\annotator\downloads
2023-08-31 00:10:05,006 - ControlNet - INFO - ControlNet v1.1.313
Loading weights [cca17b08da] from D:\STABLE\stable-diffusion-webui\models\Stable-diffusion\darkSushiMixMix_225D.safetensors
Creating model from config: D:\STABLE\stable-diffusion-webui\configs\v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 15.3s (launcher: 3.3s, import torch: 3.9s, import gradio: 1.2s, setup paths: 0.8s, other imports: 0.8s, load scripts: 2.9s, initialize extra networks: 0.3s, create ui: 0.5s, gradio launch: 0.4s, app_started_callback: 1.0s).
Applying attention optimization: sdp... done.
Model loaded in 12.9s (load weights from disk: 0.3s, create model: 1.0s, apply weights to model: 11.2s, load textual inversion embeddings: 0.2s, calculate empty prompt: 0.2s).
2023-08-31 00:10:37,709 - ControlNet - INFO - Preview Resolution = 512

Browser logs

dont know what this is

Additional information

windows 11

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

Describe the bug
Chrome report 404 error, the path https://my_stable_diffusion_domain/openpose_editor_index

{"detail":"Not Found"}

To Reproduce
Steps to reproduce the behavior:

After installation, only.

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots

Environment

• OS: [e.g. iOS] Windows (Server on Linux x64)
• Browser [e.g. chrome, safari] Chrome

Additional context
Add any other context about the problem here.

Steps to reproduce the problem

install only

What should have happened?

work normally

Commit where the problem happens

webui:
controlnet:
openpose-editor:

What browsers do you use to access the UI ?

No response

Command Line Arguments

No

Console logs

No

Browser logs

Such as the pic.

Additional information

No response

Sometimes in odd poses, the body may be calculated by ControlNet to be inverted (the left objects are actually right objects and vice versa, like left shoulder is supposed to be the right shoulder).

Editing the JSON file to accommodate this is very tricky as the values are not tied to a human-readable variable. Can there be a "Mirror body" option?

云端部署的实例，controlnet处理后的姿态图片和手动上传的json文件都无法在画布上显示，原图有时能在画布上显示，但是比例并不正确，没有错误信息

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

When the space bar is pressed, the page starts to scroll down. Zooming and panning is not possible.

Steps to reproduce the problem

1. Press space bar

What should have happened?

Possibility to zoom and pan

Commit where the problem happens

webui: SD:next / automatic Version: c0a824d8 Mon Jun 5 10:32:08 2023 -0400
controlnet: v1.1.217
openpose-editor: v0.0.11?

What browsers do you use to access the UI ?

Mozilla Firefox

Command Line Arguments

--listen --insecure --theme=dark --disable-queue

Console logs

n/a

Browser logs

n/a

Additional information

I want to point out, that the model box is not very well implemented. The overflow of the box makes navigating difficult.
The correct way would be to have a page centered box, that adjust itself in height and inside that the iframe with 100% height.

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

When WebUI is served via https, the editor cannot be loaded.

Steps to reproduce the problem

1. Load A1111 WebUI from https
2. Upload any image and run OpenPose preprocessor
3. Click 'edit' in preprocessor preview
4. sd-webui-openpose-editor won't load (only blank popup)

What should have happened?

sd-webui-openpose-editor should load properly when WebUI is served via https.

Commit where the problem happens

webui: v1.3.2
controlnet: v1.1.220 (2598ca9e78f167014c6556cb89dab792a745749f)
openpose-editor: 8843a7e

What browsers do you use to access the UI ?

Google Chrome

Command Line Arguments

--opt-sdp-attention --port 3000 --listen --enable-insecure-extension-access

Console logs

2023-06-19T05:40:16.655422611Z Launching Web UI with arguments: -f --opt-sdp-attention --port 3000 --listen --enable-insecure-extension-access
2023-06-19T05:40:16.655428674Z No module 'xformers'. Proceeding without it.
2023-06-19T05:40:16.655434936Z 2023-06-19 05:40:16,654 - ControlNet - INFO - ControlNet v1.1.220
2023-06-19T05:40:16.759052762Z ControlNet preprocessor location: /workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/downloads
2023-06-19T05:40:16.759086344Z 2023-06-19 05:40:16,758 - ControlNet - INFO - ControlNet v1.1.220
2023-06-19T05:40:18.063265705Z Loading weights [07934daabe] from /workspace/stable-diffusion-webui/models/Stable-diffusion/majicmixLux_v1.safetensors
2023-06-19T05:40:18.063301038Z *Deforum ControlNet support: enabled*
2023-06-19T05:41:44.319144943Z Running on local URL:  http://0.0.0.0:3000
2023-06-19T05:41:44.319192075Z 
2023-06-19T05:41:44.319199585Z To create a public link, set `share=True` in `launch()`.
2023-06-19T05:41:44.319206666Z Startup time: 6.7s (import torch: 1.3s, import gradio: 1.7s, import ldm: 0.4s, other imports: 0.7s, setup codeformer: 0.3s, load scripts: 1.1s, create ui: 0.9s, gradio launch: 0.4s).
2023-06-19T05:41:44.319213204Z Creating model from config: /workspace/stable-diffusion-webui/configs/v1-inference.yaml
2023-06-19T05:41:44.319219558Z LatentDiffusion: Running in eps-prediction mode
2023-06-19T05:41:44.319225451Z DiffusionWrapper has 859.52 M params.
2023-06-19T05:41:44.319231225Z Applying optimization: sdp... done.
2023-06-19T05:41:44.319237257Z Textual inversion embeddings loaded(3): badhandv4, easynegative, ng_deepnegative_v1_75t
2023-06-19T05:41:44.319243560Z Model loaded in 4.4s (load weights from disk: 1.5s, create model: 0.7s, apply weights to model: 0.9s, apply half(): 0.5s, load VAE: 0.4s, move model to device: 0.3s).
2023-06-19T05:41:44.319255022Z 2023-06-19 05:41:44,318 - ControlNet - INFO - Preview Resolution = 512

Browser logs

Mixed Content: The page at 'https://xxxx:3000/' was loaded over HTTPS, but requested an insecure resource 'http://100.65.14.206:60892/openpose_editor_index/'. This request has been blocked; the content must be served over HTTPS.
openpose_editor.js?1686250245.0:3 Uncaught (in promise) TypeError: Failed to fetch
    at checkEditorAvailable (openpose_editor.js?1686250245.0:3:23)
    at openpose_editor.js?1686250245.0:99:1

Additional information

No response

Previously, due to fabricjs conflict with Vuejs proxy, the grouped objects cannot be rotate or scaled. When the user move the cursor onto any of the controlpoint, it will always show the move icon.

After v0.1.0, this issue should be solved. There might still be display bugs on the canvas, where keypoints and connections are out of place, but I have not found consistent reproduction of it. If you meet any display problems, please feel free to submit a bug report. Thanks!

Read more details on #14.

添加右手但显示的是left hand

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

Openpose editor window very narrow, unable to enlarge

Steps to reproduce the problem

1. Go to openpose controlnet
2. Upload image, generate preview
3. Press "Edit"
4. Resulting preview window is skewed / narrow / unable to scale

What should have happened?

Open a readable window, square

Commit where the problem happens

webui: app=sd.next updated=2023-11-30 hash=c957a2fb
controlnet: 10bd9b25 Wed Nov22 2023 05:43
openpose-editor: a3d13af Tue Nov21 2023 04:40

What browsers do you use to access the UI ?

No response

Command Line Arguments

None

Console logs

will be provided if needed

Browser logs

will be provided if needed

Additional information

No response

Currently, in order to hide a keypoint, the user need to find the corresponding row in pose control panel first, which is a lot of friction. Hide keypoint by right clicking can greatly reduce this friction.

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

Hi, in WebUI I cant find how to get it, no button, no tab, nothing . Sorry but can you tell me how to have access to this dialog interface from controlnet or UI ? Thanks

Steps to reproduce the problem

1. load the plugin
2. go to txt2img or img2img
3. search the interface ...

What should have happened?

a tab or a button to access to the openpose

Commit where the problem happens

Python 3.10.6 (v3.10.6:9c7b4bd164, Aug 1 2022, 17:13:48) [Clang 13.0.0 (clang-1300.0.29.30)]
Commit hash: 955df7751eef11bb7697e2d77f6b8a6226b21e13

What browsers do you use to access the UI ?

No response

Command Line Arguments

./webui.sh

Console logs

nothing to see...

Browser logs

nothing to see...

Additional information

No response

Hello.

I've noticed that the extension doesn't work on Runpod (I get a blank page when I open the editing window).

I don't know how the extension works in detail, but I imagine it's because the FastAPI server is only accessible via localhost:7860.

I imagine this is the case for any Automatic1111 server that runs in a docker.

Are there any plans to address this issue?

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

in sd-webui controlnet click edit to edit the pose, the canvas not show up

Steps to reproduce the problem

1. Go to control net
2. Upload an image and check preview and use preview as input
3. click edit to edit the pose detected

What should have happened?

the canvas show up corretly with pose passed in.

Commit where the problem happens

webui:
version: v1.3.2  •  python: 3.10.6  •  torch: 2.0.0+cu118  •  xformers: N/A  •  gradio: 3.32.0  •  checkpoint: fc2511737a

controlnet: v1.1.224
openpose-editor: 0.16 (f2d5aac5)

What browsers do you use to access the UI ?

edge

Command Line Arguments

webui-user.bat

Console logs

localhost/:16  Uncaught SyntaxError: Unexpected token '{'
vue-i18n.esm-bundler.js:39  You are running the esm-bundler build of vue-i18n. It is recommended to configure your bundler to explicitly replace feature flag globals with boolean literals to get proper tree-shaking in the final bundle.
initFeatureFlags @ vue-i18n.esm-bundler.js:39
App.vue:287  Uncaught (in promise) TypeError: Cannot read properties of undefined (reading 'split')
    at parseDataURLtoJSON (App.vue:287:24)
    at Proxy.loadCanvasFromFrameMessage (App.vue:891:28)
    at App.vue:484:14

Browser logs

Additional information

going through some debug in vscode , the broken is caused by backgroundColor set in here,

      this.canvas = markRaw(new fabric.Canvas(<HTMLCanvasElement>this.$refs.editorCanvas, {
        backgroundColor: '#222222',
        preserveObjectStacking: true,
        fireRightClick: true,
        stopContextMenu: true,
      }));

and there is an error :Background color of canvas instance. Should be set via fabric.StaticCanvas#setBackgroundColor .

according to the error, the issue is fixed by pulling the config out and pass by variable:

  const config = {
          backgroundColor: '#222222',
          preserveObjectStacking: true,
          fireRightClick: true,
          stopContextMenu: true,
        }
      this.canvas = markRaw(new fabric.Canvas(<HTMLCanvasElement>this.$refs.editorCanvas, config));

and then the npm run dev server show the default pose correctly and sd-webui can render the canvas without error

We know that using DWPose can identify the whole body very well including hands

Unfortunately, when moving the hand, the wrist doesn't follow the hand

Is it possible to connect hands and wrists? Thanks

Mikubill/sd-webui-controlnet#2291 implements animal pose detection preprocessor. We should implemenet support for it.

It can be helpful to display a frequently used hand/face/body list so that the user don't need to start from scratch or manually pick a JSON to upload each time a body part is needed.

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

Hello, love this extension

I am unable to 3d rotate the pose. e.g. if the person is facing directly, I am unable to rotate to make the person face 180 degrees away from the camera instead.

How to achieve this? I am willing to code if required

Thank you

Steps to reproduce the problem

1. Choose to select a Pose in ControlNet
2. Notice there is no way to rotate the pose on the vertical Z axis or X axis.

What should have happened?

There should be a way to rotate the pose on vertical Z axis and to also pan the X axis view. We are currently only able to rotate on the Y axis.

Commit where the problem happens

webui:
controlnet:
openpose-editor:

What browsers do you use to access the UI ?

No response

Command Line Arguments

default

Console logs

default

Browser logs

default

Additional information

No response

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

I am not sure if this is caused by extention or the webui fork but I couldnt manage to get it work. The way I use Vlad's forks is point it to my previous a1111 installation to get models, extensions, scripts etc. This also can be another reason for the error, combined with some other issues, i dont know.

Steps to reproduce the problem

1. On Vlad's webui fork, install this repo

What should have happened?

Well.. It should've work 😄

Commit where the problem happens

webui: Vlad  Version: 82095082a Tue Jun 6 15:32:22 2023 -0400
controlnet: 2598ca9e
openpose-editor: b5d80988

What browsers do you use to access the UI ?

No response

Command Line Arguments

--insecure', '--data-dir',
                         '/home/ubuntu/stable-diffusion-webui/', '--listen',
                         '--theme', 'dark', '--disable-safe-unpickle',
                         '--cors-origins', 'http://localhost:9999',
                         '--cors-origins', 'https://www.painthua.com

Console logs

(vlad2) ubuntu@ip-172-31-37-133:~/vlad-webui$ bash webui.sh
Create and activate python venv
Launching launch.py...
22:22:00-253387 INFO     Extension preload: 0.0s
                         /home/ubuntu/vlad-webui/extensions-builtin
22:22:00-257208 INFO     Extension preload: 0.0s
                         /home/ubuntu/stable-diffusion-webui/extensions
22:22:00-258332 INFO     Starting SD.Next
22:22:00-259020 INFO     Python 3.10.11 on Linux
22:22:00-266760 INFO     Version: 82095082a Tue Jun 6 15:32:22 2023 -0400
22:22:00-482815 INFO     Latest published version:
                         4a3ab4ed3193ce82578e951a45dbee188214838c
                         2023-06-08T20:10:39Z
22:22:00-484594 INFO     Setting environment tuning
22:22:00-485546 INFO     nVidia CUDA toolkit detected
22:22:01-563432 INFO     Torch 2.0.1+cu118
22:22:01-608147 INFO     Torch backend: nVidia CUDA 11.8 cuDNN 8700
22:22:01-621710 INFO     Torch detected GPU: NVIDIA A10G VRAM 22581 Arch (8, 6)
                         Cores 80
22:22:01-623287 INFO     Verifying requirements
22:22:01-637496 INFO     Installing packages
22:22:01-646465 INFO     Enabled extensions-builtin:
                         ['stable-diffusion-webui-rembg', 'ScuNET',
                         'a1111-sd-webui-lycoris', 'Lora',
                         'sd-webui-agent-scheduler', 'clip-interrogator-ext',
                         'multidiffusion-upscaler-for-automatic1111', 'LDSR',
                         'sd-webui-controlnet', 'sd-webui-model-converter',
                         'sd-extension-system-info', 'sd-dynamic-thresholding',
                         'SwinIR', 'stable-diffusion-webui-images-browser']
22:22:01-648967 INFO     Enabled extensions: ['Abysz-LAB-Ext',
                         'Stable-Diffusion-Webui-Civitai-Helper',
                         'clip-interrogator-ext',
                         'Auto-Photoshop-StableDiffusion-Plugin',
                         'stable-diffusion-webui-anti-burn',
                         'multidiffusion-upscaler-for-automatic1111',
                         'stable-diffusion-webui-state', 'sd-dynamic-prompts',
                         'canvas-zoom', 'put extensions here.txt',
                         'sd-webui-additional-networks', 'adetailer',
                         'deforum-for-automatic1111-webui',
                         'sd-webui-regional-prompter', 'sd-webui-controlnet',
                         'sd-webui-infinite-image-browsing',
                         'sd-webui-openpose-editor', 'sdweb-merge-board',
                         'OneButtonPrompt',
                         'Hypernetwork-MonkeyPatch-Extension',
                         'SD-CN-Animation',
                         'stable-diffusion-webui-images-browser']
22:22:01-652293 INFO     Running setup
22:22:01-653018 INFO     Installing repositories
22:22:02-752122 INFO     Installing submodules
22:22:03-565556 INFO     Updating submodules
22:22:06-264263 INFO     Enabled extensions-builtin:
                         ['stable-diffusion-webui-rembg', 'ScuNET',
                         'a1111-sd-webui-lycoris', 'Lora',
                         'sd-webui-agent-scheduler', 'clip-interrogator-ext',
                         'multidiffusion-upscaler-for-automatic1111', 'LDSR',
                         'sd-webui-controlnet', 'sd-webui-model-converter',
                         'sd-extension-system-info', 'sd-dynamic-thresholding',
                         'SwinIR', 'stable-diffusion-webui-images-browser']
22:22:15-923167 INFO     Enabled extensions: ['Abysz-LAB-Ext',
                         'Stable-Diffusion-Webui-Civitai-Helper',
                         'clip-interrogator-ext',
                         'Auto-Photoshop-StableDiffusion-Plugin',
                         'stable-diffusion-webui-anti-burn',
                         'multidiffusion-upscaler-for-automatic1111',
                         'stable-diffusion-webui-state', 'sd-dynamic-prompts',
                         'canvas-zoom', 'put extensions here.txt',
                         'sd-webui-additional-networks', 'adetailer',
                         'deforum-for-automatic1111-webui',
                         'sd-webui-regional-prompter', 'sd-webui-controlnet',
                         'sd-webui-infinite-image-browsing',
                         'sd-webui-openpose-editor', 'sdweb-merge-board',
                         'OneButtonPrompt',
                         'Hypernetwork-MonkeyPatch-Extension',
                         'SD-CN-Animation',
                         'stable-diffusion-webui-images-browser']
22:22:31-872096 INFO     Extensions enabled: ['stable-diffusion-webui-rembg',
                         'ScuNET', 'a1111-sd-webui-lycoris', 'Lora',
                         'sd-webui-agent-scheduler', 'clip-interrogator-ext',
                         'multidiffusion-upscaler-for-automatic1111', 'LDSR',
                         'sd-webui-controlnet', 'sd-webui-model-converter',
                         'sd-extension-system-info', 'sd-dynamic-thresholding',
                         'SwinIR', 'stable-diffusion-webui-images-browser',
                         'Abysz-LAB-Ext',
                         'Stable-Diffusion-Webui-Civitai-Helper',
                         'Auto-Photoshop-StableDiffusion-Plugin',
                         'stable-diffusion-webui-anti-burn',
                         'stable-diffusion-webui-state', 'sd-dynamic-prompts',
                         'canvas-zoom', 'put extensions here.txt',
                         'sd-webui-additional-networks', 'adetailer',
                         'deforum-for-automatic1111-webui',
                         'sd-webui-regional-prompter',
                         'sd-webui-infinite-image-browsing',
                         'sd-webui-openpose-editor', 'sdweb-merge-board',
                         'OneButtonPrompt',
                         'Hypernetwork-MonkeyPatch-Extension',
                         'SD-CN-Animation']
22:22:31-874383 WARNING  Extensions duplicates: ['clip-interrogator-ext',
                         'multidiffusion-upscaler-for-automatic1111',
                         'sd-webui-controlnet',
                         'stable-diffusion-webui-images-browser']
22:22:31-875350 INFO     Updating Wiki
22:22:32-103143 INFO     Extension preload: 0.0s
                         /home/ubuntu/vlad-webui/extensions-builtin
22:22:32-104222 INFO     Extension preload: 0.0s
                         /home/ubuntu/stable-diffusion-webui/extensions
22:22:32-105075 INFO     Server arguments: ['--insecure', '--data-dir',
                         '/home/ubuntu/stable-diffusion-webui/', '--listen',
                         '--theme', 'dark', '--disable-safe-unpickle',
                         '--cors-origins', 'http://localhost:9999',
                         '--cors-origins', 'https://www.painthua.com']
No module 'xformers'. Proceeding without it.
22:22:36-573520 INFO     Libraries loaded
22:22:36-576967 INFO     Using data path: /home/ubuntu/stable-diffusion-webui/
22:22:36-583545 INFO     Available VAEs:
                         /home/ubuntu/stable-diffusion-webui/models/VAE 5
22:22:36-584521 INFO     Skipping conflicting extension:
                         /home/ubuntu/stable-diffusion-webui/extensions/clip-int
                         errogator-ext
22:22:36-585470 INFO     Skipping conflicting extension:
                         /home/ubuntu/stable-diffusion-webui/extensions/multidif
                         fusion-upscaler-for-automatic1111
22:22:36-586380 INFO     Skipping conflicting extension:
                         /home/ubuntu/stable-diffusion-webui/extensions/sd-webui
                         -controlnet
22:22:36-587237 INFO     Skipping conflicting extension:
                         /home/ubuntu/stable-diffusion-webui/extensions/stable-d
                         iffusion-webui-images-browser
22:22:36-678762 INFO     Available models:
                         /home/ubuntu/stable-diffusion-webui/models/Stable-diffu
                         sion 150
2023-06-08 22:22:38,548 - ControlNet - INFO - ControlNet v1.1.220
ControlNet preprocessor location: /home/ubuntu/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator
2023-06-08 22:22:38,726 - ControlNet - INFO - ControlNet v1.1.220
[-] ADetailer initialized. version: 23.6.2, num models: 8
python_server_full_path:  /home/ubuntu/stable-diffusion-webui/extensions/Auto-Photoshop-StableDiffusion-Plugin/server/python_server
22:22:40-134138 INFO     Libraries loaded
[AddNet] Updating model hashes...
0it [00:00, ?it/s]
[AddNet] Updating model hashes...
0it [00:00, ?it/s]
Civitai Helper: Get Custom Model Folder
Civitai Helper: Load setting from: /home/ubuntu/stable-diffusion-webui/extensions/Stable-Diffusion-Webui-Civitai-Helper/setting.json
Civitai Helper: No setting file, use default
22:22:41-072025 INFO     Loading UI theme: name=gradio/monochrome style=Auto
LAB
*Deforum ControlNet support: enabled*
22:22:43-689460 INFO     Setting Torch parameters: dtype=torch.float16
                         vae=torch.float16 unet=torch.float16
Loading weights: /home/ubuntu/stable-diffusion-webui/models/Stable-diffusion/_…
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
22:22:44-244782 INFO     Model created from config:
                         /home/ubuntu/vlad-webui/configs/v1-inference.yaml
Loading weights: /home/ubuntu/stable-diffusion-webui/models/VAE/vae-ft-mse-840…
22:22:45-375216 INFO     Applying scaled dot product cross attention
                         optimization
22:22:45-418318 INFO     Embeddings loaded: 38 ['0lg4kury', 'anime512',
                         'AS-Young', 'AS-Young-neg', 'AS-Younger',
                         'AshleyCipher', 'Asian-Less', 'Asian-Less-Neg',
                         'Asian-Less-Toon', 'atompunkstylesd15', 'awful512',
                         'bad-hands-5', 'beauty512', 'CeceGiacinti',
                         'cherrynobodysd15', 'DaphneDimakos',
                         'dollienobodysd15', 'EasyNegative', 'eonn',
                         'evelynnobodysd15', 'flower_style', 'jane_noexist',
                         'kristennobodysd15', 'LulaCipher', 'nbdy-celeste-sd15',
                         'nbdy-scarlet-sd15', 'Neg512-neg', 'neg_anime512',
                         'neg_facelift512', 'neg_hands512-neg',
                         'neg_realism512', 'No512-neg', 'Portrait512',
                         'realisticvision-negative-embedding', 'render512',
                         'selfie512', 'StacyHiggins', 'VeronicaCipher']
22:22:45-426911 INFO     Model loaded in 1.8s (load=0.2s create=0.4s apply=0.4s
                         vae=0.4s move=0.2s)
22:22:45-737592 INFO     Model load finished: {'ram': {'used': 13.08, 'total':
                         31.01}, 'gpu': {'used': 2.32, 'total': 22.05},
                         'retries': 0, 'oom': 0}
Running on local URL:  http://0.0.0.0:7860

To create a public link, set `share=True` in `launch()`.
22:22:46-245196 INFO     Local URL: http://localhost:7860/
22:22:46-246361 INFO     API Docs: http://localhost:7860/docs
22:22:46-247124 INFO     Initializing middleware
22:22:46-445125 INFO     [AgentScheduler] Task queue is empty
22:22:46-446175 INFO     [AgentScheduler] Registering APIs
22:22:46-474987 ERROR    executing callback:
                         /home/ubuntu/stable-diffusion-webui/extensions/sd-webui
                         -openpose-editor/scripts/openpose_editor.py
                         app_started_callback: FileNotFoundError
╭───────────────────── Traceback (most recent call last) ──────────────────────╮
│ /home/ubuntu/vlad-webui/modules/script_callbacks.py:134 in                   │
│ app_started_callback                                                         │
│                                                                              │
│   133 │   │   │   t0 = time.time()                                           │
│ ❱ 134 │   │   │   c.callback(demo, app)                                      │
│   135 │   │   │   timer(t0, c.script, 'app_started')                         │
│                                                                              │
│ /home/ubuntu/stable-diffusion-webui/extensions/sd-webui-openpose-editor/scri │
│ pts/openpose_editor.py:94 in mount_openpose_api                              │
│                                                                              │
│    93 │   if not getattr(shared.cmd_opts, "disable_openpose_editor_auto_upda │
│ ❱  94 │   │   update_app()                                                   │
│    95                                                                        │
│                                                                              │
│ /home/ubuntu/stable-diffusion-webui/extensions/sd-webui-openpose-editor/scri │
│ pts/openpose_editor.py:84 in update_app                                      │
│                                                                              │
│    83 │                                                                      │
│ ❱  84 │   package_version = get_version_from_package_json()                  │
│    85 │   current_version = get_current_release()                            │
│                                                                              │
│ /home/ubuntu/stable-diffusion-webui/extensions/sd-webui-openpose-editor/scri │
│ pts/openpose_editor.py:47 in get_version_from_package_json                   │
│                                                                              │
│    46 def get_version_from_package_json():                                   │
│ ❱  47 │   with open(os.path.join(EXTENSION_DIR, "package.json")) as f:       │
│    48 │   │   data = json.load(f)                                            │
╰──────────────────────────────────────────────────────────────────────────────╯
FileNotFoundError: [Errno 2] No such file or directory:
'extensions/sd-webui-openpose-editor/package.json'
22:22:47-649723 INFO     Startup time: 15.5s (torch=2.3s gradio=1.1s
                         libraries=1.1s models=0.1s scripts=4.3s onchange=0.1s
                         ui=4.9s launch=0.3s scripts app_started_callback=0.7s
                         checkpoint=0.7s)

Browser logs

DevTools failed to load source map: Could not load content for chrome-extension://hnmpcagpplmpfojmgmnngilcnanddlhb/browser-polyfill.min.js.map: System error: net::ERR_BLOCKED_BY_CLIENT
0.0.0.0/:124     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/Stable-Diffusion-Webui-Civitai-Helper/style.css?1684266234.2299151 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:124     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/canvas-zoom/style.css?1686084977.8827372 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:124     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/style.css?1686261619.421115 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:124     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/sd-dynamic-prompts/style.css?1684924792.0358348 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:124     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/sd-webui-additional-networks/style.css?1684266524.1618602 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:124     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/sd-webui-infinite-image-browsing/style.css?1686140435.8720932 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:124     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/sd-webui-regional-prompter/style.css?1684266312.2821693 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:124     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/stable-diffusion-webui-state/style.css?1684266321.0821226 net::ERR_ABORTED 403 (Forbidden)
bboxHint.js?1685629836.567625:515 [Violation] Added synchronous DOM mutation listener to a 'DOMNodeInserted' event. Consider using MutationObserver to make the page more responsive.
(anonymous) @ bboxHint.js?1685629836.567625:515
0.0.0.0/:80     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/canvas-zoom/javascript/canvas-zoom.js?1686250752.2547798 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:81     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/javascript/deforum-hints.js?1686261619.3891149 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:82     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/deforum-for-automatic1111-webui/javascript/deforum.js?1686261619.3891149 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:83     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/sd-dynamic-prompts/javascript/dynamic_prompting.js?1685616117.948287 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:84     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/sd-dynamic-prompts/javascript/dynamic_prompting_hints.js?1684266666.0735338 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:85     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/sd-webui-additional-networks/javascript/additional_networks.js?1684266524.1618602 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:86     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/sd-webui-infinite-image-browsing/javascript/index.js?1686140435.8720932 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:87     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/sdweb-merge-board/javascript/select_tab.js?1684266576.048864 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:88     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/Stable-Diffusion-Webui-Civitai-Helper/javascript/civitai_helper.js?1684266234.2299151 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:89     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/stable-diffusion-webui-state/javascript/state.app.js?1684266321.0821226 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:90     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/stable-diffusion-webui-state/javascript/state.constants.js?1684266321.0821226 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:91     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/stable-diffusion-webui-state/javascript/state.core.js?1684266321.0821226 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:92     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/stable-diffusion-webui-state/javascript/state.ext.control-net.js?1684266321.0821226 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:93     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/stable-diffusion-webui-state/javascript/state.store.js?1684266321.0821226 net::ERR_ABORTED 403 (Forbidden)
0.0.0.0/:94     GET http://0.0.0.0:7860/file=/home/ubuntu/stable-diffusion-webui/extensions/stable-diffusion-webui-state/javascript/state.utils.js?1684266321.0821226 net::ERR_ABORTED 403 (Forbidden)
openpose_editor.js?1686262924.9007835:3     GET http://0.0.0.0:7860/openpose_editor_index 404 (Not Found)
checkEditorAvailable @ openpose_editor.js?1686262924.9007835:3
(anonymous) @ openpose_editor.js?1686262924.9007835:99
contentscript.js:203 [Violation] 'requestAnimationFrame' handler took 333ms
script.js?1686087023.9528072:57 [Violation] 'setTimeout' handler took 58ms

Additional information

Currently, the canvas container is small, sometimes it will be cut off especially edit a portrait, Can we resize the container like following screenshot? Thanks.

The redo/undo should cover most UI interactions that affects outputs:

• Move keypoint (Merging multiple movement events into single one?)
• Rotation
• Scaling
• Toggle visibility
• Add object to canvas (object includes: background image, hand/face/body)
• Remove object from canvas

The redo/undo should not cover:

• Create active selection
• Group/Ungroup
• Lock/Unlock

Maybe we should also display a event ring to help users understand what would happen if undo is pressed.

Openpose does provide support for foot skeleton:
https://cmu-perceptual-computing-lab.github.io/foot_keypoint_dataset/

It would be nice to support it if we add foot support to ControlNet openpose model later.

这个功能超赞，希望大佬继续开发下去，我遇到的问题是这样的，面板中没有图像

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

在平板页面操作情况下就比较尴尬了,按不了快捷键

无视吧，不知道怎么删了

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

Hi,

Not really a bug, I just don't understand how to install this extension. Can you please provide a more detailed installation procedure?

Thank you

Steps to reproduce the problem

xx

What should have happened?

xx

Commit where the problem happens

xx

What browsers do you use to access the UI ?

No response

Command Line Arguments

xx

Console logs

xx

Browser logs

xx

Additional information

No response

I use [ControlNet v1.1.237] to edit the body and press [Send pose to ControlNet] to send it to ControlNet, but it cannot be displayed on ControlNet, only a black screen appears, and sometimes only the edited hands are displayed, but the body cannot show.
But in stable diffusion1.4.1, the above problems did not appear.
stable diffusion 1.5.14
ControlNet v1.1.237
openpose editor 0.1.11

Can we add more groups like left hand/right hand/face, just grouped so that it can be found easily, maybe it doesn't have grouping behavior just grouping, and when the group is collapsed, the scrollbar is smaller. Thanks.

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

I've downloaded the new automatic1111 1.5.0 webui and setup a new SD installation (because it's safer than trying to update current one), installed this sd-webui-openpose-editor and restarted webui, but the OpenPose Editor tab is still missing. There's no way to make it show up, the dist folder has the proper files, I even re-downloaded them just in case.

Steps to reproduce the problem

1. Install webui 1.5.0 from scratch
2. Install this editor extension
3. Try to locate the OpenPose Editor tab.

What should have happened?

OpenPose Editor tab should be there.

Commit where the problem happens

webui: 1.5.0
controlnet: 1.1.233
openpose-editor: Sat Jul 22 21:15:12 2023

What browsers do you use to access the UI ?

No response

Command Line Arguments

set PYTORCH_CUDA_ALLOC_CONF=max_split_size_mb:512
set COMMANDLINE_ARGS=--xformers --no-half --medvram

Console logs

venv "C:\stable-diffusion-webui-1.5.0\venv\Scripts\Python.exe"
fatal: not a git repository (or any of the parent directories): .git
fatal: not a git repository (or any of the parent directories): .git
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: 1.5.0
Commit hash: <none>

Launching Web UI with arguments: --xformers --no-half --medvram
Tag Autocomplete: Could not locate model-keyword extension, Lora trigger word completion will be limited to those added through the extra networks menu.
2023-07-26 19:15:22,519 - ControlNet - INFO - ControlNet v1.1.233
ControlNet preprocessor location: C:\stable-diffusion-webui-1.5.0\extensions\sd-webui-controlnet\annotator\downloads
2023-07-26 19:15:22,800 - ControlNet - INFO - ControlNet v1.1.233
Loading weights [35d51ba12c] from C:\stable-diffusion-webui-1.5.0\models\Stable-diffusion\kotosAbyssproto_v10.safetensors
Creating model from config: C:\stable-diffusion-webui-1.5.0\configs\v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
[AgentScheduler] Task queue is empty
[AgentScheduler] Registering APIs
Startup time: 36.0s (launcher: 14.0s, import torch: 6.5s, import gradio: 2.9s, setup paths: 3.4s, other imports: 2.9s, setup codeformer: 0.2s, list SD models: 0.3s, load scripts: 3.1s, create ui: 1.9s, gradio launch: 0.3s, app_started_callback: 0.4s).
Loading VAE weights specified in settings: C:\stable-diffusion-webui-1.5.0\models\VAE\kl-f8-anime2.ckpt
Applying attention optimization: xformers... done.
Model loaded in 59.6s (load weights from disk: 1.7s, create model: 1.3s, apply weights to model: 52.7s, load VAE: 2.1s, load textual inversion embeddings: 0.4s, calculate empty prompt: 1.4s).

Browser logs

XHRGET
http://127.0.0.1:7860/sdapi/v1/sd-models
[HTTP/1.1 404 Not Found 0ms]

XHRGET
http://127.0.0.1:7860/sdapi/v1/samplers
[HTTP/1.1 404 Not Found 0ms]

Uncaught (in promise) TypeError: n.map is not a function
getSamplers http://127.0.0.1:7860/file=extensions/sd-webui-agent-scheduler/javascript/agent-scheduler.iife.js?1690379297.1120613:302
promise callbackgetSamplers http://127.0.0.1:7860/file=extensions/sd-webui-agent-scheduler/javascript/agent-scheduler.iife.js?1690379297.1120613:302
http://127.0.0.1:7860/file=extensions/sd-webui-agent-scheduler/javascript/agent-scheduler.iife.js?1690379297.1120613:302
http://127.0.0.1:7860/file=extensions/sd-webui-agent-scheduler/javascript/agent-scheduler.iife.js?1690379297.1120613:349
agent-scheduler.iife.js:302:3667
Uncaught (in promise) TypeError: n.map is not a function
getCheckpoints http://127.0.0.1:7860/file=extensions/sd-webui-agent-scheduler/javascript/agent-scheduler.iife.js?1690379297.1120613:302
promise callbackgetCheckpoints http://127.0.0.1:7860/file=extensions/sd-webui-agent-scheduler/javascript/agent-scheduler.iife.js?1690379297.1120613:302
http://127.0.0.1:7860/file=extensions/sd-webui-agent-scheduler/javascript/agent-scheduler.iife.js?1690379297.1120613:302
http://127.0.0.1:7860/file=extensions/sd-webui-agent-scheduler/javascript/agent-scheduler.iife.js?1690379297.1120613:349
agent-scheduler.iife.js:302:3764

Additional information

No response

I can't load or change the canvas size! How can I solve this problem?"

#35 reported that the editor is unusable on mobile devices (Phone, Tablet). I think add a button to control the zoom/pan mode is only part of the solution for the extension to be fully usable on mobile.

There are several things to do to make the editor usable on mobile:

• The modal should take more screen space
• The left panel should be foldable (Drawer)
• 2 finger pinch should zoom in/out the canvas
• drag on canvas should pan the canvas
• In selection mode, keypoints should be bigger for easier selection and drag.

The text of this extension does not seem to be overwritten by the localization files in webui itself. Any plans to add localization support?

I want to generate the pose structure of characters through API, can it be achieved. I really need this feature. Please

Following minimal reproduction shows that fabric js support group to be scaled and rotated. For some unknown reason in the openpose editor, once keypoints and connections are grouped, they become unscalable and unrotateable.

<!DOCTYPE html>
<html>
<head>
    <script src="https://cdnjs.cloudflare.com/ajax/libs/fabric.js/5.3.1/fabric.min.js"></script>
</head>
<body>
    <canvas id="canvas" width="800" height="600"></canvas>
    <script>
        var canvas = new fabric.Canvas('canvas');

        // Create the first circle
        var circle1 = new fabric.Circle({
            left: 100,
            top: 100,
            fill: 'red',
            radius: 50
        });

        // Create the second circle
        var circle2 = new fabric.Circle({
            left: 200,
            top: 200,
            fill: 'blue',
            radius: 50
        });

        // Group the two circles together
        var group = new fabric.Group([circle1, circle2]);

        // Add the group to the canvas
        canvas.add(group);
    </script>
</body>
</html>

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

When I try to get to the openpose editor by clicking "Edit", I saw the same window as before I downloaded openpose editor, nothing changed :

Steps to reproduce the problem

1. ControlNet v1.1.407 input an image
2. Control type -> Openpose
3. Run Preprocessor
4. Click "Edit"

What should have happened?

The normal interface of the openpose editor should come.

Commit where the problem happens

webui: v1.6.0 v1.5.2 v1.4.1
controlnet: v1.1.407
openpose-editor: 722bca6

What browsers do you use to access the UI ?

Microsoft Edge

Command Line Arguments

NO

Console logs

To create a public link, set `share=True` in `launch()`.
Startup time: 25.9s (launcher: 8.1s, import torch: 7.1s, import gradio: 0.9s, setup paths: 1.0s, other imports: 1.2s, list SD models: 0.2s, load scripts: 3.3s, create ui: 2.3s, gradio launch: 0.6s, add APIs: 0.3s, app_started_callback: 0.8s).
Loading VAE weights specified in settings: D:\D\ruanjian\AIDraw\novelai-webui-aki-v3\models\VAE\vae-ft-mse-840000-ema-pruned.ckpt
Applying attention optimization: xformers... done.
Model loaded in 9.9s (load weights from disk: 1.2s, create model: 1.3s, apply weights to model: 2.6s, apply half(): 1.3s, load VAE: 2.3s, move model to device: 1.0s).
2023-09-06 13:49:33,270 - ControlNet - INFO - Preview Resolution = 512

Browser logs

:7860/favicon.ico:1
Failed to load resource: the server responded with a status of 403 (Forbidden)

:7860/openpose_editor_index:1
Failed to load resource: the server responded with a status of 404 (Not Found)

Additional information

I'm not very familiar with computers and don't know what Browser logs are. Anyway, I hope I copied it correctly.

User has reported that when he wants to do fine tune on a specific keypoint, other keypoints/groups should be locked. Just like how currently image can be locked, we should add a feature to lock Body/Face/Hand as well.

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

I use the RunPod Fast Stable Diffusion on Cloudservice Runpod. It uses a Jupyter Lab (Port 8888) to connect to the interface (Port 3000).

When I try to get to the openpose editor by clicking "Edit", I can only see a window without anything:

Steps to reproduce the problem

1. ControlNet v1.1.233 input an image
2. Control type -> Openpose
3. Run Preprocessor
4. Click "Edit"

What should have happened?

The normal interface of the openpose editor should come.

Commit where the problem happens

webui: v1.4.1
controlnet: v1.1.233
openpose-editor: 35dd1943

What browsers do you use to access the UI ?

Google Chrome

Command Line Arguments

No

Console logs

Running on local URL: https://rcud4c01mi5i07-3001.proxy.runpod.net
✔ Connected
Startup time: 29.1s (import torch: 3.3s, import gradio: 0.8s, import ldm: 0.5s, other imports: 2.2s, load scripts: 10.0s, create ui: 11.9s, gradio launch: 0.3s, add APIs: 0.1s).
preload_extensions_git_metadata for 33 extensions took 0.69s
2023-07-25 03:08:59,288 - ControlNet - INFO - Preview Resolution = 512

Browser logs

Mixed Content: The page at 'https://rcud4c01mi5i07-3000.proxy.runpod.net/' was loaded over HTTPS, but requested an insecure resource 'http://100.65.13.115:60811/openpose_editor_index/'. This request has been blocked; the content must be served over HTTPS.
openpose_editor.js?1689829721.2718813:4 Uncaught (in promise) TypeError: Failed to fetch
at checkEditorAvailable (openpose_editor.js?1689829721.2718813:4:27)
at openpose_editor.js?1689829721.2718813:131:5
at openpose_editor.js?1689829721.2718813:139:3
civitai_helper.js?1686112472.0:337 gradio_ver:3.23.0
civitai_helper.js?1686112472.0:438 found active tab: undefined
index.js?1686112371.0:1 sd-webui-3d-open-pose-editor: onUiLoaded
openoutpaint-ext.js?1686112535.0:117 [openoutpaint] Add message listener
2openoutpaint-ext.js?1686112535.0:184 [openoutpaint] Sending init message
index.js?a83964bb:85 i18next: languageChanged zh-TW
index.js?a83964bb:85 i18next: initialized Object
index.js?a83964bb:85 0.1.18 2023-04-15 06:20:24
662The specified value "[object Object]" cannot be parsed, or is out of range.
layers.js?v=26b7436:677 [layers] Collection 'Image Layers' at layers.collections.image registered
layers.js?v=26b7436:632 [layers] Layer 'Background' at layers.collections.image.layers.bg registered
layers.js?v=26b7436:632 [layers] Layer 'Image' at layers.collections.image.layers.image registered
layers.js?v=26b7436:632 [layers] Layer 'Mask Paint' at layers.collections.image.layers.mask registered
layers.js?v=26b7436:632 [layers] Layer 'Overlay' at layers.collections.image.layers.overlay registered
layers.js?v=26b7436:632 [layers] Layer 'Debug Layer' at layers.collections.image.layers.debug registered
openoutpaint-ext.js?1686112535.0:184 [openoutpaint] Sending init message
layers.js?v=26b7436:632 [layers] Layer 'Default Image Layer' at layers.collections.image.layers.default registered
index.js?a83964bb:102 @mediapipe/pose Module
index.js?a83964bb:102 MyPose ƒ Pv(h){var w=this;h=h||{},this.h=new Ch({locateFile:h.locateFile,files:function(M){return[{url:"pose_solution_packed_assets_loader.js"},{simd:!1,url:"pose_solution_wasm_bin.js"},{simd:!0,url:"pose_sol…
index.js?a83964bb:3440 create editor
(anonymous) @ index.js?a83964bb:3440
openoutpaint-ext.js?1686112535.0:184 [openoutpaint] Sending init message
index.js?a83964bb:3305 Infinity% loaded
openoutpaint-ext.js?1686112535.0:184 [openoutpaint] Sending init message
webui.js?v=ccd423a:38 [webui] key.json loaded successfully
webui.js?v=ccd423a:57 [webui] Window is child of 'https://rcud4c01mi5i07-3000.proxy.runpod.net/'
index.js?v=d4006e8:181 [index] Fixed host to 'https://rcud4c01mi5i07-3000.proxy.runpod.net'
index.js?a83964bb:3419 method GetAppVersion Array(0)
index.js?a83964bb:3419 return Object
openoutpaint-ext.js?1686112535.0:123 [openoutpaint] Received Init Ack
index.js?1686112371.0:1 Method GetAppVersion MessageEvent
index.js?a83964bb:3419 method Pause Array(0)
index.js?a83964bb:3419 return Object
index.js?a83964bb:3305 Infinity% loaded
index.js?1686112371.0:1 Method Pause MessageEvent
index.js?a83964bb:3305 _o
index.js?a83964bb:3305 Array(2)
index.js?a83964bb:3419 pushCommand
openoutpaint-ext.js?1686112535.0:184 [openoutpaint] Sending init message
index.js?v=d4006e8:181 [index] Fixed host to 'https://rcud4c01mi5i07-3000.proxy.runpod.net'
openoutpaint-ext.js?1686112535.0:123 [openoutpaint] Received Init Ack
127.0.0.1:7860/sdapi/v1/options:1 Failed to load resource: net::ERR_CONNECTION_REFUSED
127.0.0.1:7860/startup-events:1 Failed to load resource: net::ERR_CONNECTION_REFUSED
index.js?v=d4006e8:466 The server seems to be offline. Is host 'https://rcud4c01mi5i07-3000.proxy.runpod.net' correct?
checkConnection @ index.js?v=d4006e8:466
index.js?a83964bb:3419 method Pause Array(0)
index.js?a83964bb:3419 return Object
index.js?1686112371.0:1 Method Pause MessageEvent
index.js?v=d4006e8:1298 [index] WebUI Settings set as recommended.
index.js?v=d4006e8:1186 Current model: SDv1-5.ckpt [4c86efd062]
index.js?a83964bb:3419 method Resume Array(0)
index.js?a83964bb:3419 return Object
index.js?1686112371.0:1 Method Resume MessageEvent
index.js?a83964bb:3419 method Pause Array(0)
index.js?a83964bb:3419 return Object
index.js?1686112371.0:1 Method Pause MessageEvent
DevTools failed to load source map: Could not load content for chrome-extension://fheoggkfdfchfphceeifdbepaooicaho/sourceMap/chrome/scripts/iframe_form_check.js.map: System error: net::ERR_BLOCKED_BY_CLIENT
DevTools failed to load source map: Could not load content for chrome-extension://fheoggkfdfchfphceeifdbepaooicaho/sourceMap/chrome/scripts/iframe_form_detection.js.map: System error: net::ERR_BLOCKED_BY_CLIENT

Additional information

It would be good if the openpose editor can be run in a new tab besides coming to a bumped-out window.

It is not very easy to correspond the keypoint to the row on the pose control panel right now. We need to highlight selected keypoints in pose control panel to solve this issue.

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

After installing this openpose editor by pasting the repo link to automatic1111 and restarting the webui, i got the popup saying that the editor is not found.

I have done the following

1. I have checked the dist directory exisit inside the extension's folder
2. Close the browser and terminal and restart
3. press restart ui
4. restart computer
5. verify that "localhost:7860/openpose_editor_index" is accessible, that i can load the editor ui

This happened after i accidentally uninstalled the extension.
This causes me to install the newer version of the extension.

My extension:
controlnet version v1.1.410

Steps to reproduce the problem

1. Follow these steps: https://github.com/huchenlei/sd-webui-openpose-editor#installation
2. Run a photo through controlnet's openpose processor
3. Click edit in the preview tab

What should have happened?

The editor should have been shown

Commit where the problem happens

webui: v1.6.0
controlnet: v1.1.410
openpose-editor: 0.1.13

What browsers do you use to access the UI ?

Google Chrome

Command Line Arguments

--medvram --no-half --xformers --autolaunch

Console logs

Already up to date.
venv "D:\ProgramFIles\Stable_Diffusion\stable-diffusion-webui\venv\Scripts\Python.exe"
Python 3.10.6 | packaged by conda-forge | (main, Aug 22 2022, 20:29:51) [MSC v.1929 64 bit (AMD64)]
Version: v1.6.0
Commit hash: 5ef669de080814067961f28357256e8fe27544f4
Launching Web UI with arguments: --medvram --no-half --xformers --autolaunch
No SDP backend available, likely because you are running in pytorch versions < 2.0. In fact, you are using PyTorch 1.13.1+cu117. You might want to consider upgrading.
==============================================================================
You are running torch 1.13.1+cu117.
The program is tested to work with torch 2.0.0.
To reinstall the desired version, run with commandline flag --reinstall-torch.
Beware that this will cause a lot of large files to be downloaded, as well as
there are reports of issues with training tab on the latest version.

Use --skip-version-check commandline argument to disable this check.
==============================================================================
=================================================================================
You are running xformers 0.0.19.
The program is tested to work with xformers 0.0.20.
To reinstall the desired version, run with commandline flag --reinstall-xformers.

Use --skip-version-check commandline argument to disable this check.
=================================================================================
2023-10-15 00:45:15,600 - ControlNet - INFO - ControlNet v1.1.410
ControlNet preprocessor location: D:\ProgramFIles\Stable_Diffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\annotator\downloads
2023-10-15 00:45:15,711 - ControlNet - INFO - ControlNet v1.1.410
Loading weights [c6bbc15e32] from D:\ProgramFIles\Stable_Diffusion\stable-diffusion-webui\models\Stable-diffusion\runwayml_v1-5-inpainting.ckpt
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 12.1s (prepare environment: 3.6s, import torch: 2.3s, import gradio: 1.2s, setup paths: 0.5s, initialize shared: 0.2s, other imports: 0.5s, load scripts: 1.0s, create ui: 0.6s, gradio launch: 0.2s, app_started_callback: 1.9s).
Creating model from config: D:\ProgramFIles\Stable_Diffusion\stable-diffusion-webui\configs\v1-inpainting-inference.yaml
Applying attention optimization: xformers... done.
Model loaded in 6.5s (load weights from disk: 3.3s, create model: 0.3s, apply weights to model: 0.6s, calculate empty prompt: 2.3s).
2023-10-15 00:45:46,985 - ControlNet - INFO - Preview Resolution = 512

Browser logs

Failed to load resource: the server responded with a status of 404 (Not Found) :7860/openpose_editor_index:1
(btw, click the link ":7860/openpose_editor_index:1" works, it launches the editor in another tab)

Additional information

No response

After installing the extension, there is nothing shows up for edit. The button seems to do nothing. And the buttons layout is also different from yours. The buttons appear below the preview box instead of the right side next to it. No new lines are shown on the cmd when I click on the "edit" button. Please help, thank you.

PS: I am able to use it with "http://localhost:7860/openpose_editor_index" and manually upload and download json.

Hello, I have successfully installed the plugin and can successfully open the edit box page. The bones can be dragged, but they cannot be deleted using the delete button on the keyboard. How can I solve this problem?
Thanks！

Is there a way to use api to rewrite the key points? For example, I uploaded a picture in sd webui controlnet, and the preview effect of the foot key points is not satisfied, can I adjust and move the foot key points through api

rt

Set the canvas size to 512*768
When you click download
Not only the black background part is saved
Even the gray area outside the background is saved together.
The size of the saved image becomes too large.

Is there a way to save it as "canvas size with black background"?

AttributeError: 'Namespace' object has no attribute 'disable_openpose_editor_auto_update'
将openpose-editor插件删除后才能正常使用

https://www.youtube.com/watch?v=3E5fhFQUVLo&t=2800s
shows the experience installing the extension.

On the first time clicking the edit button, a bunch of malformed frame message errors are thrown. The editor only becomes usable when close the modal and click on edit again.