Thanks for sharing the code. I am trying to finetune for custom data and was able to get the loss to under 2.0 . however, the inference does not work. Am I missing anything? Here are a few sample predictions! training is converging!

@xuannianz Excellent work.

I have encounter such problems in training process.
2189/2250 [============================>.] - ETA: 27s - loss: 4.96312020-03-09 17:47:41 [INFO] [Thread-6] [geos.py:219] Self-intersection at or near point 507.97936313701194 440.22383226394601
2020-03-09 17:47:41 [INFO] [Thread-6] [geos.py:219] Self-intersection at or near point 639.2710706150342 574.59295807232354
2190/2250 [============================>.] - ETA: 27s - loss: 4.96312020-03-09 17:47:41 [INFO] [Thread-6] [geos.py:219] Self-intersection at or near point 482.31532442427749 637.21180633522147
2196/2250 [============================>.] - ETA: 24s - loss: 4.96312020-03-09 17:47:44 [INFO] [Thread-6] [geos.py:219] Self-intersection at or near point 36.365901518633024 639.57219251336892
2200/2250 [============================>.] - ETA: 22s - loss: 4.9631^C

and the loss keeps 4.9631. any advice to me?

Thanks a lot

Did you use regular convolutional layers instead of deformable convolutions?

这里总会报错
print(xmin_valid,xmax_valid,ymin_valid,ymax_valid)
print(xmin,xmax,ymin,ymax)
canvas[ymin_valid:ymax_valid + 1, xmin_valid:xmax_valid + 1] = np.fmax(
1 - distance_map[
ymin_valid - ymin:ymax_valid - ymin,
xmin_valid - xmin:xmax_valid - xmin],
canvas[ymin_valid:ymax_valid + 1, xmin_valid:xmax_valid + 1])
print之后发现xmin = xmin_valid，xmax_valid = xmax，ymin_valid= ymin，ymax_valid= ymax。训练数据用的是icdar2015～

DifferentiableBinarization_TF2 whs$ python inference.py
2020-08-24 17:27:40.139885: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN)to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2020-08-24 17:27:40.160421: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fbfaaf7f9c0 initialized for platform Host (this does not guarantee that XLA will be used). Devices:
2020-08-24 17:27:40.160585: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version
WARNING:tensorflow:Skipping loading of weights for layer conv2d_4 due to mismatch in number of weights (1 vs 2).
WARNING:tensorflow:Skipping loading of weights for layer conv2d_transpose_1 due to mismatch in number of weights (2 vs 1).
Segmentation fault: 11

@xuannianz

@xuannianz thank you for you hard work

• How does this implementation perform compared to the official one?
• Can Resnet-18 be trained here?

在数据处理的时候，我看resize那个函数，并不是把所有的图片resize到相同尺寸，只有最大边是640，输入图像大小不同，为什么可以批量训练呢？

Hi,

I tried to use the model in opencv-4.3 using the following steps:

from model import dbnet
import keras.backend as K
import tensorflow as tf
from openvino.inference_engine import IENetwork, IECore
import cv2
import numpy as np
import time
import math
from shapely.geometry import Polygon
import pyclipper

def freeze_session(session, keep_var_names=None, output_names=None, clear_devices=True):
    graph = session.graph
    with graph.as_default():
        freeze_var_names = list(set(v.op.name for v in tf.global_variables()).difference(keep_var_names or []))
        output_names = output_names or []
        output_names += [v.op.name for v in tf.global_variables()]
        input_graph_def = graph.as_graph_def()
        if clear_devices:
            for node in input_graph_def.node:
                node.device = ''
        frozen_graph = tf.graph_util.convert_variables_to_constants(
            session, input_graph_def, output_names, freeze_var_names)
        return frozen_graph

_, model = dbnet()
K.set_learning_phase(0)
model.load_weights('path/to/2020-01-02/db_48_2.0216_2.5701.h5', by_name=True, skip_mismatch=True)
frozen_graph = freeze_session(K.get_session(),
                              output_names=[out.op.name for out in model.outputs])
tf.train.write_graph(frozen_graph, ".", "db_model.pb", as_text=False)

net = cv2.dnn.readNetFromTensorflow("db_model.pb")
net.setPreferableBackend(cv2.dnn.DNN_BACKEND_INFERENCE_ENGINE)
net.setPreferableTarget(cv2.dnn.DNN_TARGET_CPU)
image = cv2.imread(path+"output_516.jpg")
h,w,c = image.shape
mean = np.array([103.939, 116.779, 123.68])
image = resize_image(image)
image = image.astype(np.float32)
image -= mean
blob = cv2.dnn.blobFromImage(image)
net.setInput(blob)
preds = net.forward()
bitmap = preds[0][0] > 0.3
boxes, scores = polygons_from_bitmap(preds[0][0], bitmap, w h, box_thresh=0.5)

But the output of boxes and scores is always an empty list.
The same image results in the detection of 2 regions when it is run on the inference.py script.

Could you suggest what am i doing wrong here?

My val_loss is about 2.15 and train_loss is about 1.92, how to reduce them?

[2024/04/02 16:11:14] ppocr INFO: Architecture :
[2024/04/02 16:11:14] ppocr INFO: Backbone :
[2024/04/02 16:11:14] ppocr INFO: model_name : large
[2024/04/02 16:11:14] ppocr INFO: name : MobileNetV3
[2024/04/02 16:11:14] ppocr INFO: scale : 0.5
[2024/04/02 16:11:14] ppocr INFO: Head :
[2024/04/02 16:11:14] ppocr INFO: k : 50
[2024/04/02 16:11:14] ppocr INFO: name : DBHead
[2024/04/02 16:11:14] ppocr INFO: Neck :
[2024/04/02 16:11:14] ppocr INFO: name : DBFPN
[2024/04/02 16:11:14] ppocr INFO: out_channels : 256
[2024/04/02 16:11:14] ppocr INFO: Transform : None
[2024/04/02 16:11:14] ppocr INFO: algorithm : DB
[2024/04/02 16:11:14] ppocr INFO: model_type : det
[2024/04/02 16:11:14] ppocr INFO: Eval :
[2024/04/02 16:11:14] ppocr INFO: dataset :
[2024/04/02 16:11:14] ppocr INFO: data_dir : ./train_data/train/
[2024/04/02 16:11:14] ppocr INFO: label_file_list : ['./train_data/xml2train_label.txt']
[2024/04/02 16:11:14] ppocr INFO: name : SimpleDataSet
[2024/04/02 16:11:14] ppocr INFO: transforms :
[2024/04/02 16:11:14] ppocr INFO: DecodeImage :
[2024/04/02 16:11:14] ppocr INFO: channel_first : False
[2024/04/02 16:11:14] ppocr INFO: img_mode : BGR
[2024/04/02 16:11:14] ppocr INFO: DetLabelEncode : None
[2024/04/02 16:11:14] ppocr INFO: DetResizeForTest :
[2024/04/02 16:11:14] ppocr INFO: image_shape : [736, 1280]
[2024/04/02 16:11:14] ppocr INFO: NormalizeImage :
[2024/04/02 16:11:14] ppocr INFO: mean : [0.485, 0.456, 0.406]
[2024/04/02 16:11:14] ppocr INFO: order : hwc
[2024/04/02 16:11:14] ppocr INFO: scale : 1./255.
[2024/04/02 16:11:14] ppocr INFO: std : [0.229, 0.224, 0.225]
[2024/04/02 16:11:14] ppocr INFO: ToCHWImage : None
[2024/04/02 16:11:14] ppocr INFO: KeepKeys :
[2024/04/02 16:11:14] ppocr INFO: keep_keys : ['image', 'shape', 'polys', 'ignore_tags']
[2024/04/02 16:11:14] ppocr INFO: loader :
[2024/04/02 16:11:14] ppocr INFO: batch_size_per_card : 1
[2024/04/02 16:11:14] ppocr INFO: drop_last : False
[2024/04/02 16:11:14] ppocr INFO: num_workers : 8
[2024/04/02 16:11:14] ppocr INFO: shuffle : False
[2024/04/02 16:11:14] ppocr INFO: use_shared_memory : True
[2024/04/02 16:11:14] ppocr INFO: Global :
[2024/04/02 16:11:14] ppocr INFO: cal_metric_during_train : False
[2024/04/02 16:11:14] ppocr INFO: checkpoints : None
[2024/04/02 16:11:14] ppocr INFO: distributed : False
[2024/04/02 16:11:14] ppocr INFO: epoch_num : 1200
[2024/04/02 16:11:14] ppocr INFO: eval_batch_step : [0, 2000]
[2024/04/02 16:11:14] ppocr INFO: infer_img : doc/imgs/test.jpg
[2024/04/02 16:11:14] ppocr INFO: log_smooth_window : 20
[2024/04/02 16:11:14] ppocr INFO: pretrained_model : ./pretrain_models/MobileNetV3_large_x0_5_pretrained
[2024/04/02 16:11:14] ppocr INFO: print_batch_step : 10
[2024/04/02 16:11:14] ppocr INFO: save_epoch_step : 1200
[2024/04/02 16:11:14] ppocr INFO: save_inference_dir : None
[2024/04/02 16:11:14] ppocr INFO: save_model_dir : ./output/db_mv3/
[2024/04/02 16:11:14] ppocr INFO: save_res_path : ./output/det_pse/predicts_pse.txt
[2024/04/02 16:11:14] ppocr INFO: use_gpu : True
[2024/04/02 16:11:14] ppocr INFO: use_mlu : False
[2024/04/02 16:11:14] ppocr INFO: use_visualdl : False
[2024/04/02 16:11:14] ppocr INFO: use_xpu : False
[2024/04/02 16:11:14] ppocr INFO: Loss :
[2024/04/02 16:11:14] ppocr INFO: alpha : 5
[2024/04/02 16:11:14] ppocr INFO: balance_loss : True
[2024/04/02 16:11:14] ppocr INFO: beta : 10
[2024/04/02 16:11:14] ppocr INFO: main_loss_type : DiceLoss
[2024/04/02 16:11:14] ppocr INFO: name : DBLoss
[2024/04/02 16:11:14] ppocr INFO: ohem_ratio : 3
[2024/04/02 16:11:14] ppocr INFO: Metric :
[2024/04/02 16:11:14] ppocr INFO: main_indicator : hmean
[2024/04/02 16:11:14] ppocr INFO: name : DetMetric
[2024/04/02 16:11:14] ppocr INFO: Optimizer :
[2024/04/02 16:11:14] ppocr INFO: base_lr : 0.0001
[2024/04/02 16:11:14] ppocr INFO: beta1 : 0.9
[2024/04/02 16:11:14] ppocr INFO: beta2 : 0.999
[2024/04/02 16:11:14] ppocr INFO: lr :
[2024/04/02 16:11:14] ppocr INFO: learning_rate : 0.001
[2024/04/02 16:11:14] ppocr INFO: name : Adam
[2024/04/02 16:11:14] ppocr INFO: regularizer :
[2024/04/02 16:11:14] ppocr INFO: factor : 0
[2024/04/02 16:11:14] ppocr INFO: name : L2
[2024/04/02 16:11:14] ppocr INFO: PostProcess :
[2024/04/02 16:11:14] ppocr INFO: box_thresh : 0.6
[2024/04/02 16:11:14] ppocr INFO: max_candidates : 1000
[2024/04/02 16:11:14] ppocr INFO: name : DBPostProcess
[2024/04/02 16:11:14] ppocr INFO: thresh : 0.3
[2024/04/02 16:11:14] ppocr INFO: unclip_ratio : 1.5
[2024/04/02 16:11:14] ppocr INFO: Train :
[2024/04/02 16:11:14] ppocr INFO: dataset :
[2024/04/02 16:11:14] ppocr INFO: data_dir : ./train_data/train/
[2024/04/02 16:11:14] ppocr INFO: label_file_list : ['./train_data/xml2train_label.txt']
[2024/04/02 16:11:14] ppocr INFO: name : SimpleDataSet
[2024/04/02 16:11:14] ppocr INFO: ratio_list : [1.0]
[2024/04/02 16:11:14] ppocr INFO: transforms :
[2024/04/02 16:11:14] ppocr INFO: DecodeImage :
[2024/04/02 16:11:14] ppocr INFO: channel_first : False
[2024/04/02 16:11:14] ppocr INFO: img_mode : BGR
[2024/04/02 16:11:14] ppocr INFO: DetLabelEncode : None
[2024/04/02 16:11:14] ppocr INFO: IaaAugment :
[2024/04/02 16:11:14] ppocr INFO: augmenter_args :
[2024/04/02 16:11:14] ppocr INFO: args :
[2024/04/02 16:11:14] ppocr INFO: p : 0.5
[2024/04/02 16:11:14] ppocr INFO: type : Fliplr
[2024/04/02 16:11:14] ppocr INFO: args :
[2024/04/02 16:11:14] ppocr INFO: rotate : [-10, 10]
[2024/04/02 16:11:14] ppocr INFO: type : Affine
[2024/04/02 16:11:14] ppocr INFO: args :
[2024/04/02 16:11:14] ppocr INFO: size : [0.5, 3]
[2024/04/02 16:11:14] ppocr INFO: type : Resize
[2024/04/02 16:11:14] ppocr INFO: EastRandomCropData :
[2024/04/02 16:11:14] ppocr INFO: keep_ratio : True
[2024/04/02 16:11:14] ppocr INFO: max_tries : 50
[2024/04/02 16:11:14] ppocr INFO: size : [640, 640]
[2024/04/02 16:11:14] ppocr INFO: MakeBorderMap :
[2024/04/02 16:11:14] ppocr INFO: shrink_ratio : 0.4
[2024/04/02 16:11:14] ppocr INFO: thresh_max : 0.7
[2024/04/02 16:11:14] ppocr INFO: thresh_min : 0.3
[2024/04/02 16:11:14] ppocr INFO: MakeShrinkMap :
[2024/04/02 16:11:14] ppocr INFO: min_text_size : 8
[2024/04/02 16:11:14] ppocr INFO: shrink_ratio : 0.4
[2024/04/02 16:11:14] ppocr INFO: NormalizeImage :
[2024/04/02 16:11:14] ppocr INFO: mean : [0.485, 0.456, 0.406]
[2024/04/02 16:11:14] ppocr INFO: order : hwc
[2024/04/02 16:11:14] ppocr INFO: scale : 1./255.
[2024/04/02 16:11:14] ppocr INFO: std : [0.229, 0.224, 0.225]
[2024/04/02 16:11:14] ppocr INFO: ToCHWImage : None
[2024/04/02 16:11:14] ppocr INFO: KeepKeys :
[2024/04/02 16:11:14] ppocr INFO: keep_keys : ['image', 'threshold_map', 'threshold_mask', 'shrink_map', 'shrink_mask']
[2024/04/02 16:11:14] ppocr INFO: loader :
[2024/04/02 16:11:14] ppocr INFO: batch_size_per_card : 16
[2024/04/02 16:11:14] ppocr INFO: drop_last : False
[2024/04/02 16:11:14] ppocr INFO: num_workers : 8
[2024/04/02 16:11:14] ppocr INFO: shuffle : True
[2024/04/02 16:11:14] ppocr INFO: use_shared_memory : True
[2024/04/02 16:11:14] ppocr INFO: profiler_options : None
[2024/04/02 16:11:14] ppocr INFO: train with paddle 2.4.2 and device Place(gpu:0)
[2024/04/02 16:11:14] ppocr INFO: Initialize indexs of datasets:['./train_data/xml2train_label.txt']
[2024/04/02 16:11:14] ppocr INFO: Initialize indexs of datasets:['./train_data/xml2train_label.txt']
[2024/04/02 16:11:15] ppocr INFO: train dataloader has 7 iters
[2024/04/02 16:11:15] ppocr INFO: valid dataloader has 100 iters
[2024/04/02 16:11:15] ppocr INFO: load pretrain successful from ./pretrain_models/MobileNetV3_large_x0_5_pretrained
[2024/04/02 16:11:15] ppocr INFO: During the training process, after the 0th iteration, an evaluation is run every 2000 iterations
[2024/04/02 16:11:34] ppocr INFO: save model in ./output/db_mv3/latest
[2024/04/02 16:11:38] ppocr ERROR: When parsing line video_82.jpg [{"transcription": "No", "points": [[303, 874], [653, 874], [303, 983], [653, 983]]}, {"transcription": "No", "points": [[429, 2629], [812, 2629], [429, 2700], [812, 2700]]}, {"transcription": "No", "points": [[909, 2608], [1231, 2608], [909, 2658], [1231, 2658]]}, {"transcription": "No", "points": [[1294, 2587], [1870, 2587], [1294, 2644], [1870, 2644]]}, {"transcription": "No", "points": [[1490, 2515], [1958, 2515], [1490, 2553], [1958, 2553]]}, {"transcription": "No", "points": [[419, 2487], [925, 2487], [419, 2572], [925, 2572]]}, {"transcription": "No", "points": [[421, 2402], [1093, 2402], [421, 2452], [1093, 2452]]}, {"transcription": "No", "points": [[1118, 2351], [1937, 2351], [1118, 2406], [1937, 2406]]}, {"transcription": "No", "points": [[418, 2361], [779, 2361], [418, 2417], [779, 2417]]}, {"transcription": "No", "points": [[803, 2317], [1800, 2317], [803, 2372], [1800, 2372]]}, {"transcription": "No", "points": [[412, 2308], [758, 2308], [412, 2361], [758, 2361]]}, {"transcription": "No", "points": [[787, 2270], [1577, 2270], [787, 2320], [1577, 2320]]}, {"transcription": "No", "points": [[416, 2253], [769, 2253], [416, 2308], [769, 2308]]}, {"transcription": "No", "points": [[806, 2211], [1279, 2211], [806, 2271], [1279, 2271]]}, {"transcription": "No", "points": [[1309, 2178], [1845, 2178], [1309, 2237], [1845, 2237]]}, {"transcription": "No", "points": [[378, 1828], [567, 1828], [378, 1874], [567, 1874]]}, {"transcription": "No", "points": [[365, 1785], [557, 1785], [365, 1824], [557, 1824]]}, {"transcription": "No", "points": [[362, 1732], [694, 1732], [362, 1775], [694, 1775]]}, {"transcription": "No", "points": [[361, 1700], [611, 1700], [361, 1741], [611, 1741]]}, {"transcription": "No", "points": [[358, 1665], [529, 1665], [358, 1700], [529, 1700]]}, {"transcription": "No", "points": [[356, 1611], [547, 1611], [356, 1659], [547, 1659]]}, {"transcription": "No", "points": [[357, 1561], [729, 1561], [357, 1611], [729, 1611]]}, {"transcription": "No", "points": [[347, 1520], [596, 1520], [347, 1571], [596, 1571]]}, {"transcription": "No", "points": [[339, 1423], [551, 1423], [339, 1488], [551, 1488]]}, {"transcription": "No", "points": [[796, 1777], [1016, 1777], [796, 1827], [1016, 1827]]}, {"transcription": "No", "points": [[800, 1735], [1026, 1735], [800, 1773], [1026, 1773]]}, {"transcription": "No", "points": [[793, 1691], [997, 1691], [793, 1733], [997, 1733]]}, {"transcription": "No", "points": [[780, 1643], [1034, 1643], [780, 1691], [1034, 1691]]}, {"transcription": "No", "points": [[793, 1600], [1151, 1600], [793, 1646], [1151, 1646]]}, {"transcription": "No", "points": [[792, 1559], [1120, 1559], [792, 1601], [1120, 1601]]}, {"transcription": "No", "points": [[788, 1513], [1189, 1513], [788, 1560], [1189, 1560]]}, {"transcription": "No", "points": [[780, 1483], [919, 1483], [780, 1524], [919, 1524]]}, {"transcription": "No", "points": [[777, 1424], [1091, 1424], [777, 1481], [1091, 1481]]}, {"transcription": "No", "points": [[345, 1489], [569, 1489], [345, 1530], [569, 1530]]}, {"transcription": "No", "points": [[1327, 1873], [1426, 1873], [1327, 1919], [1426, 1919]]}, {"transcription": "No", "points": [[1439, 1860], [1596, 1860], [1439, 1914], [1596, 1914]]}, {"transcription": "No", "points": [[1606, 1857], [1759, 1857], [1606, 1903], [1759, 1903]]}, {"transcription": "No", "points": [[1318, 1760], [1739, 1760], [1318, 1819], [1739, 1819]]}, {"transcription": "No", "points": [[1319, 1669], [1797, 1669], [1319, 1728], [1797, 1728]]}, {"transcription": "No", "points": [[1303, 1625], [1771, 1625], [1303, 1671], [1771, 1671]]}, {"transcription": "No", "points": [[1306, 1561], [1880, 1561], [1306, 1616], [1880, 1616]]}, {"transcription": "No", "points": [[1291, 1470], [1395, 1470], [1291, 1526], [1395, 1526]]}, {"transcription": "No", "points": [[1395, 1462], [1617, 1462], [1395, 1506], [1617, 1506]]}, {"transcription": "No", "points": [[1618, 1449], [1757, 1449], [1618, 1493], [1757, 1493]]}, {"transcription": "No", "points": [[1302, 1432], [1475, 1432], [1302, 1478], [1475, 1478]]}, {"transcription": "No", "points": [[1295, 1364], [1714, 1364], [1295, 1408], [1714, 1408]]}, {"transcription": "No", "points": [[1218, 1181], [1850, 1181], [1218, 1282], [1850, 1282]]}, {"transcription": "No", "points": [[314, 1217], [1163, 1217], [314, 1305], [1163, 1305]]}, {"transcription": "No", "points": [[315, 1109], [705, 1109], [315, 1176], [705, 1176]]}, {"transcription": "No", "points": [[714, 1087], [1086, 1087], [714, 1155], [1086, 1155]]}, {"transcription": "No", "points": [[1094, 1059], [1453, 1059], [1094, 1134], [1453, 1134]]}, {"transcription": "No", "points": [[1490, 1037], [1872, 1037], [1490, 1112], [1872, 1112]]}, {"transcription": "No", "points": [[1463, 804], [1855, 804], [1463, 876], [1855, 876]]}, {"transcription": "No", "points": [[1085, 825], [1448, 825], [1085, 923], [1448, 923]]}, {"transcription": "No", "points": [[692, 852], [1067, 852], [692, 954], [1067, 954]]}, {"transcription": "No", "points": [[303, 874], [653, 874], [303, 983], [653, 983]]}, {"transcription": "No", "points": [[429, 2629], [812, 2629], [429, 2700], [812, 2700]]}, {"transcription": "No", "points": [[909, 2608], [1231, 2608], [909, 2658], [1231, 2658]]}, {"transcription": "No", "points": [[1294, 2587], [1870, 2587], [1294, 2644], [1870, 2644]]}, {"transcription": "No", "points": [[1490, 2515], [1958, 2515], [1490, 2553], [1958, 2553]]}, {"transcription": "No", "points": [[419, 2487], [925, 2487], [419, 2572], [925, 2572]]}, {"transcription": "No", "points": [[421, 2402], [1093, 2402], [421, 2452], [1093, 2452]]}, {"transcription": "No", "points": [[1118, 2351], [1937, 2351], [1118, 2406], [1937, 2406]]}, {"transcription": "No", "points": [[418, 2361], [779, 2361], [418, 2417], [779, 2417]]}, {"transcription": "No", "points": [[803, 2317], [1800, 2317], [803, 2372], [1800, 2372]]}, {"transcription": "No", "points": [[412, 2308], [758, 2308], [412, 2361], [758, 2361]]}, {"transcription": "No", "points": [[787, 2270], [1577, 2270], [787, 2320], [1577, 2320]]}, {"transcription": "No", "points": [[416, 2253], [769, 2253], [416, 2308], [769, 2308]]}, {"transcription": "No", "points": [[806, 2211], [1279, 2211], [806, 2271], [1279, 2271]]}, {"transcription": "No", "points": [[1309, 2178], [1845, 2178], [1309, 2237], [1845, 2237]]}, {"transcription": "No", "points": [[378, 1828], [567, 1828], [378, 1874], [567, 1874]]}, {"transcription": "No", "points": [[365, 1785], [557, 1785], [365, 1824], [557, 1824]]}, {"transcription": "No", "points": [[362, 1732], [694, 1732], [362, 1775], [694, 1775]]}, {"transcription": "No", "points": [[361, 1700], [611, 1700], [361, 1741], [611, 1741]]}, {"transcription": "No", "points": [[358, 1665], [529, 1665], [358, 1700], [529, 1700]]}, {"transcription": "No", "points": [[356, 1611], [547, 1611], [356, 1659], [547, 1659]]}, {"transcription": "No", "points": [[357, 1561], [729, 1561], [357, 1611], [729, 1611]]}, {"transcription": "No", "points": [[347, 1520], [596, 1520], [347, 1571], [596, 1571]]}, {"transcription": "No", "points": [[339, 1423], [551, 1423], [339, 1488], [551, 1488]]}, {"transcription": "No", "points": [[796, 1777], [1016, 1777], [796, 1827], [1016, 1827]]}, {"transcription": "No", "points": [[800, 1735], [1026, 1735], [800, 1773], [1026, 1773]]}, {"transcription": "No", "points": [[793, 1691], [997, 1691], [793, 1733], [997, 1733]]}, {"transcription": "No", "points": [[780, 1643], [1034, 1643], [780, 1691], [1034, 1691]]}, {"transcription": "No", "points": [[793, 1600], [1151, 1600], [793, 1646], [1151, 1646]]}, {"transcription": "No", "points": [[792, 1559], [1120, 1559], [792, 1601], [1120, 1601]]}, {"transcription": "No", "points": [[788, 1513], [1189, 1513], [788, 1560], [1189, 1560]]}, {"transcription": "No", "points": [[780, 1483], [919, 1483], [780, 1524], [919, 1524]]}, {"transcription": "No", "points": [[777, 1424], [1091, 1424], [777, 1481], [1091, 1481]]}, {"transcription": "No", "points": [[345, 1489], [569, 1489], [345, 1530], [569, 1530]]}, {"transcription": "No", "points": [[1327, 1873], [1426, 1873], [1327, 1919], [1426, 1919]]}, {"transcription": "No", "points": [[1439, 1860], [1596, 1860], [1439, 1914], [1596, 1914]]}, {"transcription": "No", "points": [[1606, 1857], [1759, 1857], [1606, 1903], [1759, 1903]]}, {"transcription": "No", "points": [[1318, 1760], [1739, 1760], [1318, 1819], [1739, 1819]]}, {"transcription": "No", "points": [[1319, 1669], [1797, 1669], [1319, 1728], [1797, 1728]]}, {"transcription": "No", "points": [[1303, 1625], [1771, 1625], [1303, 1671], [1771, 1671]]}, {"transcription": "No", "points": [[1306, 1561], [1880, 1561], [1306, 1616], [1880, 1616]]}, {"transcription": "No", "points": [[1291, 1470], [1395, 1470], [1291, 1526], [1395, 1526]]}, {"transcription": "No", "points": [[1395, 1462], [1617, 1462], [1395, 1506], [1617, 1506]]}, {"transcription": "No", "points": [[1618, 1449], [1757, 1449], [1618, 1493], [1757, 1493]]}, {"transcription": "No", "points": [[1302, 1432], [1475, 1432], [1302, 1478], [1475, 1478]]}, {"transcription": "No", "points": [[1295, 1364], [1714, 1364], [1295, 1408], [1714, 1408]]}, {"transcription": "No", "points": [[1218, 1181], [1850, 1181], [1218, 1282], [1850, 1282]]}, {"transcription": "No", "points": [[314, 1217], [1163, 1217], [314, 1305], [1163, 1305]]}, {"transcription": "No", "points": [[315, 1109], [705, 1109], [315, 1176], [705, 1176]]}, {"transcription": "No", "points": [[714, 1087], [1086, 1087], [714, 1155], [1086, 1155]]}, {"transcription": "No", "points": [[1094, 1059], [1453, 1059], [1094, 1134], [1453, 1134]]}, {"transcription": "No", "points": [[1490, 1037], [1872, 1037], [1490, 1112], [1872, 1112]]}, {"transcription": "No", "points": [[1463, 804], [1855, 804], [1463, 876], [1855, 876]]}, {"transcription": "No", "points": [[1085, 825], [1448, 825], [1085, 923], [1448, 923]]}, {"transcription": "No", "points": [[692, 852], [1067, 852], [692, 954], [1067, 954]]}]

, error happened with msg: Traceback (most recent call last):
File "C:\project\paddleocrnew\ppocr\data\simple_dataset.py", line 194, in getitem
outs = transform(data, self.ops)
File "C:\project\paddleocrnew\ppocr\data\imaug_init_.py", line 56, in transform
data = op(data)
File "C:\project\paddleocrnew\ppocr\data\imaug\make_border_map.py", line 64, in call
self.draw_border_map(text_polys[i], canvas, mask=mask)
File "C:\project\paddleocrnew\ppocr\data\imaug\make_border_map.py", line 117, in draw_border_map
canvas[ymin_valid:ymax_valid + 1, xmin_valid:xmax_valid + 1] = np.fmax(
ValueError: could not broadcast input array from shape (0,143) into shape (1,143)

[2024/04/02 16:11:47] ppocr INFO: epoch: [2/1200], global_step: 10, lr: 0.001000, loss: 2.408028, loss_shrink_maps: 0.000000, loss_threshold_maps: 1.408028, loss_binary_maps: 1.000000, loss_cbn: 0.000000, avg_reader_cost: 2.77294 s, avg_batch_cost: 3.10767 s, avg_samples: 16.0, ips: 5.14855 samples/s, eta: 7:14:30
[2024/04/02 16:11:56] ppocr INFO: save model in ./output/db_mv3/latest
[2024/04/02 16:12:26] ppocr INFO: save model in ./output/db_mv3/latest
[2024/04/02 16:12:33] ppocr INFO: epoch: [4/1200], global_step: 20, lr: 0.001000, loss: 1.287940, loss_shrink_maps: 0.000000, loss_threshold_maps: 0.287940, loss_binary_maps: 1.000000, loss_cbn: 0.000000, avg_reader_cost: 4.28075 s, avg_batch_cost: 4.47097 s, avg_samples: 16.0, ips: 3.57864 samples/s, eta: 8:49:03
[2024/04/02 16:12:41] ppocr ERROR: When parsing line video_96.jpg [{"transcription": "No", "points": [[410, 2377], [761, 2377], [410, 2487], [761, 2487]]}, {"transcription": "No", "points": [[344, 653], [728, 653], [344, 724], [728, 724]]}, {"transcription": "No", "points": [[826, 645], [1148, 645], [826, 695], [1148, 695]]}, {"transcription": "No", "points": [[1210, 602], [1788, 602], [1210, 660], [1788, 660]]}, {"transcription": "No", "points": [[1415, 677], [1884, 677], [1415, 716], [1884, 716]]}, {"transcription": "No", "points": [[349, 774], [855, 774], [349, 860], [855, 860]]}, {"transcription": "No", "points": [[362, 885], [1035, 885], [362, 935], [1035, 935]]}, {"transcription": "No", "points": [[1061, 845], [1880, 845], [1061, 900], [1880, 900]]}, {"transcription": "No", "points": [[364, 937], [725, 937], [364, 993], [725, 993]]}, {"transcription": "No", "points": [[751, 904], [1749, 904], [751, 961], [1749, 961]]}, {"transcription": "No", "points": [[364, 994], [711, 994], [364, 1047], [711, 1047]]}, {"transcription": "No", "points": [[740, 969], [1531, 969], [740, 1019], [1531, 1019]]}, {"transcription": "No", "points": [[374, 1046], [728, 1046], [374, 1101], [728, 1101]]}, {"transcription": "No", "points": [[766, 1033], [1239, 1033], [766, 1093], [1239, 1093]]}, {"transcription": "No", "points": [[1270, 1008], [1807, 1008], [1270, 1067], [1807, 1067]]}, {"transcription": "No", "points": [[384, 1491], [573, 1491], [384, 1537], [573, 1537]]}, {"transcription": "No", "points": [[376, 1543], [568, 1543], [376, 1581], [568, 1581]]}, {"transcription": "No", "points": [[379, 1584], [711, 1584], [379, 1626], [711, 1626]]}, {"transcription": "No", "points": [[381, 1623], [631, 1623], [381, 1663], [631, 1663]]}, {"transcription": "No", "points": [[383, 1668], [554, 1668], [383, 1703], [554, 1703]]}, {"transcription": "No", "points": [[385, 1707], [577, 1707], [385, 1755], [577, 1755]]}, {"transcription": "No", "points": [[392, 1745], [764, 1745], [392, 1795], [764, 1795]]}, {"transcription": "No", "points": [[387, 1793], [636, 1793], [387, 1844], [636, 1844]]}, {"transcription": "No", "points": [[388, 1878], [601, 1878], [388, 1944], [601, 1944]]}, {"transcription": "No", "points": [[805, 1490], [1025, 1490], [805, 1540], [1025, 1540]]}, {"transcription": "No", "points": [[814, 1544], [1041, 1544], [814, 1581], [1041, 1581]]}, {"transcription": "No", "points": [[813, 1585], [1016, 1585], [813, 1627], [1016, 1627]]}, {"transcription": "No", "points": [[804, 1625], [1058, 1625], [804, 1674], [1058, 1674]]}, {"transcription": "No", "points": [[821, 1663], [1180, 1663], [821, 1710], [1180, 1710]]}, {"transcription": "No", "points": [[825, 1709], [1153, 1709], [825, 1752], [1153, 1752]]}, {"transcription": "No", "points": [[826, 1747], [1227, 1747], [826, 1794], [1227, 1794]]}, {"transcription": "No", "points": [[822, 1798], [961, 1798], [822, 1839], [961, 1839]]}, {"transcription": "No", "points": [[825, 1832], [1139, 1832], [825, 1889], [1139, 1889]]}, {"transcription": "No", "points": [[389, 1835], [613, 1835], [389, 1876], [613, 1876]]}, {"transcription": "No", "points": [[1324, 1347], [1423, 1347], [1324, 1393], [1423, 1393]]}, {"transcription": "No", "points": [[1436, 1336], [1593, 1336], [1436, 1390], [1593, 1390]]}, {"transcription": "No", "points": [[1603, 1329], [1756, 1329], [1603, 1376], [1756, 1376]]}, {"transcription": "No", "points": [[1326, 1430], [1747, 1430], [1326, 1489], [1747, 1489]]}, {"transcription": "No", "points": [[1336, 1517], [1815, 1517], [1336, 1576], [1815, 1576]]}, {"transcription": "No", "points": [[1327, 1576], [1795, 1576], [1327, 1622], [1795, 1622]]}, {"transcription": "No", "points": [[1335, 1625], [1910, 1625], [1335, 1680], [1910, 1680]]}, {"transcription": "No", "points": [[1332, 1742], [1436, 1742], [1332, 1797], [1436, 1797]]}, {"transcription": "No", "points": [[1437, 1743], [1659, 1743], [1437, 1788], [1659, 1788]]}, {"transcription": "No", "points": [[1660, 1737], [1799, 1737], [1660, 1781], [1799, 1781]]}, {"transcription": "No", "points": [[1347, 1785], [1520, 1785], [1347, 1830], [1520, 1830]]}, {"transcription": "No", "points": [[1347, 1841], [1766, 1841], [1347, 1885], [1766, 1885]]}, {"transcription": "No", "points": [[1287, 1964], [1920, 1964], [1287, 2064], [1920, 2064]]}, {"transcription": "No", "points": [[383, 2029], [1234, 2029], [383, 2117], [1234, 2117]]}, {"transcription": "No", "points": [[398, 2182], [789, 2182], [398, 2249], [789, 2249]]}, {"transcription": "No", "points": [[798, 2160], [1171, 2160], [798, 2228], [1171, 2228]]}, {"transcription": "No", "points": [[1179, 2139], [1538, 2139], [1179, 2214], [1538, 2214]]}, {"transcription": "No", "points": [[1576, 2116], [1958, 2116], [1576, 2191], [1958, 2191]]}, {"transcription": "No", "points": [[1574, 2354], [1967, 2354], [1574, 2426], [1967, 2426]]}, {"transcription": "No", "points": [[1195, 2350], [1558, 2350], [1195, 2448], [1558, 2448]]}, {"transcription": "No", "points": [[800, 2362], [1175, 2362], [800, 2464], [1175, 2464]]}, {"transcription": "No", "points": [[410, 2377], [761, 2377], [410, 2487], [761, 2487]]}, {"transcription": "No", "points": [[344, 653], [728, 653], [344, 724], [728, 724]]}, {"transcription": "No", "points": [[826, 645], [1148, 645], [826, 695], [1148, 695]]}, {"transcription": "No", "points": [[1210, 602], [1788, 602], [1210, 660], [1788, 660]]}, {"transcription": "No", "points": [[1415, 677], [1884, 677], [1415, 716], [1884, 716]]}, {"transcription": "No", "points": [[349, 774], [855, 774], [349, 860], [855, 860]]}, {"transcription": "No", "points": [[362, 885], [1035, 885], [362, 935], [1035, 935]]}, {"transcription": "No", "points": [[1061, 845], [1880, 845], [1061, 900], [1880, 900]]}, {"transcription": "No", "points": [[364, 937], [725, 937], [364, 993], [725, 993]]}, {"transcription": "No", "points": [[751, 904], [1749, 904], [751, 961], [1749, 961]]}, {"transcription": "No", "points": [[364, 994], [711, 994], [364, 1047], [711, 1047]]}, {"transcription": "No", "points": [[740, 969], [1531, 969], [740, 1019], [1531, 1019]]}, {"transcription": "No", "points": [[374, 1046], [728, 1046], [374, 1101], [728, 1101]]}, {"transcription": "No", "points": [[766, 1033], [1239, 1033], [766, 1093], [1239, 1093]]}, {"transcription": "No", "points": [[1270, 1008], [1807, 1008], [1270, 1067], [1807, 1067]]}, {"transcription": "No", "points": [[384, 1491], [573, 1491], [384, 1537], [573, 1537]]}, {"transcription": "No", "points": [[376, 1543], [568, 1543], [376, 1581], [568, 1581]]}, {"transcription": "No", "points": [[379, 1584], [711, 1584], [379, 1626], [711, 1626]]}, {"transcription": "No", "points": [[381, 1623], [631, 1623], [381, 1663], [631, 1663]]}, {"transcription": "No", "points": [[383, 1668], [554, 1668], [383, 1703], [554, 1703]]}, {"transcription": "No", "points": [[385, 1707], [577, 1707], [385, 1755], [577, 1755]]}, {"transcription": "No", "points": [[392, 1745], [764, 1745], [392, 1795], [764, 1795]]}, {"transcription": "No", "points": [[387, 1793], [636, 1793], [387, 1844], [636, 1844]]}, {"transcription": "No", "points": [[388, 1878], [601, 1878], [388, 1944], [601, 1944]]}, {"transcription": "No", "points": [[805, 1490], [1025, 1490], [805, 1540], [1025, 1540]]}, {"transcription": "No", "points": [[814, 1544], [1041, 1544], [814, 1581], [1041, 1581]]}, {"transcription": "No", "points": [[813, 1585], [1016, 1585], [813, 1627], [1016, 1627]]}, {"transcription": "No", "points": [[804, 1625], [1058, 1625], [804, 1674], [1058, 1674]]}, {"transcription": "No", "points": [[821, 1663], [1180, 1663], [821, 1710], [1180, 1710]]}, {"transcription": "No", "points": [[825, 1709], [1153, 1709], [825, 1752], [1153, 1752]]}, {"transcription": "No", "points": [[826, 1747], [1227, 1747], [826, 1794], [1227, 1794]]}, {"transcription": "No", "points": [[822, 1798], [961, 1798], [822, 1839], [961, 1839]]}, {"transcription": "No", "points": [[825, 1832], [1139, 1832], [825, 1889], [1139, 1889]]}, {"transcription": "No", "points": [[389, 1835], [613, 1835], [389, 1876], [613, 1876]]}, {"transcription": "No", "points": [[1324, 1347], [1423, 1347], [1324, 1393], [1423, 1393]]}, {"transcription": "No", "points": [[1436, 1336], [1593, 1336], [1436, 1390], [1593, 1390]]}, {"transcription": "No", "points": [[1603, 1329], [1756, 1329], [1603, 1376], [1756, 1376]]}, {"transcription": "No", "points": [[1326, 1430], [1747, 1430], [1326, 1489], [1747, 1489]]}, {"transcription": "No", "points": [[1336, 1517], [1815, 1517], [1336, 1576], [1815, 1576]]}, {"transcription": "No", "points": [[1327, 1576], [1795, 1576], [1327, 1622], [1795, 1622]]}, {"transcription": "No", "points": [[1335, 1625], [1910, 1625], [1335, 1680], [1910, 1680]]}, {"transcription": "No", "points": [[1332, 1742], [1436, 1742], [1332, 1797], [1436, 1797]]}, {"transcription": "No", "points": [[1437, 1743], [1659, 1743], [1437, 1788], [1659, 1788]]}, {"transcription": "No", "points": [[1660, 1737], [1799, 1737], [1660, 1781], [1799, 1781]]}, {"transcription": "No", "points": [[1347, 1785], [1520, 1785], [1347, 1830], [1520, 1830]]}, {"transcription": "No", "points": [[1347, 1841], [1766, 1841], [1347, 1885], [1766, 1885]]}, {"transcription": "No", "points": [[1287, 1964], [1920, 1964], [1287, 2064], [1920, 2064]]}, {"transcription": "No", "points": [[383, 2029], [1234, 2029], [383, 2117], [1234, 2117]]}, {"transcription": "No", "points": [[398, 2182], [789, 2182], [398, 2249], [789, 2249]]}, {"transcription": "No", "points": [[798, 2160], [1171, 2160], [798, 2228], [1171, 2228]]}, {"transcription": "No", "points": [[1179, 2139], [1538, 2139], [1179, 2214], [1538, 2214]]}, {"transcription": "No", "points": [[1576, 2116], [1958, 2116], [1576, 2191], [1958, 2191]]}, {"transcription": "No", "points": [[1574, 2354], [1967, 2354], [1574, 2426], [1967, 2426]]}, {"transcription": "No", "points": [[1195, 2350], [1558, 2350], [1195, 2448], [1558, 2448]]}, {"transcription": "No", "points": [[800, 2362], [1175, 2362], [800, 2464], [1175, 2464]]}]

, error happened with msg: Traceback (most recent call last):
File "C:\project\paddleocrnew\ppocr\data\simple_dataset.py", line 194, in getitem
outs = transform(data, self.ops)
File "C:\project\paddleocrnew\ppocr\data\imaug_init_.py", line 56, in transform
data = op(data)
File "C:\project\paddleocrnew\ppocr\data\imaug\make_border_map.py", line 64, in call
self.draw_border_map(text_polys[i], canvas, mask=mask)
File "C:\project\paddleocrnew\ppocr\data\imaug\make_border_map.py", line 117, in draw_border_map
canvas[ymin_valid:ymax_valid + 1, xmin_valid:xmax_valid + 1] = np.fmax(
ValueError: could not broadcast input array from shape (34,0) into shape (34,1)

[2024/04/02 16:12:54] ppocr ERROR: When parsing line video_97.jpg [{"transcription": "No", "points": [[349, 2839], [820, 2839], [349, 2985], [820, 2985]]}, {"transcription": "No", "points": [[392, 520], [907, 520], [392, 615], [907, 615]]}, {"transcription": "No", "points": [[1040, 544], [1473, 544], [1040, 610], [1473, 610]]}, {"transcription": "No", "points": [[1559, 525], [2335, 525], [1559, 601], [2335, 601]]}, {"transcription": "No", "points": [[1829, 637], [2459, 637], [1829, 688], [2459, 688]]}, {"transcription": "No", "points": [[388, 688], [1069, 688], [388, 802], [1069, 802]]}, {"transcription": "No", "points": [[398, 844], [1303, 844], [398, 910], [1303, 910]]}, {"transcription": "No", "points": [[1339, 849], [2442, 849], [1339, 922], [2442, 922]]}, {"transcription": "No", "points": [[398, 902], [883, 902], [398, 976], [883, 976]]}, {"transcription": "No", "points": [[918, 912], [2261, 912], [918, 985], [2261, 985]]}, {"transcription": "No", "points": [[393, 978], [859, 978], [393, 1049], [859, 1049]]}, {"transcription": "No", "points": [[900, 990], [1964, 990], [900, 1056], [1964, 1056]]}, {"transcription": "No", "points": [[403, 1049], [878, 1049], [403, 1122], [878, 1122]]}, {"transcription": "No", "points": [[930, 1066], [1566, 1066], [930, 1146], [1566, 1146]]}, {"transcription": "No", "points": [[1608, 1073], [2330, 1073], [1608, 1151], [2330, 1151]]}, {"transcription": "No", "points": [[383, 1641], [637, 1641], [383, 1702], [637, 1702]]}, {"transcription": "No", "points": [[369, 1710], [627, 1710], [369, 1761], [627, 1761]]}, {"transcription": "No", "points": [[369, 1771], [815, 1771], [369, 1827], [815, 1827]]}, {"transcription": "No", "points": [[369, 1820], [705, 1820], [369, 1873], [705, 1873]]}, {"transcription": "No", "points": [[369, 1878], [598, 1878], [369, 1924], [598, 1924]]}, {"transcription": "No", "points": [[369, 1932], [625, 1932], [369, 1995], [625, 1995]]}, {"transcription": "No", "points": [[374, 1990], [874, 1990], [374, 2056], [874, 2056]]}, {"transcription": "No", "points": [[364, 2049], [698, 2049], [364, 2117], [698, 2117]]}, {"transcription": "No", "points": [[359, 2162], [644, 2162], [359, 2249], [644, 2249]]}, {"transcription": "No", "points": [[949, 1673], [1244, 1673], [949, 1739], [1244, 1739]]}, {"transcription": "No", "points": [[957, 1746], [1261, 1746], [957, 1795], [1261, 1795]]}, {"transcription": "No", "points": [[952, 1800], [1225, 1800], [952, 1856], [1225, 1856]]}, {"transcription": "No", "points": [[937, 1856], [1278, 1856], [937, 1920], [1278, 1920]]}, {"transcription": "No", "points": [[957, 1912], [1439, 1912], [957, 1973], [1439, 1973]]}, {"transcription": "No", "points": [[959, 1973], [1400, 1973], [959, 2029], [1400, 2029]]}, {"transcription": "No", "points": [[957, 2027], [1496, 2027], [957, 2088], [1496, 2088]]}, {"transcription": "No", "points": [[949, 2085], [1135, 2085], [949, 2139], [1135, 2139]]}, {"transcription": "No", "points": [[949, 2137], [1371, 2137], [949, 2212], [1371, 2212]]}, {"transcription": "No", "points": [[364, 2105], [664, 2105], [364, 2159], [664, 2159]]}, {"transcription": "No", "points": [[1657, 1515], [1788, 1515], [1657, 1576], [1788, 1576]]}, {"transcription": "No", "points": [[1808, 1512], [2018, 1512], [1808, 1583], [2018, 1583]]}, {"transcription": "No", "points": [[2032, 1515], [2237, 1515], [2032, 1576], [2237, 1576]]}, {"transcription": "No", "points": [[1652, 1639], [2218, 1639], [1652, 1717], [2218, 1717]]}, {"transcription": "No", "points": [[1659, 1759], [2303, 1759], [1659, 1837], [2303, 1837]]}, {"transcription": "No", "points": [[1642, 1837], [2271, 1837], [1642, 1898], [2271, 1898]]}, {"transcription": "No", "points": [[1649, 1907], [2422, 1907], [1649, 1980], [2422, 1980]]}, {"transcription": "No", "points": [[1637, 2046], [1776, 2046], [1637, 2120], [1776, 2120]]}, {"transcription": "No", "points": [[1778, 2061], [2076, 2061], [1778, 2120], [2076, 2120]]}, {"transcription": "No", "points": [[2078, 2066], [2264, 2066], [2078, 2124], [2264, 2124]]}, {"transcription": "No", "points": [[1654, 2108], [1886, 2108], [1654, 2168], [1886, 2168]]}, {"transcription": "No", "points": [[1649, 2193], [2213, 2193], [1649, 2251], [2213, 2251]]}, {"transcription": "No", "points": [[1557, 2361], [2408, 2361], [1557, 2495], [2408, 2495]]}, {"transcription": "No", "points": [[339, 2388], [1483, 2388], [339, 2505], [1483, 2505]]}, {"transcription": "No", "points": [[349, 2578], [874, 2578], [349, 2666], [874, 2666]]}, {"transcription": "No", "points": [[888, 2578], [1388, 2578], [888, 2668], [1388, 2668]]}, {"transcription": "No", "points": [[1400, 2578], [1883, 2578], [1400, 2678], [1883, 2678]]}, {"transcription": "No", "points": [[1935, 2578], [2449, 2578], [1935, 2678], [2449, 2678]]}, {"transcription": "No", "points": [[1915, 2898], [2442, 2898], [1915, 2993], [2442, 2993]]}, {"transcription": "No", "points": [[1405, 2863], [1893, 2863], [1405, 2993], [1893, 2993]]}, {"transcription": "No", "points": [[874, 2849], [1378, 2849], [874, 2985], [1378, 2985]]}, {"transcription": "No", "points": [[349, 2839], [820, 2839], [349, 2985], [820, 2985]]}, {"transcription": "No", "points": [[392, 520], [907, 520], [392, 615], [907, 615]]}, {"transcription": "No", "points": [[1040, 544], [1473, 544], [1040, 610], [1473, 610]]}, {"transcription": "No", "points": [[1559, 525], [2335, 525], [1559, 601], [2335, 601]]}, {"transcription": "No", "points": [[1829, 637], [2459, 637], [1829, 688], [2459, 688]]}, {"transcription": "No", "points": [[388, 688], [1069, 688], [388, 802], [1069, 802]]}, {"transcription": "No", "points": [[398, 844], [1303, 844], [398, 910], [1303, 910]]}, {"transcription": "No", "points": [[1339, 849], [2442, 849], [1339, 922], [2442, 922]]}, {"transcription": "No", "points": [[398, 902], [883, 902], [398, 976], [883, 976]]}, {"transcription": "No", "points": [[918, 912], [2261, 912], [918, 985], [2261, 985]]}, {"transcription": "No", "points": [[393, 978], [859, 978], [393, 1049], [859, 1049]]}, {"transcription": "No", "points": [[900, 990], [1964, 990], [900, 1056], [1964, 1056]]}, {"transcription": "No", "points": [[403, 1049], [878, 1049], [403, 1122], [878, 1122]]}, {"transcription": "No", "points": [[930, 1066], [1566, 1066], [930, 1146], [1566, 1146]]}, {"transcription": "No", "points": [[1608, 1073], [2330, 1073], [1608, 1151], [2330, 1151]]}, {"transcription": "No", "points": [[383, 1641], [637, 1641], [383, 1702], [637, 1702]]}, {"transcription": "No", "points": [[369, 1710], [627, 1710], [369, 1761], [627, 1761]]}, {"transcription": "No", "points": [[369, 1771], [815, 1771], [369, 1827], [815, 1827]]}, {"transcription": "No", "points": [[369, 1820], [705, 1820], [369, 1873], [705, 1873]]}, {"transcription": "No", "points": [[369, 1878], [598, 1878], [369, 1924], [598, 1924]]}, {"transcription": "No", "points": [[369, 1932], [625, 1932], [369, 1995], [625, 1995]]}, {"transcription": "No", "points": [[374, 1990], [874, 1990], [374, 2056], [874, 2056]]}, {"transcription": "No", "points": [[364, 2049], [698, 2049], [364, 2117], [698, 2117]]}, {"transcription": "No", "points": [[359, 2162], [644, 2162], [359, 2249], [644, 2249]]}, {"transcription": "No", "points": [[949, 1673], [1244, 1673], [949, 1739], [1244, 1739]]}, {"transcription": "No", "points": [[957, 1746], [1261, 1746], [957, 1795], [1261, 1795]]}, {"transcription": "No", "points": [[952, 1800], [1225, 1800], [952, 1856], [1225, 1856]]}, {"transcription": "No", "points": [[937, 1856], [1278, 1856], [937, 1920], [1278, 1920]]}, {"transcription": "No", "points": [[957, 1912], [1439, 1912], [957, 1973], [1439, 1973]]}, {"transcription": "No", "points": [[959, 1973], [1400, 1973], [959, 2029], [1400, 2029]]}, {"transcription": "No", "points": [[957, 2027], [1496, 2027], [957, 2088], [1496, 2088]]}, {"transcription": "No", "points": [[949, 2085], [1135, 2085], [949, 2139], [1135, 2139]]}, {"transcription": "No", "points": [[949, 2137], [1371, 2137], [949, 2212], [1371, 2212]]}, {"transcription": "No", "points": [[364, 2105], [664, 2105], [364, 2159], [664, 2159]]}, {"transcription": "No", "points": [[1657, 1515], [1788, 1515], [1657, 1576], [1788, 1576]]}, {"transcription": "No", "points": [[1808, 1512], [2018, 1512], [1808, 1583], [2018, 1583]]}, {"transcription": "No", "points": [[2032, 1515], [2237, 1515], [2032, 1576], [2237, 1576]]}, {"transcription": "No", "points": [[1652, 1639], [2218, 1639], [1652, 1717], [2218, 1717]]}, {"transcription": "No", "points": [[1659, 1759], [2303, 1759], [1659, 1837], [2303, 1837]]}, {"transcription": "No", "points": [[1642, 1837], [2271, 1837], [1642, 1898], [2271, 1898]]}, {"transcription": "No", "points": [[1649, 1907], [2422, 1907], [1649, 1980], [2422, 1980]]}, {"transcription": "No", "points": [[1637, 2046], [1776, 2046], [1637, 2120], [1776, 2120]]}, {"transcription": "No", "points": [[1778, 2061], [2076, 2061], [1778, 2120], [2076, 2120]]}, {"transcription": "No", "points": [[2078, 2066], [2264, 2066], [2078, 2124], [2264, 2124]]}, {"transcription": "No", "points": [[1654, 2108], [1886, 2108], [1654, 2168], [1886, 2168]]}, {"transcription": "No", "points": [[1649, 2193], [2213, 2193], [1649, 2251], [2213, 2251]]}, {"transcription": "No", "points": [[1557, 2361], [2408, 2361], [1557, 2495], [2408, 2495]]}, {"transcription": "No", "points": [[339, 2388], [1483, 2388], [339, 2505], [1483, 2505]]}, {"transcription": "No", "points": [[349, 2578], [874, 2578], [349, 2666], [874, 2666]]}, {"transcription": "No", "points": [[888, 2578], [1388, 2578], [888, 2668], [1388, 2668]]}, {"transcription": "No", "points": [[1400, 2578], [1883, 2578], [1400, 2678], [1883, 2678]]}, {"transcription": "No", "points": [[1935, 2578], [2449, 2578], [1935, 2678], [2449, 2678]]}, {"transcription": "No", "points": [[1915, 2898], [2442, 2898], [1915, 2993], [2442, 2993]]}, {"transcription": "No", "points": [[1405, 2863], [1893, 2863], [1405, 2993], [1893, 2993]]}, {"transcription": "No", "points": [[874, 2849], [1378, 2849], [874, 2985], [1378, 2985]]}]

, error happened with msg: Traceback (most recent call last):
File "C:\project\paddleocrnew\ppocr\data\simple_dataset.py", line 194, in getitem
outs = transform(data, self.ops)
File "C:\project\paddleocrnew\ppocr\data\imaug_init_.py", line 56, in transform
data = op(data)
File "C:\project\paddleocrnew\ppocr\data\imaug\make_border_map.py", line 64, in call
self.draw_border_map(text_polys[i], canvas, mask=mask)
File "C:\project\paddleocrnew\ppocr\data\imaug\make_border_map.py", line 117, in draw_border_map
canvas[ymin_valid:ymax_valid + 1, xmin_valid:xmax_valid + 1] = np.fmax(
ValueError: could not broadcast input array from shape (0,131) into shape (1,131)

[2024/04/02 16:12:57] ppocr INFO: save model in ./output/db_mv3/latest
[2024/04/02 16:13:22] ppocr INFO: epoch: [5/1200], global_step: 30, lr: 0.001000, loss: 1.137310, loss_shrink_maps: 0.000000, loss_threshold_maps: 0.127702, loss_binary_maps: 1.000000, loss_cbn: 0.000000, avg_reader_cost: 4.53528 s, avg_batch_cost: 4.75615 s, avg_samples: 16.0, ips: 3.36406 samples/s, eta: 9:33:17
[2024/04/02 16:13:23] ppocr INFO: save model in ./output/db_mv3/latest

看起来好像是有的epoch成功了保存了参数 有的出错在make_border_map 是数据集的原因还是需要做什么修改呢

Hi,

When you load the .h5 weights at inference time on the inference model, I don't really understand how you managed to save only the weights for the "inference model" (without threshold branch) while training ?

Thank you !

error msg:
DifferentiableBinarization\generator.py:104: RuntimeWarning: invalid value encountered in sqrt
result = np.sqrt(square_distance_1 * square_distance_2 * square_sin / square_distance)
\Anaconda3\envs\keras225_python37\lib\site-packages\keras\utils\data_utils.py:709: UserWarning: An input could not be retrieved. It could be because a worker has died.We do not have any information on the lost sample.
UserWarning)

when i used icar2015 dataset to train, loss was nan,flollowing:

Epoch 1/10
200/200 [==============================] - ETA: 0s - loss: 10.4658 E:\githubcode\DifferentiableBinarization\generator_tf.py:98: RuntimeWarning: invalid value encountered in true_divide
cosin = (square_distance - square_distance_1 - square_distance_2) /(2 * np.sqrt(square_distance_1 * square_distance_2))
200/200 [==============================] - 6289s 32s/step - loss: 10.4462 - val_loss: 5.5865

Epoch 00001: saving model to checkpoints/2021-05-11\db_01_6.5202_5.5865.h5
Epoch 2/10
200/200 [==============================] - 2867s 14s/step - loss: nan - val_loss: nan

Epoch 00002: saving model to checkpoints/2021-05-11\db_02_nan_nan.h5
Epoch 3/10
200/200 [==============================] - 2693s 13s/step - loss: nan - val_loss: nan

Epoch 00003: saving model to checkpoints/2021-05-11\db_03_nan_nan.h5
Epoch 4/10
200/200 [==============================] - 2595s 13s/step - loss: nan - val_loss: nan

你好！好像是没用deformable convolution？请问影响大么？
谢谢！

Hi,
i want to download your model from Baidu but i can not download it. Is there an alternate way in which I could get access to the models?

Thanks!

在ICDAR-2019上训练，loss一直上升的问题。

label_text格式如下：
161,0,605,0,605,195,161,195,傲椒
432,153,609,157,609,196,432,192,BOBOYU
661,93,992,105,992,200,661,188,啵啵鱼
1,191,724,212,724,271,1,253,这是一条有脾气的鱼！

can't you share your code on "convert_pytorch_model_to_tensorflow_model"? Cuz, I want to finetune on my own dataset base on "pre-trained-model-synthtext" @xuannianz