rafiuddinkhan / yolo-training-googlecolab Goto Github PK

Helmet Detection using tiny-yolo-v3 by training using your own dataset and testing the results in the google colaboratory.

Python 1.33% Jupyter Notebook 98.67%

yolov3 colaboratory googlecolab object detection custom-object-detection helmet-detection helmet

yolo-training-googlecolab's Introduction

Yolo-Training-GoogleColab

Custom tiny-yolo-v3 training using your own dataset and testing the results using the google colaboratory. Object detection using yolo algorithms and training your own model and obtaining the weights file using google colab platform.

Explaination link: https://medium.com/@today.rafi/train-your-own-tiny-yolo-v3-on-google-colaboratory-with-the-custom-dataset-2e35db02bf8f

The steps includes:

Data Acquisition.
Data Preparation according to the yolo.
Load Dataset.
Train the dataset.
Obtain the model weights.
Test the model.

yolo-training-googlecolab's People

Contributors

Stargazers

Watchers

Forkers

droter jeffw99 juvu smyousuf14 yaojin nulllpointer rakshith98 rakshithjk manugaioni saharalhabsi elektrik-elektronik-muhendisligi bafana5 dheeraj-thedev mahyaj98 yong6600 locorocorolling heffie199 abhi1398 linncountyjailroster bimbinganmrawangga rahulprrahul bismillakhans akshayjh hariharanb83 dreamnotover gauravpatel89 kvsandy amitkayal technomad21c shivvignesh somakorada07 shaikkamran gaurav567 kirankumrnbg taalaialmasova madhugraj salemchniguir asr-engineering-consulting abhinavm24 saptechengineer gc5218112 sweenythomas muzammil360 sarthakforwet aishwaryashinde00 ttang2322 gokulsg deepak22-dev marmohamed dnschavarria wolfedwolf alexbodner harshit-py dimensionnxg arvind-india narikp heartnoxill antonizhubar kevin6449 ducbx rrodriguezm moli-debugger thecoderpanda asfakianos ether1oop dragonriser mustangs0786 rounak-das-02 u34rali gauravgund rohanakut drsiddharthachoubey smksmksmk rickywrq aliyun8 aashish10raj shubhamekapure cemot chitta48 sanikasalunke kamwong3 lavender321 wngmlco1 juanfcval akshayraina999 arun-purakkatt devdio yashyegare webdeveloper1016 abdulqadir0211 raghaaav rakhithjk umamona caboodles cabelo manas1245agrawal mangesh307 nagaphbilla

yolo-training-googlecolab's Issues

Cannot load image

 ./darknet detector train data_for_colab/obj.data data_for_colab/yolov3.cfg data_for_colab/yolov3.weights -dont_show
yolov3
batch = 1, time_steps = 1, train = 1 
   layer   filters  size/strd(dil)      input                output
   0 conv     32       3 x 3/ 1    416 x 416 x   3 ->  416 x 416 x  32 0.299 BF
   1 conv     64       3 x 3/ 2    416 x 416 x  32 ->  208 x 208 x  64 1.595 BF
   2 conv     32       1 x 1/ 1    208 x 208 x  64 ->  208 x 208 x  32 0.177 BF
   3 conv     64       3 x 3/ 1    208 x 208 x  32 ->  208 x 208 x  64 1.595 BF
   4 Shortcut Layer: 1
   5 conv    128       3 x 3/ 2    208 x 208 x  64 ->  104 x 104 x 128 1.595 BF
   6 conv     64       1 x 1/ 1    104 x 104 x 128 ->  104 x 104 x  64 0.177 BF
   7 conv    128       3 x 3/ 1    104 x 104 x  64 ->  104 x 104 x 128 1.595 BF
   8 Shortcut Layer: 5
   9 conv     64       1 x 1/ 1    104 x 104 x 128 ->  104 x 104 x  64 0.177 BF
  10 conv    128       3 x 3/ 1    104 x 104 x  64 ->  104 x 104 x 128 1.595 BF
  11 Shortcut Layer: 8
  12 conv    256       3 x 3/ 2    104 x 104 x 128 ->   52 x  52 x 256 1.595 BF
  13 conv    128       1 x 1/ 1     52 x  52 x 256 ->   52 x  52 x 128 0.177 BF
  14 conv    256       3 x 3/ 1     52 x  52 x 128 ->   52 x  52 x 256 1.595 BF
  15 Shortcut Layer: 12
  16 conv    128       1 x 1/ 1     52 x  52 x 256 ->   52 x  52 x 128 0.177 BF
  17 conv    256       3 x 3/ 1     52 x  52 x 128 ->   52 x  52 x 256 1.595 BF
  18 Shortcut Layer: 15
  19 conv    128       1 x 1/ 1     52 x  52 x 256 ->   52 x  52 x 128 0.177 BF
  20 conv    256       3 x 3/ 1     52 x  52 x 128 ->   52 x  52 x 256 1.595 BF
  21 Shortcut Layer: 18
  22 conv    128       1 x 1/ 1     52 x  52 x 256 ->   52 x  52 x 128 0.177 BF
  23 conv    256       3 x 3/ 1     52 x  52 x 128 ->   52 x  52 x 256 1.595 BF
  24 Shortcut Layer: 21
  25 conv    128       1 x 1/ 1     52 x  52 x 256 ->   52 x  52 x 128 0.177 BF
  26 conv    256       3 x 3/ 1     52 x  52 x 128 ->   52 x  52 x 256 1.595 BF
  27 Shortcut Layer: 24
  28 conv    128       1 x 1/ 1     52 x  52 x 256 ->   52 x  52 x 128 0.177 BF
  29 conv    256       3 x 3/ 1     52 x  52 x 128 ->   52 x  52 x 256 1.595 BF
  30 Shortcut Layer: 27
  31 conv    128       1 x 1/ 1     52 x  52 x 256 ->   52 x  52 x 128 0.177 BF
  32 conv    256       3 x 3/ 1     52 x  52 x 128 ->   52 x  52 x 256 1.595 BF
  33 Shortcut Layer: 30
  34 conv    128       1 x 1/ 1     52 x  52 x 256 ->   52 x  52 x 128 0.177 BF
  35 conv    256       3 x 3/ 1     52 x  52 x 128 ->   52 x  52 x 256 1.595 BF
  36 Shortcut Layer: 33
  37 conv    512       3 x 3/ 2     52 x  52 x 256 ->   26 x  26 x 512 1.595 BF
  38 conv    256       1 x 1/ 1     26 x  26 x 512 ->   26 x  26 x 256 0.177 BF
  39 conv    512       3 x 3/ 1     26 x  26 x 256 ->   26 x  26 x 512 1.595 BF
  40 Shortcut Layer: 37
  41 conv    256       1 x 1/ 1     26 x  26 x 512 ->   26 x  26 x 256 0.177 BF
  42 conv    512       3 x 3/ 1     26 x  26 x 256 ->   26 x  26 x 512 1.595 BF
  43 Shortcut Layer: 40
  44 conv    256       1 x 1/ 1     26 x  26 x 512 ->   26 x  26 x 256 0.177 BF
  45 conv    512       3 x 3/ 1     26 x  26 x 256 ->   26 x  26 x 512 1.595 BF
  46 Shortcut Layer: 43
  47 conv    256       1 x 1/ 1     26 x  26 x 512 ->   26 x  26 x 256 0.177 BF
  48 conv    512       3 x 3/ 1     26 x  26 x 256 ->   26 x  26 x 512 1.595 BF
  49 Shortcut Layer: 46
  50 conv    256       1 x 1/ 1     26 x  26 x 512 ->   26 x  26 x 256 0.177 BF
  51 conv    512       3 x 3/ 1     26 x  26 x 256 ->   26 x  26 x 512 1.595 BF
  52 Shortcut Layer: 49
  53 conv    256       1 x 1/ 1     26 x  26 x 512 ->   26 x  26 x 256 0.177 BF
  54 conv    512       3 x 3/ 1     26 x  26 x 256 ->   26 x  26 x 512 1.595 BF
  55 Shortcut Layer: 52
  56 conv    256       1 x 1/ 1     26 x  26 x 512 ->   26 x  26 x 256 0.177 BF
  57 conv    512       3 x 3/ 1     26 x  26 x 256 ->   26 x  26 x 512 1.595 BF
  58 Shortcut Layer: 55
  59 conv    256       1 x 1/ 1     26 x  26 x 512 ->   26 x  26 x 256 0.177 BF
  60 conv    512       3 x 3/ 1     26 x  26 x 256 ->   26 x  26 x 512 1.595 BF
  61 Shortcut Layer: 58
  62 conv   1024       3 x 3/ 2     26 x  26 x 512 ->   13 x  13 x1024 1.595 BF
  63 conv    512       1 x 1/ 1     13 x  13 x1024 ->   13 x  13 x 512 0.177 BF
  64 conv   1024       3 x 3/ 1     13 x  13 x 512 ->   13 x  13 x1024 1.595 BF
  65 Shortcut Layer: 62
  66 conv    512       1 x 1/ 1     13 x  13 x1024 ->   13 x  13 x 512 0.177 BF
  67 conv   1024       3 x 3/ 1     13 x  13 x 512 ->   13 x  13 x1024 1.595 BF
  68 Shortcut Layer: 65
  69 conv    512       1 x 1/ 1     13 x  13 x1024 ->   13 x  13 x 512 0.177 BF
  70 conv   1024       3 x 3/ 1     13 x  13 x 512 ->   13 x  13 x1024 1.595 BF
  71 Shortcut Layer: 68
  72 conv    512       1 x 1/ 1     13 x  13 x1024 ->   13 x  13 x 512 0.177 BF
  73 conv   1024       3 x 3/ 1     13 x  13 x 512 ->   13 x  13 x1024 1.595 BF
  74 Shortcut Layer: 71
  75 conv    512       1 x 1/ 1     13 x  13 x1024 ->   13 x  13 x 512 0.177 BF
  76 conv   1024       3 x 3/ 1     13 x  13 x 512 ->   13 x  13 x1024 1.595 BF
  77 conv    512       1 x 1/ 1     13 x  13 x1024 ->   13 x  13 x 512 0.177 BF
  78 conv   1024       3 x 3/ 1     13 x  13 x 512 ->   13 x  13 x1024 1.595 BF
  79 conv    512       1 x 1/ 1     13 x  13 x1024 ->   13 x  13 x 512 0.177 BF
  80 conv   1024       3 x 3/ 1     13 x  13 x 512 ->   13 x  13 x1024 1.595 BF
  81 conv     18       1 x 1/ 1     13 x  13 x1024 ->   13 x  13 x  18 0.006 BF
  82 yolo
[yolo] params: iou loss: mse (2), iou_norm: 0.75, cls_norm: 1.00, scale_x_y: 1.00
  83 route  79 		                           ->   13 x  13 x 512 
  84 conv    256       1 x 1/ 1     13 x  13 x 512 ->   13 x  13 x 256 0.044 BF
  85 upsample                 2x    13 x  13 x 256 ->   26 x  26 x 256
  86 route  85 61 	                           ->   26 x  26 x 768 
  87 conv    256       1 x 1/ 1     26 x  26 x 768 ->   26 x  26 x 256 0.266 BF
  88 conv    512       3 x 3/ 1     26 x  26 x 256 ->   26 x  26 x 512 1.595 BF
  89 conv    256       1 x 1/ 1     26 x  26 x 512 ->   26 x  26 x 256 0.177 BF
  90 conv    512       3 x 3/ 1     26 x  26 x 256 ->   26 x  26 x 512 1.595 BF
  91 conv    256       1 x 1/ 1     26 x  26 x 512 ->   26 x  26 x 256 0.177 BF
  92 conv    512       3 x 3/ 1     26 x  26 x 256 ->   26 x  26 x 512 1.595 BF
  93 conv     18       1 x 1/ 1     26 x  26 x 512 ->   26 x  26 x  18 0.012 BF
  94 yolo
[yolo] params: iou loss: mse (2), iou_norm: 0.75, cls_norm: 1.00, scale_x_y: 1.00
  95 route  91 		                           ->   26 x  26 x 256 
  96 conv    128       1 x 1/ 1     26 x  26 x 256 ->   26 x  26 x 128 0.044 BF
  97 upsample                 2x    26 x  26 x 128 ->   52 x  52 x 128
  98 route  97 36 	                           ->   52 x  52 x 384 
  99 conv    128       1 x 1/ 1     52 x  52 x 384 ->   52 x  52 x 128 0.266 BF
 100 conv    256       3 x 3/ 1     52 x  52 x 128 ->   52 x  52 x 256 1.595 BF
 101 conv    128       1 x 1/ 1     52 x  52 x 256 ->   52 x  52 x 128 0.177 BF
 102 conv    256       3 x 3/ 1     52 x  52 x 128 ->   52 x  52 x 256 1.595 BF
 103 conv    128       1 x 1/ 1     52 x  52 x 256 ->   52 x  52 x 128 0.177 BF
 104 conv    256       3 x 3/ 1     52 x  52 x 128 ->   52 x  52 x 256 1.595 BF
 105 conv     18       1 x 1/ 1     52 x  52 x 256 ->   52 x  52 x  18 0.025 BF
 106 yolo
[yolo] params: iou loss: mse (2), iou_norm: 0.75, cls_norm: 1.00, scale_x_y: 1.00
Total BFLOPS 65.290 
Loading weights from data_for_colab/yolov3.weights...
 seen 64 
Done! Loaded 107 layers from weights-file 
Learning Rate: 0.001, Momentum: 0.9, Decay: 0.0005
Saving weights to backup//yolov3_final.weights
Cannot load image /data_for_colab/data/93.jpg
Cannot load image /data_for_colab/data/13.jpg
Cannot load image Cannot load image /data_for_colab/data/road.jpg
Cannot load image /data_for_colab/data/85.jpg
Cannot load image /data_for_colab/data/91.jpg
Cannot load image /data_for_colab/data/57.jpg
Cannot load image /data_for_colab/data/72.jpg
Cannot load image /data_for_colab/data/12.jpg
Cannot load image /data_for_colab/data/94.jpg
Cannot load image /data_for_colab/data/100.jpg
Cannot load image /data_for_colab/data/43.jpg
Cannot load image /data_for_colab/data/40.jpg
Cannot load image /data_for_colab/data/78.jpg
Cannot load image /data_for_colab/data/46.jpg
Cannot load image /data_for_colab/data/15.jpg
Cannot load image /data_for_colab/data/92.jpg
Cannot load image /data_for_colab/data/45.jpg
Cannot load image /data_for_colab/data/92.jpg
Cannot load image /data_for_colab/data/33.jpg
Cannot load image /data_for_colab/data/66.jpg
Cannot load image /data_for_colab/data/33.jpg
Cannot load image /data_for_colab/data/102.jpg
Cannot load image /data_for_colab/data/seven.jpg
Cannot load image /data_for_colab/data/57.jpg
Cannot load image /data_for_colab/data/58.jpg
Cannot load image /data_for_colab/data/40.jpg
Cannot load image /data_for_colab/data/29.jpg
Cannot load image /data_for_colab/data/89.jpg
Cannot load image /data_for_colab/data/89.jpg
Cannot load image /data_for_colab/data/37.jpg
Cannot load image /data_for_colab/data/seven.jpg
Cannot load image /data_for_colab/data/92.jpg
Cannot load image /data_for_colab/data/90.jpg
Cannot load image /data_for_colab/data/67.jpg
Cannot load image /data_for_colab/data/87.jpg
Cannot load image /data_for_colab/data/13.jpg
Cannot load image /data_for_colab/data/66.jpg
Cannot load image /data_for_colab/data/20.jpg
Cannot load image /data_for_colab/data/45.jpg
Cannot load image /data_for_colab/data/81.jpg
Cannot load image /data_for_colab/data/92.jpg
Cannot load image /data_for_colab/data/101.jpg
Cannot load image /data_for_colab/data/93.jpg
Cannot load image /data_for_colab/data/77.jpg
/data_for_colab/data/65.jpg
Cannot load image /data_for_colab/data/96.jpg
Cannot load image /data_for_colab/data/81.jpg
Cannot load image /data_for_colab/data/29.jpg
Cannot load image /data_for_colab/data/61.jpg
Cannot load image /data_for_colab/data/93.jpg
Cannot load image /data_for_colab/data/93.jpg
Cannot load image /data_for_colab/data/77.jpg
Cannot load image /data_for_colab/data/nine.jpg
Cannot load image /data_for_colab/data/73.jpg
Cannot load image /data_for_colab/data/15.jpg
Cannot load image /data_for_colab/data/59.jpg
Cannot load image /data_for_colab/data/57.jpg
Cannot load image /data_for_colab/data/43.jpg
Cannot load image /data_for_colab/data/87.jpg
Cannot load image /data_for_colab/data/58.jpg
Cannot load image /data_for_colab/data/67.jpg
Cannot load image /data_for_colab/data/40.jpg
Cannot load image /data_for_colab/data/66.jpg
Cannot load image /data_for_colab/data/23.jpg

How do I run the demo

Hello,

I see you have the weights provided from the training. Can you let me know how do I test the model you have trained?

Thank you

Makefile:185: recipe for target 'obj/network_kernels.o' failed

chmod +x *.sh
nvcc -gencode arch=compute_35,code=sm_35 -gencode arch=compute_50,code=[sm_50,compute_50] -gencode arch=compute_52,code=[sm_52,compute_52] -gencode arch=compute_61,code=[sm_61,compute_61] -Iinclude/ -I3rdparty/stb/include -DOPENCV pkg-config --cflags opencv4 2> /dev/null || pkg-config --cflags opencv -DGPU -I/usr/local/cuda/include/ --compiler-options "-Wall -Wfatal-errors -Wno-unused-result -Wno-unknown-pragmas -fPIC -Ofast -DOPENCV -DGPU" -c ./src/network_kernels.cu -o obj/network_kernels.o
./src/network_kernels.cu(379): warning: variable "l" was declared but never referenced

./src/network_kernels.cu(709): error: identifier "cudaGraphExec_t" is undefined

./src/network_kernels.cu(712): error: identifier "cudaGraph_t" is undefined

./src/network_kernels.cu(721): error: identifier "cudaStreamCaptureModeGlobal" is undefined

./src/network_kernels.cu(721): error: identifier "cudaStreamBeginCapture" is undefined

./src/network_kernels.cu(729): error: identifier "cudaStreamEndCapture" is undefined

./src/network_kernels.cu(730): error: identifier "cudaGraphInstantiate" is undefined

./src/network_kernels.cu(740): error: identifier "cudaGraphLaunch" is undefined

7 errors detected in the compilation of "/tmp/tmpxft_00004e7f_00000000-13_network_kernels.compute_61.cpp1.ii".
Makefile:185: recipe for target 'obj/network_kernels.o' failed
make: *** [obj/network_kernels.o] Error 2

this error occurs when i try to run make command in darknet

No detection after training

Hi Rafiuddin,

First of all, thank you for all the work you put in with this project it helps a lot. I have followed your tutorial and trained a custom tiny yolo model with a custom dataset (wine plants) with 1200 sample.

After 8000 epochs, I get an average loss of 0.4 and when I test my model there is no detection at all.

Should I train my model longer or am I missing something?

Thanks in advance.

Regards,

Training Complete

Hi,

Thanks for putting together this information.

I ran through the training with your data and it ran over 10 hours. How do we know that the training is done or good enough?

Matt

Testing all Images in Folder

I am using Tensorflow object detection Api. I have completed training and have download the trained model through "Python export_v2.py " code.
Now I want to test my model on my test Images folder.
There are many codes that can read and detect single image. But I want to detect my all 50 images that are on my folder.
Kinldy please help me do that.. Thanks in advance

CUDA error in training

Hi, I am getting this error while executing the following step in Google Colab, do you know how to fix it?

Regards,
Michele

!./darknet detector train data_for_colab/obj.data data_for_colab/yolov3-tiny-obj.cfg data_for_colab/yolov3-tiny.conv.15 -dont_show

yolov3-tiny-obj
layer     filters    size              input                output
   0 conv     16  3 x 3 / 1   416 x 416 x   3   ->   416 x 416 x  16 0.150 BF
   1 max          2 x 2 / 2   416 x 416 x  16   ->   208 x 208 x  16 0.003 BF
   2 conv     32  3 x 3 / 1   208 x 208 x  16   ->   208 x 208 x  32 0.399 BF
   3 max          2 x 2 / 2   208 x 208 x  32   ->   104 x 104 x  32 0.001 BF
   4 conv     64  3 x 3 / 1   104 x 104 x  32   ->   104 x 104 x  64 0.399 BF
   5 max          2 x 2 / 2   104 x 104 x  64   ->    52 x  52 x  64 0.001 BF
   6 conv    128  3 x 3 / 1    52 x  52 x  64   ->    52 x  52 x 128 0.399 BF
   7 max          2 x 2 / 2    52 x  52 x 128   ->    26 x  26 x 128 0.000 BF
   8 conv    256  3 x 3 / 1    26 x  26 x 128   ->    26 x  26 x 256 0.399 BF
   9 max          2 x 2 / 2    26 x  26 x 256   ->    13 x  13 x 256 0.000 BF
  10 conv    512  3 x 3 / 1    13 x  13 x 256   ->    13 x  13 x 512 0.399 BF
  11 max          2 x 2 / 1    13 x  13 x 512   ->    13 x  13 x 512 0.000 BF
  12 conv   1024  3 x 3 / 1    13 x  13 x 512   ->    13 x  13 x1024 1.595 BF
  13 conv    256  1 x 1 / 1    13 x  13 x1024   ->    13 x  13 x 256 0.089 BF
  14 conv    512  3 x 3 / 1    13 x  13 x 256   ->    13 x  13 x 512 0.399 BF
  15 conv     18  1 x 1 / 1    13 x  13 x 512   ->    13 x  13 x  18 0.003 BF
  16 yolo
  17 route  13
  18 conv    128  1 x 1 / 1    13 x  13 x 256   ->    13 x  13 x 128 0.011 BF
  19 upsample            2x    13 x  13 x 128   ->    26 x  26 x 128
  20 route  19 8
  21 conv    256  3 x 3 / 1    26 x  26 x 384   ->    26 x  26 x 256 1.196 BF
  22 conv     18  1 x 1 / 1    26 x  26 x 256   ->    26 x  26 x  18 0.006 BF
  23 yolo
Total BFLOPS 5.448 
 Allocate additional workspace_size = 24.92 MB 
Loading weights from data_for_colab/yolov3-tiny.conv.15...
 seen 64 
Done!
Learning Rate: 0.001, Momentum: 0.9, Decay: 0.0005
Resizing
608 x 608 
 try to allocate additional workspace_size = 53.23 MB 
 CUDA allocate done! 
Loaded: 0.000058 seconds
CUDA Error Prev: an illegal memory access was encountered
CUDA Error Prev: an illegal memory access was encountered: File exists
darknet: ./src/utils.c:293: error: Assertion `0' failed.

Can't download the file"yolov3-tiny-obj_1000.weights",please provide a new download link.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.