Only single thread is used in 'Sampler' about wicwiu HOT 1 OPEN

wicwiu commented on June 7, 2024

Only single thread is used in 'Sampler'

from wicwiu.

Comments (1)

cmpark0126 commented on June 7, 2024

I think this is the problem with lambda expression code.
Please check that logic and if there is error semantically, fix them using another C/C++ function.

Refer to this code below:

WICWIU/WICWIU_src/DataLoader.hpp

Lines 212 to 228 in be6c12d

 template<typename DTYPE> void DataLoader<DTYPE>::StartProcess() { 

 // Generate thread for Dist - DistributeIdxOfData2Thread() 

 // Generate thread set for Process - 

 m_nowWorking = TRUE; 

 m_aThreadForDistInfo = std::thread([&]() { 

 this->DistributeIdxOfData2Thread(); 

 }); // lambda expression 

 printf("Generate dataloader base thread\r\n"); 

 for (int i = 0; i < m_numOfWorker; i++) { 

 m_aaWorkerForProcess[i] = std::thread([&]() { 

 this->DataPreprocess(); 

 }); // lambda expression 

 printf("Generate worker[%d] for data preprocessing\r\n", i); 

 } 

 }

from wicwiu.

Only single thread is used in 'Sampler' about wicwiu HOT 1 OPEN

Comments (1)

Related Issues (19)

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent

	template<typename DTYPE> void DataLoader<DTYPE>::StartProcess() {
	// Generate thread for Dist - DistributeIdxOfData2Thread()
	// Generate thread set for Process -
	m_nowWorking = TRUE;

	m_aThreadForDistInfo = std::thread([&]() {
	this->DistributeIdxOfData2Thread();
	}); // lambda expression
	printf("Generate dataloader base thread\r\n");

	for (int i = 0; i < m_numOfWorker; i++) {
	m_aaWorkerForProcess[i] = std::thread([&]() {
	this->DataPreprocess();
	}); // lambda expression
	printf("Generate worker[%d] for data preprocessing\r\n", i);
	}
	}