I am using yolo and on linux my build is giving me an error I have document on this issue https://forum.unity.com/threads/urgent-shader-loading-problem.1194259/
Could anyone help me here?

Hello,

I was wondering how to change the weights of the yolo model and use my own model

Thanks

Thanks for your job, its wonderful. My knowledge is limited and I would appreciate it if you could help me.
Recently, I want to deploy ML model on HoloLens2, and I found that we can directly deploy UWP on HoloLens 2. I have been deploy a clissification model, it worked. But when I tried to deploy the deteciton model, errors occurred.
I am a newbie in HoloLens 2 Deployment, and my reference source is https://learn.microsoft.com/zh-cn/windows/ai/windows-ml/tutorials/tensorflow-train-model. I don't know why detection model can' deploy on HoloLens 2 like classification model. I want to know if HoloLens 2 supports Yolov5 and other deep learning models.
If you know answers, plz share your valuable ideas. Thanks!

According to the installation method mentioned in the article：
Install-Package ..\OpenCV.HoloLens.3411.0.0.nupkg -ProjectName ComputeOnDesktopYolo
Install-Package ..\OpenCV.HoloLens.3411.0.0.nupkg -ProjectName OpenCVHelpers
I entered the above command in the program envelope console of the project as follows：

Could you point out the problem to me?

Thank you so much for this repository. It is very useful for me, so that I am developing an object detection app on the Hololens2.

I have no trouble building the YoloHololensUnityProject, but ComputeonDesktopYolo is not working properly for me. When I introduce the IP direction of my Hololens by release in x64 at Local Machine, I get an error at ppltasks.h "Unhandled exception at 0x00007FFA15A9B65C (KernelBase.dll) in ComputeOnDesktopYolo.exe: 0xC000027B: An internal application exception occurred (parameters: 0x0000029E3DB94FE0, 0x0000000000000001)."
I tried deactivaitng the firewall and the proxy but did not work.

Previous to this point, I had to chage MainPage.xaml.cpp an delete the concurrency from this void, and ad #pragma

"
#pragma warning(disable:4716)
concurrency::task MainPage::LoadModelAsync()
{
// just load the model one time.
if (_model == nullptr)
{
std::wstringstream wStringstream;
wStringstream << "Loading model..." << "\n";
OutputDebugString(wStringstream.str().c_str());

		try
		{
			String^ filePath = "ms-appx:///Assets/" + modelFileName;

			// From Windows ML samples, MNIST cpp
			create_task(StorageFile::GetFileFromApplicationUriAsync(
				ref new Uri(filePath)))
				.then([](StorageFile^ modelFile) {
				return create_task(YoloModelIO::Model::CreateFromStreamAsync(
					modelFile,
					LearningModelDeviceKind::Default)); })
				.then([this](YoloModelIO::Model ^model) {
					this->_model = model;
				});
		}
		catch (const std::exception&)
		{
			std::wstringstream wStringstream2;
			wStringstream2 << "Error loading the model." << "\n";
			OutputDebugString(wStringstream2.str().c_str());
			_model = nullptr;
		}
	}
#pragma warning(default:4716)
}

"

I need urgent help for this issue, I would be very grateful. I attached a capture of how far I could get with ComputeonDesktopYolo
.

Thank you

Hello,

I was wondering how to change the weights of the yolo model and use my own model

Thanks

When I try building the ComputeOnDesktopYolo sample, I was originally getting an error code of WMC9999 with the description "Exception from HRESULT: 0x80070003" and the file in question was Microsoft.Windows.UI.Xaml.Common.targets within the Visual Studio 2019 files. When I click on the error code, the Visual Studios documentation site "couldn't find what you were looking for." However double clicking on the error itself brings me to a "CompileXaml" task on line 266.

I tried using the fix by utrav in their issue posted on 5/2020 in which they moved the contents of LoadModelAsync() into MainPage() in the file MainPage.xaml.cpp. It wasn't the exact issue I was encountering but figured it was worth testing, and now I'm getting two errors:

The first error doesn't make a whole lot of sense given that the entire script is "#include pch.h". The second error occurs in the same file as what I encountered in the first build attempt, also in a "CompileXaml" task, albeit on line 415 this time.

Since the small change I made to MainPage.xaml.cpp leads to a different error in the same file in another CompileXaml task, I believe that there's either something wrong with Microsoft.Windows.UI.Xaml.Common.targets as a whole, or the CompileXaml tasks specifically, but I have not been able to find a good resource for diagnosing the problem. For reference, I am using Visual Studio 2019 (16.11.23). Any help would be very appreciated.

Hello Mitchell, when I deploy the ComputeOnDesktopYolo project on Local Machine, I get the error:

Exception thrown at 0x09546B00 in ComputeOnDesktopYolo.exe: 0xC0000005: Access violation executing location 0x09546B00.

Can you please help me understand what went wrong?
Thank you!

EDIT: I have noticed that the exception occurs when the function concurrency::task MainPage::LoadModelAsync() is called, even if it is called with its content commented. Any ideas why this function causes this exception?

Hello Mitchell,

thank you for your code. It has been very helpful.

When I build the Unity project using the XR SDK (following the steps here: https://microsoft.github.io/MixedRealityToolkit-Unity/Documentation/GettingStartedWithMRTKAndXRSDK.html), a connection is not established. I can stream from Hololens to PC, bounding boxes are detected on PC, but I cannot receive bounding boxes in Hololens. The error in ComputeOnDesktopYolo is:

DesktopStreamer::Consume:data dropped -- no connection!

Have you tested the project using XR SDK in Unity? Could you provide some insight on what goes wrong?

Thank you for your time.

Hello mitchell,

I deployed the first sample onto the hololens 2 and then started the ComputeOnDesktop x64 on my pc.
Everything starts fine. I use the Release Version for both the hololens sample and desktop sample.
But when entering the IP adress of the hololens the programme crashes and throws the exception:

Exception thrown at 0x00007FF875CB3B29 in ComputeOnDesktopYolo.exe: Microsoft C++ exception: Platform::COMException ^ at memory location 0x000000F024AFF4B0. HRESULT:0x8007274C

Which is the exception, that there was no response from the hololens.
The same happens if I enter some random ip address.

But the ip i entered was the same one I used for deploying the programme onto the hololens. And there it worked completely fine.
And the ip i entered in unity at the beginning is also right

Regards,
Alex

I downloaded the YoloDetectionHoloLens-Unity project.

As described, the .dlls of HoloLensForCV were put into the Plugin/ARM.

YoloDetection's Device Type was HL2 and the IP address was modified to build.

It was opened with VS2019 and changed to Release and ARM64 and built in HoloLens2.

An error occurs when running on HoloLens2.

Do you know the cause and solution of this error?

Please let me know. Thank you.

Hi,
I use your DrawBoundingBoxes.cs but the boxes (or rather the text) don't get destroyed properly:

After receiving the boxes from the parser I use the following code:

if (this.boxes.Count > 0)
{
    boundingBoxDrawer.DrawBoxes(this.boxes);
}
else
{
    this.boxes.Add(new EmptyBox());
    boundingBoxDrawer.DrawBoxes(this.boxes);
}

Any ideas what's happening??

Update: The problem seems to occure as soon as more than one object is detected in a frame. It detected two objects. Both boxes got destroyed at the next update but one label remained in the view.

I want to transfer depthframe of hololens to PC by enabling the HoloLensResearchModeSensors like your project-"HoloLensForCVUnity", but either the enable fails or the depthframe cannot be sent.(I do not know where use the "SensorFrameStreamingServer::Send").

Do you have some suggestions?
Thank you so much!

Nice to meet you! I ran your program and was very impressed! So my question is, what specific Yolo model is your program using?
I would appreciate it if you could tell me!

Hi,

I've got everything working except receiving the bounding boxes on the HoloLens.
I can see the bounding boxes on the desktop client but if I double-click in the HoloLens app the text "No bounding boxes received" shows and then the app crashed within 10-20 seconds with the following error in VS:

Exception thrown at 0x76C03A12 in YoloDetectionHoloLensUnity.exe: Microsoft C++ exception: Platform::COMException ^ at memory location 0x0717FA10. HRESULT:0x8007274C A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
WinRT information: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.

I have no idea what could cause this. I've tested it with the devices on the same WIFI and with the desktop being connected through cable (Changed IP in Unity when switching from/to cable).

Does anyone know what could cause this or what a solution could be?

When deploying the programme onto my hololens 2 I get the unity Logo and then just some text saying "Initializing MediaFrameSourceGroup".

I have deployed the Release Verision on ARM.

If you need any more information feel free to tell me