Failed to Execute Error about uitest-pop-example HOT 10 CLOSED

Hi @ADefWebserver ,

So I looked at the code and I am unable to reproduce it on my system. But I have a few suggestions to try :

1. From the error it looks like adb had issues uninstalling the app from your device/emulator, could you try manually uninstalling the app and running the tests again.
2. I have made a new branch called bug/droidIssue which includes updates to the package references and the .NET version. Could you give that branch a try? Please remember to clean the folder before you build. (Delete all bin/obj folders and the packages folder as well)
3. There is a completely new updated branch called feature/nunit3update which uses the latest pre-release UITest package that supports NUnit 3 and the NUnit adapter for VS is updated to support it. You can clean your folder and try using this branch as well. It might give you better results.

Also, my emulator is using Android Oreo, I'm not sure what version of Android your emulator is, you can also try creating a new image with the latest Android and try the samples.

Let me know if any of the solutions above work for you.

from uitest-pop-example.

Soo sorry!
I now ran the correct project and it works!

from uitest-pop-example.

Link to Twitter exchange with Microsoft:
https://twitter.com/ADefWebserver/status/1106301472268910592

Using: Microsoft Visual Studio Community Edition 15.9.8
Download Xamarin.UITest.POPSample, open up and builds fine.

The tests show up and you can select “Run Selected Tests”

The errors:
[3/15/2019 4:50:16 PM Diagnostic] On real test window Open...
[3/15/2019 4:50:16 PM Diagnostic] About to Enqueue operation 'OpenOperation', hashcode:2279597
[3/15/2019 4:50:16 PM Diagnostic] Enqueue operation 'OpenOperation', hashcode:2279597
[3/15/2019 4:50:16 PM Diagnostic] Operation left in the the queue: 1
[3/15/2019 4:50:16 PM Diagnostic] 'OpenOperation', hashcode:2279597
[3/15/2019 4:50:16 PM Diagnostic]
[3/15/2019 4:50:16 PM Diagnostic] Processing Queue .....
[3/15/2019 4:50:16 PM Diagnostic] Operation Dequeue : 'OpenOperation'
[3/15/2019 4:50:16 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=OperationSetStarted, operationInProgress=False
[3/15/2019 4:50:16 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=OperationSetStarted, InProgress=False
[3/15/2019 4:50:16 PM Diagnostic] About to Enqueue operation 'LoadPlaylistOperation', hashcode:20516373
[3/15/2019 4:50:16 PM Diagnostic] Enqueue operation 'LoadPlaylistOperation', hashcode:20516373
[3/15/2019 4:50:16 PM Diagnostic] Operation left in the the queue: 1
[3/15/2019 4:50:16 PM Diagnostic] 'LoadPlaylistOperation', hashcode:20516373
[3/15/2019 4:50:16 PM Diagnostic]

[3/15/2019 4:50:16 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=OperationSetFinished, operationInProgress=False
[3/15/2019 4:50:16 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=OperationSetFinished, InProgress=False
[3/15/2019 4:50:16 PM Diagnostic] Processing Queue .....
[3/15/2019 4:50:16 PM Diagnostic] Operation Dequeue : 'LoadPlaylistOperation'
[3/15/2019 4:50:16 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=OperationSetStarted, operationInProgress=False
[3/15/2019 4:50:16 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=OperationSetStarted, InProgress=False
[3/15/2019 4:50:16 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=OperationSetFinished, operationInProgress=True
[3/15/2019 4:50:16 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=OperationSetFinished, InProgress=False
[3/15/2019 4:50:17 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=PlaylistRefreshFinished, operationInProgress=False
[3/15/2019 4:50:17 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=PlaylistRefreshFinished, InProgress=False
[3/15/2019 4:50:17 PM Diagnostic] Verifying Solution load status...
[3/15/2019 4:50:17 PM Diagnostic] Triggering auto-discovery from OnRealTestWindowOpen Event...
[3/15/2019 4:50:17 PM Diagnostic] About to Enqueue operation 'DiscoverAllOrRunOnInitializeOperation', hashcode:54192215
[3/15/2019 4:50:17 PM Diagnostic] Enqueue operation 'DiscoverAllOrRunOnInitializeOperation', hashcode:54192215
[3/15/2019 4:50:17 PM Diagnostic] Operation left in the the queue: 1
[3/15/2019 4:50:17 PM Diagnostic] 'DiscoverAllOrRunOnInitializeOperation', hashcode:54192215
[3/15/2019 4:50:17 PM Diagnostic]

[3/15/2019 4:50:17 PM Diagnostic] Processing Queue .....
[3/15/2019 4:50:17 PM Diagnostic] Operation Dequeue : 'DiscoverAllOrRunOnInitializeOperation'
[3/15/2019 4:50:17 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=OperationSetStarted, operationInProgress=False
[3/15/2019 4:50:17 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=OperationSetStarted, InProgress=False
[3/15/2019 4:50:15 PM Diagnostic] Waiting for the package initialization...
[3/15/2019 4:50:15 PM Diagnostic] Package initialization finished !
[3/15/2019 4:50:16 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=PlaylistRefreshStarting, operationInProgress=True
[3/15/2019 4:50:16 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=PlaylistRefreshStarting, InProgress=False
[3/15/2019 4:50:16 PM Diagnostic] ------ Load Playlist started ------
[3/15/2019 4:50:16 PM Diagnostic] ========== Load Playlist finished (0:00:00) ==========
[3/15/2019 4:50:16 PM Diagnostic] Initializing real time test discovery
[3/15/2019 4:50:17 PM Diagnostic] Setting active playlist to :
[3/15/2019 4:50:17 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=ChangeDetectionStarting, operationInProgress=True
[3/15/2019 4:50:17 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=ChangeDetectionStarting, InProgress=False
[3/15/2019 4:50:17 PM Diagnostic] test container discoverer executor://pythontestexecutor/v1, discovered 0 containers
[3/15/2019 4:50:17 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=OperationSetFinished, operationInProgress=False
[3/15/2019 4:50:17 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=OperationSetFinished, InProgress=False
[3/15/2019 4:50:17 PM Diagnostic] No containers found from 'Microsoft.PythonTools.TestAdapter.TestContainerDiscoverer' :
[3/15/2019 4:50:17 PM Diagnostic] Adding the Project in Project Map for Guid a290cb94-4c60-466b-be1a-de03e06038a6
[3/15/2019 4:50:17 PM Diagnostic] Time taken for fetching Roslyn supported projects: 1 milliseconds.
[3/15/2019 4:50:17 PM Diagnostic] test container discoverer executor://vsprojectoutputcontainerdiscoverer/v1, discovered 1 containers
[3/15/2019 4:50:17 PM Diagnostic] Containers from 'Microsoft.VisualStudio.TestWindow.VsAdapters.VsProjectOutputContainerDiscoverer' :
[3/15/2019 4:50:17 PM Diagnostic] C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\bin\Debug\Xamarin.UITest.POPSample.dll:executor://vsprojectoutputcontainerdiscoverer/v1
[3/15/2019 4:50:17 PM Diagnostic] test container discoverer executor://testexplorerservicecontainerdiscoverer/v1, discovered 0 containers
[3/15/2019 4:50:17 PM Diagnostic] No containers found from 'Microsoft.VisualStudio.TestWindow.Extensibility.TestExplorerServiceContainerDiscoverer' :
[3/15/2019 4:50:17 PM Diagnostic] test container discoverer executor://cpsprojectoutputtestcontainerdiscoverer/v2, discovered 0 containers
[3/15/2019 4:50:17 PM Diagnostic] No containers found from 'Microsoft.VisualStudio.TestWindow.Extensions.CPSTestContainerDiscoverer' :
[3/15/2019 4:50:17 PM Diagnostic] test container discoverer executor://orderedtestadapter/v1, discovered 0 containers
[3/15/2019 4:50:17 PM Diagnostic] No containers found from 'Microsoft.VisualStudio.MSTest.TestWindow.OrderedTestContainerDiscoverer' :
[3/15/2019 4:50:17 PM Diagnostic] test container discoverer executor://generictestadapter/v1, discovered 0 containers
[3/15/2019 4:50:17 PM Diagnostic] No containers found from 'Microsoft.VisualStudio.MSTest.TestWindow.GenericTestContainerDiscoverer' :
[3/15/2019 4:50:17 PM Diagnostic] test container discoverer executor://webtestadapter/v1, discovered 0 containers
[3/15/2019 4:50:17 PM Diagnostic] No containers found from 'Microsoft.VisualStudio.MSTest.TestWindow.WebTestContainerDiscoverer' :
[3/15/2019 4:50:17 PM Diagnostic] DiscoveryOperation FinishedChangedCotainers, changed container count is 1
[3/15/2019 4:50:17 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=ChangeDetectionFinished, operationInProgress=False
[3/15/2019 4:50:17 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=ChangeDetectionFinished, InProgress=False
[3/15/2019 4:50:20 PM Diagnostic] Discovering tests in C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\obj\Debug\TemporaryGeneratedFile_5937a670-0e60-4077-877b-f7221da3dda1.cs
[3/15/2019 4:50:20 PM Diagnostic] Discovering tests in C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\PlatformQuery.cs
[3/15/2019 4:50:20 PM Diagnostic] Discovering tests in C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\BasePage.cs
[3/15/2019 4:50:20 PM Diagnostic] Discovering tests in C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\BaseTestFixture.cs
[3/15/2019 4:50:20 PM Diagnostic] Discovering tests in C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\Pages\TaskDetailsPage.cs
[3/15/2019 4:50:20 PM Diagnostic] Discovering tests in C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\Tests\TaskyTests.cs
[3/15/2019 4:50:20 PM Diagnostic] Discovering tests in C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\obj\Debug\TemporaryGeneratedFile_036C0B5B-1481-4323-8D20-8F5ADCB23D92.cs
[3/15/2019 4:50:20 PM Diagnostic] Discovering tests in C:\Users\webma\AppData\Local\Temp.NETFramework,Version=v4.5.AssemblyAttributes.cs
[3/15/2019 4:50:20 PM Diagnostic] Discovering tests in C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\Tests\iOSOnlyTests.cs
[3/15/2019 4:50:20 PM Diagnostic] Discovering tests in C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\obj\Debug\TemporaryGeneratedFile_E7A71F73-0F8D-4B9B-B56E-8E70B10BC5D3.cs
[3/15/2019 4:50:20 PM Diagnostic] Discovering tests in C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\AppManager.cs
[3/15/2019 4:50:20 PM Diagnostic] Discovering tests in C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\Pages\TaskListPage.cs
[3/15/2019 4:50:43 PM Diagnostic] Pausing Queue..., current operation is: no current operation
[3/15/2019 4:50:43 PM Diagnostic] About to Enqueue operation 'WaitForBuildOperation', hashcode:13856047
[3/15/2019 4:50:43 PM Diagnostic] Enqueue operation 'WaitForBuildOperation', hashcode:13856047
[3/15/2019 4:50:43 PM Diagnostic] Operation left in the the queue: 1
[3/15/2019 4:50:43 PM Diagnostic] 'WaitForBuildOperation', hashcode:13856047
[3/15/2019 4:50:43 PM Diagnostic]

[3/15/2019 4:50:43 PM Diagnostic] Processing Queue .....
[3/15/2019 4:50:43 PM Diagnostic] Operation Dequeue : 'WaitForBuildOperation'
[3/15/2019 4:50:43 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=OperationSetStarted, operationInProgress=False
[3/15/2019 4:50:43 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=OperationSetStarted, InProgress=False
[3/15/2019 4:50:45 PM Diagnostic] Firing BuildCompleted event...
[3/15/2019 4:50:45 PM Diagnostic] Container Discoverer 'Microsoft.VisualStudio.TestWindow.Extensions.CPSTestContainerDiscoverer' has container changes
[3/15/2019 4:50:45 PM Diagnostic] Firing BuildCompleted event...
[3/15/2019 4:50:45 PM Diagnostic] Container Discoverer 'Microsoft.VisualStudio.TestWindow.VsAdapters.VsProjectOutputContainerDiscoverer' has container changes
[3/15/2019 4:50:45 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=OperationSetFinished, operationInProgress=False
[3/15/2019 4:50:45 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=OperationSetFinished, InProgress=False
[3/15/2019 4:50:45 PM Diagnostic] test container discoverer executor://cpsprojectoutputtestcontainerdiscoverer/v2, discovered 0 containers
[3/15/2019 4:50:45 PM Diagnostic] No containers found from 'Microsoft.VisualStudio.TestWindow.Extensions.CPSTestContainerDiscoverer' :
[3/15/2019 4:50:45 PM Diagnostic] Container discoverer 'Microsoft.VisualStudio.TestWindow.Extensions.CPSTestContainerDiscoverer' has no containers
[3/15/2019 4:50:45 PM Diagnostic] Adding the Project in Project Map for Guid a290cb94-4c60-466b-be1a-de03e06038a6
[3/15/2019 4:50:45 PM Diagnostic] test container discoverer executor://vsprojectoutputcontainerdiscoverer/v1, discovered 1 containers
[3/15/2019 4:50:45 PM Diagnostic] Containers from 'Microsoft.VisualStudio.TestWindow.VsAdapters.VsProjectOutputContainerDiscoverer' :
[3/15/2019 4:50:45 PM Diagnostic] C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\bin\Debug\Xamarin.UITest.POPSample.dll:executor://vsprojectoutputcontainerdiscoverer/v1
[3/15/2019 4:50:45 PM Diagnostic] About to Enqueue operation 'DiscoverSelectedOperation', hashcode:26243057
[3/15/2019 4:50:45 PM Diagnostic] Enqueue operation 'DiscoverSelectedOperation', hashcode:26243057
[3/15/2019 4:50:45 PM Diagnostic] Operation left in the the queue: 1
[3/15/2019 4:50:45 PM Diagnostic] 'DiscoverSelectedOperation', hashcode:26243057
[3/15/2019 4:50:45 PM Diagnostic]

[3/15/2019 4:50:45 PM Diagnostic] Processing Queue .....
[3/15/2019 4:50:45 PM Diagnostic] Operation Dequeue : 'DiscoverSelectedOperation'
[3/15/2019 4:50:45 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=OperationSetStarted, operationInProgress=False
[3/15/2019 4:50:45 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=OperationSetStarted, InProgress=False
[3/15/2019 4:50:45 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=ChangeDetectionStarting, operationInProgress=True
[3/15/2019 4:50:45 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=ChangeDetectionStarting, InProgress=False
[3/15/2019 4:50:45 PM Diagnostic] DiscoveryOperation FinishedChangedCotainers, changed container count is 1
[3/15/2019 4:50:45 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=ChangeDetectionFinished, operationInProgress=False
[3/15/2019 4:50:45 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=ChangeDetectionFinished, InProgress=False
[3/15/2019 4:50:45 PM Diagnostic] Discovering the following containers :
[3/15/2019 4:50:45 PM Diagnostic] C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\bin\Debug\Xamarin.UITest.POPSample.dll
[3/15/2019 4:50:45 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=DiscoveryStarting, operationInProgress=False
[3/15/2019 4:50:45 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=DiscoveryStarting, InProgress=True
[3/15/2019 4:50:45 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=DiscoveryStarted, operationInProgress=False
[3/15/2019 4:50:45 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=DiscoveryStarted, InProgress=True
[3/15/2019 4:50:45 PM Informational] ------ Discover test started ------
[3/15/2019 4:50:45 PM Diagnostic] *** Discover TestCase using 'InMemoryUnitTestWriter' ***
[3/15/2019 4:50:46 PM Diagnostic] RunSettings Content:





C:\Temp\uitest-pop-example\TestResults
C:\Temp\uitest-pop-example</SolutionDirectory>
X86
Framework45


[3/15/2019 4:50:46 PM Diagnostic] Source Information Provider feature status: ON
[3/15/2019 4:50:46 PM Diagnostic] Test assembly C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\bin\Debug\Xamarin.UITest.POPSample.dll references test framework: NUNIT
[3/15/2019 4:50:46 PM Diagnostic] Time taken for fetching Roslyn supported projects: 0 milliseconds.
[3/15/2019 4:50:46 PM Diagnostic] Time taken for fetching compilation for project: xamarin.uitest.popsample = 0 milliseconds.
[3/15/2019 4:50:46 PM Diagnostic] Value of UseSpecifiedAdapterLocations as specified in Tools -> Options: True
[3/15/2019 4:50:46 PM Diagnostic] Value of FallbackToGlobalVsix as specified in Tools -> Options: True
[3/15/2019 4:50:46 PM Diagnostic] Neither MSTest V1 nor NUnit VSIX usage detected in current request. Hence setting SkipDefaultAdapters to true.
[3/15/2019 4:50:46 PM Diagnostic] Adapter location settings being used after evaluation: UseSpecifiedAdapterLocations = True, SkipDefaultAdapters = True, AreAllTestContainersCSharpOrVBProjectsOnly = True
[3/15/2019 4:50:46 PM Diagnostic] RockSteady initialized with the following extensions:
[3/15/2019 4:50:47 PM Informational] Test project Xamarin.UITest.POPSample does not reference any .NET NuGet adapter. Test discovery or execution might not work for this project.
It's recommended to reference NuGet test adapters in each test project in the solution.
[3/15/2019 4:50:47 PM Informational] ========== Discover test finished: 0 found (0:00:01.6942886) ==========
[3/15/2019 4:50:47 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=DiscoveryFinished, operationInProgress=False
[3/15/2019 4:50:47 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=DiscoveryFinished, InProgress=False
[3/15/2019 4:50:47 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=OperationSetFinished, operationInProgress=False
[3/15/2019 4:50:47 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=OperationSetFinished, InProgress=False
[3/15/2019 4:54:36 PM Diagnostic] About to Enqueue operation 'RunSelectedOperation', hashcode:48051319
[3/15/2019 4:54:36 PM Diagnostic] Enqueue operation 'RunSelectedOperation', hashcode:48051319
[3/15/2019 4:54:36 PM Diagnostic] Operation left in the the queue: 1
[3/15/2019 4:54:36 PM Diagnostic] 'RunSelectedOperation', hashcode:48051319
[3/15/2019 4:54:36 PM Diagnostic]
[3/15/2019 4:54:36 PM Diagnostic] Processing Queue .....
[3/15/2019 4:54:36 PM Diagnostic] Operation Dequeue : 'RunSelectedOperation'
[3/15/2019 4:54:36 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=OperationSetStarted, operationInProgress=False
[3/15/2019 4:54:36 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=OperationSetStarted, InProgress=False
[3/15/2019 4:54:36 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=ChangeDetectionStarting, operationInProgress=True
[3/15/2019 4:54:36 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=ChangeDetectionStarting, InProgress=False
[3/15/2019 4:54:36 PM Diagnostic] We programmatically start the build in TestWindowHost.UpdateContainer...
[3/15/2019 4:54:36 PM Diagnostic] After we await the build that programmatically started in TestWindowHost.UpdateContainer...
[3/15/2019 4:54:36 PM Diagnostic] TestContainer update (build) complete : 246 ms
[3/15/2019 4:54:36 PM Diagnostic] Time taken for fetching Roslyn supported projects: 0 milliseconds.
[3/15/2019 4:54:36 PM Diagnostic] DiscoveryOperation FinishedChangedCotainers, changed container count is 0
[3/15/2019 4:54:36 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=ChangeDetectionFinished, operationInProgress=False
[3/15/2019 4:54:36 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=ChangeDetectionFinished, InProgress=False
[3/15/2019 4:54:36 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=TestExecutionStarting, operationInProgress=False
[3/15/2019 4:54:36 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=TestExecutionStarting, InProgress=False
[3/15/2019 4:54:36 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=TestExecutionStarted, operationInProgress=False
[3/15/2019 4:54:36 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=TestExecutionStarted, InProgress=False
[3/15/2019 4:54:36 PM Informational] ------ Run test started ------
[3/15/2019 4:54:36 PM Diagnostic] RunSettings Content:





C:\Temp\uitest-pop-example\TestResults
C:\Temp\uitest-pop-example</SolutionDirectory>
X86
Framework45


[3/15/2019 4:54:36 PM Diagnostic] Test assembly C:\Temp\uitest-pop-example\Xamarin.UITest.POPSample\bin\Debug\Xamarin.UITest.POPSample.dll references test framework: NUNIT
[3/15/2019 4:54:36 PM Diagnostic] Value of UseSpecifiedAdapterLocations as specified in Tools -> Options: True
[3/15/2019 4:54:36 PM Diagnostic] Value of FallbackToGlobalVsix as specified in Tools -> Options: True
[3/15/2019 4:54:36 PM Diagnostic] Neither MSTest V1 nor NUnit VSIX usage detected in current request. Hence setting SkipDefaultAdapters to true.
[3/15/2019 4:54:36 PM Diagnostic] Adapter location settings being used after evaluation: UseSpecifiedAdapterLocations = True, SkipDefaultAdapters = True, AreAllTestContainersCSharpOrVBProjectsOnly = True
[3/15/2019 4:54:36 PM Diagnostic] Final RunSettings for the current TestRunCriteria:





C:\Temp\uitest-pop-example\TestResults
C:\Temp\uitest-pop-example</SolutionDirectory>
X86
Framework45
False


[3/15/2019 4:54:37 PM Informational] Test project Xamarin.UITest.POPSample does not reference any .NET NuGet adapter. Test discovery or execution might not work for this project.
It's recommended to reference NuGet test adapters in each test project in the solution.
[3/15/2019 4:54:37 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=OperationSetFinished, operationInProgress=False
[3/15/2019 4:54:37 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=OperationSetFinished, InProgress=False
[3/15/2019 4:54:37 PM Diagnostic] *** Run finished using 'InMemoryUnitTestWriter' ***
[3/15/2019 4:54:37 PM Informational] ========== Run test finished: 0 run (0:00:00.7166476) ==========
[3/15/2019 4:54:37 PM Diagnostic] VirtualReadOnlyTestDataStore.OperationStateChanged State=TestExecutionFinished, operationInProgress=False
[3/15/2019 4:54:37 PM Diagnostic] TestDiscoveryStats.OperationStateChanged State=TestExecutionFinished, InProgress=False

For this error:
[3/15/2019 4:50:47 PM Informational] Test project Xamarin.UITest.POPSample does not reference any .NET NuGet adapter. Test discovery or execution might not work for this project.
It's recommended to reference NuGet test adapters in each test project in the solution.

I go to:
https://developercommunity.visualstudio.com/content/problem/311537/unit-testing-cannot-findexecute-test-cases-anymore.html
and:
https://developercommunity.visualstudio.com/content/problem/319516/cant-run-or-debug-tests.html

and install:
https://marketplace.visualstudio.com/items?itemName=NUnitDevelopers.NUnitTestAdapter

Then I get:

Java Development Kit (JDK) not found. Please make sure that it is installed and if it's still not located, please set the JAVA_HOME environment variable to point to the directory. Searched locations:Windows Registry [ Source: JAVA_HOME ]

Try pointing the JAVA_HOME to: C:\Program Files\Android\jdk\microsoft_dist_openjdk_1.8.0.25\bin
See:
https://forum.unity.com/threads/android-unable-to-build-jdk-error-unable-to-find-jdk.193318/

That doesn’t work so I then install:
https://developer.android.com/studio/

That didn’t work so I installed:
https://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html

Then added these Environment Variables (note that the slashes are backward):

JAVA_HOME
C:/Program Files/Java/jdk1.8.0_201

JRE_HOME
C:/Program Files/Java/jre1.8.0_201

I then get:
System.Exception: 'No devices connected.'

I then start a Android device in the Android Simulator Device (in Visual Studio: Tools\Android\Android Device Manager)

I then Get:

The running adb server is incompatible with the Android SDK version in use by UITest:
C:\Program Files (x86)\Android\android-sdk

You probably have multiple installations of the Android SDK and should update them or ensure that your IDE, simulator and shell all use the same instance. The ANDROID_HOME environment variable can effect this.

I probably do have the ANDROID_HOME environmental variable pointing to a different place than JAVA Home

(Currently the ANDROID_HOME is pointing to a different place than the JAVA_HOME (that the UI Testing framework is using))
(However, without changing anything that error message seems to have gone away?)

I then:

1. Open an Android emulator
2. Open the UI Test project and run the Android tests and get tis error:

System.Exception: 'Failed to execute: C:\Program Files (x86)\Android\android-sdk\platform-tools.old1281326803\adb.exe -s emulator-5554 uninstall "com.xamarin.samples.taskydroid" - exit code: -1

Exception occurred while executing:
java.lang.IllegalArgumentException: Unknown package: com.xamarin.samples.taskydroid
at com.android.server.pm.Settings.isOrphaned(Settings.java:4409)
at com.android.server.pm.PackageManagerService.isOrphaned(PackageManagerService.java:22197)
at com.android.server.pm.PackageManagerService.deletePackageVersioned(PackageManagerService.java:19116)
at com.android.server.pm.PackageInstallerService.uninstall(PackageInstallerService.java:745)
at com.android.server.pm.PackageManagerShellCommand.runUninstall(PackageManagerShellCommand.java:929)
at com.android.server.pm.PackageManagerShellCommand.onCommand(PackageManagerShellCommand.java:134)
at android.os.ShellCommand.exec(ShellCommand.java:96)
at com.android.server.pm.PackageManagerService.onShellCommand(PackageManagerService.java:22497)
at android.os.Binder.shellCommand(Binder.java:594)
at android.os.Binder.onTransact(Binder.java:492)
at android.content.pm.IPackageManager$Stub.onTransact(IPackageManager.java:2658)
at com.android.server.pm.PackageManagerService.onTransact(PackageManagerService.java:3773)
at android.os.Binder.execTransact(Binder.java:697)'

This link has information on a similar (but not exact) error:
https://forums.xamarin.com/discussion/61219/android-ui-test-fail-to-execute-adb-exe

from uitest-pop-example.

Using Visual Studio 2019 Preview

Installed Android 8.1

Run the emulator

Run tests

For this error:
[3/15/2019 4:50:47 PM Informational] Test project Xamarin.UITest.POPSample does not reference any .NET NuGet adapter. Test discovery or execution might not work for this project.
It's recommended to reference NuGet test adapters in each test project in the solution.
Install NUnit 3
https://marketplace.visualstudio.com/items?itemName=NUnitDevelopers.NUnit3TestAdapter

Still get this error:
[5/1/2019 2:59:09 PM Informational] ------ Run test started ------
[5/1/2019 2:59:10 PM Informational] NUnit Adapter 3.13.0.0: Test execution started
[5/1/2019 2:59:10 PM Informational] Running all tests in C:\Users\webma\Source\Repos\uitest-pop-example\Xamarin.UITest.POPSample\bin\Debug\Xamarin.UITest.POPSample.dll
[5/1/2019 2:59:11 PM Informational] NUnit couldn't find any tests in C:\Users\webma\Source\Repos\uitest-pop-example\Xamarin.UITest.POPSample\bin\Debug\Xamarin.UITest.POPSample.dll
[5/1/2019 2:59:11 PM Informational] NUnit Adapter 3.13.0.0: Test execution complete
[5/1/2019 2:59:11 PM Warning] No test matches the given testcase filter FullyQualifiedName=Xamarin.UITest.POPSample.TaskyTests.EnterAndDeleteTask|FullyQualifiedName=Xamarin.UITest.POPSample.TaskyTests.Repl|FullyQualifiedName=Xamarin.UITest.POPSample.TaskyTests.EnterAndCompleteTask in C:\Users\webma\Source\Repos\uitest-pop-example\Xamarin.UITest.POPSample\bin\Debug\Xamarin.UITest.POPSample.dll
[5/1/2019 2:59:11 PM Informational] ========== Run test finished: 0 run (0:00:01.1974161) ==========

from uitest-pop-example.

Can you confirm which branch you used to try this? If you use this branch : feature/nunit3update, you shouldn't hit that error the error for the Test Adapter, it has been included. I am also running the same version of VS2019, with the same emulator.

from uitest-pop-example.

@ADefWebserver Hi, can you explain a bit more your working solution ? There is not enough details here to figure out what you did to make it working... Many thanks in advance !

from uitest-pop-example.

@ADefWebserver Hi, can you explain a bit more your working solution ? There is not enough details here to figure out what you did to make it working... Many thanks in advance !

Basically I used: feature/nunit3update

from uitest-pop-example.

@ADefWebserver Thanks. I read this paper too but it does not work... there is a mess between nuget and Vsix adapter, with dll versions etc. I finally succeeded in making it working but it is like 30 years old "Dll Hell"... If you don't have all the "right" versions (no doc about that) this is never working... They must certainly improve this part... Thanks again.

from uitest-pop-example.

They must certainly improve this part.

@odahan Yeah I was trying to get this to work so I could set it up to do automated testing via App Center. I eventually felt this whole thing is too 'brittle'. I knew the next update comes out and breaks everything 😒

from uitest-pop-example.

@ADefWebserver The problem is that they are updates very often !

from uitest-pop-example.