Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test failure Loader/classloader/DictionaryExpansion/DictionaryExpansion/DictionaryExpansion.sh #61299

Closed
VincentBu opened this issue Nov 8, 2021 · 11 comments · Fixed by #61432
Labels
arch-x64 area-AssemblyLoader-mono os-android runtime-mono specific to the Mono runtime untriaged New issue has not been triaged by the area owner

Comments

@VincentBu
Copy link
Contributor

VincentBu commented Nov 8, 2021

Run: runtime 20211107.13

Failed test:

Mono Android x64 Release @ Ubuntu.1804.Amd64.Android.29.Open

- Loader/classloader/DictionaryExpansion/DictionaryExpansion/DictionaryExpansion.sh

Error message:

11-06 21:59:32.724 21938 21955 E mono    : Unhandled Exception:
      11-06 21:59:32.724 21938 21955 E mono    : System.IO.FileNotFoundException: Could not load file or assembly 'xunit.assert, Version=2.4.2.0, Culture=neutral, PublicKeyToken=8d05b1bb7a6fdb6c' or one of its dependencies.
      11-06 21:59:32.724 21938 21955 E mono    : File name: 'xunit.assert, Version=2.4.2.0, Culture=neutral, PublicKeyToken=8d05b1bb7a6fdb6c'
      11-06 21:59:32.724 21938 21955 E mono    :    at GenClass`1[[System.Int32, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].DoTest_GenDerived(Int32 max)
      11-06 21:59:32.724 21938 21955 E mono    :    at Test_DictionaryExpansion.Main()
      11-06 21:59:32.724 21938 21955 E DOTNET  : UnhandledException: System.IO.FileNotFoundException Could not load file or assembly 'xunit.assert, Version=2.4.2.0, Culture=neutral, PublicKeyToken=8d05b1bb7a6fdb6c' or one of its dependencies.    at GenClass`1[[System.Int32, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].DoTest_GenDerived(Int32 max)
      11-06 21:59:32.724 21938 21955 E DOTNET  :    at Test_DictionaryExpansion.Main()
@ghost
Copy link

ghost commented Nov 8, 2021

Tagging subscribers to 'arch-android': @steveisok, @akoeplinger
See info in area-owners.md if you want to be subscribed.

Issue Details

Run: runtime 20211107.13

Failed test:

Mono Android x64 Release @ Ubuntu.1804.Amd64.Android.29.Open

- Loader/classloader/DictionaryExpansion/DictionaryExpansion/DictionaryExpansion.sh

Error message:

Return code:      1
Raw output file:      /datadisks/disk1/work/C41F0A40/w/AABD092D/uploads/Reports/Loader.classloader/DictionaryExpansion/DictionaryExpansion/DictionaryExpansion.output.txt
Raw output:
BEGIN EXECUTION
XHarness command issued: android run --instrumentation=net.dot.MonoRunner --package-name=net.dot.Loader_classloader --output-directory=/datadisks/disk1/work/C41F0A40/w/AABD092D/uploads/Reports/Loader.classloader/DictionaryExpansion/DictionaryExpansion --arg=entrypoint:libname=DictionaryExpansion.dll --expected-exit-code=100 -v
[21:21:53] dbug: Android Run command called: App = net.dot.Loader_classloader

[21:21:53] dbug: Timeout = 900 seconds.
[21:21:53] dbug: ADBRunner using ADB.exe supplied from /datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/tools/net6.0/any/../../../runtimes/any/native/adb/linux/adb
[21:21:53] dbug: Full resolved path:'/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb'
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb  start-server'
[21:21:53] dbug:
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb  devices -l'
[21:21:53] dbug: Evaluating output line for device serial: emulator-5554          device product:sdk_phone_x86_64 model:Android_SDK_built_for_x86_64 device:generic_x86_64 transport_id:1
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb  -s emulator-5554 shell pm list packages -3'
[21:21:53] dbug: Evaluating output line for device serial: emulator-5556          device product:sdk_phone_x86 model:Android_SDK_built_for_x86 device:generic_x86 transport_id:3
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb  -s emulator-5556 shell pm list packages -3'
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 shell getprop ro.build.version.sdk'
[21:21:53] info: Active Android device set to serial 'emulator-5554'
[21:21:53] info: Waiting for device to be available (max 5 minutes)
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 wait-for-device'
[21:21:53] dbug:
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 shell getprop sys.boot_completed'
[21:21:53] dbug: Waited 0.0188355 seconds for device for sys.boot_completed to be 1.
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 version'
[21:21:53] dbug: Working with Android Debug Bridge version 1.0.41
Version 29.0.6-6198805
Installed as /datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb

[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 logcat -c'
[21:21:53] info: Starting instrumentation class 'net.dot.MonoRunner' on net.dot.Loader_classloader
[21:21:53] dbug: Raw command: 'shell am instrument  -e entrypoint:libname DictionaryExpansion.dll -w net.dot.Loader_classloader/net.dot.MonoRunner'
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/


Stack trace
   at Loader_classloader._DictionaryExpansion_DictionaryExpansion_DictionaryExpansion_._DictionaryExpansion_DictionaryExpansion_DictionaryExpansion_sh()
Author: VincentBu
Assignees: -
Labels:

arch-x64, os-android

Milestone: -

@dotnet-issue-labeler dotnet-issue-labeler bot added area-System.Collections untriaged New issue has not been triaged by the area owner labels Nov 8, 2021
@ghost
Copy link

ghost commented Nov 8, 2021

Tagging subscribers to this area: @dotnet/area-system-collections
See info in area-owners.md if you want to be subscribed.

Issue Details

Run: runtime 20211107.13

Failed test:

Mono Android x64 Release @ Ubuntu.1804.Amd64.Android.29.Open

- Loader/classloader/DictionaryExpansion/DictionaryExpansion/DictionaryExpansion.sh

Error message:

Return code:      1
Raw output file:      /datadisks/disk1/work/C41F0A40/w/AABD092D/uploads/Reports/Loader.classloader/DictionaryExpansion/DictionaryExpansion/DictionaryExpansion.output.txt
Raw output:
BEGIN EXECUTION
XHarness command issued: android run --instrumentation=net.dot.MonoRunner --package-name=net.dot.Loader_classloader --output-directory=/datadisks/disk1/work/C41F0A40/w/AABD092D/uploads/Reports/Loader.classloader/DictionaryExpansion/DictionaryExpansion --arg=entrypoint:libname=DictionaryExpansion.dll --expected-exit-code=100 -v
[21:21:53] dbug: Android Run command called: App = net.dot.Loader_classloader

[21:21:53] dbug: Timeout = 900 seconds.
[21:21:53] dbug: ADBRunner using ADB.exe supplied from /datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/tools/net6.0/any/../../../runtimes/any/native/adb/linux/adb
[21:21:53] dbug: Full resolved path:'/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb'
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb  start-server'
[21:21:53] dbug:
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb  devices -l'
[21:21:53] dbug: Evaluating output line for device serial: emulator-5554          device product:sdk_phone_x86_64 model:Android_SDK_built_for_x86_64 device:generic_x86_64 transport_id:1
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb  -s emulator-5554 shell pm list packages -3'
[21:21:53] dbug: Evaluating output line for device serial: emulator-5556          device product:sdk_phone_x86 model:Android_SDK_built_for_x86 device:generic_x86 transport_id:3
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb  -s emulator-5556 shell pm list packages -3'
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 shell getprop ro.build.version.sdk'
[21:21:53] info: Active Android device set to serial 'emulator-5554'
[21:21:53] info: Waiting for device to be available (max 5 minutes)
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 wait-for-device'
[21:21:53] dbug:
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 shell getprop sys.boot_completed'
[21:21:53] dbug: Waited 0.0188355 seconds for device for sys.boot_completed to be 1.
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 version'
[21:21:53] dbug: Working with Android Debug Bridge version 1.0.41
Version 29.0.6-6198805
Installed as /datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb

[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 logcat -c'
[21:21:53] info: Starting instrumentation class 'net.dot.MonoRunner' on net.dot.Loader_classloader
[21:21:53] dbug: Raw command: 'shell am instrument  -e entrypoint:libname DictionaryExpansion.dll -w net.dot.Loader_classloader/net.dot.MonoRunner'
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/


Stack trace
   at Loader_classloader._DictionaryExpansion_DictionaryExpansion_DictionaryExpansion_._DictionaryExpansion_DictionaryExpansion_DictionaryExpansion_sh()
Author: VincentBu
Assignees: -
Labels:

area-System.Collections, arch-x64, os-android, untriaged

Milestone: -

@eiriktsarpalis eiriktsarpalis added the runtime-mono specific to the Mono runtime label Nov 8, 2021
@ghost
Copy link

ghost commented Nov 8, 2021

Tagging subscribers to this area:
See info in area-owners.md if you want to be subscribed.

Issue Details

Run: runtime 20211107.13

Failed test:

Mono Android x64 Release @ Ubuntu.1804.Amd64.Android.29.Open

- Loader/classloader/DictionaryExpansion/DictionaryExpansion/DictionaryExpansion.sh

Error message:

Return code:      1
Raw output file:      /datadisks/disk1/work/C41F0A40/w/AABD092D/uploads/Reports/Loader.classloader/DictionaryExpansion/DictionaryExpansion/DictionaryExpansion.output.txt
Raw output:
BEGIN EXECUTION
XHarness command issued: android run --instrumentation=net.dot.MonoRunner --package-name=net.dot.Loader_classloader --output-directory=/datadisks/disk1/work/C41F0A40/w/AABD092D/uploads/Reports/Loader.classloader/DictionaryExpansion/DictionaryExpansion --arg=entrypoint:libname=DictionaryExpansion.dll --expected-exit-code=100 -v
[21:21:53] dbug: Android Run command called: App = net.dot.Loader_classloader

[21:21:53] dbug: Timeout = 900 seconds.
[21:21:53] dbug: ADBRunner using ADB.exe supplied from /datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/tools/net6.0/any/../../../runtimes/any/native/adb/linux/adb
[21:21:53] dbug: Full resolved path:'/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb'
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb  start-server'
[21:21:53] dbug:
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb  devices -l'
[21:21:53] dbug: Evaluating output line for device serial: emulator-5554          device product:sdk_phone_x86_64 model:Android_SDK_built_for_x86_64 device:generic_x86_64 transport_id:1
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb  -s emulator-5554 shell pm list packages -3'
[21:21:53] dbug: Evaluating output line for device serial: emulator-5556          device product:sdk_phone_x86 model:Android_SDK_built_for_x86 device:generic_x86 transport_id:3
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb  -s emulator-5556 shell pm list packages -3'
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 shell getprop ro.build.version.sdk'
[21:21:53] info: Active Android device set to serial 'emulator-5554'
[21:21:53] info: Waiting for device to be available (max 5 minutes)
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 wait-for-device'
[21:21:53] dbug:
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 shell getprop sys.boot_completed'
[21:21:53] dbug: Waited 0.0188355 seconds for device for sys.boot_completed to be 1.
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 version'
[21:21:53] dbug: Working with Android Debug Bridge version 1.0.41
Version 29.0.6-6198805
Installed as /datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb

[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/p/microsoft.dotnet.xharness.cli/1.0.0-prerelease.21529.1/runtimes/any/native/adb/linux/adb -s emulator-5554 logcat -c'
[21:21:53] info: Starting instrumentation class 'net.dot.MonoRunner' on net.dot.Loader_classloader
[21:21:53] dbug: Raw command: 'shell am instrument  -e entrypoint:libname DictionaryExpansion.dll -w net.dot.Loader_classloader/net.dot.MonoRunner'
[21:21:53] dbug: Executing command: '/datadisks/disk1/work/C41F0A40/


Stack trace
   at Loader_classloader._DictionaryExpansion_DictionaryExpansion_DictionaryExpansion_._DictionaryExpansion_DictionaryExpansion_DictionaryExpansion_sh()
Author: VincentBu
Assignees: -
Labels:

area-System.Collections, arch-x64, os-android, untriaged, area-AssemblyLoader-mono, runtime-mono

Milestone: -

@krwq
Copy link
Member

krwq commented Nov 8, 2021

cc: @jkoritzinsky

@jkoritzinsky
Copy link
Member

Looks like xunit doesn't get uploaded with the tests for Android testing. @fanyang-mono how is the set of assemblies uploaded for runtime tests determined?

@fanyang-mono
Copy link
Member

It is very strange that only this particular test failed with this error, because all other runtime tests finished successfully, which also depends on this assembly. I wonder if this test would fail with the same error message constantly?

@jkoritzinsky
Copy link
Member

It looks like it is failing consistently: #61322

@jkoritzinsky
Copy link
Member

Majority of the other tests that now use xunit are probably disabled on Mono (most of them are the interop tests and issues.targets has many interop test exclusions on Mono)

@krwq
Copy link
Member

krwq commented Nov 9, 2021

@fanyang-mono can you please disable based on the fact it consistently fails on rolling builds?

@fanyang-mono
Copy link
Member

fanyang-mono commented Nov 10, 2021

Now I understand why this test started failing lately. It was because of this change #61226. This is code to decide what should be included in an Android app

<ItemGroup>
<AllCMDsPresent Include="$(_CMDDIR)\**\*.$(TestScriptExtension)"/>
<TestAssemblies Include="@(AllCMDsPresent->'%(RelativeDir)%(Filename).dll')" />
<TestAssemblyDirs Include="@(AllCMDsPresent->'%(RelativeDir)')" />
<AssembliesInTestDirs Include="%(AllCMDsPresent.RelativeDir)*.dll" Exclude="@(TestAssemblies)"/>
<RuntimePackLibs Include="$(MicrosoftNetCoreAppRuntimePackDir)lib/**/*.dll" />
<RuntimePackNativeLibs Include="$(MicrosoftNetCoreAppRuntimePackDir)native/**/*.dll;$(MicrosoftNetCoreAppRuntimePackDir)native/**/*.a;$(MicrosoftNetCoreAppRuntimePackDir)native/**/*.so" />
</ItemGroup>
<Copy
SourceFiles="@(TestAssemblies)"
DestinationFolder="$(BuildDir)" />
<Copy
SourceFiles="@(AssembliesInTestDirs)"
DestinationFolder="$(BuildDir)" />
<Copy
SourceFiles="@(RuntimePackNativeLibs)"
DestinationFolder="$(BuildDir)" />
<Copy
SourceFiles="@(RuntimePackLibs)"
DestinationFolder="$(BuildDir)" />

I will disable the test for now, then figure out how to include xunit.assert assembly in the app.

@jkoritzinsky
Copy link
Member

@fanyang-mono i can also take a look at a fix now that you’ve pointed me to the place that files are included into the Android app.

@ghost ghost added the in-pr There is an active PR which will close this issue when it is merged label Nov 10, 2021
@ghost ghost removed the in-pr There is an active PR which will close this issue when it is merged label Nov 11, 2021
@ghost ghost locked as resolved and limited conversation to collaborators Dec 11, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
arch-x64 area-AssemblyLoader-mono os-android runtime-mono specific to the Mono runtime untriaged New issue has not been triaged by the area owner
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants