[mobile] Overview of mobile related CI failures

[matouskozak]

Description

This issue provides an overview of dotnet/runtime CI (main branch) failures related to .NET mobile platforms. This tracking issue is updated manually. Feel free to update the issue if you encounter any out-of-date information.

Platforms

The failures are divided per mobile platform when possible or categorized as "Other Failures".

iOS/TvOS/MacCatalyst

Issue	Status	Comment	Impact
#106797	Investigating	tvOS/iOS-arm64 failures inside ClassLoader runtime tests, BigArray_32_1 is too big	Low
#105804	Investigating	NativeAOT-MacCatalyst-arm64 infra issue with smoke tests start/logging	Low
#104431	Investigating	MacCatalyst and iOS (sim x64) fail on iOS.Simulator.LambdaCompilerAot tests, attempting to JIT compile method in AOT-only mode, not clear cause, potential fix #104097
#104162	Investigating	TvOS fails on System.Runtime.Serialization.Xml.XsdDataContractExporterTests.ExporterTypesTests.TypesTest tests, not clear cause, potential fix #104097
#103692	Investigating	TvOS fails on System.Numerics.Tensors tests, failed to sign app / time-out on dedup step.	Low
#101371	untriaged	MacCatalyst occassionally fails on System.IO.IsolatedStorage tests
#101692	untriaged	TvOS fails on System.Formats.Tar tests
#107346	Resolved	NativeAOT-ios runtime tests are not properly sent over to helix	Medium
#107309	Resolved	iOS/tvOS-arm64, System.Runtime.Serialization.Formatters.pdb" because it was not found.	Medium
#106256	Resolved	tvOS/iOS-arm64 failures inside System.Runtime.Tests in Decimal+BigInteger	Medium
#105753	Resolved	tvOS/iOS-arm64 failures inside System.Runtime.Tests in Decimal+BigInteger	Low
#104881	Resolved	TvOS/iOS x64 simulators + MacCatalyst fail on System.Diagnostics.Tracing tests
#105251	Resolved	Occasional iOS crash (looks to only happen iPhone XR) at System.Threading.LazyInitializer:EnsureLockInitialized, caused by LLVM 19 bump	Low
#105932	Resolved	tvOS-arm64, MacCatalyst-arm64, tvOSSimulator-x64 failures in System.Globalization tests when retrieving native sort key	Medium
#105688	Resolved	MacCatalyst-arm64, TvOS-arm64, TvOSSimulator-x64 failures in System.Net.Sockets tests	Medium
#105322	Resolved	TvOS-arm64 + TvOS/iOS x64 simulators failures in System.Runtime.Extensions tests, newly introduced TestCpuUsage scenario
#105202	Resolved	TvOS/iOS x64 simulators + MacCatalyst fail on System.Diagnostics.DiagnosticSource tests
#105537	Resolved	TvOS-arm64 Security.Crypto, Runtime.Intrinsics, Bcl.Memory test failure, likely caused by Shuffle intrinsics	Large
#104161	Resolved	Almost all Apple mobile targets fail on System.Security.Cryptography.X509Certificates tests, notified suspects
#103982	Resolved	Linking issue. #103988
#82637	Resolved	Apple device connection failures, causing all apple device jobs to crash due to a trimming issue. #104028
#103694	Disabled	TvOS fails on System.Text.Json tests, Tagged author of #103322
#101367	Resolved	TvOS fails on System.Memory tests
#104430	Disabled	TvOS/iOS JIT_Directed runtime tests failure due to missing DLL
#107246	Closed	iOS-sim x64 failures in PhysicalFileProviderTests.TokenForEmptyFilter	Low

Android

Issue	Status	Comment	Impact
#107551	Investigating	Android x64 runtime tests are not getting sent to Helix	High
#102646	Investigating	Android x64 timeouts when installing the .apk
#105203	Resolved	Android x86 emulator fails on System.Diagnostics.DiagnosticSource tests
#105325	Disabled	Android-arm32 out-of-memory in System.Security.Cryptography tests
dotnet/dnceng#3382	Resolved	ubuntu.2204.amd64.android.29.open queue down, Infra issue, x64/86 emulators are timing out
#104709, dotnet/dnceng#3405	Resolved	Android failures on System.Net.Sockets and Ping tests, network unreachable. Possibly Infra issue.
#104010	Resolved	Arm32/Arm64/x64/x86 Androids fail on System.Net.Security tests, tagged author of suspected PR
#104030	Resolved	Arm32/Arm64 Androids fail on System.Security.Cryptography tests, tagged author of suspected PR
#100281	Disabled	Linux Bionic fails across variety of test suits

Other Failures

Issue	Status	Comment	Impact
#107244, #107254	Investigating	Widespread mobile failures in TensorExtensionsTwoSpanInSpanOut	High
#101370	Investigating	Interpreter occasionally fails on System.Data.Odbc tests
#105933	Test Removed	Interpreter failures in 452950 GC regressions test	Low
#105395	Resolved	Linux x64 fullAOT-mini Methodical_* failures	Medium
#105319	Resolved	Android/iOSSimulator/MacCatalyst/Linux x64 build failures due to LLVM 19 update	Critical
#106071	Disabled	Linux x64 fullAOT-mini/llvm EmptyStructs assert crash	Low
#103754	Disabled	Mono Windows fails on BackwardsCompatibility_DowngradeToHttp11 test
#103406	Resolved	System.Resources.Extensions.Tests.FormattedObject fails across all mobile targets

Note that the "Impact" column represents impact of the issue to the CI health/state and doesn't necessary correlate with final impact to customer apps.

[dotnet-policy-service]

Tagging subscribers to 'os-ios': @vitek-karas, @kotlarmilos, @ivanpovazan, @steveisok, @akoeplinger
See info in area-owners.md if you want to be subscribed.

[dotnet-policy-service]

Tagging subscribers to 'arch-android': @vitek-karas, @simonrozsival, @steveisok, @akoeplinger
See info in area-owners.md if you want to be subscribed.

[dotnet-policy-service]

Tagging subscribers to 'os-tvos': @vitek-karas, @kotlarmilos, @ivanpovazan, @steveisok, @akoeplinger
See info in area-owners.md if you want to be subscribed.

[dotnet-policy-service]

Tagging subscribers to 'os-maccatalyst': @vitek-karas, @kotlarmilos, @ivanpovazan, @steveisok, @akoeplinger
See info in area-owners.md if you want to be subscribed.

[steveisok]

@matouskozak #103406 needs a tweak to not run these tests as BinaryFormatter is no longer supported

[matouskozak]

@matouskozak #103406 needs a tweak to not run these tests as BinaryFormatter is no longer supported

You're right, @adamsitnik is working on that in #103471.