[tests] Add back the app size test to see if it's better now. by rolfbjarne · Pull Request #25910 · dotnet/macios

rolfbjarne · 2026-07-02T12:14:11Z

No description provided.

Copilot

Pull request overview

Re-enables the .NET app bundle size regression test and updates the stored expected outputs (bundle size reports + preserved API lists) for iOS/tvOS/Mac Catalyst/macOS across MonoVM, interpreter, NativeAOT, and CoreCLR configurations.

Changes:

Re-enable AppSizeTest by removing the fixture-level ignore.
Refresh expected app bundle size baselines for multiple platform/runtime combinations.
Refresh expected “preserved APIs” baselines for MonoVM/interpreter configurations.

Reviewed changes

Copilot reviewed 23 out of 23 changed files in this pull request and generated 1 comment.

Show a summary per file

File	Description
tests/dotnet/UnitTests/AppSizeTest.cs	Re-enables the app size test by removing `[Ignore]`.
tests/dotnet/UnitTests/expected/TVOS-NativeAOT-TrimmableStatic-size.txt	Updates expected tvOS NativeAOT (trimmable-static registrar) bundle size report.
tests/dotnet/UnitTests/expected/TVOS-NativeAOT-size.txt	Updates expected tvOS NativeAOT bundle size report.
tests/dotnet/UnitTests/expected/TVOS-MonoVM-size.txt	Updates expected tvOS MonoVM bundle size report.
tests/dotnet/UnitTests/expected/TVOS-MonoVM-preservedapis.txt	Updates expected tvOS MonoVM preserved API set.
tests/dotnet/UnitTests/expected/TVOS-MonoVM-interpreter-size.txt	Updates expected tvOS MonoVM+interpreter bundle size report.
tests/dotnet/UnitTests/expected/TVOS-MonoVM-interpreter-preservedapis.txt	Updates expected tvOS MonoVM+interpreter preserved API set.
tests/dotnet/UnitTests/expected/MacOSX-NativeAOT-TrimmableStatic-size.txt	Updates expected macOS NativeAOT (trimmable-static registrar) bundle size report.
tests/dotnet/UnitTests/expected/MacOSX-NativeAOT-size.txt	Updates expected macOS NativeAOT bundle size report.
tests/dotnet/UnitTests/expected/MacOSX-CoreCLR-Interpreter-TrimmableStatic-size.txt	Updates expected macOS CoreCLR+interpreter (trimmable-static registrar) bundle size report.
tests/dotnet/UnitTests/expected/MacOSX-CoreCLR-Interpreter-size.txt	Updates expected macOS CoreCLR+interpreter bundle size report.
tests/dotnet/UnitTests/expected/MacCatalyst-NativeAOT-TrimmableStatic-size.txt	Updates expected Mac Catalyst NativeAOT (trimmable-static registrar) bundle size report.
tests/dotnet/UnitTests/expected/MacCatalyst-NativeAOT-size.txt	Updates expected Mac Catalyst NativeAOT bundle size report.
tests/dotnet/UnitTests/expected/MacCatalyst-MonoVM-size.txt	Updates expected Mac Catalyst MonoVM bundle size report.
tests/dotnet/UnitTests/expected/MacCatalyst-MonoVM-preservedapis.txt	Updates expected Mac Catalyst MonoVM preserved API set.
tests/dotnet/UnitTests/expected/MacCatalyst-MonoVM-interpreter-size.txt	Updates expected Mac Catalyst MonoVM+interpreter bundle size report.
tests/dotnet/UnitTests/expected/MacCatalyst-MonoVM-interpreter-preservedapis.txt	Updates expected Mac Catalyst MonoVM+interpreter preserved API set.
tests/dotnet/UnitTests/expected/iOS-NativeAOT-TrimmableStatic-size.txt	Updates expected iOS NativeAOT (trimmable-static registrar) bundle size report.
tests/dotnet/UnitTests/expected/iOS-NativeAOT-size.txt	Updates expected iOS NativeAOT bundle size report.
tests/dotnet/UnitTests/expected/iOS-MonoVM-size.txt	Updates expected iOS MonoVM bundle size report.
tests/dotnet/UnitTests/expected/iOS-MonoVM-preservedapis.txt	Updates expected iOS MonoVM preserved API set.
tests/dotnet/UnitTests/expected/iOS-MonoVM-interpreter-size.txt	Updates expected iOS MonoVM+interpreter bundle size report.
tests/dotnet/UnitTests/expected/iOS-MonoVM-interpreter-preservedapis.txt	Updates expected iOS MonoVM+interpreter preserved API set.

 	[TestFixture]
-	[Ignore ("The results depend on the macOS version of the bot running the test")]
 	public class AppSizeTest : TestBaseClass {


When running in Azure DevOps CI and the AppSizeTest fails, copy the resulting .app bundle to BUILD_ARTIFACTSTAGINGDIRECTORY so it gets uploaded (zipped) as a build artifact for diagnostic purposes. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Zip the .app bundle into a single zip file (instead of copying the directory tree), and add a sortable UTC timestamp to the zip file name so subsequent failing tests don't overwrite it. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

vs-mobiletools-engineering-service2 · 2026-07-02T16:56:23Z

✅ [PR Build #dca0bf3] Build passed (Build macOS tests) ✅

Pipeline on Agent
Hash: dca0bf32a83181cc35a362e962116357dc5a2f42 [PR build]

vs-mobiletools-engineering-service2 · 2026-07-02T17:15:48Z

✅ API diff for current PR / commit

NET (empty diffs)

iOS: vsdrops gist ( No breaking changes )
tvOS: vsdrops gist ( No breaking changes )
MacCatalyst: vsdrops gist ( No breaking changes )
macOS: vsdrops gist ( No breaking changes )

✅ API diff vs stable

NET (empty diffs)

iOS: vsdrops gist ( No breaking changes )
tvOS: vsdrops gist ( No breaking changes )
MacCatalyst: vsdrops gist ( No breaking changes )
macOS: vsdrops gist ( No breaking changes )

ℹ️ Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent
Hash: dca0bf32a83181cc35a362e962116357dc5a2f42 [PR build]

vs-mobiletools-engineering-service2 · 2026-07-02T19:07:05Z

🔥 [CI Build #dca0bf3] Test results 🔥

Test results

❌ Tests failed on VSTS: test results

0 tests crashed, 1 tests failed, 198 tests passed.

Failures

❌ dotnettests tests (iOS)

1 tests failed, 0 tests passed.

Failed tests

DotNet tests: Failed (Execution failed with exit code 1)
- Xamarin.Tests.AppSizeTest.MonoVM_Interpreter(iOS,"ios-arm64"): App size changed significantly (-13,341 bytes (-13.0 KB = -0.0 MB) different > tolerance of +-10,240 bytes (10.0 KB = 0.0 MB)). ...
- Xamarin.Tests.AppSizeTest.MonoVM(iOS,"ios-arm64"): App size changed significantly (-41,693 bytes (-40.7 KB = -0.0 MB) different > tolerance of +-10,240 bytes (10.0 KB = 0.0 MB)). ...
- Xamarin.Tests.AppSizeTest.NativeAOT_TrimmableStatic(iOS,"ios-arm...: App size changed significantly (-82,301 bytes (-80.4 KB = -0.1 MB) different > tolerance of +-10,240 bytes (10.0 KB = 0.0 MB)). ...
- ... and 1 more

Html Report (VSDrops) Download

Successes

✅ assembly-processing: All 1 tests passed. Html Report (VSDrops) Download
✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download
✅ framework: All 2 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 4 tests passed. Html Report (VSDrops) Download
✅ generator: All 5 tests passed. Html Report (VSDrops) Download
✅ interdependent-binding-projects: All 4 tests passed. Html Report (VSDrops) Download
✅ introspection: All 4 tests passed. Html Report (VSDrops) Download
✅ linker (iOS): All 15 tests passed. Html Report (VSDrops) Download
✅ linker (MacCatalyst): All 15 tests passed. Html Report (VSDrops) Download
✅ linker (macOS): All 21 tests passed. Html Report (VSDrops) Download
✅ linker (tvOS): All 15 tests passed. Html Report (VSDrops) Download
✅ monotouch (iOS): All 18 tests passed. Html Report (VSDrops) Download
✅ monotouch (MacCatalyst): All 17 tests passed. Html Report (VSDrops) Download
✅ monotouch (macOS): All 18 tests passed. Html Report (VSDrops) Download
✅ monotouch (tvOS): All 18 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ sharpie: All 1 tests passed. Html Report (VSDrops) Download
✅ windows: All 3 tests passed. Html Report (VSDrops) Download
✅ xcframework: All 4 tests passed. Html Report (VSDrops) Download
✅ xtro: All 1 tests passed. Html Report (VSDrops) Download

macOS tests

✅ Tests on macOS Monterey (12): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Ventura (13): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Sonoma (14): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Sequoia (15): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Tahoe (26): All 5 tests passed. Html Report (VSDrops) Download

Linux Build Verification

✅ Linux build succeeded

Pipeline on Agent
Hash: dca0bf32a83181cc35a362e962116357dc5a2f42 [PR build]

vs-mobiletools-engineering-service2 · 2026-07-03T10:46:19Z

✅ [PR Build #fee616b] Build passed (Detect API changes) ✅

Pipeline on Agent
Hash: fee616b77cec645135e83f168799eb60845f6118 [PR build]

vs-mobiletools-engineering-service2 · 2026-07-03T10:51:59Z

✅ [PR Build #fee616b] Build passed (Build packages) ✅

Pipeline on Agent
Hash: fee616b77cec645135e83f168799eb60845f6118 [PR build]

[tests] Add back the app size test to see if it's better now.

eece6c0

Copilot AI review requested due to automatic review settings July 2, 2026 12:14

Copilot started reviewing on behalf of rolfbjarne July 2, 2026 12:14 View session

Copilot AI reviewed Jul 2, 2026

View reviewed changes

Comment thread tests/dotnet/UnitTests/AppSizeTest.cs

Comment on lines 10 to 11

[TestFixture]

[Ignore ("The results depend on the macOS version of the bot running the test")]

public class AppSizeTest : TestBaseClass {

This comment has been minimized.

Sign in to view

rolfbjarne marked this pull request as draft July 2, 2026 15:58

rolfbjarne and others added 2 commits July 2, 2026 18:00

This comment has been minimized.

Sign in to view

rolfbjarne mentioned this pull request Jul 2, 2026

[dotnet-linker] Set AssociatedSourceType on UnmanagedCallersOnly trampolines #25915

Draft

upload too.

fee616b

This comment has been minimized.

Sign in to view

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[tests] Add back the app size test to see if it's better now.#25910

[tests] Add back the app size test to see if it's better now.#25910
rolfbjarne wants to merge 4 commits into
mainfrom
dev/rolf/reintroduce-appsize-test

rolfbjarne commented Jul 2, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

vs-mobiletools-engineering-service2 commented Jul 2, 2026

Uh oh!

This comment has been minimized.

vs-mobiletools-engineering-service2 commented Jul 2, 2026

Uh oh!

This comment has been minimized.

vs-mobiletools-engineering-service2 commented Jul 2, 2026

Failed tests

Uh oh!

This comment has been minimized.

vs-mobiletools-engineering-service2 commented Jul 3, 2026

Uh oh!

vs-mobiletools-engineering-service2 commented Jul 3, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

rolfbjarne commented Jul 2, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

vs-mobiletools-engineering-service2 commented Jul 2, 2026

✅ [PR Build #dca0bf3] Build passed (Build macOS tests) ✅

Uh oh!

This comment has been minimized.

vs-mobiletools-engineering-service2 commented Jul 2, 2026

✅ API diff for current PR / commit

✅ API diff vs stable

ℹ️ Generator diff

Uh oh!

This comment has been minimized.

vs-mobiletools-engineering-service2 commented Jul 2, 2026

🔥 [CI Build #dca0bf3] Test results 🔥

Test results

Failures

❌ dotnettests tests (iOS)

Failed tests

Successes

macOS tests

Linux Build Verification

Uh oh!

This comment has been minimized.

vs-mobiletools-engineering-service2 commented Jul 3, 2026

✅ [PR Build #fee616b] Build passed (Detect API changes) ✅

Uh oh!

vs-mobiletools-engineering-service2 commented Jul 3, 2026

✅ [PR Build #fee616b] Build passed (Build packages) ✅

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants