[Perf] Windows/x64: 34 Improvements on 3/6/2023 11:36:59 AM

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in Benchstone.BenchF.NewtR

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	117.99 ms	92.23 ms	0.78	0.04	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchF.NewtR*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchF.NewtR.Test

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 92.227065 < 112.36117281249999.
IsChangePoint: Marked as a change because one of 12/20/2022 1:34:12 PM, 1/3/2023 6:29:42 AM, 1/13/2023 11:01:49 AM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 29.870345705483576 (T) = (0 -92480237.5) / Math.Sqrt((125773842473797.31 / (299)) + (52104112350 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.17466914233560207 = (112052320.15886287 - 92480237.5) / 112052320.15886287 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in System.Collections.ContainsTrue<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Stack - Duration of single invocation	463.68 μs	426.28 μs	0.92	0.24	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue<String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsTrue<String>.Stack(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 426.27587837837837 < 438.95097652714924.
IsChangePoint: Marked as a change because one of 12/21/2022 9:23:17 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 37.75440822620825 (T) = (0 -427142.22798691544) / Math.Sqrt((214750575.32231653 / (299)) + (2532902.7230440797 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.0862478593186416 = (467459.61948544154 - 427142.22798691544) / 467459.61948544154 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Select - Duration of single invocation	1.24 μs	1.12 μs	0.90	0.03	False
Select - Duration of single invocation	1.25 μs	1.12 μs	0.90	0.02	False
SelectToArray - Duration of single invocation	532.60 ns	471.63 ns	0.89	0.07	False
WhereSelect - Duration of single invocation	1.01 μs	914.03 ns	0.90	0.02	False
Repeat - Duration of single invocation	496.28 ns	438.06 ns	0.88	0.03	False
SelectToArray - Duration of single invocation	306.15 ns	276.54 ns	0.90	0.03	False
SequenceEqual - Duration of single invocation	1.23 μs	1.13 μs	0.93	0.04	False
Range - Duration of single invocation	497.90 ns	446.74 ns	0.90	0.04	False
SelectToList - Duration of single invocation	1.02 μs	939.37 ns	0.92	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Payloads

Baseline
Compare

Histogram

System.Linq.Tests.Perf_Enumerable.Select(input: IEnumerable)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.1165913346430105 < 1.178844317863114.
IsChangePoint: Marked as a change because one of 1/18/2023 11:30:09 AM, 2/9/2023 12:40:40 PM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 28.51815574425668 (T) = (0 -1116.8047513498661) / Math.Sqrt((2523.6734698736263 / (299)) + (0.15619295191032043 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.06916206446356905 = (1199.7843112252024 - 1116.8047513498661) / 1199.7843112252024 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.Select(input: IList)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.1216159191881143 < 1.1856337233893206.
IsChangePoint: Marked as a change because one of 1/18/2023 3:20:52 PM, 2/9/2023 12:40:40 PM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 25.21735729076924 (T) = (0 -1123.7567274004205) / Math.Sqrt((2775.4192933171735 / (299)) + (8.45306188631201 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.06835797775624025 = (1206.2108627238315 - 1123.7567274004205) / 1206.2108627238315 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.SelectToArray(input: IList)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 471.6278805954929 < 504.8984717100981.
IsChangePoint: Marked as a change because one of 12/21/2022 9:23:17 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 23.020114940457532 (T) = (0 -471.9736341370936) / Math.Sqrt((829.2689833500283 / (299)) + (0.6541902238644065 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.0764756623145085 = (511.057061387185 - 471.9736341370936) / 511.057061387185 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.WhereSelect(input: Array)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 914.0322966723271 < 0.9583441760881528.
IsChangePoint: Marked as a change because one of 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 16.835851293663755 (T) = (0 -913.2748662197699) / Math.Sqrt((829.941885630325 / (299)) + (41.934743170990096 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.05446813625813326 = (965.8848117561662 - 913.2748662197699) / 965.8848117561662 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.Repeat

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 438.0629942866792 < 472.48699924848705.
IsChangePoint: Marked as a change because one of 12/28/2022 5:13:50 PM, 1/3/2023 6:29:42 AM, 1/11/2023 2:37:52 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 28.88120907818418 (T) = (0 -436.52284022859084) / Math.Sqrt((459.260416116762 / (299)) + (6.270610346950133 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.09608139015857317 = (482.92272719683183 - 436.52284022859084) / 482.92272719683183 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.SelectToArray(input: Array)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 276.54011888846446 < 291.34213669960036.
IsChangePoint: Marked as a change because one of 12/21/2022 9:23:17 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 18.77111551083683 (T) = (0 -277.45081588371687) / Math.Sqrt((219.92117278727576 / (299)) + (1.6587280156306252 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.06372266140357012 = (296.3340075064109 - 277.45081588371687) / 296.3340075064109 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.SequenceEqual(input1: IEnumerable, input2: IEnumerable)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.1339291233766233 < 1.164421735273495.
IsChangePoint: Marked as a change because one of 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 9.320976455332252 (T) = (0 -1134.3120510693172) / Math.Sqrt((13629.48130415707 / (299)) + (0.35547787719769036 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.05259571105635953 = (1197.284057404975 - 1134.3120510693172) / 1197.284057404975 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.Range

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 446.7421435779155 < 472.8229320917001.
IsChangePoint: Marked as a change because one of 12/28/2022 5:13:50 PM, 1/3/2023 6:29:42 AM, 1/11/2023 2:37:52 AM, 1/13/2023 4:37:08 PM, 2/9/2023 12:40:40 PM, 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 17.231754339666768 (T) = (0 -442.34202297801517) / Math.Sqrt((752.775954266607 / (299)) + (18.61514272785443 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.08454411955032579 = (483.19316356429505 - 442.34202297801517) / 483.19316356429505 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.SelectToList(input: IEnumerable)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 939.3710378721047 < 0.9606095401279322.
IsChangePoint: Marked as a change because one of 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 23.187824602153743 (T) = (0 -940.8383899029624) / Math.Sqrt((448.01747655540265 / (299)) + (23.87224995837337 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.05453384056207288 = (995.1053038876443 - 940.8383899029624) / 995.1053038876443 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in System.Buffers.Text.Tests.Utf8ParserTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryParseUInt32Hex - Duration of single invocation	7.67 ns	6.21 ns	0.81	0.05	False
TryParseUInt64 - Duration of single invocation	7.01 ns	5.94 ns	0.85	0.05	False
TryParseUInt64Hex - Duration of single invocation	15.28 ns	13.56 ns	0.89	0.09	False
TryParseInt64 - Duration of single invocation	7.39 ns	6.11 ns	0.83	0.06	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8ParserTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32Hex(value: 3039)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.213626447230096 < 7.200839894532608.
IsChangePoint: Marked as a change because one of 12/20/2022 1:34:12 PM, 12/28/2022 5:13:50 PM, 1/3/2023 6:29:42 AM, 1/13/2023 11:20:20 PM, 1/18/2023 3:20:52 PM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 38.641315017515666 (T) = (0 -6.160589626897849) / Math.Sqrt((0.156256876215024 / (299)) + (0.0007333462713241393 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.1373924878215085 = (7.141822369874162 - 6.160589626897849) / 7.141822369874162 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value: 12345)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.943460361408201 < 6.526752838185618.
IsChangePoint: Marked as a change because one of 12/28/2022 5:13:50 PM, 1/18/2023 3:20:52 PM, 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 14.674484978117498 (T) = (0 -5.933155212970824) / Math.Sqrt((0.2635984301857318 / (299)) + (0.0002794024306909022 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.07007126053112188 = (6.380225668000649 - 5.933155212970824) / 6.380225668000649 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64Hex(value: FFFFFFFFFFFFFFFF)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.562577643204522 < 14.397801096016892.
IsChangePoint: Marked as a change because one of 1/18/2023 1:01:18 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 23.89203910521543 (T) = (0 -13.652342855258373) / Math.Sqrt((0.28959285987853367 / (299)) + (0.010379046804232416 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.08333160963193367 = (14.893436927367596 - 13.652342855258373) / 14.893436927367596 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value: 12345)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.108665435993148 < 7.014407140535605.
IsChangePoint: Marked as a change because one of 12/28/2022 5:13:50 PM, 1/3/2023 6:29:42 AM, 1/18/2023 3:20:52 PM, 2/20/2023 10:31:48 AM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 37.16583667036925 (T) = (0 -6.108420849730861) / Math.Sqrt((0.18401322186727273 / (299)) + (2.484324654151857E-07 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.13114868894405945 = (7.030455927271512 - 6.108420849730861) / 7.030455927271512 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in PerfLabTests.CastingPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FooObjIsFoo2 - Duration of single invocation	438.34 μs	379.80 μs	0.87	0.04	False
CheckArrayIsInterfaceYes - Duration of single invocation	62.39 μs	31.36 μs	0.50	0.03	False
CheckArrayIsInterfaceNo - Duration of single invocation	62.41 μs	31.22 μs	0.50	0.03	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf*'

Payloads

Baseline
Compare

Histogram

PerfLabTests.CastingPerf.FooObjIsFoo2

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 379.7994742063492 < 414.6857077991453.
IsChangePoint: Marked as a change because one of 12/28/2022 5:13:50 PM, 1/3/2023 6:29:42 AM, 1/18/2023 3:20:52 PM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 37.11367807413152 (T) = (0 -379314.59864924964) / Math.Sqrt((451510688.8595705 / (299)) + (554352.8453540459 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.11020881150185384 = (426296.19572821824 - 379314.59864924964) / 426296.19572821824 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.CastingPerf.CheckArrayIsInterfaceYes

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 31.360828323313292 < 59.27121518094289.
IsChangePoint: Marked as a change because one of 1/3/2023 6:29:42 AM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 16.49198575223303 (T) = (0 -31272.035051939816) / Math.Sqrt((243694375.21376815 / (299)) + (4479.1454969654615 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.32264206666677925 = (46167.66632975389 - 31272.035051939816) / 46167.66632975389 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.CastingPerf.CheckArrayIsInterfaceNo

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 31.220349301397203 < 59.27361530070195.
IsChangePoint: Marked as a change because one of 1/3/2023 6:29:42 AM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 16.55458578132166 (T) = (0 -31220.11798366027) / Math.Sqrt((243633048.0223547 / (299)) + (0.2058332450390743 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.3237065434197072 = (46163.566540368665 - 31220.11798366027) / 46163.566540368665 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in System.MathBenchmarks.Double

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ScaleB - Duration of single invocation	13.47 μs	11.66 μs	0.86	0.03	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.MathBenchmarks.Double*'

Payloads

Baseline
Compare

Histogram

System.MathBenchmarks.Double.ScaleB

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.655171226983306 < 12.802394845545978.
IsChangePoint: Marked as a change because one of 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 23.940436963855383 (T) = (0 -11679.610561953885) / Math.Sqrt((376217.81339245784 / (299)) + (798.9392271741665 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.07102865692740223 = (12572.62740024171 - 11679.610561953885) / 12572.62740024171 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in System.Drawing.Tests.Perf_Color

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetBrightness - Duration of single invocation	862.93 ns	735.15 ns	0.85	0.02	False
GetHue - Duration of single invocation	1.07 μs	1.00 μs	0.94	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Drawing.Tests.Perf_Color*'

Payloads

Baseline
Compare

Histogram

System.Drawing.Tests.Perf_Color.GetBrightness

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 735.1481218911256 < 819.5774762462397.
IsChangePoint: Marked as a change because one of 1/18/2023 11:30:09 AM, 2/1/2023 8:39:12 AM, 2/9/2023 4:27:10 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 75.78635758922306 (T) = (0 -736.7511336499682) / Math.Sqrt((478.2267810197477 / (299)) + (4.722619996141215 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.1371207420762049 = (853.828767912085 - 736.7511336499682) / 853.828767912085 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Drawing.Tests.Perf_Color.GetHue

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.0038216125050543 < 1.0177699758986702.
IsChangePoint: Marked as a change because one of 1/5/2023 11:35:29 PM, 1/11/2023 2:37:52 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 2/9/2023 4:27:10 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 27.253056263848904 (T) = (0 -995.0382043551161) / Math.Sqrt((1424.2759380116017 / (299)) + (58.97315243713895 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.094715837352527 = (1099.1446060926996 - 995.0382043551161) / 1099.1446060926996 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in GuardedDevirtualization.TwoClassVirtual

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Call - Duration of single invocation	6.73 ns	5.39 ns	0.80	0.05	False
Call - Duration of single invocation	6.73 ns	5.29 ns	0.79	0.06	False
Call - Duration of single invocation	6.54 ns	5.13 ns	0.78	0.06	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'GuardedDevirtualization.TwoClassVirtual*'

Payloads

Baseline
Compare

Histogram

GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.50)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.388122230477352 < 6.392151525797271.
IsChangePoint: Marked as a change because one of 12/21/2022 9:23:17 AM, 12/28/2022 5:13:50 PM, 1/3/2023 6:29:42 AM, 1/5/2023 12:24:13 PM, 1/18/2023 3:20:52 PM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 12.730546798765372 (T) = (0 -5.3984434130688745) / Math.Sqrt((0.4652204109066619 / (299)) + (0.0001881420654051593 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.0858829273398107 = (5.905636788249412 - 5.3984434130688745) / 5.905636788249412 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.40)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.290061947810552 < 6.3784017472354995.
IsChangePoint: Marked as a change because one of 1/9/2023 6:56:09 PM, 1/18/2023 3:20:52 PM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 11.460061832458129 (T) = (0 -5.283088958249336) / Math.Sqrt((0.3214004916358526 / (299)) + (7.837184942205609E-05 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.06677241188595988 = (5.6610938484211895 - 5.283088958249336) / 5.6610938484211895 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.60)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.126946912361522 < 6.1893127937350165.
IsChangePoint: Marked as a change because one of 1/5/2023 12:24:13 PM, 1/18/2023 3:20:52 PM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 8.811856986340842 (T) = (0 -5.117990238329496) / Math.Sqrt((0.3507377538991463 / (299)) + (0.000124683287448028 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.05614877940597242 = (5.42245443631297 - 5.117990238329496) / 5.42245443631297 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in System.Text.Json.Tests.Perf_Get

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetInt32 - Duration of single invocation	705.54 ns	612.77 ns	0.87	0.03	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Get*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Get.GetInt32

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 612.7694301028653 < 669.7263964787401.
IsChangePoint: Marked as a change because one of 1/3/2023 6:29:42 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 32.127273200190416 (T) = (0 -613.8259755095709) / Math.Sqrt((802.2631745954682 / (299)) + (5.428544152880972 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.09019789826883327 = (674.6807622686142 - 613.8259755095709) / 674.6807622686142 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in PerfLabTests.LowLevelPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
InterfaceInterfaceMethodLongHierarchy - Duration of single invocation	396.31 μs	344.47 μs	0.87	0.04	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.LowLevelPerf*'

Payloads

Baseline
Compare

Histogram

PerfLabTests.LowLevelPerf.InterfaceInterfaceMethodLongHierarchy

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 344.4690398550725 < 384.24302884615383.
IsChangePoint: Marked as a change because one of 12/20/2022 1:34:12 PM, 12/28/2022 5:13:50 PM, 1/3/2023 6:29:42 AM, 1/18/2023 3:20:52 PM, 2/9/2023 12:40:40 PM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 41.08270908974811 (T) = (0 -343257.16162008286) / Math.Sqrt((560517555.0327982 / (299)) + (352485.33842396137 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.1426740443606343 = (400381.161170016 - 343257.16162008286) / 400381.161170016 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in PerfLabTests.CastingPerf2.CastingPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IntObj - Duration of single invocation	226.07 μs	187.29 μs	0.83	0.04	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'

Payloads

Baseline
Compare

Histogram

PerfLabTests.CastingPerf2.CastingPerf.IntObj

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 187.29400297619048 < 215.38082185990336.
IsChangePoint: Marked as a change because one of 12/20/2022 1:34:12 PM, 12/28/2022 5:13:50 PM, 1/3/2023 6:29:42 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 11.007655784692055 (T) = (0 -187821.9185472047) / Math.Sqrt((413800230.2473975 / (299)) + (338702.2786697542 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.06571565488710573 = (201032.92913947866 - 187821.9185472047) / 201032.92913947866 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in System.Collections.IterateForEachNonGeneric<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Stack - Duration of single invocation	4.03 μs	3.64 μs	0.90	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEachNonGeneric<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.IterateForEachNonGeneric<Int32>.Stack(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.635222841225627 < 3.8297918091559526.
IsChangePoint: Marked as a change because one of 1/3/2023 6:29:42 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 43.018330489481855 (T) = (0 -3636.285412955822) / Math.Sqrt((13031.467291926567 / (299)) + (338.12798371718503 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.1057586775180993 = (4066.335698806202 - 3636.285412955822) / 4066.335698806202 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in Benchstone.BenchI.Ackermann

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	3.73 μs	3.36 μs	0.90	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchI.Ackermann*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.Ackermann.Test

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.3560598409969917 < 3.545457025381555.
IsChangePoint: Marked as a change because one of 12/20/2022 1:34:12 PM, 1/3/2023 6:29:42 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 29.13224002468772 (T) = (0 -3348.434267337754) / Math.Sqrt((29086.382059652104 / (299)) + (35.841870276528184 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.08122532137449677 = (3644.4564105173727 - 3348.434267337754) / 3644.4564105173727 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in System.Collections.AddGivenSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ICollection - Duration of single invocation	1.57 μs	1.40 μs	0.89	0.04	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.AddGivenSize<Int32>.ICollection(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.4015443363071098 < 1.4901346949417753.
IsChangePoint: Marked as a change because one of 12/20/2022 1:34:12 PM, 1/3/2023 6:29:42 AM, 2/9/2023 12:40:40 PM, 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 35.28803420551143 (T) = (0 -1402.7003397802475) / Math.Sqrt((4116.6537456695805 / (299)) + (1.8816866881421432 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.08626056133129657 = (1535.1207143077336 - 1402.7003397802475) / 1535.1207143077336 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in System.Memory.Span<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IndexOfAnyFourValues - Duration of single invocation	895.93 ns	817.05 ns	0.91	0.03	False
Fill - Duration of single invocation	3.51 ns	2.50 ns	0.71	0.27	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Int32>.IndexOfAnyFourValues(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 817.0501965923985 < 850.8705207715551.
IsChangePoint: Marked as a change because one of 12/21/2022 9:23:17 AM, 1/3/2023 6:29:42 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 21.329398435435003 (T) = (0 -813.9473294334974) / Math.Sqrt((1498.0600832343316 / (299)) + (5.39740966753525 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.05988911241737189 = (865.7992798343781 - 813.9473294334974) / 865.7992798343781 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Int32&gt;.Fill(Size: 33)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.4996369561020675 < 3.224090345540323.
IsChangePoint: Marked as a change because one of 12/21/2022 9:23:17 AM, 12/28/2022 5:13:50 PM, 2/9/2023 12:40:40 PM, 2/24/2023 9:01:57 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 23.66650216120191 (T) = (0 -2.499401857638906) / Math.Sqrt((0.23809387273808394 / (299)) + (7.07402680260185E-06 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.21098172377059776 = (3.1677363287237976 - 2.499401857638906) / 3.1677363287237976 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in System.Collections.IterateForEachNonGeneric<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Stack - Duration of single invocation	4.04 μs	3.64 μs	0.90	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEachNonGeneric<String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.IterateForEachNonGeneric<String>.Stack(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.6362597709155637 < 3.8426736622858177.
IsChangePoint: Marked as a change because one of 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/20/2023 10:31:48 AM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 47.02558263318997 (T) = (0 -3643.8066142157236) / Math.Sqrt((11986.430848297783 / (299)) + (146.0682086074301 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.09386942540122964 = (4021.2820495867068 - 3643.8066142157236) / 4021.2820495867068 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	6123cb00bbec8ae3500c970890f5b0efcf7950e8
Compare	ffbcb8336ac67496b0565112f663f74fda6cac34
Diff	Diff

Improvements in System.Memory.Span<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SequenceEqual - Duration of single invocation	13.63 ns	12.27 ns	0.90	0.11	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span<Byte>*'

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Byte>.SequenceEqual(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 12.268071987736704 < 12.90031346366449.
IsChangePoint: Marked as a change because one of 1/3/2023 3:01:43 PM, 1/13/2023 11:01:49 AM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 3/6/2023 11:14:52 AM, 3/7/2023 4:31:45 PM falls between 2/26/2023 10:10:21 PM and 3/7/2023 4:31:45 PM.
IsImprovementStdDev: Marked as improvement because 7.639719436311934 (T) = (0 -12.311967483694142) / Math.Sqrt((0.4621425130036503 / (299)) + (0.11829545087557883 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.08297170245185746 = (13.425940635215548 - 12.311967483694142) / 13.425940635215548 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[AndyAyersMS]

Mostly noise, but a few improvements from dotnet/runtime#83002