Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add perf hooks for testing substring path. #1976

Merged
merged 1 commit into from
Oct 13, 2021
Merged

Add perf hooks for testing substring path. #1976

merged 1 commit into from
Oct 13, 2021

Conversation

Lukasa
Copy link
Contributor

@Lukasa Lukasa commented Oct 13, 2021

No description provided.

@Lukasa Lukasa added the semver/none No version bump required. label Oct 13, 2021
@Lukasa Lukasa requested a review from glbrntt October 13, 2021 10:00
@Lukasa Lukasa mentioned this pull request Oct 13, 2021
Merged
@Lukasa
Copy link
Contributor Author

Lukasa commented Oct 13, 2021

@swift-nio-bot test perf please

@swift-server-bot
Copy link

performance report

build id: 80

timestamp: Wed Oct 13 10:09:17 UTC 2021

results

nameminmaxmeanstd
write_http_headers 0.004172231 0.004209493 0.0041843927 1.2151701838288613e-05
http_headers_canonical_form 0.087926831 0.088511395 0.0882293611 0.0002383746375838091
http_headers_canonical_form_trimming_whitespace 0.167315335 0.167866384 0.1677161632 0.00019522561080953434
http_headers_canonical_form_trimming_whitespace_from_short_string 0.152979155 0.154784091 0.1535655026 0.0005621724269526425
http_headers_canonical_form_trimming_whitespace_from_long_string 0.237457498 0.238106593 0.2376220876 0.00024661830577239426
bytebuffer_write_12MB_short_string_literals 0.533556192 0.539003304 0.5348711892 0.001514357801338579
bytebuffer_write_12MB_short_calculated_strings 0.53242313 0.534685864 0.5330767307000001 0.0007109384941807445
bytebuffer_write_12MB_medium_string_literals 0.177604633 0.180327764 0.1785460821 0.0007280126167892419
bytebuffer_write_12MB_medium_calculated_strings 0.228363343 0.230153644 0.22912790369999997 0.0005382986139582198
bytebuffer_write_12MB_large_calculated_strings 0.146401898 0.150480679 0.1473784741 0.0011376103723249069
bytebuffer_lots_of_rw 0.531796029 0.534674361 0.5326597043 0.0008157623242826982
bytebuffer_write_http_response_ascii_only_as_string 0.04064316 0.041195389 0.040823266999999996 0.0001987699427395065
bytebuffer_write_http_response_ascii_only_as_staticstring 0.031038351 0.031747954 0.0312639699 0.00022393155150598584
bytebuffer_write_http_response_some_nonascii_as_string 0.041892299 0.042653561 0.042179716900000004 0.0002635844633068623
bytebuffer_write_http_response_some_nonascii_as_staticstring 0.032500931 0.032971232 0.0326549307 0.00016196387773276355
no-net_http1_10k_reqs_1_conn 0.109570895 0.110830101 0.1101741399 0.00042640477747413495
http1_10k_reqs_1_conn 0.602764528 0.612588749 0.6093273509 0.0026524899006769875
http1_10k_reqs_100_conns 0.597687997 0.601683351 0.5992728296000001 0.0011196181390814943
future_whenallsucceed_100k_immediately_succeeded_off_loop 0.077736847 0.079299306 0.0782773906 0.00040934279978472763
future_whenallsucceed_100k_immediately_succeeded_on_loop 0.078747948 0.086160913 0.07979629190000001 0.0022448180221784114
future_whenallsucceed_100k_deferred_off_loop 0.28947697 0.29666439 0.2918304426 0.0021589169702229674
future_whenallsucceed_100k_deferred_on_loop 0.13415558 0.136020353 0.1350432841 0.0006103206572059696
future_whenallcomplete_100k_immediately_succeeded_off_loop 0.035875513 0.036738251 0.036101892000000003 0.0002827153998486029
future_whenallcomplete_100k_immediately_succeeded_on_loop 0.036047677 0.036651273 0.036320324 0.000196606423295657
future_whenallcomplete_100k_deferred_off_loop 0.21186356 0.219908692 0.2156486891 0.002801655623579999
future_whenallcomplete_100k_deferred_on_loop 0.070766537 0.075941892 0.0716505009 0.0015408975332088797
future_reduce_10k_futures 0.03967682 0.040363705 0.039933388800000004 0.00021001777492171052
future_reduce_into_10k_futures 0.037836259 0.038625495 0.0380761054 0.0002465852160609444
channel_pipeline_1m_events 0.101096574 0.101528403 0.10125853570000001 0.00011996319622752173
websocket_encode_50b_space_at_front_1m_frames_cow 0.515495088 0.516583521 0.5158882451 0.0003702843497069255
websocket_encode_50b_space_at_front_1m_frames_cow_masking 0.066272245 0.066761419 0.0664671522 0.0002275679591735188
websocket_encode_1kb_space_at_front_100k_frames_cow 0.054249585 0.054729985 0.0544115508 0.0002087966146366687
websocket_encode_50b_no_space_at_front_1m_frames_cow 0.515681047 0.516255508 0.5160105872 0.00020181009698824742
websocket_encode_1kb_no_space_at_front_100k_frames_cow 0.054269588 0.054732345 0.0544247714 0.000203017629057292
websocket_encode_50b_space_at_front_10k_frames 0.006845162 0.006871143 0.006856246000000001 9.335317836641161e-06
websocket_encode_50b_space_at_front_10k_frames_masking 0.081761877 0.08228739 0.0819838608 0.00023251185054807205
websocket_encode_1kb_space_at_front_1k_frames 0.000815353 0.000827704 0.0008211418 3.163620071303685e-06
websocket_encode_50b_no_space_at_front_10k_frames 0.006870062 0.006896891 0.0068835826 8.717597505429258e-06
websocket_encode_1kb_no_space_at_front_1k_frames 0.000733596 0.000750957 0.0007400661 4.620450397718578e-06
websocket_decode_125b_100k_frames 0.116678201 0.117176812 0.1169614618 0.00023060825486612672
websocket_decode_125b_with_a_masking_key_100k_frames 0.120051626 0.120566599 0.12034113900000001 0.00022690638813249294
websocket_decode_64kb_100k_frames 0.120425984 0.121032885 0.12073989780000001 0.00024342364018941736
websocket_decode_64kb_with_a_masking_key_100k_frames 0.123955029 0.124501272 0.1242870791 0.0002395981648359751
websocket_decode_64kb_+1_100k_frames 0.11995248 0.12045368 0.12024058769999998 0.00023887362726626791
websocket_decode_64kb_+1_with_a_masking_key_100k_frames 0.123478419 0.124060465 0.1237640944 0.00023361460701677063
circular_buffer_into_byte_buffer_1kb 0.041236249 0.041660108 0.041339968500000004 0.00017164214325499167
circular_buffer_into_byte_buffer_1mb 0.082259408 0.128300162 0.0924286778 0.017873158133990215
byte_buffer_view_iterator_1mb 0.020491738 0.020901453 0.020540992299999998 0.00012703387669528706
byte_to_message_decoder_decode_many_small 0.199577301 0.200130758 0.1996989196 0.0001576278171856407
generate_10k_random_request_keys 0.090147618 0.091588296 0.09115382720000001 0.00044140154082316816

comparison

name current previous winner diff
write_http_headers 0.004172231 0.004175045 current 0%
http_headers_canonical_form 0.087926831 0.087359793 previous 0%
http_headers_canonical_form_trimming_whitespace 0.167315335 0.16414186 previous 1%
http_headers_canonical_form_trimming_whitespace_from_short_string 0.152979155 0.150141559 previous 1%
http_headers_canonical_form_trimming_whitespace_from_long_string 0.237457498 0.230158238 previous 3%
bytebuffer_write_12MB_short_string_literals 0.533556192 0.538715713 current 0%
bytebuffer_write_12MB_short_calculated_strings 0.53242313 0.537945422 current -1%
bytebuffer_write_12MB_medium_string_literals 0.177604633 0.191221736 current -7%
bytebuffer_write_12MB_medium_calculated_strings 0.228363343 0.230677346 current -1%
bytebuffer_write_12MB_large_calculated_strings 0.146401898 0.146838218 current 0%
bytebuffer_lots_of_rw 0.531796029 0.482118312 previous 10%
bytebuffer_write_http_response_ascii_only_as_string 0.04064316 0.041142799 current -1%
bytebuffer_write_http_response_ascii_only_as_staticstring 0.031038351 0.030896826 previous 0%
bytebuffer_write_http_response_some_nonascii_as_string 0.041892299 0.042011427 current 0%
bytebuffer_write_http_response_some_nonascii_as_staticstring 0.032500931 0.03226906 previous 0%
no-net_http1_10k_reqs_1_conn 0.109570895 0.10922934 previous 0%
http1_10k_reqs_1_conn 0.602764528 0.599024709 previous 0%
http1_10k_reqs_100_conns 0.597687997 0.593943311 previous 0%
future_whenallsucceed_100k_immediately_succeeded_off_loop 0.077736847 0.0778737 current 0%
future_whenallsucceed_100k_immediately_succeeded_on_loop 0.078747948 0.078050194 previous 0%
future_whenallsucceed_100k_deferred_off_loop 0.28947697 0.297632057 current -2%
future_whenallsucceed_100k_deferred_on_loop 0.13415558 0.134463527 current 0%
future_whenallcomplete_100k_immediately_succeeded_off_loop 0.035875513 0.036468894 current -1%
future_whenallcomplete_100k_immediately_succeeded_on_loop 0.036047677 0.036257214 current 0%
future_whenallcomplete_100k_deferred_off_loop 0.21186356 0.221979802 current -4%
future_whenallcomplete_100k_deferred_on_loop 0.070766537 0.072151419 current -1%
future_reduce_10k_futures 0.03967682 0.038397907 previous 3%
future_reduce_into_10k_futures 0.037836259 0.037556812 previous 0%
channel_pipeline_1m_events 0.101096574 0.097143874 previous 4%
websocket_encode_50b_space_at_front_1m_frames_cow 0.515495088 0.515147191 previous 0%
websocket_encode_50b_space_at_front_1m_frames_cow_masking 0.066272245 0.066059904 previous 0%
websocket_encode_1kb_space_at_front_100k_frames_cow 0.054249585 0.054279183 current 0%
websocket_encode_50b_no_space_at_front_1m_frames_cow 0.515681047 0.51956624 current 0%
websocket_encode_1kb_no_space_at_front_100k_frames_cow 0.054269588 0.054345485 current 0%
websocket_encode_50b_space_at_front_10k_frames 0.006845162 0.006785868 previous 0%
websocket_encode_50b_space_at_front_10k_frames_masking 0.081761877 0.081483074 previous 0%
websocket_encode_1kb_space_at_front_1k_frames 0.000815353 0.000787542 previous 3%
websocket_encode_50b_no_space_at_front_10k_frames 0.006870062 0.006685971 previous 2%
websocket_encode_1kb_no_space_at_front_1k_frames 0.000733596 0.000727666 previous 0%
websocket_decode_125b_100k_frames 0.116678201 0.117553317 current 0%
websocket_decode_125b_with_a_masking_key_100k_frames 0.120051626 0.120955962 current 0%
websocket_decode_64kb_100k_frames 0.120425984 0.121225688 current 0%
websocket_decode_64kb_with_a_masking_key_100k_frames 0.123955029 0.124895855 current 0%
websocket_decode_64kb_+1_100k_frames 0.11995248 0.120830276 current 0%
websocket_decode_64kb_+1_with_a_masking_key_100k_frames 0.123478419 0.124364172 current 0%
circular_buffer_into_byte_buffer_1kb 0.041236249 0.041238146 current 0%
circular_buffer_into_byte_buffer_1mb 0.082259408 0.082273336 current 0%
byte_buffer_view_iterator_1mb 0.020491738 0.020490012 previous 0%
byte_to_message_decoder_decode_many_small 0.199577301 0.202701851 current -1%
generate_10k_random_request_keys 0.090147618 0.091048621 current 0%

significant differences found

@Lukasa Lukasa merged commit d906b89 into apple:main Oct 13, 2021
@Lukasa Lukasa deleted the cb-add-substring-perf-testing branch October 13, 2021 11:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@glbrntt glbrntt glbrntt approved these changes

Assignees
No one assigned
Labels
semver/none No version bump required.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@Lukasa @swift-server-bot @glbrntt