Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(deps): upgrade pgx to v5 #6916

Merged

Conversation

janisz
Copy link
Contributor

@janisz janisz commented Jul 12, 2023

Description

Description

pgx follows semantic versioning for the documented public API on stable releases.
v5 is the latest stable major version.

Important changes in v5:

Since https://github.com/driftprogramming/pgxpoolmock is not maintained over the last year and does not have pgx v5 support I decide to copy mocker rows file to our repo and clean it up from unused functions.

Checklist

  • Investigated and inspected CI test results
  • Unit test and regression tests added
  • Evaluated and added CHANGELOG entry if required
  • Determined and documented upgrade steps
  • Documented user facing changes (create PR based on openshift/openshift-docs and merge into rhacs-docs)

If any of these don't apply, please comment below.

Testing Performed

CI

@janisz janisz requested a review from rhybrillou July 12, 2023 20:00
@janisz janisz force-pushed the master-janisz/07-12-chore_deps_upgrade_pgx_to_v5 branch from 447de3e to e765e3b Compare July 12, 2023 20:25
@janisz janisz requested review from a team as code owners July 12, 2023 20:25
@janisz janisz force-pushed the master-janisz/07-12-chore_deps_copy_code_from_unmatinained_dep branch from f166fd6 to e0240e6 Compare July 12, 2023 20:26
@roxbot
Copy link
Contributor

roxbot commented Jul 12, 2023

Images are ready for the commit at 7e6aae1.

To use with deploy scripts, first export MAIN_IMAGE_TAG=4.3.x-96-g7e6aae12d9.

@janisz janisz force-pushed the master-janisz/07-12-chore_deps_upgrade_pgx_to_v5 branch from e765e3b to 3152b48 Compare July 13, 2023 10:32
@janisz janisz force-pushed the master-janisz/07-12-chore_deps_copy_code_from_unmatinained_dep branch from e0240e6 to ccf9ccd Compare July 13, 2023 10:33
@janisz janisz changed the title chore(deps): copy code from unmatinained dep chore(deps): copy code from unmaintained dep Jul 13, 2023
@janisz janisz force-pushed the master-janisz/07-12-chore_deps_upgrade_pgx_to_v5 branch from 3152b48 to 30917ac Compare July 13, 2023 11:32
@janisz janisz force-pushed the master-janisz/07-12-chore_deps_copy_code_from_unmatinained_dep branch 2 times, most recently from 8acfd2c to 1e64117 Compare July 13, 2023 11:46
@janisz janisz force-pushed the master-janisz/07-12-chore_deps_copy_code_from_unmatinained_dep branch from ecc8fd5 to 53233d7 Compare October 24, 2023 10:07
@janisz
Copy link
Contributor Author

janisz commented Oct 27, 2023

I run benchmarks on e2-standard-8 with following command and then filter results to keep only entries that differs:

BENCHTIME=1s BENCHTIMEOUT=0 BENCHCOUNT=30 nohup make go-postgres-bench-tests > results.txt &
sec/op master.txt new.txt diff
Datastore_Add_and_Flush/add_1000_events_to_the_writer_and_flush_it 24.09m 50.78m +110.81%
Datastore_Add_and_Flush/add_5000_events_to_the_writer_and_flush_it 172.7m 210.3m +21.76%
Datastore_Add_and_Flush/add_10000_events_to_the_writer_and_flush_i 533.3m 403.2m -24.40%
Datastore_Add_and_Flush/add_20000_events_to_the_writer_and_flush_i 667.4m 829.8m +24.34%
AlertDatabaseOps/searchWithoutHighlighted_(aka_get_IDs_only) 2.139m 1.981m -7.41%
GetMany/8_alerts 549.9µ 562.3µ +2.25%
GetMany/16_alerts 817.0µ 774.3µ -5.23%
GetMany/32_alerts 1.249m 1.281m +2.58%
GetMany/64_alerts 2.159m 2.384m +10.42%
GetMany/128_alerts 3.756m 4.128m +9.90%
GetMany/256_alerts 6.259m 6.913m +10.44%
GetMany/512_alerts 11.40m 12.53m +9.89%
GetMany/1024_alerts 21.69m 24.00m +10.66%
GetMany/2048_alerts 42.57m 47.66m +11.95%
SearchAllDeployments/SearchRetrievalList 16.06m 18.52m +15.29%
SearchAllDeployments/SearchRetrievalFull 15.85m 18.26m +15.20%
ImageResolver/GetImageComponentsInImageScanResolver 84.40m 83.06m -1.59%
ImageResolver/GetImageComponentsDerivedWithoutImageScanResolver 3.373 3.245 -3.79%
ImageResolver/GetImageOnly 876.2µ 809.6µ -7.60%
ImageResolver/GetImageWithCounts 19.07m 18.65m -2.23%
ImageResolver/GetImageScanTimeTopLevel 1.063m ± 1% 1.010m -4.94%
ImageResolver/GetImageScanTimeNested 1.233m 1.190m -3.53%
NodeResolver/GetNodeComponentsDerivedFieldsWithNodeScanResolver 149.8m 148.3m -1.00%
NodeResolver/GetNodeOnly 869.5µ 843.0µ -3.05%
ImageGetMany/GetImagesBatch 168.7m 126.0m -25.32%
ImageGetMany/GetManyImageMetadata 2.598m 2.528m -2.70%
NetEntityCreates/createNetworkEntities 20.10 ¹ 18.34 .75%
NetEntityCreateBatch/createNetworkEntitiesBatch 19.93 18.09 -9.22%
NetEntityUpdates/updateNetworkEntities 16.92 15.36 -9.20%
CreateNetworkTree/insertIntoNetworkTree 0.04034n 0.03939n -2.34%
EvaluateCluster/BenchmarkEvaluateCluster-_1_deployments;_1_polic 10.26µ 10.06µ -2.00%
EvaluateCluster/BenchmarkEvaluateCluster-_1_deployments;_10_poli 21.55µ 21.04µ -2.36%
EvaluateCluster/BenchmarkEvaluateCluster-_1_deployments;_100_pol 132.8µ 130.7µ -1.64%
EvaluateCluster/BenchmarkEvaluateCluster-_10_deployments;_10_pol 57.58µ 55.79µ -3.09%
EvaluateCluster/BenchmarkEvaluateCluster-_10_deployments;_100_po 332.9µ 327.3µ -1.68%
EvaluateCluster/BenchmarkEvaluateCluster-_100_deployments;_1_pol 225.3µ 219.7µ -2.46%
EvaluateCluster/BenchmarkEvaluateCluster-_100_deployments;_10_po 414.7µ 402.0µ -3.05%
EvaluateCluster/BenchmarkEvaluateCluster-_100_deployments;_100_p 2.283m 2.239m -1.96%
EvaluateCluster/BenchmarkEvaluateCluster-_1000_deployments;_1_po 2.582m 2.530m -2.02%
EvaluateCluster/BenchmarkEvaluateCluster-_1000_deployments;_10_p 4.421m 4.364m -1.29%
EvaluateCluster/BenchmarkEvaluateCluster-_1000_deployments;100 22.46m 22.13m -1.45%
DensePolicies/BenchmarkDensePolicies-_2000_deployments_1_policie 203.0m 192.5m -5.15%
DensePolicies/BenchmarkDensePolicies-_2000_deployments_1_policie 11.14 10.91 ± 1% -2.09%
DensePolicies/BenchmarkDensePolicies-_2000_deployments_1_policie 15.64 15.93 +1.83%
DensePolicies/BenchmarkDensePolicies-_2000_deployments_1_policie 24.98 24.68 -1.20%
SparsePolicies/BenchmarkSparsePolicies-_10000_deployments;_10_po 374.3m ± 1% 353.5m -5.57%
SparsePolicies/BenchmarkSparsePolicies-_10000_deployments;_100_p 4.206 4.700 +11.74%
GetManyNodes/GetManyNodeMetadata 1.526m 1.786m +17.00%
Nodes/searchAll 0.1862n ± 1% 0.1982n +6.42%
Nodes/searchForCluster 0.001570n ± 1% 0.001958n +24.71%
Nodes/deleteForClusters 228.7µ 249.4µ +9.07%
AddIndicator 38.89m 51.27m +31.84%
RabbitMQPruning 14.42 14.27 -1.01%
GetBindingsAndRoles/run_get_bindings_and_roles 327.6µ 352.7µ +7.68%
Collections/DryRunAddCollection 10.18m 10.42m +2.38%
Collections/DryRunUpdateCollection 11.07m 11.31m +2.15%
Collections/UpdateCollection 15.58m 16.72m +7.29%
Collections/graphInit 80.11m 92.60m +15.59%
GenerateViolationId 13.43µ 13.78µ +2.59%
ProcessPolicies/[field_name:"Process_Name"values:] 1.157m 1.174m +1.42%
ProcessPolicies/[field_name:"Privileged_Container"values:] 2.233m 2.293m +2.72%
ProcessPolicies/[field_name:"Process_Name"_values:__field_name:"Pr 1.240m 1.220m -1.61%
ProcessPolicies/[field_name:"Privileged_Container"_values:_field 3.969m 1.837m -53.71%
ProcessPolicies/[field_name:"Process_Name"_values:__field_name:"Pr 2.018m 1.009m -49.98%
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get/no_caching 363.2µ 356.3µ -1.88%
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get/with_caching 81.70µ 80.81µ -1.09%
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get2/no_caching 360.4µ 368.1µ +2.16%
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get/no_cachin 360.3µ 356.6µ -1.02%
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get/with_cach 81.27µ 84.92µ +4.49%
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get2/no_cachi 7.363µ 7.724µ +4.90%
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get2/with_cac 6.358µ 6.488µ +2.04%
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/curl/no_caching 3.413µ 3.571µ +4.61%
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/curl/with_caching 2.442µ 2.599µ ± 1% +6.41%
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/bash/no_caching 3.437µ 3.645µ +6.07%
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/bash/with_caching 2.471µ 2.544µ +2.95%
KeyFence 24.04µ 25.20µ +4.82%
ValueStreamWrite 322.3n 348.6n +8.16%
SliceAppend 30.65n ± 1% 28.13n .22%
SliceAppendWithMutex 341.6n 343.2n +0.48%
ValueStreamRead 108.0n 110.4n +2.22%
ValueStreamReadAsync 396.2n 427.9n +7.99%
BufChanRead 89.89n 90.81n +1.02%
Buf1ChanRead 804.2n 848.0n +5.44%
UnbufChanRead 1.131µ 1.195µ +5.66%
SortedKeys 2.796µ 3.119µ +11.55%
CertFingerprintChoices/SHA-1 1.113µ 1.167µ +4.85%
CertFingerprintChoices/SHA-256 1.897µ 1.933µ +1.92%
CertFingerprintChoices/SHA-512 1.873µ 1.902µ +1.49%
Walk/walk 0.01490n 0.01561n +4.77%
RateLimiter/NoLimit_NoThrottle 94.91n 95.38n +0.48%
RateLimiter/WithLimitHit_NoThrottle 124.9n 126.7n +1.48%
RateLimiter/WithLimitNoHit_NoThrottle 95.08n 99.17n ± 1% +4.31%
RateLimiter/NoLimit_Throttle_1s 1.575µ 1.619µ +2.76%
RateLimiter/WithLimitNoHit_Throttle_1s 1.575µ 1.584µ +0.57%
NRadixTreeForIPv4/IPv4NRadixTree:Create 0.05212n 0.05335n +2.36%
NRadixTreeForIPv4/IPv4NRadixTree:GetSupernetForCIDR 0.06268n 0.06525n ± 1% +4.09%
NRadixTreeForIPv4/IPv4NRadixTree:GetSubnetsForCIDR 0.06725n 0.06893n +2.50%
NRadixTreeForIPv4/IPv4NRadixTree:Insert 0.07140n 0.07279n +1.95%
NRadixTreeForIPv6/IPv6NRadixTree:Create 0.1779n 0.1765n -0.79%
NRadixTreeForIPv6/IPv6NRadixTree:GetSupernet 0.07010n 0.07351n ± 1% +4.87%
NRadixTreeForIPv6/IPv6NRadixTree:GetSubnets 0.1635n 0.1677n +2.57%
NRadixTreeForIPv6/IPv6NRadixTree:GetSubnetsForCIDR 0.1847n 0.1919n +3.90%
ReplaceVars/long 80.21µ 80.97µ +0.95%
IntSet 525.7µ 450.5µ -14.30%
StringSet 856.9µ 877.9µ +2.44%
VerifyAgainstSignatureIntegrations_1Integration 151.4µ 153.8µ +1.58%
VerifyAgainstSignatureIntegrations_100Integrations 13.73m 13.91m +1.27%
VerifyAgainstSignatureIntegrations_200Integrations 27.60m 27.83m +0.84%
geomean 224.0µ 226.2µ +0.96%
¹ benchmarks vary in networkgraph/entity/datastore

B/op master.txt new.txt diff
Datastore_Add_and_Flush/add_1000_events_to_the_writer_and_flush_it 2.596Mi 3.149Mi +21.31%
Datastore_Add_and_Flush/add_5000_events_to_the_writer_and_flush_it 16.17Mi 20.52Mi +26.85%
Datastore_Add_and_Flush/add_10000_events_to_the_writer_and_flush_i 32.38Mi 40.97Mi +26.54%
Datastore_Add_and_Flush/add_20000_events_to_the_writer_and_flush_i 64.75Mi 81.74Mi +26.23%
AlertDatabaseOps/searchWithStringHighlighted 1.283Mi 1.090Mi -15.07%
AlertDatabaseOps/searchWithoutHighlighted_(aka_get_IDs_only) 373.3Ki 327.4Ki -12.31%
AlertDatabaseOps/searchWithRawListAlert 8.960Mi 8.863Mi -1.09%
AlertDatabaseOps/markResolvedBatch 12.74Mi 14.29Mi +12.17%
GetMany/1_alerts 11.32Ki 11.52Ki +1.79%
GetMany/2_alerts 19.02Ki 18.91Ki -0.59%
GetMany/4_alerts 34.40Ki 33.69Ki -2.06%
GetMany/8_alerts 65.17Ki 64.02Ki -1.76%
GetMany/16_alerts 128.3Ki 125.0Ki -2.62%
GetMany/32_alerts 253.2Ki 248.1Ki -2.00%
GetMany/64_alerts 504.5Ki 493.6Ki -2.15%
GetMany/128_alerts 1007.0Ki 984.3Ki -2.25%
GetMany/256_alerts 1.963Mi 1.931Mi -1.62%
GetMany/512_alerts 3.932Mi 3.849Mi -2.13%
GetMany/1024_alerts 7.861Mi 7.724Mi -1.74%
GetMany/2048_alerts 15.78Mi 15.74Mi -0.23%
SearchAllDeployments/SearchRetrievalList 4.499Mi 4.691Mi +4.25%
SearchAllDeployments/SearchRetrievalFull 4.354Mi 4.546Mi +4.40%
ImageResolver/GetImageComponentsWithoutImageScanResolver 102.0Mi 101.6Mi -0.40%
ImageResolver/GetImageComponentsDerivedFieldsWithImageScanResolver 42.02Mi 42.02Mi +0.01%
ImageResolver/GetImageComponentsDerivedWithoutImageScanResolver 664.1Mi 663.4Mi -0.10%
ImageResolver/GetImageOnly 46.04Ki 45.75Ki -0.62%
ImageResolver/GetImageWithCounts 1.409Mi 1.410Mi +0.07%
ImageResolver/GetImageScanTimeTopLevel 66.00Ki 65.71Ki -0.43%
ImageResolver/GetImageScanTimeNested 80.94Ki 80.65Ki -0.35%
NodeResolver/GetNodeComponentsWithoutNodeScanResolver 101.5Mi 102.1Mi +0.57%
NodeResolver/GetNodeComponentsDerivedWithoutNodeScanResolver 590.5Mi 596.4Mi +1.00%
NodeResolver/GetNodeOnly 52.16Ki 51.03Ki -2.17%
NodeResolver/GetNodeWithCounts 1.363Mi 1.382Mi +1.41%
ImageGetMany/GetImagesBatch 9.260Mi 9.358Mi +1.06%
ImageGetMany/GetManyImageMetadata 655.3Ki 632.1Ki -3.54%
InitFromStore/New 16.13Mi 16.80Mi +4.15%
NetEntityCreates/createNetworkEntities 85.11Mi ¹ 79.55Mi -6.54%
NetEntityCreateBatch/createNetworkEntitiesBatch 78.64Mi 73.15Mi -6.98%
NetEntityUpdates/updateNetworkEntities 73.76Mi 68.48Mi -7.15%
GetManyNodes/GetNodesBatch 7.485Mi 7.672Mi +2.50%
GetManyNodes/GetManyNodeMetadata 254.0Ki 285.8Ki +12.54%
Nodes/upsertNodeWithOldScan 8.565Ki 9.974Ki +16.44%
Nodes/upsertNodeWithNewScan 8.568Ki 9.980Ki +16.48%
Nodes/deleteForClusters 12.34Ki 12.75Ki +3.28%
AddIndicator 1.974Mi 3.330Mi +68.68%
GetBindingsAndRoles/run_get_bindings_and_roles 21.80Ki 22.09Ki +1.35%
Collections/UpdateCollection 2.730Mi 2.665Mi -2.40%
Collections/graphInit 9.998Mi 9.573Mi -4.25%
Create/create 28.02Ki 24.37Ki -13.02%
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get/with_cach 16.63Ki 16.63Ki +0.01%
SliceAppendWithMutex 46.00 45.00 -2.17%
StringSet 76.11Ki 79.50Ki +4.46%
geomean ³ +0.78% ³
¹ benchmarks vary in networkgraph/entity/datastore
² all samples are equal
³ summaries must be >0 to compute geomean

allocs/op master.txt new.txt diff
Datastore_Add_and_Flush/add_1000_events_to_the_writer_and_flush_it 32.63k 46.85k +43.59%
Datastore_Add_and_Flush/add_5000_events_to_the_writer_and_flush_it 216.5k 324.2k +49.76%
Datastore_Add_and_Flush/add_10000_events_to_the_writer_and_flush_i 432.9k 648.4k +49.77%
Datastore_Add_and_Flush/add_20000_events_to_the_writer_and_flush_i 865.7k 1296.6k +49.77%
AlertDatabaseOps/searchWithStringHighlighted 23.39k 23.38k -0.08%
AlertDatabaseOps/searchWithoutHighlighted_(aka_get_IDs_only) 3.270k 3.265k -0.15%
AlertDatabaseOps/searchWithRawListAlert 195.4k 196.2k +0.41%
AlertDatabaseOps/markResolvedBatch 242.5k 292.3k +20.57%
GetMany/1_alerts 160.0 184.0 +15.00%
GetMany/2_alerts 257.0 284.0 +10.51%
GetMany/4_alerts 451.0 483.0 +7.10%
GetMany/8_alerts 837.0 882.0 +5.38%
GetMany/16_alerts 1.612k 1.677k +4.03%
GetMany/32_alerts 3.156k 3.265k +3.45%
GetMany/64_alerts 6.242k 6.438k +3.14%
GetMany/128_alerts 12.41k 12.78k +2.96%
GetMany/256_alerts 24.75k 25.46k +2.87%
GetMany/512_alerts 49.41k 50.80k +2.82%
GetMany/1024_alerts 98.74k 101.50k +2.80%
GetMany/2048_alerts 197.4k 202.9k +2.79%
SearchAllDeployments/SearchRetrievalList 72.35k 75.31k +4.08%
SearchAllDeployments/SearchRetrievalFull 71.35k 74.31k +4.14%
ImageResolver/GetImageComponentsWithoutImageScanResolver 1.345M 1.347M +0.14%
ImageResolver/GetImageComponentsDerivedFieldsWithImageScanResolver 705.2k 705.2k +0.01%
ImageResolver/GetImageComponentsDerivedWithoutImageScanResolver 8.102M 8.162M +0.74%
ImageResolver/GetImageOnly 831.0 834.0 +0.36%
ImageResolver/GetImageWithCounts 15.27k 15.39k +0.75%
ImageResolver/GetImageScanTimeTopLevel 1.315k 1.317k +0.15%
ImageResolver/GetImageScanTimeNested 1.795k 1.798k +0.17%
NodeResolver/GetNodeComponentsWithoutNodeScanResolver 1.332M 1.370M +2.85%
NodeResolver/GetNodeComponentsDerivedWithoutNodeScanResolver 7.654M 7.969M +4.12%
NodeResolver/GetNodeOnly 835.0 837.0 +0.24%
NodeResolver/GetNodeWithCounts 15.14k 16.00k +5.70%
ImageGetMany/GetImagesBatch 105.0k 114.8k +9.31%
ImageGetMany/GetManyImageMetadata 9.588k 9.571k -0.18%
InitFromStore/New 256.9k 289.0k +12.48%
NetEntityCreates/createNetworkEntities 1.558M ¹ 1.486M -4.59%
NetEntityCreateBatch/createNetworkEntitiesBatch 1.391M 1.319M -5.12%
NetEntityUpdates/updateNetworkEntities 1.401M 1.350M -3.58%
GetManyNodes/GetNodesBatch 77.69k 87.81k +13.03%
GetManyNodes/GetManyNodeMetadata 3.975k 5.480k +37.86%
Nodes/upsertNodeWithOldScan 134.0 199.0 +48.51%
Nodes/upsertNodeWithNewScan 134.0 200.0 +49.25%
Nodes/deleteForClusters 165.0 181.0 +9.70%
AddIndicator 29.17k 70.20k +140.69%
GetBindingsAndRoles/run_get_bindings_and_roles 350.0 363.0 +3.71%
Collections/DryRunUpdateCollection 482.5 487.5 +1.04%
Collections/UpdateCollection 3.304k 3.123k -5.45%
Collections/graphInit 89.74k 99.71k +11.11%
Create/create 440.0 425.0 -3.41%
geomean ³ +3.03% ³
¹ benchmarks vary in networkgraph/entity/datastore
² all samples are equal
³ summaries must be >0 to compute geomean

@janisz janisz force-pushed the master-janisz/07-12-chore_deps_copy_code_from_unmatinained_dep branch 3 times, most recently from 0eeb37f to 6383126 Compare November 6, 2023 14:14
@janisz janisz changed the title WIP: upgrade pgx to v5 upgrade pgx to v5 Nov 6, 2023
@janisz janisz requested a review from a team November 6, 2023 14:16
@janisz janisz force-pushed the master-janisz/07-12-chore_deps_copy_code_from_unmatinained_dep branch from 6383126 to 16315c1 Compare November 6, 2023 16:24
@janisz janisz changed the title upgrade pgx to v5 chore(deps): upgrade pgx to v5 Nov 6, 2023
@janisz janisz requested a review from a team November 6, 2023 16:48
@dashrews78
Copy link
Contributor

/test

Copy link

openshift-ci bot commented Nov 6, 2023

@dashrews78: The /test command needs one or more targets.
The following commands are available to trigger required jobs:

  • /test shell-unit-tests

The following commands are available to trigger optional jobs:

  • /test aks-qa-e2e-tests
  • /test aro-qa-e2e-tests
  • /test eks-qa-e2e-tests
  • /test gke-nongroovy-e2e-tests
  • /test gke-operator-e2e-tests
  • /test gke-qa-e2e-tests
  • /test gke-race-condition-qa-e2e-tests
  • /test gke-scale-tests
  • /test gke-sensor-integration-tests
  • /test gke-ui-e2e-tests
  • /test gke-upgrade-tests
  • /test gke-version-compatibility-tests
  • /test ibmcloudz-4-14-qa-e2e-tests
  • /test ibmcloudz-qa-e2e-tests
  • /test ocp-4-11-compliance-e2e-tests
  • /test ocp-4-11-ebpf-qa-e2e-tests
  • /test ocp-4-11-operator-e2e-tests
  • /test ocp-4-11-qa-e2e-tests
  • /test ocp-4-11-sensor-integration-tests
  • /test ocp-4-11-sensor-profiling
  • /test ocp-4-11-ui-e2e-tests
  • /test ocp-4-13-compliance-e2e-tests
  • /test ocp-4-13-ebpf-qa-e2e-tests
  • /test ocp-4-13-fips-qa-e2e-tests
  • /test ocp-4-13-operator-e2e-tests
  • /test ocp-4-13-qa-e2e-tests
  • /test ocp-4-13-sensor-integration-tests
  • /test ocp-4-13-sensor-profiling
  • /test ocp-4-13-ui-e2e-tests
  • /test ocp-4-14-compliance-e2e-tests
  • /test ocp-4-14-ebpf-qa-e2e-tests
  • /test ocp-4-14-operator-e2e-tests
  • /test ocp-4-14-qa-e2e-tests
  • /test ocp-4-14-sensor-integration-tests
  • /test ocp-4-14-sensor-profiling
  • /test ocp-4-14-ui-e2e-tests
  • /test osd-aws-qa-e2e-tests
  • /test osd-gcp-qa-e2e-tests
  • /test powervs-4-12-qa-e2e-tests
  • /test powervs-4-14-qa-e2e-tests
  • /test powervs-qa-e2e-tests
  • /test rosa-qa-e2e-tests

Use /test all to run the following jobs that were automatically triggered:

  • pull-ci-stackrox-stackrox-master-gke-nongroovy-e2e-tests
  • pull-ci-stackrox-stackrox-master-gke-operator-e2e-tests
  • pull-ci-stackrox-stackrox-master-gke-qa-e2e-tests
  • pull-ci-stackrox-stackrox-master-gke-sensor-integration-tests
  • pull-ci-stackrox-stackrox-master-gke-ui-e2e-tests
  • pull-ci-stackrox-stackrox-master-gke-upgrade-tests
  • pull-ci-stackrox-stackrox-master-ocp-4-11-compliance-e2e-tests
  • pull-ci-stackrox-stackrox-master-ocp-4-11-operator-e2e-tests
  • pull-ci-stackrox-stackrox-master-ocp-4-11-qa-e2e-tests
  • pull-ci-stackrox-stackrox-master-ocp-4-13-compliance-e2e-tests
  • pull-ci-stackrox-stackrox-master-ocp-4-13-operator-e2e-tests
  • pull-ci-stackrox-stackrox-master-ocp-4-13-qa-e2e-tests

In response to this:

/test

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@dashrews78
Copy link
Contributor

/test gke-scale-tests

1 similar comment
@dashrews78
Copy link
Contributor

/test gke-scale-tests

Copy link
Contributor

@dashrews78 dashrews78 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is probably a good time to tackle this. It would probably be worth having @mtodor look at it in a performance environment. (Though that may come after merge so we can incrementally fix any performance fallout)

@janisz
Copy link
Contributor Author

janisz commented Nov 7, 2023

I think I know why some results are worse. I've profiled Datastore test for CPU and allocations and looks like the 5.4.2 version has a regression in copy from method that allocates more memory then old version. Update to 5.5.0 resolves this issue.

methods allocs
pgx/v4.18.1(*copyFrom).run.func1 581302
pgx/v5.4.2.(*copyFrom).run.func1 1807443
pgx/v5.5.0.(*copyFrom).run.func1 543334

Signed-off-by: Tomasz Janiszewski <tomek@redhat.com>
Signed-off-by: Tomasz Janiszewski <tomek@redhat.com>
Signed-off-by: Tomasz Janiszewski <tomek@redhat.com>
@janisz janisz force-pushed the master-janisz/07-12-chore_deps_copy_code_from_unmatinained_dep branch from 3cccb20 to 7e6aae1 Compare November 7, 2023 16:17
Copy link

openshift-ci bot commented Nov 7, 2023

@janisz: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/ocp-4-13-core-bpf-qa-e2e-tests 4552503 link false /test ocp-4-13-core-bpf-qa-e2e-tests
ci/prow/shell-unit-tests 53233d7 link true /test shell-unit-tests
ci/prow/ocp-4-10-qa-e2e-tests 0eeb37f link false /test ocp-4-10-qa-e2e-tests
ci/prow/gke-ui-e2e-tests 7e6aae1 link false /test gke-ui-e2e-tests
ci/prow/ocp-4-11-qa-e2e-tests 7e6aae1 link false /test ocp-4-11-qa-e2e-tests

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@janisz
Copy link
Contributor Author

janisz commented Nov 8, 2023

Bench results after upgrading to 5.5 looks better. Still there is a room for improvements but it's not that bad.

PGX: 
                                                                                                                                                                                                    │    master.txt    │                 new-5.5.txt                 │
                                                                                                                                                                                                    │      sec/op      │     sec/op       vs base                    │
Datastore_Add_and_Flush/add_1000_events_to_the_writer_and_flush_it-8                                                                                                                                     24.09m ± 0%        29.43m ±  1%   +22.18% (p=0.000 n=30)
Datastore_Add_and_Flush/add_5000_events_to_the_writer_and_flush_it-8                                                                                                                                     172.7m ± 0%        207.1m ±  0%   +19.96% (p=0.007 n=30)
Datastore_Add_and_Flush/add_10000_events_to_the_writer_and_flush_it-8                                                                                                                                    533.3m ± 0%        401.4m ±  0%   -24.74% (p=0.001 n=30)
Datastore_Add_and_Flush/add_20000_events_to_the_writer_and_flush_it-8                                                                                                                                    667.4m ± 0%        811.1m ±  0%   +21.53% (p=0.000 n=30)
AlertDatabaseOps/searchWithStringHighlighted-8                                                                                                                                                           5.971m ± 0%        5.780m ±  0%    -3.19% (p=0.000 n=30)
AlertDatabaseOps/searchWithoutHighlighted_(aka_get_IDs_only)-8                                                                                                                                           2.139m ± 0%        1.891m ±  0%   -11.61% (p=0.000 n=30)
AlertDatabaseOps/searchWithRawListAlert-8                                                                                                                                                                29.30m ± 0%        28.24m ±  0%    -3.64% (p=0.000 n=30)
AlertDatabaseOps/markResolvedBatch-8                                                                                                                                                                     158.0m ± 1%        170.9m ±  2%         ~ (p=0.219 n=30)
GetMany/1_alerts-8                                                                                                                                                                                       307.8µ ± 0%        625.0µ ±  0%  +103.06% (p=0.000 n=30)
GetMany/2_alerts-8                                                                                                                                                                                       338.5µ ± 0%        634.7µ ±  1%   +87.52% (p=0.000 n=30)
GetMany/4_alerts-8                                                                                                                                                                                       431.4µ ± 0%        447.1µ ±  0%    +3.64% (p=0.048 n=30)
GetMany/8_alerts-8                                                                                                                                                                                       549.9µ ± 0%        568.6µ ±  0%    +3.40% (p=0.021 n=30)
GetMany/16_alerts-8                                                                                                                                                                                      817.0µ ± 0%        821.6µ ±  0%         ~ (p=0.994 n=30)
GetMany/32_alerts-8                                                                                                                                                                                      1.249m ± 0%        1.302m ±  0%    +4.24% (p=0.000 n=30)
GetMany/64_alerts-8                                                                                                                                                                                      2.159m ± 0%        2.178m ±  0%         ~ (p=0.208 n=30)
GetMany/128_alerts-8                                                                                                                                                                                     3.756m ± 0%        3.774m ±  0%         ~ (p=0.203 n=30)
GetMany/256_alerts-8                                                                                                                                                                                     6.259m ± 0%        6.861m ±  0%    +9.61% (p=0.000 n=30)
GetMany/512_alerts-8                                                                                                                                                                                     11.40m ± 0%        12.59m ±  0%   +10.39% (p=0.000 n=30)
GetMany/1024_alerts-8                                                                                                                                                                                    21.69m ± 0%        24.00m ±  0%   +10.65% (p=0.000 n=30)
GetMany/2048_alerts-8                                                                                                                                                                                    42.57m ± 0%        47.73m ±  0%   +12.11% (p=0.000 n=30)
AggregatedResults-8                                                                                                                                                                                      273.9m ± 0%        267.7m ±  0%    -2.27% (p=0.000 n=30)
SearchAllDeployments/SearchRetrievalList-8                                                                                                                                                               16.06m ± 0%        18.09m ±  0%   +12.65% (p=0.000 n=30)
SearchAllDeployments/SearchRetrievalFull-8                                                                                                                                                               15.85m ± 0%        17.90m ±  0%   +12.89% (p=0.000 n=30)
DefaultPolicies-8                                                                                                                                                                                        10.92m ± 0%        10.55m ±  0%    -3.39% (p=0.000 n=30)
ImageResolver/GetImageComponentsInImageScanResolver-8                                                                                                                                                    84.40m ± 0%        82.26m ±  0%    -2.54% (p=0.000 n=30)
ImageResolver/GetImageComponentsWithoutImageScanResolver-8                                                                                                                                              1009.7m ± 0%        953.7m ±  0%    -5.54% (p=0.000 n=30)
ImageResolver/GetImageComponentsDerivedFieldsWithImageScanResolver-8                                                                                                                                     143.5m ± 0%        140.6m ±  0%    -2.02% (p=0.010 n=30)
ImageResolver/GetImageComponentsDerivedWithoutImageScanResolver-8                                                                                                                                         3.373 ± 0%         3.177 ±  0%    -5.81% (p=0.000 n=30)
ImageResolver/GetImageOnly-8                                                                                                                                                                             876.2µ ± 0%        809.2µ ±  0%    -7.64% (p=0.000 n=30)
ImageResolver/GetImageWithCounts-8                                                                                                                                                                       19.07m ± 0%        18.25m ±  0%    -4.32% (p=0.000 n=30)
ImageResolver/GetImageScanTimeTopLevel-8                                                                                                                                                                1062.5µ ± 1%        997.3µ ±  0%    -6.13% (p=0.000 n=30)
ImageResolver/GetImageScanTimeNested-8                                                                                                                                                                   1.233m ± 0%        1.150m ±  0%    -6.79% (p=0.000 n=30)
NodeResolver/GetNodeComponentsInNodeScanResolver-8                                                                                                                                                       89.36m ± 0%        86.76m ±  0%    -2.92% (p=0.000 n=30)
NodeResolver/GetNodeComponentsWithoutNodeScanResolver-8                                                                                                                                                  346.3m ± 0%        349.8m ±  0%         ~ (p=0.063 n=30)
NodeResolver/GetNodeComponentsDerivedFieldsWithNodeScanResolver-8                                                                                                                                        149.8m ± 0%        143.9m ±  0%    -3.88% (p=0.000 n=30)
NodeResolver/GetNodeComponentsDerivedWithoutNodeScanResolver-8                                                                                                                                            2.380 ± 0%         2.375 ±  0%         ~ (p=0.582 n=30)
NodeResolver/GetNodeOnly-8                                                                                                                                                                               869.5µ ± 0%        819.4µ ±  0%    -5.77% (p=0.000 n=30)
NodeResolver/GetNodeWithCounts-8                                                                                                                                                                         14.38m ± 0%        13.87m ±  0%    -3.53% (p=0.000 n=30)
ImageGetMany/GetImagesBatch-8                                                                                                                                                                            168.7m ± 0%        142.3m ± 10%   -15.67% (p=0.001 n=30)
ImageGetMany/GetManyImageMetadata-8                                                                                                                                                                      2.598m ± 0%        2.365m ±  0%    -8.97% (p=0.000 n=30)
InitFromStore/New-8                                                                                                                                                                                      412.6m ± 0%        407.6m ±  0%         ~ (p=0.173 n=30)
NetEntityCreates/createNetworkEntities-8                                                                                                                                                                  20.10 ± 0% ¹       18.83 ±  0%    -6.31% (p=0.000 n=30)
NetEntityCreateBatch/createNetworkEntitiesBatch-8                                                                                                                                                         19.93 ± 0%         18.64 ±  0%    -6.46% (p=0.000 n=30)
NetEntityUpdates/updateNetworkEntities-8                                                                                                                                                                  16.92 ± 0%         14.91 ±  0%   -11.92% (p=0.000 n=30)
CreateNetworkTree/insertIntoNetworkTree-8                                                                                                                                                              0.04034n ± 0%      0.03863n ±  0%    -4.24% (p=0.000 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_1_deployments;_1_policies-8                                                                                                                                 10.264µ ± 0%        9.866µ ±  0%    -3.88% (p=0.000 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_1_deployments;_10_policies-8                                                                                                                                 21.55µ ± 0%        20.78µ ±  0%    -3.57% (p=0.000 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_1_deployments;_100_policies-8                                                                                                                                132.8µ ± 0%        130.2µ ±  0%    -1.99% (p=0.000 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_10_deployments;_1_policies-8                                                                                                                                 29.04µ ± 0%        28.59µ ±  0%    -1.54% (p=0.008 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_10_deployments;_10_policies-8                                                                                                                                57.58µ ± 0%        55.20µ ±  0%    -4.12% (p=0.000 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_10_deployments;_100_policies-8                                                                                                                               332.9µ ± 0%        325.2µ ±  0%    -2.31% (p=0.000 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_100_deployments;_1_policies-8                                                                                                                                225.3µ ± 0%        217.3µ ±  0%    -3.52% (p=0.000 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_100_deployments;_10_policies-8                                                                                                                               414.7µ ± 0%        400.7µ ±  0%    -3.37% (p=0.000 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_100_deployments;_100_policies-8                                                                                                                              2.283m ± 0%        2.236m ±  0%    -2.10% (p=0.000 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_1000_deployments;_1_policies-8                                                                                                                               2.582m ± 0%        2.474m ±  0%    -4.20% (p=0.000 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_1000_deployments;_10_policies-8                                                                                                                              4.421m ± 0%        4.227m ±  0%    -4.38% (p=0.000 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_1000_deployments;_100_policies-8                                                                                                                             22.46m ± 0%        21.76m ±  0%    -3.11% (p=0.000 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_200_ingress_allowed_per_policy_200_egress_allowed_per_policy-8                                                                       203.0m ± 0%        192.1m ±  0%    -5.36% (p=0.000 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_200_ingress_allowed_per_policy_1000_egress_allowed_per_policy-8                                                                       11.14 ± 0%         10.21 ±  0%    -8.38% (p=0.013 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_200_ingress_allowed_per_policy_2000_egress_allowed_per_policy-8                                                                       11.81 ± 0%         10.77 ±  0%    -8.79% (p=0.000 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_1000_ingress_allowed_per_policy_200_egress_allowed_per_policy-8                                                                       15.15 ± 0%         14.00 ±  0%    -7.61% (p=0.040 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_1000_ingress_allowed_per_policy_1000_egress_allowed_per_policy-8                                                                      15.64 ± 0%         14.12 ±  0%    -9.70% (p=0.028 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_1000_ingress_allowed_per_policy_2000_egress_allowed_per_policy-8                                                                      23.83 ± 0%         21.87 ±  0%    -8.23% (p=0.001 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_2000_ingress_allowed_per_policy_200_egress_allowed_per_policy-8                                                                       15.64 ± 0%         14.44 ±  0%    -7.68% (p=0.000 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_2000_ingress_allowed_per_policy_1000_egress_allowed_per_policy-8                                                                      23.82 ± 0%         19.25 ± 12%   -19.19% (p=0.003 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_2000_ingress_allowed_per_policy_2000_egress_allowed_per_policy-8                                                                      24.98 ± 0%         22.49 ±  0%    -9.95% (p=0.000 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_1_policies_each_applied_to_1_nodes-8                                                                                                        73.59m ± 0%        58.61m ±  0%   -20.36% (p=0.000 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_1_policies_each_applied_to_10_nodes-8                                                                                                       70.88m ± 0%        58.66m ±  0%   -17.24% (p=0.000 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_1_policies_each_applied_to_100_nodes-8                                                                                                      69.60m ± 0%        59.54m ±  0%   -14.46% (p=0.000 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_10_policies_each_applied_to_1_nodes-8                                                                                                       358.6m ± 0%        284.9m ±  0%   -20.54% (p=0.000 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_10_policies_each_applied_to_10_nodes-8                                                                                                      348.3m ± 0%        289.0m ±  0%   -17.02% (p=0.000 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_10_policies_each_applied_to_100_nodes-8                                                                                                     374.3m ± 1%        296.9m ±  0%   -20.67% (p=0.000 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_100_policies_each_applied_to_1_nodes-8                                                                                                       3.137 ± 0%         2.484 ±  0%   -20.81% (p=0.000 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_100_policies_each_applied_to_10_nodes-8                                                                                                      3.184 ± 0%         2.561 ±  0%   -19.56% (p=0.000 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_100_policies_each_applied_to_100_nodes-8                                                                                                     4.206 ± 0%         3.341 ±  0%   -20.58% (p=0.000 n=30)
GetManyNodes/GetNodesBatch-8                                                                                                                                                                             141.9m ± 0%        246.0m ±  1%   +73.30% (p=0.000 n=30)
GetManyNodes/GetManyNodeMetadata-8                                                                                                                                                                       1.526m ± 0%        1.725m ±  0%   +13.05% (p=0.000 n=30)
Nodes/upsertNodeWithOldScan-8                                                                                                                                                                            3.604m ± 0%        3.455m ±  0%    -4.11% (p=0.013 n=30)
Nodes/upsertNodeWithNewScan-8                                                                                                                                                                            3.622m ± 0%        3.415m ±  0%    -5.73% (p=0.001 n=30)
Nodes/searchAll-8                                                                                                                                                                                       0.1862n ± 1%       0.1894n ±  0%         ~ (p=0.212 n=30)
Nodes/searchForCluster-8                                                                                                                                                                              0.001570n ± 1%     0.001494n ±  1%         ~ (p=0.255 n=30)
Nodes/deleteForClusters-8                                                                                                                                                                                228.7µ ± 0%        233.8µ ±  0%    +2.21% (p=0.036 n=30)
AddIndicator-8                                                                                                                                                                                           38.89m ± 0%        49.96m ±  0%   +28.48% (p=0.000 n=25+23)
RabbitMQPruning-8                                                                                                                                                                                         14.42 ± 0%         14.22 ±  0%    -1.32% (p=0.000 n=30)
GetBindingsAndRoles/run_get_bindings_and_roles-8                                                                                                                                                         327.6µ ± 0%        337.2µ ±  0%         ~ (p=0.213 n=30)
Collections/DryRunAddCollection-8                                                                                                                                                                       10.175m ± 0%        9.527m ±  0%    -6.37% (p=0.000 n=30)
Collections/DryRunUpdateCollection-8                                                                                                                                                                     11.07m ± 0%        10.41m ±  0%    -6.01% (p=0.000 n=30)
Collections/UpdateCollection-8                                                                                                                                                                           15.58m ± 0%        14.74m ±  0%    -5.37% (p=0.000 n=30)
Collections/graphInit-8                                                                                                                                                                                  80.11m ± 0%        76.47m ±  0%    -4.55% (p=0.000 n=30)
Collections/AddCollection-8                                                                                                                                                                              33.75m ± 3%        33.07m ±  2%         ~ (p=0.820 n=30)
GenerateViolationId-8                                                                                                                                                                                    13.43µ ± 0%        13.40µ ±  0%         ~ (p=0.078 n=30)
Create/create-8                                                                                                                                                                                          7.812m ± 1%        8.070m ±  0%         ~ (p=0.542 n=30)
ProcessPolicies/[field_name:"Process_Name"_values:<value:"apt-get"_>_]-8                                                                                                                                 1.157m ± 0%        1.148m ±  0%    -0.79% (p=0.019 n=30)
ProcessPolicies/[field_name:"Unexpected_Process_Executed"_values:<value:"true"_>_]-8                                                                                                                     1.922m ± 0%        1.885m ±  0%    -1.97% (p=0.000 n=30)
ProcessPolicies/[field_name:"Privileged_Container"_values:<value:"true"_>_]-8                                                                                                                            2.233m ± 0%        2.187m ±  0%    -2.07% (p=0.000 n=30)
ProcessPolicies/[field_name:"Process_Name"_values:<value:"apt-get"_>__field_name:"Unexpected_Process_Executed"_values:<value:"true"_>_]-8                                                                998.8µ ± 0%       1431.8µ ± 30%         ~ (p=0.208 n=30)
ProcessPolicies/[field_name:"Process_Name"_values:<value:"apt-get"_>__field_name:"Privileged_Container"_values:<value:"true"_>_]-8                                                                       1.240m ± 0%        2.494m ±  0%  +101.16% (p=0.000 n=30)
ProcessPolicies/[field_name:"Privileged_Container"_values:<value:"true"_>__field_name:"Unexpected_Process_Executed"_values:<value:"true"_>_]-8                                                           3.969m ± 0%        3.288m ±  2%   -17.16% (p=0.000 n=30)
ProcessPolicies/[field_name:"Process_Name"_values:<value:"apt-get"_>__field_name:"Privileged_Container"_values:<value:"true"_>__field_name:"Unexpected_Process_Executed"_values:<value:"true"_>_]-8      2.018m ± 0%        1.017m ±  0%   -49.59% (p=0.000 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get/no_caching-8                                                                                                                                       363.2µ ± 0%        355.6µ ±  0%    -2.08% (p=0.000 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get/with_caching-8                                                                                                                                     81.70µ ± 0%        80.12µ ±  0%    -1.93% (p=0.000 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get2/no_caching-8                                                                                                                                      360.4µ ± 0%        354.1µ ±  0%    -1.73% (p=0.000 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get2/with_caching-8                                                                                                                                    81.86µ ± 0%        80.43µ ±  0%    -1.75% (p=0.000 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/curl/no_caching-8                                                                                                                                          3.410µ ± 0%        3.395µ ±  0%    -0.44% (p=0.012 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/curl/with_caching-8                                                                                                                                        2.448µ ± 0%        2.435µ ±  0%         ~ (p=0.084 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/bash/no_caching-8                                                                                                                                          3.419µ ± 0%        3.393µ ±  0%    -0.78% (p=0.018 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/bash/with_caching-8                                                                                                                                        2.456µ ± 0%        2.441µ ±  0%    -0.61% (p=0.014 n=30)
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get/no_caching-8                                                                                                                                    360.3µ ± 0%        356.8µ ±  0%    -0.95% (p=0.004 n=30)
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get/with_caching-8                                                                                                                                  81.27µ ± 0%        80.17µ ±  0%    -1.35% (p=0.001 n=30)
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get2/no_caching-8                                                                                                                                   7.363µ ± 0%        7.194µ ±  0%    -2.30% (p=0.000 n=30)
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get2/with_caching-8                                                                                                                                 6.358µ ± 0%        6.263µ ±  0%    -1.50% (p=0.000 n=30)
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/curl/no_caching-8                                                                                                                                       3.413µ ± 0%        3.384µ ±  0%    -0.85% (p=0.001 n=30)
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/curl/with_caching-8                                                                                                                                     2.442µ ± 0%        2.443µ ±  0%         ~ (p=0.652 n=30)
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/bash/no_caching-8                                                                                                                                       3.437µ ± 0%        3.391µ ±  0%    -1.32% (p=0.000 n=30)
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/bash/with_caching-8                                                                                                                                     2.471µ ± 0%        2.436µ ±  0%    -1.40% (p=0.000 n=30)
KeyFence-8                                                                                                                                                                                               24.04µ ± 0%        23.16µ ±  0%    -3.63% (p=0.000 n=30)
ValueStreamWrite-8                                                                                                                                                                                       322.3n ± 0%        309.7n ±  0%    -3.91% (p=0.000 n=30)
BufChanWrite-8                                                                                                                                                                                           32.56n ± 0%        31.92n ±  0%    -1.97% (p=0.000 n=30)
Buf1ChanWrite-8                                                                                                                                                                                          574.0n ± 0%        573.3n ±  0%         ~ (p=0.117 n=30)
UnbufChanWrite-8                                                                                                                                                                                         814.7n ± 0%        813.5n ±  0%         ~ (p=0.668 n=30)
SliceAppend-8                                                                                                                                                                                            30.65n ± 1%        29.25n ±  1%         ~ (p=0.350 n=30)
SliceAppendWithMutex-8                                                                                                                                                                                   341.6n ± 0%        338.0n ±  0%    -1.05% (p=0.009 n=30)
ValueStreamRead-8                                                                                                                                                                                        108.0n ± 0%        107.0n ±  0%    -0.93% (p=0.004 n=30)
ValueStreamReadAsync-8                                                                                                                                                                                   396.2n ± 0%        379.2n ±  0%    -4.28% (p=0.000 n=30)
BufChanRead-8                                                                                                                                                                                            89.89n ± 0%        89.73n ±  0%         ~ (p=0.090 n=30)
Buf1ChanRead-8                                                                                                                                                                                           804.2n ± 0%        805.9n ±  0%         ~ (p=0.965 n=30)
UnbufChanRead-8                                                                                                                                                                                          1.131µ ± 0%        1.124µ ±  0%    -0.57% (p=0.025 n=30)
SliceRead-8                                                                                                                                                                                              1.044n ± 0%        1.039n ±  0%         ~ (p=0.078 n=30)
SliceReadWithMutex-8                                                                                                                                                                                     283.2n ± 0%        281.9n ±  0%         ~ (p=0.110 n=30)
SortedKeys-8                                                                                                                                                                                             2.796µ ± 0%        2.737µ ±  0%    -2.09% (p=0.001 n=30)
CertFingerprintChoices/SHA-1-8                                                                                                                                                                           1.113µ ± 0%        1.092µ ±  0%    -1.93% (p=0.000 n=30)
CertFingerprintChoices/SHA-256-8                                                                                                                                                                         1.897µ ± 0%        1.897µ ±  0%         ~ (p=0.923 n=30)
CertFingerprintChoices/SHA-512-8                                                                                                                                                                         1.873µ ± 0%        1.848µ ±  0%    -1.36% (p=0.000 n=30)
CertFingerprintChoices/SHA-512_256-8                                                                                                                                                                     1.622µ ± 0%        1.596µ ±  0%    -1.60% (p=0.000 n=30)
Walk/walk-8                                                                                                                                                                                            0.01490n ± 0%      0.01464n ±  0%    -1.74% (p=0.010 n=30)
RateLimiter/NoLimit_NoThrottle-8                                                                                                                                                                         94.91n ± 0%        94.71n ±  0%    -0.22% (p=0.031 n=30)
RateLimiter/WithLimitHit_NoThrottle-8                                                                                                                                                                    124.9n ± 0%        123.9n ±  0%    -0.76% (p=0.000 n=30)
RateLimiter/WithLimitNoHit_NoThrottle-8                                                                                                                                                                  95.08n ± 0%        94.80n ±  0%    -0.30% (p=0.023 n=30)
RateLimiter/NoLimit_Throttle_1s-8                                                                                                                                                                        1.575µ ± 0%        1.549µ ±  0%    -1.68% (p=0.001 n=30)
RateLimiter/WithLimitHit_Throttle_1s-8                                                                                                                                                                   990.0m ± 0%        990.0m ±  0%         ~ (p=0.562 n=30)
RateLimiter/WithLimitNoHit_Throttle_1s-8                                                                                                                                                                 1.575µ ± 0%        1.528µ ±  0%    -2.98% (p=0.000 n=30)
NRadixTreeForIPv4/IPv4NRadixTree:Create-8                                                                                                                                                              0.05212n ± 0%      0.04960n ±  0%    -4.83% (p=0.000 n=30)
NRadixTreeForIPv4/IPv4NRadixTree:Get-8                                                                                                                                                                 0.07382n ± 0%      0.07171n ±  0%    -2.86% (p=0.001 n=30)
NRadixTreeForIPv4/IPv4NRadixTree:GetSupernet-8                                                                                                                                                         0.04605n ± 0%      0.04344n ±  0%    -5.66% (p=0.000 n=30)
NRadixTreeForIPv4/IPv4NRadixTree:GetSupernetForCIDR-8                                                                                                                                                  0.06268n ± 0%      0.06140n ±  0%    -2.05% (p=0.021 n=30)
NRadixTreeForIPv4/IPv4NRadixTree:GetSubnets-8                                                                                                                                                          0.06933n ± 0%      0.06681n ±  0%    -3.63% (p=0.000 n=30)
NRadixTreeForIPv4/IPv4NRadixTree:GetSubnetsForCIDR-8                                                                                                                                                   0.06725n ± 0%      0.06524n ±  0%    -3.00% (p=0.002 n=30)
NRadixTreeForIPv4/IPv4NRadixTree:Insert-8                                                                                                                                                              0.07140n ± 0%      0.07102n ±  0%         ~ (p=0.866 n=30)
NRadixTreeForIPv6/IPv6NRadixTree:Create-8                                                                                                                                                               0.1779n ± 0%       0.1726n ±  0%    -2.92% (p=0.000 n=30)
NRadixTreeForIPv6/IPv6NRadixTree:Get-8                                                                                                                                                                 0.07657n ± 0%      0.07406n ±  0%    -3.28% (p=0.000 n=30)
NRadixTreeForIPv6/IPv6NRadixTree:GetSupernet-8                                                                                                                                                         0.07010n ± 0%      0.06830n ±  0%    -2.57% (p=0.010 n=30)
NRadixTreeForIPv6/IPv6NRadixTree:GetSupernetForCIDR-8                                                                                                                                                  0.10065n ± 0%      0.09674n ±  0%    -3.89% (p=0.000 n=30)
NRadixTreeForIPv6/IPv6NRadixTree:GetSubnets-8                                                                                                                                                           0.1635n ± 0%       0.1572n ±  0%    -3.88% (p=0.000 n=30)
NRadixTreeForIPv6/IPv6NRadixTree:GetSubnetsForCIDR-8                                                                                                                                                    0.1847n ± 0%       0.1788n ±  0%    -3.22% (p=0.000 n=30)
NRadixTreeForIPv6/IPv6NRadixTree:Insert-8                                                                                                                                                               0.1988n ± 0%       0.1921n ±  0%    -3.37% (p=0.000 n=30)
GoGoProtoClone-8                                                                                                                                                                                         168.5µ ± 0%        163.8µ ±  0%    -2.79% (p=0.000 n=30)
GolangProtoClone-8                                                                                                                                                                                       554.9µ ± 0%        520.6µ ±  0%    -6.17% (p=0.000 n=30)
AutogeneratedClone-8                                                                                                                                                                                     172.7µ ± 0%        162.8µ ±  0%    -5.73% (p=0.000 n=30)
ReplaceVars/short-8                                                                                                                                                                                      601.4n ± 0%        603.4n ±  0%         ~ (p=0.171 n=30)
ReplaceVars/long-8                                                                                                                                                                                       80.21µ ± 0%        80.10µ ±  0%         ~ (p=0.130 n=30)
IntSet-8                                                                                                                                                                                                 525.7µ ± 0%        492.5µ ±  0%    -6.30% (p=0.000 n=30)
StringSet-8                                                                                                                                                                                              856.9µ ± 0%        784.3µ ±  0%    -8.48% (p=0.000 n=30)
VerifyAgainstSignatureIntegrations_1Integration-8                                                                                                                                                        151.4µ ± 0%        149.0µ ±  0%    -1.62% (p=0.000 n=30)
VerifyAgainstSignatureIntegrations_10Integrations-8                                                                                                                                                      1.385m ± 0%        1.354m ±  0%    -2.23% (p=0.000 n=30)
VerifyAgainstSignatureIntegrations_100Integrations-8                                                                                                                                                     13.73m ± 0%        13.65m ±  0%    -0.61% (p=0.010 n=30)
VerifyAgainstSignatureIntegrations_200Integrations-8                                                                                                                                                     27.60m ± 0%        27.22m ±  0%    -1.35% (p=0.004 n=30)
geomean                                                                                                                                                                                                  224.0µ             220.3µ          -1.65%
¹ benchmarks vary in networkgraph/entity/datastore

                                                                                                                                                                                                    │   master.txt    │                new-5.5.txt                │
                                                                                                                                                                                                    │      B/op       │     B/op      vs base                     │
Datastore_Add_and_Flush/add_1000_events_to_the_writer_and_flush_it-8                                                                                                                                   2.596Mi ± 0%     3.153Mi ± 0%  +21.44% (p=0.000 n=30)
Datastore_Add_and_Flush/add_5000_events_to_the_writer_and_flush_it-8                                                                                                                                   16.17Mi ± 0%     20.49Mi ± 0%  +26.66% (p=0.000 n=30)
Datastore_Add_and_Flush/add_10000_events_to_the_writer_and_flush_it-8                                                                                                                                  32.38Mi ± 0%     41.00Mi ± 0%  +26.62% (p=0.000 n=30)
Datastore_Add_and_Flush/add_20000_events_to_the_writer_and_flush_it-8                                                                                                                                  64.75Mi ± 0%     81.67Mi ± 0%  +26.13% (p=0.000 n=30)
AlertDatabaseOps/searchWithStringHighlighted-8                                                                                                                                                         1.283Mi ± 0%     1.090Mi ± 0%  -15.07% (p=0.000 n=30)
AlertDatabaseOps/searchWithoutHighlighted_(aka_get_IDs_only)-8                                                                                                                                         373.3Ki ± 0%     327.3Ki ± 0%  -12.31% (p=0.000 n=30)
AlertDatabaseOps/searchWithRawListAlert-8                                                                                                                                                              8.960Mi ± 0%     8.862Mi ± 0%   -1.09% (p=0.000 n=30)
AlertDatabaseOps/markResolvedBatch-8                                                                                                                                                                   12.74Mi ± 0%     14.29Mi ± 0%  +12.19% (p=0.000 n=30)
GetMany/1_alerts-8                                                                                                                                                                                     11.32Ki ± 0%     11.52Ki ± 0%   +1.79% (p=0.000 n=30)
GetMany/2_alerts-8                                                                                                                                                                                     19.02Ki ± 0%     18.91Ki ± 0%   -0.59% (p=0.000 n=30)
GetMany/4_alerts-8                                                                                                                                                                                     34.40Ki ± 0%     33.69Ki ± 0%   -2.06% (p=0.000 n=30)
GetMany/8_alerts-8                                                                                                                                                                                     65.17Ki ± 0%     64.02Ki ± 0%   -1.76% (p=0.000 n=30)
GetMany/16_alerts-8                                                                                                                                                                                    128.3Ki ± 0%     125.0Ki ± 0%   -2.62% (p=0.000 n=30)
GetMany/32_alerts-8                                                                                                                                                                                    253.2Ki ± 0%     248.1Ki ± 0%   -2.00% (p=0.000 n=30)
GetMany/64_alerts-8                                                                                                                                                                                    504.5Ki ± 0%     493.6Ki ± 0%   -2.16% (p=0.000 n=30)
GetMany/128_alerts-8                                                                                                                                                                                  1007.0Ki ± 0%     984.5Ki ± 0%   -2.23% (p=0.000 n=30)
GetMany/256_alerts-8                                                                                                                                                                                   1.963Mi ± 0%     1.932Mi ± 0%   -1.58% (p=0.000 n=30)
GetMany/512_alerts-8                                                                                                                                                                                   3.932Mi ± 0%     3.850Mi ± 0%   -2.10% (p=0.000 n=30)
GetMany/1024_alerts-8                                                                                                                                                                                  7.861Mi ± 0%     7.717Mi ± 0%   -1.83% (p=0.000 n=30)
GetMany/2048_alerts-8                                                                                                                                                                                  15.78Mi ± 0%     15.74Mi ± 0%   -0.23% (p=0.000 n=30)
AggregatedResults-8                                                                                                                                                                                    1.965Ki ± 0%     1.965Ki ± 0%        ~ (p=0.557 n=30)
SearchAllDeployments/SearchRetrievalList-8                                                                                                                                                             4.499Mi ± 0%     4.690Mi ± 0%   +4.23% (p=0.000 n=30)
SearchAllDeployments/SearchRetrievalFull-8                                                                                                                                                             4.354Mi ± 0%     4.546Mi ± 0%   +4.40% (p=0.000 n=30)
DefaultPolicies-8                                                                                                                                                                                      2.841Mi ± 0%     2.842Mi ± 0%        ~ (p=0.540 n=30)
ImageResolver/GetImageComponentsInImageScanResolver-8                                                                                                                                                  23.87Mi ± 0%     23.87Mi ± 0%        ~ (p=0.070 n=30)
ImageResolver/GetImageComponentsWithoutImageScanResolver-8                                                                                                                                             102.0Mi ± 0%     101.6Mi ± 0%   -0.40% (p=0.000 n=30)
ImageResolver/GetImageComponentsDerivedFieldsWithImageScanResolver-8                                                                                                                                   42.02Mi ± 0%     42.02Mi ± 0%        ~ (p=0.230 n=30)
ImageResolver/GetImageComponentsDerivedWithoutImageScanResolver-8                                                                                                                                      664.1Mi ± 0%     663.5Mi ± 0%   -0.09% (p=0.000 n=30)
ImageResolver/GetImageOnly-8                                                                                                                                                                           46.04Ki ± 0%     45.76Ki ± 0%   -0.61% (p=0.000 n=30)
ImageResolver/GetImageWithCounts-8                                                                                                                                                                     1.409Mi ± 0%     1.410Mi ± 0%   +0.07% (p=0.000 n=30)
ImageResolver/GetImageScanTimeTopLevel-8                                                                                                                                                               66.00Ki ± 0%     65.71Ki ± 0%   -0.43% (p=0.000 n=30)
ImageResolver/GetImageScanTimeNested-8                                                                                                                                                                 80.94Ki ± 0%     80.65Ki ± 0%   -0.35% (p=0.000 n=30)
NodeResolver/GetNodeComponentsInNodeScanResolver-8                                                                                                                                                     25.65Mi ± 0%     25.65Mi ± 0%        ~ (p=0.654 n=30)
NodeResolver/GetNodeComponentsWithoutNodeScanResolver-8                                                                                                                                                101.5Mi ± 0%     102.1Mi ± 0%   +0.56% (p=0.000 n=30)
NodeResolver/GetNodeComponentsDerivedFieldsWithNodeScanResolver-8                                                                                                                                      43.72Mi ± 0%     43.71Mi ± 0%        ~ (p=0.592 n=30)
NodeResolver/GetNodeComponentsDerivedWithoutNodeScanResolver-8                                                                                                                                         590.5Mi ± 0%     596.3Mi ± 0%   +0.99% (p=0.000 n=30)
NodeResolver/GetNodeOnly-8                                                                                                                                                                             52.16Ki ± 0%     51.02Ki ± 0%   -2.17% (p=0.000 n=30)
NodeResolver/GetNodeWithCounts-8                                                                                                                                                                       1.363Mi ± 0%     1.382Mi ± 0%   +1.41% (p=0.000 n=30)
ImageGetMany/GetImagesBatch-8                                                                                                                                                                          9.260Mi ± 0%     9.358Mi ± 0%   +1.06% (p=0.000 n=30)
ImageGetMany/GetManyImageMetadata-8                                                                                                                                                                    655.3Ki ± 0%     632.1Ki ± 0%   -3.54% (p=0.000 n=30)
InitFromStore/New-8                                                                                                                                                                                    16.13Mi ± 0%     16.80Mi ± 0%   +4.15% (p=0.000 n=30)
NetEntityCreates/createNetworkEntities-8                                                                                                                                                               85.11Mi ± 0% ¹   81.06Mi ± 0%   -4.76% (p=0.000 n=30)
NetEntityCreateBatch/createNetworkEntitiesBatch-8                                                                                                                                                      78.64Mi ± 0%     74.67Mi ± 0%   -5.05% (p=0.000 n=30)
NetEntityUpdates/updateNetworkEntities-8                                                                                                                                                               73.76Mi ± 0%     69.70Mi ± 0%   -5.50% (p=0.000 n=30)
CreateNetworkTree/insertIntoNetworkTree-8                                                                                                                                                                0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
EvaluateCluster/_BenchmarkEvaluateCluster_-_1_deployments;_1_policies-8                                                                                                                                4.242Ki ± 0%     4.242Ki ± 0%        ~ (p=1.000 n=30)    ²
EvaluateCluster/_BenchmarkEvaluateCluster_-_1_deployments;_10_policies-8                                                                                                                               8.391Ki ± 0%     8.391Ki ± 0%        ~ (p=1.000 n=30)    ²
EvaluateCluster/_BenchmarkEvaluateCluster_-_1_deployments;_100_policies-8                                                                                                                              49.88Ki ± 0%     49.88Ki ± 0%        ~ (p=1.000 n=30)    ²
EvaluateCluster/_BenchmarkEvaluateCluster_-_10_deployments;_1_policies-8                                                                                                                               9.385Ki ± 0%     9.385Ki ± 0%        ~ (p=0.142 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_10_deployments;_10_policies-8                                                                                                                              13.53Ki ± 0%     13.53Ki ± 0%        ~ (p=0.052 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_10_deployments;_100_policies-8                                                                                                                             55.02Ki ± 0%     55.02Ki ± 0%        ~ (p=0.759 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_100_deployments;_1_policies-8                                                                                                                              63.85Ki ± 0%     63.85Ki ± 0%        ~ (p=0.316 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_100_deployments;_10_policies-8                                                                                                                             67.99Ki ± 0%     67.99Ki ± 0%        ~ (p=0.778 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_100_deployments;_100_policies-8                                                                                                                            109.5Ki ± 0%     109.5Ki ± 0%        ~ (p=0.923 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_1000_deployments;_1_policies-8                                                                                                                             671.9Ki ± 0%     671.9Ki ± 0%        ~ (p=0.416 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_1000_deployments;_10_policies-8                                                                                                                            676.1Ki ± 0%     676.1Ki ± 0%        ~ (p=0.888 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_1000_deployments;_100_policies-8                                                                                                                           717.6Ki ± 0%     717.6Ki ± 0%        ~ (p=0.679 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_200_ingress_allowed_per_policy_200_egress_allowed_per_policy-8                                                                     4.684Mi ± 0%     4.684Mi ± 0%        ~ (p=0.137 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_200_ingress_allowed_per_policy_1000_egress_allowed_per_policy-8                                                                    824.9Mi ± 0%     824.9Mi ± 0%        ~ (p=0.273 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_200_ingress_allowed_per_policy_2000_egress_allowed_per_policy-8                                                                    825.4Mi ± 0%     825.4Mi ± 0%        ~ (p=0.854 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_1000_ingress_allowed_per_policy_200_egress_allowed_per_policy-8                                                                    1.307Gi ± 0%     1.307Gi ± 0%        ~ (p=0.797 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_1000_ingress_allowed_per_policy_1000_egress_allowed_per_policy-8                                                                   1.307Gi ± 0%     1.307Gi ± 0%        ~ (p=0.959 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_1000_ingress_allowed_per_policy_2000_egress_allowed_per_policy-8                                                                   1.924Gi ± 0%     1.924Gi ± 0%        ~ (p=0.947 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_2000_ingress_allowed_per_policy_200_egress_allowed_per_policy-8                                                                    1.322Gi ± 0%     1.322Gi ± 0%        ~ (p=0.106 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_2000_ingress_allowed_per_policy_1000_egress_allowed_per_policy-8                                                                   1.939Gi ± 0%     1.323Gi ± 0%        ~ (p=0.109 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_2000_ingress_allowed_per_policy_2000_egress_allowed_per_policy-8                                                                   1.940Gi ± 0%     1.940Gi ± 0%        ~ (p=0.878 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_1_policies_each_applied_to_1_nodes-8                                                                                                      6.296Mi ± 0%     6.296Mi ± 0%        ~ (p=0.582 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_1_policies_each_applied_to_10_nodes-8                                                                                                     6.298Mi ± 0%     6.297Mi ± 0%        ~ (p=0.206 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_1_policies_each_applied_to_100_nodes-8                                                                                                    6.306Mi ± 0%     6.306Mi ± 0%        ~ (p=0.520 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_10_policies_each_applied_to_1_nodes-8                                                                                                     6.342Mi ± 0%     6.342Mi ± 0%        ~ (p=0.237 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_10_policies_each_applied_to_10_nodes-8                                                                                                    6.351Mi ± 0%     6.351Mi ± 0%        ~ (p=0.139 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_10_policies_each_applied_to_100_nodes-8                                                                                                   6.437Mi ± 0%     6.437Mi ± 0%        ~ (p=0.610 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_100_policies_each_applied_to_1_nodes-8                                                                                                    6.800Mi ± 0%     6.798Mi ± 0%        ~ (p=0.135 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_100_policies_each_applied_to_10_nodes-8                                                                                                   7.101Mi ± 0%     7.077Mi ± 0%        ~ (p=0.786 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_100_policies_each_applied_to_100_nodes-8                                                                                                  25.92Mi ± 0%     26.47Mi ± 2%        ~ (p=0.582 n=30)
GetManyNodes/GetNodesBatch-8                                                                                                                                                                           7.485Mi ± 0%     7.672Mi ± 0%   +2.50% (p=0.000 n=30)
GetManyNodes/GetManyNodeMetadata-8                                                                                                                                                                     254.0Ki ± 0%     285.8Ki ± 0%  +12.54% (p=0.000 n=30)
Nodes/upsertNodeWithOldScan-8                                                                                                                                                                          8.565Ki ± 0%     9.890Ki ± 0%  +15.46% (p=0.000 n=30)
Nodes/upsertNodeWithNewScan-8                                                                                                                                                                          8.568Ki ± 0%     9.894Ki ± 0%  +15.48% (p=0.000 n=30)
Nodes/searchAll-8                                                                                                                                                                                        0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
Nodes/searchForCluster-8                                                                                                                                                                                 0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
Nodes/deleteForClusters-8                                                                                                                                                                              12.34Ki ± 0%     12.75Ki ± 0%   +3.28% (p=0.000 n=30)
AddIndicator-8                                                                                                                                                                                         1.974Mi ± 0%     3.340Mi ± 0%  +69.16% (p=0.000 n=25+23)
RabbitMQPruning-8                                                                                                                                                                                      1.886Gi ± 0%     1.886Gi ± 0%        ~ (p=0.467 n=30)
GetBindingsAndRoles/run_get_bindings_and_roles-8                                                                                                                                                       21.80Ki ± 0%     22.09Ki ± 0%   +1.35% (p=0.000 n=30)
Collections/DryRunAddCollection-8                                                                                                                                                                      2.451Mi ± 0%     2.451Mi ± 0%        ~ (p=0.663 n=30)
Collections/DryRunUpdateCollection-8                                                                                                                                                                   2.455Mi ± 0%     2.455Mi ± 0%        ~ (p=0.620 n=30)
Collections/UpdateCollection-8                                                                                                                                                                         2.730Mi ± 0%     2.728Mi ± 0%   -0.06% (p=0.003 n=30)
Collections/graphInit-8                                                                                                                                                                                9.998Mi ± 0%     9.588Mi ± 0%   -4.11% (p=0.000 n=30)
Collections/AddCollection-8                                                                                                                                                                            3.381Mi ± 0%     3.533Mi ± 0%        ~ (p=0.146 n=30)
GenerateViolationId-8                                                                                                                                                                                  2.708Ki ± 0%     2.708Ki ± 0%        ~ (p=1.000 n=30)    ²
Create/create-8                                                                                                                                                                                        28.02Ki ± 0%     28.02Ki ± 0%        ~ (p=0.177 n=30)
ProcessPolicies/[field_name:"Process_Name"_values:<value:"apt-get"_>_]-8                                                                                                                               269.8Ki ± 0%     269.8Ki ± 0%        ~ (p=0.451 n=30)
ProcessPolicies/[field_name:"Unexpected_Process_Executed"_values:<value:"true"_>_]-8                                                                                                                   448.3Ki ± 0%     448.3Ki ± 0%        ~ (p=0.813 n=30)
ProcessPolicies/[field_name:"Privileged_Container"_values:<value:"true"_>_]-8                                                                                                                          519.0Ki ± 0%     519.0Ki ± 0%        ~ (p=0.078 n=30)
ProcessPolicies/[field_name:"Process_Name"_values:<value:"apt-get"_>__field_name:"Unexpected_Process_Executed"_values:<value:"true"_>_]-8                                                              234.1Ki ± 0%     234.1Ki ± 0%        ~ (p=0.329 n=30)
ProcessPolicies/[field_name:"Process_Name"_values:<value:"apt-get"_>__field_name:"Privileged_Container"_values:<value:"true"_>_]-8                                                                     283.1Ki ± 0%     283.1Ki ± 0%        ~ (p=0.363 n=30)
ProcessPolicies/[field_name:"Privileged_Container"_values:<value:"true"_>__field_name:"Unexpected_Process_Executed"_values:<value:"true"_>_]-8                                                         428.3Ki ± 0%     428.3Ki ± 0%        ~ (p=0.717 n=30)
ProcessPolicies/[field_name:"Process_Name"_values:<value:"apt-get"_>__field_name:"Privileged_Container"_values:<value:"true"_>__field_name:"Unexpected_Process_Executed"_values:<value:"true"_>_]-8    233.8Ki ± 0%     233.8Ki ± 0%        ~ (p=0.906 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get/no_caching-8                                                                                                                                     80.98Ki ± 0%     80.98Ki ± 0%        ~ (p=0.189 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get/with_caching-8                                                                                                                                   16.63Ki ± 0%     16.63Ki ± 0%        ~ (p=0.454 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get2/no_caching-8                                                                                                                                    80.98Ki ± 0%     80.98Ki ± 0%        ~ (p=0.403 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get2/with_caching-8                                                                                                                                  16.63Ki ± 0%     16.63Ki ± 0%        ~ (p=0.423 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/curl/no_caching-8                                                                                                                                          801.0 ± 0%       801.0 ± 0%        ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_PRIVILEGED/curl/with_caching-8                                                                                                                                        448.0 ± 0%       448.0 ± 0%        ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_PRIVILEGED/bash/no_caching-8                                                                                                                                          801.0 ± 0%       801.0 ± 0%        ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_PRIVILEGED/bash/with_caching-8                                                                                                                                        448.0 ± 0%       448.0 ± 0%        ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get/no_caching-8                                                                                                                                  80.98Ki ± 0%     80.98Ki ± 0%        ~ (p=0.441 n=30)
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get/with_caching-8                                                                                                                                16.63Ki ± 0%     16.63Ki ± 0%        ~ (p=0.085 n=30)
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get2/no_caching-8                                                                                                                                 1.641Ki ± 0%     1.641Ki ± 0%        ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get2/with_caching-8                                                                                                                               1.294Ki ± 0%     1.294Ki ± 0%        ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/curl/no_caching-8                                                                                                                                       801.0 ± 0%       801.0 ± 0%        ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/curl/with_caching-8                                                                                                                                     448.0 ± 0%       448.0 ± 0%        ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/bash/no_caching-8                                                                                                                                       801.0 ± 0%       801.0 ± 0%        ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/bash/with_caching-8                                                                                                                                     448.0 ± 0%       448.0 ± 0%        ~ (p=1.000 n=30)    ²
KeyFence-8                                                                                                                                                                                             3.455Ki ± 0%     3.462Ki ± 0%   +0.21% (p=0.000 n=30)
ValueStreamWrite-8                                                                                                                                                                                       120.0 ± 0%       120.0 ± 0%        ~ (p=1.000 n=30)    ²
BufChanWrite-8                                                                                                                                                                                           0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
Buf1ChanWrite-8                                                                                                                                                                                          0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
UnbufChanWrite-8                                                                                                                                                                                         0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
SliceAppend-8                                                                                                                                                                                            44.50 ± 1%       44.00 ± 0%        ~ (p=0.688 n=30)
SliceAppendWithMutex-8                                                                                                                                                                                   46.00 ± 0%       45.00 ± 0%        ~ (p=0.113 n=30)
ValueStreamRead-8                                                                                                                                                                                        0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
ValueStreamReadAsync-8                                                                                                                                                                                   119.0 ± 0%       119.0 ± 0%        ~ (p=0.499 n=30)
BufChanRead-8                                                                                                                                                                                            0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
Buf1ChanRead-8                                                                                                                                                                                           0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
UnbufChanRead-8                                                                                                                                                                                          0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
SliceRead-8                                                                                                                                                                                              0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
SliceReadWithMutex-8                                                                                                                                                                                     0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
SortedKeys-8                                                                                                                                                                                           1.281Ki ± 0%     1.281Ki ± 0%        ~ (p=1.000 n=30)    ²
CertFingerprintChoices/SHA-1-8                                                                                                                                                                           128.0 ± 0%       128.0 ± 0%        ~ (p=1.000 n=30)    ²
CertFingerprintChoices/SHA-256-8                                                                                                                                                                         192.0 ± 0%       192.0 ± 0%        ~ (p=1.000 n=30)    ²
CertFingerprintChoices/SHA-512-8                                                                                                                                                                         384.0 ± 0%       384.0 ± 0%        ~ (p=1.000 n=30)    ²
CertFingerprintChoices/SHA-512_256-8                                                                                                                                                                     192.0 ± 0%       192.0 ± 0%        ~ (p=1.000 n=30)    ²
Walk/walk-8                                                                                                                                                                                              0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
RateLimiter/NoLimit_NoThrottle-8                                                                                                                                                                         0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
RateLimiter/WithLimitHit_NoThrottle-8                                                                                                                                                                    0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
RateLimiter/WithLimitNoHit_NoThrottle-8                                                                                                                                                                  0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
RateLimiter/NoLimit_Throttle_1s-8                                                                                                                                                                        336.0 ± 0%       336.0 ± 0%        ~ (p=1.000 n=30)    ²
RateLimiter/WithLimitHit_Throttle_1s-8                                                                                                                                                                   550.0 ± 0%       550.0 ± 0%        ~ (p=0.655 n=30)
RateLimiter/WithLimitNoHit_Throttle_1s-8                                                                                                                                                                 336.0 ± 0%       336.0 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:Create-8                                                                                                                                                                0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:Get-8                                                                                                                                                                   0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:GetSupernet-8                                                                                                                                                           0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:GetSupernetForCIDR-8                                                                                                                                                    0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:GetSubnets-8                                                                                                                                                            0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:GetSubnetsForCIDR-8                                                                                                                                                     0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:Insert-8                                                                                                                                                                0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:Create-8                                                                                                                                                                0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:Get-8                                                                                                                                                                   0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:GetSupernet-8                                                                                                                                                           0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:GetSupernetForCIDR-8                                                                                                                                                    0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:GetSubnets-8                                                                                                                                                            0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:GetSubnetsForCIDR-8                                                                                                                                                     0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:Insert-8                                                                                                                                                                0.000 ± 0%       0.000 ± 0%        ~ (p=1.000 n=30)    ²
GoGoProtoClone-8                                                                                                                                                                                       77.54Ki ± 0%     77.54Ki ± 0%        ~ (p=0.784 n=30)
GolangProtoClone-8                                                                                                                                                                                     465.6Ki ± 0%     465.6Ki ± 0%        ~ (p=0.077 n=30)
AutogeneratedClone-8                                                                                                                                                                                   77.54Ki ± 0%     77.54Ki ± 0%        ~ (p=0.126 n=30)
ReplaceVars/short-8                                                                                                                                                                                      96.00 ± 0%       96.00 ± 0%        ~ (p=1.000 n=30)    ²
ReplaceVars/long-8                                                                                                                                                                                     15.07Ki ± 0%     15.07Ki ± 0%        ~ (p=1.000 n=30)    ²
IntSet-8                                                                                                                                                                                               47.21Ki ± 1%     46.21Ki ± 0%   -2.13% (p=0.006 n=30)
StringSet-8                                                                                                                                                                                            76.11Ki ± 0%     72.89Ki ± 0%   -4.23% (p=0.000 n=30)
VerifyAgainstSignatureIntegrations_1Integration-8                                                                                                                                                      6.955Ki ± 0%     6.954Ki ± 0%        ~ (p=0.445 n=30)
VerifyAgainstSignatureIntegrations_10Integrations-8                                                                                                                                                    53.97Ki ± 0%     53.97Ki ± 0%   +0.00% (p=0.001 n=30)
VerifyAgainstSignatureIntegrations_100Integrations-8                                                                                                                                                   539.2Ki ± 0%     539.2Ki ± 0%        ~ (p=0.865 n=30)
VerifyAgainstSignatureIntegrations_200Integrations-8                                                                                                                                                   1.053Mi ± 0%     1.053Mi ± 0%        ~ (p=0.425 n=30)
geomean                                                                                                                                                                                                             ³                  +0.61%                   ³
¹ benchmarks vary in networkgraph/entity/datastore
² all samples are equal
³ summaries must be >0 to compute geomean

                                                                                                                                                                                                    │  master.txt   │                new-5.5.txt                 │
                                                                                                                                                                                                    │   allocs/op   │  allocs/op    vs base                      │
Datastore_Add_and_Flush/add_1000_events_to_the_writer_and_flush_it-8                                                                                                                                  32.63k ± 0%      46.85k ± 0%   +43.59% (p=0.000 n=30)
Datastore_Add_and_Flush/add_5000_events_to_the_writer_and_flush_it-8                                                                                                                                  216.5k ± 0%      324.2k ± 0%   +49.76% (p=0.000 n=30)
Datastore_Add_and_Flush/add_10000_events_to_the_writer_and_flush_it-8                                                                                                                                 432.9k ± 0%      648.4k ± 0%   +49.77% (p=0.000 n=30)
Datastore_Add_and_Flush/add_20000_events_to_the_writer_and_flush_it-8                                                                                                                                 865.7k ± 0%     1296.6k ± 0%   +49.77% (p=0.000 n=30)
AlertDatabaseOps/searchWithStringHighlighted-8                                                                                                                                                        23.39k ± 0%      23.38k ± 0%    -0.07% (p=0.000 n=30)
AlertDatabaseOps/searchWithoutHighlighted_(aka_get_IDs_only)-8                                                                                                                                        3.270k ± 0%      3.265k ± 0%    -0.15% (p=0.000 n=30)
AlertDatabaseOps/searchWithRawListAlert-8                                                                                                                                                             195.4k ± 0%      196.2k ± 0%    +0.41% (p=0.000 n=30)
AlertDatabaseOps/markResolvedBatch-8                                                                                                                                                                  242.5k ± 0%      292.3k ± 0%   +20.57% (p=0.000 n=30)
GetMany/1_alerts-8                                                                                                                                                                                     160.0 ± 0%       184.0 ± 0%   +15.00% (p=0.000 n=30)
GetMany/2_alerts-8                                                                                                                                                                                     257.0 ± 0%       284.0 ± 0%   +10.51% (p=0.000 n=30)
GetMany/4_alerts-8                                                                                                                                                                                     451.0 ± 0%       483.0 ± 0%    +7.10% (p=0.000 n=30)
GetMany/8_alerts-8                                                                                                                                                                                     837.0 ± 0%       882.0 ± 0%    +5.38% (p=0.000 n=30)
GetMany/16_alerts-8                                                                                                                                                                                   1.612k ± 0%      1.677k ± 0%    +4.03% (p=0.000 n=30)
GetMany/32_alerts-8                                                                                                                                                                                   3.156k ± 0%      3.265k ± 0%    +3.45% (p=0.000 n=30)
GetMany/64_alerts-8                                                                                                                                                                                   6.242k ± 0%      6.438k ± 0%    +3.14% (p=0.000 n=30)
GetMany/128_alerts-8                                                                                                                                                                                  12.41k ± 0%      12.78k ± 0%    +2.96% (p=0.000 n=30)
GetMany/256_alerts-8                                                                                                                                                                                  24.75k ± 0%      25.46k ± 0%    +2.88% (p=0.000 n=30)
GetMany/512_alerts-8                                                                                                                                                                                  49.41k ± 0%      50.80k ± 0%    +2.82% (p=0.000 n=30)
GetMany/1024_alerts-8                                                                                                                                                                                 98.74k ± 0%     101.50k ± 0%    +2.80% (p=0.000 n=30)
GetMany/2048_alerts-8                                                                                                                                                                                 197.4k ± 0%      202.9k ± 0%    +2.79% (p=0.000 n=30)
AggregatedResults-8                                                                                                                                                                                    21.00 ± 0%       21.00 ± 0%         ~ (p=0.570 n=30)
SearchAllDeployments/SearchRetrievalList-8                                                                                                                                                            72.35k ± 0%      75.31k ± 0%    +4.08% (p=0.000 n=30)
SearchAllDeployments/SearchRetrievalFull-8                                                                                                                                                            71.35k ± 0%      74.31k ± 0%    +4.14% (p=0.000 n=30)
DefaultPolicies-8                                                                                                                                                                                     43.57k ± 0%      43.57k ± 0%     0.00% (p=0.036 n=30)
ImageResolver/GetImageComponentsInImageScanResolver-8                                                                                                                                                 447.6k ± 0%      447.6k ± 0%         ~ (p=0.209 n=30)
ImageResolver/GetImageComponentsWithoutImageScanResolver-8                                                                                                                                            1.345M ± 0%      1.346M ± 0%    +0.13% (p=0.000 n=30)
ImageResolver/GetImageComponentsDerivedFieldsWithImageScanResolver-8                                                                                                                                  705.2k ± 0%      705.2k ± 0%         ~ (p=0.167 n=30)
ImageResolver/GetImageComponentsDerivedWithoutImageScanResolver-8                                                                                                                                     8.102M ± 0%      8.162M ± 0%    +0.74% (p=0.000 n=30)
ImageResolver/GetImageOnly-8                                                                                                                                                                           831.0 ± 0%       834.0 ± 0%    +0.36% (p=0.000 n=30)
ImageResolver/GetImageWithCounts-8                                                                                                                                                                    15.27k ± 0%      15.39k ± 0%    +0.76% (p=0.000 n=30)
ImageResolver/GetImageScanTimeTopLevel-8                                                                                                                                                              1.315k ± 0%      1.318k ± 0%    +0.23% (p=0.000 n=30)
ImageResolver/GetImageScanTimeNested-8                                                                                                                                                                1.795k ± 0%      1.798k ± 0%    +0.17% (p=0.000 n=30)
NodeResolver/GetNodeComponentsInNodeScanResolver-8                                                                                                                                                    457.9k ± 0%      457.9k ± 0%         ~ (p=0.515 n=30)
NodeResolver/GetNodeComponentsWithoutNodeScanResolver-8                                                                                                                                               1.332M ± 0%      1.370M ± 0%    +2.85% (p=0.000 n=30)
NodeResolver/GetNodeComponentsDerivedFieldsWithNodeScanResolver-8                                                                                                                                     715.3k ± 0%      715.2k ± 0%         ~ (p=0.918 n=30)
NodeResolver/GetNodeComponentsDerivedWithoutNodeScanResolver-8                                                                                                                                        7.654M ± 0%      7.969M ± 0%    +4.12% (p=0.000 n=30)
NodeResolver/GetNodeOnly-8                                                                                                                                                                             835.0 ± 0%       837.0 ± 0%    +0.24% (p=0.000 n=30)
NodeResolver/GetNodeWithCounts-8                                                                                                                                                                      15.14k ± 0%      16.00k ± 0%    +5.70% (p=0.000 n=30)
ImageGetMany/GetImagesBatch-8                                                                                                                                                                         105.0k ± 0%      114.8k ± 0%    +9.31% (p=0.000 n=30)
ImageGetMany/GetManyImageMetadata-8                                                                                                                                                                   9.588k ± 0%      9.571k ± 0%    -0.18% (p=0.000 n=30)
InitFromStore/New-8                                                                                                                                                                                   256.9k ± 0%      289.0k ± 0%   +12.48% (p=0.000 n=30)
NetEntityCreates/createNetworkEntities-8                                                                                                                                                              1.558M ± 0% ¹    1.511M ± 0%    -3.03% (p=0.000 n=30)
NetEntityCreateBatch/createNetworkEntitiesBatch-8                                                                                                                                                     1.391M ± 0%      1.343M ± 0%    -3.42% (p=0.000 n=30)
NetEntityUpdates/updateNetworkEntities-8                                                                                                                                                              1.401M ± 0%      1.370M ± 0%    -2.16% (p=0.000 n=30)
CreateNetworkTree/insertIntoNetworkTree-8                                                                                                                                                              0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
EvaluateCluster/_BenchmarkEvaluateCluster_-_1_deployments;_1_policies-8                                                                                                                                56.00 ± 0%       56.00 ± 0%         ~ (p=1.000 n=30)    ²
EvaluateCluster/_BenchmarkEvaluateCluster_-_1_deployments;_10_policies-8                                                                                                                               101.0 ± 0%       101.0 ± 0%         ~ (p=1.000 n=30)    ²
EvaluateCluster/_BenchmarkEvaluateCluster_-_1_deployments;_100_policies-8                                                                                                                              551.0 ± 0%       551.0 ± 0%         ~ (p=1.000 n=30)    ²
EvaluateCluster/_BenchmarkEvaluateCluster_-_10_deployments;_1_policies-8                                                                                                                               126.0 ± 0%       126.0 ± 0%         ~ (p=1.000 n=30)    ²
EvaluateCluster/_BenchmarkEvaluateCluster_-_10_deployments;_10_policies-8                                                                                                                              171.0 ± 0%       171.0 ± 0%         ~ (p=1.000 n=30)    ²
EvaluateCluster/_BenchmarkEvaluateCluster_-_10_deployments;_100_policies-8                                                                                                                             621.0 ± 0%       621.0 ± 0%         ~ (p=1.000 n=30)    ²
EvaluateCluster/_BenchmarkEvaluateCluster_-_100_deployments;_1_policies-8                                                                                                                              774.0 ± 0%       774.0 ± 0%         ~ (p=1.000 n=30)    ²
EvaluateCluster/_BenchmarkEvaluateCluster_-_100_deployments;_10_policies-8                                                                                                                             819.0 ± 0%       819.0 ± 0%         ~ (p=0.334 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_100_deployments;_100_policies-8                                                                                                                           1.269k ± 0%      1.269k ± 0%         ~ (p=0.499 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_1000_deployments;_1_policies-8                                                                                                                            7.127k ± 0%      7.127k ± 0%         ~ (p=0.795 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_1000_deployments;_10_policies-8                                                                                                                           7.172k ± 0%      7.172k ± 0%         ~ (p=0.804 n=30)
EvaluateCluster/_BenchmarkEvaluateCluster_-_1000_deployments;_100_policies-8                                                                                                                          7.623k ± 0%      7.623k ± 0%         ~ (p=0.766 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_200_ingress_allowed_per_policy_200_egress_allowed_per_policy-8                                                                    420.2k ± 0%      420.2k ± 0%         ~ (p=0.137 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_200_ingress_allowed_per_policy_1000_egress_allowed_per_policy-8                                                                   12.69M ± 0%      12.69M ± 0%         ~ (p=0.387 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_200_ingress_allowed_per_policy_2000_egress_allowed_per_policy-8                                                                   12.70M ± 0%      12.70M ± 0%         ~ (p=0.959 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_1000_ingress_allowed_per_policy_200_egress_allowed_per_policy-8                                                                   18.39M ± 0%      18.39M ± 0%         ~ (p=0.877 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_1000_ingress_allowed_per_policy_1000_egress_allowed_per_policy-8                                                                  18.39M ± 0%      18.39M ± 0%         ~ (p=0.901 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_1000_ingress_allowed_per_policy_2000_egress_allowed_per_policy-8                                                                  30.51M ± 0%      30.51M ± 0%         ~ (p=1.000 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_2000_ingress_allowed_per_policy_200_egress_allowed_per_policy-8                                                                   20.39M ± 0%      20.39M ± 0%         ~ (p=0.101 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_2000_ingress_allowed_per_policy_1000_egress_allowed_per_policy-8                                                                  32.51M ± 0%      20.40M ± 0%         ~ (p=0.154 n=30)
DensePolicies/_BenchmarkDensePolicies_-_2000_deployments_1_policies_2000_ingress_allowed_per_policy_2000_egress_allowed_per_policy-8                                                                  32.52M ± 0%      32.52M ± 0%         ~ (p=0.751 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_1_policies_each_applied_to_1_nodes-8                                                                                                     70.55k ± 0%      70.55k ± 0%         ~ (p=0.538 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_1_policies_each_applied_to_10_nodes-8                                                                                                    70.62k ± 0%      70.62k ± 0%         ~ (p=0.182 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_1_policies_each_applied_to_100_nodes-8                                                                                                   71.25k ± 0%      71.25k ± 0%         ~ (p=0.558 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_10_policies_each_applied_to_1_nodes-8                                                                                                    71.12k ± 0%      71.12k ± 0%         ~ (p=0.261 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_10_policies_each_applied_to_10_nodes-8                                                                                                   71.79k ± 0%      71.79k ± 0%         ~ (p=0.174 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_10_policies_each_applied_to_100_nodes-8                                                                                                  78.08k ± 0%      78.08k ± 0%         ~ (p=0.549 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_100_policies_each_applied_to_1_nodes-8                                                                                                   76.90k ± 0%      76.89k ± 0%         ~ (p=0.131 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_100_policies_each_applied_to_10_nodes-8                                                                                                  87.91k ± 0%      87.52k ± 0%         ~ (p=0.764 n=30)
SparsePolicies/_BenchmarkSparsePolicies_-_10000_deployments;_100_policies_each_applied_to_100_nodes-8                                                                                                 475.6k ± 0%      481.8k ± 1%         ~ (p=0.741 n=30)
GetManyNodes/GetNodesBatch-8                                                                                                                                                                          77.69k ± 0%      87.81k ± 0%   +13.03% (p=0.000 n=30)
GetManyNodes/GetManyNodeMetadata-8                                                                                                                                                                    3.975k ± 0%      5.480k ± 0%   +37.86% (p=0.000 n=30)
Nodes/upsertNodeWithOldScan-8                                                                                                                                                                          134.0 ± 0%       197.0 ± 0%   +47.01% (p=0.000 n=30)
Nodes/upsertNodeWithNewScan-8                                                                                                                                                                          134.0 ± 0%       198.0 ± 0%   +47.76% (p=0.000 n=30)
Nodes/searchAll-8                                                                                                                                                                                      0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
Nodes/searchForCluster-8                                                                                                                                                                               0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
Nodes/deleteForClusters-8                                                                                                                                                                              165.0 ± 0%       181.0 ± 0%    +9.70% (p=0.000 n=30)
AddIndicator-8                                                                                                                                                                                        29.17k ± 0%      70.20k ± 0%  +140.69% (p=0.000 n=25+23)
RabbitMQPruning-8                                                                                                                                                                                     61.00M ± 0%      61.00M ± 0%         ~ (p=0.416 n=30)
GetBindingsAndRoles/run_get_bindings_and_roles-8                                                                                                                                                       350.0 ± 0%       363.0 ± 0%    +3.71% (p=0.000 n=30)
Collections/DryRunAddCollection-8                                                                                                                                                                      416.0 ± 0%       416.5 ± 0%         ~ (p=0.810 n=30)
Collections/DryRunUpdateCollection-8                                                                                                                                                                   482.5 ± 0%       487.0 ± 0%    +0.93% (p=0.000 n=30)
Collections/UpdateCollection-8                                                                                                                                                                        3.304k ± 0%      3.304k ± 0%         ~ (p=0.520 n=30)
Collections/graphInit-8                                                                                                                                                                               89.74k ± 0%      99.97k ± 0%   +11.39% (p=0.000 n=30)
Collections/AddCollection-8                                                                                                                                                                           8.005k ± 1%      8.379k ± 1%         ~ (p=0.476 n=30)
GenerateViolationId-8                                                                                                                                                                                  14.00 ± 0%       14.00 ± 0%         ~ (p=1.000 n=30)    ²
Create/create-8                                                                                                                                                                                        440.0 ± 0%       443.0 ± 0%    +0.68% (p=0.000 n=30)
ProcessPolicies/[field_name:"Process_Name"_values:<value:"apt-get"_>_]-8                                                                                                                              5.578k ± 0%      5.578k ± 0%         ~ (p=1.000 n=30)
ProcessPolicies/[field_name:"Unexpected_Process_Executed"_values:<value:"true"_>_]-8                                                                                                                  8.929k ± 0%      8.929k ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/[field_name:"Privileged_Container"_values:<value:"true"_>_]-8                                                                                                                         10.85k ± 0%      10.85k ± 0%         ~ (p=0.764 n=30)
ProcessPolicies/[field_name:"Process_Name"_values:<value:"apt-get"_>__field_name:"Unexpected_Process_Executed"_values:<value:"true"_>_]-8                                                             4.637k ± 0%      4.637k ± 0%         ~ (p=0.357 n=30)
ProcessPolicies/[field_name:"Process_Name"_values:<value:"apt-get"_>__field_name:"Privileged_Container"_values:<value:"true"_>_]-8                                                                    5.818k ± 0%      5.818k ± 0%         ~ (p=0.161 n=30)
ProcessPolicies/[field_name:"Privileged_Container"_values:<value:"true"_>__field_name:"Unexpected_Process_Executed"_values:<value:"true"_>_]-8                                                        8.767k ± 0%      8.767k ± 0%         ~ (p=0.802 n=30)
ProcessPolicies/[field_name:"Process_Name"_values:<value:"apt-get"_>__field_name:"Privileged_Container"_values:<value:"true"_>__field_name:"Unexpected_Process_Executed"_values:<value:"true"_>_]-8   4.710k ± 0%      4.710k ± 0%         ~ (p=0.795 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get/no_caching-8                                                                                                                                    1.604k ± 0%      1.604k ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get/with_caching-8                                                                                                                                   266.0 ± 0%       266.0 ± 0%         ~ (p=0.334 n=30)
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get2/no_caching-8                                                                                                                                   1.604k ± 0%      1.604k ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_PRIVILEGED/apt-get2/with_caching-8                                                                                                                                  266.0 ± 0%       266.0 ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_PRIVILEGED/curl/no_caching-8                                                                                                                                        19.00 ± 0%       19.00 ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_PRIVILEGED/curl/with_caching-8                                                                                                                                      11.00 ± 0%       11.00 ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_PRIVILEGED/bash/no_caching-8                                                                                                                                        19.00 ± 0%       19.00 ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_PRIVILEGED/bash/with_caching-8                                                                                                                                      11.00 ± 0%       11.00 ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get/no_caching-8                                                                                                                                 1.604k ± 0%      1.604k ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get/with_caching-8                                                                                                                                266.0 ± 0%       266.0 ± 0%         ~ (p=0.334 n=30)
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get2/no_caching-8                                                                                                                                 36.00 ± 0%       36.00 ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/apt-get2/with_caching-8                                                                                                                               28.00 ± 0%       28.00 ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/curl/no_caching-8                                                                                                                                     19.00 ± 0%       19.00 ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/curl/with_caching-8                                                                                                                                   11.00 ± 0%       11.00 ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/bash/no_caching-8                                                                                                                                     19.00 ± 0%       19.00 ± 0%         ~ (p=1.000 n=30)    ²
ProcessPolicies/benchmark_caching:_NOTPRIVILEGED/bash/with_caching-8                                                                                                                                   11.00 ± 0%       11.00 ± 0%         ~ (p=1.000 n=30)    ²
KeyFence-8                                                                                                                                                                                             128.0 ± 0%       128.0 ± 0%         ~ (p=1.000 n=30)    ²
ValueStreamWrite-8                                                                                                                                                                                     2.000 ± 0%       2.000 ± 0%         ~ (p=1.000 n=30)    ²
BufChanWrite-8                                                                                                                                                                                         0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
Buf1ChanWrite-8                                                                                                                                                                                        0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
UnbufChanWrite-8                                                                                                                                                                                       0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
SliceAppend-8                                                                                                                                                                                          0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
SliceAppendWithMutex-8                                                                                                                                                                                 0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
ValueStreamRead-8                                                                                                                                                                                      0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
ValueStreamReadAsync-8                                                                                                                                                                                 1.000 ± 0%       1.000 ± 0%         ~ (p=0.499 n=30)
BufChanRead-8                                                                                                                                                                                          0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
Buf1ChanRead-8                                                                                                                                                                                         0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
UnbufChanRead-8                                                                                                                                                                                        0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
SliceRead-8                                                                                                                                                                                            0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
SliceReadWithMutex-8                                                                                                                                                                                   0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
SortedKeys-8                                                                                                                                                                                           20.00 ± 0%       20.00 ± 0%         ~ (p=1.000 n=30)    ²
CertFingerprintChoices/SHA-1-8                                                                                                                                                                         2.000 ± 0%       2.000 ± 0%         ~ (p=1.000 n=30)    ²
CertFingerprintChoices/SHA-256-8                                                                                                                                                                       2.000 ± 0%       2.000 ± 0%         ~ (p=1.000 n=30)    ²
CertFingerprintChoices/SHA-512-8                                                                                                                                                                       2.000 ± 0%       2.000 ± 0%         ~ (p=1.000 n=30)    ²
CertFingerprintChoices/SHA-512_256-8                                                                                                                                                                   2.000 ± 0%       2.000 ± 0%         ~ (p=1.000 n=30)    ²
Walk/walk-8                                                                                                                                                                                            0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
RateLimiter/NoLimit_NoThrottle-8                                                                                                                                                                       0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
RateLimiter/WithLimitHit_NoThrottle-8                                                                                                                                                                  0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
RateLimiter/WithLimitNoHit_NoThrottle-8                                                                                                                                                                0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
RateLimiter/NoLimit_Throttle_1s-8                                                                                                                                                                      6.000 ± 0%       6.000 ± 0%         ~ (p=1.000 n=30)    ²
RateLimiter/WithLimitHit_Throttle_1s-8                                                                                                                                                                 9.000 ± 0%       9.000 ± 0%         ~ (p=1.000 n=30)    ²
RateLimiter/WithLimitNoHit_Throttle_1s-8                                                                                                                                                               6.000 ± 0%       6.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:Create-8                                                                                                                                                              0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:Get-8                                                                                                                                                                 0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:GetSupernet-8                                                                                                                                                         0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:GetSupernetForCIDR-8                                                                                                                                                  0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:GetSubnets-8                                                                                                                                                          0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:GetSubnetsForCIDR-8                                                                                                                                                   0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv4/IPv4NRadixTree:Insert-8                                                                                                                                                              0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:Create-8                                                                                                                                                              0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:Get-8                                                                                                                                                                 0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:GetSupernet-8                                                                                                                                                         0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:GetSupernetForCIDR-8                                                                                                                                                  0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:GetSubnets-8                                                                                                                                                          0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:GetSubnetsForCIDR-8                                                                                                                                                   0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
NRadixTreeForIPv6/IPv6NRadixTree:Insert-8                                                                                                                                                              0.000 ± 0%       0.000 ± 0%         ~ (p=1.000 n=30)    ²
GoGoProtoClone-8                                                                                                                                                                                       678.0 ± 0%       678.0 ± 0%         ~ (p=1.000 n=30)    ²
GolangProtoClone-8                                                                                                                                                                                    2.074k ± 0%      2.074k ± 0%         ~ (p=1.000 n=30)    ²
AutogeneratedClone-8                                                                                                                                                                                   678.0 ± 0%       678.0 ± 0%         ~ (p=1.000 n=30)    ²
ReplaceVars/short-8                                                                                                                                                                                    2.000 ± 0%       2.000 ± 0%         ~ (p=1.000 n=30)    ²
ReplaceVars/long-8                                                                                                                                                                                     904.0 ± 0%       904.0 ± 0%         ~ (p=1.000 n=30)    ²
IntSet-8                                                                                                                                                                                               37.00 ± 0%       36.00 ± 0%    -2.70% (p=0.005 n=30)
StringSet-8                                                                                                                                                                                           2.032k ± 0%      2.036k ± 0%    +0.20% (p=0.000 n=30)
VerifyAgainstSignatureIntegrations_1Integration-8                                                                                                                                                      134.0 ± 0%       134.0 ± 0%         ~ (p=1.000 n=30)    ²
VerifyAgainstSignatureIntegrations_10Integrations-8                                                                                                                                                   1.035k ± 0%      1.035k ± 0%         ~ (p=1.000 n=30)    ²
VerifyAgainstSignatureIntegrations_100Integrations-8                                                                                                                                                  10.31k ± 0%      10.31k ± 0%         ~ (p=1.000 n=30)    ²
VerifyAgainstSignatureIntegrations_200Integrations-8                                                                                                                                                  20.61k ± 0%      20.61k ± 0%         ~ (p=0.230 n=30)
geomean                                                                                                                                                                                                           ³                   +2.83%                   ³
¹ benchmarks vary in networkgraph/entity/datastore
² all samples are equal
³ summaries must be >0 to compute geomean

@janisz janisz merged commit cb4fffa into master Nov 8, 2023
56 of 58 checks passed
@janisz janisz deleted the master-janisz/07-12-chore_deps_copy_code_from_unmatinained_dep branch November 8, 2023 08:55
ksurabhi91 pushed a commit that referenced this pull request Nov 28, 2023
Signed-off-by: Tomasz Janiszewski <tomek@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants