Skip to content

NO-ISSUE: Automated - Update synthetic test data#31233

Open
openshift-ci[bot] wants to merge 1 commit into
mainfrom
no-issue--automated---update-synthetic-test-data
Open

NO-ISSUE: Automated - Update synthetic test data#31233
openshift-ci[bot] wants to merge 1 commit into
mainfrom
no-issue--automated---update-synthetic-test-data

Conversation

@openshift-ci
Copy link
Copy Markdown
Contributor

@openshift-ci openshift-ci Bot commented May 29, 2026

disruptions Information

There were (122) added jobs and (248) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 329 jobs increased and 1507 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
openshift-api-http2-localhost-new-connections 5.0 amd64 ovn metal ha 364 2m35s 97.20% 3m24.38s 156.37%
kube-api-http1-localhost-new-connections 4.22 amd64 ovn metal ha 324 2m10.85s 81.74% 3m27.39s 184.88%
kube-api-http1-localhost-new-connections 5.0 amd64 ovn azure ha 349 1m13.6s 76.92% 1m22.52s 65.30%
ingress-to-oauth-server-new-connections 4.22 amd64 ovn aws single 106 1m21.75s 48.64% 1m23s 50.91%
openshift-api-http2-service-network-reused-connections 5.0 5.0 amd64 ovn azure ha 900 8s 788.89% 16s 120.99%
ingress-to-console-reused-connections 5.0 ppc64le ovn libvirt ha 177 5.8s 110.91% 1m15.76s 408.46%
kube-api-http1-service-network-new-connections 5.0 5.0 amd64 ovn azure ha 900 7s 75.00% 9s 88.28%
ingress-to-oauth-server-reused-connections 4.22 amd64 ovn aws single 106 7.75s 55.00% 14.85s 197.00%
ingress-to-console-new-connections 4.22 ppc64le ovn none ha 203 4s 100.00% 4m57.16s 14758.00%
openshift-api-http2-service-network-new-connections 4.22 amd64 ovn azure ha 300 4s 40.35% 6s 102.02%
service-load-balancer-with-pdb-new-connections 4.22 amd64 ovn azure ha 300 3s 62.16% 5s 153.81%
ingress-to-oauth-server-new-connections 4.22 4.22 amd64 ovn gcp ha 1148 1s 0.00% 2s 100.00%
openshift-api-new-connections 4.22 4.21 amd64 ovn azure ha 1076 1s 0.00% 7s 40.00%
cache-oauth-api-reused-connections 4.22 4.22 multi ovn aws ha 135 0s 0.00% 1s 61.29%
kube-api-http2-internal-lb-new-connections 4.22 amd64 ovn aws single 106 55.75s 0.00% 1m45.55s 95.64%
host-to-pod-new-connections 4.22 4.22 multi ovn aws ha 135 0s 0.00% 1s 61.29%
cache-openshift-api-new-connections 4.22 amd64 ovn aws single 106 55.75s 0.00% 1m44.65s 94.01%
openshift-api-new-connections 4.22 amd64 ovn aws single 106 55.75s 0.00% 1m44.65s 94.01%
pod-to-host-reused-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 34.75s 54.31%
host-to-pod-new-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 4.5s 90.68%
kube-api-http1-localhost-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.7s 94.07%
openshift-api-http2-service-network-reused-connections 4.22 multi ovn aws ha 260 0s 0.00% 1s 150.00%
kube-api-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.01%
kube-api-http2-service-network-new-connections 4.22 amd64 ovn azure ha 300 4s 0.00% 6.01s 51.39%
kube-api-http1-service-network-reused-connections 4.22 amd64 ovn aws single 106 2m16.5s 0.00% 2m44.1s 43.99%
kube-api-http2-internal-lb-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m43.7s 95.77%
cache-openshift-api-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.16%
openshift-api-http2-localhost-reused-connections 4.22 4.22 amd64 ovn aws ha 929 1m8s 0.00% 2m22.64s 165.03%
host-to-host-reused-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 32.5s 53.59%
cache-oauth-api-reused-connections 4.22 4.22 amd64 ovn aws ha 929 0s 0.00% 2.44s 144.00%
cache-oauth-api-new-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.01%
host-to-pod-reused-connections 4.22 4.22 multi ovn aws ha 135 0s 0.00% 1s 61.29%
host-to-pod-reused-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 3.25s 37.71%
host-to-service-new-connections 4.22 4.22 amd64 ovn azure ha 802 1s 0.00% 2s 106.19%
kube-api-http1-localhost-new-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m46.6s 97.52%
host-to-pod-new-connections 4.22 amd64 ovn gcp ha 428 0s 0.00% 730ms 265.00%
service-load-balancer-with-pdb-new-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 8.25s 278.44%
pod-to-host-new-connections 4.22 4.22 amd64 ovn azure ha 802 0s 0.00% 9.91s 891.00%
cache-openshift-api-reused-connections 4.22 4.22 amd64 ovn azure ha 802 1s 0.00% 2s 106.19%
host-to-pod-reused-connections 4.22 4.22 amd64 ovn aws ha 929 0s 0.00% 1.72s 72.00%
kube-api-http1-service-network-new-connections 4.22 amd64 ovn aws single 106 2m16.5s 0.00% 2m46.95s 46.49%
openshift-api-http2-service-network-reused-connections 4.22 amd64 ovn azure ha 133 0s 0.00% 14.68s 645.18%
kube-api-http2-localhost-new-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m49.45s 102.80%
oauth-api-reused-connections 4.22 amd64 ovn gcp ha 184 0s 0.00% 1s 400.00%
service-load-balancer-with-pdb-new-connections 4.22 amd64 ovn gcp ha 184 0s 0.00% 12.73s 809.29%
openshift-api-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.01%
kube-api-new-connections 4.22 ppc64le ovn none ha 205 4s 0.00% 4m58.16s 6325.86%
pod-to-pod-new-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 4.25s 80.08%
cache-kube-api-new-connections 4.22 amd64 ovn aws single 106 55.75s 0.00% 1m44.65s 94.01%
metrics-api-new-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 1s 455.56%
cache-kube-api-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.16%
cache-oauth-api-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.16%
cache-kube-api-new-connections 4.22 4.22 amd64 ovn gcp ha 1148 0s 0.00% 2s 106.19%
host-to-pod-new-connections 4.22 4.22 amd64 ovn aws ha 929 0s 0.00% 1.72s 72.00%
pod-to-pod-reused-connections 4.22 4.22 multi ovn aws ha 135 0s 0.00% 1s 61.29%
host-to-host-new-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 35.5s 62.25%
ci-cluster-network-liveness-new-connections 4.22 multi ovn aws ha 260 0s 0.00% 4.51s 275.83%
oauth-api-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.01%
kube-api-http1-internal-lb-new-connections 4.22 amd64 ovn aws single 106 55.75s 0.00% 1m45.75s 99.53%
kube-api-http1-service-network-new-connections 4.22 amd64 ovn azure ha 300 4s 0.00% 7.01s 77.92%
cache-kube-api-new-connections 4.22 amd64 ovn gcp ha 184 0s 0.00% 29.16s 2816.00%
ci-cluster-network-liveness-new-connections 4.22 4.22 multi ovn aws ha 135 0s 0.00% 10.56s 467.74%
oauth-api-reused-connections 4.22 4.21 amd64 ovn azure ha 1076 2s 0.00% 8.25s 53.92%
pod-to-host-new-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 33.25s 50.05%
kube-api-new-connections 4.22 amd64 ovn aws single 106 55.75s 0.00% 1m44.65s 94.16%
openshift-api-http2-internal-lb-reused-connections 4.22 4.21 amd64 ovn azure ha 1076 1s 0.00% 2s 69.49%
image-registry-reused-connections 5.0 5.0 amd64 ovn aws ha 1027 0s 0.00% 3.74s 419.44%
metrics-api-reused-connections 5.0 ppc64le ovn libvirt ha 177 0s 0.00% 1m46.96s 73.07%
cache-kube-api-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%
host-to-pod-reused-connections 5.0 4.22 amd64 ovn azure ha 1133 0s 0.00% 3s 50.00%
kube-api-reused-connections 5.0 5.0 multi ovn aws ha 131 0s 0.00% 5.8s 32.72%
cache-openshift-api-new-connections 5.0 4.22 amd64 ovn azure ha 1133 0s 0.00% 1.68s 68.00%
kube-api-reused-connections 5.0 ppc64le ovn libvirt ha 177 0s 0.00% 59.08s 13028.89%
kube-api-http2-internal-lb-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 2s 0.00% 6.15s 207.50%
oauth-api-new-connections 5.0 5.0 multi ovn aws ha 131 0s 0.00% 4s 33.33%
oauth-api-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%
ingress-to-oauth-server-new-connections 5.0 5.0 multi ovn aws ha 131 500ms 0.00% 1.7s 70.00%
oauth-api-new-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 2s 100.00%
ingress-to-console-reused-connections 5.0 4.22 amd64 ovn azure ha 1133 0s 0.00% 2.68s 34.00%
cache-openshift-api-reused-connections 5.0 ppc64le ovn libvirt ha 177 0s 0.00% 59.08s 13028.89%
openshift-api-http2-internal-lb-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 2s 0.00% 6.49s 66.41%
kube-api-http2-internal-lb-reused-connections 5.0 amd64 ovn gcp ha 291 0s 0.00% 2.2s 120.00%
openshift-api-http2-service-network-reused-connections 5.0 amd64 ovn aws ha 821 0s 0.00% 1m6.8s 9581.16%
metrics-api-new-connections 5.0 5.0 amd64 ovn aws ha 1027 0s 0.00% 24.96s 107.31%
cache-openshift-api-new-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%
ingress-to-oauth-server-new-connections 5.0 5.0 amd64 ovn azure ha 900 0s 0.00% 5s 32.98%
cache-oauth-api-new-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%
metrics-api-reused-connections 5.0 amd64 ovn azure ha 349 600ms 0.00% 1s 63.93%
metrics-api-new-connections 5.0 4.22 amd64 ovn gcp ha 1058 0s 0.00% 2s 100.00%
openshift-api-reused-connections 5.0 ppc64le ovn libvirt ha 177 0s 0.00% 1m7.44s 14886.67%
kube-api-http1-internal-lb-new-connections 5.0 ppc64le ovn libvirt ha 176 1s 0.00% 7.25s 32.78%
ingress-to-oauth-server-reused-connections 5.0 ppc64le ovn libvirt ha 177 0s 0.00% 1m6.12s 2598.78%
kube-api-http1-localhost-reused-connections 5.0 ppc64le ovn libvirt ha 176 0s 0.00% 6.75s 35.00%
oauth-api-reused-connections 5.0 ppc64le ovn libvirt ha 177 0s 0.00% 59.08s 13028.89%
cache-oauth-api-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 2s 100.00%
openshift-api-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 2s 100.00%
cache-openshift-api-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 2s 100.00%
kube-api-new-connections 5.0 amd64 ovn gcp ha 291 0s 0.00% 2.7s 170.00%
kube-api-http2-localhost-reused-connections 5.0 ppc64le ovn libvirt ha 176 0s 0.00% 6.75s 35.00%
kube-api-new-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%
kube-api-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%
pod-to-pod-new-connections 5.0 s390x ovn none ha 104 0s 0.00% 970ms 4750.00%
cache-kube-api-new-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%

alerts Information

There were (5671) added jobs and (2598) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 63 jobs increased and 768 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
HighOverallControlPlaneMemory openshift-machine-config-operator Warning 5.0 amd64 ovn aws single 138 14m20.9s 262.33% 35m9.44s 395.55%
NodeSystemSaturation openshift-monitoring Warning 4.22 4.21 amd64 ovn azure ha 220 5m29.5s 0.00% 19m23.3s 55.83%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.22 amd64 ovn azure ha 220 31s 0.00% 6m10.52s 108.16%
CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning 4.22 4.21 amd64 ovn azure ha 220 2m58s 0.00% 5m39.28s 77.17%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.22 4.22 amd64 ovn azure ha 220 1m28s 0.00% 3m22.3s 36.69%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.22 4.22 amd64 ovn gcp ha 240 1m26.1s 0.00% 19m39.82s 64.09%
KubeletPlegDurationHigh kube-system Warning 4.22 4.21 amd64 ovn azure ha 220 2m58s 0.00% 5m39.28s 53.17%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.22 amd64 ovn metal two-node-fencing 266 0s 0.00% 20.3s 262.50%
SystemMemoryExceedsReservation openshift-machine-config-operator Warning 4.22 4.21 amd64 ovn azure ha 220 0s 0.00% 10m38.94s 425.44%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.22 amd64 ovn metal two-node-fencing 266 0s 0.00% 2m28s 2542.86%
CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning 4.22 4.21 amd64 ovn aws ha 240 2m58s 0.00% 6m58s 93.16%
KubeDeploymentRolloutStuck openshift-ingress Warning 4.22 4.22 amd64 ovn aws single 205 0s 0.00% 3h4m10.88s 1579.47%
NodeSystemSaturation openshift-monitoring Warning 4.22 amd64 ovn gcp ha 237 2m46s 0.00% 30m42.4s 30.25%
SystemMemoryExceedsReservation openshift-machine-config-operator Warning 5.0 5.0 amd64 ovn aws ha 332 0s 0.00% 1m17.76s 257.02%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 5.0 amd64 ovn vsphere ha 331 0s 0.00% 49s 75.00%
NodeSystemSaturation openshift-monitoring Warning 5.0 amd64 ovn aws ha 718 0s 0.00% 1m46.14s 83.00%
KubeJobFailed openshift-insights Warning 5.0 5.0 amd64 ovn azure ha 302 0s 0.00% 1h56m59.1s 225.25%
OpenShiftUpdateRiskMightApply openshift-cluster-version Warning 5.0 amd64 ovn gcp ha 256 0s 0.00% 5m23s 43.58%
KubeDeploymentRolloutStuck openshift-ingress Warning 5.0 5.0 amd64 ovn aws single 251 0s 0.00% 3h10m30s 2634.45%
KubeCPUOvercommit kube-system Warning 5.0 5.0 amd64 ovn aws single 251 0s 0.00% 3h22m59s 338.91%
KubeDeploymentReplicasMismatch openshift-ingress Warning 5.0 5.0 amd64 ovn aws single 251 0s 0.00% 3h20m1s 1078.88%
NodeSystemSaturation openshift-monitoring Warning 5.0 5.0 amd64 ovn aws single 251 4m28s 0.00% 1h28m22s 868.22%
KubePodNotScheduled openshift-ingress Warning 5.0 5.0 amd64 ovn aws single 251 0s 0.00% 2h50m1s 3323.15%
NodeSystemSaturation openshift-monitoring Warning 5.0 4.22 amd64 ovn gcp ha 268 4m16.2s 0.00% 14m6.7s 30.26%
TestAlertFeatureE2ETestOTA1813 openshift-cluster-version Critical 5.0 amd64 ovn gcp ha 256 1m2s 0.00% 1m46.5s 41.92%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 5.0 amd64 ovn azure ha 253 58s 0.00% 2m56.96s 101.09%
/cc @xueqzhan, @neisw, @smg247

@openshift-merge-bot
Copy link
Copy Markdown
Contributor

openshift-merge-bot Bot commented May 29, 2026

Pipeline controller notification
This repo is configured to use the pipeline controller. Second-stage tests will be triggered either automatically or after lgtm label is added, depending on the repository configuration. The pipeline controller will automatically detect which contexts are required and will utilize /test Prow commands to trigger the second stage.

For optional jobs, comment /test ? to see a list of all defined jobs. To trigger manually all jobs from second stage use /pipeline required command.

This repository is configured in: automatic mode

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label May 29, 2026
@openshift-ci-robot
Copy link
Copy Markdown

openshift-ci-robot commented May 29, 2026

@openshift-ci[bot]: This pull request explicitly references no jira issue.

Details

In response to this:

disruptions Information

There were (122) added jobs and (248) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 329 jobs increased and 1507 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
openshift-api-http2-localhost-new-connections 5.0 amd64 ovn metal ha 364 2m35s 97.20% 3m24.38s 156.37%
kube-api-http1-localhost-new-connections 4.22 amd64 ovn metal ha 324 2m10.85s 81.74% 3m27.39s 184.88%
kube-api-http1-localhost-new-connections 5.0 amd64 ovn azure ha 349 1m13.6s 76.92% 1m22.52s 65.30%
ingress-to-oauth-server-new-connections 4.22 amd64 ovn aws single 106 1m21.75s 48.64% 1m23s 50.91%
openshift-api-http2-service-network-reused-connections 5.0 5.0 amd64 ovn azure ha 900 8s 788.89% 16s 120.99%
ingress-to-console-reused-connections 5.0 ppc64le ovn libvirt ha 177 5.8s 110.91% 1m15.76s 408.46%
kube-api-http1-service-network-new-connections 5.0 5.0 amd64 ovn azure ha 900 7s 75.00% 9s 88.28%
ingress-to-oauth-server-reused-connections 4.22 amd64 ovn aws single 106 7.75s 55.00% 14.85s 197.00%
ingress-to-console-new-connections 4.22 ppc64le ovn none ha 203 4s 100.00% 4m57.16s 14758.00%
openshift-api-http2-service-network-new-connections 4.22 amd64 ovn azure ha 300 4s 40.35% 6s 102.02%
service-load-balancer-with-pdb-new-connections 4.22 amd64 ovn azure ha 300 3s 62.16% 5s 153.81%
ingress-to-oauth-server-new-connections 4.22 4.22 amd64 ovn gcp ha 1148 1s 0.00% 2s 100.00%
openshift-api-new-connections 4.22 4.21 amd64 ovn azure ha 1076 1s 0.00% 7s 40.00%
cache-oauth-api-reused-connections 4.22 4.22 multi ovn aws ha 135 0s 0.00% 1s 61.29%
kube-api-http2-internal-lb-new-connections 4.22 amd64 ovn aws single 106 55.75s 0.00% 1m45.55s 95.64%
host-to-pod-new-connections 4.22 4.22 multi ovn aws ha 135 0s 0.00% 1s 61.29%
cache-openshift-api-new-connections 4.22 amd64 ovn aws single 106 55.75s 0.00% 1m44.65s 94.01%
openshift-api-new-connections 4.22 amd64 ovn aws single 106 55.75s 0.00% 1m44.65s 94.01%
pod-to-host-reused-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 34.75s 54.31%
host-to-pod-new-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 4.5s 90.68%
kube-api-http1-localhost-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.7s 94.07%
openshift-api-http2-service-network-reused-connections 4.22 multi ovn aws ha 260 0s 0.00% 1s 150.00%
kube-api-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.01%
kube-api-http2-service-network-new-connections 4.22 amd64 ovn azure ha 300 4s 0.00% 6.01s 51.39%
kube-api-http1-service-network-reused-connections 4.22 amd64 ovn aws single 106 2m16.5s 0.00% 2m44.1s 43.99%
kube-api-http2-internal-lb-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m43.7s 95.77%
cache-openshift-api-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.16%
openshift-api-http2-localhost-reused-connections 4.22 4.22 amd64 ovn aws ha 929 1m8s 0.00% 2m22.64s 165.03%
host-to-host-reused-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 32.5s 53.59%
cache-oauth-api-reused-connections 4.22 4.22 amd64 ovn aws ha 929 0s 0.00% 2.44s 144.00%
cache-oauth-api-new-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.01%
host-to-pod-reused-connections 4.22 4.22 multi ovn aws ha 135 0s 0.00% 1s 61.29%
host-to-pod-reused-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 3.25s 37.71%
host-to-service-new-connections 4.22 4.22 amd64 ovn azure ha 802 1s 0.00% 2s 106.19%
kube-api-http1-localhost-new-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m46.6s 97.52%
host-to-pod-new-connections 4.22 amd64 ovn gcp ha 428 0s 0.00% 730ms 265.00%
service-load-balancer-with-pdb-new-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 8.25s 278.44%
pod-to-host-new-connections 4.22 4.22 amd64 ovn azure ha 802 0s 0.00% 9.91s 891.00%
cache-openshift-api-reused-connections 4.22 4.22 amd64 ovn azure ha 802 1s 0.00% 2s 106.19%
host-to-pod-reused-connections 4.22 4.22 amd64 ovn aws ha 929 0s 0.00% 1.72s 72.00%
kube-api-http1-service-network-new-connections 4.22 amd64 ovn aws single 106 2m16.5s 0.00% 2m46.95s 46.49%
openshift-api-http2-service-network-reused-connections 4.22 amd64 ovn azure ha 133 0s 0.00% 14.68s 645.18%
kube-api-http2-localhost-new-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m49.45s 102.80%
oauth-api-reused-connections 4.22 amd64 ovn gcp ha 184 0s 0.00% 1s 400.00%
service-load-balancer-with-pdb-new-connections 4.22 amd64 ovn gcp ha 184 0s 0.00% 12.73s 809.29%
openshift-api-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.01%
kube-api-new-connections 4.22 ppc64le ovn none ha 205 4s 0.00% 4m58.16s 6325.86%
pod-to-pod-new-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 4.25s 80.08%
cache-kube-api-new-connections 4.22 amd64 ovn aws single 106 55.75s 0.00% 1m44.65s 94.01%
metrics-api-new-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 1s 455.56%
cache-kube-api-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.16%
cache-oauth-api-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.16%
cache-kube-api-new-connections 4.22 4.22 amd64 ovn gcp ha 1148 0s 0.00% 2s 106.19%
host-to-pod-new-connections 4.22 4.22 amd64 ovn aws ha 929 0s 0.00% 1.72s 72.00%
pod-to-pod-reused-connections 4.22 4.22 multi ovn aws ha 135 0s 0.00% 1s 61.29%
host-to-host-new-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 35.5s 62.25%
ci-cluster-network-liveness-new-connections 4.22 multi ovn aws ha 260 0s 0.00% 4.51s 275.83%
oauth-api-reused-connections 4.22 amd64 ovn aws single 106 56s 0.00% 1m44.65s 94.01%
kube-api-http1-internal-lb-new-connections 4.22 amd64 ovn aws single 106 55.75s 0.00% 1m45.75s 99.53%
kube-api-http1-service-network-new-connections 4.22 amd64 ovn azure ha 300 4s 0.00% 7.01s 77.92%
cache-kube-api-new-connections 4.22 amd64 ovn gcp ha 184 0s 0.00% 29.16s 2816.00%
ci-cluster-network-liveness-new-connections 4.22 4.22 multi ovn aws ha 135 0s 0.00% 10.56s 467.74%
oauth-api-reused-connections 4.22 4.21 amd64 ovn azure ha 1076 2s 0.00% 8.25s 53.92%
pod-to-host-new-connections 4.22 4.21 amd64 ovn azure ha 1076 0s 0.00% 33.25s 50.05%
kube-api-new-connections 4.22 amd64 ovn aws single 106 55.75s 0.00% 1m44.65s 94.16%
openshift-api-http2-internal-lb-reused-connections 4.22 4.21 amd64 ovn azure ha 1076 1s 0.00% 2s 69.49%
image-registry-reused-connections 5.0 5.0 amd64 ovn aws ha 1027 0s 0.00% 3.74s 419.44%
metrics-api-reused-connections 5.0 ppc64le ovn libvirt ha 177 0s 0.00% 1m46.96s 73.07%
cache-kube-api-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%
host-to-pod-reused-connections 5.0 4.22 amd64 ovn azure ha 1133 0s 0.00% 3s 50.00%
kube-api-reused-connections 5.0 5.0 multi ovn aws ha 131 0s 0.00% 5.8s 32.72%
cache-openshift-api-new-connections 5.0 4.22 amd64 ovn azure ha 1133 0s 0.00% 1.68s 68.00%
kube-api-reused-connections 5.0 ppc64le ovn libvirt ha 177 0s 0.00% 59.08s 13028.89%
kube-api-http2-internal-lb-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 2s 0.00% 6.15s 207.50%
oauth-api-new-connections 5.0 5.0 multi ovn aws ha 131 0s 0.00% 4s 33.33%
oauth-api-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%
ingress-to-oauth-server-new-connections 5.0 5.0 multi ovn aws ha 131 500ms 0.00% 1.7s 70.00%
oauth-api-new-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 2s 100.00%
ingress-to-console-reused-connections 5.0 4.22 amd64 ovn azure ha 1133 0s 0.00% 2.68s 34.00%
cache-openshift-api-reused-connections 5.0 ppc64le ovn libvirt ha 177 0s 0.00% 59.08s 13028.89%
openshift-api-http2-internal-lb-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 2s 0.00% 6.49s 66.41%
kube-api-http2-internal-lb-reused-connections 5.0 amd64 ovn gcp ha 291 0s 0.00% 2.2s 120.00%
openshift-api-http2-service-network-reused-connections 5.0 amd64 ovn aws ha 821 0s 0.00% 1m6.8s 9581.16%
metrics-api-new-connections 5.0 5.0 amd64 ovn aws ha 1027 0s 0.00% 24.96s 107.31%
cache-openshift-api-new-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%
ingress-to-oauth-server-new-connections 5.0 5.0 amd64 ovn azure ha 900 0s 0.00% 5s 32.98%
cache-oauth-api-new-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%
metrics-api-reused-connections 5.0 amd64 ovn azure ha 349 600ms 0.00% 1s 63.93%
metrics-api-new-connections 5.0 4.22 amd64 ovn gcp ha 1058 0s 0.00% 2s 100.00%
openshift-api-reused-connections 5.0 ppc64le ovn libvirt ha 177 0s 0.00% 1m7.44s 14886.67%
kube-api-http1-internal-lb-new-connections 5.0 ppc64le ovn libvirt ha 176 1s 0.00% 7.25s 32.78%
ingress-to-oauth-server-reused-connections 5.0 ppc64le ovn libvirt ha 177 0s 0.00% 1m6.12s 2598.78%
kube-api-http1-localhost-reused-connections 5.0 ppc64le ovn libvirt ha 176 0s 0.00% 6.75s 35.00%
oauth-api-reused-connections 5.0 ppc64le ovn libvirt ha 177 0s 0.00% 59.08s 13028.89%
cache-oauth-api-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 2s 100.00%
openshift-api-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 2s 100.00%
cache-openshift-api-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 2s 100.00%
kube-api-new-connections 5.0 amd64 ovn gcp ha 291 0s 0.00% 2.7s 170.00%
kube-api-http2-localhost-reused-connections 5.0 ppc64le ovn libvirt ha 176 0s 0.00% 6.75s 35.00%
kube-api-new-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%
kube-api-reused-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%
pod-to-pod-new-connections 5.0 s390x ovn none ha 104 0s 0.00% 970ms 4750.00%
cache-kube-api-new-connections 5.0 4.22 amd64 ovn vsphere ha 118 1s 0.00% 1.83s 83.00%

alerts Information

There were (5671) added jobs and (2598) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 63 jobs increased and 768 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
HighOverallControlPlaneMemory openshift-machine-config-operator Warning 5.0 amd64 ovn aws single 138 14m20.9s 262.33% 35m9.44s 395.55%
NodeSystemSaturation openshift-monitoring Warning 4.22 4.21 amd64 ovn azure ha 220 5m29.5s 0.00% 19m23.3s 55.83%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.22 amd64 ovn azure ha 220 31s 0.00% 6m10.52s 108.16%
CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning 4.22 4.21 amd64 ovn azure ha 220 2m58s 0.00% 5m39.28s 77.17%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.22 4.22 amd64 ovn azure ha 220 1m28s 0.00% 3m22.3s 36.69%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.22 4.22 amd64 ovn gcp ha 240 1m26.1s 0.00% 19m39.82s 64.09%
KubeletPlegDurationHigh kube-system Warning 4.22 4.21 amd64 ovn azure ha 220 2m58s 0.00% 5m39.28s 53.17%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.22 amd64 ovn metal two-node-fencing 266 0s 0.00% 20.3s 262.50%
SystemMemoryExceedsReservation openshift-machine-config-operator Warning 4.22 4.21 amd64 ovn azure ha 220 0s 0.00% 10m38.94s 425.44%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.22 amd64 ovn metal two-node-fencing 266 0s 0.00% 2m28s 2542.86%
CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning 4.22 4.21 amd64 ovn aws ha 240 2m58s 0.00% 6m58s 93.16%
KubeDeploymentRolloutStuck openshift-ingress Warning 4.22 4.22 amd64 ovn aws single 205 0s 0.00% 3h4m10.88s 1579.47%
NodeSystemSaturation openshift-monitoring Warning 4.22 amd64 ovn gcp ha 237 2m46s 0.00% 30m42.4s 30.25%
SystemMemoryExceedsReservation openshift-machine-config-operator Warning 5.0 5.0 amd64 ovn aws ha 332 0s 0.00% 1m17.76s 257.02%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 5.0 amd64 ovn vsphere ha 331 0s 0.00% 49s 75.00%
NodeSystemSaturation openshift-monitoring Warning 5.0 amd64 ovn aws ha 718 0s 0.00% 1m46.14s 83.00%
KubeJobFailed openshift-insights Warning 5.0 5.0 amd64 ovn azure ha 302 0s 0.00% 1h56m59.1s 225.25%
OpenShiftUpdateRiskMightApply openshift-cluster-version Warning 5.0 amd64 ovn gcp ha 256 0s 0.00% 5m23s 43.58%
KubeDeploymentRolloutStuck openshift-ingress Warning 5.0 5.0 amd64 ovn aws single 251 0s 0.00% 3h10m30s 2634.45%
KubeCPUOvercommit kube-system Warning 5.0 5.0 amd64 ovn aws single 251 0s 0.00% 3h22m59s 338.91%
KubeDeploymentReplicasMismatch openshift-ingress Warning 5.0 5.0 amd64 ovn aws single 251 0s 0.00% 3h20m1s 1078.88%
NodeSystemSaturation openshift-monitoring Warning 5.0 5.0 amd64 ovn aws single 251 4m28s 0.00% 1h28m22s 868.22%
KubePodNotScheduled openshift-ingress Warning 5.0 5.0 amd64 ovn aws single 251 0s 0.00% 2h50m1s 3323.15%
NodeSystemSaturation openshift-monitoring Warning 5.0 4.22 amd64 ovn gcp ha 268 4m16.2s 0.00% 14m6.7s 30.26%
TestAlertFeatureE2ETestOTA1813 openshift-cluster-version Critical 5.0 amd64 ovn gcp ha 256 1m2s 0.00% 1m46.5s 41.92%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 5.0 amd64 ovn azure ha 253 58s 0.00% 2m56.96s 101.09%
/cc @xueqzhan, @neisw, @smg247

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci Bot requested review from deads2k and sjenning May 29, 2026 03:03
@openshift-ci
Copy link
Copy Markdown
Contributor Author

openshift-ci Bot commented May 29, 2026

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: openshift-ci[bot]
Once this PR has been reviewed and has the lgtm label, please assign xueqzhan for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci
Copy link
Copy Markdown
Contributor Author

openshift-ci Bot commented May 29, 2026

@openshift-ci[bot]: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/unit a29824a link true /test unit

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@deads2k deads2k Awaiting requested review from deads2k

@sjenning sjenning Awaiting requested review from sjenning

Assignees

No one assigned

Labels

jira/valid-reference Indicates that this PR references a valid Jira ticket of any type.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@openshift-ci-robot