CIHealth
<
Weekly: Jul 6 - Jul 12▾
Last 7 Days Weekly: Jul 6 - Jul 12 Sprint: Jul 6 - Jul 19 Single Day: Jul 12
Custom time window
> Reset
View JSON API

Environment: INT

Failure patterns: 9 · Failures matched: 25 · Total runs: 24 · Runs affected: 9

Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs.Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern).Number of distinct job runs where this failure pattern was detected.Percentage of all job runs in this environment affected by this failure pattern during the selected window.Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate.TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size.Also inOther environments where the same failure pattern was also detected during the selected window.
timeout during CreateHCPClusterAndWait; context deadline exceeded
full failure pattern:
timeout during CreateHCPClusterAndWait; context deadline exceeded
Signal: FlakeSignal: Flake — present in 4 prior week(s); spread across 3 days
e2e520.83%5 of 24 job runs affectedFlakeSignal: Flake — present in 4 prior week(s); spread across 3 daysShow trend detailsJul 5: 0 · Jul 6: 0 · Jul 7: 0 · Jul 8: 6 · Jul 9: 0 · Jul 10: 4 · Jul 11: 1 · Jul 12: 0none
Full failure examples (3)
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:589]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc00095c9f0>: 
    failed to create HCP cluster np-downgrade-g9g6xf, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-g9g6xf in resource group rg-np-downgrade-g9g6xf-875q59, error: failed waiting for cluster="np-downgrade-g9g6xf" in resourcegroup="rg-np-downgrade-g9g6xf-875q59" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-g9g6xf in resource group rg-np-downgrade-g9g6xf-875q59, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:589]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc00095c9f0>: 
    failed to create HCP cluster np-downgrade-g9g6xf, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-g9g6xf in resource group rg-np-downgrade-g9g6xf-875q59, error: failed waiting for cluster="np-downgrade-g9g6xf" in resourcegroup="rg-np-downgrade-g9g6xf-875q59" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-g9g6xf in resource group rg-np-downgrade-g9g6xf-875q59, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-zhsxbm/cluster-candidate-5-0-kfvs9w should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0016955c0>: 
    failed to create HCP cluster cluster-candidate-5-0-kfvs9w, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-kfvs9w in resource group rg-candidate-5-0-zhsxbm, error: failed waiting for cluster="cluster-candidate-5-0-kfvs9w" in resourcegroup="rg-candidate-5-0-zhsxbm" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-kfvs9w in resource group rg-candidate-5-0-zhsxbm, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-zhsxbm/cluster-candidate-5-0-kfvs9w should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0016955c0>: 
    failed to create HCP cluster cluster-candidate-5-0-kfvs9w, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-kfvs9w in resource group rg-candidate-5-0-zhsxbm, error: failed waiting for cluster="cluster-candidate-5-0-kfvs9w" in resourcegroup="rg-candidate-5-0-zhsxbm" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-kfvs9w in resource group rg-candidate-5-0-zhsxbm, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-sh2xgl/cluster-candidate-4-22-gtzf24 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc001570210>: 
    failed to create HCP cluster cluster-candidate-4-22-gtzf24, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-gtzf24 in resource group rg-candidate-4-22-sh2xgl, error: failed waiting for cluster="cluster-candidate-4-22-gtzf24" in resourcegroup="rg-candidate-4-22-sh2xgl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-gtzf24 in resource group rg-candidate-4-22-sh2xgl, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-sh2xgl/cluster-candidate-4-22-gtzf24 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc001570210>: 
    failed to create HCP cluster cluster-candidate-4-22-gtzf24, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-gtzf24 in resource group rg-candidate-4-22-sh2xgl, error: failed waiting for cluster="cluster-candidate-4-22-gtzf24" in resourcegroup="rg-candidate-4-22-sh2xgl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-gtzf24 in resource group rg-candidate-4-22-sh2xgl, error: context deadline exceeded
    ...
occurred
Contributing tests (11)
Failed AtJobTestSupport
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.221
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.01
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should be able to create a cluster with an external auth config and get the external auth config1
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should be able to create an HCP cluster and manage ImageDigestMirrors1
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should be able to create an HCP cluster with Image Registry not present1
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should be able to lifecycle and confirm external auth on a cluster1
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should be able to update node pool labels and taints1
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should create an HCP cluster and validate TLS certificates1
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious1
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelHCP Nodepools GPU instances creates and deletes a GPU nodepool in a single cluster1
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelService Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.221
Affected runs (5)
Date (UTC)Associated PRProw job
n/a2075795979096821760
n/a2075598157906972672
n/a2075470437046816768
n/a2075418155898900480
n/a2074858931108188160
DeleteHCPCluster timed out after <minutes> minutes; context deadline exceeded
full failure pattern:
DeleteHCPCluster timed out after <minutes> minutes; context deadline exceeded
Signal: IndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior history
e2e312.50%3 of 24 job runs affectedIndeterminateSignal: Indeterminate — no prior history; active 2 day(s) — New failure pattern — no prior historyShow trend detailsJul 5: 0 · Jul 6: 0 · Jul 7: 0 · Jul 8: 1 · Jul 9: 0 · Jul 10: 0 · Jul 11: 3 · Jul 12: 0none
Full failure examples (3)
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283]: Unexpected error:
    <*errors.joinError | 0xc00199a1f8>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="rg-zstream-upgrade-4-22-xddbdf", caused by: failed waiting for hcpCluster="cluster-zstream-4-22-qz9tbp" in resourcegroup="rg-zstream-upgrade-4-22-xddbdf" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cluster-zstream-4-22-qz9tbp in resource group rg-zstream-upgrade-4-22-xddbdf, error: context deadline exceeded, error: failed waiting for hcpCluster="cluster-zstream-4-22-qz9tbp" in resourcegroup="rg-zstream-upgrade-4-22-xddbdf" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cluster-zstream-4-22-qz9tbp in resource group rg-zstream-upgrade-4-22-xddbdf, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283]: Unexpected error:
    <*errors.joinError | 0xc00199a1f8>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="rg-zstream-upgrade-4-22-xddbdf", caused by: failed waiting for hcpCluster="cluster-zstream-4-22-qz9tbp" in resourcegroup="rg-zstream-upgrade-4-22-xddbdf" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cluster-zstream-4-22-qz9tbp in resource group rg-zstream-upgrade-4-22-xddbdf, error: context deadline exceeded, error: failed waiting for hcpCluster="cluster-zstream-4-22-qz9tbp" in resourcegroup="rg-zstream-upgrade-4-22-xddbdf" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cluster-zstream-4-22-qz9tbp in resource group rg-zstream-upgrade-4-22-xddbdf, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283]: Unexpected error:
    <*errors.joinError | 0xc00125a0f0>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="ephemeral-osdisk-wdqlbm", caused by: failed waiting for hcpCluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-wdqlbm" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster ephemeral-disk in resource group ephemeral-osdisk-wdqlbm, error: context deadline exceeded, error: failed waiting for hcpCluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-wdqlbm" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster ephemeral-disk in resource group ephemeral-osdisk-wdqlbm, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283]: Unexpected error:
    <*errors.joinError | 0xc00125a0f0>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="ephemeral-osdisk-wdqlbm", caused by: failed waiting for hcpCluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-wdqlbm" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster ephemeral-disk in resource group ephemeral-osdisk-wdqlbm, error: context deadline exceeded, error: failed waiting for hcpCluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-wdqlbm" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster ephemeral-disk in resource group ephemeral-osdisk-wdqlbm, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283]: Unexpected error:
    <*errors.joinError | 0xc000538648>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="rg-cluster-back-version-pndqms", caused by: failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-pndqms" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-pndqms, error: context deadline exceeded, error: failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-pndqms" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-pndqms, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283]: Unexpected error:
    <*errors.joinError | 0xc000538648>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="rg-cluster-back-version-pndqms", caused by: failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-pndqms" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-pndqms, error: context deadline exceeded, error: failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-pndqms" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-pndqms, error: context deadline exceeded
    ...
occurred
Contributing tests (3)
Failed AtJobTestSupport
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelNodepool Ephemeral OS Disk should create a nodepool with ephemeral OS disk when autoRepair is enabled2
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should be able to create an HCP cluster with back-level version 4.191
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelService Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.221
Affected runs (3)
Date (UTC)Associated PRProw job
n/a2075795979096821760
n/a2075737788124237824
n/a2074858931108188160
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
full failure pattern:
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
Signal: IndeterminateSignal: Indeterminate — seen in 4 prior week(s); active 2 day(s)
e2e312.50%3 of 24 job runs affectedIndeterminateSignal: Indeterminate — seen in 4 prior week(s); active 2 day(s)Show trend detailsJul 5: 0 · Jul 6: 0 · Jul 7: 0 · Jul 8: 0 · Jul 9: 0 · Jul 10: 2 · Jul 11: 1 · Jul 12: 0none
Full failure examples (3)
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-7rhzs8" for cluster "cluster-candidate-4-21-7rhzs8"
Unexpected error:
    <*fmt.wrapErrors | 0xc00278eba0>: 
    failed to create NodePool np-7rhzs8, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-7rhzs8 in resource group rg-candidate-4-21-c5mrcr, error: failed waiting for nodepool="np-7rhzs8" for cluster "cluster-candidate-4-21-7rhzs8" in resourcegroup="rg-candidate-4-21-c5mrcr" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-7rhzs8" for cluster "cluster-candidate-4-21-7rhzs8"
Unexpected error:
    <*fmt.wrapErrors | 0xc00278eba0>: 
    failed to create NodePool np-7rhzs8, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-7rhzs8 in resource group rg-candidate-4-21-c5mrcr, error: failed waiting for nodepool="np-7rhzs8" for cluster "cluster-candidate-4-21-7rhzs8" in resourcegroup="rg-candidate-4-21-c5mrcr" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc001451a40>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-jdcpr7, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-jdcpr7" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc001451a40>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-jdcpr7, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-jdcpr7" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc002648ae0>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-wwvmbg, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-wwvmbg" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapErrors | 0xc002648ae0>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group private-keyvault-wwvmbg, error: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-wwvmbg" to finish creating: context deadline exceeded
    ...
occurred
Contributing tests (2)
Failed AtJobTestSupport
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCreate HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API2
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.211
Affected runs (3)
Date (UTC)Associated PRProw job
n/a2075795979096821760
n/a2075531347568365568
n/a2075470437046816768
client rate limiter Wait returned an error: context deadline exceeded
full failure pattern:
client rate limiter Wait returned an error: context deadline exceeded
Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)
e2e28.33%2 of 24 job runs affectedIndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)Show trend detailsJul 5: 0 · Jul 6: 0 · Jul 7: 0 · Jul 8: 0 · Jul 9: 0 · Jul 10: 2 · Jul 11: 0 · Jul 12: 0none
Full failure examples (2)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc0012f23c0>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-9zw5pq, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-9zw5pq" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc0012f23c0>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-9zw5pq, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-9zw5pq" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc0024e2588>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-xz2mth, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-xz2mth" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc0024e2588>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-xz2mth, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-xz2mth" to finish creating: context deadline exceeded
    ...
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully2
Affected runs (2)
Date (UTC)Associated PRProw job
n/a2075531347568365568
n/a2075470437046816768
tls: failed to verify certificate: x509: certificate signed by unknown authority
full failure pattern:
tls: failed to verify certificate: x509: certificate signed by unknown authority
Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)
e2e14.17%1 of 24 job runs affectedIndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)Show trend detailsJul 5: 0 · Jul 6: 0 · Jul 7: 0 · Jul 8: 0 · Jul 9: 0 · Jul 10: 0 · Jul 11: 1 · Jul 12: 0none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:194]: failed to run simple web app and connectivity check with cilium CNI
Unexpected error:
    <*errors.joinError | 0xc00131c1b0>: 
    VerifySimpleWebApp failed: route was never reachable: Get "https://agnhost-e2e-serving-app-x5slv.apps.aro.cilium-cluster.f5i8.uksouth.aroapp-hcp.azure-test.net": tls: failed to verify certificate: x509: certificate signed by unknown authority
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:194]: failed to run simple web app and connectivity check with cilium CNI
Unexpected error:
    <*errors.joinError | 0xc00131c1b0>: 
    VerifySimpleWebApp failed: route was never reachable: Get "https://agnhost-e2e-serving-app-x5slv.apps.aro.cilium-cluster.f5i8.uksouth.aroapp-hcp.azure-test.net": tls: failed to verify certificate: x509: certificate signed by unknown authority
    ...
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully1
Affected runs (1)
Date (UTC)Associated PRProw job
n/a2075874054463557632
VerifyAllAPIServicesAvailable failed: failed to list all APIServices: the server was unable to return a response in the time allotted, but may still be processing the request (get...
full failure pattern:
VerifyAllAPIServicesAvailable failed: failed to list all APIServices: the server was unable to return a response in the time allotted, but may still be processing the request (get apiservices.apiregistration.k8s.io)
Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history
e2e14.17%1 of 24 job runs affectedIndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior historyShow trend detailsJul 5: 0 · Jul 6: 0 · Jul 7: 0 · Jul 8: 0 · Jul 9: 0 · Jul 10: 1 · Jul 11: 0 · Jul 12: 0none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:118]: failed to verify HCP cluster "cluster-candidate-4-22-jqz4vm" is viable
Unexpected error:
    <*errors.joinError | 0xc000e7ed50>: 
    VerifyAllAPIServicesAvailable failed: failed to list all APIServices: the server was unable to return a response in the time allotted, but may still be processing the request (get apiservices.apiregistration.k8s.io)
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:118]: failed to verify HCP cluster "cluster-candidate-4-22-jqz4vm" is viable
Unexpected error:
    <*errors.joinError | 0xc000e7ed50>: 
    VerifyAllAPIServicesAvailable failed: failed to list all APIServices: the server was unable to return a response in the time allotted, but may still be processing the request (get apiservices.apiregistration.k8s.io)
    ...
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.221
Affected runs (1)
Date (UTC)Associated PRProw job
n/a2075418155898900480
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: c...
full failure pattern:
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)
e2e14.17%1 of 24 job runs affectedIndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)Show trend detailsJul 5: 0 · Jul 6: 1 · Jul 7: 0 · Jul 8: 0 · Jul 9: 0 · Jul 10: 0 · Jul 11: 0 · Jul 12: 0none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc001680288>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-ntmhbf" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc001680288>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-ntmhbf" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
Contributing tests (1)
Failed AtJobTestSupport
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits1
Affected runs (1)
Date (UTC)Associated PRProw job
n/a2074163480042147840
failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: context deadline exceeded
full failure pattern:
failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: context deadline exceeded
Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history
e2e14.17%1 of 24 job runs affectedIndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior historyShow trend detailsJul 5: 0 · Jul 6: 0 · Jul 7: 0 · Jul 8: 0 · Jul 9: 0 · Jul 10: 1 · Jul 11: 0 · Jul 12: 0none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:194]: failed to create node pool version 4.19.7 for back-level cluster
Unexpected error:
    <*fmt.wrapError | 0xc000967c60>: 
    failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-ffwvvf" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:194]: failed to create node pool version 4.19.7 for back-level cluster
Unexpected error:
    <*fmt.wrapError | 0xc000967c60>: 
    failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-ffwvvf" to finish creating: context deadline exceeded
    ...
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should be able to create an HCP cluster with back-level version 4.191
Affected runs (1)
Date (UTC)Associated PRProw job
n/a2075470437046816768
node pool <nodepool> verification failed: <node> (release images unchanged: [quay
full failure pattern:
node pool <nodepool> verification failed: <node> (release images unchanged: [quay
Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history
e2e14.17%1 of 24 job runs affectedIndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior historyShow trend detailsJul 5: 0 · Jul 6: 0 · Jul 7: 0 · Jul 8: 0 · Jul 9: 0 · Jul 10: 1 · Jul 11: 0 · Jul 12: 0none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:363]: Timed out after 2700.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc002a45820>: 
    node pool upgrade verification failed: t9u7i7r5z0u0f6g-npnoedge-4-20-nljmf-cn2l4 (release images unchanged: [quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49872a7f5108c35a2a70813cd4cfd2b20c94310421ec77ff9948ca8825fd410b quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:95b5846e79dc56caada8d377dd0809a0e23170cd9a16844064c8661b2a074351 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9aa7d0ce36c6c9e21dba3eb58561a2ac480841c4aee3489555ac8b0693cf9792 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03674c1f4c7a736f4e508e4949f79781fbcc32ec4a9a9af7a05fca1df155dcb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a34a0212283a65c9888a43fb44dd00e91f14846de8637aca0451420bde858d3 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79afbddb9e92d39b3d596ab7641bd2df6388f61c95900a6f33b3719f61da9a4a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8fe828479c1d44400596894b789b76f7eca7c32a7e8dc1652d3e3cf9deef0b4c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f022aca801d827626015b39a818727c393706569b8a1b26997ce42a5e734ef62 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52fd6091be3180a20b3c0f7175528d8de586d72679f560dfe033a8bfbc50d749 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d031a12f5284ca0cdb903b10403e09024ac6f428f66f6dc0822166e597de8aa0 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:80849ffb79dd5c24c4ce31ac060045aa173ce440c6ee46e8c9810a30073a27b6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9455c0af32d052a722572a0ab297f14bddee06cd286c4dc1875909850245d126 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:390168836769c0fb1ca5c5b5e21dc91ea4f9cc8e21134af96e0df3ed8c190eea quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:964d14d4daf60f699f43bf96f42b492062a3b80b12dddfd0b8ade8a251aa7156 arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2453895ad86d62436e790e0b9399b87c47aa228300b27cc83cfd931a9db18a50 arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e72327cf36e1b290fa2bbdde3571f08b8547f307c28737a82a5986a58d9ff798 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:55a3180ddcb75c343c7121119c4661fb184c7f89419e6da067af8447ff133d43 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de4c4b8f254196ae36bae3333097127ac672624b9fda1c7645003044a18ddebe quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5deea0845bb90e9ad93d05b71b988e128a12b3b5514194c092bd5fe4ee64e30a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dfcc383e709c9bf641a1c9369a427d00d346f594b898cf6ead89d2cb7d8b9fa8 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c1669fe97d168a651be1742f5b51290d37e4d4bc29d40d8f692ae72fde848fe1 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8854bc764270010669d4052a64d0ce204d93654f9e0c60032f25ffb2b438664 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a8ae4c499eb77d64d2ad321959db0dbb6da86d25b389d7857465140067ef1e8 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b488f8b1cda2b5d2c9c9a0b55fcc9e687716f62fb101abea3f44b8fa46f6c814 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31de3e9201d7f6acc376533a32d765c5f3c64345eb76fbb8b5ac570599779eff quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39336d0bd9a5bda7d17078381982974c9b469aa6ff922e31af90f3906f8b0bce quay.io/openshift/origin-insights-runtime-extractor@sha256:c4f7b0c6eefe8b18e6d8a4bc11b3b70f951f811dd551b392ebf235730a8c1e97 quay.io/openshift/origin-insights-runtime-extractor@sha256:d6a4414d94942241301f29743a489515ee3bf951d9277de040d20882cd45204f quay.io/openshift/origin-insights-runtime-extractor:latest quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2efd2e8ee9f864488bd98cc4b7346441eead71b106714d194a48582778ea955b quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:772b39c6ffe1c00752ed64eb07bbe1b3e18291af33e620d88bababdeb014f259 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:14e343b365a3e0d1936de98c650a362b8bb67e15e660e486ea18a3f4a6901958 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eb6c92d8d659c35575582a0683a711c2b12bdc2f88fa5b5a7f15c715f0850610 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51bb8e10c10f1cf23d5f07d8be40052c6cdaadfdd2ea0d9c488e168f2d59e834 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf930626fb4371b445bab6a14f631296fcf4ca89f1a6153d102345d2e8364586 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b33b3e6f296ebaabaebb20d623afdd172d12f1d172cf64ced0cd4612bd7aba93 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd7dab5b6ec92b6eecefec17f84bb3df525692f39a44f3d8c22b4469e420f0f3 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1782613ad01fa0a4a02316ddc506eb9f25193fc85192d90c3dc7b3e1c8df6c5e quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c1e5e03b066b54b32f8e61a3e6714d71d93e676cd113c1342483c3c227098b53 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:56158f4279d0edce475b87f0d280bd2318ad69f5f493cc1b692d8d1d80468af4 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaeec8ad60ad3c1a0aad61f0a3ca7e9f40319cb933285c2309aa27b0328c58e quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ec6a34df50ec0d33c618e9fa65fab28e15a5d1daccdfa8e760203b6af9a428ca quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0b340013055bd8e5fa8c63eb7c43f2815dc7910133aefdd62c4563368ee0cc5 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b92b01af0f3247a78a0e1930a69319585a2bd6989f5dba0c86980f817116c0ca quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf37294d95facbac106adc7be7d65dfa2218304c856ba7c2a4087871d504a676 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:29abdffa3472c4cd393a24ce7b0461719bd75f923733d38ffcaebcb4e423d9fb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ec66a0352a04dc6720fdd3d5376cf08b9aefa435be938fc0408e71e58e946d2 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c891be7703b706b7159106152e6e4486b98fd84539ffbb25cb7b3d43745dbdc quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:18c7175de30b4a6c6bf570858ec4e6666eb06c05fe3715491395b4a8526df056 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:175405c2f6fd55278c5a3f2653f0eef00c820ea395aa10d738172ccdbad14442 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e061a904689f3f504f7d59d43abba799247859533b608d30c5e51572ff458344 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5147da14055c6f3099289420594595d5a4518a944e0991b2e9f407414b175e35 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66ad83f0a4e9d810ae14d8f5f496b0f33e1ca9149f7b0f275f9f82b04af22403 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:452ab0bdbbe681a49577a87b4aa186b900d8560774463af8416e593a55298966 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:96b91a67babd36515f2882267368aac2cf041e6a395a0a65d6f97d84f5e7dc11 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574a3d94ba37b2a60a0d85bb3d688697a876edbe1565c32e2410905479286ef1 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a95d05d15ae6b7058bec91857f86e4b9cad2d759b802ea21f99bf2ea87bc743 quay.io/openshift/origin-kube-rbac-proxy@sha256:9fa7c0125c5217797dcd586e7cc44e9c1d6a8f931bcb4d3eddaa2d1b0c27e2ce quay.io/openshift/origin-kube-rbac-proxy@sha256:d82c862da8fe5446edc0eb8fbed1f1f6bc38aac7d7c1586cad0e03d3efd6f90e quay.io/openshift/origin-kube-rbac-proxy:latest quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afa1bc6810004e8ba3d5b62fc9427140faaf97a9d4111edea7ba05633c14887d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e408af1e9140ce2a64aaea88dfde0c99590d678df2c014bc17c9e1b794176e99 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8b725b47b52c7be52d86d175edb923aa978aebc7f5e9afaca324e88ef82d4799 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91ba98bfe825bcee8abfe3c0d3a572b05e9d9ab4907185ac7a55977ce24fb659 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:08ff83a2fa217f58d41c9b7f92697a0f0398b1f0127cf4899eb61ccbd47d42cc quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a7ad4a4b377ba7fef68b6c05750b873bb300801160ce3bf163058fa0422d4b9a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:76fcc46e716184d91d90c399f8d5d9ba0f467d152fa5f9a7580c53edb6c0f6f6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87e95472f325cde0575df90da957cbcc6d648a9b03592f6ad30d87a63395d485 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:323c65b761730f56ab62e28fb90b0ee14fa4356fe1c5a84eab57abf07a254246 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:94a4b74543daf5de7586633fa3c4657be13423930eb1753919c11ba9e568bd6c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:595b18750ff93e47d4e7d14c78ed8e34cf6d279b40ac8acfc06650577d05b9b2 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:61282763ab3421a2739726257e8dde8a6eb84e4b97310f22b5fb846546ec89e1 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b9b70617918c933f0235987af7839bc0aae240513ace30e161d35606297eb0a7 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f7cdf181c5be46ea7673f39c72c2608fa818cdf73989ce70459336c5e8b852cf arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:01e2fdf4b300e93e446e290cc95919361258c9b30d9d5c7d7d285c8fec071c1d arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:372695628a11a3c10ccaf9448cf7c88fb4ffd5b93ae093f33a09039e5c76ade9 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7b9f8bf0f4d50d3c48cd2a8e4a0da9fdb64a620fbef6bbbe34f6e9e4b736e5d0 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f2f1ae49df9a4bdcacc996b2ae499724b4ed910a777cec0ded140fa0c36a67 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2cf5917237d38a7af496c3e13a5fd40bcefc7551533fded52122ddc8c456d0f8 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:507b4550ea19b0cffee516a0f351389b0f5a2779dcaf6b35f3b12ad5e8b2604b quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:005105ea5d7d66e28d1730eca894b3aa4f86339523e0b8b5c3b2c648cd8f8ab7 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6771519f53293e9f4bc620a4ac43a27a17006cd4250fae989bfa7ccb528a4055 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:62873ccfeff7b738a06610b557912d263821d8ac289ff940ae4fad7dc390c5ff quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:937e937c524cf8f6427d006c06d11fd2e26c3e6c43c249585253908582764193 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c29002002e8a35e0c45383629fb78a18a62a57e8840a9b9ed869b6fcb175d4fb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d5fd24d7fe4bca0f2a4652fae1eb3b5d43dec9763f9382cc7946edf7234cb6f5 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0021d24380d66ff22709f1112b3b6a89adc18e39649ccebe7d6ca8a881a12aa5 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:82c311d293189bbb494d9f1808a2b45cacbb46803ae79d35f040377c34a80091 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:07b52b7679384f272eb58640370fd9a1a723d5923d44670900baf9a2e4e55962 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0ffb119a4f12fb3446003c2b0b63d593700a2bd02b63f11a95cfc9e0a50c6047 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0701c9aeeaeb2a36b26e45a45d8e21331a388c61998795fa7584c7638b30b5e6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1caccc701d4e3b624c9d0a443c2fc4c5db30d9d33ecf6ae61ad87e67d5bafd3e quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3533a37bbf3fba120ce3ab531d8c79b62dd455011b44af5d7344c6e671deca88 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ba3bbfffecd7f528b413c07bb4b81f23b7bd130ce01e9642a9a96b0ff19766ce quay.io/openshift/origin-insights-runtime-exporter@sha256:4361ca1dc004b38547adeb65e35e05338ab7ab119e3d501838bc94a20acf7e02 quay.io/openshift/origin-insights-runtime-exporter@sha256:f955508b8f36095ebd2e9fdfed56acbf1712ede85970571261addbe9ec618927 quay.io/openshift/origin-insights-runtime-exporter:latest quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:272688971269d75b281897d5f3a36473bd730c9def89d6e2043ba93ebcb0d675 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43db5033175b5981ae608e6cc3b9a441a866185e107a29936fe635b2d6b00fff quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4b3a20d7c90468574cac63f0fa0394dbc14e20a1f1951b101e354a5ce0a58886 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6b6ee474e7b4ed3263df8ef3e15e2a9dc8da007d09adb430e76663008f33eca arohcpocpint.azurecr.io/redhat-user-workloads/crt-redhat-acm-tenant/hypershift-shared-ingress-main@sha256:03ff3448f5bb02f3a255eccd3c26730f65fdee658a5efb28ecad7e539bed9a8c arohcpocpint.azurecr.io/redhat-user-workloads/crt-redhat-acm-tenant/hypershift-shared-ingress-main@sha256:5e22710fe440869655329ecc0ef57b4ae15f4ef96e74a8904b1e6fafc0d87678]); nodes=[{"name":"t9u7i7r5z0u0f6g-npnoedge-4-20-gnhqt-2xqt4","ready":true,"containerRuntimeVersion":"cri-o://1.33.5-3.rhaos4.20.gitd0ea985.el9","releaseImages":["quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49872a7f5108c35a2a70813cd4cfd2b20c94310421ec77ff9948ca8825fd410b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:95b5846e79dc56caada8d377dd0809a0e23170cd9a16844064c8661b2a074351","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9aa7d0ce36c6c9e21dba3eb58561a2ac480841c4aee3489555ac8b0693cf9792","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03674c1f4c7a736f4e508e4949f79781fbcc32ec4a9a9af7a05fca1df155dcb","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a34a0212283a65c9888a43fb44dd00e91f14846de8637aca0451420bde858d3","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79afbddb9e92d39b3d596ab7641bd2df6388f61c95900a6f33b3719f61da9a4a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ab01ebc4da3cf2f0e0c305c300d337891b712cbacc9a885715b848c2ceedaf72","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0f023117cc59000a25c1b8adb7b4d32c5b0c1f84d8d49725a819a06848b143a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52fd6091be3180a20b3c0f7175528d8de586d72679f560dfe033a8bfbc50d749","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d031a12f5284ca0cdb903b10403e09024ac6f428f66f6dc0822166e597de8aa0","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2c6fef0789e2182aacb35cc8c3ae1a0847fb61306a4e134f67381c87c5e7b41c","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c42266c5731d12c45bdaa441d998cabe3dc707dbcc938b55de284b1dd02b5617","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:390168836769c0fb1ca5c5b5e21dc91ea4f9cc8e21134af96e0df3ed8c190eea","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:964d14d4daf60f699f43bf96f42b492062a3b80b12dddfd0b8ade8a251aa7156","arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2453895ad86d62436e790e0b9399b87c47aa228300b27cc83cfd931a9db18a50","arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e72327cf36e1b290fa2bbdde3571f08b8547f307c28737a82a5986a58d9ff798","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:55a3180ddcb75c343c7121119c4661fb184c7f89419e6da067af8447ff133d43","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de4c4b8f254196ae36bae3333097127ac672624b9fda1c7645003044a18ddebe","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5deea0845bb90e9ad93d05b71b988e128a12b3b5514194c092bd5fe4ee64e30a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dfcc383e709c9bf641a1c9369a427d00d346f594b898cf6ead89d2cb7d8b9fa8","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c1669fe97d168a651be1742f5b51290d37e4d4bc29d40d8f692ae72fde848fe1","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8854bc764270010669d4052a64d0ce204d93654f9e0c60032f25ffb2b438664","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8670caccf8fd94dc6d568dafd47a5cb5312a74ab5cd9d40daee38fdbce23e400","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fdfc454254a63d317a01a4689e1856df23fd40b5dc955bd7ef65574817e874a7","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31de3e9201d7f6acc376533a32d765c5f3c64345eb76fbb8b5ac570599779eff","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39336d0bd9a5bda7d17078381982974c9b469aa6ff922e31af90f3906f8b0bce","quay.io/openshift/origin-insights-runtime-extractor@sha256:c4f7b0c6eefe8b18e6d8a4bc11b3b70f951f811dd551b392ebf235730a8c1e97","quay.io/openshift/origin-insights-runtime-extractor@sha256:d6a4414d94942241301f29743a489515ee3bf951d9277de040d20882cd45204f","quay.io/openshift/origin-insights-runtime-extractor:latest","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2efd2e8ee9f864488bd98cc4b7346441eead71b106714d194a48582778ea955b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:772b39c6ffe1c00752ed64eb07bbe1b3e18291af33e620d88bababdeb014f259","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:060dd93bb12090a1a5a8183fa44345c4144afe06e53562a229d32b797579d91f","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26675cec341f0cac6c7beec942ebb89cb96091ec22d82928a769aa86076cc0e9","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51bb8e10c10f1cf23d5f07d8be40052c6cdaadfdd2ea0d9c488e168f2d59e834","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf930626fb4371b445bab6a14f631296fcf4ca89f1a6153d102345d2e8364586","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b33b3e6f296ebaabaebb20d623afdd172d12f1d172cf64ced0cd4612bd7aba93","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd7dab5b6ec92b6eecefec17f84bb3df525692f39a44f3d8c22b4469e420f0f3","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1782613ad01fa0a4a02316ddc506eb9f25193fc85192d90c3dc7b3e1c8df6c5e","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c1e5e03b066b54b32f8e61a3e6714d71d93e676cd113c1342483c3c227098b53","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c891be7703b706b7159106152e6e4486b98fd84539ffbb25cb7b3d43745dbdc","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:18c7175de30b4a6c6bf570858ec4e6666eb06c05fe3715491395b4a8526df056","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:175405c2f6fd55278c5a3f2653f0eef00c820ea395aa10d738172ccdbad14442","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e061a904689f3f504f7d59d43abba799247859533b608d30c5e51572ff458344","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5147da14055c6f3099289420594595d5a4518a944e0991b2e9f407414b175e35","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66ad83f0a4e9d810ae14d8f5f496b0f33e1ca9149f7b0f275f9f82b04af22403","quay.io/openshift/origin-kube-rbac-proxy@sha256:9fa7c0125c5217797dcd586e7cc44e9c1d6a8f931bcb4d3eddaa2d1b0c27e2ce","quay.io/openshift/origin-kube-rbac-proxy@sha256:d82c862da8fe5446edc0eb8fbed1f1f6bc38aac7d7c1586cad0e03d3efd6f90e","quay.io/openshift/origin-kube-rbac-proxy:latest","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afa1bc6810004e8ba3d5b62fc9427140faaf97a9d4111edea7ba05633c14887d","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e408af1e9140ce2a64aaea88dfde0c99590d678df2c014bc17c9e1b794176e99","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8b725b47b52c7be52d86d175edb923aa978aebc7f5e9afaca324e88ef82d4799","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91ba98bfe825bcee8abfe3c0d3a572b05e9d9ab4907185ac7a55977ce24fb659","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:08ff83a2fa217f58d41c9b7f92697a0f0398b1f0127cf4899eb61ccbd47d42cc","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a7ad4a4b377ba7fef68b6c05750b873bb300801160ce3bf163058fa0422d4b9a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:76fcc46e716184d91d90c399f8d5d9ba0f467d152fa5f9a7580c53edb6c0f6f6","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87e95472f325cde0575df90da957cbcc6d648a9b03592f6ad30d87a63395d485","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:323c65b761730f56ab62e28fb90b0ee14fa4356fe1c5a84eab57abf07a254246","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:94a4b74543daf5de7586633fa3c4657be13423930eb1753919c11ba9e568bd6c","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:595b18750ff93e47d4e7d14c78ed8e34cf6d279b40ac8acfc06650577d05b9b2","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:61282763ab3421a2739726257e8dde8a6eb84e4b97310f22b5fb846546ec89e1","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b9b70617918c933f0235987af7839bc0aae240513ace30e161d35606297eb0a7","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f7cdf181c5be46ea7673f39c72c2608fa818cdf73989ce70459336c5e8b852cf","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:57d8882dcb28ccccbd35821afa557262892bcff050828db3f9eaf3ed9fbb4bf7","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b15ad93fe5b61a5052cf6a1c551ada3f634be7f670c4cac1e46f530c22e80287","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7b9f8bf0f4d50d3c48cd2a8e4a0da9fdb64a620fbef6bbbe34f6e9e4b736e5d0","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f2f1ae49df9a4bdcacc996b2ae499724b4ed910a777cec0ded140fa0c36a67","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:083978421f8a145bf87cd50b5287d467d6badd5372dc5c8d326e0b39adfbb39f","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2de5fb1138dd771200317bb75011fb46416bf3690d1a1ada1c98146b20e0d18b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2cf5917237d38a7af496c3e13a5fd40bcefc7551533fded52122ddc8c456d0f8","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:507b4550ea19b0cffee516a0f351389b0f5a2779dcaf6b35f3b12ad5e8b2604b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c29002002e8a35e0c45383629fb78a18a62a57e8840a9b9ed869b6fcb175d4fb","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d5fd24d7fe4bca0f2a4652fae1eb3b5d43dec9763f9382cc7946edf7234cb6f5","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0021d24380d66ff22709f1112b3b6a89adc18e39649ccebe7d6ca8a881a12aa5","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:82c311d293189bbb494d9f1808a2b45cacbb46803ae79d35f040377c34a80091","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:07b52b7679384f272eb58640370fd9a1a723d5923d44670900baf9a2e4e55962","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0ffb119a4f12fb3446003c2b0b63d593700a2bd02b63f11a95cfc9e0a50c6047","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1f438988d355666032bdfa84a2b3f099d1eeaea3c56276f277d88ae0254612cc","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a2453a316238121955e8a40d322c993fdc1b35d39e110bd4a77edfcc41452fa","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0701c9aeeaeb2a36b26e45a45d8e21331a388c61998795fa7584c7638b30b5e6","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1caccc701d4e3b624c9d0a443c2fc4c5db30d9d33ecf6ae61ad87e67d5bafd3e","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3533a37bbf3fba120ce3ab531d8c79b62dd455011b44af5d7344c6e671deca88","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ba3bbfffecd7f528b413c07bb4b81f23b7bd130ce01e9642a9a96b0ff19766ce","quay.io/openshift/origin-insights-runtime-exporter@sha256:4361ca1dc004b38547adeb65e35e05338ab7ab119e3d501838bc94a20acf7e02","quay.io/openshift/origin-insights-runtime-exporter@sha256:f955508b8f36095ebd2e9fdfed56acbf1712ede85970571261addbe9ec618927","quay.io/openshift/origin-insights-runtime-exporter:latest","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:272688971269d75b281897d5f3a36473bd730c9def89d6e2043ba93ebcb0d675","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43db5033175b5981ae608e6cc3b9a441a866185e107a29936fe635b2d6b00fff","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4b3a20d7c90468574cac63f0fa0394dbc14e20a1f1951b101e354a5ce0a58886","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6b6ee474e7b4ed3263df8ef3e15e2a9dc8da007d09adb430e76663008f33eca","arohcpocpint.azurecr.io/redhat-user-workloads/crt-redhat-acm-tenant/hypershift-shared-ingress-main@sha256:03ff3448f5bb02f3a255eccd3c26730f65fdee658a5efb28ecad7e539bed9a8c","arohcpocpint.azurecr.io/redhat-user-workloads/crt-redhat-acm-tenant/hypershift-shared-ingress-main@sha256:5e22710fe440869655329ecc0ef57b4ae15f4ef96e74a8904b1e6fafc0d87678","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:83c44e8d52d7ecb23e2f680ddb3cf0e6824906ae92a35dae469ade6b44cee1b2","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd3463a9b86f0a8246307e8118cd039f095e07a1730f2125bf6611700395f1c5"]},{"name":"t9u7i7r5z0u0f6g-npnoedge-4-20-nljmf-cn2l4","ready":true,"containerRuntimeVersion":"cri-o://1.33.4-4.rhaos4.20.gitc8e7df2.el9","releaseImages":["quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49872a7f5108c35a2a70813cd4cfd2b20c94310421ec77ff9948ca8825fd410b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:95b5846e79dc56caada8d377dd0809a0e23170cd9a16844064c8661b2a074351","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9aa7d0ce36c6c9e21dba3eb58561a2ac480841c4aee3489555ac8b0693cf9792","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03674c1f4c7a736f4e508e4949f79781fbcc32ec4a9a9af7a05fca1df155dcb","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a34a0212283a65c9888a43fb44dd00e91f14846de8637aca0451420bde858d3","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79afbddb9e92d39b3d596ab7641bd2df6388f61c95900a6f33b3719f61da9a4a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8fe828479c1d44400596894b789b76f7eca7c32a7e8dc1652d3e3cf9deef0b4c","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f022aca801d827626015b39a818727c393706569b8a1b26997ce42a5e734ef62","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52fd6091be3180a20b3c0f7175528d8de586d72679f560dfe033a8bfbc50d749","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d031a12f5284ca0cdb903b10403e09024ac6f428f66f6dc0822166e597de8aa0","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:80849ffb79dd5c24c4ce31ac060045aa173ce440c6ee46e8c9810a30073a27b6","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9455c0af32d052a722572a0ab297f14bddee06cd286c4dc1875909850245d126","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:390168836769c0fb1ca5c5b5e21dc91ea4f9cc8e21134af96e0df3ed8c190eea","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:964d14d4daf60f699f43bf96f42b492062a3b80b12dddfd0b8ade8a251aa7156","arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2453895ad86d62436e790e0b9399b87c47aa228300b27cc83cfd931a9db18a50","arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e72327cf36e1b290fa2bbdde3571f08b8547f307c28737a82a5986a58d9ff798","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:55a3180ddcb75c343c7121119c4661fb184c7f89419e6da067af8447ff133d43","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de4c4b8f254196ae36bae3333097127ac672624b9fda1c7645003044a18ddebe","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5deea0845bb90e9ad93d05b71b988e128a12b3b5514194c092bd5fe4ee64e30a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dfcc383e709c9bf641a1c9369a427d00d346f594b898cf6ead89d2cb7d8b9fa8","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c1669fe97d168a651be1742f5b51290d37e4d4bc29d40d8f692ae72fde848fe1","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8854bc764270010669d4052a64d0ce204d93654f9e0c60032f25ffb2b438664","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a8ae4c499eb77d64d2ad321959db0dbb6da86d25b389d7857465140067ef1e8","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b488f8b1cda2b5d2c9c9a0b55fcc9e687716f62fb101abea3f44b8fa46f6c814","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31de3e9201d7f6acc376533a32d765c5f3c64345eb76fbb8b5ac570599779eff","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39336d0bd9a5bda7d17078381982974c9b469aa6ff922e31af90f3906f8b0bce","quay.io/openshift/origin-insights-runtime-extractor@sha256:c4f7b0c6eefe8b18e6d8a4bc11b3b70f951f811dd551b392ebf235730a8c1e97","quay.io/openshift/origin-insights-runtime-extractor@sha256:d6a4414d94942241301f29743a489515ee3bf951d9277de040d20882cd45204f","quay.io/openshift/origin-insights-runtime-extractor:latest","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2efd2e8ee9f864488bd98cc4b7346441eead71b106714d194a48582778ea955b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:772b39c6ffe1c00752ed64eb07bbe1b3e18291af33e620d88bababdeb014f259","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:14e343b365a3e0d1936de98c650a362b8bb67e15e660e486ea18a3f4a6901958","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eb6c92d8d659c35575582a0683a711c2b12bdc2f88fa5b5a7f15c715f0850610","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51bb8e10c10f1cf23d5f07d8be40052c6cdaadfdd2ea0d9c488e168f2d59e834","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf930626fb4371b445bab6a14f631296fcf4ca89f1a6153d102345d2e8364586","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b33b3e6f296ebaabaebb20d623afdd172d12f1d172cf64ced0cd4612bd7aba93","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd7dab5b6ec92b6eecefec17f84bb3df525692f39a44f3d8c22b4469e420f0f3","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1782613ad01fa0a4a02316ddc506eb9f25193fc85192d90c3dc7b3e1c8df6c5e","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c1e5e03b066b54b32f8e61a3e6714d71d93e676cd113c1342483c3c227098b53","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:56158f4279d0edce475b87f0d280bd2318ad69f5f493cc1b692d8d1d80468af4","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaeec8ad60ad3c1a0aad61f0a3ca7e9f40319cb933285c2309aa27b0328c58e","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ec6a34df50ec0d33c618e9fa65fab28e15a5d1daccdfa8e760203b6af9a428ca","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0b340013055bd8e5fa8c63eb7c43f2815dc7910133aefdd62c4563368ee0cc5","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b92b01af0f3247a78a0e1930a69319585a2bd6989f5dba0c86980f817116c0ca","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf37294d95facbac106adc7be7d65dfa2218304c856ba7c2a4087871d504a676","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:29abdffa3472c4cd393a24ce7b0461719bd75f923733d38ffcaebcb4e423d9fb","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ec66a0352a04dc6720fdd3d5376cf08b9aefa435be938fc0408e71e58e946d2","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c891be7703b706b7159106152e6e4486b98fd84539ffbb25cb7b3d43745dbdc","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:18c7175de30b4a6c6bf570858ec4e6666eb06c05fe3715491395b4a8526df056","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:175405c2f6fd55278c5a3f2653f0eef00c820ea395aa10d738172ccdbad14442","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e061a904689f3f504f7d59d43abba799247859533b608d30c5e51572ff458344","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5147da14055c6f3099289420594595d5a4518a944e0991b2e9f407414b175e35","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66ad83f0a4e9d810ae14d8f5f496b0f33e1ca9149f7b0f275f9f82b04af22403","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:452ab0bdbbe681a49577a87b4aa186b900d8560774463af8416e593a55298966","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:96b91a67babd36515f2882267368aac2cf041e6a395a0a65d6f97d84f5e7dc11","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574a3d94ba37b2a60a0d85bb3d688697a876edbe1565c32e2410905479286ef1","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a95d05d15ae6b7058bec91857f86e4b9cad2d759b802ea21f99bf2ea87bc743","quay.io/openshift/origin-kube-rbac-proxy@sha256:9fa7c0125c5217797dcd586e7cc44e9c1d6a8f931bcb4d3eddaa2d1b0c27e2ce","quay.io/openshift/origin-kube-rbac-proxy@sha256:d82c862da8fe5446edc0eb8fbed1f1f6bc38aac7d7c1586cad0e03d3efd6f90e","quay.io/openshift/origin-kube-rbac-proxy:latest","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afa1bc6810004e8ba3d5b62fc9427140faaf97a9d4111edea7ba05633c14887d","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e408af1e9140ce2a64aaea88dfde0c99590d678df2c014bc17c9e1b794176e99","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8b725b47b52c7be52d86d175edb923aa978aebc7f5e9afaca324e88ef82d4799","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91ba98bfe825bcee8abfe3c0d3a572b05e9d9ab4907185ac7a55977ce24fb659","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:08ff83a2fa217f58d41c9b7f92697a0f0398b1f0127cf4899eb61ccbd47d42cc","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a7ad4a4b377ba7fef68b6c05750b873bb300801160ce3bf163058fa0422d4b9a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:76fcc46e716184d91d90c399f8d5d9ba0f467d152fa5f9a7580c53edb6c0f6f6","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87e95472f325cde0575df90da957cbcc6d648a9b03592f6ad30d87a63395d485","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:323c65b761730f56ab62e28fb90b0ee14fa4356fe1c5a84eab57abf07a254246","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:94a4b74543daf5de7586633fa3c4657be13423930eb1753919c11ba9e568bd6c","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:595b18750ff93e47d4e7d14c78ed8e34cf6d279b40ac8acfc06650577d05b9b2","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:61282763ab3421a2739726257e8dde8a6eb84e4b97310f22b5fb846546ec89e1","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b9b70617918c933f0235987af7839bc0aae240513ace30e161d35606297eb0a7","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f7cdf181c5be46ea7673f39c72c2608fa818cdf73989ce70459336c5e8b852cf","arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:01e2fdf4b300e93e446e290cc95919361258c9b30d9d5c7d7d285c8fec071c1d","arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:372695628a11a3c10ccaf9448cf7c88fb4ffd5b93ae093f33a09039e5c76ade9","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7b9f8bf0f4d50d3c48cd2a8e4a0da9fdb64a620fbef6bbbe34f6e9e4b736e5d0","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f2f1ae49df9a4bdcacc996b2ae499724b4ed910a777cec0ded140fa0c36a67","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2cf5917237d38a7af496c3e13a5fd40bcefc7551533fded52122ddc8c456d0f8","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:507b4550ea19b0cffee516a0f351389b0f5a2779dcaf6b35f3b12ad5e8b2604b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:005105ea5d7d66e28d1730eca894b3aa4f86339523e0b8b5c3b2c648cd8f8ab7","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6771519f53293e9f4bc620a4ac43a27a17006cd4250fae989bfa7ccb528a4055","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:62873ccfeff7b738a06610b557912d263821d8ac289ff940ae4fad7dc390c5ff","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:937e937c524cf8f6427d006c06d11fd2e26c3e6c43c249585253908582764193","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c29002002e8a35e0c45383629fb78a18a62a57e8840a9b9ed869b6fcb175d4fb","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d5fd24d7fe4bca0f2a4652fae1eb3b5d43dec9763f9382cc7946edf7234cb6f5","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0021d24380d66ff22709f1112b3b6a89adc18e39649ccebe7d6ca8a881a12aa5","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:82c311d293189bbb494d9f1808a2b45cacbb46803ae79d35f040377c34a80091","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:07b52b7679384f272eb58640370fd9a1a723d5923d44670900baf9a2e4e55962","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0ffb119a4f12fb3446003c2b0b63d593700a2bd02b63f11a95cfc9e0a50c6047","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0701c9aeeaeb2a36b26e45a45d8e21331a388c61998795fa7584c7638b30b5e6","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1caccc701d4e3b624c9d0a443c2fc4c5db30d9d33ecf6ae61ad87e67d5bafd3e","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3533a37bbf3fba120ce3ab531d8c79b62dd455011b44af5d7344c6e671deca88","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ba3bbfffecd7f528b413c07bb4b81f23b7bd130ce01e9642a9a96b0ff19766ce","quay.io/openshift/origin-insights-runtime-exporter@sha256:4361ca1dc004b38547adeb65e35e05338ab7ab119e3d501838bc94a20acf7e02","quay.io/openshift/origin-insights-runtime-exporter@sha256:f955508b8f36095ebd2e9fdfed56acbf1712ede85970571261addbe9ec618927","quay.io/openshift/origin-insights-runtime-exporter:latest","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:272688971269d75b281897d5f3a36473bd730c9def89d6e2043ba93ebcb0d675","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43db5033175b5981ae608e6cc3b9a441a866185e107a29936fe635b2d6b00fff","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4b3a20d7c90468574cac63f0fa0394dbc14e20a1f1951b101e354a5ce0a58886","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6b6ee474e7b4ed3263df8ef3e15e2a9dc8da007d09adb430e76663008f33eca","arohcpocpint.azurecr.io/redhat-user-workloads/crt-redhat-acm-tenant/hypershift-shared-ingress-main@sha256:03ff3448f5bb02f3a255eccd3c26730f65fdee658a5efb28ecad7e539bed9a8c","arohcpocpint.azurecr.io/redhat-user-workloads/crt-redhat-acm-tenant/hypershift-shared-ingress-main@sha256:5e22710fe440869655329ecc0ef57b4ae15f4ef96e74a8904b1e6fafc0d87678"]}]
    ...
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:363]: Timed out after 2700.001s.
Expected success, but got an error:
    <*errors.errorString | 0xc002a45820>: 
    node pool upgrade verification failed: t9u7i7r5z0u0f6g-npnoedge-4-20-nljmf-cn2l4 (release images unchanged: [quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49872a7f5108c35a2a70813cd4cfd2b20c94310421ec77ff9948ca8825fd410b quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:95b5846e79dc56caada8d377dd0809a0e23170cd9a16844064c8661b2a074351 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9aa7d0ce36c6c9e21dba3eb58561a2ac480841c4aee3489555ac8b0693cf9792 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03674c1f4c7a736f4e508e4949f79781fbcc32ec4a9a9af7a05fca1df155dcb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a34a0212283a65c9888a43fb44dd00e91f14846de8637aca0451420bde858d3 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79afbddb9e92d39b3d596ab7641bd2df6388f61c95900a6f33b3719f61da9a4a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8fe828479c1d44400596894b789b76f7eca7c32a7e8dc1652d3e3cf9deef0b4c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f022aca801d827626015b39a818727c393706569b8a1b26997ce42a5e734ef62 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52fd6091be3180a20b3c0f7175528d8de586d72679f560dfe033a8bfbc50d749 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d031a12f5284ca0cdb903b10403e09024ac6f428f66f6dc0822166e597de8aa0 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:80849ffb79dd5c24c4ce31ac060045aa173ce440c6ee46e8c9810a30073a27b6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9455c0af32d052a722572a0ab297f14bddee06cd286c4dc1875909850245d126 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:390168836769c0fb1ca5c5b5e21dc91ea4f9cc8e21134af96e0df3ed8c190eea quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:964d14d4daf60f699f43bf96f42b492062a3b80b12dddfd0b8ade8a251aa7156 arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2453895ad86d62436e790e0b9399b87c47aa228300b27cc83cfd931a9db18a50 arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e72327cf36e1b290fa2bbdde3571f08b8547f307c28737a82a5986a58d9ff798 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:55a3180ddcb75c343c7121119c4661fb184c7f89419e6da067af8447ff133d43 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de4c4b8f254196ae36bae3333097127ac672624b9fda1c7645003044a18ddebe quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5deea0845bb90e9ad93d05b71b988e128a12b3b5514194c092bd5fe4ee64e30a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dfcc383e709c9bf641a1c9369a427d00d346f594b898cf6ead89d2cb7d8b9fa8 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c1669fe97d168a651be1742f5b51290d37e4d4bc29d40d8f692ae72fde848fe1 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8854bc764270010669d4052a64d0ce204d93654f9e0c60032f25ffb2b438664 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a8ae4c499eb77d64d2ad321959db0dbb6da86d25b389d7857465140067ef1e8 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b488f8b1cda2b5d2c9c9a0b55fcc9e687716f62fb101abea3f44b8fa46f6c814 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31de3e9201d7f6acc376533a32d765c5f3c64345eb76fbb8b5ac570599779eff quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39336d0bd9a5bda7d17078381982974c9b469aa6ff922e31af90f3906f8b0bce quay.io/openshift/origin-insights-runtime-extractor@sha256:c4f7b0c6eefe8b18e6d8a4bc11b3b70f951f811dd551b392ebf235730a8c1e97 quay.io/openshift/origin-insights-runtime-extractor@sha256:d6a4414d94942241301f29743a489515ee3bf951d9277de040d20882cd45204f quay.io/openshift/origin-insights-runtime-extractor:latest quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2efd2e8ee9f864488bd98cc4b7346441eead71b106714d194a48582778ea955b quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:772b39c6ffe1c00752ed64eb07bbe1b3e18291af33e620d88bababdeb014f259 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:14e343b365a3e0d1936de98c650a362b8bb67e15e660e486ea18a3f4a6901958 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eb6c92d8d659c35575582a0683a711c2b12bdc2f88fa5b5a7f15c715f0850610 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51bb8e10c10f1cf23d5f07d8be40052c6cdaadfdd2ea0d9c488e168f2d59e834 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf930626fb4371b445bab6a14f631296fcf4ca89f1a6153d102345d2e8364586 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b33b3e6f296ebaabaebb20d623afdd172d12f1d172cf64ced0cd4612bd7aba93 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd7dab5b6ec92b6eecefec17f84bb3df525692f39a44f3d8c22b4469e420f0f3 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1782613ad01fa0a4a02316ddc506eb9f25193fc85192d90c3dc7b3e1c8df6c5e quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c1e5e03b066b54b32f8e61a3e6714d71d93e676cd113c1342483c3c227098b53 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:56158f4279d0edce475b87f0d280bd2318ad69f5f493cc1b692d8d1d80468af4 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaeec8ad60ad3c1a0aad61f0a3ca7e9f40319cb933285c2309aa27b0328c58e quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ec6a34df50ec0d33c618e9fa65fab28e15a5d1daccdfa8e760203b6af9a428ca quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0b340013055bd8e5fa8c63eb7c43f2815dc7910133aefdd62c4563368ee0cc5 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b92b01af0f3247a78a0e1930a69319585a2bd6989f5dba0c86980f817116c0ca quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf37294d95facbac106adc7be7d65dfa2218304c856ba7c2a4087871d504a676 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:29abdffa3472c4cd393a24ce7b0461719bd75f923733d38ffcaebcb4e423d9fb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ec66a0352a04dc6720fdd3d5376cf08b9aefa435be938fc0408e71e58e946d2 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c891be7703b706b7159106152e6e4486b98fd84539ffbb25cb7b3d43745dbdc quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:18c7175de30b4a6c6bf570858ec4e6666eb06c05fe3715491395b4a8526df056 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:175405c2f6fd55278c5a3f2653f0eef00c820ea395aa10d738172ccdbad14442 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e061a904689f3f504f7d59d43abba799247859533b608d30c5e51572ff458344 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5147da14055c6f3099289420594595d5a4518a944e0991b2e9f407414b175e35 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66ad83f0a4e9d810ae14d8f5f496b0f33e1ca9149f7b0f275f9f82b04af22403 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:452ab0bdbbe681a49577a87b4aa186b900d8560774463af8416e593a55298966 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:96b91a67babd36515f2882267368aac2cf041e6a395a0a65d6f97d84f5e7dc11 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574a3d94ba37b2a60a0d85bb3d688697a876edbe1565c32e2410905479286ef1 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a95d05d15ae6b7058bec91857f86e4b9cad2d759b802ea21f99bf2ea87bc743 quay.io/openshift/origin-kube-rbac-proxy@sha256:9fa7c0125c5217797dcd586e7cc44e9c1d6a8f931bcb4d3eddaa2d1b0c27e2ce quay.io/openshift/origin-kube-rbac-proxy@sha256:d82c862da8fe5446edc0eb8fbed1f1f6bc38aac7d7c1586cad0e03d3efd6f90e quay.io/openshift/origin-kube-rbac-proxy:latest quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afa1bc6810004e8ba3d5b62fc9427140faaf97a9d4111edea7ba05633c14887d quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e408af1e9140ce2a64aaea88dfde0c99590d678df2c014bc17c9e1b794176e99 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8b725b47b52c7be52d86d175edb923aa978aebc7f5e9afaca324e88ef82d4799 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91ba98bfe825bcee8abfe3c0d3a572b05e9d9ab4907185ac7a55977ce24fb659 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:08ff83a2fa217f58d41c9b7f92697a0f0398b1f0127cf4899eb61ccbd47d42cc quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a7ad4a4b377ba7fef68b6c05750b873bb300801160ce3bf163058fa0422d4b9a quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:76fcc46e716184d91d90c399f8d5d9ba0f467d152fa5f9a7580c53edb6c0f6f6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87e95472f325cde0575df90da957cbcc6d648a9b03592f6ad30d87a63395d485 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:323c65b761730f56ab62e28fb90b0ee14fa4356fe1c5a84eab57abf07a254246 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:94a4b74543daf5de7586633fa3c4657be13423930eb1753919c11ba9e568bd6c quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:595b18750ff93e47d4e7d14c78ed8e34cf6d279b40ac8acfc06650577d05b9b2 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:61282763ab3421a2739726257e8dde8a6eb84e4b97310f22b5fb846546ec89e1 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b9b70617918c933f0235987af7839bc0aae240513ace30e161d35606297eb0a7 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f7cdf181c5be46ea7673f39c72c2608fa818cdf73989ce70459336c5e8b852cf arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:01e2fdf4b300e93e446e290cc95919361258c9b30d9d5c7d7d285c8fec071c1d arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:372695628a11a3c10ccaf9448cf7c88fb4ffd5b93ae093f33a09039e5c76ade9 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7b9f8bf0f4d50d3c48cd2a8e4a0da9fdb64a620fbef6bbbe34f6e9e4b736e5d0 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f2f1ae49df9a4bdcacc996b2ae499724b4ed910a777cec0ded140fa0c36a67 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2cf5917237d38a7af496c3e13a5fd40bcefc7551533fded52122ddc8c456d0f8 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:507b4550ea19b0cffee516a0f351389b0f5a2779dcaf6b35f3b12ad5e8b2604b quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:005105ea5d7d66e28d1730eca894b3aa4f86339523e0b8b5c3b2c648cd8f8ab7 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6771519f53293e9f4bc620a4ac43a27a17006cd4250fae989bfa7ccb528a4055 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:62873ccfeff7b738a06610b557912d263821d8ac289ff940ae4fad7dc390c5ff quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:937e937c524cf8f6427d006c06d11fd2e26c3e6c43c249585253908582764193 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c29002002e8a35e0c45383629fb78a18a62a57e8840a9b9ed869b6fcb175d4fb quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d5fd24d7fe4bca0f2a4652fae1eb3b5d43dec9763f9382cc7946edf7234cb6f5 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0021d24380d66ff22709f1112b3b6a89adc18e39649ccebe7d6ca8a881a12aa5 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:82c311d293189bbb494d9f1808a2b45cacbb46803ae79d35f040377c34a80091 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:07b52b7679384f272eb58640370fd9a1a723d5923d44670900baf9a2e4e55962 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0ffb119a4f12fb3446003c2b0b63d593700a2bd02b63f11a95cfc9e0a50c6047 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0701c9aeeaeb2a36b26e45a45d8e21331a388c61998795fa7584c7638b30b5e6 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1caccc701d4e3b624c9d0a443c2fc4c5db30d9d33ecf6ae61ad87e67d5bafd3e quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3533a37bbf3fba120ce3ab531d8c79b62dd455011b44af5d7344c6e671deca88 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ba3bbfffecd7f528b413c07bb4b81f23b7bd130ce01e9642a9a96b0ff19766ce quay.io/openshift/origin-insights-runtime-exporter@sha256:4361ca1dc004b38547adeb65e35e05338ab7ab119e3d501838bc94a20acf7e02 quay.io/openshift/origin-insights-runtime-exporter@sha256:f955508b8f36095ebd2e9fdfed56acbf1712ede85970571261addbe9ec618927 quay.io/openshift/origin-insights-runtime-exporter:latest quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:272688971269d75b281897d5f3a36473bd730c9def89d6e2043ba93ebcb0d675 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43db5033175b5981ae608e6cc3b9a441a866185e107a29936fe635b2d6b00fff quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4b3a20d7c90468574cac63f0fa0394dbc14e20a1f1951b101e354a5ce0a58886 quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6b6ee474e7b4ed3263df8ef3e15e2a9dc8da007d09adb430e76663008f33eca arohcpocpint.azurecr.io/redhat-user-workloads/crt-redhat-acm-tenant/hypershift-shared-ingress-main@sha256:03ff3448f5bb02f3a255eccd3c26730f65fdee658a5efb28ecad7e539bed9a8c arohcpocpint.azurecr.io/redhat-user-workloads/crt-redhat-acm-tenant/hypershift-shared-ingress-main@sha256:5e22710fe440869655329ecc0ef57b4ae15f4ef96e74a8904b1e6fafc0d87678]); nodes=[{"name":"t9u7i7r5z0u0f6g-npnoedge-4-20-gnhqt-2xqt4","ready":true,"containerRuntimeVersion":"cri-o://1.33.5-3.rhaos4.20.gitd0ea985.el9","releaseImages":["quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49872a7f5108c35a2a70813cd4cfd2b20c94310421ec77ff9948ca8825fd410b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:95b5846e79dc56caada8d377dd0809a0e23170cd9a16844064c8661b2a074351","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9aa7d0ce36c6c9e21dba3eb58561a2ac480841c4aee3489555ac8b0693cf9792","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03674c1f4c7a736f4e508e4949f79781fbcc32ec4a9a9af7a05fca1df155dcb","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a34a0212283a65c9888a43fb44dd00e91f14846de8637aca0451420bde858d3","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79afbddb9e92d39b3d596ab7641bd2df6388f61c95900a6f33b3719f61da9a4a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ab01ebc4da3cf2f0e0c305c300d337891b712cbacc9a885715b848c2ceedaf72","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0f023117cc59000a25c1b8adb7b4d32c5b0c1f84d8d49725a819a06848b143a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52fd6091be3180a20b3c0f7175528d8de586d72679f560dfe033a8bfbc50d749","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d031a12f5284ca0cdb903b10403e09024ac6f428f66f6dc0822166e597de8aa0","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2c6fef0789e2182aacb35cc8c3ae1a0847fb61306a4e134f67381c87c5e7b41c","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c42266c5731d12c45bdaa441d998cabe3dc707dbcc938b55de284b1dd02b5617","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:390168836769c0fb1ca5c5b5e21dc91ea4f9cc8e21134af96e0df3ed8c190eea","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:964d14d4daf60f699f43bf96f42b492062a3b80b12dddfd0b8ade8a251aa7156","arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2453895ad86d62436e790e0b9399b87c47aa228300b27cc83cfd931a9db18a50","arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e72327cf36e1b290fa2bbdde3571f08b8547f307c28737a82a5986a58d9ff798","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:55a3180ddcb75c343c7121119c4661fb184c7f89419e6da067af8447ff133d43","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de4c4b8f254196ae36bae3333097127ac672624b9fda1c7645003044a18ddebe","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5deea0845bb90e9ad93d05b71b988e128a12b3b5514194c092bd5fe4ee64e30a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dfcc383e709c9bf641a1c9369a427d00d346f594b898cf6ead89d2cb7d8b9fa8","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c1669fe97d168a651be1742f5b51290d37e4d4bc29d40d8f692ae72fde848fe1","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8854bc764270010669d4052a64d0ce204d93654f9e0c60032f25ffb2b438664","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8670caccf8fd94dc6d568dafd47a5cb5312a74ab5cd9d40daee38fdbce23e400","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fdfc454254a63d317a01a4689e1856df23fd40b5dc955bd7ef65574817e874a7","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31de3e9201d7f6acc376533a32d765c5f3c64345eb76fbb8b5ac570599779eff","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39336d0bd9a5bda7d17078381982974c9b469aa6ff922e31af90f3906f8b0bce","quay.io/openshift/origin-insights-runtime-extractor@sha256:c4f7b0c6eefe8b18e6d8a4bc11b3b70f951f811dd551b392ebf235730a8c1e97","quay.io/openshift/origin-insights-runtime-extractor@sha256:d6a4414d94942241301f29743a489515ee3bf951d9277de040d20882cd45204f","quay.io/openshift/origin-insights-runtime-extractor:latest","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2efd2e8ee9f864488bd98cc4b7346441eead71b106714d194a48582778ea955b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:772b39c6ffe1c00752ed64eb07bbe1b3e18291af33e620d88bababdeb014f259","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:060dd93bb12090a1a5a8183fa44345c4144afe06e53562a229d32b797579d91f","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:26675cec341f0cac6c7beec942ebb89cb96091ec22d82928a769aa86076cc0e9","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51bb8e10c10f1cf23d5f07d8be40052c6cdaadfdd2ea0d9c488e168f2d59e834","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf930626fb4371b445bab6a14f631296fcf4ca89f1a6153d102345d2e8364586","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b33b3e6f296ebaabaebb20d623afdd172d12f1d172cf64ced0cd4612bd7aba93","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd7dab5b6ec92b6eecefec17f84bb3df525692f39a44f3d8c22b4469e420f0f3","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1782613ad01fa0a4a02316ddc506eb9f25193fc85192d90c3dc7b3e1c8df6c5e","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c1e5e03b066b54b32f8e61a3e6714d71d93e676cd113c1342483c3c227098b53","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c891be7703b706b7159106152e6e4486b98fd84539ffbb25cb7b3d43745dbdc","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:18c7175de30b4a6c6bf570858ec4e6666eb06c05fe3715491395b4a8526df056","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:175405c2f6fd55278c5a3f2653f0eef00c820ea395aa10d738172ccdbad14442","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e061a904689f3f504f7d59d43abba799247859533b608d30c5e51572ff458344","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5147da14055c6f3099289420594595d5a4518a944e0991b2e9f407414b175e35","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66ad83f0a4e9d810ae14d8f5f496b0f33e1ca9149f7b0f275f9f82b04af22403","quay.io/openshift/origin-kube-rbac-proxy@sha256:9fa7c0125c5217797dcd586e7cc44e9c1d6a8f931bcb4d3eddaa2d1b0c27e2ce","quay.io/openshift/origin-kube-rbac-proxy@sha256:d82c862da8fe5446edc0eb8fbed1f1f6bc38aac7d7c1586cad0e03d3efd6f90e","quay.io/openshift/origin-kube-rbac-proxy:latest","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afa1bc6810004e8ba3d5b62fc9427140faaf97a9d4111edea7ba05633c14887d","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e408af1e9140ce2a64aaea88dfde0c99590d678df2c014bc17c9e1b794176e99","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8b725b47b52c7be52d86d175edb923aa978aebc7f5e9afaca324e88ef82d4799","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91ba98bfe825bcee8abfe3c0d3a572b05e9d9ab4907185ac7a55977ce24fb659","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:08ff83a2fa217f58d41c9b7f92697a0f0398b1f0127cf4899eb61ccbd47d42cc","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a7ad4a4b377ba7fef68b6c05750b873bb300801160ce3bf163058fa0422d4b9a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:76fcc46e716184d91d90c399f8d5d9ba0f467d152fa5f9a7580c53edb6c0f6f6","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87e95472f325cde0575df90da957cbcc6d648a9b03592f6ad30d87a63395d485","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:323c65b761730f56ab62e28fb90b0ee14fa4356fe1c5a84eab57abf07a254246","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:94a4b74543daf5de7586633fa3c4657be13423930eb1753919c11ba9e568bd6c","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:595b18750ff93e47d4e7d14c78ed8e34cf6d279b40ac8acfc06650577d05b9b2","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:61282763ab3421a2739726257e8dde8a6eb84e4b97310f22b5fb846546ec89e1","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b9b70617918c933f0235987af7839bc0aae240513ace30e161d35606297eb0a7","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f7cdf181c5be46ea7673f39c72c2608fa818cdf73989ce70459336c5e8b852cf","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:57d8882dcb28ccccbd35821afa557262892bcff050828db3f9eaf3ed9fbb4bf7","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b15ad93fe5b61a5052cf6a1c551ada3f634be7f670c4cac1e46f530c22e80287","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7b9f8bf0f4d50d3c48cd2a8e4a0da9fdb64a620fbef6bbbe34f6e9e4b736e5d0","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f2f1ae49df9a4bdcacc996b2ae499724b4ed910a777cec0ded140fa0c36a67","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:083978421f8a145bf87cd50b5287d467d6badd5372dc5c8d326e0b39adfbb39f","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2de5fb1138dd771200317bb75011fb46416bf3690d1a1ada1c98146b20e0d18b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2cf5917237d38a7af496c3e13a5fd40bcefc7551533fded52122ddc8c456d0f8","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:507b4550ea19b0cffee516a0f351389b0f5a2779dcaf6b35f3b12ad5e8b2604b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c29002002e8a35e0c45383629fb78a18a62a57e8840a9b9ed869b6fcb175d4fb","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d5fd24d7fe4bca0f2a4652fae1eb3b5d43dec9763f9382cc7946edf7234cb6f5","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0021d24380d66ff22709f1112b3b6a89adc18e39649ccebe7d6ca8a881a12aa5","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:82c311d293189bbb494d9f1808a2b45cacbb46803ae79d35f040377c34a80091","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:07b52b7679384f272eb58640370fd9a1a723d5923d44670900baf9a2e4e55962","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0ffb119a4f12fb3446003c2b0b63d593700a2bd02b63f11a95cfc9e0a50c6047","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1f438988d355666032bdfa84a2b3f099d1eeaea3c56276f277d88ae0254612cc","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a2453a316238121955e8a40d322c993fdc1b35d39e110bd4a77edfcc41452fa","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0701c9aeeaeb2a36b26e45a45d8e21331a388c61998795fa7584c7638b30b5e6","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1caccc701d4e3b624c9d0a443c2fc4c5db30d9d33ecf6ae61ad87e67d5bafd3e","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3533a37bbf3fba120ce3ab531d8c79b62dd455011b44af5d7344c6e671deca88","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ba3bbfffecd7f528b413c07bb4b81f23b7bd130ce01e9642a9a96b0ff19766ce","quay.io/openshift/origin-insights-runtime-exporter@sha256:4361ca1dc004b38547adeb65e35e05338ab7ab119e3d501838bc94a20acf7e02","quay.io/openshift/origin-insights-runtime-exporter@sha256:f955508b8f36095ebd2e9fdfed56acbf1712ede85970571261addbe9ec618927","quay.io/openshift/origin-insights-runtime-exporter:latest","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:272688971269d75b281897d5f3a36473bd730c9def89d6e2043ba93ebcb0d675","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43db5033175b5981ae608e6cc3b9a441a866185e107a29936fe635b2d6b00fff","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4b3a20d7c90468574cac63f0fa0394dbc14e20a1f1951b101e354a5ce0a58886","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6b6ee474e7b4ed3263df8ef3e15e2a9dc8da007d09adb430e76663008f33eca","arohcpocpint.azurecr.io/redhat-user-workloads/crt-redhat-acm-tenant/hypershift-shared-ingress-main@sha256:03ff3448f5bb02f3a255eccd3c26730f65fdee658a5efb28ecad7e539bed9a8c","arohcpocpint.azurecr.io/redhat-user-workloads/crt-redhat-acm-tenant/hypershift-shared-ingress-main@sha256:5e22710fe440869655329ecc0ef57b4ae15f4ef96e74a8904b1e6fafc0d87678","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:83c44e8d52d7ecb23e2f680ddb3cf0e6824906ae92a35dae469ade6b44cee1b2","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cd3463a9b86f0a8246307e8118cd039f095e07a1730f2125bf6611700395f1c5"]},{"name":"t9u7i7r5z0u0f6g-npnoedge-4-20-nljmf-cn2l4","ready":true,"containerRuntimeVersion":"cri-o://1.33.4-4.rhaos4.20.gitc8e7df2.el9","releaseImages":["quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49872a7f5108c35a2a70813cd4cfd2b20c94310421ec77ff9948ca8825fd410b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:95b5846e79dc56caada8d377dd0809a0e23170cd9a16844064c8661b2a074351","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9aa7d0ce36c6c9e21dba3eb58561a2ac480841c4aee3489555ac8b0693cf9792","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b03674c1f4c7a736f4e508e4949f79781fbcc32ec4a9a9af7a05fca1df155dcb","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a34a0212283a65c9888a43fb44dd00e91f14846de8637aca0451420bde858d3","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79afbddb9e92d39b3d596ab7641bd2df6388f61c95900a6f33b3719f61da9a4a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8fe828479c1d44400596894b789b76f7eca7c32a7e8dc1652d3e3cf9deef0b4c","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f022aca801d827626015b39a818727c393706569b8a1b26997ce42a5e734ef62","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52fd6091be3180a20b3c0f7175528d8de586d72679f560dfe033a8bfbc50d749","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d031a12f5284ca0cdb903b10403e09024ac6f428f66f6dc0822166e597de8aa0","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:80849ffb79dd5c24c4ce31ac060045aa173ce440c6ee46e8c9810a30073a27b6","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9455c0af32d052a722572a0ab297f14bddee06cd286c4dc1875909850245d126","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:390168836769c0fb1ca5c5b5e21dc91ea4f9cc8e21134af96e0df3ed8c190eea","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:964d14d4daf60f699f43bf96f42b492062a3b80b12dddfd0b8ade8a251aa7156","arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2453895ad86d62436e790e0b9399b87c47aa228300b27cc83cfd931a9db18a50","arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e72327cf36e1b290fa2bbdde3571f08b8547f307c28737a82a5986a58d9ff798","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:55a3180ddcb75c343c7121119c4661fb184c7f89419e6da067af8447ff133d43","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:de4c4b8f254196ae36bae3333097127ac672624b9fda1c7645003044a18ddebe","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5deea0845bb90e9ad93d05b71b988e128a12b3b5514194c092bd5fe4ee64e30a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dfcc383e709c9bf641a1c9369a427d00d346f594b898cf6ead89d2cb7d8b9fa8","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c1669fe97d168a651be1742f5b51290d37e4d4bc29d40d8f692ae72fde848fe1","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8854bc764270010669d4052a64d0ce204d93654f9e0c60032f25ffb2b438664","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a8ae4c499eb77d64d2ad321959db0dbb6da86d25b389d7857465140067ef1e8","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b488f8b1cda2b5d2c9c9a0b55fcc9e687716f62fb101abea3f44b8fa46f6c814","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31de3e9201d7f6acc376533a32d765c5f3c64345eb76fbb8b5ac570599779eff","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39336d0bd9a5bda7d17078381982974c9b469aa6ff922e31af90f3906f8b0bce","quay.io/openshift/origin-insights-runtime-extractor@sha256:c4f7b0c6eefe8b18e6d8a4bc11b3b70f951f811dd551b392ebf235730a8c1e97","quay.io/openshift/origin-insights-runtime-extractor@sha256:d6a4414d94942241301f29743a489515ee3bf951d9277de040d20882cd45204f","quay.io/openshift/origin-insights-runtime-extractor:latest","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2efd2e8ee9f864488bd98cc4b7346441eead71b106714d194a48582778ea955b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:772b39c6ffe1c00752ed64eb07bbe1b3e18291af33e620d88bababdeb014f259","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:14e343b365a3e0d1936de98c650a362b8bb67e15e660e486ea18a3f4a6901958","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eb6c92d8d659c35575582a0683a711c2b12bdc2f88fa5b5a7f15c715f0850610","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:51bb8e10c10f1cf23d5f07d8be40052c6cdaadfdd2ea0d9c488e168f2d59e834","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf930626fb4371b445bab6a14f631296fcf4ca89f1a6153d102345d2e8364586","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b33b3e6f296ebaabaebb20d623afdd172d12f1d172cf64ced0cd4612bd7aba93","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dd7dab5b6ec92b6eecefec17f84bb3df525692f39a44f3d8c22b4469e420f0f3","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1782613ad01fa0a4a02316ddc506eb9f25193fc85192d90c3dc7b3e1c8df6c5e","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c1e5e03b066b54b32f8e61a3e6714d71d93e676cd113c1342483c3c227098b53","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:56158f4279d0edce475b87f0d280bd2318ad69f5f493cc1b692d8d1d80468af4","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaeec8ad60ad3c1a0aad61f0a3ca7e9f40319cb933285c2309aa27b0328c58e","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ec6a34df50ec0d33c618e9fa65fab28e15a5d1daccdfa8e760203b6af9a428ca","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f0b340013055bd8e5fa8c63eb7c43f2815dc7910133aefdd62c4563368ee0cc5","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b92b01af0f3247a78a0e1930a69319585a2bd6989f5dba0c86980f817116c0ca","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf37294d95facbac106adc7be7d65dfa2218304c856ba7c2a4087871d504a676","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:29abdffa3472c4cd393a24ce7b0461719bd75f923733d38ffcaebcb4e423d9fb","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ec66a0352a04dc6720fdd3d5376cf08b9aefa435be938fc0408e71e58e946d2","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c891be7703b706b7159106152e6e4486b98fd84539ffbb25cb7b3d43745dbdc","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:18c7175de30b4a6c6bf570858ec4e6666eb06c05fe3715491395b4a8526df056","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:175405c2f6fd55278c5a3f2653f0eef00c820ea395aa10d738172ccdbad14442","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e061a904689f3f504f7d59d43abba799247859533b608d30c5e51572ff458344","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5147da14055c6f3099289420594595d5a4518a944e0991b2e9f407414b175e35","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66ad83f0a4e9d810ae14d8f5f496b0f33e1ca9149f7b0f275f9f82b04af22403","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:452ab0bdbbe681a49577a87b4aa186b900d8560774463af8416e593a55298966","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:96b91a67babd36515f2882267368aac2cf041e6a395a0a65d6f97d84f5e7dc11","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574a3d94ba37b2a60a0d85bb3d688697a876edbe1565c32e2410905479286ef1","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a95d05d15ae6b7058bec91857f86e4b9cad2d759b802ea21f99bf2ea87bc743","quay.io/openshift/origin-kube-rbac-proxy@sha256:9fa7c0125c5217797dcd586e7cc44e9c1d6a8f931bcb4d3eddaa2d1b0c27e2ce","quay.io/openshift/origin-kube-rbac-proxy@sha256:d82c862da8fe5446edc0eb8fbed1f1f6bc38aac7d7c1586cad0e03d3efd6f90e","quay.io/openshift/origin-kube-rbac-proxy:latest","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afa1bc6810004e8ba3d5b62fc9427140faaf97a9d4111edea7ba05633c14887d","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e408af1e9140ce2a64aaea88dfde0c99590d678df2c014bc17c9e1b794176e99","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8b725b47b52c7be52d86d175edb923aa978aebc7f5e9afaca324e88ef82d4799","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91ba98bfe825bcee8abfe3c0d3a572b05e9d9ab4907185ac7a55977ce24fb659","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:08ff83a2fa217f58d41c9b7f92697a0f0398b1f0127cf4899eb61ccbd47d42cc","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a7ad4a4b377ba7fef68b6c05750b873bb300801160ce3bf163058fa0422d4b9a","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:76fcc46e716184d91d90c399f8d5d9ba0f467d152fa5f9a7580c53edb6c0f6f6","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87e95472f325cde0575df90da957cbcc6d648a9b03592f6ad30d87a63395d485","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:323c65b761730f56ab62e28fb90b0ee14fa4356fe1c5a84eab57abf07a254246","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:94a4b74543daf5de7586633fa3c4657be13423930eb1753919c11ba9e568bd6c","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:595b18750ff93e47d4e7d14c78ed8e34cf6d279b40ac8acfc06650577d05b9b2","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:61282763ab3421a2739726257e8dde8a6eb84e4b97310f22b5fb846546ec89e1","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b9b70617918c933f0235987af7839bc0aae240513ace30e161d35606297eb0a7","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f7cdf181c5be46ea7673f39c72c2608fa818cdf73989ce70459336c5e8b852cf","arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:01e2fdf4b300e93e446e290cc95919361258c9b30d9d5c7d7d285c8fec071c1d","arohcpocpint.azurecr.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:372695628a11a3c10ccaf9448cf7c88fb4ffd5b93ae093f33a09039e5c76ade9","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7b9f8bf0f4d50d3c48cd2a8e4a0da9fdb64a620fbef6bbbe34f6e9e4b736e5d0","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c0f2f1ae49df9a4bdcacc996b2ae499724b4ed910a777cec0ded140fa0c36a67","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2cf5917237d38a7af496c3e13a5fd40bcefc7551533fded52122ddc8c456d0f8","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:507b4550ea19b0cffee516a0f351389b0f5a2779dcaf6b35f3b12ad5e8b2604b","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:005105ea5d7d66e28d1730eca894b3aa4f86339523e0b8b5c3b2c648cd8f8ab7","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6771519f53293e9f4bc620a4ac43a27a17006cd4250fae989bfa7ccb528a4055","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:62873ccfeff7b738a06610b557912d263821d8ac289ff940ae4fad7dc390c5ff","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:937e937c524cf8f6427d006c06d11fd2e26c3e6c43c249585253908582764193","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c29002002e8a35e0c45383629fb78a18a62a57e8840a9b9ed869b6fcb175d4fb","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d5fd24d7fe4bca0f2a4652fae1eb3b5d43dec9763f9382cc7946edf7234cb6f5","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0021d24380d66ff22709f1112b3b6a89adc18e39649ccebe7d6ca8a881a12aa5","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:82c311d293189bbb494d9f1808a2b45cacbb46803ae79d35f040377c34a80091","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:07b52b7679384f272eb58640370fd9a1a723d5923d44670900baf9a2e4e55962","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0ffb119a4f12fb3446003c2b0b63d593700a2bd02b63f11a95cfc9e0a50c6047","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0701c9aeeaeb2a36b26e45a45d8e21331a388c61998795fa7584c7638b30b5e6","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1caccc701d4e3b624c9d0a443c2fc4c5db30d9d33ecf6ae61ad87e67d5bafd3e","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3533a37bbf3fba120ce3ab531d8c79b62dd455011b44af5d7344c6e671deca88","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ba3bbfffecd7f528b413c07bb4b81f23b7bd130ce01e9642a9a96b0ff19766ce","quay.io/openshift/origin-insights-runtime-exporter@sha256:4361ca1dc004b38547adeb65e35e05338ab7ab119e3d501838bc94a20acf7e02","quay.io/openshift/origin-insights-runtime-exporter@sha256:f955508b8f36095ebd2e9fdfed56acbf1712ede85970571261addbe9ec618927","quay.io/openshift/origin-insights-runtime-exporter:latest","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:272688971269d75b281897d5f3a36473bd730c9def89d6e2043ba93ebcb0d675","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43db5033175b5981ae608e6cc3b9a441a866185e107a29936fe635b2d6b00fff","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4b3a20d7c90468574cac63f0fa0394dbc14e20a1f1951b101e354a5ce0a58886","quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b6b6ee474e7b4ed3263df8ef3e15e2a9dc8da007d09adb430e76663008f33eca","arohcpocpint.azurecr.io/redhat-user-workloads/crt-redhat-acm-tenant/hypershift-shared-ingress-main@sha256:03ff3448f5bb02f3a255eccd3c26730f65fdee658a5efb28ecad7e539bed9a8c","arohcpocpint.azurecr.io/redhat-user-workloads/crt-redhat-acm-tenant/hypershift-shared-ingress-main@sha256:5e22710fe440869655329ecc0ef57b4ae15f4ef96e74a8904b1e6fafc0d87678"]}]
    ...
Contributing tests (1)
Failed AtJobTestSupport
e2ebranch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallelCustomer should upgrade a nodepool to a version without Cincinnati upgrade edge z-stream upgrade without Cincinnati edge in 4.201
Affected runs (1)
Date (UTC)Associated PRProw job
n/a2075470437046816768