CIHealth
<
Single Day: Jun 5▾
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: PROD

Time (UTC)JobFailed atResultPRFailed testsDetails
periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel-ocp-nightly
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 2
e2e (2)
ERROR CODE: InvalidRequestContent; detail message Version 'openshift-v<version>' doesn't exist; provider Microsoft.RedHatOpenShift
23:00:15 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.21.zLatest to 4.19.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:704]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapError | 0xc000474f00>: 
    failed to create HCP cluster np-dg-minor-cp78hj: failed starting cluster creation "np-dg-minor-cp78hj" in resourcegroup="rg-np-dg-minor-cp78hj-jmhhpv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-cp78hj-jmhhpv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-cp78hj
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Version 'openshift-v4.21.0-nightly' doesn't exist"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:704]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapError | 0xc000474f00>: 
    failed to create HCP cluster np-dg-minor-cp78hj: failed starting cluster creation "np-dg-minor-cp78hj" in resourcegroup="rg-np-dg-minor-cp78hj-jmhhpv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-cp78hj-jmhhpv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-cp78hj
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Version 'openshift-v4.21.0-nightly' doesn't exist"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
ERROR CODE: InvalidRequestContent; detail message Version 'openshift-v<version>' doesn't exist; provider Microsoft.RedHatOpenShift
23:00:15 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:443]: failed to create HCP cluster np-skip-minor-f44np8 at version 4.22.0
Unexpected error:
    <*fmt.wrapError | 0xc000b8ad60>: 
    failed to create HCP cluster np-skip-minor-f44np8: failed starting cluster creation "np-skip-minor-f44np8" in resourcegroup="rg-np-skip-minor-f44np8-r7d95h": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-skip-minor-f44np8-r7d95h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-skip-minor-f44np8
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Version 'openshift-v4.22.0-nightly' doesn't exist"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:443]: failed to create HCP cluster np-skip-minor-f44np8 at version 4.22.0
Unexpected error:
    <*fmt.wrapError | 0xc000b8ad60>: 
    failed to create HCP cluster np-skip-minor-f44np8: failed starting cluster creation "np-skip-minor-f44np8" in resourcegroup="rg-np-skip-minor-f44np8-r7d95h": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-skip-minor-f44np8-r7d95h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-skip-minor-f44np8
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Version 'openshift-v4.22.0-nightly' doesn't exist"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 3
e2e (3)
Deserializaion Error: no output from command
02:00:11 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite prod/parallel
Show raw failure
30 pc=0x6b4e210
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).deleteCreatedResources-fm({0x7f40654cc128?, 0xc00148eb70?})
	<autogenerated>:1 +0x33 fp=0xc000cdd8b0 sp=0xc000cdd888 pc=0x6b69d33
runtime.call16(0xc000a17590, 0xc000e04410, 0x0, 0x0, 0x0, 0x10, 0xc000cddb08)
	/usr/lib/golang/src/runtime/asm_amd64.s:774 +0x43 fp=0xc000cdd8d0 sp=0xc000cdd8b0 pc=0x2ed1223
runtime.reflectcall(0x7ff2360?, 0xc00148eb70?, 0x2?, 0x86532af?, 0x0?, 0x12?, 0x7bb8920?)
	<autogenerated>:1 +0x36 fp=0xc000cdd910 sp=0xc000cdd8d0 pc=0x2ed9ab6
reflect.Value.call({0x746e4e0?, 0xc000e04410?, 0xc000132ed8?}, {0x860f1d5, 0x4}, {0xc000132f60, 0x1, 0x0?})
	/usr/lib/golang/src/reflect/value.go:581 +0xcc6 fp=0xc000cdde70 sp=0xc000cdd910 pc=0x2f0cc66
reflect.Value.Call({0x746e4e0?, 0xc000e04410?, 0x0?}, {0xc000132f60?, 0x2eef2c9?, 0x6b4f6da?})
	/usr/lib/golang/src/reflect/value.go:365 +0xb9 fp=0xc000cddee8 sp=0xc000cdde70 pc=0x2f0bd59
github.com/onsi/ginkgo/v2/internal.NewCleanupNode.func2({0x91f9670?, 0xc00148eb70?})
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:589 +0x150 fp=0xc000cddf88 sp=0xc000cddee8 pc=0x3330170
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b fp=0xc000cddfe0 sp=0xc000cddf88 pc=0x3342c3b
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000cddfe8 sp=0xc000cddfe0 pc=0x2ed2cc1
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 98
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50

goroutine 434 gp=0xc001582a80 m=nil [select]:
runtime.gopark(0xc000091768?, 0x2?, 0x60?, 0xc8?, 0xc00009175c?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc0000915e8 sp=0xc0000915c8 pc=0x2eca50e
runtime.selectgo(0xc000091768, 0xc000091758, 0xc000ff47a0?, 0x0, 0x3698d5c?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc000091728 sp=0xc0000915e8 pc=0x2ea52f7
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x91df3b8, 0xc0005abc00}, 0x863299e?)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 +0x76 fp=0xc000091798 sp=0xc000091728 pc=0x36984b6
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x9230900, {0x91df3b8, 0xc0005abc00}, 0x2ec7af3)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 +0x732 fp=0xc000091a98 sp=0xc000091798 pc=0x3d99192
github.com/Azure/ARO-HCP/test/util/framework.deleteHCPClusterAttempt({0x91df3b8, 0xc0005abc00}, 0xc0018106a8, {0xc000082948, 0x18}, {0xc00065cb60, 0x1d})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:239 +0x365 fp=0xc000091c20 sp=0xc000091a98 pc=0x6b2e305
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610.func1({0x91df3b8?, 0xc0005abc00?})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:197 +0x72 fp=0xc000091cc8 sp=0xc000091c20 pc=0x6b2dd32
k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x91df3b8?, 0xc0005abc00?}, 0xc0005abc10?)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:159 +0x62 fp=0xc000091d20 sp=0xc000091cc8 pc=0x364ba82
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoffWithContext({0x91df3b8, 0xc0005abc00}, {0xdf8475800, 0x4000000000000000, 0x3fb999999999999a, 0x5, 0x0}, 0xc000091e68)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:501 +0xae fp=0xc000091d98 sp=0xc000091d20 pc=0x3649b2e
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610({0x91df348, 0xc0007c4730}, 0xc0018106a8, {0xc000082948, 0x18}, {0xc00065cb60, 0x1d}, 0x274a48a7800)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:195 +0x285 fp=0xc000091ef0 sp=0xc000091d98 pc=0x6b2daa5
github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610.func1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:521 +0x7e fp=0xc000091f78 sp=0xc000091ef0 pc=0x6b3199e
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:93 +0x50 fp=0xc000091fe0 sp=0xc000091f78 pc=0x4766a30
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000091fe8 sp=0xc000091fe0 pc=0x2ed2cc1
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 395
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:78 +0x95

rax    0xfffffffffffffffc
rbx    0x5
rcx    0x2e49e2e
rdx    0x80
rdi    0x5
rsi    0x7ffe401a3a54
rbp    0x7ffe401a3a08
rsp    0x7ffe401a39c0
r8     0x0
r9     0x0
r10    0x22
r11    0x246
r12    0x7ffe401a3a98
r13    0x1
r14    0xc7ea580
r15    0x1
rip    0x2e49e2e
rflags 0x246
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserializaion Error: no output from command
30 pc=0x6b4e210
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).deleteCreatedResources-fm({0x7f40654cc128?, 0xc00148eb70?})
	<autogenerated>:1 +0x33 fp=0xc000cdd8b0 sp=0xc000cdd888 pc=0x6b69d33
runtime.call16(0xc000a17590, 0xc000e04410, 0x0, 0x0, 0x0, 0x10, 0xc000cddb08)
	/usr/lib/golang/src/runtime/asm_amd64.s:774 +0x43 fp=0xc000cdd8d0 sp=0xc000cdd8b0 pc=0x2ed1223
runtime.reflectcall(0x7ff2360?, 0xc00148eb70?, 0x2?, 0x86532af?, 0x0?, 0x12?, 0x7bb8920?)
	<autogenerated>:1 +0x36 fp=0xc000cdd910 sp=0xc000cdd8d0 pc=0x2ed9ab6
reflect.Value.call({0x746e4e0?, 0xc000e04410?, 0xc000132ed8?}, {0x860f1d5, 0x4}, {0xc000132f60, 0x1, 0x0?})
	/usr/lib/golang/src/reflect/value.go:581 +0xcc6 fp=0xc000cdde70 sp=0xc000cdd910 pc=0x2f0cc66
reflect.Value.Call({0x746e4e0?, 0xc000e04410?, 0x0?}, {0xc000132f60?, 0x2eef2c9?, 0x6b4f6da?})
	/usr/lib/golang/src/reflect/value.go:365 +0xb9 fp=0xc000cddee8 sp=0xc000cdde70 pc=0x2f0bd59
github.com/onsi/ginkgo/v2/internal.NewCleanupNode.func2({0x91f9670?, 0xc00148eb70?})
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:589 +0x150 fp=0xc000cddf88 sp=0xc000cddee8 pc=0x3330170
github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901 +0x7b fp=0xc000cddfe0 sp=0xc000cddf88 pc=0x3342c3b
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000cddfe8 sp=0xc000cddfe0 pc=0x2ed2cc1
created by github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 98
	/go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888 +0xd50

goroutine 434 gp=0xc001582a80 m=nil [select]:
runtime.gopark(0xc000091768?, 0x2?, 0x60?, 0xc8?, 0xc00009175c?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc0000915e8 sp=0xc0000915c8 pc=0x2eca50e
runtime.selectgo(0xc000091768, 0xc000091758, 0xc000ff47a0?, 0x0, 0x3698d5c?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc000091728 sp=0xc0000915e8 pc=0x2ea52f7
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x91df3b8, 0xc0005abc00}, 0x863299e?)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 +0x76 fp=0xc000091798 sp=0xc000091728 pc=0x36984b6
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x9230900, {0x91df3b8, 0xc0005abc00}, 0x2ec7af3)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 +0x732 fp=0xc000091a98 sp=0xc000091798 pc=0x3d99192
github.com/Azure/ARO-HCP/test/util/framework.deleteHCPClusterAttempt({0x91df3b8, 0xc0005abc00}, 0xc0018106a8, {0xc000082948, 0x18}, {0xc00065cb60, 0x1d})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:239 +0x365 fp=0xc000091c20 sp=0xc000091a98 pc=0x6b2e305
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610.func1({0x91df3b8?, 0xc0005abc00?})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:197 +0x72 fp=0xc000091cc8 sp=0xc000091c20 pc=0x6b2dd32
k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x91df3b8?, 0xc0005abc00?}, 0xc0005abc10?)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:159 +0x62 fp=0xc000091d20 sp=0xc000091cc8 pc=0x364ba82
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoffWithContext({0x91df3b8, 0xc0005abc00}, {0xdf8475800, 0x4000000000000000, 0x3fb999999999999a, 0x5, 0x0}, 0xc000091e68)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:501 +0xae fp=0xc000091d98 sp=0xc000091d20 pc=0x3649b2e
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610({0x91df348, 0xc0007c4730}, 0xc0018106a8, {0xc000082948, 0x18}, {0xc00065cb60, 0x1d}, 0x274a48a7800)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:195 +0x285 fp=0xc000091ef0 sp=0xc000091d98 pc=0x6b2daa5
github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610.func1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:521 +0x7e fp=0xc000091f78 sp=0xc000091ef0 pc=0x6b3199e
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:93 +0x50 fp=0xc000091fe0 sp=0xc000091f78 pc=0x4766a30
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000091fe8 sp=0xc000091fe0 pc=0x2ed2cc1
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 395
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:78 +0x95

rax    0xfffffffffffffffc
rbx    0x5
rcx    0x2e49e2e
rdx    0x80
rdi    0x5
rsi    0x7ffe401a3a54
rbp    0x7ffe401a3a08
rsp    0x7ffe401a39c0
r8     0x0
r9     0x0
r10    0x22
r11    0x246
r12    0x7ffe401a3a98
r13    0x1
r14    0xc7ea580
r15    0x1
rip    0x2e49e2e
rflags 0x246
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserializaion Error: no output from command
ERROR CODE: MultipleErrorsOccurred; detail code InvalidRequestContent; detail message Invalid value: "4.19.33": cannot downgrade from version 4.21.18 to 4.19.33; provider Microsoft.RedHatOpenShift
02:00:11 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.21.zLatest to 4.19.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:750]: failed to update nodepool npdg-421-419 to downgrade target 4.19.33
Unexpected error:
    <*fmt.wrapError | 0xc000d5d120>: 
    failed to start nodepool "npdg-421-419" update in cluster "np-dg-minor-thcd8z" resourcegroup="rg-np-dg-minor-thcd8z-w24xx4": PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-thcd8z-w24xx4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-thcd8z/nodePools/npdg-421-419
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: MultipleErrorsOccurred
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "MultipleErrorsOccurred",
        "message": "2 errors occurred",
        "details": [
          {
            "code": "InvalidRequestContent",
            "message": "Invalid value: \"4.19.33\": invalid node pool version 4.19.33: cannot downgrade from current version 4.21.18",
            "target": "properties.version.id"
          },
          {
            "code": "InvalidRequestContent",
            "message": "Invalid value: \"4.19.33\": cannot downgrade from version 4.21.18 to 4.19.33",
            "target": "properties.version.id"
          }
        ]
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:750]: failed to update nodepool npdg-421-419 to downgrade target 4.19.33
Unexpected error:
    <*fmt.wrapError | 0xc000d5d120>: 
    failed to start nodepool "npdg-421-419" update in cluster "np-dg-minor-thcd8z" resourcegroup="rg-np-dg-minor-thcd8z-w24xx4": PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-thcd8z-w24xx4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-thcd8z/nodePools/npdg-421-419
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: MultipleErrorsOccurred
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "MultipleErrorsOccurred",
        "message": "2 errors occurred",
        "details": [
          {
            "code": "InvalidRequestContent",
            "message": "Invalid value: \"4.19.33\": invalid node pool version 4.19.33: cannot downgrade from current version 4.21.18",
            "target": "properties.version.id"
          },
          {
            "code": "InvalidRequestContent",
            "message": "Invalid value: \"4.19.33\": cannot downgrade from version 4.21.18 to 4.19.33",
            "target": "properties.version.id"
          }
        ]
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
ERROR CODE: MultipleErrorsOccurred; detail code InvalidRequestContent; detail message Invalid value: "4.21.17": cannot downgrade from version 4.21.18 to 4.21.17; provider Microsoft.RedHatOpenShift
02:00:11 UTC · failed at e2e · test Customer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:619]: failed to update nodepool npdg-4-21 to downgrade target 4.21.17
Unexpected error:
    <*fmt.wrapError | 0xc00045dcc0>: 
    failed to start nodepool "npdg-4-21" update in cluster "np-downgrade-4z9hsj" resourcegroup="rg-np-downgrade-4z9hsj-qn6gtn": PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-downgrade-4z9hsj-qn6gtn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-downgrade-4z9hsj/nodePools/npdg-4-21
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: MultipleErrorsOccurred
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "MultipleErrorsOccurred",
        "message": "2 errors occurred",
        "details": [
          {
            "code": "InvalidRequestContent",
            "message": "Invalid value: \"4.21.17\": invalid node pool version 4.21.17: cannot downgrade from current version 4.21.18",
            "target": "properties.version.id"
          },
          {
            "code": "InvalidRequestContent",
            "message": "Invalid value: \"4.21.17\": cannot downgrade from version 4.21.18 to 4.21.17",
            "target": "properties.version.id"
          }
        ]
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:619]: failed to update nodepool npdg-4-21 to downgrade target 4.21.17
Unexpected error:
    <*fmt.wrapError | 0xc00045dcc0>: 
    failed to start nodepool "npdg-4-21" update in cluster "np-downgrade-4z9hsj" resourcegroup="rg-np-downgrade-4z9hsj-qn6gtn": PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-downgrade-4z9hsj-qn6gtn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-downgrade-4z9hsj/nodePools/npdg-4-21
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: MultipleErrorsOccurred
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "MultipleErrorsOccurred",
        "message": "2 errors occurred",
        "details": [
          {
            "code": "InvalidRequestContent",
            "message": "Invalid value: \"4.21.17\": invalid node pool version 4.21.17: cannot downgrade from current version 4.21.18",
            "target": "properties.version.id"
          },
          {
            "code": "InvalidRequestContent",
            "message": "Invalid value: \"4.21.17\": cannot downgrade from version 4.21.18 to 4.21.17",
            "target": "properties.version.id"
          }
        ]
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred