No failure patterns match your search.
Environment: DEV
Failure patterns: 45 · Failures matched: 558 · Total runs: 77 · Runs affected: 62
| Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs. | Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern). | Number of distinct job runs where this failure pattern was detected. | Percentage of all job runs in this environment affected by this failure pattern during the selected window. | Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate. | TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size. | Also inOther environments where the same failure pattern was also detected during the selected window. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRERROR CODE: DeadlineExceeded; detail message node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hype...full failure pattern: ERROR CODE: DeadlineExceeded; detail message node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet; provider Microsoft.RedHatOpenShift Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | e2e | 1 | 1.30%1 of 77 job runs affected | RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:403]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
<*errors.joinError | 0x394650f4c690>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-txc4g676jchd" to finish creating: GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f",
"name": "b74958ca-74c5-4aed-bdef-2d25ccfd763f",
"status": "Failed",
"startTime": "2026-10-05T22:11:10.271614632Z",
"endTime": "2026-10-05T22:30:19.790444395Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x394650f4c678>{
errs: [
<*fmt.wrapError | 0x394650914540>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x394651164040>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x394651e824c0>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x394651e82480>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x394651e82400>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x394651e823c0>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x394652251040>{
msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-txc4g676jchd\" to finish creating: GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n \"name\": \"b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T22:11:10.271614632Z\",\n \"endTime\": \"2026-10-05T22:30:19.790444395Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x394652250900>{
msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-txc4g676jchd\" to finish creating: GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n \"name\": \"b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T22:11:10.271614632Z\",\n \"endTime\": \"2026-10-05T22:30:19.790444395Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x3946515b1020>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"afe2deb3-54d4-4b50-a32f-f2d06131e56f",
],
"Date": [
"Mon, 05 Oct 2026 22:30:27 GMT",
],
"Content-Length": ["620"],
"X-Envoy-Upstream-Service-Time": ["9"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x394652250820>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 55, 52, 57, 53, 56, 99, 97, 45, 55, 52, 99, 53, 45, 52, 97, 101, 100, 45, 98, 100, 101, 102, 45, 50, 100, 50, 53, 99, 99, 102, 100, 55, 54, 51, 102, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 55, 52, 57, 53, 56, 99, 97, 45, 55, 52, 99, 53, 45, 52, 97, 101, 100, 45, 98, 100, 101, 102, 45, 50, 100, 50, 53, 99, 99, 102, 100, 55, 54, 51, 102, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 50, 58, 49, 49, 58, 49, 48, 46, 50, 55, 49, 54, 49, 52, 54, 51, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 50, 58, 51, 48, 58, 49, 57, 46, 55, 57, 48, 52, 52, 52, 51, 57, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 110, 111, 116, 32, 99, 97, 99, 104, 101, 100, 32, 121, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 620,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j1538688.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f",
Fragment: "",
RawQuery: "api-version=2026-09-01-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"fffb22aa-0f4c-43e9-89d1-09d2bda795e6",
],
"X-Ms-Client-Request-Id": [
"0f6fdf15-8ef6-489d-a565-de2b11510c75",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T22:30:27Z\"}",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j1538688.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j1538688.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x394651770ec0>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bd760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n \"name\": \"b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T22:11:10.271614632Z\",\n \"endTime\": \"2026-10-05T22:30:19.790444395Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:403]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
<*errors.joinError | 0x394650f4c690>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-txc4g676jchd" to finish creating: GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f",
"name": "b74958ca-74c5-4aed-bdef-2d25ccfd763f",
"status": "Failed",
"startTime": "2026-10-05T22:11:10.271614632Z",
"endTime": "2026-10-05T22:30:19.790444395Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x394650f4c678>{
errs: [
<*fmt.wrapError | 0x394650914540>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x394651164040>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x394651e824c0>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x394651e82480>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x394651e82400>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x394651e823c0>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x394652251040>{
msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-txc4g676jchd\" to finish creating: GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n \"name\": \"b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T22:11:10.271614632Z\",\n \"endTime\": \"2026-10-05T22:30:19.790444395Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x394652250900>{
msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-txc4g676jchd\" to finish creating: GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n \"name\": \"b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T22:11:10.271614632Z\",\n \"endTime\": \"2026-10-05T22:30:19.790444395Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x3946515b1020>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"afe2deb3-54d4-4b50-a32f-f2d06131e56f",
],
"Date": [
"Mon, 05 Oct 2026 22:30:27 GMT",
],
"Content-Length": ["620"],
"X-Envoy-Upstream-Service-Time": ["9"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x394652250820>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 55, 52, 57, 53, 56, 99, 97, 45, 55, 52, 99, 53, 45, 52, 97, 101, 100, 45, 98, 100, 101, 102, 45, 50, 100, 50, 53, 99, 99, 102, 100, 55, 54, 51, 102, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 55, 52, 57, 53, 56, 99, 97, 45, 55, 52, 99, 53, 45, 52, 97, 101, 100, 45, 98, 100, 101, 102, 45, 50, 100, 50, 53, 99, 99, 102, 100, 55, 54, 51, 102, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 50, 58, 49, 49, 58, 49, 48, 46, 50, 55, 49, 54, 49, 52, 54, 51, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 50, 58, 51, 48, 58, 49, 57, 46, 55, 57, 48, 52, 52, 52, 51, 57, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 110, 111, 116, 32, 99, 97, 99, 104, 101, 100, 32, 121, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 620,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j1538688.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f",
Fragment: "",
RawQuery: "api-version=2026-09-01-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"fffb22aa-0f4c-43e9-89d1-09d2bda795e6",
],
"X-Ms-Client-Request-Id": [
"0f6fdf15-8ef6-489d-a565-de2b11510c75",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T22:30:27Z\"}",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j1538688.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j1538688.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x394651770ec0>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bd760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n \"name\": \"b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T22:11:10.271614632Z\",\n \"endTime\": \"2026-10-05T22:30:19.790444395Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRERROR CODE: DeploymentFailed; detail code BadRequest; detail message The requested operation cannot be performed because the database account arohcpci01-rp-j1672192 is in the proc...full failure pattern: ERROR CODE: DeploymentFailed; detail code BadRequest; detail message The requested operation cannot be performed because the database account arohcpci01-rp-j1672192 is in the process of being created. Please wait until account creation completes and retry the operation.\\\\\\\ \\\\\\ ActivityId: <uuid>, Microsoft.Azure.Documents.Common/2.14.0"\\\ \\ }; provider Microsoft.DocumentDB Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | provision | 1 | 1.30%1 of 77 job runs affected | RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)time=2026-10-05T23:36:27.137Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra description="Step infra\n Kind: ARM\n Template: templates/region.bicep\n Parameters: configurations/region.tmpl.bicepparam"
time=2026-10-05T23:36:28.752Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra
time=2026-10-05T23:36:29.424Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra deployment=5dd69a04f62785b0df4182f2e62bb16930ed2731284e7680f8dc157ea0096d63 portal=https://ms.portal.azure.com/#view/Microsoft_Azure_Resources/DeploymentDetails.MenuView/~/overview/id/%2Fsubscriptions%2FXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%2FresourceGroups%2Fhcp-underlay-ci01-j1672192%2Fproviders%2FMicrosoft.Resources%2Fdeployments%2F5dd69a04f62785b0df4182f2e62bb16930ed2731284e7680f8dc157ea0096d63
time=2026-10-05T23:38:29.834Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j1672192/providers/Microsoft.Resources/deployments/5dd69a04f62785b0df4182f2e62bb16930ed2731284e7680f8dc157ea0096d63/operationStatuses/08584103634964314871\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j1672192/providers/Microsoft.Resources/deployments/rp-cosmos-account\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"BadRequest\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j1672192/providers/Microsoft.DocumentDB/databaseAccounts/arohcpci01-rp-j1672192\\\",\\r\\n \\\"message\\\": \\\"{\\\\r\\\\n \\\\\\\"code\\\\\\\": \\\\\\\"BadRequest\\\\\\\",\\\\r\\\\n \\\\\\\"message\\\\\\\": \\\\\\\"The requested operation cannot be performed because the database account arohcpci01-rp-j1672192 is in the process of being created. Please wait until account creation completes and retry the operation.\\\\\\\\r\\\\\\\\nActivityId: 75b0de9b-7548-4bae-95bc-f97589468144, Microsoft.Azure.Documents.Common/2.14.0\\\\\\\"\\\\r\\\\n}\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n"Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRERROR CODE: DeploymentFailed; detail code DeploymentActive; detail message The deployment with resource id '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers...full failure pattern: ERROR CODE: DeploymentFailed; detail code DeploymentActive; detail message The deployment with resource id '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.Resources/deployments/profile-thqgrr3ymebbw' cannot be saved, because this would overwrite an existing deployment which is still active. If this is an intentional re-deployment, please wait for the original deployment to complete, or cancel it before re-attempting the operation. The previous deployment was started at '<timestamp>' with correlationId '<uuid>', and will expire at '<timestamp>' if it does not complete before then. Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | provision | 1 | 1.30%1 of 77 job runs affected | RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)time=2026-10-05T17:12:22.862Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=nsp stamp=2 description="Step nsp\n Kind: ARM\n Template: templates/mgmt-nsp.bicep\n Parameters: configurations/mgmt-nsp.tmpl.bicepparam"
time=2026-10-05T17:12:23.287Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=nsp stamp=2
time=2026-10-05T17:12:24.013Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=nsp stamp=2 deployment=e2e1fa40714c294cc444d45df7d65e7230bd956473842bf5c4f49c5bfba93caa portal=https://ms.portal.azure.com/#view/Microsoft_Azure_Resources/DeploymentDetails.MenuView/~/overview/id/%2Fsubscriptions%2FXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%2FresourceGroups%2Fhcp-underlay-ci01-j9265280-mgmt-2%2Fproviders%2FMicrosoft.Resources%2Fdeployments%2Fe2e1fa40714c294cc444d45df7d65e7230bd956473842bf5c4f49c5bfba93caa
time=2026-10-05T17:13:24.301Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=nsp stamp=2 err="stamp 2: failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j9265280-mgmt-2/providers/Microsoft.Resources/deployments/e2e1fa40714c294cc444d45df7d65e7230bd956473842bf5c4f49c5bfba93caa/operationStatuses/08584103865419476507\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"DeploymentActive\\\",\\r\\n \\\"message\\\": \\\"The deployment with resource id '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j9265280-mgmt-2/providers/Microsoft.Resources/deployments/profile-thqgrr3ymebbw' cannot be saved, because this would overwrite an existing deployment which is still active. If this is an intentional re-deployment, please wait for the original deployment to complete, or cancel it before re-attempting the operation. The previous deployment was started at '10/5/2026 5:12:37 PM' with correlationId '9bd28390-2035-44ef-a1dc-d068a232c592', and will expire at '10/12/2026 5:12:37 PM' if it does not complete before then. Please see https://aka.ms/arm-deploy-resources for usage details.\\\"\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n"Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRERROR CODE: DeploymentFailed; detail code NotFound; detail message Resource '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.ManagedIdentity/user...full failure pattern: ERROR CODE: DeploymentFailed; detail code NotFound; detail message Resource '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-puller' was not found.; provider Microsoft.ManagedIdentity Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | provision | 1 | 1.30%1 of 77 job runs affected | RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)time=2026-10-05T09:59:52.082Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster stamp=2 description="Step cluster\n Kind: ARM\n Template: templates/mgmt-cluster.bicep\n Parameters: configurations/mgmt-cluster.tmpl.bicepparam"
time=2026-10-05T09:59:52.761Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster stamp=2
time=2026-10-05T09:59:53.566Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster stamp=2 deployment=c9397b972a000626b7c9dd06c82246169ec346b2e88665f7f2672f34e557c5c2 portal=https://ms.portal.azure.com/#view/Microsoft_Azure_Resources/DeploymentDetails.MenuView/~/overview/id/%2Fsubscriptions%2FXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%2FresourceGroups%2Fhcp-underlay-ci01-j2945792-mgmt-2%2Fproviders%2FMicrosoft.Resources%2Fdeployments%2Fc9397b972a000626b7c9dd06c82246169ec346b2e88665f7f2672f34e557c5c2
time=2026-10-05T10:01:54.159Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster stamp=2 err="stamp 2: failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2945792-mgmt-2/providers/Microsoft.Resources/deployments/c9397b972a000626b7c9dd06c82246169ec346b2e88665f7f2672f34e557c5c2/operationStatuses/08584104124922522992\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n \"status\": \"Failed\",\n \"error\": {\n \"code\": \"DeploymentFailed\",\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n \"details\": [\n {\n \"code\": \"Conflict\",\n \"message\": \"{\\r\\n \\\"status\\\": \\\"Failed\\\",\\r\\n \\\"error\\\": {\\r\\n \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2945792-mgmt-2/providers/Microsoft.Resources/deployments/aks-cluster-post\\\",\\r\\n \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n \\\"details\\\": [\\r\\n {\\r\\n \\\"code\\\": \\\"NotFound\\\",\\r\\n \\\"message\\\": \\\"Resource '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2945792-mgmt-2/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-puller' was not found.\\\"\\r\\n }\\r\\n ]\\r\\n }\\r\\n ]\\r\\n }\\r\\n}\"\n }\n ]\n }\n}\n--------------------------------------------------------------------------------\n"Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRERROR CODE: InvalidRequestContent; detail message Invalid scope(s) in request: at least one of these scopes is required: /subscriptions/<subscription>/resourcegroups/<resource-gro...full failure pattern: ERROR CODE: InvalidRequestContent; detail message Invalid scope(s) in request: at least one of these scopes is required: /subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.Monitor/accounts/hcps-j2198528,/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.Monitor/accounts/services-j2198528; got: /subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.Monitor/accounts/services-j2198528; provider Microsoft.Monitor Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | e2e | 1 | 1.30%1 of 77 job runs affected | RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/admin_api.go:493]: failed to create alert processing rule
Unexpected error:
<*errors.errorString | 0x383c4f08c1e0>:
expected status 200, got 400: {
"error": {
"code": "InvalidRequestContent",
"message": "Invalid scope(s) in request: at least one of these scopes is required: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/hcps-j2198528,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528; got: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528"
}
}
{
s: "expected status 200, got 400: {\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Invalid scope(s) in request: at least one of these scopes is required: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/hcps-j2198528,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528; got: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528\"\n }\n}",
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_api.go:493]: failed to create alert processing rule
Unexpected error:
<*errors.errorString | 0x383c4f08c1e0>:
expected status 200, got 400: {
"error": {
"code": "InvalidRequestContent",
"message": "Invalid scope(s) in request: at least one of these scopes is required: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/hcps-j2198528,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528; got: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528"
}
}
{
s: "expected status 200, got 400: {\n \"error\": {\n \"code\": \"InvalidRequestContent\",\n \"message\": \"Invalid scope(s) in request: at least one of these scopes is required: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/hcps-j2198528,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528; got: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528\"\n }\n}",
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRUnauthorizedfull failure pattern: Unauthorized Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | e2e | 1 | 1.30%1 of 77 job runs affected | RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:128]: failed to disable kube-proxy via network operator patch
Unexpected error:
<*errors.StatusError | 0x1122950dbe00>:
Unauthorized
{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
ShardInfo: nil,
},
Status: "Failure",
Message: "Unauthorized",
Reason: "Unauthorized",
Details: nil,
Code: 401,
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:128]: failed to disable kube-proxy via network operator patch
Unexpected error:
<*errors.StatusError | 0x1122950dbe00>:
Unauthorized
{
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
ShardInfo: nil,
},
Status: "Failure",
Message: "Unauthorized",
Reason: "Unauthorized",
Details: nil,
Code: 401,
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRVerifyDefaultIngressCertificate timed out after 35m0.003s: default ingress route must serve trusted HTTPS: Get "<url>": context deadline exceededfull failure pattern: VerifyDefaultIngressCertificate timed out after 35m0.003s: default ingress route must serve trusted HTTPS: Get "<url>": context deadline exceeded Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | e2e | 1 | 1.30%1 of 77 job runs affected | RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_serve_default_ingress_certificate_public.go:162]: sample app must return HTTP 200 over trusted HTTPS through public ingress
Unexpected error:
<*fmt.wrapError | 0x1ec2e1beb2e0>:
VerifyDefaultIngressCertificate timed out after 35m0.003s: default ingress route must serve trusted HTTPS: Get "https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud": context deadline exceeded
{
msg: "VerifyDefaultIngressCertificate timed out after 35m0.003s: default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud\": context deadline exceeded",
err: <*fmt.wrapError | 0x1ec2e1beafe0>{
msg: "default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud\": context deadline exceeded",
err: <*url.Error | 0x1ec2e1a4fb60>{
Op: "Get",
URL: "https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud",
Err: <context.deadlineExceededError>{},
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_serve_default_ingress_certificate_public.go:162]: sample app must return HTTP 200 over trusted HTTPS through public ingress
Unexpected error:
<*fmt.wrapError | 0x1ec2e1beb2e0>:
VerifyDefaultIngressCertificate timed out after 35m0.003s: default ingress route must serve trusted HTTPS: Get "https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud": context deadline exceeded
{
msg: "VerifyDefaultIngressCertificate timed out after 35m0.003s: default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud\": context deadline exceeded",
err: <*fmt.wrapError | 0x1ec2e1beafe0>{
msg: "default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud\": context deadline exceeded",
err: <*url.Error | 0x1ec2e1a4fb60>{
Op: "Get",
URL: "https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud",
Err: <context.deadlineExceededError>{},
},
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRVerifyImagePulled(acrpull6864z6s54xlk.azurecr.io/ubi-minimal) timed out after 2m0.006s: expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-d...full failure pattern: VerifyImagePulled(acrpull6864z6s54xlk.azurecr.io/ubi-minimal) timed out after 2m0.006s: expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors: Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | e2e | 1 | 1.30%1 of 77 job runs affected | RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_container_registry.go:257]: [day 2] pod in namespace acr-pull-test-day2 never pulled image ubi-minimal from private ACR acrpull6864z6s54xlk.azurecr.io
Unexpected error:
<*fmt.wrapError | 0x88c3b4bd360>:
VerifyImagePulled(acrpull6864z6s54xlk.azurecr.io/ubi-minimal) timed out after 2m0.006s: expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:
- pod acr-pull-test container acr-pull-test: ErrImagePull - unable to pull image or OCI artifact: pull image err: initializing source docker://acrpull6864z6s54xlk.azurecr.io/ubi-minimal:latest: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 3e6da004-1a48-4c61-b7cd-2c06205130ad; artifact err: image reference: get manifest from ref: create image source: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 2c421171-6e86-4b5b-8da9-c36681c3d54a
{
msg: "VerifyImagePulled(acrpull6864z6s54xlk.azurecr.io/ubi-minimal) timed out after 2m0.006s: expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:\n - pod acr-pull-test container acr-pull-test: ErrImagePull - unable to pull image or OCI artifact: pull image err: initializing source docker://acrpull6864z6s54xlk.azurecr.io/ubi-minimal:latest: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 3e6da004-1a48-4c61-b7cd-2c06205130ad; artifact err: image reference: get manifest from ref: create image source: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 2c421171-6e86-4b5b-8da9-c36681c3d54a",
err: <*errors.errorString | 0x88c3b30f800>{
s: "expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:\n - pod acr-pull-test container acr-pull-test: ErrImagePull - unable to pull image or OCI artifact: pull image err: initializing source docker://acrpull6864z6s54xlk.azurecr.io/ubi-minimal:latest: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 3e6da004-1a48-4c61-b7cd-2c06205130ad; artifact err: image reference: get manifest from ref: create image source: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 2c421171-6e86-4b5b-8da9-c36681c3d54a",
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_container_registry.go:257]: [day 2] pod in namespace acr-pull-test-day2 never pulled image ubi-minimal from private ACR acrpull6864z6s54xlk.azurecr.io
Unexpected error:
<*fmt.wrapError | 0x88c3b4bd360>:
VerifyImagePulled(acrpull6864z6s54xlk.azurecr.io/ubi-minimal) timed out after 2m0.006s: expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:
- pod acr-pull-test container acr-pull-test: ErrImagePull - unable to pull image or OCI artifact: pull image err: initializing source docker://acrpull6864z6s54xlk.azurecr.io/ubi-minimal:latest: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 3e6da004-1a48-4c61-b7cd-2c06205130ad; artifact err: image reference: get manifest from ref: create image source: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 2c421171-6e86-4b5b-8da9-c36681c3d54a
{
msg: "VerifyImagePulled(acrpull6864z6s54xlk.azurecr.io/ubi-minimal) timed out after 2m0.006s: expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:\n - pod acr-pull-test container acr-pull-test: ErrImagePull - unable to pull image or OCI artifact: pull image err: initializing source docker://acrpull6864z6s54xlk.azurecr.io/ubi-minimal:latest: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 3e6da004-1a48-4c61-b7cd-2c06205130ad; artifact err: image reference: get manifest from ref: create image source: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 2c421171-6e86-4b5b-8da9-c36681c3d54a",
err: <*errors.errorString | 0x88c3b30f800>{
s: "expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:\n - pod acr-pull-test container acr-pull-test: ErrImagePull - unable to pull image or OCI artifact: pull image err: initializing source docker://acrpull6864z6s54xlk.azurecr.io/ubi-minimal:latest: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 3e6da004-1a48-4c61-b7cd-2c06205130ad; artifact err: image reference: get manifest from ref: create image source: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 2c421171-6e86-4b5b-8da9-c36681c3d54a",
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRalert [hcp] KubeDeploymentRolloutStuck firedfull failure pattern: alert [hcp] KubeDeploymentRolloutStuck fired Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | alert | 1 | 1.30%1 of 77 job runs affected | RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)alert fired 2 time(s) Firing 1: State: Resolved Started: 2026-10-05T12:54:04Z Ended: 2026-10-05T13:00:05Z Severity: Sev3 Labels: alertname="KubeDeploymentRolloutStuck", cluster="ci01-j2217856-mgmt-1", component="kubernetes-infrastructure", condition="Progressing", container="kube-state-metrics", deployment="capi-provider", endpoint="http", environment="ci01", instance="10.128.64.214:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2217856/providers/microsoft.monitor/accounts/hcps-j2217856", namespace="ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics", pod="arohcp-monitor-kube-state-metrics-7988dc648c-twm4t", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", reason="progressdeadlineexceeded", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning", status="false" Description: Rollout of deployment ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics/capi-provider is not progressing for longer than 30 minutes. Firing 2: State: Resolved Started: 2026-10-05T12:54:04Z Ended: 2026-10-05T13:00:05Z Severity: Sev3 Labels: alertname="KubeDeploymentRolloutStuck", cluster="ci01-j2217856-mgmt-1", component="kubernetes-infrastructure", condition="Progressing", container="kube-state-metrics", deployment="capi-provider", endpoint="http", environment="ci01", instance="10.128.64.214:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2217856/providers/microsoft.monitor/accounts/hcps-j2217856", namespace="ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics", pod="arohcp-monitor-kube-state-metrics-7988dc648c-twm4t", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", reason="progressdeadlineexceeded", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning", status="false" Description: Rollout of deployment ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics/capi-provider is not progressing for longer than 30 minutes. Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRfailed to gather logs: failed to execute custom logs query: error during query execution: failed to execute query: failed to read query "detailedInfraOrchestrationLogs" result (KQ...full failure pattern: failed to gather logs: failed to execute custom logs query: error during query execution: failed to execute query: failed to read query "detailedInfraOrchestrationLogs" result (KQL: let _startTime = datetime(2026-10-04T19:42:22 Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | e2e | 1 | 1.30%1 of 77 job runs affected | RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:96]: Timed out after 600.004s.
Expected success, but got an error:
<*fmt.wrapError | 0x260bcea34260>:
failed to gather logs: failed to execute custom logs query: error during query execution: failed to execute query: failed to read query "detailedInfraOrchestrationLogs" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);
let _endTime = datetime(2026-10-05T19:42:22.1821449Z);
// Extract cluster ID from CS logs using cid field
let _cs_cluster_id = toscalar(
database('ServiceLogs').table('clustersServiceLogs')
| where timestamp between (_startTime .. _endTime)
| where resource_id has 'kusto-logs-xj24lxzh8jt8'
| where isnotempty(log.cid)
| distinct tostring(log.cid)
| limit 1
);
// Find all Maestro resource IDs for this cluster
let maestro_resource_ids = (
database('ServiceLogs').table('containerLogs')
| where timestamp between (_startTime .. _endTime)
| where namespace_name has "maestro"
| extend logStr = tostring(log)
| where logStr has _cs_cluster_id
| extend resourceId = extract(@'resourceid[=:"]+([a-f0-9\-]+)', 1, logStr)
| where isnotempty(resourceId)
| distinct resourceId
);
// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent
union
(
// Maestro logs: Resource bundle operations for this cluster and its associated resources
// Includes: resource creation, updates, deletions, status events, gRPC communications
database('ServiceLogs').table('containerLogs')
| where timestamp between (_startTime .. _endTime)
| where namespace_name has "maestro"
| extend logStr = tostring(log)
| where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)
| project timestamp, container_name, msg = logStr, log
),
(
// Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs
// Includes the CR reconciliation logs
database('ServiceLogs').table('containerLogs')
| where timestamp between (_startTime .. _endTime)
| where namespace_name has "hypershift"
| extend logStr = tostring(log)
| where logStr has _cs_cluster_id
| project timestamp, container_name, msg = logStr, log
),
(
// ACM Agent logs: ManifestWork reconciliation on the managed cluster
// Includes: work agent operations, manifest application, status feedback
database('ServiceLogs').table('containerLogs')
| where timestamp between (_startTime .. _endTime)
| where namespace_name has "open-cluster-management-agent"
| extend logStr = tostring(log)
| where logStr has _cs_cluster_id
| project timestamp, container_name, msg = logStr, log
)
| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:"LimitsExceeded", Message:"Request is invalid and cannot be executed.", Description:"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..", Type:"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException", Context:v2.ErrorContext{Timestamp:"2026-10-05T19:42:30.9508158Z", ServiceAlias:"HCP-DEV-US-2", MachineName:"", ProcessName:"", ProcessId:0, ThreadId:0, ClientRequestId:"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4", ActivityId:"f7c0f10d-28d1-4f0c-aa3d-b966d3722931", SubActivityId:"f7c0f10d-28d1-4f0c-aa3d-b966d3722931", ActivityType:"GW.Http.CallContext", ParentActivityId:"f7c0f10d-28d1-4f0c-aa3d-b966d3722931", ActivityStack:"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)"}, IsPermanent:false})
{
msg: "failed to gather logs: failed to execute custom logs query: error during query execution: failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n database('ServiceLogs').table('clustersServiceLogs')\n | where timestamp between (_startTime .. _endTime)\n | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n | where isnotempty(log.cid)\n | distinct tostring(log.cid)\n | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n | where isnotempty(resourceId)\n | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n (\n // Maestro logs: Resource bundle operations for this cluster and its associated resources\n // Includes: resource creation, updates, deletions, status events, gRPC communications\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n // Includes the CR reconciliation logs\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"hypershift\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n // Includes: work agent operations, manifest application, status feedback\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"open-cluster-management-agent\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
err: <*errors.joinError | 0x260bd06af728>{
errs: [
<*fmt.wrapError | 0x260bcea34240>{
msg: "failed to execute custom logs query: error during query execution: failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n database('ServiceLogs').table('clustersServiceLogs')\n | where timestamp between (_startTime .. _endTime)\n | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n | where isnotempty(log.cid)\n | distinct tostring(log.cid)\n | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n | where isnotempty(resourceId)\n | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n (\n // Maestro logs: Resource bundle operations for this cluster and its associated resources\n // Includes: resource creation, updates, deletions, status events, gRPC communications\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n // Includes the CR reconciliation logs\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"hypershift\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n // Includes: work agent operations, manifest application, status feedback\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"open-cluster-management-agent\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
err: <*fmt.wrapError | 0x260bcea34220>{
msg: "error during query execution: failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n database('ServiceLogs').table('clustersServiceLogs')\n | where timestamp between (_startTime .. _endTime)\n | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n | where isnotempty(log.cid)\n | distinct tostring(log.cid)\n | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n | where isnotempty(resourceId)\n | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n (\n // Maestro logs: Resource bundle operations for this cluster and its associated resources\n // Includes: resource creation, updates, deletions, status events, gRPC communications\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n // Includes the CR reconciliation logs\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"hypershift\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n // Includes: work agent operations, manifest application, status feedback\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"open-cluster-management-agent\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
err: <*fmt.wrapError | 0x260bcfe34b60>{
msg: "failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n database('ServiceLogs').table('clustersServiceLogs')\n | where timestamp between (_startTime .. _endTime)\n | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n | where isnotempty(log.cid)\n | distinct tostring(log.cid)\n | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n | where isnotempty(resourceId)\n | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n (\n // Maestro logs: Resource bundle operations for this cluster and its associated resources\n // Includes: resource creation, updates, deletions, status events, gRPC communications\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n // Includes the CR reconciliation logs\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"hypershift\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n // Includes: work agent operations, manifest application, status feedback\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"open-cluster-management-agent\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
err: <*fmt.wrapError | 0x260bcfe34b00>{
msg: "failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n database('ServiceLogs').table('clustersServiceLogs')\n | where timestamp between (_startTime .. _endTime)\n | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n | where isnotempty(log.cid)\n | distinct tostring(log.cid)\n | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n | where isnotempty(resourceId)\n | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n (\n // Maestro logs: Resource bundle operations for this cluster and its associated resources\n // Includes: resource creation, updates, deletions, status events, gRPC communications\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n // Includes the CR reconciliation logs\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"hypershift\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n // Includes: work agent operations, manifest application, status feedback\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"open-cluster-management-agent\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
err: <*v2.OneApiError | 0x260bcef76000>{
ErrorMessage: {
Code: "LimitsExceeded",
Message: "Request is invalid and cannot be executed.",
Description: "Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..",
Type: "Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException",
Context: {
Timestamp: ...,
ServiceAlias: ...,
MachineName: ...,
ProcessName: ...,
ProcessId: ...,
ThreadId: ...,
ClientRequestId: ...,
ActivityId: ...,
SubActivityId: ...,
ActivityType: ...,
ParentActivityId: ...,
ActivityStack: ...,
},
IsPermanent: false,
},
},
},
},
},
},
],
},
}
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:96]: Timed out after 600.004s.
Expected success, but got an error:
<*fmt.wrapError | 0x260bcea34260>:
failed to gather logs: failed to execute custom logs query: error during query execution: failed to execute query: failed to read query "detailedInfraOrchestrationLogs" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);
let _endTime = datetime(2026-10-05T19:42:22.1821449Z);
// Extract cluster ID from CS logs using cid field
let _cs_cluster_id = toscalar(
database('ServiceLogs').table('clustersServiceLogs')
| where timestamp between (_startTime .. _endTime)
| where resource_id has 'kusto-logs-xj24lxzh8jt8'
| where isnotempty(log.cid)
| distinct tostring(log.cid)
| limit 1
);
// Find all Maestro resource IDs for this cluster
let maestro_resource_ids = (
database('ServiceLogs').table('containerLogs')
| where timestamp between (_startTime .. _endTime)
| where namespace_name has "maestro"
| extend logStr = tostring(log)
| where logStr has _cs_cluster_id
| extend resourceId = extract(@'resourceid[=:"]+([a-f0-9\-]+)', 1, logStr)
| where isnotempty(resourceId)
| distinct resourceId
);
// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent
union
(
// Maestro logs: Resource bundle operations for this cluster and its associated resources
// Includes: resource creation, updates, deletions, status events, gRPC communications
database('ServiceLogs').table('containerLogs')
| where timestamp between (_startTime .. _endTime)
| where namespace_name has "maestro"
| extend logStr = tostring(log)
| where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)
| project timestamp, container_name, msg = logStr, log
),
(
// Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs
// Includes the CR reconciliation logs
database('ServiceLogs').table('containerLogs')
| where timestamp between (_startTime .. _endTime)
| where namespace_name has "hypershift"
| extend logStr = tostring(log)
| where logStr has _cs_cluster_id
| project timestamp, container_name, msg = logStr, log
),
(
// ACM Agent logs: ManifestWork reconciliation on the managed cluster
// Includes: work agent operations, manifest application, status feedback
database('ServiceLogs').table('containerLogs')
| where timestamp between (_startTime .. _endTime)
| where namespace_name has "open-cluster-management-agent"
| extend logStr = tostring(log)
| where logStr has _cs_cluster_id
| project timestamp, container_name, msg = logStr, log
)
| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:"LimitsExceeded", Message:"Request is invalid and cannot be executed.", Description:"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..", Type:"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException", Context:v2.ErrorContext{Timestamp:"2026-10-05T19:42:30.9508158Z", ServiceAlias:"HCP-DEV-US-2", MachineName:"", ProcessName:"", ProcessId:0, ThreadId:0, ClientRequestId:"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4", ActivityId:"f7c0f10d-28d1-4f0c-aa3d-b966d3722931", SubActivityId:"f7c0f10d-28d1-4f0c-aa3d-b966d3722931", ActivityType:"GW.Http.CallContext", ParentActivityId:"f7c0f10d-28d1-4f0c-aa3d-b966d3722931", ActivityStack:"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)"}, IsPermanent:false})
{
msg: "failed to gather logs: failed to execute custom logs query: error during query execution: failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n database('ServiceLogs').table('clustersServiceLogs')\n | where timestamp between (_startTime .. _endTime)\n | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n | where isnotempty(log.cid)\n | distinct tostring(log.cid)\n | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n | where isnotempty(resourceId)\n | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n (\n // Maestro logs: Resource bundle operations for this cluster and its associated resources\n // Includes: resource creation, updates, deletions, status events, gRPC communications\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n // Includes the CR reconciliation logs\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"hypershift\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n // Includes: work agent operations, manifest application, status feedback\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"open-cluster-management-agent\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
err: <*errors.joinError | 0x260bd06af728>{
errs: [
<*fmt.wrapError | 0x260bcea34240>{
msg: "failed to execute custom logs query: error during query execution: failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n database('ServiceLogs').table('clustersServiceLogs')\n | where timestamp between (_startTime .. _endTime)\n | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n | where isnotempty(log.cid)\n | distinct tostring(log.cid)\n | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n | where isnotempty(resourceId)\n | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n (\n // Maestro logs: Resource bundle operations for this cluster and its associated resources\n // Includes: resource creation, updates, deletions, status events, gRPC communications\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n // Includes the CR reconciliation logs\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"hypershift\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n // Includes: work agent operations, manifest application, status feedback\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"open-cluster-management-agent\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
err: <*fmt.wrapError | 0x260bcea34220>{
msg: "error during query execution: failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n database('ServiceLogs').table('clustersServiceLogs')\n | where timestamp between (_startTime .. _endTime)\n | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n | where isnotempty(log.cid)\n | distinct tostring(log.cid)\n | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n | where isnotempty(resourceId)\n | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n (\n // Maestro logs: Resource bundle operations for this cluster and its associated resources\n // Includes: resource creation, updates, deletions, status events, gRPC communications\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n // Includes the CR reconciliation logs\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"hypershift\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n // Includes: work agent operations, manifest application, status feedback\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"open-cluster-management-agent\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
err: <*fmt.wrapError | 0x260bcfe34b60>{
msg: "failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n database('ServiceLogs').table('clustersServiceLogs')\n | where timestamp between (_startTime .. _endTime)\n | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n | where isnotempty(log.cid)\n | distinct tostring(log.cid)\n | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n | where isnotempty(resourceId)\n | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n (\n // Maestro logs: Resource bundle operations for this cluster and its associated resources\n // Includes: resource creation, updates, deletions, status events, gRPC communications\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n // Includes the CR reconciliation logs\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"hypershift\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n // Includes: work agent operations, manifest application, status feedback\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"open-cluster-management-agent\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
err: <*fmt.wrapError | 0x260bcfe34b00>{
msg: "failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n database('ServiceLogs').table('clustersServiceLogs')\n | where timestamp between (_startTime .. _endTime)\n | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n | where isnotempty(log.cid)\n | distinct tostring(log.cid)\n | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n | where isnotempty(resourceId)\n | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n (\n // Maestro logs: Resource bundle operations for this cluster and its associated resources\n // Includes: resource creation, updates, deletions, status events, gRPC communications\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"maestro\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n // Includes the CR reconciliation logs\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"hypershift\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n ),\n (\n // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n // Includes: work agent operations, manifest application, status feedback\n database('ServiceLogs').table('containerLogs')\n | where timestamp between (_startTime .. _endTime)\n | where namespace_name has \"open-cluster-management-agent\"\n | extend logStr = tostring(log)\n | where logStr has _cs_cluster_id\n | project timestamp, container_name, msg = logStr, log\n )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
err: <*v2.OneApiError | 0x260bcef76000>{
ErrorMessage: {
Code: "LimitsExceeded",
Message: "Request is invalid and cannot be executed.",
Description: "Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..",
Type: "Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException",
Context: {
Timestamp: ...,
ServiceAlias: ...,
MachineName: ...,
ProcessName: ...,
ProcessId: ...,
ThreadId: ...,
ClientRequestId: ...,
ActivityId: ...,
SubActivityId: ...,
ActivityType: ...,
ParentActivityId: ...,
ActivityStack: ...,
},
IsPermanent: false,
},
},
},
},
},
},
],
},
}Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRfailed to roll out Helm release: unable to continue with install: could not get information about the resource Deployment "maestro-agent" in namespace "<namespace>": the server wa...full failure pattern: failed to roll out Helm release: unable to continue with install: could not get information about the resource Deployment "maestro-agent" in namespace "<namespace>": the server was unable to return a response in the time allotted, but may still be processing Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | provision | 1 | 1.30%1 of 77 job runs affected | RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)time=2026-10-05T22:09:08.885Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 description="Step deploy\n Kind: Helm\n" time=2026-10-05T22:09:09.811Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 values="map[azure:map[clientId:f8b6549e-d7f6-4ed0-9e41-251cd63c5293 cloudEnvironmentName:AzurePublicCloud tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] broker:map[host:arohcp-ci01-maestro-j9785984.westus3-1.ts.eventgrid.azure.net port:8883] consumerName:hcp-underlay-j9785984-mgmt-1 credsKeyVault:map[name:ah-ci01-mg-j9785984-1 secret:hcp-underlay-j9785984-mgmt-1] deployment:map[zoneCount:3] glog_v:2 image:map[digest:sha256:9af415e086251e94f471e03844ce768bed6493653b6cabdaff68acf99573679d registry:arohcpsvcdev.azurecr.io repository:redhat-user-workloads/maestro-rhtap-tenant/maestro/maestro] installAppliedManifestWorkCRD:false replicas:1 serviceAccountName:maestro sideCar:map[image:map[digest:sha256:3a8316d42c6491dbc15f2cf59985901365c7c402d3a0649abe695a4a6554654e registry:mcr.microsoft.com repository:azurelinux/base/nginx]]]" time=2026-10-05T22:09:09.811Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 time=2026-10-05T22:09:25.359Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 namespace=maestro time=2026-10-05T22:09:40.945Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 dryRun=false time=2026-10-05T22:09:40.945Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 time=2026-10-05T22:09:41.070Z level=INFO msg="No release history found, running the first release..." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 time=2026-10-05T22:11:59.108Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 err="unable to continue with install: could not get information about the resource Deployment \"maestro-agent\" in namespace \"maestro\": the server was unable to return a response in the time allotted, but may still be processing the request (get deployments.apps maestro-agent)" time=2026-10-05T22:11:59.108Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 err="stamp 1: error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: unable to continue with install: could not get information about the resource Deployment \"maestro-agent\" in namespace \"maestro\": the server was unable to return a response in the time allotted, but may still be processing the request (get deployments.apps maestro-agent)" Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRtls: failed to verify certificate: x509: certificate signed by unknown authorityfull failure pattern: tls: failed to verify certificate: x509: certificate signed by unknown authority Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | e2e | 1 | 1.30%1 of 77 job runs affected | RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_serve_default_ingress_certificate_public.go:162]: sample app must return HTTP 200 over trusted HTTPS through public ingress
Unexpected error:
<*fmt.wrapError | 0x3372404d8860>:
VerifyDefaultIngressCertificate timed out after 35m0.006s: default ingress route must serve trusted HTTPS: Get "https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud": tls: failed to verify certificate: x509: certificate signed by unknown authority
{
msg: "VerifyDefaultIngressCertificate timed out after 35m0.006s: default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*fmt.wrapError | 0x3372404d86a0>{
msg: "default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*url.Error | 0x337240d25200>{
Op: "Get",
URL: "https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
Err: <*tls.CertificateVerificationError | 0x337240d251d0>{
UnverifiedCertificates: [
{
Raw: [48, 130, 3, 150, 48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
RawTBSCertificate: [48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1],
RawSubject: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x337240007ac0>{
N: {
neg: false,
abs: [9337245268397936185, 5255789798456801510, 14154494615915577176, 13109335347058024190, 5072296307041548036, 10439277193874690340, 17833462028520810340, 16099347852796190717, 15302004063425798626, 7170477405477910213, 9971114008945693550, 13006318046232270092, 8600807242817419703, 6308103462559865749, 15463010847702061686, 16363344735281340381, 7111570420315025654, 6109672876023564938, 15424636460196878899, 7713335239787772476, 10387744396337381444, 5635081974936846311, 14718196154500586111, 14611695969280247348, 1443315009325149712, 11815840286537703567, 12683726052456297414, 292525798815078696, 515881726454289397, 10099284332814716175, 2649542967606308371, 13084258991057181117],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [11686061353655275548, 5126660660355678701],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "reserved.hcp.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"reserved.hcp.osadev.cloud",
},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "reserved.hcp.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"reserved.hcp.osadev.cloud",
},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926798559, loc: nil},
NotAfter: {wall: 0, ext: 63942523959, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [2, 5, 29, 15],
Critical: true,
Value: [3, 2, 5, 160],
},
{Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
{
Id: [2, 5, 29, 37],
Critical: false,
Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
},
{
Id: [2, 5, 29, 17],
Critical: false,
Value: "0;\x829*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
},
{
Id: [2, 5, 29, 35],
Critical: false,
Value: [48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
},
{
Id: [2, 5, 29, 14],
Critical: false,
Value: [4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
AuthorityKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
Err: <x509.UnknownAuthorityError>{
Cert: {
Raw: [48, 130, 3, 150, 48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
RawTBSCertificate: [48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1],
RawSubject: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x337240007ac0>{
N: {
neg: false,
abs: [9337245268397936185, 5255789798456801510, 14154494615915577176, 13109335347058024190, 5072296307041548036, 10439277193874690340, 17833462028520810340, 16099347852796190717, 15302004063425798626, 7170477405477910213, 9971114008945693550, 13006318046232270092, 8600807242817419703, 6308103462559865749, 15463010847702061686, 16363344735281340381, 7111570420315025654, 6109672876023564938, 15424636460196878899, 7713335239787772476, 10387744396337381444, 5635081974936846311, 14718196154500586111, 14611695969280247348, 1443315009325149712, 11815840286537703567, 12683726052456297414, 292525798815078696, 515881726454289397, 10099284332814716175, 2649542967606308371, 13084258991057181117],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [11686061353655275548, 5126660660355678701],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "reserved.hcp.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"reserved.hcp.osadev.cloud",
},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "reserved.hcp.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"reserved.hcp.osadev.cloud",
},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926798559, loc: nil},
NotAfter: {wall: 0, ext: 63942523959, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [2, 5, 29, 15],
Critical: true,
Value: [3, 2, 5, 160],
},
{Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
{
Id: [2, 5, 29, 37],
Critical: false,
Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
},
{
Id: [2, 5, 29, 17],
Critical: false,
Value: "0;\x829*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
},
{
Id: [2, 5, 29, 35],
Critical: false,
Value: [48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
},
{
Id: [2, 5, 29, 14],
Critical: false,
Value: [4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
AuthorityKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
hintErr: nil,
hintCert: nil,
},
},
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_serve_default_ingress_certificate_public.go:162]: sample app must return HTTP 200 over trusted HTTPS through public ingress
Unexpected error:
<*fmt.wrapError | 0x3372404d8860>:
VerifyDefaultIngressCertificate timed out after 35m0.006s: default ingress route must serve trusted HTTPS: Get "https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud": tls: failed to verify certificate: x509: certificate signed by unknown authority
{
msg: "VerifyDefaultIngressCertificate timed out after 35m0.006s: default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*fmt.wrapError | 0x3372404d86a0>{
msg: "default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
err: <*url.Error | 0x337240d25200>{
Op: "Get",
URL: "https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
Err: <*tls.CertificateVerificationError | 0x337240d251d0>{
UnverifiedCertificates: [
{
Raw: [48, 130, 3, 150, 48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
RawTBSCertificate: [48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1],
RawSubject: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x337240007ac0>{
N: {
neg: false,
abs: [9337245268397936185, 5255789798456801510, 14154494615915577176, 13109335347058024190, 5072296307041548036, 10439277193874690340, 17833462028520810340, 16099347852796190717, 15302004063425798626, 7170477405477910213, 9971114008945693550, 13006318046232270092, 8600807242817419703, 6308103462559865749, 15463010847702061686, 16363344735281340381, 7111570420315025654, 6109672876023564938, 15424636460196878899, 7713335239787772476, 10387744396337381444, 5635081974936846311, 14718196154500586111, 14611695969280247348, 1443315009325149712, 11815840286537703567, 12683726052456297414, 292525798815078696, 515881726454289397, 10099284332814716175, 2649542967606308371, 13084258991057181117],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [11686061353655275548, 5126660660355678701],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "reserved.hcp.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"reserved.hcp.osadev.cloud",
},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "reserved.hcp.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"reserved.hcp.osadev.cloud",
},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926798559, loc: nil},
NotAfter: {wall: 0, ext: 63942523959, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [2, 5, 29, 15],
Critical: true,
Value: [3, 2, 5, 160],
},
{Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
{
Id: [2, 5, 29, 37],
Critical: false,
Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
},
{
Id: [2, 5, 29, 17],
Critical: false,
Value: "0;\x829*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
},
{
Id: [2, 5, 29, 35],
Critical: false,
Value: [48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
},
{
Id: [2, 5, 29, 14],
Critical: false,
Value: [4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
AuthorityKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
Err: <x509.UnknownAuthorityError>{
Cert: {
Raw: [48, 130, 3, 150, 48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
RawTBSCertificate: [48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1],
RawSubject: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x337240007ac0>{
N: {
neg: false,
abs: [9337245268397936185, 5255789798456801510, 14154494615915577176, 13109335347058024190, 5072296307041548036, 10439277193874690340, 17833462028520810340, 16099347852796190717, 15302004063425798626, 7170477405477910213, 9971114008945693550, 13006318046232270092, 8600807242817419703, 6308103462559865749, 15463010847702061686, 16363344735281340381, 7111570420315025654, 6109672876023564938, 15424636460196878899, 7713335239787772476, 10387744396337381444, 5635081974936846311, 14718196154500586111, 14611695969280247348, 1443315009325149712, 11815840286537703567, 12683726052456297414, 292525798815078696, 515881726454289397, 10099284332814716175, 2649542967606308371, 13084258991057181117],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [11686061353655275548, 5126660660355678701],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "reserved.hcp.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"reserved.hcp.osadev.cloud",
},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "reserved.hcp.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"reserved.hcp.osadev.cloud",
},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926798559, loc: nil},
NotAfter: {wall: 0, ext: 63942523959, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [2, 5, 29, 15],
Critical: true,
Value: [3, 2, 5, 160],
},
{Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
{
Id: [2, 5, 29, 37],
Critical: false,
Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
},
{
Id: [2, 5, 29, 17],
Critical: false,
Value: "0;\x829*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
},
{
Id: [2, 5, 29, 35],
Critical: false,
Value: [48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
},
{
Id: [2, 5, 29, 14],
Critical: false,
Value: [4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
AuthorityKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
hintErr: nil,
hintCert: nil,
},
},
},
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeadlineExceeded; provider Microsoft.Computefull failure pattern: ERROR CODE: DeadlineExceeded; provider Microsoft.Compute Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 7 days | e2e | 37 | 48.05%37 of 77 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 7 days | Show trend detailsSep 29: 10 · Sep 30: 8 · Oct 1: 21 · Oct 2: 21 · Oct 3: 10 · Oct 4: 61 · Oct 5: 276 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:159]: failed to create node pool "np-1" for private KAS cluster "private-kas"
Unexpected error:
<*fmt.wrapError | 0x87d3cbc4aa0>:
failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "private-kas" in resourcegroup="private-kas-jwhp5tq4cqwd" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c",
"name": "b0d48117-514b-478b-977c-25e8c43baf9c",
"status": "Failed",
"startTime": "2026-10-06T00:11:05.686165077Z",
"endTime": "2026-10-06T00:30:11.474018181Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed waiting for nodepool=\"np-1\" for cluster \"private-kas\" in resourcegroup=\"private-kas-jwhp5tq4cqwd\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\",\n \"name\": \"b0d48117-514b-478b-977c-25e8c43baf9c\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:11:05.686165077Z\",\n \"endTime\": \"2026-10-06T00:30:11.474018181Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x87d3d5a41c0>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"private-kas\" in resourcegroup=\"private-kas-jwhp5tq4cqwd\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\",\n \"name\": \"b0d48117-514b-478b-977c-25e8c43baf9c\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:11:05.686165077Z\",\n \"endTime\": \"2026-10-06T00:30:11.474018181Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x87d3de4c3c0>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["1387"],
"X-Envoy-Upstream-Service-Time": ["11"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"603ab4c0-fea1-47ce-8270-c4d08c44ea6b",
],
"Date": [
"Tue, 06 Oct 2026 00:30:18 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x87d3d5a4000>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 48, 100, 52, 56, 49, 49, 55, 45, 53, 49, 52, 98, 45, 52, 55, 56, 98, 45, 57, 55, 55, 99, 45, 50, 53, 101, 56, 99, 52, 51, 98, 97, 102, 57, 99, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 48, 100, 52, 56, 49, 49, 55, 45, 53, 49, 52, 98, 45, 52, 55, 56, 98, 45, 57, 55, 55, 99, 45, 50, 53, 101, 56, 99, 52, 51, 98, 97, 102, 57, 99, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 49, 58, 48, 53, 46, 54, 56, 54, 49, 54, 53, 48, 55, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 48, 58, 49, 49, 46, 52, 55, 52, 48, 49, 56, 49, 56, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 49, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 49, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 106, 119, 104, 112, 53, 116, 113, 52, 99, 113, 119, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 49, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 106, 119, 104, 112, 53, 116, 113, 52, 99, 113, 119, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1387,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"4ec77276-bcdf-4f79-a17b-de505a326025",
],
"X-Ms-Client-Request-Id": [
"76f6daf9-5cb5-4a8d-a190-0b8e8b6c620f",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:30:18Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x87d3cd125d0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12798357290586720628, 8480743146650813573],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926839811, loc: nil},
NotAfter: {wall: 0, ext: 63942565211, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j5947136.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\",\n \"name\": \"b0d48117-514b-478b-977c-25e8c43baf9c\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:11:05.686165077Z\",\n \"endTime\": \"2026-10-06T00:30:11.474018181Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:159]: failed to create node pool "np-1" for private KAS cluster "private-kas"
Unexpected error:
<*fmt.wrapError | 0x87d3cbc4aa0>:
failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "private-kas" in resourcegroup="private-kas-jwhp5tq4cqwd" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c",
"name": "b0d48117-514b-478b-977c-25e8c43baf9c",
"status": "Failed",
"startTime": "2026-10-06T00:11:05.686165077Z",
"endTime": "2026-10-06T00:30:11.474018181Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed waiting for nodepool=\"np-1\" for cluster \"private-kas\" in resourcegroup=\"private-kas-jwhp5tq4cqwd\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\",\n \"name\": \"b0d48117-514b-478b-977c-25e8c43baf9c\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:11:05.686165077Z\",\n \"endTime\": \"2026-10-06T00:30:11.474018181Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x87d3d5a41c0>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"private-kas\" in resourcegroup=\"private-kas-jwhp5tq4cqwd\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\",\n \"name\": \"b0d48117-514b-478b-977c-25e8c43baf9c\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:11:05.686165077Z\",\n \"endTime\": \"2026-10-06T00:30:11.474018181Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x87d3de4c3c0>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["1387"],
"X-Envoy-Upstream-Service-Time": ["11"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"603ab4c0-fea1-47ce-8270-c4d08c44ea6b",
],
"Date": [
"Tue, 06 Oct 2026 00:30:18 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x87d3d5a4000>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 48, 100, 52, 56, 49, 49, 55, 45, 53, 49, 52, 98, 45, 52, 55, 56, 98, 45, 57, 55, 55, 99, 45, 50, 53, 101, 56, 99, 52, 51, 98, 97, 102, 57, 99, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 48, 100, 52, 56, 49, 49, 55, 45, 53, 49, 52, 98, 45, 52, 55, 56, 98, 45, 57, 55, 55, 99, 45, 50, 53, 101, 56, 99, 52, 51, 98, 97, 102, 57, 99, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 49, 58, 48, 53, 46, 54, 56, 54, 49, 54, 53, 48, 55, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 48, 58, 49, 49, 46, 52, 55, 52, 48, 49, 56, 49, 56, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 49, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 49, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 106, 119, 104, 112, 53, 116, 113, 52, 99, 113, 119, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 49, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 106, 119, 104, 112, 53, 116, 113, 52, 99, 113, 119, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1387,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"4ec77276-bcdf-4f79-a17b-de505a326025",
],
"X-Ms-Client-Request-Id": [
"76f6daf9-5cb5-4a8d-a190-0b8e8b6c620f",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:30:18Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x87d3cd125d0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12798357290586720628, 8480743146650813573],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926839811, loc: nil},
NotAfter: {wall: 0, ext: 63942565211, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j5947136.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\",\n \"name\": \"b0d48117-514b-478b-977c-25e8c43baf9c\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:11:05.686165077Z\",\n \"endTime\": \"2026-10-06T00:30:11.474018181Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-xhdn56" for cluster "cluster-candidate-5-0-xhdn56"
Unexpected error:
<*fmt.wrapError | 0x73c49f3c980>:
failed to create NodePool np-xhdn56: failed waiting for nodepool="np-xhdn56" for cluster "cluster-candidate-5-0-xhdn56" in resourcegroup="rg-candidate-5-0-l69m5s2wj9zh" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560",
"name": "63aba31b-da06-4f4a-9914-cbd8d6017560",
"status": "Failed",
"startTime": "2026-10-06T00:10:54.897052208Z",
"endTime": "2026-10-06T00:30:01.84112593Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-xhdn56: failed waiting for nodepool=\"np-xhdn56\" for cluster \"cluster-candidate-5-0-xhdn56\" in resourcegroup=\"rg-candidate-5-0-l69m5s2wj9zh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\",\n \"name\": \"63aba31b-da06-4f4a-9914-cbd8d6017560\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:10:54.897052208Z\",\n \"endTime\": \"2026-10-06T00:30:01.84112593Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x73c4a89ecc0>{
msg: "failed waiting for nodepool=\"np-xhdn56\" for cluster \"cluster-candidate-5-0-xhdn56\" in resourcegroup=\"rg-candidate-5-0-l69m5s2wj9zh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\",\n \"name\": \"63aba31b-da06-4f4a-9914-cbd8d6017560\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:10:54.897052208Z\",\n \"endTime\": \"2026-10-06T00:30:01.84112593Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x73c4b254c30>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["7"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"cbeb0ebc-f5fc-4c59-9458-989384b89c6d",
],
"Date": [
"Tue, 06 Oct 2026 00:30:08 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x73c4a89eae0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 54, 51, 97, 98, 97, 51, 49, 98, 45, 100, 97, 48, 54, 45, 52, 102, 52, 97, 45, 57, 57, 49, 52, 45, 99, 98, 100, 56, 100, 54, 48, 49, 55, 53, 54, 48, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 54, 51, 97, 98, 97, 51, 49, 98, 45, 100, 97, 48, 54, 45, 52, 102, 52, 97, 45, 57, 57, 49, 52, 45, 99, 98, 100, 56, 100, 54, 48, 49, 55, 53, 54, 48, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 48, 58, 53, 52, 46, 56, 57, 55, 48, 53, 50, 50, 48, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 48, 58, 48, 49, 46, 56, 52, 49, 49, 50, 53, 57, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"d6f9bece-8fd8-4312-a433-a0c321f4c5f1",
],
"X-Ms-Client-Request-Id": [
"6f8bed6d-9a07-4894-b3b1-18e9c91b02ca",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:30:08Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x73c4a679ae0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12798357290586720628, 8480743146650813573],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926839811, loc: nil},
NotAfter: {wall: 0, ext: 63942565211, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j5947136.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\",\n \"name\": \"63aba31b-da06-4f4a-9914-cbd8d6017560\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:10:54.897052208Z\",\n \"endTime\": \"2026-10-06T00:30:01.84112593Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-xhdn56" for cluster "cluster-candidate-5-0-xhdn56"
Unexpected error:
<*fmt.wrapError | 0x73c49f3c980>:
failed to create NodePool np-xhdn56: failed waiting for nodepool="np-xhdn56" for cluster "cluster-candidate-5-0-xhdn56" in resourcegroup="rg-candidate-5-0-l69m5s2wj9zh" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560",
"name": "63aba31b-da06-4f4a-9914-cbd8d6017560",
"status": "Failed",
"startTime": "2026-10-06T00:10:54.897052208Z",
"endTime": "2026-10-06T00:30:01.84112593Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-xhdn56: failed waiting for nodepool=\"np-xhdn56\" for cluster \"cluster-candidate-5-0-xhdn56\" in resourcegroup=\"rg-candidate-5-0-l69m5s2wj9zh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\",\n \"name\": \"63aba31b-da06-4f4a-9914-cbd8d6017560\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:10:54.897052208Z\",\n \"endTime\": \"2026-10-06T00:30:01.84112593Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x73c4a89ecc0>{
msg: "failed waiting for nodepool=\"np-xhdn56\" for cluster \"cluster-candidate-5-0-xhdn56\" in resourcegroup=\"rg-candidate-5-0-l69m5s2wj9zh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\",\n \"name\": \"63aba31b-da06-4f4a-9914-cbd8d6017560\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:10:54.897052208Z\",\n \"endTime\": \"2026-10-06T00:30:01.84112593Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x73c4b254c30>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["7"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"cbeb0ebc-f5fc-4c59-9458-989384b89c6d",
],
"Date": [
"Tue, 06 Oct 2026 00:30:08 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x73c4a89eae0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 54, 51, 97, 98, 97, 51, 49, 98, 45, 100, 97, 48, 54, 45, 52, 102, 52, 97, 45, 57, 57, 49, 52, 45, 99, 98, 100, 56, 100, 54, 48, 49, 55, 53, 54, 48, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 54, 51, 97, 98, 97, 51, 49, 98, 45, 100, 97, 48, 54, 45, 52, 102, 52, 97, 45, 57, 57, 49, 52, 45, 99, 98, 100, 56, 100, 54, 48, 49, 55, 53, 54, 48, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 48, 58, 53, 52, 46, 56, 57, 55, 48, 53, 50, 50, 48, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 48, 58, 48, 49, 46, 56, 52, 49, 49, 50, 53, 57, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"d6f9bece-8fd8-4312-a433-a0c321f4c5f1",
],
"X-Ms-Client-Request-Id": [
"6f8bed6d-9a07-4894-b3b1-18e9c91b02ca",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:30:08Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x73c4a679ae0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12798357290586720628, 8480743146650813573],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926839811, loc: nil},
NotAfter: {wall: 0, ext: 63942565211, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j5947136.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\",\n \"name\": \"63aba31b-da06-4f4a-9914-cbd8d6017560\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:10:54.897052208Z\",\n \"endTime\": \"2026-10-06T00:30:01.84112593Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
<*errors.joinError | 0xd75da0ec270>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-zjz8vfx54pwq" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466",
"name": "1a2981fe-47af-45c6-aa16-68dab8daa466",
"status": "Failed",
"startTime": "2026-10-06T00:14:09.62885793Z",
"endTime": "2026-10-06T00:33:11.463583946Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0xd75da0ec210>{
errs: [
<*fmt.wrapError | 0xd75db066900>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0xd75dae671a0>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0xd75dafb0500>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
err: <*fmt.wrapError | 0xd75dafb04e0>{
msg: "not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
err: <*errors.errorString | 0xd75d9a137a0>{
s: "no cilium pods found in kube-system namespace",
},
},
},
],
},
<*fmt.wrapError | 0xd75db066060>{
msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-zjz8vfx54pwq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\",\n \"name\": \"1a2981fe-47af-45c6-aa16-68dab8daa466\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:14:09.62885793Z\",\n \"endTime\": \"2026-10-06T00:33:11.463583946Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xd75db0d03a0>{
msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-zjz8vfx54pwq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\",\n \"name\": \"1a2981fe-47af-45c6-aa16-68dab8daa466\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:14:09.62885793Z\",\n \"endTime\": \"2026-10-06T00:33:11.463583946Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xd75dbce6870>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"84f21420-6517-4fcd-a156-bde9ed70da59",
],
"Date": [
"Tue, 06 Oct 2026 00:33:13 GMT",
],
"Content-Length": ["1645"],
"X-Envoy-Upstream-Service-Time": ["7"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0xd75db0d02c0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 49, 97, 50, 57, 56, 49, 102, 101, 45, 52, 55, 97, 102, 45, 52, 53, 99, 54, 45, 97, 97, 49, 54, 45, 54, 56, 100, 97, 98, 56, 100, 97, 97, 52, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 49, 97, 50, 57, 56, 49, 102, 101, 45, 52, 55, 97, 102, 45, 52, 53, 99, 54, 45, 97, 97, 49, 54, 45, 54, 56, 100, 97, 98, 56, 100, 97, 97, 52, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 52, 58, 48, 57, 46, 54, 50, 56, 56, 53, 55, 57, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 51, 58, 49, 49, 46, 52, 54, 51, 53, 56, 51, 57, 52, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 120, 103, 98, 110, 53, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 122, 106, 122, 56, 118, 102, 120, 53, 52, 112, 119, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 120, 103, 98, 110, 53, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 122, 106, 122, 56, 118, 102, 120, 53, 52, 112, 119, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1645,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"e744a325-a27c-41a0-9df8-747b325e8113",
],
"X-Ms-Client-Request-Id": [
"da44c5b3-1830-4973-a452-c8236a098071",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:33:13Z\"}",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0xd75db6ac3b0>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\",\n \"name\": \"1a2981fe-47af-45c6-aa16-68dab8daa466\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:14:09.62885793Z\",\n \"endTime\": \"2026-10-06T00:33:11.463583946Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
<*errors.joinError | 0xd75da0ec270>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-zjz8vfx54pwq" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466",
"name": "1a2981fe-47af-45c6-aa16-68dab8daa466",
"status": "Failed",
"startTime": "2026-10-06T00:14:09.62885793Z",
"endTime": "2026-10-06T00:33:11.463583946Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0xd75da0ec210>{
errs: [
<*fmt.wrapError | 0xd75db066900>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0xd75dae671a0>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0xd75dafb0500>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
err: <*fmt.wrapError | 0xd75dafb04e0>{
msg: "not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
err: <*errors.errorString | 0xd75d9a137a0>{
s: "no cilium pods found in kube-system namespace",
},
},
},
],
},
<*fmt.wrapError | 0xd75db066060>{
msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-zjz8vfx54pwq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\",\n \"name\": \"1a2981fe-47af-45c6-aa16-68dab8daa466\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:14:09.62885793Z\",\n \"endTime\": \"2026-10-06T00:33:11.463583946Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xd75db0d03a0>{
msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-zjz8vfx54pwq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\",\n \"name\": \"1a2981fe-47af-45c6-aa16-68dab8daa466\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:14:09.62885793Z\",\n \"endTime\": \"2026-10-06T00:33:11.463583946Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xd75dbce6870>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"84f21420-6517-4fcd-a156-bde9ed70da59",
],
"Date": [
"Tue, 06 Oct 2026 00:33:13 GMT",
],
"Content-Length": ["1645"],
"X-Envoy-Upstream-Service-Time": ["7"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0xd75db0d02c0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 49, 97, 50, 57, 56, 49, 102, 101, 45, 52, 55, 97, 102, 45, 52, 53, 99, 54, 45, 97, 97, 49, 54, 45, 54, 56, 100, 97, 98, 56, 100, 97, 97, 52, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 49, 97, 50, 57, 56, 49, 102, 101, 45, 52, 55, 97, 102, 45, 52, 53, 99, 54, 45, 97, 97, 49, 54, 45, 54, 56, 100, 97, 98, 56, 100, 97, 97, 52, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 52, 58, 48, 57, 46, 54, 50, 56, 56, 53, 55, 57, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 51, 58, 49, 49, 46, 52, 54, 51, 53, 56, 51, 57, 52, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 120, 103, 98, 110, 53, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 122, 106, 122, 56, 118, 102, 120, 53, 52, 112, 119, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 120, 103, 98, 110, 53, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 122, 106, 122, 56, 118, 102, 120, 53, 52, 112, 119, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1645,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"e744a325-a27c-41a0-9df8-747b325e8113",
],
"X-Ms-Client-Request-Id": [
"da44c5b3-1830-4973-a452-c8236a098071",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:33:13Z\"}",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0xd75db6ac3b0>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\",\n \"name\": \"1a2981fe-47af-45c6-aa16-68dab8daa466\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:14:09.62885793Z\",\n \"endTime\": \"2026-10-06T00:33:11.463583946Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurredContributing tests (20)
Affected runs (37) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
client rate limiter Wait returned an error: context deadline exceededfull failure pattern: client rate limiter Wait returned an error: context deadline exceeded Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 4 days | e2e | 27 | 35.06%27 of 77 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 4 days | Show trend detailsSep 29: 0 · Sep 30: 1 · Oct 1: 0 · Oct 2: 4 · Oct 3: 0 · Oct 4: 5 · Oct 5: 36 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:193]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
<*errors.joinError | 0x34e792c98030>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool cilium-np: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-mmc2xb78g9bz" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9",
"name": "b706eec9-2140-4d2a-886f-fbf6a9c66dd9",
"status": "Failed",
"startTime": "2026-10-06T00:23:40.809196099Z",
"endTime": "2026-10-06T00:42:49.207450913Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x34e792c98018>{
errs: [
<*fmt.wrapError | 0x34e792adad20>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x34e793b0fd30>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x34e7934e0260>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x34e7934e0240>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x34e7934e0200>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x34e7934e01e0>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x34e7934f0aa0>{
msg: "failed to create NodePool cilium-np: failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-mmc2xb78g9bz\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n \"name\": \"b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:40.809196099Z\",\n \"endTime\": \"2026-10-06T00:42:49.207450913Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x34e7931a8cc0>{
msg: "failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-mmc2xb78g9bz\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n \"name\": \"b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:40.809196099Z\",\n \"endTime\": \"2026-10-06T00:42:49.207450913Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x34e7935f8f30>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["12"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"ec6d1a06-8329-4fda-80cb-6f299a2e3b46",
],
"Date": [
"Tue, 06 Oct 2026 00:42:54 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x34e7931a8b60>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 55, 48, 54, 101, 101, 99, 57, 45, 50, 49, 52, 48, 45, 52, 100, 50, 97, 45, 56, 56, 54, 102, 45, 102, 98, 102, 54, 97, 57, 99, 54, 54, 100, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 55, 48, 54, 101, 101, 99, 57, 45, 50, 49, 52, 48, 45, 52, 100, 50, 97, 45, 56, 56, 54, 102, 45, 102, 98, 102, 54, 97, 57, 99, 54, 54, 100, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 51, 58, 52, 48, 46, 56, 48, 57, 49, 57, 54, 48, 57, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 52, 57, 46, 50, 48, 55, 52, 53, 48, 57, 49, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 115, 116, 99, 114, 104, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 115, 116, 99, 114, 104, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 115, 116, 99, 114, 104, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 115, 101, 116, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 50, 116, 56, 117, 116, 106, 105, 98, 113, 54, 54, 111, 113, 48, 50, 101, 55, 97, 54, 51, 117, 48, 56, 53, 53, 100, 101, 53, 57, 111, 101, 97, 95, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 97, 115, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 115, 101, 116, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 83, 101, 116, 115, 47, 50, 116, 56, 117, 116, 106, 105, 98, 113, 54, 54, 111, 113, 48, 50, 101, 55, 97, 54, 51, 117, 48, 56, 53, 53, 100, 101, 53, 57, 111, 101, 97, 95, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 97, 115, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 39, 32, 97, 99, 116, 111, 114, 32, 39, 51, 57, 101, 101, 102, 99, 52, 102, 45, 53, 101, 50, 52, 45, 52, 57, 49, 100, 45, 57, 102, 48, 57, 45, 98, 99, 99, 48, 97, 100, 53, 55, 51, 98, 99, 102, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"b75ee27e-2e14-4129-9e4d-0d377c24b1a9",
],
"X-Ms-Client-Request-Id": [
"785a8b33-08f1-4ca1-ad3f-503cda07acc8",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:42:54Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x34e792a80cf0>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n \"name\": \"b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:40.809196099Z\",\n \"endTime\": \"2026-10-06T00:42:49.207450913Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:193]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
<*errors.joinError | 0x34e792c98030>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool cilium-np: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-mmc2xb78g9bz" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9",
"name": "b706eec9-2140-4d2a-886f-fbf6a9c66dd9",
"status": "Failed",
"startTime": "2026-10-06T00:23:40.809196099Z",
"endTime": "2026-10-06T00:42:49.207450913Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x34e792c98018>{
errs: [
<*fmt.wrapError | 0x34e792adad20>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x34e793b0fd30>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x34e7934e0260>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x34e7934e0240>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x34e7934e0200>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x34e7934e01e0>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x34e7934f0aa0>{
msg: "failed to create NodePool cilium-np: failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-mmc2xb78g9bz\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n \"name\": \"b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:40.809196099Z\",\n \"endTime\": \"2026-10-06T00:42:49.207450913Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x34e7931a8cc0>{
msg: "failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-mmc2xb78g9bz\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n \"name\": \"b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:40.809196099Z\",\n \"endTime\": \"2026-10-06T00:42:49.207450913Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x34e7935f8f30>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["12"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"ec6d1a06-8329-4fda-80cb-6f299a2e3b46",
],
"Date": [
"Tue, 06 Oct 2026 00:42:54 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x34e7931a8b60>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 55, 48, 54, 101, 101, 99, 57, 45, 50, 49, 52, 48, 45, 52, 100, 50, 97, 45, 56, 56, 54, 102, 45, 102, 98, 102, 54, 97, 57, 99, 54, 54, 100, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 55, 48, 54, 101, 101, 99, 57, 45, 50, 49, 52, 48, 45, 52, 100, 50, 97, 45, 56, 56, 54, 102, 45, 102, 98, 102, 54, 97, 57, 99, 54, 54, 100, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 51, 58, 52, 48, 46, 56, 48, 57, 49, 57, 54, 48, 57, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 52, 57, 46, 50, 48, 55, 52, 53, 48, 57, 49, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 115, 116, 99, 114, 104, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 115, 116, 99, 114, 104, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 115, 116, 99, 114, 104, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 115, 101, 116, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 50, 116, 56, 117, 116, 106, 105, 98, 113, 54, 54, 111, 113, 48, 50, 101, 55, 97, 54, 51, 117, 48, 56, 53, 53, 100, 101, 53, 57, 111, 101, 97, 95, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 97, 115, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 115, 101, 116, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 83, 101, 116, 115, 47, 50, 116, 56, 117, 116, 106, 105, 98, 113, 54, 54, 111, 113, 48, 50, 101, 55, 97, 54, 51, 117, 48, 56, 53, 53, 100, 101, 53, 57, 111, 101, 97, 95, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 97, 115, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 39, 32, 97, 99, 116, 111, 114, 32, 39, 51, 57, 101, 101, 102, 99, 52, 102, 45, 53, 101, 50, 52, 45, 52, 57, 49, 100, 45, 57, 102, 48, 57, 45, 98, 99, 99, 48, 97, 100, 53, 55, 51, 98, 99, 102, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"b75ee27e-2e14-4129-9e4d-0d377c24b1a9",
],
"X-Ms-Client-Request-Id": [
"785a8b33-08f1-4ca1-ad3f-503cda07acc8",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:42:54Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x34e792a80cf0>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n \"name\": \"b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:40.809196099Z\",\n \"endTime\": \"2026-10-06T00:42:49.207450913Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
<*errors.joinError | 0x8a5d7b18078>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-7zrw7bt2w5s4" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76",
"name": "6e1a1bac-777c-489b-a4ad-a4ce327f9e76",
"status": "Failed",
"startTime": "2026-10-06T00:23:01.529024983Z",
"endTime": "2026-10-06T00:42:08.957585569Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x8a5d7b18048>{
errs: [
<*fmt.wrapError | 0x8a5d7792020>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x8a5d7ad42d0>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x8a5d745c260>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x8a5d745c240>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x8a5d745c200>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x8a5d745c1e0>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x8a5d751e8a0>{
msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-7zrw7bt2w5s4\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n \"name\": \"6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:01.529024983Z\",\n \"endTime\": \"2026-10-06T00:42:08.957585569Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x8a5d751e680>{
msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-7zrw7bt2w5s4\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n \"name\": \"6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:01.529024983Z\",\n \"endTime\": \"2026-10-06T00:42:08.957585569Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x8a5d741cd20>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"8a808e74-a7a5-4e02-b899-c9cfe73958f6",
],
"Date": [
"Tue, 06 Oct 2026 00:42:14 GMT",
],
"X-Envoy-Upstream-Service-Time": ["9"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x8a5d751e5a0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 54, 101, 49, 97, 49, 98, 97, 99, 45, 55, 55, 55, 99, 45, 52, 56, 57, 98, 45, 97, 52, 97, 100, 45, 97, 52, 99, 101, 51, 50, 55, 102, 57, 101, 55, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 54, 101, 49, 97, 49, 98, 97, 99, 45, 55, 55, 55, 99, 45, 52, 56, 57, 98, 45, 97, 52, 97, 100, 45, 97, 52, 99, 101, 51, 50, 55, 102, 57, 101, 55, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 51, 58, 48, 49, 46, 53, 50, 57, 48, 50, 52, 57, 56, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 48, 56, 46, 57, 53, 55, 53, 56, 53, 53, 54, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 98, 119, 50, 115, 53, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 55, 122, 114, 119, 55, 98, 116, 50, 119, 53, 115, 52, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 98, 119, 50, 115, 53, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 55, 122, 114, 119, 55, 98, 116, 50, 119, 53, 115, 52, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 55, 122, 114, 119, 55, 98, 116, 50, 119, 53, 115, 52, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 39, 32, 97, 99, 116, 111, 114, 32, 39, 51, 57, 101, 101, 102, 99, 52, 102, 45, 53, 101, 50, 52, 45, 52, 57, 49, 100, 45, 57, 102, 48, 57, 45, 98, 99, 99, 48, 97, 100, 53, 55, 51, 98, 99, 102, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Authorization": ["redacted"],
"X-Ms-Correlation-Request-Id": [
"6d01cafb-a9cb-45c8-9cce-57f3b1b4f172",
],
"X-Ms-Client-Request-Id": [
"da5486fc-d5e7-44b9-810a-8d1d4e00fbed",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:42:14Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x8a5d822f990>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n \"name\": \"6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:01.529024983Z\",\n \"endTime\": \"2026-10-06T00:42:08.957585569Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
<*errors.joinError | 0x8a5d7b18078>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-7zrw7bt2w5s4" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76",
"name": "6e1a1bac-777c-489b-a4ad-a4ce327f9e76",
"status": "Failed",
"startTime": "2026-10-06T00:23:01.529024983Z",
"endTime": "2026-10-06T00:42:08.957585569Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x8a5d7b18048>{
errs: [
<*fmt.wrapError | 0x8a5d7792020>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x8a5d7ad42d0>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x8a5d745c260>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x8a5d745c240>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x8a5d745c200>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x8a5d745c1e0>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x8a5d751e8a0>{
msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-7zrw7bt2w5s4\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n \"name\": \"6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:01.529024983Z\",\n \"endTime\": \"2026-10-06T00:42:08.957585569Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x8a5d751e680>{
msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-7zrw7bt2w5s4\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n \"name\": \"6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:01.529024983Z\",\n \"endTime\": \"2026-10-06T00:42:08.957585569Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x8a5d741cd20>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"8a808e74-a7a5-4e02-b899-c9cfe73958f6",
],
"Date": [
"Tue, 06 Oct 2026 00:42:14 GMT",
],
"X-Envoy-Upstream-Service-Time": ["9"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x8a5d751e5a0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 54, 101, 49, 97, 49, 98, 97, 99, 45, 55, 55, 55, 99, 45, 52, 56, 57, 98, 45, 97, 52, 97, 100, 45, 97, 52, 99, 101, 51, 50, 55, 102, 57, 101, 55, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 54, 101, 49, 97, 49, 98, 97, 99, 45, 55, 55, 55, 99, 45, 52, 56, 57, 98, 45, 97, 52, 97, 100, 45, 97, 52, 99, 101, 51, 50, 55, 102, 57, 101, 55, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 51, 58, 48, 49, 46, 53, 50, 57, 48, 50, 52, 57, 56, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 48, 56, 46, 57, 53, 55, 53, 56, 53, 53, 54, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 98, 119, 50, 115, 53, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 55, 122, 114, 119, 55, 98, 116, 50, 119, 53, 115, 52, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 98, 119, 50, 115, 53, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 55, 122, 114, 119, 55, 98, 116, 50, 119, 53, 115, 52, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 55, 122, 114, 119, 55, 98, 116, 50, 119, 53, 115, 52, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 39, 32, 97, 99, 116, 111, 114, 32, 39, 51, 57, 101, 101, 102, 99, 52, 102, 45, 53, 101, 50, 52, 45, 52, 57, 49, 100, 45, 57, 102, 48, 57, 45, 98, 99, 99, 48, 97, 100, 53, 55, 51, 98, 99, 102, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Authorization": ["redacted"],
"X-Ms-Correlation-Request-Id": [
"6d01cafb-a9cb-45c8-9cce-57f3b1b4f172",
],
"X-Ms-Client-Request-Id": [
"da5486fc-d5e7-44b9-810a-8d1d4e00fbed",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:42:14Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x8a5d822f990>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n \"name\": \"6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:01.529024983Z\",\n \"endTime\": \"2026-10-06T00:42:08.957585569Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
<*errors.joinError | 0x124a88912018>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-q9jgfkvl8wfd" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca",
"name": "17635fe1-58eb-49b7-8f56-02062587c9ca",
"status": "Failed",
"startTime": "2026-10-06T00:17:22.925439722Z",
"endTime": "2026-10-06T00:36:24.290937421Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x124a88912000>{
errs: [
<*fmt.wrapError | 0x124a89baf100>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x124a8987cc30>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x124a89bae240>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x124a89bae220>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x124a89bae1e0>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x124a89bae1c0>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x124a89c3c3c0>{
msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-q9jgfkvl8wfd\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\",\n \"name\": \"17635fe1-58eb-49b7-8f56-02062587c9ca\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:17:22.925439722Z\",\n \"endTime\": \"2026-10-06T00:36:24.290937421Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x124a88604520>{
msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-q9jgfkvl8wfd\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\",\n \"name\": \"17635fe1-58eb-49b7-8f56-02062587c9ca\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:17:22.925439722Z\",\n \"endTime\": \"2026-10-06T00:36:24.290937421Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x124a88dfc840>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"104849b7-9743-4b31-821d-345ed3dffead",
],
"Date": [
"Tue, 06 Oct 2026 00:36:25 GMT",
],
"Content-Length": ["1646"],
"X-Envoy-Upstream-Service-Time": ["8"],
},
Body: <*exported.nopClosingBytesReader | 0x124a88604440>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 49, 55, 54, 51, 53, 102, 101, 49, 45, 53, 56, 101, 98, 45, 52, 57, 98, 55, 45, 56, 102, 53, 54, 45, 48, 50, 48, 54, 50, 53, 56, 55, 99, 57, 99, 97, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 49, 55, 54, 51, 53, 102, 101, 49, 45, 53, 56, 101, 98, 45, 52, 57, 98, 55, 45, 56, 102, 53, 54, 45, 48, 50, 48, 54, 50, 53, 56, 55, 99, 57, 99, 97, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 55, 58, 50, 50, 46, 57, 50, 53, 52, 51, 57, 55, 50, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 54, 58, 50, 52, 46, 50, 57, 48, 57, 51, 55, 52, 50, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 112, 120, 53, 109, 115, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 113, 57, 106, 103, 102, 107, 118, 108, 56, 119, 102, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 112, 120, 53, 109, 115, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 113, 57, 106, 103, 102, 107, 118, 108, 56, 119, 102, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1646,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j9938304.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Authorization": ["redacted"],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"3e1faf47-a710-4139-aaba-847d9f08d99c",
],
"X-Ms-Client-Request-Id": [
"4f200bc1-9193-40c2-aea0-0e6f7338b9f8",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:36:25Z\"}",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j9938304.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j9938304.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x124a89bf5380>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\",\n \"name\": \"17635fe1-58eb-49b7-8f56-02062587c9ca\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:17:22.925439722Z\",\n \"endTime\": \"2026-10-06T00:36:24.290937421Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
<*errors.joinError | 0x124a88912018>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-q9jgfkvl8wfd" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca",
"name": "17635fe1-58eb-49b7-8f56-02062587c9ca",
"status": "Failed",
"startTime": "2026-10-06T00:17:22.925439722Z",
"endTime": "2026-10-06T00:36:24.290937421Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x124a88912000>{
errs: [
<*fmt.wrapError | 0x124a89baf100>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x124a8987cc30>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x124a89bae240>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x124a89bae220>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x124a89bae1e0>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x124a89bae1c0>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x124a89c3c3c0>{
msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-q9jgfkvl8wfd\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\",\n \"name\": \"17635fe1-58eb-49b7-8f56-02062587c9ca\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:17:22.925439722Z\",\n \"endTime\": \"2026-10-06T00:36:24.290937421Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x124a88604520>{
msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-q9jgfkvl8wfd\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\",\n \"name\": \"17635fe1-58eb-49b7-8f56-02062587c9ca\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:17:22.925439722Z\",\n \"endTime\": \"2026-10-06T00:36:24.290937421Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x124a88dfc840>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"104849b7-9743-4b31-821d-345ed3dffead",
],
"Date": [
"Tue, 06 Oct 2026 00:36:25 GMT",
],
"Content-Length": ["1646"],
"X-Envoy-Upstream-Service-Time": ["8"],
},
Body: <*exported.nopClosingBytesReader | 0x124a88604440>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 49, 55, 54, 51, 53, 102, 101, 49, 45, 53, 56, 101, 98, 45, 52, 57, 98, 55, 45, 56, 102, 53, 54, 45, 48, 50, 48, 54, 50, 53, 56, 55, 99, 57, 99, 97, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 49, 55, 54, 51, 53, 102, 101, 49, 45, 53, 56, 101, 98, 45, 52, 57, 98, 55, 45, 56, 102, 53, 54, 45, 48, 50, 48, 54, 50, 53, 56, 55, 99, 57, 99, 97, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 55, 58, 50, 50, 46, 57, 50, 53, 52, 51, 57, 55, 50, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 54, 58, 50, 52, 46, 50, 57, 48, 57, 51, 55, 52, 50, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 112, 120, 53, 109, 115, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 113, 57, 106, 103, 102, 107, 118, 108, 56, 119, 102, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 112, 120, 53, 109, 115, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 113, 57, 106, 103, 102, 107, 118, 108, 56, 119, 102, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1646,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j9938304.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Authorization": ["redacted"],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"3e1faf47-a710-4139-aaba-847d9f08d99c",
],
"X-Ms-Client-Request-Id": [
"4f200bc1-9193-40c2-aea0-0e6f7338b9f8",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:36:25Z\"}",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j9938304.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j9938304.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x124a89bf5380>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\",\n \"name\": \"17635fe1-58eb-49b7-8f56-02062587c9ca\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:17:22.925439722Z\",\n \"endTime\": \"2026-10-06T00:36:24.290937421Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurredContributing tests (2)
Affected runs (27) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [svc] BackendControllerQueueDepthHigh firedfull failure pattern: alert [svc] BackendControllerQueueDepthHigh fired Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 7 days | alert | 26 | 33.77%26 of 77 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 7 days | Show trend detailsSep 29: 11 · Sep 30: 3 · Oct 1: 5 · Oct 2: 19 · Oct 3: 15 · Oct 4: 3 · Oct 5: 26 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)alert fired 1 time(s) Firing 1: State: Resolved Started: 2026-10-06T00:29:05Z Ended: 2026-10-06T00:35:10Z Severity: Sev3 Labels: alertname="BackendControllerQueueDepthHigh", cluster="ci01-j1885952-svc", component="backend", name="clustervalidationcontrolplaneidentitiespermissionsclustervalidation", region="westus3", severity="warning" Description: Backend controller workqueue clustervalidationcontrolplaneidentitiespermissionsclustervalidation has had a depth > 10 for more than 15 minutes, indicating work is accumulating faster than it can be processed. alert fired 2 time(s) Firing 1: State: Resolved Started: 2026-10-06T00:16:45Z Ended: 2026-10-06T00:22:41Z Severity: Sev3 Labels: alertname="BackendControllerQueueDepthHigh", cluster="ci01-j5947136-svc", component="backend", name="clustervalidationcontrolplaneidentitiespermissionsclustervalidation", region="canadacentral", severity="warning" Description: Backend controller workqueue clustervalidationcontrolplaneidentitiespermissionsclustervalidation has had a depth > 10 for more than 15 minutes, indicating work is accumulating faster than it can be processed. Firing 2: State: Resolved Started: 2026-10-06T00:18:42Z Ended: 2026-10-06T00:35:43Z Severity: Sev3 Labels: alertname="BackendControllerQueueDepthHigh", cluster="ci01-j5947136-svc", component="backend", name="clusterresources", region="canadacentral", severity="warning" Description: Backend controller workqueue clusterresources has had a depth > 10 for more than 15 minutes, indicating work is accumulating faster than it can be processed. alert fired 2 time(s) Firing 1: State: Resolved Started: 2026-10-06T00:28:30Z Ended: 2026-10-06T00:42:31Z Severity: Sev3 Labels: alertname="BackendControllerQueueDepthHigh", cluster="ci01-j9125632-svc", component="backend", name="csstatedump", region="westus3", severity="warning" Description: Backend controller workqueue csstatedump has had a depth > 10 for more than 15 minutes, indicating work is accumulating faster than it can be processed. Firing 2: State: Resolved Started: 2026-10-06T00:28:30Z Ended: 2026-10-06T00:54:31Z Severity: Sev3 Labels: alertname="BackendControllerQueueDepthHigh", cluster="ci01-j9125632-svc", component="backend", name="clusterresources", region="westus3", severity="warning" Description: Backend controller workqueue clusterresources has had a depth > 10 for more than 15 minutes, indicating work is accumulating faster than it can be processed. Contributing tests (1)
Affected runs (26) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [hcp] KubeDeploymentReplicasMismatch firedfull failure pattern: alert [hcp] KubeDeploymentReplicasMismatch fired Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days | alert | 7 | 9.09%7 of 77 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days | Show trend detailsSep 29: 3 · Sep 30: 4 · Oct 1: 5 · Oct 2: 1 · Oct 3: 0 · Oct 4: 0 · Oct 5: 7 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)alert fired 2 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T23:36:50Z Severity: Sev3 Labels: alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j3932544-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="cloud-network-config-controller", endpoint="http", environment="ci01", instance="10.128.64.126:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j3932544/providers/microsoft.monitor/accounts/hcps-j3932544", namespace="ocm-arohcpci01-2t8tisk9kktfaj2i52gigds57r9odgif-a2w7k9s5c0u9u3c", pod="arohcp-monitor-kube-state-metrics-7988dc648c-vcq6q", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Deployment ocm-arohcpci01-2t8tisk9kktfaj2i52gigds57r9odgif-a2w7k9s5c0u9u3c/cloud-network-config-controller has not matched the expected number of replicas for longer than 30 minutes. Firing 2: State: Fired (not resolved) Started: 2026-10-05T23:36:50Z Severity: Sev3 Labels: alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j3932544-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="cloud-network-config-controller", endpoint="http", environment="ci01", instance="10.128.64.126:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j3932544/providers/microsoft.monitor/accounts/hcps-j3932544", namespace="ocm-arohcpci01-2t8tisk9kktfaj2i52gigds57r9odgif-a2w7k9s5c0u9u3c", pod="arohcp-monitor-kube-state-metrics-7988dc648c-vcq6q", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Deployment ocm-arohcpci01-2t8tisk9kktfaj2i52gigds57r9odgif-a2w7k9s5c0u9u3c/cloud-network-config-controller has not matched the expected number of replicas for longer than 30 minutes. alert fired 4 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T21:24:03Z Severity: Sev3 Labels: alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j6160640-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="cluster-api", endpoint="http", environment="ci01", instance="10.128.64.165:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j6160640/providers/microsoft.monitor/accounts/hcps-j6160640", namespace="ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r", pod="arohcp-monitor-kube-state-metrics-7988dc648c-bnmhw", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Deployment ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r/cluster-api has not matched the expected number of replicas for longer than 30 minutes. Firing 2: State: Fired (not resolved) Started: 2026-10-05T21:24:03Z Severity: Sev3 Labels: alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j6160640-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="capi-provider", endpoint="http", environment="ci01", instance="10.128.64.165:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j6160640/providers/microsoft.monitor/accounts/hcps-j6160640", namespace="ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r", pod="arohcp-monitor-kube-state-metrics-7988dc648c-bnmhw", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Deployment ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r/capi-provider has not matched the expected number of replicas for longer than 30 minutes. Firing 3: State: Fired (not resolved) Started: 2026-10-05T21:44:02Z Severity: Sev3 Labels: alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j6160640-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="cluster-api", endpoint="http", environment="ci01", instance="10.128.64.165:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j6160640/providers/microsoft.monitor/accounts/hcps-j6160640", namespace="ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r", pod="arohcp-monitor-kube-state-metrics-7988dc648c-bnmhw", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Deployment ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r/cluster-api has not matched the expected number of replicas for longer than 30 minutes. Firing 4: State: Fired (not resolved) Started: 2026-10-05T21:44:02Z Severity: Sev3 Labels: alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j6160640-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="capi-provider", endpoint="http", environment="ci01", instance="10.128.64.165:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j6160640/providers/microsoft.monitor/accounts/hcps-j6160640", namespace="ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r", pod="arohcp-monitor-kube-state-metrics-7988dc648c-bnmhw", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Deployment ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r/capi-provider has not matched the expected number of replicas for longer than 30 minutes. alert fired 4 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T21:53:02Z Severity: Sev3 Labels: alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j8926720-mgmt-1", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="capi-provider", endpoint="http", environment="ci01", instance="10.128.64.137:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j8926720/providers/microsoft.monitor/accounts/hcps-j8926720", namespace="ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s", pod="arohcp-monitor-kube-state-metrics-7988dc648c-zq9dq", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Deployment ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s/capi-provider has not matched the expected number of replicas for longer than 30 minutes. Firing 2: State: Fired (not resolved) Started: 2026-10-05T21:54:01Z Severity: Sev3 Labels: alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j8926720-mgmt-1", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="cluster-api", endpoint="http", environment="ci01", instance="10.128.64.137:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j8926720/providers/microsoft.monitor/accounts/hcps-j8926720", namespace="ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s", pod="arohcp-monitor-kube-state-metrics-7988dc648c-zq9dq", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Deployment ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s/cluster-api has not matched the expected number of replicas for longer than 30 minutes. Firing 3: State: Fired (not resolved) Started: 2026-10-05T21:54:01Z Severity: Sev3 Labels: alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j8926720-mgmt-1", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="cluster-api", endpoint="http", environment="ci01", instance="10.128.64.137:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j8926720/providers/microsoft.monitor/accounts/hcps-j8926720", namespace="ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s", pod="arohcp-monitor-kube-state-metrics-7988dc648c-zq9dq", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Deployment ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s/cluster-api has not matched the expected number of replicas for longer than 30 minutes. Firing 4: State: Fired (not resolved) Started: 2026-10-05T21:54:01Z Severity: Sev3 Labels: alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j8926720-mgmt-1", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="capi-provider", endpoint="http", environment="ci01", instance="10.128.64.137:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j8926720/providers/microsoft.monitor/accounts/hcps-j8926720", namespace="ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s", pod="arohcp-monitor-kube-state-metrics-7988dc648c-zq9dq", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Deployment ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s/capi-provider has not matched the expected number of replicas for longer than 30 minutes. Contributing tests (1)
Affected runs (7) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [svc] KustoLogsDataStale firedfull failure pattern: alert [svc] KustoLogsDataStale fired Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 5 days | alert | 6 | 7.79%6 of 77 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 5 days | Show trend detailsSep 29: 2 · Sep 30: 2 · Oct 1: 3 · Oct 2: 2 · Oct 3: 0 · Oct 4: 0 · Oct 5: 6 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)alert fired 2 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-06T00:01:43Z Severity: Sev3 Labels: alertname="KustoLogsDataStale", cluster="ci01-j3932544-svc", component="kusto", container="aro-hcp-exporter", endpoint="metrics", environment="ci01", instance="10.128.64.40:8080", job="aro-hcp-exporter", kusto_cluster="hcp-dev-us-2", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j3932544/providers/microsoft.monitor/accounts/services-j3932544", namespace="aro-hcp-exporter", pod="aro-hcp-exporter-7f699bc757-kn9nf", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="aro-hcp-exporter", severity="warning", table="systemdlogs" Description: Kusto log data for table systemdlogs on cluster ci01-j3932544-svc (Kusto cluster hcp-dev-us-2) is stale. Check the ingestion pipeline. Firing 2: State: Fired (not resolved) Started: 2026-10-06T00:01:43Z Severity: Sev3 Labels: alertname="KustoLogsDataStale", cluster="ci01-j3932544-svc", component="kusto", container="aro-hcp-exporter", endpoint="metrics", environment="ci01", instance="10.128.64.40:8080", job="aro-hcp-exporter", kusto_cluster="hcp-dev-us-2", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j3932544/providers/microsoft.monitor/accounts/services-j3932544", namespace="aro-hcp-exporter", pod="aro-hcp-exporter-7f699bc757-kn9nf", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="aro-hcp-exporter", severity="warning", table="systemdlogs" Description: Kusto log data for table systemdlogs on cluster ci01-j3932544-svc (Kusto cluster hcp-dev-us-2) is stale. Check the ingestion pipeline. alert fired 2 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T20:29:50Z Severity: Sev3 Labels: alertname="KustoLogsDataStale", cluster="ci01-j2518144-svc", component="kusto", container="aro-hcp-exporter", endpoint="metrics", environment="ci01", instance="10.128.64.80:8080", job="aro-hcp-exporter", kusto_cluster="hcp-dev-us-2", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2518144/providers/microsoft.monitor/accounts/services-j2518144", namespace="aro-hcp-exporter", pod="aro-hcp-exporter-ccd58d89f-8dxcr", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="aro-hcp-exporter", severity="warning", table="systemdlogs" Description: Kusto log data for table systemdlogs on cluster ci01-j2518144-svc (Kusto cluster hcp-dev-us-2) is stale. Check the ingestion pipeline. Firing 2: State: Fired (not resolved) Started: 2026-10-05T20:29:50Z Severity: Sev3 Labels: alertname="KustoLogsDataStale", cluster="ci01-j2518144-svc", component="kusto", container="aro-hcp-exporter", endpoint="metrics", environment="ci01", instance="10.128.64.80:8080", job="aro-hcp-exporter", kusto_cluster="hcp-dev-us-2", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2518144/providers/microsoft.monitor/accounts/services-j2518144", namespace="aro-hcp-exporter", pod="aro-hcp-exporter-ccd58d89f-8dxcr", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="aro-hcp-exporter", severity="warning", table="systemdlogs" Description: Kusto log data for table systemdlogs on cluster ci01-j2518144-svc (Kusto cluster hcp-dev-us-2) is stale. Check the ingestion pipeline. alert fired 2 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T14:51:33Z Severity: Sev3 Labels: alertname="KustoLogsDataStale", cluster="ci01-j0003968-svc", component="kusto", container="aro-hcp-exporter", endpoint="metrics", environment="ci01", instance="10.128.64.41:8080", job="aro-hcp-exporter", kusto_cluster="hcp-dev-us-2", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j0003968/providers/microsoft.monitor/accounts/services-j0003968", namespace="aro-hcp-exporter", pod="aro-hcp-exporter-5497464f5-rjdk8", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="aro-hcp-exporter", severity="warning", table="systemdlogs" Description: Kusto log data for table systemdlogs on cluster ci01-j0003968-svc (Kusto cluster hcp-dev-us-2) is stale. Check the ingestion pipeline. Firing 2: State: Fired (not resolved) Started: 2026-10-05T14:51:33Z Severity: Sev3 Labels: alertname="KustoLogsDataStale", cluster="ci01-j0003968-svc", component="kusto", container="aro-hcp-exporter", endpoint="metrics", environment="ci01", instance="10.128.64.41:8080", job="aro-hcp-exporter", kusto_cluster="hcp-dev-us-2", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j0003968/providers/microsoft.monitor/accounts/services-j0003968", namespace="aro-hcp-exporter", pod="aro-hcp-exporter-5497464f5-rjdk8", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="aro-hcp-exporter", severity="warning", table="systemdlogs" Description: Kusto log data for table systemdlogs on cluster ci01-j0003968-svc (Kusto cluster hcp-dev-us-2) is stale. Check the ingestion pipeline. Contributing tests (1)
Affected runs (6) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [svc] KubePodNotReady firedfull failure pattern: alert [svc] KubePodNotReady fired Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days | alert | 4 | 5.19%4 of 77 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days | Show trend detailsSep 29: 6 · Sep 30: 7 · Oct 1: 0 · Oct 2: 3 · Oct 3: 1 · Oct 4: 0 · Oct 5: 4 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)alert fired 3 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T23:24:58Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0130560-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-d8469", region="canadacentral", severity="warning" Description: Pod arobit/arobit-forwarder-d8469 has been in a non-ready state for longer than 5 minutes. Firing 2: State: Fired (not resolved) Started: 2026-10-05T23:28:58Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0130560-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-69flm", region="canadacentral", severity="warning" Description: Pod arobit/arobit-forwarder-69flm has been in a non-ready state for longer than 5 minutes. Firing 3: State: Fired (not resolved) Started: 2026-10-05T23:28:58Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0130560-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-g4dmc", region="canadacentral", severity="warning" Description: Pod arobit/arobit-forwarder-g4dmc has been in a non-ready state for longer than 5 minutes. alert fired 3 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T22:00:22Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9785984-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-pmhh6", region="westus3", severity="warning" Description: Pod arobit/arobit-forwarder-pmhh6 has been in a non-ready state for longer than 5 minutes. Firing 2: State: Fired (not resolved) Started: 2026-10-05T22:01:23Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9785984-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-g2sk2", region="westus3", severity="warning" Description: Pod arobit/arobit-forwarder-g2sk2 has been in a non-ready state for longer than 5 minutes. Firing 3: State: Fired (not resolved) Started: 2026-10-05T22:03:25Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9785984-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-2fdvx", region="westus3", severity="warning" Description: Pod arobit/arobit-forwarder-2fdvx has been in a non-ready state for longer than 5 minutes. alert fired 3 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T18:58:19Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j8411136-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-pv2hz", region="westus3", severity="warning" Description: Pod arobit/arobit-forwarder-pv2hz has been in a non-ready state for longer than 5 minutes. Firing 2: State: Fired (not resolved) Started: 2026-10-05T18:58:19Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j8411136-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-cwfj7", region="westus3", severity="warning" Description: Pod arobit/arobit-forwarder-cwfj7 has been in a non-ready state for longer than 5 minutes. Firing 3: State: Fired (not resolved) Started: 2026-10-05T19:00:20Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j8411136-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-9czh7", region="westus3", severity="warning" Description: Pod arobit/arobit-forwarder-9czh7 has been in a non-ready state for longer than 5 minutes. Contributing tests (1)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [hcp] KubePodNotReady firedfull failure pattern: alert [hcp] KubePodNotReady fired Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 6 days | alert | 3 | 3.90%3 of 77 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 6 days | Show trend detailsSep 29: 7 · Sep 30: 10 · Oct 1: 6 · Oct 2: 5 · Oct 3: 2 · Oct 4: 0 · Oct 5: 3 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)alert fired 1 time(s) Firing 1: State: Resolved Started: 2026-10-05T17:31:22Z Ended: 2026-10-05T18:01:21Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j3289856-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8osonvedkq4us42vso5g475pmi6bd2-t8u7l4d5a0n0j4i", pod="router-fcdd476b-ns9vb", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8osonvedkq4us42vso5g475pmi6bd2-t8u7l4d5a0n0j4i/router-fcdd476b-ns9vb has been in a non-ready state for longer than 5 minutes. alert fired 25 time(s) Firing 1: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-kx88p", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-kx88p has been in a non-ready state for longer than 5 minutes. Firing 2: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:16Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-xz59p", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-xz59p has been in a non-ready state for longer than 5 minutes. Firing 3: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-cs6cc", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-cs6cc has been in a non-ready state for longer than 5 minutes. Firing 4: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-jj9lv", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-jj9lv has been in a non-ready state for longer than 5 minutes. Firing 5: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-7lzb4", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-7lzb4 has been in a non-ready state for longer than 5 minutes. Firing 6: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-fpswn", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-fpswn has been in a non-ready state for longer than 5 minutes. Firing 7: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-jd2zc", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-jd2zc has been in a non-ready state for longer than 5 minutes. Firing 8: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-62265", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-62265 has been in a non-ready state for longer than 5 minutes. Firing 9: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:16Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-p7hl9", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-p7hl9 has been in a non-ready state for longer than 5 minutes. Firing 10: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-9b89p", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-9b89p has been in a non-ready state for longer than 5 minutes. Firing 11: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:57:14Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-jwnvq", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-jwnvq has been in a non-ready state for longer than 5 minutes. Firing 12: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-64tmg", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-64tmg has been in a non-ready state for longer than 5 minutes. Firing 13: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-4c9ln", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-4c9ln has been in a non-ready state for longer than 5 minutes. Firing 14: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-8v98s", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-8v98s has been in a non-ready state for longer than 5 minutes. Firing 15: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:16Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-r8p2j", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-r8p2j has been in a non-ready state for longer than 5 minutes. Firing 16: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-tjf2v", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-tjf2v has been in a non-ready state for longer than 5 minutes. Firing 17: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-gbnfj", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-gbnfj has been in a non-ready state for longer than 5 minutes. Firing 18: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-nhf96", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-nhf96 has been in a non-ready state for longer than 5 minutes. Firing 19: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-q9gf7", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-q9gf7 has been in a non-ready state for longer than 5 minutes. Firing 20: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-h5rt4", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-h5rt4 has been in a non-ready state for longer than 5 minutes. Firing 21: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-29s4f", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-29s4f has been in a non-ready state for longer than 5 minutes. Firing 22: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:57:14Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-fjjh8", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-fjjh8 has been in a non-ready state for longer than 5 minutes. Firing 23: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:57:14Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-x82jg", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-x82jg has been in a non-ready state for longer than 5 minutes. Firing 24: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-rzpbb", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-rzpbb has been in a non-ready state for longer than 5 minutes. Firing 25: State: Resolved Started: 2026-10-05T12:27:17Z Ended: 2026-10-05T12:53:15Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-tlbkl", region="westus3", severity="warning" Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-tlbkl has been in a non-ready state for longer than 5 minutes. alert fired 30 time(s) Firing 1: State: Resolved Started: 2026-10-05T06:01:34Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-wdgbt", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-wdgbt has been in a non-ready state for longer than 5 minutes. Firing 2: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:38Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-c9c8c", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-c9c8c has been in a non-ready state for longer than 5 minutes. Firing 3: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-g7h4x", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-g7h4x has been in a non-ready state for longer than 5 minutes. Firing 4: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:36Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-hbfhn", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-hbfhn has been in a non-ready state for longer than 5 minutes. Firing 5: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-t7xgn", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-t7xgn has been in a non-ready state for longer than 5 minutes. Firing 6: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:36Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-rk9hr", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-rk9hr has been in a non-ready state for longer than 5 minutes. Firing 7: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:36Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-8cwl5", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-8cwl5 has been in a non-ready state for longer than 5 minutes. Firing 8: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-6xrf2", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-6xrf2 has been in a non-ready state for longer than 5 minutes. Firing 9: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-wc285", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-wc285 has been in a non-ready state for longer than 5 minutes. Firing 10: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:38Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-gs6ng", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-gs6ng has been in a non-ready state for longer than 5 minutes. Firing 11: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-55fbw", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-55fbw has been in a non-ready state for longer than 5 minutes. Firing 12: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-kmpnh", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-kmpnh has been in a non-ready state for longer than 5 minutes. Firing 13: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-2lb9z", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-2lb9z has been in a non-ready state for longer than 5 minutes. Firing 14: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:38Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-5hg9l", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-5hg9l has been in a non-ready state for longer than 5 minutes. Firing 15: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-7bn7h", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-7bn7h has been in a non-ready state for longer than 5 minutes. Firing 16: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:36Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-5jd2x", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-5jd2x has been in a non-ready state for longer than 5 minutes. Firing 17: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-rspt4", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-rspt4 has been in a non-ready state for longer than 5 minutes. Firing 18: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:38Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-f8ff5", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-f8ff5 has been in a non-ready state for longer than 5 minutes. Firing 19: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:36Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-hk4dh", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-hk4dh has been in a non-ready state for longer than 5 minutes. Firing 20: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-bn4mj", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-bn4mj has been in a non-ready state for longer than 5 minutes. Firing 21: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:36Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-wtj9v", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-wtj9v has been in a non-ready state for longer than 5 minutes. Firing 22: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-72wfb", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-72wfb has been in a non-ready state for longer than 5 minutes. Firing 23: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:38Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-srdxs", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-srdxs has been in a non-ready state for longer than 5 minutes. Firing 24: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:36Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-2f6vs", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-2f6vs has been in a non-ready state for longer than 5 minutes. Firing 25: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:36Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-blmhn", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-blmhn has been in a non-ready state for longer than 5 minutes. Firing 26: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:38Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-x4877", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-x4877 has been in a non-ready state for longer than 5 minutes. Firing 27: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-5fxm6", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-5fxm6 has been in a non-ready state for longer than 5 minutes. Firing 28: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:37Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-9b6xs", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-9b6xs has been in a non-ready state for longer than 5 minutes. Firing 29: State: Resolved Started: 2026-10-05T06:01:35Z Ended: 2026-10-05T06:35:36Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-mkx2w", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-mkx2w has been in a non-ready state for longer than 5 minutes. Firing 30: State: Resolved Started: 2026-10-05T06:01:36Z Ended: 2026-10-05T06:35:38Z Severity: Sev3 Labels: alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-4xsqp", region="canadacentral", severity="warning" Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-4xsqp has been in a non-ready state for longer than 5 minutes. Contributing tests (1)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [hcp] KubeStatefulSetReplicasMismatch firedfull failure pattern: alert [hcp] KubeStatefulSetReplicasMismatch fired Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days | alert | 2 | 2.60%2 of 77 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days | Show trend detailsSep 29: 5 · Sep 30: 2 · Oct 1: 5 · Oct 2: 1 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)alert fired 2 time(s) Firing 1: State: Resolved Started: 2026-10-05T16:17:11Z Ended: 2026-10-05T16:43:07Z Severity: Sev3 Labels: alertname="KubeStatefulSetReplicasMismatch", cluster="ci01-j4561920-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.65.37:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j4561920/providers/microsoft.monitor/accounts/hcps-j4561920", namespace="ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d", pod="arohcp-monitor-kube-state-metrics-7988dc648c-dvvxp", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning", statefulset="etcd" Description: StatefulSet ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d/etcd has not matched the expected number of replicas for longer than 15 minutes. Firing 2: State: Resolved Started: 2026-10-05T16:17:11Z Ended: 2026-10-05T16:42:08Z Severity: Sev3 Labels: alertname="KubeStatefulSetReplicasMismatch", cluster="ci01-j4561920-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.65.37:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j4561920/providers/microsoft.monitor/accounts/hcps-j4561920", namespace="ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d", pod="arohcp-monitor-kube-state-metrics-7988dc648c-dvvxp", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning", statefulset="etcd" Description: StatefulSet ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d/etcd has not matched the expected number of replicas for longer than 15 minutes. alert fired 2 time(s) Firing 1: State: Resolved Started: 2026-10-05T12:29:02Z Ended: 2026-10-05T12:58:06Z Severity: Sev3 Labels: alertname="KubeStatefulSetReplicasMismatch", cluster="ci01-j2217856-mgmt-1", component="kubernetes-infrastructure", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.64.214:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2217856/providers/microsoft.monitor/accounts/hcps-j2217856", namespace="ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics", pod="arohcp-monitor-kube-state-metrics-7988dc648c-twm4t", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning", statefulset="etcd" Description: StatefulSet ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics/etcd has not matched the expected number of replicas for longer than 15 minutes. Firing 2: State: Resolved Started: 2026-10-05T12:29:02Z Ended: 2026-10-05T12:58:06Z Severity: Sev3 Labels: alertname="KubeStatefulSetReplicasMismatch", cluster="ci01-j2217856-mgmt-1", component="kubernetes-infrastructure", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.64.214:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2217856/providers/microsoft.monitor/accounts/hcps-j2217856", namespace="ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics", pod="arohcp-monitor-kube-state-metrics-7988dc648c-twm4t", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning", statefulset="etcd" Description: StatefulSet ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics/etcd has not matched the expected number of replicas for longer than 15 minutes. Contributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [hcp] KubePodCrashLooping firedfull failure pattern: alert [hcp] KubePodCrashLooping fired Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days | alert | 2 | 2.60%2 of 77 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days | Show trend detailsSep 29: 2 · Sep 30: 3 · Oct 1: 5 · Oct 2: 1 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)alert fired 2 time(s) Firing 1: State: Resolved Started: 2026-10-05T16:19:07Z Ended: 2026-10-05T16:47:06Z Severity: Sev3 Labels: alertname="KubePodCrashLooping", cluster="ci01-j4561920-mgmt-2", component="kubernetes-infrastructure", container="etcd", endpoint="http", environment="ci01", instance="10.128.65.37:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j4561920/providers/microsoft.monitor/accounts/hcps-j4561920", namespace="ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d", pod="etcd-2", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", reason="CrashLoopBackOff", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning", uid="57a4a966-6353-4123-811e-4e0b86345fdf" Description: Pod ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d/etcd-2 (etcd) is in waiting state (reason: "CrashLoopBackOff"). Firing 2: State: Resolved Started: 2026-10-05T16:19:07Z Ended: 2026-10-05T16:47:06Z Severity: Sev3 Labels: alertname="KubePodCrashLooping", cluster="ci01-j4561920-mgmt-2", component="kubernetes-infrastructure", container="etcd", endpoint="http", environment="ci01", instance="10.128.65.37:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j4561920/providers/microsoft.monitor/accounts/hcps-j4561920", namespace="ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d", pod="etcd-2", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", reason="CrashLoopBackOff", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning", uid="57a4a966-6353-4123-811e-4e0b86345fdf" Description: Pod ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d/etcd-2 (etcd) is in waiting state (reason: "CrashLoopBackOff"). alert fired 2 time(s) Firing 1: State: Resolved Started: 2026-10-05T12:29:59Z Ended: 2026-10-05T13:02:01Z Severity: Sev3 Labels: alertname="KubePodCrashLooping", cluster="ci01-j2217856-mgmt-1", component="kubernetes-infrastructure", container="etcd", endpoint="http", environment="ci01", instance="10.128.64.214:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2217856/providers/microsoft.monitor/accounts/hcps-j2217856", namespace="ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics", pod="etcd-2", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", reason="CrashLoopBackOff", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning", uid="5e533b4c-45fc-47fd-bd2f-17c4a977b441" Description: Pod ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics/etcd-2 (etcd) is in waiting state (reason: "CrashLoopBackOff"). Firing 2: State: Resolved Started: 2026-10-05T12:31:03Z Ended: 2026-10-05T13:02:01Z Severity: Sev3 Labels: alertname="KubePodCrashLooping", cluster="ci01-j2217856-mgmt-1", component="kubernetes-infrastructure", container="etcd", endpoint="http", environment="ci01", instance="10.128.64.214:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2217856/providers/microsoft.monitor/accounts/hcps-j2217856", namespace="ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics", pod="etcd-2", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", reason="CrashLoopBackOff", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning", uid="5e533b4c-45fc-47fd-bd2f-17c4a977b441" Description: Pod ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics/etcd-2 (etcd) is in waiting state (reason: "CrashLoopBackOff"). Contributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeadlineExceeded; detail message cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedC...full failure pattern: ERROR CODE: DeadlineExceeded; detail message cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: [capi-provider]; provider Microsoft.RedHatOpenShift Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 5 days | e2e | 2 | 2.60%2 of 77 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 5 days | Show trend detailsSep 29: 19 · Sep 30: 3 · Oct 1: 5 · Oct 2: 1 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/kms_key_rotation.go:98]: failed to create HCP cluster for KMS key rotation test
Unexpected error:
<*fmt.wrapError | 0x36e441954e40>:
failed to create HCP cluster kms-key-rotate-422: failed waiting for cluster="kms-key-rotate-422" in resourcegroup="kms-key-rotate-b88w54wctnjn" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4",
"name": "baaa9036-b952-4d2a-af36-e458936f36a4",
"status": "Failed",
"startTime": "2026-10-05T15:55:35.591747237Z",
"endTime": "2026-10-05T16:24:44.537042498Z",
"error": {
"code": "DeadlineExceeded",
"message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster kms-key-rotate-422: failed waiting for cluster=\"kms-key-rotate-422\" in resourcegroup=\"kms-key-rotate-b88w54wctnjn\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\",\n \"name\": \"baaa9036-b952-4d2a-af36-e458936f36a4\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T15:55:35.591747237Z\",\n \"endTime\": \"2026-10-05T16:24:44.537042498Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x36e441954e20>{
msg: "failed waiting for cluster=\"kms-key-rotate-422\" in resourcegroup=\"kms-key-rotate-b88w54wctnjn\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\",\n \"name\": \"baaa9036-b952-4d2a-af36-e458936f36a4\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T15:55:35.591747237Z\",\n \"endTime\": \"2026-10-05T16:24:44.537042498Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x36e442c82e10>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["6"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"a3f95c09-30cc-48c8-864f-93bedfa005a5",
],
"Date": [
"Mon, 05 Oct 2026 16:24:50 GMT",
],
"Content-Length": ["800"],
},
Body: <*exported.nopClosingBytesReader | 0x36e441954c40>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 97, 97, 97, 57, 48, 51, 54, 45, 98, 57, 53, 50, 45, 52, 100, 50, 97, 45, 97, 102, 51, 54, 45, 101, 52, 53, 56, 57, 51, 54, 102, 51, 54, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 97, 97, 97, 57, 48, 51, 54, 45, 98, 57, 53, 50, 45, 52, 100, 50, 97, 45, 97, 102, 51, 54, 45, 101, 52, 53, 56, 57, 51, 54, 102, 51, 54, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 53, 58, 53, 53, 58, 51, 53, 46, 53, 57, 49, 55, 52, 55, 50, 51, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 54, 58, 50, 52, 58, 52, 52, 46, 53, 51, 55, 48, 52, 50, 52, 57, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 67, 108, 117, 115, 116, 101, 114, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 105, 115, 32, 110, 111, 116, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 58, 32, 75, 117, 98, 101, 99, 111, 110, 102, 105, 103, 87, 97, 105, 116, 105, 110, 103, 70, 111, 114, 67, 114, 101, 97, 116, 101, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 104, 111, 115, 116, 101, 100, 32, 99, 111, 110, 116, 114, 111, 108, 32, 112, 108, 97, 110, 101, 32, 107, 117, 98, 101, 99, 111, 110, 102, 105, 103, 32, 116, 111, 32, 98, 101, 32, 99, 114, 101, 97, 116, 101, 100, 59, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 100, 101, 103, 114, 97, 100, 101, 100, 58, 32, 85, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 82, 101, 112, 108, 105, 99, 97, 115, 58, 32, 99, 97, 112, 105, 45, 112, 114, 111, 118, 105, 100, 101, 114, 32, 100, 101, 112, 108, 111, 121, 109, 101, 110, 116, 32, 104, 97, 115, 32, 49, 32, 117, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 32, 114, 101, 112, 108, 105, 99, 97, 115, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 800,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j4561920.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4",
Fragment: "",
RawQuery: "api-version=2026-09-01-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"a3ce1ebc-332d-4e44-a410-f6ca7636c979",
],
"X-Ms-Client-Request-Id": [
"5ecae373-2571-4956-8610-1ab01d3b362e",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T16:24:50Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j4561920.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j4561920.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 89, 137, 96, 29, 156, 142, 71, 98, 167, 44, 132, 78, 7, 14, 193, 251, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 53, 50, 50, 48, 48, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 53, 51, 50, 48, 48, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 231, 231, 253, 109, 174, 181, 17, 215, 186, 77, 63, 196, 58, 222, 175, 33, 28, 131, 179, 251, 41, 63, 148, 152, 51, 172, 168, 230, 18, 247, 84, 5, 79, 216, 227, 149, 240, 153, 53, 93, 57, 19, 59, 5, 142, 41, 112, 29, 14, 68, 145, 79, 89, 110, 162, 155, 43, 16, 218, 133, 190, 1, 152, 142, 229, 8, 67, 206, 153, 68, 147, 15, 192, 143, 211, 209, 51, 145, 84, 185, 53, 205, 119, 241, 27, 143, 4, 44, 39, 10, 155, 210, 236, 213, 27, 42, 161, 78, 32, 1, 101, 190, 80, 224, 117, 98, 180, 76, 143, 235, 13, 240, 54, 230, 227, 149, 237, 6, 102, 14, 174, 17, 183, 2, 178, 148, 86, 8, 1, 224, 188, 201, 190, 20, 165, 170, 141, 233, 49, 180, 0, 18, 114, 26, 98, 58, 26, 190, 204, 17, 179, 165, 84, 179, 40, 193, 90, 80, 151, 175, 250, 84, 168, 191, 34, 95, 118, 214, 204, 155, 171, 128, 146, 139, 223, 155, 195, 124, 166, 70, 207, 45, 134, 38, 88, 73, 9, 171, 118, 46, 47, 153, 194, 24, 132, 240, 135, 99, 233, 93, 80, 101, 242, 192, 158, 233, 194, 126, 203, 100, 99, 1, 231, 174, 180, 173, 114, 188, 69, 11, 164, 7, 126, 10, 22, 55, 23, 129, 153, 16, 251, 179, 65, 2, 176, 95, 49, 112, 42, 89, 135, 146, 221, 37, 58, 92, 93, 225, 155, 138, 158, 86, 144, 220, 151, 145, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 173, 183, 143, 196, 8, 157, 186, 151, 80, 173, 243, 27, 54, 197, 55, 99, 150, 226, 67, 127, 130, 110, 110, 211, 42, 183, 183, 230, 128, 78, 70, 226, 32, 144, 33, 196, 70, 195, 33, 25, 114, 119, 79, 153, 54, 160, 81, 47, 213, 95, 44, 242, 107, 54, 150, 225, 141, 76, 61, 94, 237, 104, 184, 21, 163, 180, 222, 18, 130, 158, 202, 48, 96, 213, 244, 77, 101, 52, 116, 60, 29, 140, 216, 69, 142, 121, 0, 75, 144, 15, 205, 243, 239, 25, 139, 110, 221, 119, 1, 178, 160, 244, 34, 242, 187, 94, 49, 173, 88, 114, 7, 238, 240, 221, 240, 246, 34, 229, 31, 88, 134, 87, 39, 227, 192, 14, 53, 12, 64, 137, 25, 217, 232, 157, 239, 65, 169, 187, 255, 211, 200, 121, 11, 114, 40, 13, 123, 200, 193, 37, 43, 2, 169, 146, 140, 184, 83, 137, 2, 135, 157, 124, 50, 42, 189, 102, 91, 64, 132, 92, 33, 21, 178, 71, 150, 4, 122, 232, 232, 122, 154, 132, 25, 46, 166, 181, 10, 61, 109, 45, 237, 158, 34, 226, 81, 246, 153, 43, 221, 171, 68, 26, 241, 67, 140, 208, 214, 188, 37, 60, 156, 213, 251, 187, 198, 99, 41, 39, 145, 202, 144, 186, 234, 111, 177, 231, 151, 149, 226, 188, 253, 57, 197, 84, 237, 163, 103, 34, 72, 57, 41, 120, 212, 29, 172, 19, 119, 164, 221, 169, 172, 109, 198, 221, 151, 166],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 89, 137, 96, 29, 156, 142, 71, 98, 167, 44, 132, 78, 7, 14, 193, 251, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 53, 50, 50, 48, 48, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 53, 51, 50, 48, 48, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 231, 231, 253, 109, 174, 181, 17, 215, 186, 77, 63, 196, 58, 222, 175, 33, 28, 131, 179, 251, 41, 63, 148, 152, 51, 172, 168, 230, 18, 247, 84, 5, 79, 216, 227, 149, 240, 153, 53, 93, 57, 19, 59, 5, 142, 41, 112, 29, 14, 68, 145, 79, 89, 110, 162, 155, 43, 16, 218, 133, 190, 1, 152, 142, 229, 8, 67, 206, 153, 68, 147, 15, 192, 143, 211, 209, 51, 145, 84, 185, 53, 205, 119, 241, 27, 143, 4, 44, 39, 10, 155, 210, 236, 213, 27, 42, 161, 78, 32, 1, 101, 190, 80, 224, 117, 98, 180, 76, 143, 235, 13, 240, 54, 230, 227, 149, 237, 6, 102, 14, 174, 17, 183, 2, 178, 148, 86, 8, 1, 224, 188, 201, 190, 20, 165, 170, 141, 233, 49, 180, 0, 18, 114, 26, 98, 58, 26, 190, 204, 17, 179, 165, 84, 179, 40, 193, 90, 80, 151, 175, 250, 84, 168, 191, 34, 95, 118, 214, 204, 155, 171, 128, 146, 139, 223, 155, 195, 124, 166, 70, 207, 45, 134, 38, 88, 73, 9, 171, 118, 46, 47, 153, 194, 24, 132, 240, 135, 99, 233, 93, 80, 101, 242, 192, 158, 233, 194, 126, 203, 100, 99, 1, 231, 174, 180, 173, 114, 188, 69, 11, 164, 7, 126, 10, 22, 55, 23, 129, 153, 16, 251, 179, 65, 2, 176, 95, 49, 112, 42, 89, 135, 146, 221, 37, 58, 92, 93, 225, 155, 138, 158, 86, 144, 220, 151, 145, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 231, 231, 253, 109, 174, 181, 17, 215, 186, 77, 63, 196, 58, 222, 175, 33, 28, 131, 179, 251, 41, 63, 148, 152, 51, 172, 168, 230, 18, 247, 84, 5, 79, 216, 227, 149, 240, 153, 53, 93, 57, 19, 59, 5, 142, 41, 112, 29, 14, 68, 145, 79, 89, 110, 162, 155, 43, 16, 218, 133, 190, 1, 152, 142, 229, 8, 67, 206, 153, 68, 147, 15, 192, 143, 211, 209, 51, 145, 84, 185, 53, 205, 119, 241, 27, 143, 4, 44, 39, 10, 155, 210, 236, 213, 27, 42, 161, 78, 32, 1, 101, 190, 80, 224, 117, 98, 180, 76, 143, 235, 13, 240, 54, 230, 227, 149, 237, 6, 102, 14, 174, 17, 183, 2, 178, 148, 86, 8, 1, 224, 188, 201, 190, 20, 165, 170, 141, 233, 49, 180, 0, 18, 114, 26, 98, 58, 26, 190, 204, 17, 179, 165, 84, 179, 40, 193, 90, 80, 151, 175, 250, 84, 168, 191, 34, 95, 118, 214, 204, 155, 171, 128, 146, 139, 223, 155, 195, 124, 166, 70, 207, 45, 134, 38, 88, 73, 9, 171, 118, 46, 47, 153, 194, 24, 132, 240, 135, 99, 233, 93, 80, 101, 242, 192, 158, 233, 194, 126, 203, 100, 99, 1, 231, 174, 180, 173, 114, 188, 69, 11, 164, 7, 126, 10, 22, 55, 23, 129, 153, 16, 251, 179, 65, 2, 176, 95, 49, 112, 42, 89, 135, 146, 221, 37, 58, 92, 93, 225, 155, 138, 158, 86, 144, 220, 151, 145, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [173, 183, 143, 196, 8, 157, 186, 151, 80, 173, 243, 27, 54, 197, 55, 99, 150, 226, 67, 127, 130, 110, 110, 211, 42, 183, 183, 230, 128, 78, 70, 226, 32, 144, 33, 196, 70, 195, 33, 25, 114, 119, 79, 153, 54, 160, 81, 47, 213, 95, 44, 242, 107, 54, 150, 225, 141, 76, 61, 94, 237, 104, 184, 21, 163, 180, 222, 18, 130, 158, 202, 48, 96, 213, 244, 77, 101, 52, 116, 60, 29, 140, 216, 69, 142, 121, 0, 75, 144, 15, 205, 243, 239, 25, 139, 110, 221, 119, 1, 178, 160, 244, 34, 242, 187, 94, 49, 173, 88, 114, 7, 238, 240, 221, 240, 246, 34, 229, 31, 88, 134, 87, 39, 227, 192, 14, 53, 12, 64, 137, 25, 217, 232, 157, 239, 65, 169, 187, 255, 211, 200, 121, 11, 114, 40, 13, 123, 200, 193, 37, 43, 2, 169, 146, 140, 184, 83, 137, 2, 135, 157, 124, 50, 42, 189, 102, 91, 64, 132, 92, 33, 21, 178, 71, 150, 4, 122, 232, 232, 122, 154, 132, 25, 46, 166, 181, 10, 61, 109, 45, 237, 158, 34, 226, 81, 246, 153, 43, 221, 171, 68, 26, 241, 67, 140, 208, 214, 188, 37, 60, 156, 213, 251, 187, 198, 99, 41, 39, 145, 202, 144, 186, 234, 111, 177, 231, 151, 149, 226, 188, 253, 57, 197, 84, 237, 163, 103, 34, 72, 57, 41, 120, 212, 29, 172, 19, 119, 164, 221, 169, 172, 109, 198, 221, 151, 166],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x36e4416e62a0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12046148573969957371, 6451793621481834338],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j4561920.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j4561920.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926810520, loc: nil},
NotAfter: {wall: 0, ext: 63942535920, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160],
AuthorityKeyId: [83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j4561920.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\",\n \"name\": \"baaa9036-b952-4d2a-af36-e458936f36a4\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T15:55:35.591747237Z\",\n \"endTime\": \"2026-10-05T16:24:44.537042498Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/kms_key_rotation.go:98]: failed to create HCP cluster for KMS key rotation test
Unexpected error:
<*fmt.wrapError | 0x36e441954e40>:
failed to create HCP cluster kms-key-rotate-422: failed waiting for cluster="kms-key-rotate-422" in resourcegroup="kms-key-rotate-b88w54wctnjn" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4",
"name": "baaa9036-b952-4d2a-af36-e458936f36a4",
"status": "Failed",
"startTime": "2026-10-05T15:55:35.591747237Z",
"endTime": "2026-10-05T16:24:44.537042498Z",
"error": {
"code": "DeadlineExceeded",
"message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster kms-key-rotate-422: failed waiting for cluster=\"kms-key-rotate-422\" in resourcegroup=\"kms-key-rotate-b88w54wctnjn\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\",\n \"name\": \"baaa9036-b952-4d2a-af36-e458936f36a4\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T15:55:35.591747237Z\",\n \"endTime\": \"2026-10-05T16:24:44.537042498Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x36e441954e20>{
msg: "failed waiting for cluster=\"kms-key-rotate-422\" in resourcegroup=\"kms-key-rotate-b88w54wctnjn\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\",\n \"name\": \"baaa9036-b952-4d2a-af36-e458936f36a4\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T15:55:35.591747237Z\",\n \"endTime\": \"2026-10-05T16:24:44.537042498Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x36e442c82e10>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["6"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"a3f95c09-30cc-48c8-864f-93bedfa005a5",
],
"Date": [
"Mon, 05 Oct 2026 16:24:50 GMT",
],
"Content-Length": ["800"],
},
Body: <*exported.nopClosingBytesReader | 0x36e441954c40>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 97, 97, 97, 57, 48, 51, 54, 45, 98, 57, 53, 50, 45, 52, 100, 50, 97, 45, 97, 102, 51, 54, 45, 101, 52, 53, 56, 57, 51, 54, 102, 51, 54, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 97, 97, 97, 57, 48, 51, 54, 45, 98, 57, 53, 50, 45, 52, 100, 50, 97, 45, 97, 102, 51, 54, 45, 101, 52, 53, 56, 57, 51, 54, 102, 51, 54, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 53, 58, 53, 53, 58, 51, 53, 46, 53, 57, 49, 55, 52, 55, 50, 51, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 54, 58, 50, 52, 58, 52, 52, 46, 53, 51, 55, 48, 52, 50, 52, 57, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 67, 108, 117, 115, 116, 101, 114, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 105, 115, 32, 110, 111, 116, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 58, 32, 75, 117, 98, 101, 99, 111, 110, 102, 105, 103, 87, 97, 105, 116, 105, 110, 103, 70, 111, 114, 67, 114, 101, 97, 116, 101, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 104, 111, 115, 116, 101, 100, 32, 99, 111, 110, 116, 114, 111, 108, 32, 112, 108, 97, 110, 101, 32, 107, 117, 98, 101, 99, 111, 110, 102, 105, 103, 32, 116, 111, 32, 98, 101, 32, 99, 114, 101, 97, 116, 101, 100, 59, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 100, 101, 103, 114, 97, 100, 101, 100, 58, 32, 85, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 82, 101, 112, 108, 105, 99, 97, 115, 58, 32, 99, 97, 112, 105, 45, 112, 114, 111, 118, 105, 100, 101, 114, 32, 100, 101, 112, 108, 111, 121, 109, 101, 110, 116, 32, 104, 97, 115, 32, 49, 32, 117, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 32, 114, 101, 112, 108, 105, 99, 97, 115, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 800,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j4561920.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4",
Fragment: "",
RawQuery: "api-version=2026-09-01-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"a3ce1ebc-332d-4e44-a410-f6ca7636c979",
],
"X-Ms-Client-Request-Id": [
"5ecae373-2571-4956-8610-1ab01d3b362e",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T16:24:50Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j4561920.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j4561920.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 89, 137, 96, 29, 156, 142, 71, 98, 167, 44, 132, 78, 7, 14, 193, 251, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 53, 50, 50, 48, 48, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 53, 51, 50, 48, 48, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 231, 231, 253, 109, 174, 181, 17, 215, 186, 77, 63, 196, 58, 222, 175, 33, 28, 131, 179, 251, 41, 63, 148, 152, 51, 172, 168, 230, 18, 247, 84, 5, 79, 216, 227, 149, 240, 153, 53, 93, 57, 19, 59, 5, 142, 41, 112, 29, 14, 68, 145, 79, 89, 110, 162, 155, 43, 16, 218, 133, 190, 1, 152, 142, 229, 8, 67, 206, 153, 68, 147, 15, 192, 143, 211, 209, 51, 145, 84, 185, 53, 205, 119, 241, 27, 143, 4, 44, 39, 10, 155, 210, 236, 213, 27, 42, 161, 78, 32, 1, 101, 190, 80, 224, 117, 98, 180, 76, 143, 235, 13, 240, 54, 230, 227, 149, 237, 6, 102, 14, 174, 17, 183, 2, 178, 148, 86, 8, 1, 224, 188, 201, 190, 20, 165, 170, 141, 233, 49, 180, 0, 18, 114, 26, 98, 58, 26, 190, 204, 17, 179, 165, 84, 179, 40, 193, 90, 80, 151, 175, 250, 84, 168, 191, 34, 95, 118, 214, 204, 155, 171, 128, 146, 139, 223, 155, 195, 124, 166, 70, 207, 45, 134, 38, 88, 73, 9, 171, 118, 46, 47, 153, 194, 24, 132, 240, 135, 99, 233, 93, 80, 101, 242, 192, 158, 233, 194, 126, 203, 100, 99, 1, 231, 174, 180, 173, 114, 188, 69, 11, 164, 7, 126, 10, 22, 55, 23, 129, 153, 16, 251, 179, 65, 2, 176, 95, 49, 112, 42, 89, 135, 146, 221, 37, 58, 92, 93, 225, 155, 138, 158, 86, 144, 220, 151, 145, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 173, 183, 143, 196, 8, 157, 186, 151, 80, 173, 243, 27, 54, 197, 55, 99, 150, 226, 67, 127, 130, 110, 110, 211, 42, 183, 183, 230, 128, 78, 70, 226, 32, 144, 33, 196, 70, 195, 33, 25, 114, 119, 79, 153, 54, 160, 81, 47, 213, 95, 44, 242, 107, 54, 150, 225, 141, 76, 61, 94, 237, 104, 184, 21, 163, 180, 222, 18, 130, 158, 202, 48, 96, 213, 244, 77, 101, 52, 116, 60, 29, 140, 216, 69, 142, 121, 0, 75, 144, 15, 205, 243, 239, 25, 139, 110, 221, 119, 1, 178, 160, 244, 34, 242, 187, 94, 49, 173, 88, 114, 7, 238, 240, 221, 240, 246, 34, 229, 31, 88, 134, 87, 39, 227, 192, 14, 53, 12, 64, 137, 25, 217, 232, 157, 239, 65, 169, 187, 255, 211, 200, 121, 11, 114, 40, 13, 123, 200, 193, 37, 43, 2, 169, 146, 140, 184, 83, 137, 2, 135, 157, 124, 50, 42, 189, 102, 91, 64, 132, 92, 33, 21, 178, 71, 150, 4, 122, 232, 232, 122, 154, 132, 25, 46, 166, 181, 10, 61, 109, 45, 237, 158, 34, 226, 81, 246, 153, 43, 221, 171, 68, 26, 241, 67, 140, 208, 214, 188, 37, 60, 156, 213, 251, 187, 198, 99, 41, 39, 145, 202, 144, 186, 234, 111, 177, 231, 151, 149, 226, 188, 253, 57, 197, 84, 237, 163, 103, 34, 72, 57, 41, 120, 212, 29, 172, 19, 119, 164, 221, 169, 172, 109, 198, 221, 151, 166],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 89, 137, 96, 29, 156, 142, 71, 98, 167, 44, 132, 78, 7, 14, 193, 251, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 53, 50, 50, 48, 48, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 53, 51, 50, 48, 48, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 231, 231, 253, 109, 174, 181, 17, 215, 186, 77, 63, 196, 58, 222, 175, 33, 28, 131, 179, 251, 41, 63, 148, 152, 51, 172, 168, 230, 18, 247, 84, 5, 79, 216, 227, 149, 240, 153, 53, 93, 57, 19, 59, 5, 142, 41, 112, 29, 14, 68, 145, 79, 89, 110, 162, 155, 43, 16, 218, 133, 190, 1, 152, 142, 229, 8, 67, 206, 153, 68, 147, 15, 192, 143, 211, 209, 51, 145, 84, 185, 53, 205, 119, 241, 27, 143, 4, 44, 39, 10, 155, 210, 236, 213, 27, 42, 161, 78, 32, 1, 101, 190, 80, 224, 117, 98, 180, 76, 143, 235, 13, 240, 54, 230, 227, 149, 237, 6, 102, 14, 174, 17, 183, 2, 178, 148, 86, 8, 1, 224, 188, 201, 190, 20, 165, 170, 141, 233, 49, 180, 0, 18, 114, 26, 98, 58, 26, 190, 204, 17, 179, 165, 84, 179, 40, 193, 90, 80, 151, 175, 250, 84, 168, 191, 34, 95, 118, 214, 204, 155, 171, 128, 146, 139, 223, 155, 195, 124, 166, 70, 207, 45, 134, 38, 88, 73, 9, 171, 118, 46, 47, 153, 194, 24, 132, 240, 135, 99, 233, 93, 80, 101, 242, 192, 158, 233, 194, 126, 203, 100, 99, 1, 231, 174, 180, 173, 114, 188, 69, 11, 164, 7, 126, 10, 22, 55, 23, 129, 153, 16, 251, 179, 65, 2, 176, 95, 49, 112, 42, 89, 135, 146, 221, 37, 58, 92, 93, 225, 155, 138, 158, 86, 144, 220, 151, 145, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 231, 231, 253, 109, 174, 181, 17, 215, 186, 77, 63, 196, 58, 222, 175, 33, 28, 131, 179, 251, 41, 63, 148, 152, 51, 172, 168, 230, 18, 247, 84, 5, 79, 216, 227, 149, 240, 153, 53, 93, 57, 19, 59, 5, 142, 41, 112, 29, 14, 68, 145, 79, 89, 110, 162, 155, 43, 16, 218, 133, 190, 1, 152, 142, 229, 8, 67, 206, 153, 68, 147, 15, 192, 143, 211, 209, 51, 145, 84, 185, 53, 205, 119, 241, 27, 143, 4, 44, 39, 10, 155, 210, 236, 213, 27, 42, 161, 78, 32, 1, 101, 190, 80, 224, 117, 98, 180, 76, 143, 235, 13, 240, 54, 230, 227, 149, 237, 6, 102, 14, 174, 17, 183, 2, 178, 148, 86, 8, 1, 224, 188, 201, 190, 20, 165, 170, 141, 233, 49, 180, 0, 18, 114, 26, 98, 58, 26, 190, 204, 17, 179, 165, 84, 179, 40, 193, 90, 80, 151, 175, 250, 84, 168, 191, 34, 95, 118, 214, 204, 155, 171, 128, 146, 139, 223, 155, 195, 124, 166, 70, 207, 45, 134, 38, 88, 73, 9, 171, 118, 46, 47, 153, 194, 24, 132, 240, 135, 99, 233, 93, 80, 101, 242, 192, 158, 233, 194, 126, 203, 100, 99, 1, 231, 174, 180, 173, 114, 188, 69, 11, 164, 7, 126, 10, 22, 55, 23, 129, 153, 16, 251, 179, 65, 2, 176, 95, 49, 112, 42, 89, 135, 146, 221, 37, 58, 92, 93, 225, 155, 138, 158, 86, 144, 220, 151, 145, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [173, 183, 143, 196, 8, 157, 186, 151, 80, 173, 243, 27, 54, 197, 55, 99, 150, 226, 67, 127, 130, 110, 110, 211, 42, 183, 183, 230, 128, 78, 70, 226, 32, 144, 33, 196, 70, 195, 33, 25, 114, 119, 79, 153, 54, 160, 81, 47, 213, 95, 44, 242, 107, 54, 150, 225, 141, 76, 61, 94, 237, 104, 184, 21, 163, 180, 222, 18, 130, 158, 202, 48, 96, 213, 244, 77, 101, 52, 116, 60, 29, 140, 216, 69, 142, 121, 0, 75, 144, 15, 205, 243, 239, 25, 139, 110, 221, 119, 1, 178, 160, 244, 34, 242, 187, 94, 49, 173, 88, 114, 7, 238, 240, 221, 240, 246, 34, 229, 31, 88, 134, 87, 39, 227, 192, 14, 53, 12, 64, 137, 25, 217, 232, 157, 239, 65, 169, 187, 255, 211, 200, 121, 11, 114, 40, 13, 123, 200, 193, 37, 43, 2, 169, 146, 140, 184, 83, 137, 2, 135, 157, 124, 50, 42, 189, 102, 91, 64, 132, 92, 33, 21, 178, 71, 150, 4, 122, 232, 232, 122, 154, 132, 25, 46, 166, 181, 10, 61, 109, 45, 237, 158, 34, 226, 81, 246, 153, 43, 221, 171, 68, 26, 241, 67, 140, 208, 214, 188, 37, 60, 156, 213, 251, 187, 198, 99, 41, 39, 145, 202, 144, 186, 234, 111, 177, 231, 151, 149, 226, 188, 253, 57, 197, 84, 237, 163, 103, 34, 72, 57, 41, 120, 212, 29, 172, 19, 119, 164, 221, 169, 172, 109, 198, 221, 151, 166],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x36e4416e62a0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12046148573969957371, 6451793621481834338],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j4561920.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j4561920.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926810520, loc: nil},
NotAfter: {wall: 0, ext: 63942535920, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160],
AuthorityKeyId: [83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j4561920.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\",\n \"name\": \"baaa9036-b952-4d2a-af36-e458936f36a4\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T15:55:35.591747237Z\",\n \"endTime\": \"2026-10-05T16:24:44.537042498Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/metrics_amw_hcp_ksm.go:87]: failed to create HCP cluster "ksm-hcp-metrics"
Unexpected error:
<*fmt.wrapError | 0x344ebf63c7c0>:
failed to create HCP cluster ksm-hcp-metrics: failed waiting for cluster="ksm-hcp-metrics" in resourcegroup="hcp-metrics-bsf4h8h9wkbr" to finish creating: GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37",
"name": "1d5a733a-9da9-4475-bed6-8528cbdf6e37",
"status": "Failed",
"startTime": "2026-10-05T12:10:42.682289211Z",
"endTime": "2026-10-05T12:39:45.193347342Z",
"error": {
"code": "DeadlineExceeded",
"message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster ksm-hcp-metrics: failed waiting for cluster=\"ksm-hcp-metrics\" in resourcegroup=\"hcp-metrics-bsf4h8h9wkbr\" to finish creating: GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n \"name\": \"1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T12:10:42.682289211Z\",\n \"endTime\": \"2026-10-05T12:39:45.193347342Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x344ebf63c7a0>{
msg: "failed waiting for cluster=\"ksm-hcp-metrics\" in resourcegroup=\"hcp-metrics-bsf4h8h9wkbr\" to finish creating: GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n \"name\": \"1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T12:10:42.682289211Z\",\n \"endTime\": \"2026-10-05T12:39:45.193347342Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x344ebef45c80>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["60"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"c4545e57-f0ba-44a5-9d2d-736013623271",
],
"Date": [
"Mon, 05 Oct 2026 12:39:46 GMT",
],
"Content-Length": ["794"],
},
Body: <*exported.nopClosingBytesReader | 0x344ebf63c6c0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 54, 101, 100, 49, 50, 50, 100, 49, 45, 55, 101, 48, 51, 45, 52, 97, 48, 49, 45, 98, 97, 97, 101, 45, 57, 48, 50, 48, 97, 98, 102, 51, 53, 48, 100, 52, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 49, 100, 53, 97, 55, 51, 51, 97, 45, 57, 100, 97, 57, 45, 52, 52, 55, 53, 45, 98, 101, 100, 54, 45, 56, 53, 50, 56, 99, 98, 100, 102, 54, 101, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 49, 100, 53, 97, 55, 51, 51, 97, 45, 57, 100, 97, 57, 45, 52, 52, 55, 53, 45, 98, 101, 100, 54, 45, 56, 53, 50, 56, 99, 98, 100, 102, 54, 101, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 50, 58, 49, 48, 58, 52, 50, 46, 54, 56, 50, 50, 56, 57, 50, 49, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 50, 58, 51, 57, 58, 52, 53, 46, 49, 57, 51, 51, 52, 55, 51, 52, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 67, 108, 117, 115, 116, 101, 114, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 105, 115, 32, 110, 111, 116, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 58, 32, 75, 117, 98, 101, 99, 111, 110, 102, 105, 103, 87, 97, 105, 116, 105, 110, 103, 70, 111, 114, 67, 114, 101, 97, 116, 101, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 104, 111, 115, 116, 101, 100, 32, 99, 111, 110, 116, 114, 111, 108, 32, 112, 108, 97, 110, 101, 32, 107, 117, 98, 101, 99, 111, 110, 102, 105, 103, 32, 116, 111, 32, 98, 101, 32, 99, 114, 101, 97, 116, 101, 100, 59, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 100, 101, 103, 114, 97, 100, 101, 100, 58, 32, 85, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 82, 101, 112, 108, 105, 99, 97, 115, 58, 32, 99, 97, 112, 105, 45, 112, 114, 111, 118, 105, 100, 101, 114, 32, 100, 101, 112, 108, 111, 121, 109, 101, 110, 116, 32, 104, 97, 115, 32, 49, 32, 117, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 32, 114, 101, 112, 108, 105, 99, 97, 115, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 794,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j2217856.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"136ed6eb-937d-4e4b-8536-654350fef198",
],
"X-Ms-Client-Request-Id": [
"18cbf27a-1b01-4066-9df8-5b9ddaff0188",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T12:39:46Z\"}",
],
"Authorization": ["redacted"],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j2217856.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j2217856.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 162, 138, 19, 106, 44, 72, 120, 181, 58, 242, 89, 145, 224, 14, 9, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 49, 51, 54, 49, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 49, 52, 54, 49, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 174, 156, 77, 233, 7, 127, 159, 162, 157, 235, 232, 227, 255, 166, 19, 14, 245, 60, 140, 93, 118, 51, 96, 255, 192, 163, 118, 110, 43, 124, 203, 93, 85, 87, 146, 108, 72, 214, 202, 116, 171, 142, 180, 205, 133, 86, 235, 10, 152, 203, 107, 214, 81, 127, 185, 214, 69, 193, 179, 100, 48, 233, 108, 109, 239, 8, 113, 231, 177, 0, 52, 96, 85, 72, 181, 74, 215, 103, 190, 232, 214, 39, 150, 40, 199, 4, 178, 208, 201, 24, 20, 11, 42, 60, 77, 2, 119, 196, 88, 169, 193, 20, 163, 9, 62, 112, 224, 168, 71, 51, 171, 0, 67, 18, 78, 190, 120, 33, 71, 9, 231, 233, 17, 29, 88, 51, 123, 145, 5, 22, 216, 6, 109, 49, 158, 8, 249, 27, 68, 33, 152, 229, 107, 195, 143, 224, 237, 149, 46, 5, 62, 110, 32, 62, 167, 158, 31, 55, 104, 231, 151, 30, 134, 141, 176, 90, 143, 178, 35, 164, 43, 193, 3, 70, 37, 145, 203, 200, 179, 42, 223, 160, 187, 217, 164, 23, 171, 6, 218, 227, 186, 63, 172, 179, 89, 204, 121, 155, 215, 17, 123, 55, 26, 36, 87, 196, 64, 137, 148, 48, 231, 54, 153, 130, 71, 64, 232, 246, 223, 184, 140, 127, 185, 70, 119, 146, 141, 164, 215, 156, 180, 142, 121, 231, 80, 30, 143, 180, 230, 13, 5, 99, 230, 213, 92, 90, 180, 18, 230, 171, 116, 155, 158, 217, 107, 193, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 35, 201, 110, 86, 226, 149, 129, 41, 31, 201, 26, 80, 55, 77, 236, 190, 206, 104, 63, 159, 181, 80, 31, 47, 237, 97, 163, 105, 223, 53, 62, 118, 159, 122, 65, 57, 182, 33, 162, 243, 236, 24, 116, 140, 20, 240, 109, 25, 198, 192, 225, 185, 135, 163, 200, 91, 29, 209, 149, 102, 208, 12, 89, 35, 0, 28, 49, 199, 84, 168, 58, 198, 188, 195, 229, 51, 229, 43, 243, 28, 80, 216, 59, 101, 35, 255, 206, 250, 235, 93, 29, 233, 27, 166, 132, 173, 37, 82, 79, 122, 63, 118, 243, 249, 225, 136, 231, 26, 223, 227, 6, 27, 14, 236, 245, 215, 115, 194, 225, 89, 218, 58, 146, 43, 150, 5, 42, 131, 192, 64, 219, 53, 207, 177, 199, 212, 250, 141, 9, 134, 132, 116, 200, 62, 193, 108, 72, 222, 169, 245, 83, 186, 241, 41, 162, 158, 146, 8, 56, 179, 245, 68, 199, 118, 234, 18, 154, 252, 50, 6, 51, 66, 10, 148, 54, 136, 220, 193, 117, 109, 153, 202, 23, 34, 252, 160, 73, 126, 124, 100, 174, 230, 164, 240, 52, 221, 61, 97, 160, 95, 250, 112, 161, 170, 210, 134, 112, 162, 181, 98, 113, 56, 52, 78, 37, 228, 40, 202, 230, 8, 51, 12, 165, 169, 222, 130, 77, 59, 203, 103, 110, 96, 192, 56, 59, 91, 163, 57, 182, 188, 150, 210, 44, 238, 63, 61, 158, 38, 28, 189, 32, 34, 148, 168, 68, 105],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 162, 138, 19, 106, 44, 72, 120, 181, 58, 242, 89, 145, 224, 14, 9, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 49, 51, 54, 49, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 49, 52, 54, 49, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 174, 156, 77, 233, 7, 127, 159, 162, 157, 235, 232, 227, 255, 166, 19, 14, 245, 60, 140, 93, 118, 51, 96, 255, 192, 163, 118, 110, 43, 124, 203, 93, 85, 87, 146, 108, 72, 214, 202, 116, 171, 142, 180, 205, 133, 86, 235, 10, 152, 203, 107, 214, 81, 127, 185, 214, 69, 193, 179, 100, 48, 233, 108, 109, 239, 8, 113, 231, 177, 0, 52, 96, 85, 72, 181, 74, 215, 103, 190, 232, 214, 39, 150, 40, 199, 4, 178, 208, 201, 24, 20, 11, 42, 60, 77, 2, 119, 196, 88, 169, 193, 20, 163, 9, 62, 112, 224, 168, 71, 51, 171, 0, 67, 18, 78, 190, 120, 33, 71, 9, 231, 233, 17, 29, 88, 51, 123, 145, 5, 22, 216, 6, 109, 49, 158, 8, 249, 27, 68, 33, 152, 229, 107, 195, 143, 224, 237, 149, 46, 5, 62, 110, 32, 62, 167, 158, 31, 55, 104, 231, 151, 30, 134, 141, 176, 90, 143, 178, 35, 164, 43, 193, 3, 70, 37, 145, 203, 200, 179, 42, 223, 160, 187, 217, 164, 23, 171, 6, 218, 227, 186, 63, 172, 179, 89, 204, 121, 155, 215, 17, 123, 55, 26, 36, 87, 196, 64, 137, 148, 48, 231, 54, 153, 130, 71, 64, 232, 246, 223, 184, 140, 127, 185, 70, 119, 146, 141, 164, 215, 156, 180, 142, 121, 231, 80, 30, 143, 180, 230, 13, 5, 99, 230, 213, 92, 90, 180, 18, 230, 171, 116, 155, 158, 217, 107, 193, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 174, 156, 77, 233, 7, 127, 159, 162, 157, 235, 232, 227, 255, 166, 19, 14, 245, 60, 140, 93, 118, 51, 96, 255, 192, 163, 118, 110, 43, 124, 203, 93, 85, 87, 146, 108, 72, 214, 202, 116, 171, 142, 180, 205, 133, 86, 235, 10, 152, 203, 107, 214, 81, 127, 185, 214, 69, 193, 179, 100, 48, 233, 108, 109, 239, 8, 113, 231, 177, 0, 52, 96, 85, 72, 181, 74, 215, 103, 190, 232, 214, 39, 150, 40, 199, 4, 178, 208, 201, 24, 20, 11, 42, 60, 77, 2, 119, 196, 88, 169, 193, 20, 163, 9, 62, 112, 224, 168, 71, 51, 171, 0, 67, 18, 78, 190, 120, 33, 71, 9, 231, 233, 17, 29, 88, 51, 123, 145, 5, 22, 216, 6, 109, 49, 158, 8, 249, 27, 68, 33, 152, 229, 107, 195, 143, 224, 237, 149, 46, 5, 62, 110, 32, 62, 167, 158, 31, 55, 104, 231, 151, 30, 134, 141, 176, 90, 143, 178, 35, 164, 43, 193, 3, 70, 37, 145, 203, 200, 179, 42, 223, 160, 187, 217, 164, 23, 171, 6, 218, 227, 186, 63, 172, 179, 89, 204, 121, 155, 215, 17, 123, 55, 26, 36, 87, 196, 64, 137, 148, 48, 231, 54, 153, 130, 71, 64, 232, 246, 223, 184, 140, 127, 185, 70, 119, 146, 141, 164, 215, 156, 180, 142, 121, 231, 80, 30, 143, 180, 230, 13, 5, 99, 230, 213, 92, 90, 180, 18, 230, 171, 116, 155, 158, 217, 107, 193, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [35, 201, 110, 86, 226, 149, 129, 41, 31, 201, 26, 80, 55, 77, 236, 190, 206, 104, 63, 159, 181, 80, 31, 47, 237, 97, 163, 105, 223, 53, 62, 118, 159, 122, 65, 57, 182, 33, 162, 243, 236, 24, 116, 140, 20, 240, 109, 25, 198, 192, 225, 185, 135, 163, 200, 91, 29, 209, 149, 102, 208, 12, 89, 35, 0, 28, 49, 199, 84, 168, 58, 198, 188, 195, 229, 51, 229, 43, 243, 28, 80, 216, 59, 101, 35, 255, 206, 250, 235, 93, 29, 233, 27, 166, 132, 173, 37, 82, 79, 122, 63, 118, 243, 249, 225, 136, 231, 26, 223, 227, 6, 27, 14, 236, 245, 215, 115, 194, 225, 89, 218, 58, 146, 43, 150, 5, 42, 131, 192, 64, 219, 53, 207, 177, 199, 212, 250, 141, 9, 134, 132, 116, 200, 62, 193, 108, 72, 222, 169, 245, 83, 186, 241, 41, 162, 158, 146, 8, 56, 179, 245, 68, 199, 118, 234, 18, 154, 252, 50, 6, 51, 66, 10, 148, 54, 136, 220, 193, 117, 109, 153, 202, 23, 34, 252, 160, 73, 126, 124, 100, 174, 230, 164, 240, 52, 221, 61, 97, 160, 95, 250, 112, 161, 170, 210, 134, 112, 162, 181, 98, 113, 56, 52, 78, 37, 228, 40, 202, 230, 8, 51, 12, 165, 169, 222, 130, 77, 59, 203, 103, 110, 96, 192, 56, 59, 91, 163, 57, 182, 188, 150, 210, 44, 238, 63, 61, 158, 38, 28, 189, 32, 34, 148, 168, 68, 105],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x344ebe526210>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [13059016536027565577, 8476489264654993528],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j2217856.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j2217856.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926796977, loc: nil},
NotAfter: {wall: 0, ext: 63942522377, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: "\xc2\xd3^K5\x88YjE\xf8\xfc\xf2\xe2\xf6\xed\xe7a\xf8\xb0\xbd",
AuthorityKeyId: "\xc2\xd3^K5\x88YjE\xf8\xfc\xf2\xe2\xf6\xed\xe7a\xf8\xb0\xbd",
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j2217856.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n \"name\": \"1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T12:10:42.682289211Z\",\n \"endTime\": \"2026-10-05T12:39:45.193347342Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/metrics_amw_hcp_ksm.go:87]: failed to create HCP cluster "ksm-hcp-metrics"
Unexpected error:
<*fmt.wrapError | 0x344ebf63c7c0>:
failed to create HCP cluster ksm-hcp-metrics: failed waiting for cluster="ksm-hcp-metrics" in resourcegroup="hcp-metrics-bsf4h8h9wkbr" to finish creating: GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37",
"name": "1d5a733a-9da9-4475-bed6-8528cbdf6e37",
"status": "Failed",
"startTime": "2026-10-05T12:10:42.682289211Z",
"endTime": "2026-10-05T12:39:45.193347342Z",
"error": {
"code": "DeadlineExceeded",
"message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster ksm-hcp-metrics: failed waiting for cluster=\"ksm-hcp-metrics\" in resourcegroup=\"hcp-metrics-bsf4h8h9wkbr\" to finish creating: GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n \"name\": \"1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T12:10:42.682289211Z\",\n \"endTime\": \"2026-10-05T12:39:45.193347342Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x344ebf63c7a0>{
msg: "failed waiting for cluster=\"ksm-hcp-metrics\" in resourcegroup=\"hcp-metrics-bsf4h8h9wkbr\" to finish creating: GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n \"name\": \"1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T12:10:42.682289211Z\",\n \"endTime\": \"2026-10-05T12:39:45.193347342Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x344ebef45c80>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["60"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"c4545e57-f0ba-44a5-9d2d-736013623271",
],
"Date": [
"Mon, 05 Oct 2026 12:39:46 GMT",
],
"Content-Length": ["794"],
},
Body: <*exported.nopClosingBytesReader | 0x344ebf63c6c0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 54, 101, 100, 49, 50, 50, 100, 49, 45, 55, 101, 48, 51, 45, 52, 97, 48, 49, 45, 98, 97, 97, 101, 45, 57, 48, 50, 48, 97, 98, 102, 51, 53, 48, 100, 52, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 49, 100, 53, 97, 55, 51, 51, 97, 45, 57, 100, 97, 57, 45, 52, 52, 55, 53, 45, 98, 101, 100, 54, 45, 56, 53, 50, 56, 99, 98, 100, 102, 54, 101, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 49, 100, 53, 97, 55, 51, 51, 97, 45, 57, 100, 97, 57, 45, 52, 52, 55, 53, 45, 98, 101, 100, 54, 45, 56, 53, 50, 56, 99, 98, 100, 102, 54, 101, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 50, 58, 49, 48, 58, 52, 50, 46, 54, 56, 50, 50, 56, 57, 50, 49, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 50, 58, 51, 57, 58, 52, 53, 46, 49, 57, 51, 51, 52, 55, 51, 52, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 67, 108, 117, 115, 116, 101, 114, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 105, 115, 32, 110, 111, 116, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 58, 32, 75, 117, 98, 101, 99, 111, 110, 102, 105, 103, 87, 97, 105, 116, 105, 110, 103, 70, 111, 114, 67, 114, 101, 97, 116, 101, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 104, 111, 115, 116, 101, 100, 32, 99, 111, 110, 116, 114, 111, 108, 32, 112, 108, 97, 110, 101, 32, 107, 117, 98, 101, 99, 111, 110, 102, 105, 103, 32, 116, 111, 32, 98, 101, 32, 99, 114, 101, 97, 116, 101, 100, 59, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 100, 101, 103, 114, 97, 100, 101, 100, 58, 32, 85, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 82, 101, 112, 108, 105, 99, 97, 115, 58, 32, 99, 97, 112, 105, 45, 112, 114, 111, 118, 105, 100, 101, 114, 32, 100, 101, 112, 108, 111, 121, 109, 101, 110, 116, 32, 104, 97, 115, 32, 49, 32, 117, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 32, 114, 101, 112, 108, 105, 99, 97, 115, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 794,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j2217856.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"136ed6eb-937d-4e4b-8536-654350fef198",
],
"X-Ms-Client-Request-Id": [
"18cbf27a-1b01-4066-9df8-5b9ddaff0188",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T12:39:46Z\"}",
],
"Authorization": ["redacted"],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j2217856.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j2217856.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 162, 138, 19, 106, 44, 72, 120, 181, 58, 242, 89, 145, 224, 14, 9, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 49, 51, 54, 49, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 49, 52, 54, 49, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 174, 156, 77, 233, 7, 127, 159, 162, 157, 235, 232, 227, 255, 166, 19, 14, 245, 60, 140, 93, 118, 51, 96, 255, 192, 163, 118, 110, 43, 124, 203, 93, 85, 87, 146, 108, 72, 214, 202, 116, 171, 142, 180, 205, 133, 86, 235, 10, 152, 203, 107, 214, 81, 127, 185, 214, 69, 193, 179, 100, 48, 233, 108, 109, 239, 8, 113, 231, 177, 0, 52, 96, 85, 72, 181, 74, 215, 103, 190, 232, 214, 39, 150, 40, 199, 4, 178, 208, 201, 24, 20, 11, 42, 60, 77, 2, 119, 196, 88, 169, 193, 20, 163, 9, 62, 112, 224, 168, 71, 51, 171, 0, 67, 18, 78, 190, 120, 33, 71, 9, 231, 233, 17, 29, 88, 51, 123, 145, 5, 22, 216, 6, 109, 49, 158, 8, 249, 27, 68, 33, 152, 229, 107, 195, 143, 224, 237, 149, 46, 5, 62, 110, 32, 62, 167, 158, 31, 55, 104, 231, 151, 30, 134, 141, 176, 90, 143, 178, 35, 164, 43, 193, 3, 70, 37, 145, 203, 200, 179, 42, 223, 160, 187, 217, 164, 23, 171, 6, 218, 227, 186, 63, 172, 179, 89, 204, 121, 155, 215, 17, 123, 55, 26, 36, 87, 196, 64, 137, 148, 48, 231, 54, 153, 130, 71, 64, 232, 246, 223, 184, 140, 127, 185, 70, 119, 146, 141, 164, 215, 156, 180, 142, 121, 231, 80, 30, 143, 180, 230, 13, 5, 99, 230, 213, 92, 90, 180, 18, 230, 171, 116, 155, 158, 217, 107, 193, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 35, 201, 110, 86, 226, 149, 129, 41, 31, 201, 26, 80, 55, 77, 236, 190, 206, 104, 63, 159, 181, 80, 31, 47, 237, 97, 163, 105, 223, 53, 62, 118, 159, 122, 65, 57, 182, 33, 162, 243, 236, 24, 116, 140, 20, 240, 109, 25, 198, 192, 225, 185, 135, 163, 200, 91, 29, 209, 149, 102, 208, 12, 89, 35, 0, 28, 49, 199, 84, 168, 58, 198, 188, 195, 229, 51, 229, 43, 243, 28, 80, 216, 59, 101, 35, 255, 206, 250, 235, 93, 29, 233, 27, 166, 132, 173, 37, 82, 79, 122, 63, 118, 243, 249, 225, 136, 231, 26, 223, 227, 6, 27, 14, 236, 245, 215, 115, 194, 225, 89, 218, 58, 146, 43, 150, 5, 42, 131, 192, 64, 219, 53, 207, 177, 199, 212, 250, 141, 9, 134, 132, 116, 200, 62, 193, 108, 72, 222, 169, 245, 83, 186, 241, 41, 162, 158, 146, 8, 56, 179, 245, 68, 199, 118, 234, 18, 154, 252, 50, 6, 51, 66, 10, 148, 54, 136, 220, 193, 117, 109, 153, 202, 23, 34, 252, 160, 73, 126, 124, 100, 174, 230, 164, 240, 52, 221, 61, 97, 160, 95, 250, 112, 161, 170, 210, 134, 112, 162, 181, 98, 113, 56, 52, 78, 37, 228, 40, 202, 230, 8, 51, 12, 165, 169, 222, 130, 77, 59, 203, 103, 110, 96, 192, 56, 59, 91, 163, 57, 182, 188, 150, 210, 44, 238, 63, 61, 158, 38, 28, 189, 32, 34, 148, 168, 68, 105],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 162, 138, 19, 106, 44, 72, 120, 181, 58, 242, 89, 145, 224, 14, 9, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 49, 51, 54, 49, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 49, 52, 54, 49, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 174, 156, 77, 233, 7, 127, 159, 162, 157, 235, 232, 227, 255, 166, 19, 14, 245, 60, 140, 93, 118, 51, 96, 255, 192, 163, 118, 110, 43, 124, 203, 93, 85, 87, 146, 108, 72, 214, 202, 116, 171, 142, 180, 205, 133, 86, 235, 10, 152, 203, 107, 214, 81, 127, 185, 214, 69, 193, 179, 100, 48, 233, 108, 109, 239, 8, 113, 231, 177, 0, 52, 96, 85, 72, 181, 74, 215, 103, 190, 232, 214, 39, 150, 40, 199, 4, 178, 208, 201, 24, 20, 11, 42, 60, 77, 2, 119, 196, 88, 169, 193, 20, 163, 9, 62, 112, 224, 168, 71, 51, 171, 0, 67, 18, 78, 190, 120, 33, 71, 9, 231, 233, 17, 29, 88, 51, 123, 145, 5, 22, 216, 6, 109, 49, 158, 8, 249, 27, 68, 33, 152, 229, 107, 195, 143, 224, 237, 149, 46, 5, 62, 110, 32, 62, 167, 158, 31, 55, 104, 231, 151, 30, 134, 141, 176, 90, 143, 178, 35, 164, 43, 193, 3, 70, 37, 145, 203, 200, 179, 42, 223, 160, 187, 217, 164, 23, 171, 6, 218, 227, 186, 63, 172, 179, 89, 204, 121, 155, 215, 17, 123, 55, 26, 36, 87, 196, 64, 137, 148, 48, 231, 54, 153, 130, 71, 64, 232, 246, 223, 184, 140, 127, 185, 70, 119, 146, 141, 164, 215, 156, 180, 142, 121, 231, 80, 30, 143, 180, 230, 13, 5, 99, 230, 213, 92, 90, 180, 18, 230, 171, 116, 155, 158, 217, 107, 193, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 174, 156, 77, 233, 7, 127, 159, 162, 157, 235, 232, 227, 255, 166, 19, 14, 245, 60, 140, 93, 118, 51, 96, 255, 192, 163, 118, 110, 43, 124, 203, 93, 85, 87, 146, 108, 72, 214, 202, 116, 171, 142, 180, 205, 133, 86, 235, 10, 152, 203, 107, 214, 81, 127, 185, 214, 69, 193, 179, 100, 48, 233, 108, 109, 239, 8, 113, 231, 177, 0, 52, 96, 85, 72, 181, 74, 215, 103, 190, 232, 214, 39, 150, 40, 199, 4, 178, 208, 201, 24, 20, 11, 42, 60, 77, 2, 119, 196, 88, 169, 193, 20, 163, 9, 62, 112, 224, 168, 71, 51, 171, 0, 67, 18, 78, 190, 120, 33, 71, 9, 231, 233, 17, 29, 88, 51, 123, 145, 5, 22, 216, 6, 109, 49, 158, 8, 249, 27, 68, 33, 152, 229, 107, 195, 143, 224, 237, 149, 46, 5, 62, 110, 32, 62, 167, 158, 31, 55, 104, 231, 151, 30, 134, 141, 176, 90, 143, 178, 35, 164, 43, 193, 3, 70, 37, 145, 203, 200, 179, 42, 223, 160, 187, 217, 164, 23, 171, 6, 218, 227, 186, 63, 172, 179, 89, 204, 121, 155, 215, 17, 123, 55, 26, 36, 87, 196, 64, 137, 148, 48, 231, 54, 153, 130, 71, 64, 232, 246, 223, 184, 140, 127, 185, 70, 119, 146, 141, 164, 215, 156, 180, 142, 121, 231, 80, 30, 143, 180, 230, 13, 5, 99, 230, 213, 92, 90, 180, 18, 230, 171, 116, 155, 158, 217, 107, 193, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [35, 201, 110, 86, 226, 149, 129, 41, 31, 201, 26, 80, 55, 77, 236, 190, 206, 104, 63, 159, 181, 80, 31, 47, 237, 97, 163, 105, 223, 53, 62, 118, 159, 122, 65, 57, 182, 33, 162, 243, 236, 24, 116, 140, 20, 240, 109, 25, 198, 192, 225, 185, 135, 163, 200, 91, 29, 209, 149, 102, 208, 12, 89, 35, 0, 28, 49, 199, 84, 168, 58, 198, 188, 195, 229, 51, 229, 43, 243, 28, 80, 216, 59, 101, 35, 255, 206, 250, 235, 93, 29, 233, 27, 166, 132, 173, 37, 82, 79, 122, 63, 118, 243, 249, 225, 136, 231, 26, 223, 227, 6, 27, 14, 236, 245, 215, 115, 194, 225, 89, 218, 58, 146, 43, 150, 5, 42, 131, 192, 64, 219, 53, 207, 177, 199, 212, 250, 141, 9, 134, 132, 116, 200, 62, 193, 108, 72, 222, 169, 245, 83, 186, 241, 41, 162, 158, 146, 8, 56, 179, 245, 68, 199, 118, 234, 18, 154, 252, 50, 6, 51, 66, 10, 148, 54, 136, 220, 193, 117, 109, 153, 202, 23, 34, 252, 160, 73, 126, 124, 100, 174, 230, 164, 240, 52, 221, 61, 97, 160, 95, 250, 112, 161, 170, 210, 134, 112, 162, 181, 98, 113, 56, 52, 78, 37, 228, 40, 202, 230, 8, 51, 12, 165, 169, 222, 130, 77, 59, 203, 103, 110, 96, 192, 56, 59, 91, 163, 57, 182, 188, 150, 210, 44, 238, 63, 61, 158, 38, 28, 189, 32, 34, 148, 168, 68, 105],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x344ebe526210>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [13059016536027565577, 8476489264654993528],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j2217856.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j2217856.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926796977, loc: nil},
NotAfter: {wall: 0, ext: 63942522377, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: "\xc2\xd3^K5\x88YjE\xf8\xfc\xf2\xe2\xf6\xed\xe7a\xf8\xb0\xbd",
AuthorityKeyId: "\xc2\xd3^K5\x88YjE\xf8\xfc\xf2\xe2\xf6\xed\xe7a\xf8\xb0\xbd",
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j2217856.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n \"name\": \"1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T12:10:42.682289211Z\",\n \"endTime\": \"2026-10-05T12:39:45.193347342Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurredContributing tests (2)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail message cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster still exists; [clusterServic...full failure pattern: ERROR CODE: InternalServerError; detail message cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster still exists; [clusterServiceStatus] state is "uninstalling"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: nodePools, serviceProviderClusters, serviceProviderNodePools; provider Microsoft.RedHatOpenShift Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 3 days | e2e | 1 | 1.30%1 of 77 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 3 days | Show trend detailsSep 29: 17 · Sep 30: 22 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 8 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
<*errors.joinError | 0x1aa156004108>:
resource group "rg-candidate-5-0-8tjwmpdtkhph": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-5-0-pgtvx6" in resourcegroup="rg-candidate-5-0-8tjwmpdtkhph" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8",
"name": "79c1b550-6373-4cea-be54-1e9006359ec8",
"status": "Failed",
"startTime": "2026-10-05T02:23:09.692187892Z",
"endTime": "2026-10-05T02:47:13.541313539Z",
"error": {
"code": "InternalServerError",
"message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0x1aa155a102a0>{
msg: "resource group \"rg-candidate-5-0-8tjwmpdtkhph\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1aa155a10260>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1aa155a10220>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1aa155a10200>{
msg: "failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x1aa1560a4660>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [...],
"Date": [...],
"Content-Length": [...],
"X-Envoy-Upstream-Service-Time": [...],
"Server": [...],
"Content-Type": [...],
},
Body: <*exported.nopClosingBytesReader | 0x1aa155a10000>{
s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
i: 0,
},
ContentLength: 1034,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0780544.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0780544.hcpsvc.osadev.cloud",
PeerCertificates: [...],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57c5760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
<*errors.joinError | 0x1aa156004108>:
resource group "rg-candidate-5-0-8tjwmpdtkhph": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-5-0-pgtvx6" in resourcegroup="rg-candidate-5-0-8tjwmpdtkhph" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8",
"name": "79c1b550-6373-4cea-be54-1e9006359ec8",
"status": "Failed",
"startTime": "2026-10-05T02:23:09.692187892Z",
"endTime": "2026-10-05T02:47:13.541313539Z",
"error": {
"code": "InternalServerError",
"message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0x1aa155a102a0>{
msg: "resource group \"rg-candidate-5-0-8tjwmpdtkhph\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1aa155a10260>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1aa155a10220>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1aa155a10200>{
msg: "failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x1aa1560a4660>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Ms-Request-Id": [...],
"Date": [...],
"Content-Length": [...],
"X-Envoy-Upstream-Service-Time": [...],
"Server": [...],
"Content-Type": [...],
},
Body: <*exported.nopClosingBytesReader | 0x1aa155a10000>{
s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
i: 0,
},
ContentLength: 1034,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0780544.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0780544.hcpsvc.osadev.cloud",
PeerCertificates: [...],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57c5760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
<*errors.joinError | 0x3a1639c9c150>:
resource group "rg-candidate-4-22-w6vk6h8k9k9m": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-4-22-5ngq9s" in resourcegroup="rg-candidate-4-22-w6vk6h8k9k9m" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7",
"name": "2709f4f5-77a0-416d-aca2-c1cf92ad96b7",
"status": "Failed",
"startTime": "2026-10-05T02:18:35.841855817Z",
"endTime": "2026-10-05T02:42:44.185198344Z",
"error": {
"code": "InternalServerError",
"message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0x3a1637397360>{
msg: "resource group \"rg-candidate-4-22-w6vk6h8k9k9m\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3a1637397320>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3a16373972e0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3a1637397280>{
msg: "failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x3a1639c32cf0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": [...],
"Server": [...],
"Content-Type": [...],
"X-Ms-Request-Id": [...],
"Date": [...],
"Content-Length": [...],
},
Body: <*exported.nopClosingBytesReader | 0x3a1637396e00>{
s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
i: 0,
},
ContentLength: 1034,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0780544.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0780544.hcpsvc.osadev.cloud",
PeerCertificates: [...],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57c5760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
<*errors.joinError | 0x3a1639c9c150>:
resource group "rg-candidate-4-22-w6vk6h8k9k9m": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-4-22-5ngq9s" in resourcegroup="rg-candidate-4-22-w6vk6h8k9k9m" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7",
"name": "2709f4f5-77a0-416d-aca2-c1cf92ad96b7",
"status": "Failed",
"startTime": "2026-10-05T02:18:35.841855817Z",
"endTime": "2026-10-05T02:42:44.185198344Z",
"error": {
"code": "InternalServerError",
"message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0x3a1637397360>{
msg: "resource group \"rg-candidate-4-22-w6vk6h8k9k9m\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3a1637397320>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3a16373972e0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3a1637397280>{
msg: "failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x3a1639c32cf0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": [...],
"Server": [...],
"Content-Type": [...],
"X-Ms-Request-Id": [...],
"Date": [...],
"Content-Length": [...],
},
Body: <*exported.nopClosingBytesReader | 0x3a1637396e00>{
s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
i: 0,
},
ContentLength: 1034,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0780544.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0780544.hcpsvc.osadev.cloud",
PeerCertificates: [...],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57c5760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
<*errors.joinError | 0x303aeb2f0180>:
resource group "rg-candidate-4-20-f7fctkc5pgvh": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-4-20-2xk4k8" in resourcegroup="rg-candidate-4-20-f7fctkc5pgvh" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe",
"name": "ac7db877-195f-438d-ad8c-5562e31beefe",
"status": "Failed",
"startTime": "2026-10-05T02:17:15.872053554Z",
"endTime": "2026-10-05T02:41:23.612334671Z",
"error": {
"code": "InternalServerError",
"message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0x303aea9f69e0>{
msg: "resource group \"rg-candidate-4-20-f7fctkc5pgvh\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x303aea9f6720>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x303aea9f66a0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x303aea9f6660>{
msg: "failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x303aeba3eab0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": [...],
"X-Ms-Request-Id": [...],
"Date": [...],
"Content-Length": [...],
"X-Envoy-Upstream-Service-Time": [...],
"Server": [...],
},
Body: <*exported.nopClosingBytesReader | 0x303aea9f6440>{
s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
i: 0,
},
ContentLength: 1034,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0780544.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0780544.hcpsvc.osadev.cloud",
PeerCertificates: [...],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57c5760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
<*errors.joinError | 0x303aeb2f0180>:
resource group "rg-candidate-4-20-f7fctkc5pgvh": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-4-20-2xk4k8" in resourcegroup="rg-candidate-4-20-f7fctkc5pgvh" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe",
"name": "ac7db877-195f-438d-ad8c-5562e31beefe",
"status": "Failed",
"startTime": "2026-10-05T02:17:15.872053554Z",
"endTime": "2026-10-05T02:41:23.612334671Z",
"error": {
"code": "InternalServerError",
"message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0x303aea9f69e0>{
msg: "resource group \"rg-candidate-4-20-f7fctkc5pgvh\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x303aea9f6720>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x303aea9f66a0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x303aea9f6660>{
msg: "failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x303aeba3eab0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": [...],
"X-Ms-Request-Id": [...],
"Date": [...],
"Content-Length": [...],
"X-Envoy-Upstream-Service-Time": [...],
"Server": [...],
},
Body: <*exported.nopClosingBytesReader | 0x303aea9f6440>{
s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
i: 0,
},
ContentLength: 1034,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0780544.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0780544.hcpsvc.osadev.cloud",
PeerCertificates: [...],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57c5760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
},
},
],
}
occurredContributing tests (8)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [svc] ServiceCPUDrift firedfull failure pattern: alert [svc] ServiceCPUDrift fired Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 3 days | alert | 1 | 1.30%1 of 77 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 3 days | Show trend detailsSep 29: 2 · Sep 30: 1 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)alert fired 2 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T02:34:29Z Severity: Sev3 Labels: alertname="ServiceCPUDrift", cluster="ci01-j0780544-svc", component="service-memory", container="aro-hcp-frontend", namespace="aro-hcp", pod="aro-hcp-frontend-7d685f5d65-pqsl6", severity="warning", team="hcp-sl" Description: Container aro-hcp-frontend in pod aro-hcp-frontend-7d685f5d65-pqsl6 (namespace aro-hcp) on cluster ci01-j0780544-svc has averaged 333.9% of its CPU request over the last 30 minutes. This may indicate workload growth that requires right-sizing the request in config.yaml. Firing 2: State: Fired (not resolved) Started: 2026-10-05T02:34:29Z Severity: Sev3 Labels: alertname="ServiceCPUDrift", cluster="ci01-j0780544-svc", component="service-memory", container="aro-hcp-frontend", namespace="aro-hcp", pod="aro-hcp-frontend-7d685f5d65-cx7cb", severity="warning", team="hcp-sl" Description: Container aro-hcp-frontend in pod aro-hcp-frontend-7d685f5d65-cx7cb (namespace aro-hcp) on cluster ci01-j0780544-svc has averaged 330.2% of its CPU request over the last 30 minutes. This may indicate workload growth that requires right-sizing the request in config.yaml. Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeadlineExceeded; detail message cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet complete...full failure pattern: ERROR CODE: DeadlineExceeded; detail message cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version <version> is Partial (want Completed), started <duration> ago; hosted cluster degraded: UnavailableReplicas: [router]; provider Microsoft.RedHatOpenShift Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 3 days | e2e | 1 | 1.30%1 of 77 job runs affected | FlakeSignal: Flake — present in 2 prior week(s); spread across 3 days | Show trend detailsSep 29: 10 · Sep 30: 5 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-23-dtftt72rmq4p/cluster-candidate-4-23-8jw2cp should provision
Unexpected error:
<*fmt.wrapError | 0x26a5bc4e400>:
failed to create HCP cluster cluster-candidate-4-23-8jw2cp: failed waiting for cluster="cluster-candidate-4-23-8jw2cp" in resourcegroup="rg-candidate-4-23-dtftt72rmq4p" to finish creating: GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b",
"name": "37d8a3f3-8107-442c-8393-d0345952f91b",
"status": "Failed",
"startTime": "2026-10-05T17:20:34.024624942Z",
"endTime": "2026-10-05T17:49:43.310425447Z",
"error": {
"code": "DeadlineExceeded",
"message": "cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster cluster-candidate-4-23-8jw2cp: failed waiting for cluster=\"cluster-candidate-4-23-8jw2cp\" in resourcegroup=\"rg-candidate-4-23-dtftt72rmq4p\" to finish creating: GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\",\n \"name\": \"37d8a3f3-8107-442c-8393-d0345952f91b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T17:20:34.024624942Z\",\n \"endTime\": \"2026-10-05T17:49:43.310425447Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x26a5bc4e120>{
msg: "failed waiting for cluster=\"cluster-candidate-4-23-8jw2cp\" in resourcegroup=\"rg-candidate-4-23-dtftt72rmq4p\" to finish creating: GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\",\n \"name\": \"37d8a3f3-8107-442c-8393-d0345952f91b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T17:20:34.024624942Z\",\n \"endTime\": \"2026-10-05T17:49:43.310425447Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x26a5c6a2390>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"f46ca1e1-52f8-44e9-bb67-889cb17d0373",
],
"Date": [
"Mon, 05 Oct 2026 17:49:46 GMT",
],
"Content-Length": ["736"],
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x26a5bc4e000>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 51, 55, 100, 56, 97, 51, 102, 51, 45, 56, 49, 48, 55, 45, 52, 52, 50, 99, 45, 56, 51, 57, 51, 45, 100, 48, 51, 52, 53, 57, 53, 50, 102, 57, 49, 98, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 51, 55, 100, 56, 97, 51, 102, 51, 45, 56, 49, 48, 55, 45, 52, 52, 50, 99, 45, 56, 51, 57, 51, 45, 100, 48, 51, 52, 53, 57, 53, 50, 102, 57, 49, 98, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 50, 48, 58, 51, 52, 46, 48, 50, 52, 54, 50, 52, 57, 52, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 52, 57, 58, 52, 51, 46, 51, 49, 48, 52, 50, 53, 52, 52, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 99, 111, 110, 116, 114, 111, 108, 32, 112, 108, 97, 110, 101, 32, 118, 101, 114, 115, 105, 111, 110, 32, 110, 111, 116, 32, 121, 101, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 100, 58, 32, 118, 101, 114, 115, 105, 111, 110, 32, 52, 46, 50, 51, 46, 48, 45, 101, 99, 46, 49, 32, 105, 115, 32, 80, 97, 114, 116, 105, 97, 108, 32, 40, 119, 97, 110, 116, 32, 67, 111, 109, 112, 108, 101, 116, 101, 100, 41, 44, 32, 115, 116, 97, 114, 116, 101, 100, 32, 50, 52, 109, 50, 115, 32, 97, 103, 111, 59, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 100, 101, 103, 114, 97, 100, 101, 100, 58, 32, 85, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 82, 101, 112, 108, 105, 99, 97, 115, 58, 32, 114, 111, 117, 116, 101, 114, 32, 100, 101, 112, 108, 111, 121, 109, 101, 110, 116, 32, 104, 97, 115, 32, 49, 32, 117, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 32, 114, 101, 112, 108, 105, 99, 97, 115, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 736,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j3289856.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"fbcf69e0-8a48-4875-8e0c-6fab6efbd907",
],
"X-Ms-Client-Request-Id": [
"f2be8d2b-f66b-4625-9159-9d50d40c317a",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T17:49:46Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j3289856.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j3289856.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 107, 16, 41, 198, 229, 167, 64, 194, 189, 195, 219, 170, 46, 184, 246, 21, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 52, 56, 48, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 53, 56, 48, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 150, 152, 67, 23, 80, 197, 3, 214, 173, 48, 146, 197, 159, 131, 245, 239, 109, 67, 141, 171, 26, 170, 225, 238, 17, 240, 7, 118, 31, 128, 141, 62, 64, 132, 163, 242, 128, 85, 162, 85, 173, 151, 127, 68, 90, 126, 166, 35, 20, 160, 105, 137, 93, 71, 177, 228, 174, 40, 113, 105, 101, 154, 174, 58, 137, 55, 103, 32, 216, 17, 81, 76, 55, 205, 51, 246, 106, 255, 233, 113, 209, 163, 78, 5, 126, 193, 177, 2, 182, 114, 168, 59, 3, 141, 7, 173, 185, 198, 177, 198, 82, 55, 232, 135, 230, 217, 22, 77, 175, 50, 99, 142, 19, 191, 186, 1, 180, 74, 134, 150, 200, 216, 123, 226, 69, 252, 169, 149, 66, 87, 52, 135, 226, 137, 242, 120, 203, 144, 228, 26, 181, 58, 152, 151, 194, 207, 55, 162, 126, 41, 184, 109, 173, 167, 142, 250, 205, 93, 182, 105, 138, 50, 20, 91, 125, 29, 167, 75, 29, 146, 18, 166, 172, 223, 231, 119, 145, 173, 249, 48, 247, 37, 133, 61, 40, 226, 184, 214, 184, 202, 72, 105, 131, 34, 29, 42, 124, 39, 7, 153, 169, 41, 206, 70, 76, 120, 203, 213, 137, 50, 199, 244, 16, 199, 85, 137, 233, 99, 116, 207, 22, 248, 172, 110, 62, 2, 9, 154, 49, 253, 154, 159, 52, 95, 223, 138, 4, 84, 15, 178, 94, 180, 190, 189, 32, 205, 219, 40, 252, 157, 88, 16, 24, 76, 62, 217, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 39, 67, 216, 246, 105, 235, 89, 216, 192, 224, 246, 247, 245, 47, 112, 137, 249, 153, 80, 223, 21, 233, 102, 111, 198, 158, 97, 203, 183, 25, 213, 195, 111, 236, 9, 19, 78, 96, 161, 40, 206, 119, 92, 217, 13, 190, 25, 15, 6, 168, 7, 4, 249, 168, 216, 237, 64, 154, 70, 212, 214, 124, 133, 159, 57, 240, 178, 7, 72, 38, 212, 196, 142, 91, 74, 246, 181, 34, 139, 220, 212, 59, 10, 74, 151, 247, 97, 49, 209, 82, 114, 108, 4, 233, 199, 44, 35, 29, 170, 92, 48, 17, 95, 192, 11, 155, 72, 107, 249, 202, 248, 102, 5, 122, 14, 160, 74, 241, 70, 28, 115, 144, 228, 77, 53, 218, 11, 248, 37, 76, 76, 63, 16, 174, 217, 165, 212, 84, 30, 170, 207, 14, 233, 47, 127, 153, 250, 180, 218, 225, 47, 239, 165, 138, 88, 59, 251, 42, 227, 42, 200, 72, 63, 123, 131, 158, 109, 22, 236, 236, 56, 118, 164, 93, 217, 188, 109, 1, 208, 13, 51, 74, 10, 166, 98, 111, 162, 123, 183, 185, 170, 237, 141, 226, 231, 17, 103, 106, 75, 4, 1, 185, 99, 2, 235, 200, 159, 171, 253, 186, 119, 187, 116, 172, 189, 208, 165, 87, 56, 16, 100, 254, 168, 53, 131, 34, 58, 200, 111, 89, 210, 244, 185, 51, 89, 32, 201, 82, 122, 3, 250, 9, 61, 77, 68, 154, 27, 188, 200, 227, 237, 129, 19, 136, 78, 60],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 107, 16, 41, 198, 229, 167, 64, 194, 189, 195, 219, 170, 46, 184, 246, 21, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 52, 56, 48, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 53, 56, 48, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 150, 152, 67, 23, 80, 197, 3, 214, 173, 48, 146, 197, 159, 131, 245, 239, 109, 67, 141, 171, 26, 170, 225, 238, 17, 240, 7, 118, 31, 128, 141, 62, 64, 132, 163, 242, 128, 85, 162, 85, 173, 151, 127, 68, 90, 126, 166, 35, 20, 160, 105, 137, 93, 71, 177, 228, 174, 40, 113, 105, 101, 154, 174, 58, 137, 55, 103, 32, 216, 17, 81, 76, 55, 205, 51, 246, 106, 255, 233, 113, 209, 163, 78, 5, 126, 193, 177, 2, 182, 114, 168, 59, 3, 141, 7, 173, 185, 198, 177, 198, 82, 55, 232, 135, 230, 217, 22, 77, 175, 50, 99, 142, 19, 191, 186, 1, 180, 74, 134, 150, 200, 216, 123, 226, 69, 252, 169, 149, 66, 87, 52, 135, 226, 137, 242, 120, 203, 144, 228, 26, 181, 58, 152, 151, 194, 207, 55, 162, 126, 41, 184, 109, 173, 167, 142, 250, 205, 93, 182, 105, 138, 50, 20, 91, 125, 29, 167, 75, 29, 146, 18, 166, 172, 223, 231, 119, 145, 173, 249, 48, 247, 37, 133, 61, 40, 226, 184, 214, 184, 202, 72, 105, 131, 34, 29, 42, 124, 39, 7, 153, 169, 41, 206, 70, 76, 120, 203, 213, 137, 50, 199, 244, 16, 199, 85, 137, 233, 99, 116, 207, 22, 248, 172, 110, 62, 2, 9, 154, 49, 253, 154, 159, 52, 95, 223, 138, 4, 84, 15, 178, 94, 180, 190, 189, 32, 205, 219, 40, 252, 157, 88, 16, 24, 76, 62, 217, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 150, 152, 67, 23, 80, 197, 3, 214, 173, 48, 146, 197, 159, 131, 245, 239, 109, 67, 141, 171, 26, 170, 225, 238, 17, 240, 7, 118, 31, 128, 141, 62, 64, 132, 163, 242, 128, 85, 162, 85, 173, 151, 127, 68, 90, 126, 166, 35, 20, 160, 105, 137, 93, 71, 177, 228, 174, 40, 113, 105, 101, 154, 174, 58, 137, 55, 103, 32, 216, 17, 81, 76, 55, 205, 51, 246, 106, 255, 233, 113, 209, 163, 78, 5, 126, 193, 177, 2, 182, 114, 168, 59, 3, 141, 7, 173, 185, 198, 177, 198, 82, 55, 232, 135, 230, 217, 22, 77, 175, 50, 99, 142, 19, 191, 186, 1, 180, 74, 134, 150, 200, 216, 123, 226, 69, 252, 169, 149, 66, 87, 52, 135, 226, 137, 242, 120, 203, 144, 228, 26, 181, 58, 152, 151, 194, 207, 55, 162, 126, 41, 184, 109, 173, 167, 142, 250, 205, 93, 182, 105, 138, 50, 20, 91, 125, 29, 167, 75, 29, 146, 18, 166, 172, 223, 231, 119, 145, 173, 249, 48, 247, 37, 133, 61, 40, 226, 184, 214, 184, 202, 72, 105, 131, 34, 29, 42, 124, 39, 7, 153, 169, 41, 206, 70, 76, 120, 203, 213, 137, 50, 199, 244, 16, 199, 85, 137, 233, 99, 116, 207, 22, 248, 172, 110, 62, 2, 9, 154, 49, 253, 154, 159, 52, 95, 223, 138, 4, 84, 15, 178, 94, 180, 190, 189, 32, 205, 219, 40, 252, 157, 88, 16, 24, 76, 62, 217, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [39, 67, 216, 246, 105, 235, 89, 216, 192, 224, 246, 247, 245, 47, 112, 137, 249, 153, 80, 223, 21, 233, 102, 111, 198, 158, 97, 203, 183, 25, 213, 195, 111, 236, 9, 19, 78, 96, 161, 40, 206, 119, 92, 217, 13, 190, 25, 15, 6, 168, 7, 4, 249, 168, 216, 237, 64, 154, 70, 212, 214, 124, 133, 159, 57, 240, 178, 7, 72, 38, 212, 196, 142, 91, 74, 246, 181, 34, 139, 220, 212, 59, 10, 74, 151, 247, 97, 49, 209, 82, 114, 108, 4, 233, 199, 44, 35, 29, 170, 92, 48, 17, 95, 192, 11, 155, 72, 107, 249, 202, 248, 102, 5, 122, 14, 160, 74, 241, 70, 28, 115, 144, 228, 77, 53, 218, 11, 248, 37, 76, 76, 63, 16, 174, 217, 165, 212, 84, 30, 170, 207, 14, 233, 47, 127, 153, 250, 180, 218, 225, 47, 239, 165, 138, 88, 59, 251, 42, 227, 42, 200, 72, 63, 123, 131, 158, 109, 22, 236, 236, 56, 118, 164, 93, 217, 188, 109, 1, 208, 13, 51, 74, 10, 166, 98, 111, 162, 123, 183, 185, 170, 237, 141, 226, 231, 17, 103, 106, 75, 4, 1, 185, 99, 2, 235, 200, 159, 171, 253, 186, 119, 187, 116, 172, 189, 208, 165, 87, 56, 16, 100, 254, 168, 53, 131, 34, 58, 200, 111, 89, 210, 244, 185, 51, 89, 32, 201, 82, 122, 3, 250, 9, 61, 77, 68, 154, 27, 188, 200, 227, 237, 129, 19, 136, 78, 60],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x26a5c2c7ee0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [13674014417601754645, 7714712095918866626],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j3289856.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j3289856.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926815684, loc: nil},
NotAfter: {wall: 0, ext: 63942541084, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20],
AuthorityKeyId: [21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j3289856.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ba760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\",\n \"name\": \"37d8a3f3-8107-442c-8393-d0345952f91b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T17:20:34.024624942Z\",\n \"endTime\": \"2026-10-05T17:49:43.310425447Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-23-dtftt72rmq4p/cluster-candidate-4-23-8jw2cp should provision
Unexpected error:
<*fmt.wrapError | 0x26a5bc4e400>:
failed to create HCP cluster cluster-candidate-4-23-8jw2cp: failed waiting for cluster="cluster-candidate-4-23-8jw2cp" in resourcegroup="rg-candidate-4-23-dtftt72rmq4p" to finish creating: GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b",
"name": "37d8a3f3-8107-442c-8393-d0345952f91b",
"status": "Failed",
"startTime": "2026-10-05T17:20:34.024624942Z",
"endTime": "2026-10-05T17:49:43.310425447Z",
"error": {
"code": "DeadlineExceeded",
"message": "cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create HCP cluster cluster-candidate-4-23-8jw2cp: failed waiting for cluster=\"cluster-candidate-4-23-8jw2cp\" in resourcegroup=\"rg-candidate-4-23-dtftt72rmq4p\" to finish creating: GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\",\n \"name\": \"37d8a3f3-8107-442c-8393-d0345952f91b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T17:20:34.024624942Z\",\n \"endTime\": \"2026-10-05T17:49:43.310425447Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x26a5bc4e120>{
msg: "failed waiting for cluster=\"cluster-candidate-4-23-8jw2cp\" in resourcegroup=\"rg-candidate-4-23-dtftt72rmq4p\" to finish creating: GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\",\n \"name\": \"37d8a3f3-8107-442c-8393-d0345952f91b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T17:20:34.024624942Z\",\n \"endTime\": \"2026-10-05T17:49:43.310425447Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x26a5c6a2390>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"f46ca1e1-52f8-44e9-bb67-889cb17d0373",
],
"Date": [
"Mon, 05 Oct 2026 17:49:46 GMT",
],
"Content-Length": ["736"],
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x26a5bc4e000>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 51, 55, 100, 56, 97, 51, 102, 51, 45, 56, 49, 48, 55, 45, 52, 52, 50, 99, 45, 56, 51, 57, 51, 45, 100, 48, 51, 52, 53, 57, 53, 50, 102, 57, 49, 98, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 51, 55, 100, 56, 97, 51, 102, 51, 45, 56, 49, 48, 55, 45, 52, 52, 50, 99, 45, 56, 51, 57, 51, 45, 100, 48, 51, 52, 53, 57, 53, 50, 102, 57, 49, 98, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 50, 48, 58, 51, 52, 46, 48, 50, 52, 54, 50, 52, 57, 52, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 52, 57, 58, 52, 51, 46, 51, 49, 48, 52, 50, 53, 52, 52, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 99, 111, 110, 116, 114, 111, 108, 32, 112, 108, 97, 110, 101, 32, 118, 101, 114, 115, 105, 111, 110, 32, 110, 111, 116, 32, 121, 101, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 100, 58, 32, 118, 101, 114, 115, 105, 111, 110, 32, 52, 46, 50, 51, 46, 48, 45, 101, 99, 46, 49, 32, 105, 115, 32, 80, 97, 114, 116, 105, 97, 108, 32, 40, 119, 97, 110, 116, 32, 67, 111, 109, 112, 108, 101, 116, 101, 100, 41, 44, 32, 115, 116, 97, 114, 116, 101, 100, 32, 50, 52, 109, 50, 115, 32, 97, 103, 111, 59, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 100, 101, 103, 114, 97, 100, 101, 100, 58, 32, 85, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 82, 101, 112, 108, 105, 99, 97, 115, 58, 32, 114, 111, 117, 116, 101, 114, 32, 100, 101, 112, 108, 111, 121, 109, 101, 110, 116, 32, 104, 97, 115, 32, 49, 32, 117, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 32, 114, 101, 112, 108, 105, 99, 97, 115, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 736,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j3289856.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"fbcf69e0-8a48-4875-8e0c-6fab6efbd907",
],
"X-Ms-Client-Request-Id": [
"f2be8d2b-f66b-4625-9159-9d50d40c317a",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T17:49:46Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j3289856.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j3289856.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 107, 16, 41, 198, 229, 167, 64, 194, 189, 195, 219, 170, 46, 184, 246, 21, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 52, 56, 48, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 53, 56, 48, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 150, 152, 67, 23, 80, 197, 3, 214, 173, 48, 146, 197, 159, 131, 245, 239, 109, 67, 141, 171, 26, 170, 225, 238, 17, 240, 7, 118, 31, 128, 141, 62, 64, 132, 163, 242, 128, 85, 162, 85, 173, 151, 127, 68, 90, 126, 166, 35, 20, 160, 105, 137, 93, 71, 177, 228, 174, 40, 113, 105, 101, 154, 174, 58, 137, 55, 103, 32, 216, 17, 81, 76, 55, 205, 51, 246, 106, 255, 233, 113, 209, 163, 78, 5, 126, 193, 177, 2, 182, 114, 168, 59, 3, 141, 7, 173, 185, 198, 177, 198, 82, 55, 232, 135, 230, 217, 22, 77, 175, 50, 99, 142, 19, 191, 186, 1, 180, 74, 134, 150, 200, 216, 123, 226, 69, 252, 169, 149, 66, 87, 52, 135, 226, 137, 242, 120, 203, 144, 228, 26, 181, 58, 152, 151, 194, 207, 55, 162, 126, 41, 184, 109, 173, 167, 142, 250, 205, 93, 182, 105, 138, 50, 20, 91, 125, 29, 167, 75, 29, 146, 18, 166, 172, 223, 231, 119, 145, 173, 249, 48, 247, 37, 133, 61, 40, 226, 184, 214, 184, 202, 72, 105, 131, 34, 29, 42, 124, 39, 7, 153, 169, 41, 206, 70, 76, 120, 203, 213, 137, 50, 199, 244, 16, 199, 85, 137, 233, 99, 116, 207, 22, 248, 172, 110, 62, 2, 9, 154, 49, 253, 154, 159, 52, 95, 223, 138, 4, 84, 15, 178, 94, 180, 190, 189, 32, 205, 219, 40, 252, 157, 88, 16, 24, 76, 62, 217, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 39, 67, 216, 246, 105, 235, 89, 216, 192, 224, 246, 247, 245, 47, 112, 137, 249, 153, 80, 223, 21, 233, 102, 111, 198, 158, 97, 203, 183, 25, 213, 195, 111, 236, 9, 19, 78, 96, 161, 40, 206, 119, 92, 217, 13, 190, 25, 15, 6, 168, 7, 4, 249, 168, 216, 237, 64, 154, 70, 212, 214, 124, 133, 159, 57, 240, 178, 7, 72, 38, 212, 196, 142, 91, 74, 246, 181, 34, 139, 220, 212, 59, 10, 74, 151, 247, 97, 49, 209, 82, 114, 108, 4, 233, 199, 44, 35, 29, 170, 92, 48, 17, 95, 192, 11, 155, 72, 107, 249, 202, 248, 102, 5, 122, 14, 160, 74, 241, 70, 28, 115, 144, 228, 77, 53, 218, 11, 248, 37, 76, 76, 63, 16, 174, 217, 165, 212, 84, 30, 170, 207, 14, 233, 47, 127, 153, 250, 180, 218, 225, 47, 239, 165, 138, 88, 59, 251, 42, 227, 42, 200, 72, 63, 123, 131, 158, 109, 22, 236, 236, 56, 118, 164, 93, 217, 188, 109, 1, 208, 13, 51, 74, 10, 166, 98, 111, 162, 123, 183, 185, 170, 237, 141, 226, 231, 17, 103, 106, 75, 4, 1, 185, 99, 2, 235, 200, 159, 171, 253, 186, 119, 187, 116, 172, 189, 208, 165, 87, 56, 16, 100, 254, 168, 53, 131, 34, 58, 200, 111, 89, 210, 244, 185, 51, 89, 32, 201, 82, 122, 3, 250, 9, 61, 77, 68, 154, 27, 188, 200, 227, 237, 129, 19, 136, 78, 60],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 107, 16, 41, 198, 229, 167, 64, 194, 189, 195, 219, 170, 46, 184, 246, 21, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 52, 56, 48, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 53, 56, 48, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 150, 152, 67, 23, 80, 197, 3, 214, 173, 48, 146, 197, 159, 131, 245, 239, 109, 67, 141, 171, 26, 170, 225, 238, 17, 240, 7, 118, 31, 128, 141, 62, 64, 132, 163, 242, 128, 85, 162, 85, 173, 151, 127, 68, 90, 126, 166, 35, 20, 160, 105, 137, 93, 71, 177, 228, 174, 40, 113, 105, 101, 154, 174, 58, 137, 55, 103, 32, 216, 17, 81, 76, 55, 205, 51, 246, 106, 255, 233, 113, 209, 163, 78, 5, 126, 193, 177, 2, 182, 114, 168, 59, 3, 141, 7, 173, 185, 198, 177, 198, 82, 55, 232, 135, 230, 217, 22, 77, 175, 50, 99, 142, 19, 191, 186, 1, 180, 74, 134, 150, 200, 216, 123, 226, 69, 252, 169, 149, 66, 87, 52, 135, 226, 137, 242, 120, 203, 144, 228, 26, 181, 58, 152, 151, 194, 207, 55, 162, 126, 41, 184, 109, 173, 167, 142, 250, 205, 93, 182, 105, 138, 50, 20, 91, 125, 29, 167, 75, 29, 146, 18, 166, 172, 223, 231, 119, 145, 173, 249, 48, 247, 37, 133, 61, 40, 226, 184, 214, 184, 202, 72, 105, 131, 34, 29, 42, 124, 39, 7, 153, 169, 41, 206, 70, 76, 120, 203, 213, 137, 50, 199, 244, 16, 199, 85, 137, 233, 99, 116, 207, 22, 248, 172, 110, 62, 2, 9, 154, 49, 253, 154, 159, 52, 95, 223, 138, 4, 84, 15, 178, 94, 180, 190, 189, 32, 205, 219, 40, 252, 157, 88, 16, 24, 76, 62, 217, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 150, 152, 67, 23, 80, 197, 3, 214, 173, 48, 146, 197, 159, 131, 245, 239, 109, 67, 141, 171, 26, 170, 225, 238, 17, 240, 7, 118, 31, 128, 141, 62, 64, 132, 163, 242, 128, 85, 162, 85, 173, 151, 127, 68, 90, 126, 166, 35, 20, 160, 105, 137, 93, 71, 177, 228, 174, 40, 113, 105, 101, 154, 174, 58, 137, 55, 103, 32, 216, 17, 81, 76, 55, 205, 51, 246, 106, 255, 233, 113, 209, 163, 78, 5, 126, 193, 177, 2, 182, 114, 168, 59, 3, 141, 7, 173, 185, 198, 177, 198, 82, 55, 232, 135, 230, 217, 22, 77, 175, 50, 99, 142, 19, 191, 186, 1, 180, 74, 134, 150, 200, 216, 123, 226, 69, 252, 169, 149, 66, 87, 52, 135, 226, 137, 242, 120, 203, 144, 228, 26, 181, 58, 152, 151, 194, 207, 55, 162, 126, 41, 184, 109, 173, 167, 142, 250, 205, 93, 182, 105, 138, 50, 20, 91, 125, 29, 167, 75, 29, 146, 18, 166, 172, 223, 231, 119, 145, 173, 249, 48, 247, 37, 133, 61, 40, 226, 184, 214, 184, 202, 72, 105, 131, 34, 29, 42, 124, 39, 7, 153, 169, 41, 206, 70, 76, 120, 203, 213, 137, 50, 199, 244, 16, 199, 85, 137, 233, 99, 116, 207, 22, 248, 172, 110, 62, 2, 9, 154, 49, 253, 154, 159, 52, 95, 223, 138, 4, 84, 15, 178, 94, 180, 190, 189, 32, 205, 219, 40, 252, 157, 88, 16, 24, 76, 62, 217, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [39, 67, 216, 246, 105, 235, 89, 216, 192, 224, 246, 247, 245, 47, 112, 137, 249, 153, 80, 223, 21, 233, 102, 111, 198, 158, 97, 203, 183, 25, 213, 195, 111, 236, 9, 19, 78, 96, 161, 40, 206, 119, 92, 217, 13, 190, 25, 15, 6, 168, 7, 4, 249, 168, 216, 237, 64, 154, 70, 212, 214, 124, 133, 159, 57, 240, 178, 7, 72, 38, 212, 196, 142, 91, 74, 246, 181, 34, 139, 220, 212, 59, 10, 74, 151, 247, 97, 49, 209, 82, 114, 108, 4, 233, 199, 44, 35, 29, 170, 92, 48, 17, 95, 192, 11, 155, 72, 107, 249, 202, 248, 102, 5, 122, 14, 160, 74, 241, 70, 28, 115, 144, 228, 77, 53, 218, 11, 248, 37, 76, 76, 63, 16, 174, 217, 165, 212, 84, 30, 170, 207, 14, 233, 47, 127, 153, 250, 180, 218, 225, 47, 239, 165, 138, 88, 59, 251, 42, 227, 42, 200, 72, 63, 123, 131, 158, 109, 22, 236, 236, 56, 118, 164, 93, 217, 188, 109, 1, 208, 13, 51, 74, 10, 166, 98, 111, 162, 123, 183, 185, 170, 237, 141, 226, 231, 17, 103, 106, 75, 4, 1, 185, 99, 2, 235, 200, 159, 171, 253, 186, 119, 187, 116, 172, 189, 208, 165, 87, 56, 16, 100, 254, 168, 53, 131, 34, 58, 200, 111, 89, 210, 244, 185, 51, 89, 32, 201, 82, 122, 3, 250, 9, 61, 77, 68, 154, 27, 188, 200, 227, 237, 129, 19, 136, 78, 60],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x26a5c2c7ee0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [13674014417601754645, 7714712095918866626],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j3289856.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j3289856.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926815684, loc: nil},
NotAfter: {wall: 0, ext: 63942541084, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20],
AuthorityKeyId: [21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j3289856.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ba760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\",\n \"name\": \"37d8a3f3-8107-442c-8393-d0345952f91b\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T17:20:34.024624942Z\",\n \"endTime\": \"2026-10-05T17:49:43.310425447Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not existfull failure pattern: certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 3 days | e2e | 1 | 1.30%1 of 77 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 3 days | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 1 · Oct 2: 1 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:388]: Timed out after 600.008s.
Certificate should be issued by Let's Encrypt staging via ACME DNS-01
Expected success, but got an error:
<*errors.errorString | 0x3e07d72e7160>:
certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist
{
s: "certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist",
}
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:388]: Timed out after 600.008s.
Certificate should be issued by Let's Encrypt staging via ACME DNS-01
Expected success, but got an error:
<*errors.errorString | 0x3e07d72e7160>:
certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist
{
s: "certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist",
}Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: ResourceNotFound; detail message The resource 'locations/hcpOperationStatuses/<uuid>' under resource group '' was not found.; provider Microsoft.RedHatOpenShiftfull failure pattern: ERROR CODE: ResourceNotFound; detail message The resource 'locations/hcpOperationStatuses/<uuid>' under resource group '' was not found.; provider Microsoft.RedHatOpenShift Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 4 days | e2e | 1 | 1.30%1 of 77 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 4 days | Show trend detailsSep 29: 1 · Sep 30: 3 · Oct 1: 0 · Oct 2: 1 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:102]: failed to create node pool "np-1" for v20260901preview cluster "v20260901"
Unexpected error:
<*fmt.wrapError | 0x352e8fdfe6c0>:
failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "v20260901" in resourcegroup="v20260901preview-gqb58gqd8ldz" to finish creating: GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141
--------------------------------------------------------------------------------
RESPONSE 404: 404 Not Found
ERROR CODE: ResourceNotFound
--------------------------------------------------------------------------------
{
"error": {
"code": "ResourceNotFound",
"message": "The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed waiting for nodepool=\"np-1\" for cluster \"v20260901\" in resourcegroup=\"v20260901preview-gqb58gqd8ldz\" to finish creating: GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE: ResourceNotFound\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceNotFound\",\n \"message\": \"The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x352e8fdfe2a0>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"v20260901\" in resourcegroup=\"v20260901preview-gqb58gqd8ldz\" to finish creating: GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE: ResourceNotFound\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceNotFound\",\n \"message\": \"The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x352e919c0810>{
ErrorCode: "ResourceNotFound",
StatusCode: 404,
RawResponse: {
Status: "404 Not Found",
StatusCode: 404,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["9"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ResourceNotFound"],
"X-Ms-Request-Id": [
"bb64626a-f069-4e2c-9f9a-a7bf9903305e",
],
"Date": [
"Mon, 05 Oct 2026 19:38:08 GMT",
],
"Content-Length": ["394"],
},
Body: <*exported.nopClosingBytesReader | 0x352e8fdfe100>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 82, 101, 115, 111, 117, 114, 99, 101, 78, 111, 116, 70, 111, 117, 110, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 84, 104, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 39, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 98, 56, 102, 55, 101, 101, 100, 45, 98, 100, 101, 100, 45, 52, 57, 50, 99, 45, 97, 54, 55, 49, 45, 52, 102, 99, 56, 98, 56, 53, 50, 100, 49, 52, 49, 39, 32, 117, 110, 100, 101, 114, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 103, 114, 111, 117, 112, 32, 39, 39, 32, 119, 97, 115, 32, 110, 111, 116, 32, 102, 111, 117, 110, 100, 46, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 98, 56, 102, 55, 101, 101, 100, 45, 98, 100, 101, 100, 45, 52, 57, 50, 99, 45, 97, 54, 55, 49, 45, 52, 102, 99, 56, 98, 56, 53, 50, 100, 49, 52, 49, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 394,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j8278144.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141",
Fragment: "",
RawQuery: "api-version=2026-09-01-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"15a1cb22-1bff-47f2-bc22-751642c58b3b",
],
"X-Ms-Client-Request-Id": [
"00763265-c059-4a7d-84bf-5ebca7b78a65",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T19:38:08Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j8278144.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j8278144.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 63, 201, 82, 254, 216, 113, 77, 142, 179, 149, 53, 248, 85, 8, 13, 84, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 56, 51, 56, 53, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 52, 56, 53, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 200, 4, 205, 142, 135, 243, 51, 168, 224, 82, 218, 135, 233, 120, 73, 52, 115, 137, 71, 50, 129, 143, 132, 12, 8, 170, 212, 218, 88, 161, 133, 28, 60, 175, 112, 149, 174, 214, 160, 25, 58, 171, 8, 5, 16, 210, 213, 67, 241, 155, 47, 183, 42, 188, 3, 255, 82, 96, 248, 155, 20, 7, 216, 155, 201, 165, 232, 39, 72, 174, 187, 26, 89, 80, 170, 103, 240, 10, 37, 16, 242, 63, 0, 206, 91, 250, 71, 130, 22, 100, 137, 84, 184, 231, 95, 166, 196, 139, 210, 14, 215, 186, 145, 123, 36, 230, 96, 30, 177, 234, 248, 204, 112, 60, 148, 40, 102, 23, 150, 96, 23, 219, 57, 18, 106, 178, 144, 70, 196, 58, 231, 206, 140, 14, 92, 11, 201, 59, 54, 90, 41, 153, 17, 8, 252, 214, 120, 165, 243, 76, 22, 199, 184, 20, 75, 45, 173, 214, 34, 254, 107, 56, 21, 182, 217, 220, 234, 19, 159, 135, 49, 176, 197, 52, 75, 131, 244, 191, 220, 63, 70, 110, 14, 67, 154, 216, 119, 194, 87, 241, 122, 7, 250, 22, 189, 8, 116, 57, 58, 177, 144, 222, 37, 50, 190, 114, 7, 149, 56, 137, 200, 38, 186, 252, 185, 61, 151, 101, 84, 253, 20, 172, 131, 24, 245, 38, 48, 63, 26, 246, 8, 11, 72, 128, 29, 195, 103, 90, 135, 188, 60, 42, 48, 62, 234, 50, 105, 225, 116, 176, 46, 189, 121, 246, 228, 161, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 121, 172, 253, 212, 219, 183, 41, 188, 253, 172, 34, 131, 20, 157, 101, 53, 248, 120, 66, 61, 186, 66, 238, 90, 138, 92, 131, 79, 10, 243, 73, 52, 133, 220, 145, 236, 169, 9, 207, 1, 70, 25, 225, 73, 85, 75, 67, 75, 45, 224, 112, 148, 242, 71, 229, 156, 134, 230, 7, 121, 100, 119, 26, 2, 3, 234, 90, 98, 164, 196, 63, 27, 231, 232, 44, 47, 216, 188, 214, 85, 114, 116, 192, 5, 205, 146, 145, 241, 17, 164, 243, 235, 235, 249, 36, 28, 102, 60, 151, 212, 49, 249, 203, 13, 16, 133, 192, 0, 195, 183, 12, 115, 81, 13, 76, 255, 105, 128, 70, 199, 211, 73, 251, 91, 121, 88, 235, 113, 22, 92, 206, 240, 178, 226, 81, 191, 61, 157, 142, 244, 45, 95, 118, 102, 172, 215, 91, 167, 99, 194, 210, 242, 232, 60, 98, 206, 16, 181, 74, 69, 24, 217, 199, 81, 25, 202, 254, 83, 34, 190, 205, 16, 108, 82, 95, 122, 39, 110, 28, 5, 71, 91, 189, 224, 248, 163, 130, 233, 86, 213, 142, 89, 250, 234, 16, 220, 231, 117, 14, 81, 17, 234, 45, 34, 92, 240, 124, 73, 169, 193, 114, 100, 219, 42, 193, 141, 198, 213, 221, 215, 248, 233, 96, 208, 0, 244, 218, 253, 65, 32, 116, 109, 240, 192, 8, 233, 121, 191, 78, 100, 135, 253, 114, 62, 72, 38, 254, 185, 250, 81, 241, 140, 191, 167, 103, 136],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 63, 201, 82, 254, 216, 113, 77, 142, 179, 149, 53, 248, 85, 8, 13, 84, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 56, 51, 56, 53, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 52, 56, 53, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 200, 4, 205, 142, 135, 243, 51, 168, 224, 82, 218, 135, 233, 120, 73, 52, 115, 137, 71, 50, 129, 143, 132, 12, 8, 170, 212, 218, 88, 161, 133, 28, 60, 175, 112, 149, 174, 214, 160, 25, 58, 171, 8, 5, 16, 210, 213, 67, 241, 155, 47, 183, 42, 188, 3, 255, 82, 96, 248, 155, 20, 7, 216, 155, 201, 165, 232, 39, 72, 174, 187, 26, 89, 80, 170, 103, 240, 10, 37, 16, 242, 63, 0, 206, 91, 250, 71, 130, 22, 100, 137, 84, 184, 231, 95, 166, 196, 139, 210, 14, 215, 186, 145, 123, 36, 230, 96, 30, 177, 234, 248, 204, 112, 60, 148, 40, 102, 23, 150, 96, 23, 219, 57, 18, 106, 178, 144, 70, 196, 58, 231, 206, 140, 14, 92, 11, 201, 59, 54, 90, 41, 153, 17, 8, 252, 214, 120, 165, 243, 76, 22, 199, 184, 20, 75, 45, 173, 214, 34, 254, 107, 56, 21, 182, 217, 220, 234, 19, 159, 135, 49, 176, 197, 52, 75, 131, 244, 191, 220, 63, 70, 110, 14, 67, 154, 216, 119, 194, 87, 241, 122, 7, 250, 22, 189, 8, 116, 57, 58, 177, 144, 222, 37, 50, 190, 114, 7, 149, 56, 137, 200, 38, 186, 252, 185, 61, 151, 101, 84, 253, 20, 172, 131, 24, 245, 38, 48, 63, 26, 246, 8, 11, 72, 128, 29, 195, 103, 90, 135, 188, 60, 42, 48, 62, 234, 50, 105, 225, 116, 176, 46, 189, 121, 246, 228, 161, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 200, 4, 205, 142, 135, 243, 51, 168, 224, 82, 218, 135, 233, 120, 73, 52, 115, 137, 71, 50, 129, 143, 132, 12, 8, 170, 212, 218, 88, 161, 133, 28, 60, 175, 112, 149, 174, 214, 160, 25, 58, 171, 8, 5, 16, 210, 213, 67, 241, 155, 47, 183, 42, 188, 3, 255, 82, 96, 248, 155, 20, 7, 216, 155, 201, 165, 232, 39, 72, 174, 187, 26, 89, 80, 170, 103, 240, 10, 37, 16, 242, 63, 0, 206, 91, 250, 71, 130, 22, 100, 137, 84, 184, 231, 95, 166, 196, 139, 210, 14, 215, 186, 145, 123, 36, 230, 96, 30, 177, 234, 248, 204, 112, 60, 148, 40, 102, 23, 150, 96, 23, 219, 57, 18, 106, 178, 144, 70, 196, 58, 231, 206, 140, 14, 92, 11, 201, 59, 54, 90, 41, 153, 17, 8, 252, 214, 120, 165, 243, 76, 22, 199, 184, 20, 75, 45, 173, 214, 34, 254, 107, 56, 21, 182, 217, 220, 234, 19, 159, 135, 49, 176, 197, 52, 75, 131, 244, 191, 220, 63, 70, 110, 14, 67, 154, 216, 119, 194, 87, 241, 122, 7, 250, 22, 189, 8, 116, 57, 58, 177, 144, 222, 37, 50, 190, 114, 7, 149, 56, 137, 200, 38, 186, 252, 185, 61, 151, 101, 84, 253, 20, 172, 131, 24, 245, 38, 48, 63, 26, 246, 8, 11, 72, 128, 29, 195, 103, 90, 135, 188, 60, 42, 48, 62, 234, 50, 105, 225, 116, 176, 46, 189, 121, 246, 228, 161, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [121, 172, 253, 212, 219, 183, 41, 188, 253, 172, 34, 131, 20, 157, 101, 53, 248, 120, 66, 61, 186, 66, 238, 90, 138, 92, 131, 79, 10, 243, 73, 52, 133, 220, 145, 236, 169, 9, 207, 1, 70, 25, 225, 73, 85, 75, 67, 75, 45, 224, 112, 148, 242, 71, 229, 156, 134, 230, 7, 121, 100, 119, 26, 2, 3, 234, 90, 98, 164, 196, 63, 27, 231, 232, 44, 47, 216, 188, 214, 85, 114, 116, 192, 5, 205, 146, 145, 241, 17, 164, 243, 235, 235, 249, 36, 28, 102, 60, 151, 212, 49, 249, 203, 13, 16, 133, 192, 0, 195, 183, 12, 115, 81, 13, 76, 255, 105, 128, 70, 199, 211, 73, 251, 91, 121, 88, 235, 113, 22, 92, 206, 240, 178, 226, 81, 191, 61, 157, 142, 244, 45, 95, 118, 102, 172, 215, 91, 167, 99, 194, 210, 242, 232, 60, 98, 206, 16, 181, 74, 69, 24, 217, 199, 81, 25, 202, 254, 83, 34, 190, 205, 16, 108, 82, 95, 122, 39, 110, 28, 5, 71, 91, 189, 224, 248, 163, 130, 233, 86, 213, 142, 89, 250, 234, 16, 220, 231, 117, 14, 81, 17, 234, 45, 34, 92, 240, 124, 73, 169, 193, 114, 100, 219, 42, 193, 141, 198, 213, 221, 215, 248, 233, 96, 208, 0, 244, 218, 253, 65, 32, 116, 109, 240, 192, 8, 233, 121, 191, 78, 100, 135, 253, 114, 62, 72, 38, 254, 185, 250, 81, 241, 140, 191, 167, 103, 136],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x352e90a880e0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12940308445013740884, 4596296149214776718],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j8278144.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j8278144.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926822334, loc: nil},
NotAfter: {wall: 0, ext: 63942547734, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: "s\xfc?i_\xb0\xbe͙\xf5\x84d\x82(5\xf8\xa3\xa1'\xa4",
AuthorityKeyId: "s\xfc?i_\xb0\xbe͙\xf5\x84d\x82(5\xf8\xa3\xa1'\xa4",
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j8278144.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE: ResourceNotFound\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceNotFound\",\n \"message\": \"The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:102]: failed to create node pool "np-1" for v20260901preview cluster "v20260901"
Unexpected error:
<*fmt.wrapError | 0x352e8fdfe6c0>:
failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "v20260901" in resourcegroup="v20260901preview-gqb58gqd8ldz" to finish creating: GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141
--------------------------------------------------------------------------------
RESPONSE 404: 404 Not Found
ERROR CODE: ResourceNotFound
--------------------------------------------------------------------------------
{
"error": {
"code": "ResourceNotFound",
"message": "The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.",
"target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed waiting for nodepool=\"np-1\" for cluster \"v20260901\" in resourcegroup=\"v20260901preview-gqb58gqd8ldz\" to finish creating: GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE: ResourceNotFound\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceNotFound\",\n \"message\": \"The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x352e8fdfe2a0>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"v20260901\" in resourcegroup=\"v20260901preview-gqb58gqd8ldz\" to finish creating: GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE: ResourceNotFound\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceNotFound\",\n \"message\": \"The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x352e919c0810>{
ErrorCode: "ResourceNotFound",
StatusCode: 404,
RawResponse: {
Status: "404 Not Found",
StatusCode: 404,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["9"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Error-Code": ["ResourceNotFound"],
"X-Ms-Request-Id": [
"bb64626a-f069-4e2c-9f9a-a7bf9903305e",
],
"Date": [
"Mon, 05 Oct 2026 19:38:08 GMT",
],
"Content-Length": ["394"],
},
Body: <*exported.nopClosingBytesReader | 0x352e8fdfe100>{
s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 82, 101, 115, 111, 117, 114, 99, 101, 78, 111, 116, 70, 111, 117, 110, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 84, 104, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 39, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 98, 56, 102, 55, 101, 101, 100, 45, 98, 100, 101, 100, 45, 52, 57, 50, 99, 45, 97, 54, 55, 49, 45, 52, 102, 99, 56, 98, 56, 53, 50, 100, 49, 52, 49, 39, 32, 117, 110, 100, 101, 114, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 103, 114, 111, 117, 112, 32, 39, 39, 32, 119, 97, 115, 32, 110, 111, 116, 32, 102, 111, 117, 110, 100, 46, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 98, 56, 102, 55, 101, 101, 100, 45, 98, 100, 101, 100, 45, 52, 57, 50, 99, 45, 97, 54, 55, 49, 45, 52, 102, 99, 56, 98, 56, 53, 50, 100, 49, 52, 49, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 394,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j8278144.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141",
Fragment: "",
RawQuery: "api-version=2026-09-01-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"15a1cb22-1bff-47f2-bc22-751642c58b3b",
],
"X-Ms-Client-Request-Id": [
"00763265-c059-4a7d-84bf-5ebca7b78a65",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T19:38:08Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j8278144.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j8278144.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 63, 201, 82, 254, 216, 113, 77, 142, 179, 149, 53, 248, 85, 8, 13, 84, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 56, 51, 56, 53, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 52, 56, 53, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 200, 4, 205, 142, 135, 243, 51, 168, 224, 82, 218, 135, 233, 120, 73, 52, 115, 137, 71, 50, 129, 143, 132, 12, 8, 170, 212, 218, 88, 161, 133, 28, 60, 175, 112, 149, 174, 214, 160, 25, 58, 171, 8, 5, 16, 210, 213, 67, 241, 155, 47, 183, 42, 188, 3, 255, 82, 96, 248, 155, 20, 7, 216, 155, 201, 165, 232, 39, 72, 174, 187, 26, 89, 80, 170, 103, 240, 10, 37, 16, 242, 63, 0, 206, 91, 250, 71, 130, 22, 100, 137, 84, 184, 231, 95, 166, 196, 139, 210, 14, 215, 186, 145, 123, 36, 230, 96, 30, 177, 234, 248, 204, 112, 60, 148, 40, 102, 23, 150, 96, 23, 219, 57, 18, 106, 178, 144, 70, 196, 58, 231, 206, 140, 14, 92, 11, 201, 59, 54, 90, 41, 153, 17, 8, 252, 214, 120, 165, 243, 76, 22, 199, 184, 20, 75, 45, 173, 214, 34, 254, 107, 56, 21, 182, 217, 220, 234, 19, 159, 135, 49, 176, 197, 52, 75, 131, 244, 191, 220, 63, 70, 110, 14, 67, 154, 216, 119, 194, 87, 241, 122, 7, 250, 22, 189, 8, 116, 57, 58, 177, 144, 222, 37, 50, 190, 114, 7, 149, 56, 137, 200, 38, 186, 252, 185, 61, 151, 101, 84, 253, 20, 172, 131, 24, 245, 38, 48, 63, 26, 246, 8, 11, 72, 128, 29, 195, 103, 90, 135, 188, 60, 42, 48, 62, 234, 50, 105, 225, 116, 176, 46, 189, 121, 246, 228, 161, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 121, 172, 253, 212, 219, 183, 41, 188, 253, 172, 34, 131, 20, 157, 101, 53, 248, 120, 66, 61, 186, 66, 238, 90, 138, 92, 131, 79, 10, 243, 73, 52, 133, 220, 145, 236, 169, 9, 207, 1, 70, 25, 225, 73, 85, 75, 67, 75, 45, 224, 112, 148, 242, 71, 229, 156, 134, 230, 7, 121, 100, 119, 26, 2, 3, 234, 90, 98, 164, 196, 63, 27, 231, 232, 44, 47, 216, 188, 214, 85, 114, 116, 192, 5, 205, 146, 145, 241, 17, 164, 243, 235, 235, 249, 36, 28, 102, 60, 151, 212, 49, 249, 203, 13, 16, 133, 192, 0, 195, 183, 12, 115, 81, 13, 76, 255, 105, 128, 70, 199, 211, 73, 251, 91, 121, 88, 235, 113, 22, 92, 206, 240, 178, 226, 81, 191, 61, 157, 142, 244, 45, 95, 118, 102, 172, 215, 91, 167, 99, 194, 210, 242, 232, 60, 98, 206, 16, 181, 74, 69, 24, 217, 199, 81, 25, 202, 254, 83, 34, 190, 205, 16, 108, 82, 95, 122, 39, 110, 28, 5, 71, 91, 189, 224, 248, 163, 130, 233, 86, 213, 142, 89, 250, 234, 16, 220, 231, 117, 14, 81, 17, 234, 45, 34, 92, 240, 124, 73, 169, 193, 114, 100, 219, 42, 193, 141, 198, 213, 221, 215, 248, 233, 96, 208, 0, 244, 218, 253, 65, 32, 116, 109, 240, 192, 8, 233, 121, 191, 78, 100, 135, 253, 114, 62, 72, 38, 254, 185, 250, 81, 241, 140, 191, 167, 103, 136],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 63, 201, 82, 254, 216, 113, 77, 142, 179, 149, 53, 248, 85, 8, 13, 84, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 56, 51, 56, 53, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 52, 56, 53, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 200, 4, 205, 142, 135, 243, 51, 168, 224, 82, 218, 135, 233, 120, 73, 52, 115, 137, 71, 50, 129, 143, 132, 12, 8, 170, 212, 218, 88, 161, 133, 28, 60, 175, 112, 149, 174, 214, 160, 25, 58, 171, 8, 5, 16, 210, 213, 67, 241, 155, 47, 183, 42, 188, 3, 255, 82, 96, 248, 155, 20, 7, 216, 155, 201, 165, 232, 39, 72, 174, 187, 26, 89, 80, 170, 103, 240, 10, 37, 16, 242, 63, 0, 206, 91, 250, 71, 130, 22, 100, 137, 84, 184, 231, 95, 166, 196, 139, 210, 14, 215, 186, 145, 123, 36, 230, 96, 30, 177, 234, 248, 204, 112, 60, 148, 40, 102, 23, 150, 96, 23, 219, 57, 18, 106, 178, 144, 70, 196, 58, 231, 206, 140, 14, 92, 11, 201, 59, 54, 90, 41, 153, 17, 8, 252, 214, 120, 165, 243, 76, 22, 199, 184, 20, 75, 45, 173, 214, 34, 254, 107, 56, 21, 182, 217, 220, 234, 19, 159, 135, 49, 176, 197, 52, 75, 131, 244, 191, 220, 63, 70, 110, 14, 67, 154, 216, 119, 194, 87, 241, 122, 7, 250, 22, 189, 8, 116, 57, 58, 177, 144, 222, 37, 50, 190, 114, 7, 149, 56, 137, 200, 38, 186, 252, 185, 61, 151, 101, 84, 253, 20, 172, 131, 24, 245, 38, 48, 63, 26, 246, 8, 11, 72, 128, 29, 195, 103, 90, 135, 188, 60, 42, 48, 62, 234, 50, 105, 225, 116, 176, 46, 189, 121, 246, 228, 161, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 200, 4, 205, 142, 135, 243, 51, 168, 224, 82, 218, 135, 233, 120, 73, 52, 115, 137, 71, 50, 129, 143, 132, 12, 8, 170, 212, 218, 88, 161, 133, 28, 60, 175, 112, 149, 174, 214, 160, 25, 58, 171, 8, 5, 16, 210, 213, 67, 241, 155, 47, 183, 42, 188, 3, 255, 82, 96, 248, 155, 20, 7, 216, 155, 201, 165, 232, 39, 72, 174, 187, 26, 89, 80, 170, 103, 240, 10, 37, 16, 242, 63, 0, 206, 91, 250, 71, 130, 22, 100, 137, 84, 184, 231, 95, 166, 196, 139, 210, 14, 215, 186, 145, 123, 36, 230, 96, 30, 177, 234, 248, 204, 112, 60, 148, 40, 102, 23, 150, 96, 23, 219, 57, 18, 106, 178, 144, 70, 196, 58, 231, 206, 140, 14, 92, 11, 201, 59, 54, 90, 41, 153, 17, 8, 252, 214, 120, 165, 243, 76, 22, 199, 184, 20, 75, 45, 173, 214, 34, 254, 107, 56, 21, 182, 217, 220, 234, 19, 159, 135, 49, 176, 197, 52, 75, 131, 244, 191, 220, 63, 70, 110, 14, 67, 154, 216, 119, 194, 87, 241, 122, 7, 250, 22, 189, 8, 116, 57, 58, 177, 144, 222, 37, 50, 190, 114, 7, 149, 56, 137, 200, 38, 186, 252, 185, 61, 151, 101, 84, 253, 20, 172, 131, 24, 245, 38, 48, 63, 26, 246, 8, 11, 72, 128, 29, 195, 103, 90, 135, 188, 60, 42, 48, 62, 234, 50, 105, 225, 116, 176, 46, 189, 121, 246, 228, 161, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [121, 172, 253, 212, 219, 183, 41, 188, 253, 172, 34, 131, 20, 157, 101, 53, 248, 120, 66, 61, 186, 66, 238, 90, 138, 92, 131, 79, 10, 243, 73, 52, 133, 220, 145, 236, 169, 9, 207, 1, 70, 25, 225, 73, 85, 75, 67, 75, 45, 224, 112, 148, 242, 71, 229, 156, 134, 230, 7, 121, 100, 119, 26, 2, 3, 234, 90, 98, 164, 196, 63, 27, 231, 232, 44, 47, 216, 188, 214, 85, 114, 116, 192, 5, 205, 146, 145, 241, 17, 164, 243, 235, 235, 249, 36, 28, 102, 60, 151, 212, 49, 249, 203, 13, 16, 133, 192, 0, 195, 183, 12, 115, 81, 13, 76, 255, 105, 128, 70, 199, 211, 73, 251, 91, 121, 88, 235, 113, 22, 92, 206, 240, 178, 226, 81, 191, 61, 157, 142, 244, 45, 95, 118, 102, 172, 215, 91, 167, 99, 194, 210, 242, 232, 60, 98, 206, 16, 181, 74, 69, 24, 217, 199, 81, 25, 202, 254, 83, 34, 190, 205, 16, 108, 82, 95, 122, 39, 110, 28, 5, 71, 91, 189, 224, 248, 163, 130, 233, 86, 213, 142, 89, 250, 234, 16, 220, 231, 117, 14, 81, 17, 234, 45, 34, 92, 240, 124, 73, 169, 193, 114, 100, 219, 42, 193, 141, 198, 213, 221, 215, 248, 233, 96, 208, 0, 244, 218, 253, 65, 32, 116, 109, 240, 192, 8, 233, 121, 191, 78, 100, 135, 253, 114, 62, 72, 38, 254, 185, 250, 81, 241, 140, 191, 167, 103, 136],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x352e90a880e0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12940308445013740884, 4596296149214776718],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j8278144.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j8278144.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926822334, loc: nil},
NotAfter: {wall: 0, ext: 63942547734, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: "s\xfc?i_\xb0\xbe͙\xf5\x84d\x82(5\xf8\xa3\xa1'\xa4",
AuthorityKeyId: "s\xfc?i_\xb0\xbe͙\xf5\x84d\x82(5\xf8\xa3\xa1'\xa4",
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j8278144.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE: ResourceNotFound\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"ResourceNotFound\",\n \"message\": \"The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.\",\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
--------------------------------------------------------------------------------full failure pattern: -------------------------------------------------------------------------------- Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 3 days | e2e | 1 | 1.30%1 of 77 job runs affected | FlakeSignal: Flake — present in 3 prior week(s); spread across 3 days | Show trend detailsSep 29: 0 · Sep 30: 2 · Oct 1: 0 · Oct 2: 0 · Oct 3: 1 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:132]: nodepool creation errors: [failed to create NodePool np-update-NODES: failed waiting for nodepool="np-update-NODES" for cluster "np-update-nodes-hcp-cluster" in resourcegroup="nodepool-update-nodes-s2df9c9g5rnt" to finish creating: GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533",
"name": "804b1468-bc9d-4cd4-810e-085d36fab533",
"status": "Failed",
"startTime": "2026-10-05T17:20:24.835135873Z",
"endTime": "2026-10-05T17:39:28.597417139Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\n"
}
}
--------------------------------------------------------------------------------
]
Expected
<[]error | len:1, cap:1>: [
<*fmt.wrapError | 0x1274e3ba83a0>{
msg: "failed to create NodePool np-update-NODES: failed waiting for nodepool=\"np-update-NODES\" for cluster \"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-s2df9c9g5rnt\" to finish creating: GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\",\n \"name\": \"804b1468-bc9d-4cd4-810e-085d36fab533\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T17:20:24.835135873Z\",\n \"endTime\": \"2026-10-05T17:39:28.597417139Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1274e368e1e0>{
msg: "failed waiting for nodepool=\"np-update-NODES\" for cluster \"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-s2df9c9g5rnt\" to finish creating: GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\",\n \"name\": \"804b1468-bc9d-4cd4-810e-085d36fab533\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T17:20:24.835135873Z\",\n \"endTime\": \"2026-10-05T17:39:28.597417139Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x1274e49e2420>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["1461"],
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"899145d5-ec22-45c5-a22a-ffcdba0a2eda",
],
"Date": [
"Mon, 05 Oct 2026 17:39:34 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x1274e386c1a0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 56, 48, 52, 98, 49, 52, 54, 56, 45, 98, 99, 57, 100, 45, 52, 99, 100, 52, 45, 56, 49, 48, 101, 45, 48, 56, 53, 100, 51, 54, 102, 97, 98, 53, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 56, 48, 52, 98, 49, 52, 54, 56, 45, 98, 99, 57, 100, 45, 52, 99, 100, 52, 45, 56, 49, 48, 101, 45, 48, 56, 53, 100, 51, 54, 102, 97, 98, 53, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 50, 48, 58, 50, 52, 46, 56, 51, 53, 49, 51, 53, 56, 55, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 51, 57, 58, 50, 56, 46, 53, 57, 55, 52, 49, 55, 49, 51, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 49, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 115, 50, 100, 102, 57, 99, 57, 103, 53, 114, 110, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 115, 50, 100, 102, 57, 99, 57, 103, 53, 114, 110, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1461,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j2198528.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"c75486c1-7a37-4aed-9c02-c6fa004ef9f8",
],
"X-Ms-Client-Request-Id": [
"555b284c-ed81-4274-874b-02ed7482c7a6",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T17:39:34Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j2198528.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j2198528.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 32, 166, 247, 238, 189, 27, 78, 131, 164, 192, 1, 195, 147, 175, 134, 216, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 49, 52, 50, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 50, 52, 50, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 49, 252, 86, 114, 244, 124, 97, 104, 161, 52, 86, 109, 182, 148, 247, 136, 170, 164, 12, 238, 248, 127, 234, 250, 152, 19, 133, 248, 86, 157, 40, 139, 104, 199, 244, 114, 9, 66, 7, 65, 150, 30, 89, 249, 41, 188, 31, 218, 254, 96, 218, 108, 16, 7, 194, 102, 155, 44, 161, 192, 231, 91, 230, 123, 179, 185, 126, 226, 110, 217, 76, 91, 57, 41, 170, 95, 210, 161, 79, 197, 58, 234, 250, 171, 13, 55, 66, 46, 114, 29, 150, 223, 237, 40, 231, 31, 19, 84, 187, 102, 80, 234, 193, 68, 181, 222, 247, 95, 186, 175, 85, 53, 199, 209, 182, 235, 71, 233, 247, 249, 250, 182, 166, 40, 79, 25, 210, 248, 190, 51, 241, 29, 221, 65, 73, 43, 196, 5, 141, 69, 71, 20, 12, 120, 107, 215, 203, 28, 156, 180, 128, 78, 168, 15, 159, 255, 3, 108, 164, 197, 198, 80, 6, 181, 168, 32, 124, 227, 136, 63, 22, 7, 126, 71, 75, 0, 104, 46, 179, 207, 179, 186, 155, 152, 158, 239, 145, 145, 98, 141, 132, 172, 204, 112, 5, 125, 172, 184, 166, 235, 24, 217, 209, 74, 169, 43, 121, 80, 61, 93, 246, 234, 38, 231, 43, 51, 68, 225, 1, 216, 165, 87, 108, 2, 253, 80, 251, 172, 190, 119, 156, 176, 86, 137, 188, 128, 164, 190, 112, 9, 164, 244, 77, 172, 26, 113, 16, 99, 229, 78, 126, 64, 122, 228, 237, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 93, 155, 163, 243, 41, 219, 118, 101, 117, 161, 123, 18, 101, 41, 56, 126, 102, 90, 14, 183, 93, 230, 97, 200, 9, 76, 139, 241, 111, 250, 164, 150, 238, 236, 209, 195, 31, 241, 167, 252, 86, 22, 106, 173, 212, 139, 123, 27, 229, 179, 179, 201, 43, 36, 192, 68, 74, 92, 228, 192, 150, 224, 70, 141, 4, 228, 208, 87, 77, 86, 36, 248, 188, 252, 111, 114, 168, 210, 227, 127, 7, 24, 120, 238, 139, 122, 236, 240, 108, 196, 138, 185, 162, 87, 246, 167, 124, 111, 149, 108, 124, 189, 140, 203, 84, 115, 119, 163, 56, 221, 233, 198, 138, 116, 60, 59, 174, 119, 19, 77, 29, 137, 220, 10, 235, 240, 240, 46, 142, 122, 178, 89, 169, 87, 35, 8, 7, 208, 223, 137, 30, 135, 188, 14, 0, 249, 249, 74, 0, 81, 51, 81, 185, 193, 155, 35, 12, 79, 28, 72, 155, 35, 196, 252, 148, 205, 109, 41, 168, 122, 232, 91, 98, 51, 3, 202, 187, 88, 58, 114, 163, 114, 32, 142, 212, 81, 24, 206, 235, 176, 238, 40, 121, 170, 54, 85, 208, 6, 211, 32, 137, 156, 215, 29, 91, 254, 13, 161, 30, 90, 50, 95, 134, 148, 119, 91, 207, 94, 118, 93, 244, 147, 220, 185, 150, 143, 11, 133, 227, 208, 60, 198, 171, 4, 78, 255, 87, 143, 97, 128, 133, 125, 190, 3, 12, 148, 13, 236, 56, 138, 111, 84, 37, 183, 176, 192],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 32, 166, 247, 238, 189, 27, 78, 131, 164, 192, 1, 195, 147, 175, 134, 216, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 49, 52, 50, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 50, 52, 50, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 49, 252, 86, 114, 244, 124, 97, 104, 161, 52, 86, 109, 182, 148, 247, 136, 170, 164, 12, 238, 248, 127, 234, 250, 152, 19, 133, 248, 86, 157, 40, 139, 104, 199, 244, 114, 9, 66, 7, 65, 150, 30, 89, 249, 41, 188, 31, 218, 254, 96, 218, 108, 16, 7, 194, 102, 155, 44, 161, 192, 231, 91, 230, 123, 179, 185, 126, 226, 110, 217, 76, 91, 57, 41, 170, 95, 210, 161, 79, 197, 58, 234, 250, 171, 13, 55, 66, 46, 114, 29, 150, 223, 237, 40, 231, 31, 19, 84, 187, 102, 80, 234, 193, 68, 181, 222, 247, 95, 186, 175, 85, 53, 199, 209, 182, 235, 71, 233, 247, 249, 250, 182, 166, 40, 79, 25, 210, 248, 190, 51, 241, 29, 221, 65, 73, 43, 196, 5, 141, 69, 71, 20, 12, 120, 107, 215, 203, 28, 156, 180, 128, 78, 168, 15, 159, 255, 3, 108, 164, 197, 198, 80, 6, 181, 168, 32, 124, 227, 136, 63, 22, 7, 126, 71, 75, 0, 104, 46, 179, 207, 179, 186, 155, 152, 158, 239, 145, 145, 98, 141, 132, 172, 204, 112, 5, 125, 172, 184, 166, 235, 24, 217, 209, 74, 169, 43, 121, 80, 61, 93, 246, 234, 38, 231, 43, 51, 68, 225, 1, 216, 165, 87, 108, 2, 253, 80, 251, 172, 190, 119, 156, 176, 86, 137, 188, 128, 164, 190, 112, 9, 164, 244, 77, 172, 26, 113, 16, 99, 229, 78, 126, 64, 122, 228, 237, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 49, 252, 86, 114, 244, 124, 97, 104, 161, 52, 86, 109, 182, 148, 247, 136, 170, 164, 12, 238, 248, 127, 234, 250, 152, 19, 133, 248, 86, 157, 40, 139, 104, 199, 244, 114, 9, 66, 7, 65, 150, 30, 89, 249, 41, 188, 31, 218, 254, 96, 218, 108, 16, 7, 194, 102, 155, 44, 161, 192, 231, 91, 230, 123, 179, 185, 126, 226, 110, 217, 76, 91, 57, 41, 170, 95, 210, 161, 79, 197, 58, 234, 250, 171, 13, 55, 66, 46, 114, 29, 150, 223, 237, 40, 231, 31, 19, 84, 187, 102, 80, 234, 193, 68, 181, 222, 247, 95, 186, 175, 85, 53, 199, 209, 182, 235, 71, 233, 247, 249, 250, 182, 166, 40, 79, 25, 210, 248, 190, 51, 241, 29, 221, 65, 73, 43, 196, 5, 141, 69, 71, 20, 12, 120, 107, 215, 203, 28, 156, 180, 128, 78, 168, 15, 159, 255, 3, 108, 164, 197, 198, 80, 6, 181, 168, 32, 124, 227, 136, 63, 22, 7, 126, 71, 75, 0, 104, 46, 179, 207, 179, 186, 155, 152, 158, 239, 145, 145, 98, 141, 132, 172, 204, 112, 5, 125, 172, 184, 166, 235, 24, 217, 209, 74, 169, 43, 121, 80, 61, 93, 246, 234, 38, 231, 43, 51, 68, 225, 1, 216, 165, 87, 108, 2, 253, 80, 251, 172, 190, 119, 156, 176, 86, 137, 188, 128, 164, 190, 112, 9, 164, 244, 77, 172, 26, 113, 16, 99, 229, 78, 126, 64, 122, 228, 237, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [93, 155, 163, 243, 41, 219, 118, 101, 117, 161, 123, 18, 101, 41, 56, 126, 102, 90, 14, 183, 93, 230, 97, 200, 9, 76, 139, 241, 111, 250, 164, 150, 238, 236, 209, 195, 31, 241, 167, 252, 86, 22, 106, 173, 212, 139, 123, 27, 229, 179, 179, 201, 43, 36, 192, 68, 74, 92, 228, 192, 150, 224, 70, 141, 4, 228, 208, 87, 77, 86, 36, 248, 188, 252, 111, 114, 168, 210, 227, 127, 7, 24, 120, 238, 139, 122, 236, 240, 108, 196, 138, 185, 162, 87, 246, 167, 124, 111, 149, 108, 124, 189, 140, 203, 84, 115, 119, 163, 56, 221, 233, 198, 138, 116, 60, 59, 174, 119, 19, 77, 29, 137, 220, 10, 235, 240, 240, 46, 142, 122, 178, 89, 169, 87, 35, 8, 7, 208, 223, 137, 30, 135, 188, 14, 0, 249, 249, 74, 0, 81, 51, 81, 185, 193, 155, 35, 12, 79, 28, 72, 155, 35, 196, 252, 148, 205, 109, 41, 168, 122, 232, 91, 98, 51, 3, 202, 187, 88, 58, 114, 163, 114, 32, 142, 212, 81, 24, 206, 235, 176, 238, 40, 121, 170, 54, 85, 208, 6, 211, 32, 137, 156, 215, 29, 91, 254, 13, 161, 30, 90, 50, 95, 134, 148, 119, 91, 207, 94, 118, 93, 244, 147, 220, 185, 150, 143, 11, 133, 227, 208, 60, 198, 171, 4, 78, 255, 87, 143, 97, 128, 133, 125, 190, 3, 12, 148, 13, 236, 56, 138, 111, 84, 37, 183, 176, 192],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x1274e2e36730>{
N: {neg: ..., abs: ...},
E: 65537,
},
Version: 3,
SerialNumber: {neg: false, abs: [..., ...]},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j2198528.hcpsvc.osadev.cloud",
Names: [...],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j2198528.hcpsvc.osadev.cloud",
Names: [...],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926813667, loc: nil},
NotAfter: {wall: 0, ext: 63942539067, loc: nil},
KeyUsage: 5,
Extensions: [
{Id: ..., Critical: ..., Value: ...},
{Id: ..., Critical: ..., Value: ...},
{Id: ..., Critical: ..., Value: ...},
{Id: ..., Critical: ..., Value: ...},
{Id: ..., Critical: ..., Value: ...},
{Id: ..., Critical: ..., Value: ...},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231],
AuthorityKeyId: [227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j2198528.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x5733c20,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\",\n \"name\": \"804b1468-bc9d-4cd4-810e-085d36fab533\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T17:20:24.835135873Z\",\n \"endTime\": \"2026-10-05T17:39:28.597417139Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
]
to be empty
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:132]: nodepool creation errors: [failed to create NodePool np-update-NODES: failed waiting for nodepool="np-update-NODES" for cluster "np-update-nodes-hcp-cluster" in resourcegroup="nodepool-update-nodes-s2df9c9g5rnt" to finish creating: GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533",
"name": "804b1468-bc9d-4cd4-810e-085d36fab533",
"status": "Failed",
"startTime": "2026-10-05T17:20:24.835135873Z",
"endTime": "2026-10-05T17:39:28.597417139Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\n"
}
}
--------------------------------------------------------------------------------
]
Expected
<[]error | len:1, cap:1>: [
<*fmt.wrapError | 0x1274e3ba83a0>{
msg: "failed to create NodePool np-update-NODES: failed waiting for nodepool=\"np-update-NODES\" for cluster \"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-s2df9c9g5rnt\" to finish creating: GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\",\n \"name\": \"804b1468-bc9d-4cd4-810e-085d36fab533\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T17:20:24.835135873Z\",\n \"endTime\": \"2026-10-05T17:39:28.597417139Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1274e368e1e0>{
msg: "failed waiting for nodepool=\"np-update-NODES\" for cluster \"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-s2df9c9g5rnt\" to finish creating: GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\",\n \"name\": \"804b1468-bc9d-4cd4-810e-085d36fab533\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T17:20:24.835135873Z\",\n \"endTime\": \"2026-10-05T17:39:28.597417139Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x1274e49e2420>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": ["1461"],
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"899145d5-ec22-45c5-a22a-ffcdba0a2eda",
],
"Date": [
"Mon, 05 Oct 2026 17:39:34 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x1274e386c1a0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 56, 48, 52, 98, 49, 52, 54, 56, 45, 98, 99, 57, 100, 45, 52, 99, 100, 52, 45, 56, 49, 48, 101, 45, 48, 56, 53, 100, 51, 54, 102, 97, 98, 53, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 56, 48, 52, 98, 49, 52, 54, 56, 45, 98, 99, 57, 100, 45, 52, 99, 100, 52, 45, 56, 49, 48, 101, 45, 48, 56, 53, 100, 51, 54, 102, 97, 98, 53, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 50, 48, 58, 50, 52, 46, 56, 51, 53, 49, 51, 53, 56, 55, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 51, 57, 58, 50, 56, 46, 53, 57, 55, 52, 49, 55, 49, 51, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 49, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 115, 50, 100, 102, 57, 99, 57, 103, 53, 114, 110, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 115, 50, 100, 102, 57, 99, 57, 103, 53, 114, 110, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1461,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j2198528.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"c75486c1-7a37-4aed-9c02-c6fa004ef9f8",
],
"X-Ms-Client-Request-Id": [
"555b284c-ed81-4274-874b-02ed7482c7a6",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T17:39:34Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j2198528.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j2198528.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 32, 166, 247, 238, 189, 27, 78, 131, 164, 192, 1, 195, 147, 175, 134, 216, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 49, 52, 50, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 50, 52, 50, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 49, 252, 86, 114, 244, 124, 97, 104, 161, 52, 86, 109, 182, 148, 247, 136, 170, 164, 12, 238, 248, 127, 234, 250, 152, 19, 133, 248, 86, 157, 40, 139, 104, 199, 244, 114, 9, 66, 7, 65, 150, 30, 89, 249, 41, 188, 31, 218, 254, 96, 218, 108, 16, 7, 194, 102, 155, 44, 161, 192, 231, 91, 230, 123, 179, 185, 126, 226, 110, 217, 76, 91, 57, 41, 170, 95, 210, 161, 79, 197, 58, 234, 250, 171, 13, 55, 66, 46, 114, 29, 150, 223, 237, 40, 231, 31, 19, 84, 187, 102, 80, 234, 193, 68, 181, 222, 247, 95, 186, 175, 85, 53, 199, 209, 182, 235, 71, 233, 247, 249, 250, 182, 166, 40, 79, 25, 210, 248, 190, 51, 241, 29, 221, 65, 73, 43, 196, 5, 141, 69, 71, 20, 12, 120, 107, 215, 203, 28, 156, 180, 128, 78, 168, 15, 159, 255, 3, 108, 164, 197, 198, 80, 6, 181, 168, 32, 124, 227, 136, 63, 22, 7, 126, 71, 75, 0, 104, 46, 179, 207, 179, 186, 155, 152, 158, 239, 145, 145, 98, 141, 132, 172, 204, 112, 5, 125, 172, 184, 166, 235, 24, 217, 209, 74, 169, 43, 121, 80, 61, 93, 246, 234, 38, 231, 43, 51, 68, 225, 1, 216, 165, 87, 108, 2, 253, 80, 251, 172, 190, 119, 156, 176, 86, 137, 188, 128, 164, 190, 112, 9, 164, 244, 77, 172, 26, 113, 16, 99, 229, 78, 126, 64, 122, 228, 237, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 93, 155, 163, 243, 41, 219, 118, 101, 117, 161, 123, 18, 101, 41, 56, 126, 102, 90, 14, 183, 93, 230, 97, 200, 9, 76, 139, 241, 111, 250, 164, 150, 238, 236, 209, 195, 31, 241, 167, 252, 86, 22, 106, 173, 212, 139, 123, 27, 229, 179, 179, 201, 43, 36, 192, 68, 74, 92, 228, 192, 150, 224, 70, 141, 4, 228, 208, 87, 77, 86, 36, 248, 188, 252, 111, 114, 168, 210, 227, 127, 7, 24, 120, 238, 139, 122, 236, 240, 108, 196, 138, 185, 162, 87, 246, 167, 124, 111, 149, 108, 124, 189, 140, 203, 84, 115, 119, 163, 56, 221, 233, 198, 138, 116, 60, 59, 174, 119, 19, 77, 29, 137, 220, 10, 235, 240, 240, 46, 142, 122, 178, 89, 169, 87, 35, 8, 7, 208, 223, 137, 30, 135, 188, 14, 0, 249, 249, 74, 0, 81, 51, 81, 185, 193, 155, 35, 12, 79, 28, 72, 155, 35, 196, 252, 148, 205, 109, 41, 168, 122, 232, 91, 98, 51, 3, 202, 187, 88, 58, 114, 163, 114, 32, 142, 212, 81, 24, 206, 235, 176, 238, 40, 121, 170, 54, 85, 208, 6, 211, 32, 137, 156, 215, 29, 91, 254, 13, 161, 30, 90, 50, 95, 134, 148, 119, 91, 207, 94, 118, 93, 244, 147, 220, 185, 150, 143, 11, 133, 227, 208, 60, 198, 171, 4, 78, 255, 87, 143, 97, 128, 133, 125, 190, 3, 12, 148, 13, 236, 56, 138, 111, 84, 37, 183, 176, 192],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 32, 166, 247, 238, 189, 27, 78, 131, 164, 192, 1, 195, 147, 175, 134, 216, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 49, 52, 50, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 50, 52, 50, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 49, 252, 86, 114, 244, 124, 97, 104, 161, 52, 86, 109, 182, 148, 247, 136, 170, 164, 12, 238, 248, 127, 234, 250, 152, 19, 133, 248, 86, 157, 40, 139, 104, 199, 244, 114, 9, 66, 7, 65, 150, 30, 89, 249, 41, 188, 31, 218, 254, 96, 218, 108, 16, 7, 194, 102, 155, 44, 161, 192, 231, 91, 230, 123, 179, 185, 126, 226, 110, 217, 76, 91, 57, 41, 170, 95, 210, 161, 79, 197, 58, 234, 250, 171, 13, 55, 66, 46, 114, 29, 150, 223, 237, 40, 231, 31, 19, 84, 187, 102, 80, 234, 193, 68, 181, 222, 247, 95, 186, 175, 85, 53, 199, 209, 182, 235, 71, 233, 247, 249, 250, 182, 166, 40, 79, 25, 210, 248, 190, 51, 241, 29, 221, 65, 73, 43, 196, 5, 141, 69, 71, 20, 12, 120, 107, 215, 203, 28, 156, 180, 128, 78, 168, 15, 159, 255, 3, 108, 164, 197, 198, 80, 6, 181, 168, 32, 124, 227, 136, 63, 22, 7, 126, 71, 75, 0, 104, 46, 179, 207, 179, 186, 155, 152, 158, 239, 145, 145, 98, 141, 132, 172, 204, 112, 5, 125, 172, 184, 166, 235, 24, 217, 209, 74, 169, 43, 121, 80, 61, 93, 246, 234, 38, 231, 43, 51, 68, 225, 1, 216, 165, 87, 108, 2, 253, 80, 251, 172, 190, 119, 156, 176, 86, 137, 188, 128, 164, 190, 112, 9, 164, 244, 77, 172, 26, 113, 16, 99, 229, 78, 126, 64, 122, 228, 237, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 49, 252, 86, 114, 244, 124, 97, 104, 161, 52, 86, 109, 182, 148, 247, 136, 170, 164, 12, 238, 248, 127, 234, 250, 152, 19, 133, 248, 86, 157, 40, 139, 104, 199, 244, 114, 9, 66, 7, 65, 150, 30, 89, 249, 41, 188, 31, 218, 254, 96, 218, 108, 16, 7, 194, 102, 155, 44, 161, 192, 231, 91, 230, 123, 179, 185, 126, 226, 110, 217, 76, 91, 57, 41, 170, 95, 210, 161, 79, 197, 58, 234, 250, 171, 13, 55, 66, 46, 114, 29, 150, 223, 237, 40, 231, 31, 19, 84, 187, 102, 80, 234, 193, 68, 181, 222, 247, 95, 186, 175, 85, 53, 199, 209, 182, 235, 71, 233, 247, 249, 250, 182, 166, 40, 79, 25, 210, 248, 190, 51, 241, 29, 221, 65, 73, 43, 196, 5, 141, 69, 71, 20, 12, 120, 107, 215, 203, 28, 156, 180, 128, 78, 168, 15, 159, 255, 3, 108, 164, 197, 198, 80, 6, 181, 168, 32, 124, 227, 136, 63, 22, 7, 126, 71, 75, 0, 104, 46, 179, 207, 179, 186, 155, 152, 158, 239, 145, 145, 98, 141, 132, 172, 204, 112, 5, 125, 172, 184, 166, 235, 24, 217, 209, 74, 169, 43, 121, 80, 61, 93, 246, 234, 38, 231, 43, 51, 68, 225, 1, 216, 165, 87, 108, 2, 253, 80, 251, 172, 190, 119, 156, 176, 86, 137, 188, 128, 164, 190, 112, 9, 164, 244, 77, 172, 26, 113, 16, 99, 229, 78, 126, 64, 122, 228, 237, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [93, 155, 163, 243, 41, 219, 118, 101, 117, 161, 123, 18, 101, 41, 56, 126, 102, 90, 14, 183, 93, 230, 97, 200, 9, 76, 139, 241, 111, 250, 164, 150, 238, 236, 209, 195, 31, 241, 167, 252, 86, 22, 106, 173, 212, 139, 123, 27, 229, 179, 179, 201, 43, 36, 192, 68, 74, 92, 228, 192, 150, 224, 70, 141, 4, 228, 208, 87, 77, 86, 36, 248, 188, 252, 111, 114, 168, 210, 227, 127, 7, 24, 120, 238, 139, 122, 236, 240, 108, 196, 138, 185, 162, 87, 246, 167, 124, 111, 149, 108, 124, 189, 140, 203, 84, 115, 119, 163, 56, 221, 233, 198, 138, 116, 60, 59, 174, 119, 19, 77, 29, 137, 220, 10, 235, 240, 240, 46, 142, 122, 178, 89, 169, 87, 35, 8, 7, 208, 223, 137, 30, 135, 188, 14, 0, 249, 249, 74, 0, 81, 51, 81, 185, 193, 155, 35, 12, 79, 28, 72, 155, 35, 196, 252, 148, 205, 109, 41, 168, 122, 232, 91, 98, 51, 3, 202, 187, 88, 58, 114, 163, 114, 32, 142, 212, 81, 24, 206, 235, 176, 238, 40, 121, 170, 54, 85, 208, 6, 211, 32, 137, 156, 215, 29, 91, 254, 13, 161, 30, 90, 50, 95, 134, 148, 119, 91, 207, 94, 118, 93, 244, 147, 220, 185, 150, 143, 11, 133, 227, 208, 60, 198, 171, 4, 78, 255, 87, 143, 97, 128, 133, 125, 190, 3, 12, 148, 13, 236, 56, 138, 111, 84, 37, 183, 176, 192],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x1274e2e36730>{
N: {neg: ..., abs: ...},
E: 65537,
},
Version: 3,
SerialNumber: {neg: false, abs: [..., ...]},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j2198528.hcpsvc.osadev.cloud",
Names: [...],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j2198528.hcpsvc.osadev.cloud",
Names: [...],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926813667, loc: nil},
NotAfter: {wall: 0, ext: 63942539067, loc: nil},
KeyUsage: 5,
Extensions: [
{Id: ..., Critical: ..., Value: ...},
{Id: ..., Critical: ..., Value: ...},
{Id: ..., Critical: ..., Value: ...},
{Id: ..., Critical: ..., Value: ...},
{Id: ..., Critical: ..., Value: ...},
{Id: ..., Critical: ..., Value: ...},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231],
AuthorityKeyId: [227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j2198528.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x5733c20,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\",\n \"name\": \"804b1468-bc9d-4cd4-810e-085d36fab533\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T17:20:24.835135873Z\",\n \"endTime\": \"2026-10-05T17:39:28.597417139Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
]
to be emptyContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to create nodepool <nodepool>: failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: GET <url>full failure pattern: failed to create nodepool <nodepool>: failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: GET <url> Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 1 day(s) | e2e | 34 | 44.16%34 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 1 day(s) | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 34 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
<*fmt.wrapError | 0x325fd7944b20>:
failed to create NodePool np-deletable: failed waiting for nodepool="np-deletable" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-ng96cscd46kh" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723",
"name": "e2da8575-58f4-46e6-afe9-f8b19daec723",
"status": "Failed",
"startTime": "2026-10-06T00:31:19.626547026Z",
"endTime": "2026-10-06T00:50:21.291382978Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-deletable: failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-ng96cscd46kh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\",\n \"name\": \"e2da8575-58f4-46e6-afe9-f8b19daec723\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:31:19.626547026Z\",\n \"endTime\": \"2026-10-06T00:50:21.291382978Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x325fd7944880>{
msg: "failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-ng96cscd46kh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\",\n \"name\": \"e2da8575-58f4-46e6-afe9-f8b19daec723\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:31:19.626547026Z\",\n \"endTime\": \"2026-10-06T00:50:21.291382978Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x325fd9614ea0>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"66aff4b8-5d1b-45a0-bb13-b10f02fc92a8",
],
"Date": [
"Tue, 06 Oct 2026 00:50:22 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x325fd7944780>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 101, 50, 100, 97, 56, 53, 55, 53, 45, 53, 56, 102, 52, 45, 52, 54, 101, 54, 45, 97, 102, 101, 57, 45, 102, 56, 98, 49, 57, 100, 97, 101, 99, 55, 50, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 101, 50, 100, 97, 56, 53, 55, 53, 45, 53, 56, 102, 52, 45, 52, 54, 101, 54, 45, 97, 102, 101, 57, 45, 102, 56, 98, 49, 57, 100, 97, 101, 99, 55, 50, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 49, 58, 49, 57, 46, 54, 50, 54, 53, 52, 55, 48, 50, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 53, 48, 58, 50, 49, 46, 50, 57, 49, 51, 56, 50, 57, 55, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723",
Fragment: "",
RawQuery: "api-version=2026-09-01-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"3af8787f-942d-41b9-a8d4-1ae5d4856cd8",
],
"X-Ms-Client-Request-Id": [
"65b76431-6c2c-4f8f-ab9e-3592dd03f034",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:50:22Z\"}",
],
"Authorization": ["redacted"],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x325fd86f0100>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12798357290586720628, 8480743146650813573],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926839811, loc: nil},
NotAfter: {wall: 0, ext: 63942565211, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j5947136.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\",\n \"name\": \"e2da8575-58f4-46e6-afe9-f8b19daec723\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:31:19.626547026Z\",\n \"endTime\": \"2026-10-06T00:50:21.291382978Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
<*fmt.wrapError | 0x325fd7944b20>:
failed to create NodePool np-deletable: failed waiting for nodepool="np-deletable" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-ng96cscd46kh" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723",
"name": "e2da8575-58f4-46e6-afe9-f8b19daec723",
"status": "Failed",
"startTime": "2026-10-06T00:31:19.626547026Z",
"endTime": "2026-10-06T00:50:21.291382978Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-deletable: failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-ng96cscd46kh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\",\n \"name\": \"e2da8575-58f4-46e6-afe9-f8b19daec723\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:31:19.626547026Z\",\n \"endTime\": \"2026-10-06T00:50:21.291382978Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x325fd7944880>{
msg: "failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-ng96cscd46kh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\",\n \"name\": \"e2da8575-58f4-46e6-afe9-f8b19daec723\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:31:19.626547026Z\",\n \"endTime\": \"2026-10-06T00:50:21.291382978Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x325fd9614ea0>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"66aff4b8-5d1b-45a0-bb13-b10f02fc92a8",
],
"Date": [
"Tue, 06 Oct 2026 00:50:22 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x325fd7944780>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 101, 50, 100, 97, 56, 53, 55, 53, 45, 53, 56, 102, 52, 45, 52, 54, 101, 54, 45, 97, 102, 101, 57, 45, 102, 56, 98, 49, 57, 100, 97, 101, 99, 55, 50, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 101, 50, 100, 97, 56, 53, 55, 53, 45, 53, 56, 102, 52, 45, 52, 54, 101, 54, 45, 97, 102, 101, 57, 45, 102, 56, 98, 49, 57, 100, 97, 101, 99, 55, 50, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 49, 58, 49, 57, 46, 54, 50, 54, 53, 52, 55, 48, 50, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 53, 48, 58, 50, 49, 46, 50, 57, 49, 51, 56, 50, 57, 55, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723",
Fragment: "",
RawQuery: "api-version=2026-09-01-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"3af8787f-942d-41b9-a8d4-1ae5d4856cd8",
],
"X-Ms-Client-Request-Id": [
"65b76431-6c2c-4f8f-ab9e-3592dd03f034",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:50:22Z\"}",
],
"Authorization": ["redacted"],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x325fd86f0100>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12798357290586720628, 8480743146650813573],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926839811, loc: nil},
NotAfter: {wall: 0, ext: 63942565211, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j5947136.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\",\n \"name\": \"e2da8575-58f4-46e6-afe9-f8b19daec723\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:31:19.626547026Z\",\n \"endTime\": \"2026-10-06T00:50:21.291382978Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
<*fmt.wrapError | 0xf77febeee80>:
failed to create NodePool np-deletable: failed waiting for nodepool="np-deletable" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-59nnck7b7ddj" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f",
"name": "9b8637f6-4e4e-4e11-adc5-52f9df281d6f",
"status": "Failed",
"startTime": "2026-10-06T00:42:41.848796269Z",
"endTime": "2026-10-06T01:01:47.364609011Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-deletable: failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-59nnck7b7ddj\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n \"name\": \"9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:42:41.848796269Z\",\n \"endTime\": \"2026-10-06T01:01:47.364609011Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xf77fe058740>{
msg: "failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-59nnck7b7ddj\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n \"name\": \"9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:42:41.848796269Z\",\n \"endTime\": \"2026-10-06T01:01:47.364609011Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xf7800502930>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"33221c57-5c0c-4abf-b7e6-98abf13efab6",
],
"Date": [
"Tue, 06 Oct 2026 01:01:55 GMT",
],
"Content-Length": ["1234"],
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0xf77fe058660>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 98, 56, 54, 51, 55, 102, 54, 45, 52, 101, 52, 101, 45, 52, 101, 49, 49, 45, 97, 100, 99, 53, 45, 53, 50, 102, 57, 100, 102, 50, 56, 49, 100, 54, 102, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 57, 98, 56, 54, 51, 55, 102, 54, 45, 52, 101, 52, 101, 45, 52, 101, 49, 49, 45, 97, 100, 99, 53, 45, 53, 50, 102, 57, 100, 102, 50, 56, 49, 100, 54, 102, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 52, 49, 46, 56, 52, 56, 55, 57, 54, 50, 54, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 49, 58, 52, 55, 46, 51, 54, 52, 54, 48, 57, 48, 49, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 103, 106, 113, 104, 108, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 110, 108, 107, 52, 98, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 103, 106, 113, 104, 108, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 110, 108, 107, 52, 98, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1234,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f",
Fragment: "",
RawQuery: "api-version=2026-09-01-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"487730a8-1aeb-4abb-8a9a-e21aaec92b9a",
],
"X-Ms-Client-Request-Id": [
"e8cf4544-9e1a-413a-ac74-ce09ca9fb545",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:01:55Z\"}",
],
"Authorization": ["redacted"],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0xf77fe8e06f0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [13759147031339684878, 7869995520253709034],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926840305, loc: nil},
NotAfter: {wall: 0, ext: 63942565705, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
AuthorityKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j0653312.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n \"name\": \"9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:42:41.848796269Z\",\n \"endTime\": \"2026-10-06T01:01:47.364609011Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
<*fmt.wrapError | 0xf77febeee80>:
failed to create NodePool np-deletable: failed waiting for nodepool="np-deletable" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-59nnck7b7ddj" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f",
"name": "9b8637f6-4e4e-4e11-adc5-52f9df281d6f",
"status": "Failed",
"startTime": "2026-10-06T00:42:41.848796269Z",
"endTime": "2026-10-06T01:01:47.364609011Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-deletable: failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-59nnck7b7ddj\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n \"name\": \"9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:42:41.848796269Z\",\n \"endTime\": \"2026-10-06T01:01:47.364609011Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xf77fe058740>{
msg: "failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-59nnck7b7ddj\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n \"name\": \"9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:42:41.848796269Z\",\n \"endTime\": \"2026-10-06T01:01:47.364609011Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xf7800502930>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"33221c57-5c0c-4abf-b7e6-98abf13efab6",
],
"Date": [
"Tue, 06 Oct 2026 01:01:55 GMT",
],
"Content-Length": ["1234"],
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0xf77fe058660>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 98, 56, 54, 51, 55, 102, 54, 45, 52, 101, 52, 101, 45, 52, 101, 49, 49, 45, 97, 100, 99, 53, 45, 53, 50, 102, 57, 100, 102, 50, 56, 49, 100, 54, 102, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 57, 98, 56, 54, 51, 55, 102, 54, 45, 52, 101, 52, 101, 45, 52, 101, 49, 49, 45, 97, 100, 99, 53, 45, 53, 50, 102, 57, 100, 102, 50, 56, 49, 100, 54, 102, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 52, 49, 46, 56, 52, 56, 55, 57, 54, 50, 54, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 49, 58, 52, 55, 46, 51, 54, 52, 54, 48, 57, 48, 49, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 103, 106, 113, 104, 108, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 110, 108, 107, 52, 98, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 103, 106, 113, 104, 108, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 110, 108, 107, 52, 98, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1234,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f",
Fragment: "",
RawQuery: "api-version=2026-09-01-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"487730a8-1aeb-4abb-8a9a-e21aaec92b9a",
],
"X-Ms-Client-Request-Id": [
"e8cf4544-9e1a-413a-ac74-ce09ca9fb545",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:01:55Z\"}",
],
"Authorization": ["redacted"],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0xf77fe8e06f0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [13759147031339684878, 7869995520253709034],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926840305, loc: nil},
NotAfter: {wall: 0, ext: 63942565705, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
AuthorityKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j0653312.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n \"name\": \"9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:42:41.848796269Z\",\n \"endTime\": \"2026-10-06T01:01:47.364609011Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
<*fmt.wrapError | 0x3b8837030ea0>:
failed to create NodePool np-delete-main: failed waiting for nodepool="np-delete-main" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-qn7rxq8vsgwr" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506",
"name": "981cb8df-9c35-4549-a20c-83287e603506",
"status": "Failed",
"startTime": "2026-10-06T00:37:58.264221134Z",
"endTime": "2026-10-06T00:57:04.189335399Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-delete-main: failed waiting for nodepool=\"np-delete-main\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-qn7rxq8vsgwr\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\",\n \"name\": \"981cb8df-9c35-4549-a20c-83287e603506\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:37:58.264221134Z\",\n \"endTime\": \"2026-10-06T00:57:04.189335399Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3b883737f660>{
msg: "failed waiting for nodepool=\"np-delete-main\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-qn7rxq8vsgwr\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\",\n \"name\": \"981cb8df-9c35-4549-a20c-83287e603506\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:37:58.264221134Z\",\n \"endTime\": \"2026-10-06T00:57:04.189335399Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x3b88381ab200>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"474511fc-52ec-4aa0-bd04-d3e41f10bbf8",
],
"Date": [
"Tue, 06 Oct 2026 00:57:10 GMT",
],
"Content-Length": ["1242"],
},
Body: <*exported.nopClosingBytesReader | 0x3b883737f480>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 56, 49, 99, 98, 56, 100, 102, 45, 57, 99, 51, 53, 45, 52, 53, 52, 57, 45, 97, 50, 48, 99, 45, 56, 51, 50, 56, 55, 101, 54, 48, 51, 53, 48, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 57, 56, 49, 99, 98, 56, 100, 102, 45, 57, 99, 51, 53, 45, 52, 53, 52, 57, 45, 97, 50, 48, 99, 45, 56, 51, 50, 56, 55, 101, 54, 48, 51, 53, 48, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 55, 58, 53, 56, 46, 50, 54, 52, 50, 50, 49, 49, 51, 52, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 53, 55, 58, 48, 52, 46, 49, 56, 57, 51, 51, 53, 51, 57, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 100, 54, 116, 56, 118, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 122, 122, 109, 107, 110, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 100, 54, 116, 56, 118, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 122, 122, 109, 107, 110, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1242,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j9938304.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506",
Fragment: "",
RawQuery: "api-version=2026-09-01-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"5ba9f580-f6e2-462f-bd15-4fc5763b18a4",
],
"X-Ms-Client-Request-Id": [
"087963ac-e16d-4e23-a64e-401f0b3a2a3e",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:57:10Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j9938304.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j9938304.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 96, 194, 189, 158, 203, 105, 79, 211, 191, 245, 146, 112, 247, 60, 85, 129, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 203, 117, 185, 198, 76, 212, 191, 117, 110, 44, 13, 213, 77, 186, 6, 114, 97, 159, 92, 238, 16, 232, 11, 220, 30, 68, 84, 236, 144, 54, 84, 170, 21, 225, 238, 212, 169, 147, 207, 169, 88, 245, 197, 223, 118, 62, 183, 246, 252, 145, 96, 24, 10, 205, 200, 174, 21, 205, 76, 99, 239, 137, 91, 1, 36, 233, 73, 76, 221, 154, 188, 197, 81, 147, 42, 40, 148, 59, 116, 29, 106, 117, 28, 168, 65, 218, 248, 135, 123, 164, 138, 79, 164, 182, 52, 65, 233, 71, 252, 61, 218, 128, 146, 25, 151, 53, 119, 73, 61, 17, 220, 234, 186, 105, 213, 235, 85, 24, 130, 35, 46, 131, 167, 15, 4, 242, 33, 46, 125, 185, 40, 133, 27, 41, 105, 48, 227, 54, 190, 245, 71, 2, 198, 247, 177, 169, 202, 225, 186, 4, 11, 32, 104, 239, 65, 77, 51, 228, 72, 53, 197, 126, 53, 120, 86, 130, 68, 39, 84, 228, 150, 219, 144, 48, 105, 29, 220, 226, 136, 19, 185, 207, 34, 38, 128, 184, 227, 135, 166, 143, 119, 83, 185, 150, 116, 229, 68, 132, 56, 129, 150, 254, 77, 195, 176, 211, 212, 170, 194, 40, 166, 243, 122, 203, 208, 109, 192, 97, 230, 78, 124, 105, 30, 98, 58, 78, 1, 93, 184, 205, 104, 240, 48, 60, 192, 243, 232, 66, 41, 95, 53, 215, 110, 166, 65, 7, 36, 26, 19, 184, 94, 47, 188, 202, 174, 241, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 143, 51, 79, 196, 133, 79, 64, 223, 17, 63, 65, 79, 213, 125, 90, 140, 226, 7, 141, 228, 217, 205, 103, 246, 14, 254, 125, 211, 91, 0, 150, 108, 253, 51, 90, 88, 114, 159, 144, 124, 77, 140, 254, 137, 25, 143, 16, 39, 125, 115, 34, 61, 186, 114, 36, 115, 241, 111, 50, 244, 155, 137, 108, 232, 77, 252, 178, 187, 11, 16, 120, 9, 196, 72, 187, 25, 105, 252, 165, 109, 128, 160, 11, 71, 238, 218, 191, 72, 111, 159, 12, 156, 227, 1, 241, 159, 56, 136, 21, 231, 75, 214, 214, 186, 100, 154, 253, 60, 127, 86, 157, 127, 245, 69, 85, 235, 177, 230, 209, 93, 184, 1, 202, 199, 12, 164, 0, 48, 143, 205, 223, 158, 131, 81, 53, 188, 107, 42, 30, 155, 111, 79, 50, 245, 219, 234, 182, 18, 32, 205, 160, 75, 127, 40, 15, 156, 206, 210, 75, 47, 255, 166, 147, 165, 50, 200, 180, 33, 106, 156, 195, 175, 136, 141, 49, 235, 37, 90, 6, 121, 22, 97, 83, 32, 168, 184, 39, 44, 140, 102, 70, 81, 73, 19, 254, 95, 248, 249, 210, 227, 20, 174, 43, 248, 204, 199, 139, 13, 178, 43, 117, 173, 80, 83, 4, 105, 2, 41, 72, 254, 123, 172, 2, 169, 255, 244, 151, 222, 68, 174, 102, 70, 11, 183, 235, 138, 216, 149, 247, 208, 128, 36, 220, 233, 80, 132, 211, 207, 157, 31, 153, 80, 182, 80, 189, 162],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 96, 194, 189, 158, 203, 105, 79, 211, 191, 245, 146, 112, 247, 60, 85, 129, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 203, 117, 185, 198, 76, 212, 191, 117, 110, 44, 13, 213, 77, 186, 6, 114, 97, 159, 92, 238, 16, 232, 11, 220, 30, 68, 84, 236, 144, 54, 84, 170, 21, 225, 238, 212, 169, 147, 207, 169, 88, 245, 197, 223, 118, 62, 183, 246, 252, 145, 96, 24, 10, 205, 200, 174, 21, 205, 76, 99, 239, 137, 91, 1, 36, 233, 73, 76, 221, 154, 188, 197, 81, 147, 42, 40, 148, 59, 116, 29, 106, 117, 28, 168, 65, 218, 248, 135, 123, 164, 138, 79, 164, 182, 52, 65, 233, 71, 252, 61, 218, 128, 146, 25, 151, 53, 119, 73, 61, 17, 220, 234, 186, 105, 213, 235, 85, 24, 130, 35, 46, 131, 167, 15, 4, 242, 33, 46, 125, 185, 40, 133, 27, 41, 105, 48, 227, 54, 190, 245, 71, 2, 198, 247, 177, 169, 202, 225, 186, 4, 11, 32, 104, 239, 65, 77, 51, 228, 72, 53, 197, 126, 53, 120, 86, 130, 68, 39, 84, 228, 150, 219, 144, 48, 105, 29, 220, 226, 136, 19, 185, 207, 34, 38, 128, 184, 227, 135, 166, 143, 119, 83, 185, 150, 116, 229, 68, 132, 56, 129, 150, 254, 77, 195, 176, 211, 212, 170, 194, 40, 166, 243, 122, 203, 208, 109, 192, 97, 230, 78, 124, 105, 30, 98, 58, 78, 1, 93, 184, 205, 104, 240, 48, 60, 192, 243, 232, 66, 41, 95, 53, 215, 110, 166, 65, 7, 36, 26, 19, 184, 94, 47, 188, 202, 174, 241, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 203, 117, 185, 198, 76, 212, 191, 117, 110, 44, 13, 213, 77, 186, 6, 114, 97, 159, 92, 238, 16, 232, 11, 220, 30, 68, 84, 236, 144, 54, 84, 170, 21, 225, 238, 212, 169, 147, 207, 169, 88, 245, 197, 223, 118, 62, 183, 246, 252, 145, 96, 24, 10, 205, 200, 174, 21, 205, 76, 99, 239, 137, 91, 1, 36, 233, 73, 76, 221, 154, 188, 197, 81, 147, 42, 40, 148, 59, 116, 29, 106, 117, 28, 168, 65, 218, 248, 135, 123, 164, 138, 79, 164, 182, 52, 65, 233, 71, 252, 61, 218, 128, 146, 25, 151, 53, 119, 73, 61, 17, 220, 234, 186, 105, 213, 235, 85, 24, 130, 35, 46, 131, 167, 15, 4, 242, 33, 46, 125, 185, 40, 133, 27, 41, 105, 48, 227, 54, 190, 245, 71, 2, 198, 247, 177, 169, 202, 225, 186, 4, 11, 32, 104, 239, 65, 77, 51, 228, 72, 53, 197, 126, 53, 120, 86, 130, 68, 39, 84, 228, 150, 219, 144, 48, 105, 29, 220, 226, 136, 19, 185, 207, 34, 38, 128, 184, 227, 135, 166, 143, 119, 83, 185, 150, 116, 229, 68, 132, 56, 129, 150, 254, 77, 195, 176, 211, 212, 170, 194, 40, 166, 243, 122, 203, 208, 109, 192, 97, 230, 78, 124, 105, 30, 98, 58, 78, 1, 93, 184, 205, 104, 240, 48, 60, 192, 243, 232, 66, 41, 95, 53, 215, 110, 166, 65, 7, 36, 26, 19, 184, 94, 47, 188, 202, 174, 241, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [143, 51, 79, 196, 133, 79, 64, 223, 17, 63, 65, 79, 213, 125, 90, 140, 226, 7, 141, 228, 217, 205, 103, 246, 14, 254, 125, 211, 91, 0, 150, 108, 253, 51, 90, 88, 114, 159, 144, 124, 77, 140, 254, 137, 25, 143, 16, 39, 125, 115, 34, 61, 186, 114, 36, 115, 241, 111, 50, 244, 155, 137, 108, 232, 77, 252, 178, 187, 11, 16, 120, 9, 196, 72, 187, 25, 105, 252, 165, 109, 128, 160, 11, 71, 238, 218, 191, 72, 111, 159, 12, 156, 227, 1, 241, 159, 56, 136, 21, 231, 75, 214, 214, 186, 100, 154, 253, 60, 127, 86, 157, 127, 245, 69, 85, 235, 177, 230, 209, 93, 184, 1, 202, 199, 12, 164, 0, 48, 143, 205, 223, 158, 131, 81, 53, 188, 107, 42, 30, 155, 111, 79, 50, 245, 219, 234, 182, 18, 32, 205, 160, 75, 127, 40, 15, 156, 206, 210, 75, 47, 255, 166, 147, 165, 50, 200, 180, 33, 106, 156, 195, 175, 136, 141, 49, 235, 37, 90, 6, 121, 22, 97, 83, 32, 168, 184, 39, 44, 140, 102, 70, 81, 73, 19, 254, 95, 248, 249, 210, 227, 20, 174, 43, 248, 204, 199, 139, 13, 178, 43, 117, 173, 80, 83, 4, 105, 2, 41, 72, 254, 123, 172, 2, 169, 255, 244, 151, 222, 68, 174, 102, 70, 11, 183, 235, 138, 216, 149, 247, 208, 128, 36, 220, 233, 80, 132, 211, 207, 157, 31, 153, 80, 182, 80, 189, 162],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x3b8837184b80>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [13832122844420265345, 6972343662838108115],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j9938304.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j9938304.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926839815, loc: nil},
NotAfter: {wall: 0, ext: 63942565215, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134],
AuthorityKeyId: [82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j9938304.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\",\n \"name\": \"981cb8df-9c35-4549-a20c-83287e603506\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:37:58.264221134Z\",\n \"endTime\": \"2026-10-06T00:57:04.189335399Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
<*fmt.wrapError | 0x3b8837030ea0>:
failed to create NodePool np-delete-main: failed waiting for nodepool="np-delete-main" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-qn7rxq8vsgwr" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506",
"name": "981cb8df-9c35-4549-a20c-83287e603506",
"status": "Failed",
"startTime": "2026-10-06T00:37:58.264221134Z",
"endTime": "2026-10-06T00:57:04.189335399Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-delete-main: failed waiting for nodepool=\"np-delete-main\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-qn7rxq8vsgwr\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\",\n \"name\": \"981cb8df-9c35-4549-a20c-83287e603506\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:37:58.264221134Z\",\n \"endTime\": \"2026-10-06T00:57:04.189335399Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3b883737f660>{
msg: "failed waiting for nodepool=\"np-delete-main\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-qn7rxq8vsgwr\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\",\n \"name\": \"981cb8df-9c35-4549-a20c-83287e603506\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:37:58.264221134Z\",\n \"endTime\": \"2026-10-06T00:57:04.189335399Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x3b88381ab200>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"474511fc-52ec-4aa0-bd04-d3e41f10bbf8",
],
"Date": [
"Tue, 06 Oct 2026 00:57:10 GMT",
],
"Content-Length": ["1242"],
},
Body: <*exported.nopClosingBytesReader | 0x3b883737f480>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 56, 49, 99, 98, 56, 100, 102, 45, 57, 99, 51, 53, 45, 52, 53, 52, 57, 45, 97, 50, 48, 99, 45, 56, 51, 50, 56, 55, 101, 54, 48, 51, 53, 48, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 57, 56, 49, 99, 98, 56, 100, 102, 45, 57, 99, 51, 53, 45, 52, 53, 52, 57, 45, 97, 50, 48, 99, 45, 56, 51, 50, 56, 55, 101, 54, 48, 51, 53, 48, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 55, 58, 53, 56, 46, 50, 54, 52, 50, 50, 49, 49, 51, 52, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 53, 55, 58, 48, 52, 46, 49, 56, 57, 51, 51, 53, 51, 57, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 100, 54, 116, 56, 118, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 122, 122, 109, 107, 110, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 100, 54, 116, 56, 118, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 122, 122, 109, 107, 110, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1242,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j9938304.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506",
Fragment: "",
RawQuery: "api-version=2026-09-01-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"5ba9f580-f6e2-462f-bd15-4fc5763b18a4",
],
"X-Ms-Client-Request-Id": [
"087963ac-e16d-4e23-a64e-401f0b3a2a3e",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:57:10Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j9938304.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j9938304.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 96, 194, 189, 158, 203, 105, 79, 211, 191, 245, 146, 112, 247, 60, 85, 129, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 203, 117, 185, 198, 76, 212, 191, 117, 110, 44, 13, 213, 77, 186, 6, 114, 97, 159, 92, 238, 16, 232, 11, 220, 30, 68, 84, 236, 144, 54, 84, 170, 21, 225, 238, 212, 169, 147, 207, 169, 88, 245, 197, 223, 118, 62, 183, 246, 252, 145, 96, 24, 10, 205, 200, 174, 21, 205, 76, 99, 239, 137, 91, 1, 36, 233, 73, 76, 221, 154, 188, 197, 81, 147, 42, 40, 148, 59, 116, 29, 106, 117, 28, 168, 65, 218, 248, 135, 123, 164, 138, 79, 164, 182, 52, 65, 233, 71, 252, 61, 218, 128, 146, 25, 151, 53, 119, 73, 61, 17, 220, 234, 186, 105, 213, 235, 85, 24, 130, 35, 46, 131, 167, 15, 4, 242, 33, 46, 125, 185, 40, 133, 27, 41, 105, 48, 227, 54, 190, 245, 71, 2, 198, 247, 177, 169, 202, 225, 186, 4, 11, 32, 104, 239, 65, 77, 51, 228, 72, 53, 197, 126, 53, 120, 86, 130, 68, 39, 84, 228, 150, 219, 144, 48, 105, 29, 220, 226, 136, 19, 185, 207, 34, 38, 128, 184, 227, 135, 166, 143, 119, 83, 185, 150, 116, 229, 68, 132, 56, 129, 150, 254, 77, 195, 176, 211, 212, 170, 194, 40, 166, 243, 122, 203, 208, 109, 192, 97, 230, 78, 124, 105, 30, 98, 58, 78, 1, 93, 184, 205, 104, 240, 48, 60, 192, 243, 232, 66, 41, 95, 53, 215, 110, 166, 65, 7, 36, 26, 19, 184, 94, 47, 188, 202, 174, 241, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 143, 51, 79, 196, 133, 79, 64, 223, 17, 63, 65, 79, 213, 125, 90, 140, 226, 7, 141, 228, 217, 205, 103, 246, 14, 254, 125, 211, 91, 0, 150, 108, 253, 51, 90, 88, 114, 159, 144, 124, 77, 140, 254, 137, 25, 143, 16, 39, 125, 115, 34, 61, 186, 114, 36, 115, 241, 111, 50, 244, 155, 137, 108, 232, 77, 252, 178, 187, 11, 16, 120, 9, 196, 72, 187, 25, 105, 252, 165, 109, 128, 160, 11, 71, 238, 218, 191, 72, 111, 159, 12, 156, 227, 1, 241, 159, 56, 136, 21, 231, 75, 214, 214, 186, 100, 154, 253, 60, 127, 86, 157, 127, 245, 69, 85, 235, 177, 230, 209, 93, 184, 1, 202, 199, 12, 164, 0, 48, 143, 205, 223, 158, 131, 81, 53, 188, 107, 42, 30, 155, 111, 79, 50, 245, 219, 234, 182, 18, 32, 205, 160, 75, 127, 40, 15, 156, 206, 210, 75, 47, 255, 166, 147, 165, 50, 200, 180, 33, 106, 156, 195, 175, 136, 141, 49, 235, 37, 90, 6, 121, 22, 97, 83, 32, 168, 184, 39, 44, 140, 102, 70, 81, 73, 19, 254, 95, 248, 249, 210, 227, 20, 174, 43, 248, 204, 199, 139, 13, 178, 43, 117, 173, 80, 83, 4, 105, 2, 41, 72, 254, 123, 172, 2, 169, 255, 244, 151, 222, 68, 174, 102, 70, 11, 183, 235, 138, 216, 149, 247, 208, 128, 36, 220, 233, 80, 132, 211, 207, 157, 31, 153, 80, 182, 80, 189, 162],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 96, 194, 189, 158, 203, 105, 79, 211, 191, 245, 146, 112, 247, 60, 85, 129, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 203, 117, 185, 198, 76, 212, 191, 117, 110, 44, 13, 213, 77, 186, 6, 114, 97, 159, 92, 238, 16, 232, 11, 220, 30, 68, 84, 236, 144, 54, 84, 170, 21, 225, 238, 212, 169, 147, 207, 169, 88, 245, 197, 223, 118, 62, 183, 246, 252, 145, 96, 24, 10, 205, 200, 174, 21, 205, 76, 99, 239, 137, 91, 1, 36, 233, 73, 76, 221, 154, 188, 197, 81, 147, 42, 40, 148, 59, 116, 29, 106, 117, 28, 168, 65, 218, 248, 135, 123, 164, 138, 79, 164, 182, 52, 65, 233, 71, 252, 61, 218, 128, 146, 25, 151, 53, 119, 73, 61, 17, 220, 234, 186, 105, 213, 235, 85, 24, 130, 35, 46, 131, 167, 15, 4, 242, 33, 46, 125, 185, 40, 133, 27, 41, 105, 48, 227, 54, 190, 245, 71, 2, 198, 247, 177, 169, 202, 225, 186, 4, 11, 32, 104, 239, 65, 77, 51, 228, 72, 53, 197, 126, 53, 120, 86, 130, 68, 39, 84, 228, 150, 219, 144, 48, 105, 29, 220, 226, 136, 19, 185, 207, 34, 38, 128, 184, 227, 135, 166, 143, 119, 83, 185, 150, 116, 229, 68, 132, 56, 129, 150, 254, 77, 195, 176, 211, 212, 170, 194, 40, 166, 243, 122, 203, 208, 109, 192, 97, 230, 78, 124, 105, 30, 98, 58, 78, 1, 93, 184, 205, 104, 240, 48, 60, 192, 243, 232, 66, 41, 95, 53, 215, 110, 166, 65, 7, 36, 26, 19, 184, 94, 47, 188, 202, 174, 241, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 203, 117, 185, 198, 76, 212, 191, 117, 110, 44, 13, 213, 77, 186, 6, 114, 97, 159, 92, 238, 16, 232, 11, 220, 30, 68, 84, 236, 144, 54, 84, 170, 21, 225, 238, 212, 169, 147, 207, 169, 88, 245, 197, 223, 118, 62, 183, 246, 252, 145, 96, 24, 10, 205, 200, 174, 21, 205, 76, 99, 239, 137, 91, 1, 36, 233, 73, 76, 221, 154, 188, 197, 81, 147, 42, 40, 148, 59, 116, 29, 106, 117, 28, 168, 65, 218, 248, 135, 123, 164, 138, 79, 164, 182, 52, 65, 233, 71, 252, 61, 218, 128, 146, 25, 151, 53, 119, 73, 61, 17, 220, 234, 186, 105, 213, 235, 85, 24, 130, 35, 46, 131, 167, 15, 4, 242, 33, 46, 125, 185, 40, 133, 27, 41, 105, 48, 227, 54, 190, 245, 71, 2, 198, 247, 177, 169, 202, 225, 186, 4, 11, 32, 104, 239, 65, 77, 51, 228, 72, 53, 197, 126, 53, 120, 86, 130, 68, 39, 84, 228, 150, 219, 144, 48, 105, 29, 220, 226, 136, 19, 185, 207, 34, 38, 128, 184, 227, 135, 166, 143, 119, 83, 185, 150, 116, 229, 68, 132, 56, 129, 150, 254, 77, 195, 176, 211, 212, 170, 194, 40, 166, 243, 122, 203, 208, 109, 192, 97, 230, 78, 124, 105, 30, 98, 58, 78, 1, 93, 184, 205, 104, 240, 48, 60, 192, 243, 232, 66, 41, 95, 53, 215, 110, 166, 65, 7, 36, 26, 19, 184, 94, 47, 188, 202, 174, 241, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [143, 51, 79, 196, 133, 79, 64, 223, 17, 63, 65, 79, 213, 125, 90, 140, 226, 7, 141, 228, 217, 205, 103, 246, 14, 254, 125, 211, 91, 0, 150, 108, 253, 51, 90, 88, 114, 159, 144, 124, 77, 140, 254, 137, 25, 143, 16, 39, 125, 115, 34, 61, 186, 114, 36, 115, 241, 111, 50, 244, 155, 137, 108, 232, 77, 252, 178, 187, 11, 16, 120, 9, 196, 72, 187, 25, 105, 252, 165, 109, 128, 160, 11, 71, 238, 218, 191, 72, 111, 159, 12, 156, 227, 1, 241, 159, 56, 136, 21, 231, 75, 214, 214, 186, 100, 154, 253, 60, 127, 86, 157, 127, 245, 69, 85, 235, 177, 230, 209, 93, 184, 1, 202, 199, 12, 164, 0, 48, 143, 205, 223, 158, 131, 81, 53, 188, 107, 42, 30, 155, 111, 79, 50, 245, 219, 234, 182, 18, 32, 205, 160, 75, 127, 40, 15, 156, 206, 210, 75, 47, 255, 166, 147, 165, 50, 200, 180, 33, 106, 156, 195, 175, 136, 141, 49, 235, 37, 90, 6, 121, 22, 97, 83, 32, 168, 184, 39, 44, 140, 102, 70, 81, 73, 19, 254, 95, 248, 249, 210, 227, 20, 174, 43, 248, 204, 199, 139, 13, 178, 43, 117, 173, 80, 83, 4, 105, 2, 41, 72, 254, 123, 172, 2, 169, 255, 244, 151, 222, 68, 174, 102, 70, 11, 183, 235, 138, 216, 149, 247, 208, 128, 36, 220, 233, 80, 132, 211, 207, 157, 31, 153, 80, 182, 80, 189, 162],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x3b8837184b80>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [13832122844420265345, 6972343662838108115],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j9938304.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j9938304.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926839815, loc: nil},
NotAfter: {wall: 0, ext: 63942565215, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134],
AuthorityKeyId: [82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j9938304.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\",\n \"name\": \"981cb8df-9c35-4549-a20c-83287e603506\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:37:58.264221134Z\",\n \"endTime\": \"2026-10-06T00:57:04.189335399Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}Contributing tests (1)
Affected runs (34) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeadlineExceeded; provider Microsoft.Networkfull failure pattern: ERROR CODE: DeadlineExceeded; provider Microsoft.Network Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 2 day(s) | e2e | 30 | 38.96%30 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 2 day(s) | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 20 · Oct 5: 78 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-cnrz26" for cluster "cluster-candidate-4-20-cnrz26"
Unexpected error:
<*fmt.wrapError | 0x9b2aa98c820>:
failed to create NodePool np-cnrz26: failed waiting for nodepool="np-cnrz26" for cluster "cluster-candidate-4-20-cnrz26" in resourcegroup="rg-candidate-4-20-t59xhk8kf8gv" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da",
"name": "4c26a0bf-9ed6-4a94-a418-b5f53ab148da",
"status": "Failed",
"startTime": "2026-10-06T00:10:04.605905756Z",
"endTime": "2026-10-06T00:29:11.434639901Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-cnrz26: failed waiting for nodepool=\"np-cnrz26\" for cluster \"cluster-candidate-4-20-cnrz26\" in resourcegroup=\"rg-candidate-4-20-t59xhk8kf8gv\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n \"name\": \"4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:10:04.605905756Z\",\n \"endTime\": \"2026-10-06T00:29:11.434639901Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x9b2a98a8520>{
msg: "failed waiting for nodepool=\"np-cnrz26\" for cluster \"cluster-candidate-4-20-cnrz26\" in resourcegroup=\"rg-candidate-4-20-t59xhk8kf8gv\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n \"name\": \"4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:10:04.605905756Z\",\n \"endTime\": \"2026-10-06T00:29:11.434639901Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x9b2ab3de5a0>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["6"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"b76f349f-d162-4e80-8d68-9ad1f44a1294",
],
"Date": [
"Tue, 06 Oct 2026 00:29:17 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x9b2a98a8340>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 52, 99, 50, 54, 97, 48, 98, 102, 45, 57, 101, 100, 54, 45, 52, 97, 57, 52, 45, 97, 52, 49, 56, 45, 98, 53, 102, 53, 51, 97, 98, 49, 52, 56, 100, 97, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 52, 99, 50, 54, 97, 48, 98, 102, 45, 57, 101, 100, 54, 45, 52, 97, 57, 52, 45, 97, 52, 49, 56, 45, 98, 53, 102, 53, 51, 97, 98, 49, 52, 56, 100, 97, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 48, 58, 48, 52, 46, 54, 48, 53, 57, 48, 53, 55, 53, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 57, 58, 49, 49, 46, 52, 51, 52, 54, 51, 57, 57, 48, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 57, 116, 106, 109, 99, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 52, 45, 50, 48, 45, 116, 53, 57, 120, 104, 107, 56, 107, 102, 56, 103, 118, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 99, 110, 114, 122, 50, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 57, 116, 106, 109, 99, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 52, 45, 50, 48, 45, 116, 53, 57, 120, 104, 107, 56, 107, 102, 56, 103, 118, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 99, 110, 114, 122, 50, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 52, 45, 50, 48, 45, 116, 53, 57, 120, 104, 107, 56, 107, 102, 56, 103, 118, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 99, 110, 114, 122, 50, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 39, 32, 97, 99, 116, 111, 114, 32, 39, 102, 100, 51, 53, 97, 99, 53, 102, 45, 54, 52, 57, 51, 45, 52, 48, 99, 98, 45, 57, 49, 51, 49, 45, 100, 54, 54, 57, 97, 55, 48, 49, 49, 52, 99, 51, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"21f5f497-c676-4db6-ae72-1d4a52bd4c58",
],
"X-Ms-Client-Request-Id": [
"6fa3a6e2-8e70-48b5-b48b-af1365738b7f",
],
"Authorization": ["redacted"],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:29:17Z\"}",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x9b2aa01fc60>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12798357290586720628, 8480743146650813573],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926839811, loc: nil},
NotAfter: {wall: 0, ext: 63942565211, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j5947136.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n \"name\": \"4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:10:04.605905756Z\",\n \"endTime\": \"2026-10-06T00:29:11.434639901Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-cnrz26" for cluster "cluster-candidate-4-20-cnrz26"
Unexpected error:
<*fmt.wrapError | 0x9b2aa98c820>:
failed to create NodePool np-cnrz26: failed waiting for nodepool="np-cnrz26" for cluster "cluster-candidate-4-20-cnrz26" in resourcegroup="rg-candidate-4-20-t59xhk8kf8gv" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da",
"name": "4c26a0bf-9ed6-4a94-a418-b5f53ab148da",
"status": "Failed",
"startTime": "2026-10-06T00:10:04.605905756Z",
"endTime": "2026-10-06T00:29:11.434639901Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-cnrz26: failed waiting for nodepool=\"np-cnrz26\" for cluster \"cluster-candidate-4-20-cnrz26\" in resourcegroup=\"rg-candidate-4-20-t59xhk8kf8gv\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n \"name\": \"4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:10:04.605905756Z\",\n \"endTime\": \"2026-10-06T00:29:11.434639901Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x9b2a98a8520>{
msg: "failed waiting for nodepool=\"np-cnrz26\" for cluster \"cluster-candidate-4-20-cnrz26\" in resourcegroup=\"rg-candidate-4-20-t59xhk8kf8gv\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n \"name\": \"4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:10:04.605905756Z\",\n \"endTime\": \"2026-10-06T00:29:11.434639901Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x9b2ab3de5a0>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["6"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"b76f349f-d162-4e80-8d68-9ad1f44a1294",
],
"Date": [
"Tue, 06 Oct 2026 00:29:17 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x9b2a98a8340>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 52, 99, 50, 54, 97, 48, 98, 102, 45, 57, 101, 100, 54, 45, 52, 97, 57, 52, 45, 97, 52, 49, 56, 45, 98, 53, 102, 53, 51, 97, 98, 49, 52, 56, 100, 97, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 52, 99, 50, 54, 97, 48, 98, 102, 45, 57, 101, 100, 54, 45, 52, 97, 57, 52, 45, 97, 52, 49, 56, 45, 98, 53, 102, 53, 51, 97, 98, 49, 52, 56, 100, 97, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 48, 58, 48, 52, 46, 54, 48, 53, 57, 48, 53, 55, 53, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 57, 58, 49, 49, 46, 52, 51, 52, 54, 51, 57, 57, 48, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 57, 116, 106, 109, 99, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 52, 45, 50, 48, 45, 116, 53, 57, 120, 104, 107, 56, 107, 102, 56, 103, 118, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 99, 110, 114, 122, 50, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 57, 116, 106, 109, 99, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 52, 45, 50, 48, 45, 116, 53, 57, 120, 104, 107, 56, 107, 102, 56, 103, 118, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 99, 110, 114, 122, 50, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 52, 45, 50, 48, 45, 116, 53, 57, 120, 104, 107, 56, 107, 102, 56, 103, 118, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 99, 110, 114, 122, 50, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 39, 32, 97, 99, 116, 111, 114, 32, 39, 102, 100, 51, 53, 97, 99, 53, 102, 45, 54, 52, 57, 51, 45, 52, 48, 99, 98, 45, 57, 49, 51, 49, 45, 100, 54, 54, 57, 97, 55, 48, 49, 49, 52, 99, 51, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"21f5f497-c676-4db6-ae72-1d4a52bd4c58",
],
"X-Ms-Client-Request-Id": [
"6fa3a6e2-8e70-48b5-b48b-af1365738b7f",
],
"Authorization": ["redacted"],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:29:17Z\"}",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x9b2aa01fc60>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12798357290586720628, 8480743146650813573],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926839811, loc: nil},
NotAfter: {wall: 0, ext: 63942565211, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j5947136.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n \"name\": \"4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:10:04.605905756Z\",\n \"endTime\": \"2026-10-06T00:29:11.434639901Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:138]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
<*fmt.wrapError | 0x2e2078a1dec0>:
failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-tb9m6klh44nq" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4",
"name": "32bc3eda-5158-4662-b3b6-59d79c4170a4",
"status": "Failed",
"startTime": "2026-10-06T00:12:59.67085605Z",
"endTime": "2026-10-06T00:32:01.502118765Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed waiting for nodepool=\"np-1\" for cluster \"private-kv-cluster\" in resourcegroup=\"private-keyvault-tb9m6klh44nq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n \"name\": \"32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:12:59.67085605Z\",\n \"endTime\": \"2026-10-06T00:32:01.502118765Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x2e20791d0a00>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"private-kv-cluster\" in resourcegroup=\"private-keyvault-tb9m6klh44nq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n \"name\": \"32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:12:59.67085605Z\",\n \"endTime\": \"2026-10-06T00:32:01.502118765Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x2e2079014b10>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"51d257d1-1c22-488c-8519-e537d67ac3c6",
],
"Date": [
"Tue, 06 Oct 2026 00:32:02 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x2e20791d07c0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 51, 50, 98, 99, 51, 101, 100, 97, 45, 53, 49, 53, 56, 45, 52, 54, 54, 50, 45, 98, 51, 98, 54, 45, 53, 57, 100, 55, 57, 99, 52, 49, 55, 48, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 51, 50, 98, 99, 51, 101, 100, 97, 45, 53, 49, 53, 56, 45, 52, 54, 54, 50, 45, 98, 51, 98, 54, 45, 53, 57, 100, 55, 57, 99, 52, 49, 55, 48, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 50, 58, 53, 57, 46, 54, 55, 48, 56, 53, 54, 48, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 50, 58, 48, 49, 46, 53, 48, 50, 49, 49, 56, 55, 54, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 109, 102, 52, 110, 55, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 109, 102, 52, 110, 55, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 39, 32, 97, 99, 116, 111, 114, 32, 39, 102, 100, 51, 53, 97, 99, 53, 102, 45, 54, 52, 57, 51, 45, 52, 48, 99, 98, 45, 57, 49, 51, 49, 45, 100, 54, 54, 57, 97, 55, 48, 49, 49, 52, 99, 51, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 46, 32, 82, 101, 102, 101, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"49e32d01-96ca-492a-940f-2ffaf9b46927",
],
"X-Ms-Client-Request-Id": [
"144d5ac7-df67-413f-8449-0642b93ebc52",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:32:02Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x2e20789f9950>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12798357290586720628, 8480743146650813573],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926839811, loc: nil},
NotAfter: {wall: 0, ext: 63942565211, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j5947136.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n \"name\": \"32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:12:59.67085605Z\",\n \"endTime\": \"2026-10-06T00:32:01.502118765Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:138]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
<*fmt.wrapError | 0x2e2078a1dec0>:
failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-tb9m6klh44nq" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4",
"name": "32bc3eda-5158-4662-b3b6-59d79c4170a4",
"status": "Failed",
"startTime": "2026-10-06T00:12:59.67085605Z",
"endTime": "2026-10-06T00:32:01.502118765Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-1: failed waiting for nodepool=\"np-1\" for cluster \"private-kv-cluster\" in resourcegroup=\"private-keyvault-tb9m6klh44nq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n \"name\": \"32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:12:59.67085605Z\",\n \"endTime\": \"2026-10-06T00:32:01.502118765Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x2e20791d0a00>{
msg: "failed waiting for nodepool=\"np-1\" for cluster \"private-kv-cluster\" in resourcegroup=\"private-keyvault-tb9m6klh44nq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n \"name\": \"32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:12:59.67085605Z\",\n \"endTime\": \"2026-10-06T00:32:01.502118765Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x2e2079014b10>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"51d257d1-1c22-488c-8519-e537d67ac3c6",
],
"Date": [
"Tue, 06 Oct 2026 00:32:02 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x2e20791d07c0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 51, 50, 98, 99, 51, 101, 100, 97, 45, 53, 49, 53, 56, 45, 52, 54, 54, 50, 45, 98, 51, 98, 54, 45, 53, 57, 100, 55, 57, 99, 52, 49, 55, 48, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 51, 50, 98, 99, 51, 101, 100, 97, 45, 53, 49, 53, 56, 45, 52, 54, 54, 50, 45, 98, 51, 98, 54, 45, 53, 57, 100, 55, 57, 99, 52, 49, 55, 48, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 50, 58, 53, 57, 46, 54, 55, 48, 56, 53, 54, 48, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 50, 58, 48, 49, 46, 53, 48, 50, 49, 49, 56, 55, 54, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 109, 102, 52, 110, 55, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 109, 102, 52, 110, 55, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 39, 32, 97, 99, 116, 111, 114, 32, 39, 102, 100, 51, 53, 97, 99, 53, 102, 45, 54, 52, 57, 51, 45, 52, 48, 99, 98, 45, 57, 49, 51, 49, 45, 100, 54, 54, 57, 97, 55, 48, 49, 49, 52, 99, 51, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 46, 32, 82, 101, 102, 101, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"49e32d01-96ca-492a-940f-2ffaf9b46927",
],
"X-Ms-Client-Request-Id": [
"144d5ac7-df67-413f-8449-0642b93ebc52",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:32:02Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x2e20789f9950>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12798357290586720628, 8480743146650813573],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926839811, loc: nil},
NotAfter: {wall: 0, ext: 63942565211, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j5947136.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n \"name\": \"32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:12:59.67085605Z\",\n \"endTime\": \"2026-10-06T00:32:01.502118765Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:193]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
<*errors.joinError | 0x2591190241f8>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
failed to create NodePool cilium-np: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-8jtnxl7527bt" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933",
"name": "8a2eda1e-5b61-431e-9807-ec017ff31933",
"status": "Failed",
"startTime": "2026-10-06T00:12:27.991930257Z",
"endTime": "2026-10-06T00:31:33.303872485Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x2591190241e0>{
errs: [
<*fmt.wrapError | 0x2591189e64c0>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x259119689b80>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x2591189e6980>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
err: <*fmt.wrapError | 0x2591189e6940>{
msg: "not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
err: <*errors.errorString | 0x259119cf8240>{
s: "no cilium pods found in kube-system namespace",
},
},
},
],
},
<*fmt.wrapError | 0x2591184c3340>{
msg: "failed to create NodePool cilium-np: failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-8jtnxl7527bt\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\",\n \"name\": \"8a2eda1e-5b61-431e-9807-ec017ff31933\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:12:27.991930257Z\",\n \"endTime\": \"2026-10-06T00:31:33.303872485Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x259119444c40>{
msg: "failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-8jtnxl7527bt\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\",\n \"name\": \"8a2eda1e-5b61-431e-9807-ec017ff31933\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:12:27.991930257Z\",\n \"endTime\": \"2026-10-06T00:31:33.303872485Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x2591193daae0>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["9"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"7fa66e49-4e6a-4bf0-a4a8-a2d540d934f1",
],
"Date": [
"Tue, 06 Oct 2026 00:31:41 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x259119444aa0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 56, 97, 50, 101, 100, 97, 49, 101, 45, 53, 98, 54, 49, 45, 52, 51, 49, 101, 45, 57, 56, 48, 55, 45, 101, 99, 48, 49, 55, 102, 102, 51, 49, 57, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 56, 97, 50, 101, 100, 97, 49, 101, 45, 53, 98, 54, 49, 45, 52, 51, 49, 101, 45, 57, 56, 48, 55, 45, 101, 99, 48, 49, 55, 102, 102, 51, 49, 57, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 50, 58, 50, 55, 46, 57, 57, 49, 57, 51, 48, 50, 53, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 49, 58, 51, 51, 46, 51, 48, 51, 56, 55, 50, 52, 56, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 107, 110, 53, 120, 115, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 107, 110, 53, 120, 115, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 39, 32, 97, 99, 116, 111, 114, 32, 39, 102, 100, 51, 53, 97, 99, 53, 102, 45, 54, 52, 57, 51, 45, 52, 48, 99, 98, 45, 57, 49, 51, 49, 45, 100, 54, 54, 57, 97, 55, 48, 49, 49, 52, 99, 51, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Authorization": ["redacted"],
"X-Ms-Correlation-Request-Id": [
"163dc543-7acc-4d2a-a58d-111eee39e74f",
],
"X-Ms-Client-Request-Id": [
"c4ca5eed-06d7-48dd-8f0a-5e169ff93ad6",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:31:41Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x259118882f10>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\",\n \"name\": \"8a2eda1e-5b61-431e-9807-ec017ff31933\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:12:27.991930257Z\",\n \"endTime\": \"2026-10-06T00:31:33.303872485Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:193]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
<*errors.joinError | 0x2591190241f8>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
failed to create NodePool cilium-np: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-8jtnxl7527bt" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933",
"name": "8a2eda1e-5b61-431e-9807-ec017ff31933",
"status": "Failed",
"startTime": "2026-10-06T00:12:27.991930257Z",
"endTime": "2026-10-06T00:31:33.303872485Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x2591190241e0>{
errs: [
<*fmt.wrapError | 0x2591189e64c0>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x259119689b80>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x2591189e6980>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
err: <*fmt.wrapError | 0x2591189e6940>{
msg: "not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
err: <*errors.errorString | 0x259119cf8240>{
s: "no cilium pods found in kube-system namespace",
},
},
},
],
},
<*fmt.wrapError | 0x2591184c3340>{
msg: "failed to create NodePool cilium-np: failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-8jtnxl7527bt\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\",\n \"name\": \"8a2eda1e-5b61-431e-9807-ec017ff31933\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:12:27.991930257Z\",\n \"endTime\": \"2026-10-06T00:31:33.303872485Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x259119444c40>{
msg: "failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-8jtnxl7527bt\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\",\n \"name\": \"8a2eda1e-5b61-431e-9807-ec017ff31933\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:12:27.991930257Z\",\n \"endTime\": \"2026-10-06T00:31:33.303872485Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x2591193daae0>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["9"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"7fa66e49-4e6a-4bf0-a4a8-a2d540d934f1",
],
"Date": [
"Tue, 06 Oct 2026 00:31:41 GMT",
],
},
Body: <*exported.nopClosingBytesReader | 0x259119444aa0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 56, 97, 50, 101, 100, 97, 49, 101, 45, 53, 98, 54, 49, 45, 52, 51, 49, 101, 45, 57, 56, 48, 55, 45, 101, 99, 48, 49, 55, 102, 102, 51, 49, 57, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 56, 97, 50, 101, 100, 97, 49, 101, 45, 53, 98, 54, 49, 45, 52, 51, 49, 101, 45, 57, 56, 48, 55, 45, 101, 99, 48, 49, 55, 102, 102, 51, 49, 57, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 50, 58, 50, 55, 46, 57, 57, 49, 57, 51, 48, 50, 53, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 49, 58, 51, 51, 46, 51, 48, 51, 56, 55, 50, 52, 56, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 107, 110, 53, 120, 115, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 107, 110, 53, 120, 115, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 39, 32, 97, 99, 116, 111, 114, 32, 39, 102, 100, 51, 53, 97, 99, 53, 102, 45, 54, 52, 57, 51, 45, 52, 48, 99, 98, 45, 57, 49, 51, 49, 45, 100, 54, 54, 57, 97, 55, 48, 49, 49, 52, 99, 51, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: -1,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Authorization": ["redacted"],
"X-Ms-Correlation-Request-Id": [
"163dc543-7acc-4d2a-a58d-111eee39e74f",
],
"X-Ms-Client-Request-Id": [
"c4ca5eed-06d7-48dd-8f0a-5e169ff93ad6",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:31:41Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5947136.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x259118882f10>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\",\n \"name\": \"8a2eda1e-5b61-431e-9807-ec017ff31933\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:12:27.991930257Z\",\n \"endTime\": \"2026-10-06T00:31:33.303872485Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurredContributing tests (13)
Affected runs (30) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeadlineExceeded; detail message node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hype...full failure pattern: ERROR CODE: DeadlineExceeded; detail message node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is <count>, want <count>; node pool condition AllNodesHealthy is False: <count> of <count> machines are not healthy Machine <node>: InspectionFailed: Waiting for AzureMachine to report spec.providerID; node pool condition AllMachinesReady is False: <count> of <count> machines are not ready Machine <node>: Creating: virtualmachine creating or updating; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | e2e | 9 | 11.69%9 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s) | Show trend detailsSep 29: 0 · Sep 30: 1 · Oct 1: 0 · Oct 2: 2 · Oct 3: 0 · Oct 4: 4 · Oct 5: 11 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-9jh9gn" for cluster "cluster-candidate-5-0-9jh9gn"
Unexpected error:
<*fmt.wrapError | 0x17e9091f29e0>:
failed to create NodePool np-9jh9gn: failed waiting for nodepool="np-9jh9gn" for cluster "cluster-candidate-5-0-9jh9gn" in resourcegroup="rg-candidate-5-0-hhnc656zf7v8" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602",
"name": "cc8a7713-2f0f-40da-953a-e1b9b99c5602",
"status": "Failed",
"startTime": "2026-10-06T00:23:17.637571157Z",
"endTime": "2026-10-06T00:42:19.175724188Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-9jh9gn: failed waiting for nodepool=\"np-9jh9gn\" for cluster \"cluster-candidate-5-0-9jh9gn\" in resourcegroup=\"rg-candidate-5-0-hhnc656zf7v8\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n \"name\": \"cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:17.637571157Z\",\n \"endTime\": \"2026-10-06T00:42:19.175724188Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x17e908176f80>{
msg: "failed waiting for nodepool=\"np-9jh9gn\" for cluster \"cluster-candidate-5-0-9jh9gn\" in resourcegroup=\"rg-candidate-5-0-hhnc656zf7v8\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n \"name\": \"cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:17.637571157Z\",\n \"endTime\": \"2026-10-06T00:42:19.175724188Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x17e909ab8a20>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"41e56312-6ea5-4a44-ae2e-628973948b84",
],
"Date": [
"Tue, 06 Oct 2026 00:42:20 GMT",
],
"Content-Length": ["1222"],
"X-Envoy-Upstream-Service-Time": ["6"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x17e908176a60>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 99, 99, 56, 97, 55, 55, 49, 51, 45, 50, 102, 48, 102, 45, 52, 48, 100, 97, 45, 57, 53, 51, 97, 45, 101, 49, 98, 57, 98, 57, 57, 99, 53, 54, 48, 50, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 99, 99, 56, 97, 55, 55, 49, 51, 45, 50, 102, 48, 102, 45, 52, 48, 100, 97, 45, 57, 53, 51, 97, 45, 101, 49, 98, 57, 98, 57, 57, 99, 53, 54, 48, 50, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 51, 58, 49, 55, 46, 54, 51, 55, 53, 55, 49, 49, 53, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 49, 57, 46, 49, 55, 53, 55, 50, 52, 49, 56, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 56, 109, 104, 52, 106, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 102, 54, 55, 118, 56, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 56, 109, 104, 52, 106, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 102, 54, 55, 118, 56, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1222,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"a05be8f2-de1a-4de0-b563-c8435b71e8f7",
],
"X-Ms-Client-Request-Id": [
"f3e8143c-04a5-4a9a-abf6-e99ae982b4b5",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:42:20Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x17e908fc72b0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [13759147031339684878, 7869995520253709034],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926840305, loc: nil},
NotAfter: {wall: 0, ext: 63942565705, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
AuthorityKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j0653312.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n \"name\": \"cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:17.637571157Z\",\n \"endTime\": \"2026-10-06T00:42:19.175724188Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-9jh9gn" for cluster "cluster-candidate-5-0-9jh9gn"
Unexpected error:
<*fmt.wrapError | 0x17e9091f29e0>:
failed to create NodePool np-9jh9gn: failed waiting for nodepool="np-9jh9gn" for cluster "cluster-candidate-5-0-9jh9gn" in resourcegroup="rg-candidate-5-0-hhnc656zf7v8" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602",
"name": "cc8a7713-2f0f-40da-953a-e1b9b99c5602",
"status": "Failed",
"startTime": "2026-10-06T00:23:17.637571157Z",
"endTime": "2026-10-06T00:42:19.175724188Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-9jh9gn: failed waiting for nodepool=\"np-9jh9gn\" for cluster \"cluster-candidate-5-0-9jh9gn\" in resourcegroup=\"rg-candidate-5-0-hhnc656zf7v8\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n \"name\": \"cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:17.637571157Z\",\n \"endTime\": \"2026-10-06T00:42:19.175724188Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x17e908176f80>{
msg: "failed waiting for nodepool=\"np-9jh9gn\" for cluster \"cluster-candidate-5-0-9jh9gn\" in resourcegroup=\"rg-candidate-5-0-hhnc656zf7v8\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n \"name\": \"cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:17.637571157Z\",\n \"endTime\": \"2026-10-06T00:42:19.175724188Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x17e909ab8a20>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"41e56312-6ea5-4a44-ae2e-628973948b84",
],
"Date": [
"Tue, 06 Oct 2026 00:42:20 GMT",
],
"Content-Length": ["1222"],
"X-Envoy-Upstream-Service-Time": ["6"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x17e908176a60>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 99, 99, 56, 97, 55, 55, 49, 51, 45, 50, 102, 48, 102, 45, 52, 48, 100, 97, 45, 57, 53, 51, 97, 45, 101, 49, 98, 57, 98, 57, 57, 99, 53, 54, 48, 50, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 99, 99, 56, 97, 55, 55, 49, 51, 45, 50, 102, 48, 102, 45, 52, 48, 100, 97, 45, 57, 53, 51, 97, 45, 101, 49, 98, 57, 98, 57, 57, 99, 53, 54, 48, 50, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 51, 58, 49, 55, 46, 54, 51, 55, 53, 55, 49, 49, 53, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 49, 57, 46, 49, 55, 53, 55, 50, 52, 49, 56, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 56, 109, 104, 52, 106, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 102, 54, 55, 118, 56, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 56, 109, 104, 52, 106, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 102, 54, 55, 118, 56, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1222,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"a05be8f2-de1a-4de0-b563-c8435b71e8f7",
],
"X-Ms-Client-Request-Id": [
"f3e8143c-04a5-4a9a-abf6-e99ae982b4b5",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:42:20Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j0653312.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x17e908fc72b0>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [13759147031339684878, 7869995520253709034],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926840305, loc: nil},
NotAfter: {wall: 0, ext: 63942565705, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
AuthorityKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j0653312.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n \"name\": \"cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:23:17.637571157Z\",\n \"endTime\": \"2026-10-06T00:42:19.175724188Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-t5hfj4" for cluster "cluster-candidate-5-0-t5hfj4"
Unexpected error:
<*fmt.wrapError | 0x3b72184d8a40>:
failed to create NodePool np-t5hfj4: failed waiting for nodepool="np-t5hfj4" for cluster "cluster-candidate-5-0-t5hfj4" in resourcegroup="rg-candidate-5-0-2v55vjrk7dfm" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133",
"name": "eff3fb29-4e2b-4687-a19e-15a4aa893133",
"status": "Failed",
"startTime": "2026-10-05T21:05:57.84981301Z",
"endTime": "2026-10-05T21:25:06.303015406Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-t5hfj4: failed waiting for nodepool=\"np-t5hfj4\" for cluster \"cluster-candidate-5-0-t5hfj4\" in resourcegroup=\"rg-candidate-5-0-2v55vjrk7dfm\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n \"name\": \"eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:05:57.84981301Z\",\n \"endTime\": \"2026-10-05T21:25:06.303015406Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3b7218500920>{
msg: "failed waiting for nodepool=\"np-t5hfj4\" for cluster \"cluster-candidate-5-0-t5hfj4\" in resourcegroup=\"rg-candidate-5-0-2v55vjrk7dfm\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n \"name\": \"eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:05:57.84981301Z\",\n \"endTime\": \"2026-10-05T21:25:06.303015406Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x3b7219402930>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["10"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"22ce707c-b71f-46ef-bf90-dcf6f867c005",
],
"Date": [
"Mon, 05 Oct 2026 21:25:11 GMT",
],
"Content-Length": ["1221"],
},
Body: <*exported.nopClosingBytesReader | 0x3b7218500780>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 101, 102, 102, 51, 102, 98, 50, 57, 45, 52, 101, 50, 98, 45, 52, 54, 56, 55, 45, 97, 49, 57, 101, 45, 49, 53, 97, 52, 97, 97, 56, 57, 51, 49, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 101, 102, 102, 51, 102, 98, 50, 57, 45, 52, 101, 50, 98, 45, 52, 54, 56, 55, 45, 97, 49, 57, 101, 45, 49, 53, 97, 52, 97, 97, 56, 57, 51, 49, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 49, 58, 48, 53, 58, 53, 55, 46, 56, 52, 57, 56, 49, 51, 48, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 49, 58, 50, 53, 58, 48, 54, 46, 51, 48, 51, 48, 49, 53, 52, 48, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 102, 113, 54, 109, 115, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 106, 112, 55, 55, 116, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 102, 113, 54, 109, 115, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 106, 112, 55, 55, 116, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1221,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5671936.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"0d7d56a0-1031-45a3-8395-fdaed234a6d6",
],
"X-Ms-Client-Request-Id": [
"83ed7df8-bc83-4538-8779-dd64bcdd8b8f",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T21:25:11Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5671936.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5671936.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 30, 97, 14, 183, 2, 170, 79, 197, 166, 215, 232, 195, 14, 120, 53, 119, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 48, 49, 48, 53, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 48, 50, 48, 53, 57, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 208, 52, 107, 158, 24, 162, 58, 246, 247, 100, 25, 165, 188, 120, 178, 50, 150, 18, 88, 139, 80, 219, 129, 210, 92, 75, 45, 56, 129, 125, 76, 84, 3, 45, 170, 254, 81, 64, 145, 144, 202, 33, 210, 227, 2, 65, 90, 13, 223, 240, 176, 25, 24, 166, 60, 25, 115, 237, 148, 154, 224, 93, 59, 211, 248, 19, 159, 37, 43, 63, 177, 79, 92, 8, 59, 222, 119, 65, 50, 185, 115, 219, 224, 95, 122, 158, 50, 126, 203, 36, 202, 47, 90, 97, 29, 64, 153, 4, 176, 70, 67, 36, 50, 33, 117, 66, 173, 152, 10, 148, 148, 23, 231, 51, 114, 246, 227, 227, 17, 201, 178, 59, 202, 113, 71, 118, 104, 85, 204, 211, 130, 101, 39, 68, 123, 253, 4, 156, 221, 31, 183, 107, 125, 86, 161, 36, 53, 233, 248, 159, 48, 180, 32, 66, 83, 96, 75, 226, 215, 70, 182, 205, 57, 246, 40, 101, 62, 96, 48, 0, 252, 188, 162, 162, 173, 236, 33, 201, 115, 202, 91, 82, 61, 7, 85, 245, 129, 8, 182, 202, 141, 80, 38, 240, 219, 49, 151, 171, 88, 248, 128, 233, 116, 10, 134, 82, 97, 128, 188, 32, 27, 219, 82, 174, 4, 222, 189, 223, 8, 232, 104, 10, 59, 238, 102, 116, 0, 91, 117, 141, 17, 191, 44, 252, 50, 112, 68, 51, 17, 82, 229, 98, 1, 175, 62, 143, 219, 161, 109, 243, 220, 13, 164, 9, 60, 153, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 34, 138, 183, 177, 196, 6, 163, 227, 242, 231, 107, 169, 23, 218, 3, 15, 224, 125, 135, 143, 185, 192, 61, 116, 213, 140, 10, 238, 101, 114, 113, 236, 115, 4, 123, 184, 73, 176, 151, 225, 249, 49, 173, 130, 231, 175, 113, 13, 52, 46, 85, 113, 42, 8, 142, 171, 12, 147, 245, 144, 198, 240, 213, 213, 249, 55, 7, 71, 59, 55, 48, 160, 17, 203, 192, 207, 0, 231, 180, 60, 46, 124, 221, 174, 56, 215, 240, 169, 169, 8, 60, 23, 81, 201, 46, 67, 119, 87, 144, 34, 70, 37, 173, 148, 206, 229, 63, 150, 194, 134, 166, 125, 37, 133, 47, 51, 46, 224, 109, 71, 17, 100, 21, 45, 18, 32, 214, 243, 203, 226, 52, 107, 252, 20, 215, 215, 18, 46, 173, 109, 174, 154, 107, 53, 58, 127, 185, 76, 216, 223, 83, 128, 159, 0, 31, 4, 65, 43, 173, 28, 223, 138, 127, 12, 73, 18, 190, 199, 41, 235, 45, 76, 147, 240, 179, 40, 200, 51, 84, 244, 74, 24, 114, 116, 9, 195, 78, 205, 87, 254, 134, 160, 225, 31, 111, 71, 33, 206, 197, 238, 83, 110, 67, 254, 223, 160, 86, 152, 246, 115, 114, 94, 76, 5, 144, 13, 195, 182, 68, 218, 225, 17, 222, 177, 216, 18, 237, 105, 214, 181, 204, 67, 244, 23, 201, 246, 156, 29, 15, 13, 254, 137, 172, 157, 162, 188, 169, 39, 194, 230, 172, 160, 50, 80, 242, 139],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 30, 97, 14, 183, 2, 170, 79, 197, 166, 215, 232, 195, 14, 120, 53, 119, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 48, 49, 48, 53, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 48, 50, 48, 53, 57, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 208, 52, 107, 158, 24, 162, 58, 246, 247, 100, 25, 165, 188, 120, 178, 50, 150, 18, 88, 139, 80, 219, 129, 210, 92, 75, 45, 56, 129, 125, 76, 84, 3, 45, 170, 254, 81, 64, 145, 144, 202, 33, 210, 227, 2, 65, 90, 13, 223, 240, 176, 25, 24, 166, 60, 25, 115, 237, 148, 154, 224, 93, 59, 211, 248, 19, 159, 37, 43, 63, 177, 79, 92, 8, 59, 222, 119, 65, 50, 185, 115, 219, 224, 95, 122, 158, 50, 126, 203, 36, 202, 47, 90, 97, 29, 64, 153, 4, 176, 70, 67, 36, 50, 33, 117, 66, 173, 152, 10, 148, 148, 23, 231, 51, 114, 246, 227, 227, 17, 201, 178, 59, 202, 113, 71, 118, 104, 85, 204, 211, 130, 101, 39, 68, 123, 253, 4, 156, 221, 31, 183, 107, 125, 86, 161, 36, 53, 233, 248, 159, 48, 180, 32, 66, 83, 96, 75, 226, 215, 70, 182, 205, 57, 246, 40, 101, 62, 96, 48, 0, 252, 188, 162, 162, 173, 236, 33, 201, 115, 202, 91, 82, 61, 7, 85, 245, 129, 8, 182, 202, 141, 80, 38, 240, 219, 49, 151, 171, 88, 248, 128, 233, 116, 10, 134, 82, 97, 128, 188, 32, 27, 219, 82, 174, 4, 222, 189, 223, 8, 232, 104, 10, 59, 238, 102, 116, 0, 91, 117, 141, 17, 191, 44, 252, 50, 112, 68, 51, 17, 82, 229, 98, 1, 175, 62, 143, 219, 161, 109, 243, 220, 13, 164, 9, 60, 153, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 208, 52, 107, 158, 24, 162, 58, 246, 247, 100, 25, 165, 188, 120, 178, 50, 150, 18, 88, 139, 80, 219, 129, 210, 92, 75, 45, 56, 129, 125, 76, 84, 3, 45, 170, 254, 81, 64, 145, 144, 202, 33, 210, 227, 2, 65, 90, 13, 223, 240, 176, 25, 24, 166, 60, 25, 115, 237, 148, 154, 224, 93, 59, 211, 248, 19, 159, 37, 43, 63, 177, 79, 92, 8, 59, 222, 119, 65, 50, 185, 115, 219, 224, 95, 122, 158, 50, 126, 203, 36, 202, 47, 90, 97, 29, 64, 153, 4, 176, 70, 67, 36, 50, 33, 117, 66, 173, 152, 10, 148, 148, 23, 231, 51, 114, 246, 227, 227, 17, 201, 178, 59, 202, 113, 71, 118, 104, 85, 204, 211, 130, 101, 39, 68, 123, 253, 4, 156, 221, 31, 183, 107, 125, 86, 161, 36, 53, 233, 248, 159, 48, 180, 32, 66, 83, 96, 75, 226, 215, 70, 182, 205, 57, 246, 40, 101, 62, 96, 48, 0, 252, 188, 162, 162, 173, 236, 33, 201, 115, 202, 91, 82, 61, 7, 85, 245, 129, 8, 182, 202, 141, 80, 38, 240, 219, 49, 151, 171, 88, 248, 128, 233, 116, 10, 134, 82, 97, 128, 188, 32, 27, 219, 82, 174, 4, 222, 189, 223, 8, 232, 104, 10, 59, 238, 102, 116, 0, 91, 117, 141, 17, 191, 44, 252, 50, 112, 68, 51, 17, 82, 229, 98, 1, 175, 62, 143, 219, 161, 109, 243, 220, 13, 164, 9, 60, 153, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [34, 138, 183, 177, 196, 6, 163, 227, 242, 231, 107, 169, 23, 218, 3, 15, 224, 125, 135, 143, 185, 192, 61, 116, 213, 140, 10, 238, 101, 114, 113, 236, 115, 4, 123, 184, 73, 176, 151, 225, 249, 49, 173, 130, 231, 175, 113, 13, 52, 46, 85, 113, 42, 8, 142, 171, 12, 147, 245, 144, 198, 240, 213, 213, 249, 55, 7, 71, 59, 55, 48, 160, 17, 203, 192, 207, 0, 231, 180, 60, 46, 124, 221, 174, 56, 215, 240, 169, 169, 8, 60, 23, 81, 201, 46, 67, 119, 87, 144, 34, 70, 37, 173, 148, 206, 229, 63, 150, 194, 134, 166, 125, 37, 133, 47, 51, 46, 224, 109, 71, 17, 100, 21, 45, 18, 32, 214, 243, 203, 226, 52, 107, 252, 20, 215, 215, 18, 46, 173, 109, 174, 154, 107, 53, 58, 127, 185, 76, 216, 223, 83, 128, 159, 0, 31, 4, 65, 43, 173, 28, 223, 138, 127, 12, 73, 18, 190, 199, 41, 235, 45, 76, 147, 240, 179, 40, 200, 51, 84, 244, 74, 24, 114, 116, 9, 195, 78, 205, 87, 254, 134, 160, 225, 31, 111, 71, 33, 206, 197, 238, 83, 110, 67, 254, 223, 160, 86, 152, 246, 115, 114, 94, 76, 5, 144, 13, 195, 182, 68, 218, 225, 17, 222, 177, 216, 18, 237, 105, 214, 181, 204, 67, 244, 23, 201, 246, 156, 29, 15, 13, 254, 137, 172, 157, 162, 188, 169, 39, 194, 230, 172, 160, 50, 80, 242, 139],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x3b7217dc8a30>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12022333654747854199, 2189047073065291717],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5671936.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5671936.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926827859, loc: nil},
NotAfter: {wall: 0, ext: 63942553259, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149],
AuthorityKeyId: [199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j5671936.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n \"name\": \"eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:05:57.84981301Z\",\n \"endTime\": \"2026-10-05T21:25:06.303015406Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-t5hfj4" for cluster "cluster-candidate-5-0-t5hfj4"
Unexpected error:
<*fmt.wrapError | 0x3b72184d8a40>:
failed to create NodePool np-t5hfj4: failed waiting for nodepool="np-t5hfj4" for cluster "cluster-candidate-5-0-t5hfj4" in resourcegroup="rg-candidate-5-0-2v55vjrk7dfm" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133",
"name": "eff3fb29-4e2b-4687-a19e-15a4aa893133",
"status": "Failed",
"startTime": "2026-10-05T21:05:57.84981301Z",
"endTime": "2026-10-05T21:25:06.303015406Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool np-t5hfj4: failed waiting for nodepool=\"np-t5hfj4\" for cluster \"cluster-candidate-5-0-t5hfj4\" in resourcegroup=\"rg-candidate-5-0-2v55vjrk7dfm\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n \"name\": \"eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:05:57.84981301Z\",\n \"endTime\": \"2026-10-05T21:25:06.303015406Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3b7218500920>{
msg: "failed waiting for nodepool=\"np-t5hfj4\" for cluster \"cluster-candidate-5-0-t5hfj4\" in resourcegroup=\"rg-candidate-5-0-2v55vjrk7dfm\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n \"name\": \"eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:05:57.84981301Z\",\n \"endTime\": \"2026-10-05T21:25:06.303015406Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x3b7219402930>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"X-Envoy-Upstream-Service-Time": ["10"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"22ce707c-b71f-46ef-bf90-dcf6f867c005",
],
"Date": [
"Mon, 05 Oct 2026 21:25:11 GMT",
],
"Content-Length": ["1221"],
},
Body: <*exported.nopClosingBytesReader | 0x3b7218500780>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 101, 102, 102, 51, 102, 98, 50, 57, 45, 52, 101, 50, 98, 45, 52, 54, 56, 55, 45, 97, 49, 57, 101, 45, 49, 53, 97, 52, 97, 97, 56, 57, 51, 49, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 101, 102, 102, 51, 102, 98, 50, 57, 45, 52, 101, 50, 98, 45, 52, 54, 56, 55, 45, 97, 49, 57, 101, 45, 49, 53, 97, 52, 97, 97, 56, 57, 51, 49, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 49, 58, 48, 53, 58, 53, 55, 46, 56, 52, 57, 56, 49, 51, 48, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 49, 58, 50, 53, 58, 48, 54, 46, 51, 48, 51, 48, 49, 53, 52, 48, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 102, 113, 54, 109, 115, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 106, 112, 55, 55, 116, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 102, 113, 54, 109, 115, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 106, 112, 55, 55, 116, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1221,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5671936.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"0d7d56a0-1031-45a3-8395-fdaed234a6d6",
],
"X-Ms-Client-Request-Id": [
"83ed7df8-bc83-4538-8779-dd64bcdd8b8f",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T21:25:11Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5671936.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5671936.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 30, 97, 14, 183, 2, 170, 79, 197, 166, 215, 232, 195, 14, 120, 53, 119, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 48, 49, 48, 53, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 48, 50, 48, 53, 57, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 208, 52, 107, 158, 24, 162, 58, 246, 247, 100, 25, 165, 188, 120, 178, 50, 150, 18, 88, 139, 80, 219, 129, 210, 92, 75, 45, 56, 129, 125, 76, 84, 3, 45, 170, 254, 81, 64, 145, 144, 202, 33, 210, 227, 2, 65, 90, 13, 223, 240, 176, 25, 24, 166, 60, 25, 115, 237, 148, 154, 224, 93, 59, 211, 248, 19, 159, 37, 43, 63, 177, 79, 92, 8, 59, 222, 119, 65, 50, 185, 115, 219, 224, 95, 122, 158, 50, 126, 203, 36, 202, 47, 90, 97, 29, 64, 153, 4, 176, 70, 67, 36, 50, 33, 117, 66, 173, 152, 10, 148, 148, 23, 231, 51, 114, 246, 227, 227, 17, 201, 178, 59, 202, 113, 71, 118, 104, 85, 204, 211, 130, 101, 39, 68, 123, 253, 4, 156, 221, 31, 183, 107, 125, 86, 161, 36, 53, 233, 248, 159, 48, 180, 32, 66, 83, 96, 75, 226, 215, 70, 182, 205, 57, 246, 40, 101, 62, 96, 48, 0, 252, 188, 162, 162, 173, 236, 33, 201, 115, 202, 91, 82, 61, 7, 85, 245, 129, 8, 182, 202, 141, 80, 38, 240, 219, 49, 151, 171, 88, 248, 128, 233, 116, 10, 134, 82, 97, 128, 188, 32, 27, 219, 82, 174, 4, 222, 189, 223, 8, 232, 104, 10, 59, 238, 102, 116, 0, 91, 117, 141, 17, 191, 44, 252, 50, 112, 68, 51, 17, 82, 229, 98, 1, 175, 62, 143, 219, 161, 109, 243, 220, 13, 164, 9, 60, 153, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 34, 138, 183, 177, 196, 6, 163, 227, 242, 231, 107, 169, 23, 218, 3, 15, 224, 125, 135, 143, 185, 192, 61, 116, 213, 140, 10, 238, 101, 114, 113, 236, 115, 4, 123, 184, 73, 176, 151, 225, 249, 49, 173, 130, 231, 175, 113, 13, 52, 46, 85, 113, 42, 8, 142, 171, 12, 147, 245, 144, 198, 240, 213, 213, 249, 55, 7, 71, 59, 55, 48, 160, 17, 203, 192, 207, 0, 231, 180, 60, 46, 124, 221, 174, 56, 215, 240, 169, 169, 8, 60, 23, 81, 201, 46, 67, 119, 87, 144, 34, 70, 37, 173, 148, 206, 229, 63, 150, 194, 134, 166, 125, 37, 133, 47, 51, 46, 224, 109, 71, 17, 100, 21, 45, 18, 32, 214, 243, 203, 226, 52, 107, 252, 20, 215, 215, 18, 46, 173, 109, 174, 154, 107, 53, 58, 127, 185, 76, 216, 223, 83, 128, 159, 0, 31, 4, 65, 43, 173, 28, 223, 138, 127, 12, 73, 18, 190, 199, 41, 235, 45, 76, 147, 240, 179, 40, 200, 51, 84, 244, 74, 24, 114, 116, 9, 195, 78, 205, 87, 254, 134, 160, 225, 31, 111, 71, 33, 206, 197, 238, 83, 110, 67, 254, 223, 160, 86, 152, 246, 115, 114, 94, 76, 5, 144, 13, 195, 182, 68, 218, 225, 17, 222, 177, 216, 18, 237, 105, 214, 181, 204, 67, 244, 23, 201, 246, 156, 29, 15, 13, 254, 137, 172, 157, 162, 188, 169, 39, 194, 230, 172, 160, 50, 80, 242, 139],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 30, 97, 14, 183, 2, 170, 79, 197, 166, 215, 232, 195, 14, 120, 53, 119, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 48, 49, 48, 53, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 48, 50, 48, 53, 57, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 208, 52, 107, 158, 24, 162, 58, 246, 247, 100, 25, 165, 188, 120, 178, 50, 150, 18, 88, 139, 80, 219, 129, 210, 92, 75, 45, 56, 129, 125, 76, 84, 3, 45, 170, 254, 81, 64, 145, 144, 202, 33, 210, 227, 2, 65, 90, 13, 223, 240, 176, 25, 24, 166, 60, 25, 115, 237, 148, 154, 224, 93, 59, 211, 248, 19, 159, 37, 43, 63, 177, 79, 92, 8, 59, 222, 119, 65, 50, 185, 115, 219, 224, 95, 122, 158, 50, 126, 203, 36, 202, 47, 90, 97, 29, 64, 153, 4, 176, 70, 67, 36, 50, 33, 117, 66, 173, 152, 10, 148, 148, 23, 231, 51, 114, 246, 227, 227, 17, 201, 178, 59, 202, 113, 71, 118, 104, 85, 204, 211, 130, 101, 39, 68, 123, 253, 4, 156, 221, 31, 183, 107, 125, 86, 161, 36, 53, 233, 248, 159, 48, 180, 32, 66, 83, 96, 75, 226, 215, 70, 182, 205, 57, 246, 40, 101, 62, 96, 48, 0, 252, 188, 162, 162, 173, 236, 33, 201, 115, 202, 91, 82, 61, 7, 85, 245, 129, 8, 182, 202, 141, 80, 38, 240, 219, 49, 151, 171, 88, 248, 128, 233, 116, 10, 134, 82, 97, 128, 188, 32, 27, 219, 82, 174, 4, 222, 189, 223, 8, 232, 104, 10, 59, 238, 102, 116, 0, 91, 117, 141, 17, 191, 44, 252, 50, 112, 68, 51, 17, 82, 229, 98, 1, 175, 62, 143, 219, 161, 109, 243, 220, 13, 164, 9, 60, 153, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 208, 52, 107, 158, 24, 162, 58, 246, 247, 100, 25, 165, 188, 120, 178, 50, 150, 18, 88, 139, 80, 219, 129, 210, 92, 75, 45, 56, 129, 125, 76, 84, 3, 45, 170, 254, 81, 64, 145, 144, 202, 33, 210, 227, 2, 65, 90, 13, 223, 240, 176, 25, 24, 166, 60, 25, 115, 237, 148, 154, 224, 93, 59, 211, 248, 19, 159, 37, 43, 63, 177, 79, 92, 8, 59, 222, 119, 65, 50, 185, 115, 219, 224, 95, 122, 158, 50, 126, 203, 36, 202, 47, 90, 97, 29, 64, 153, 4, 176, 70, 67, 36, 50, 33, 117, 66, 173, 152, 10, 148, 148, 23, 231, 51, 114, 246, 227, 227, 17, 201, 178, 59, 202, 113, 71, 118, 104, 85, 204, 211, 130, 101, 39, 68, 123, 253, 4, 156, 221, 31, 183, 107, 125, 86, 161, 36, 53, 233, 248, 159, 48, 180, 32, 66, 83, 96, 75, 226, 215, 70, 182, 205, 57, 246, 40, 101, 62, 96, 48, 0, 252, 188, 162, 162, 173, 236, 33, 201, 115, 202, 91, 82, 61, 7, 85, 245, 129, 8, 182, 202, 141, 80, 38, 240, 219, 49, 151, 171, 88, 248, 128, 233, 116, 10, 134, 82, 97, 128, 188, 32, 27, 219, 82, 174, 4, 222, 189, 223, 8, 232, 104, 10, 59, 238, 102, 116, 0, 91, 117, 141, 17, 191, 44, 252, 50, 112, 68, 51, 17, 82, 229, 98, 1, 175, 62, 143, 219, 161, 109, 243, 220, 13, 164, 9, 60, 153, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [34, 138, 183, 177, 196, 6, 163, 227, 242, 231, 107, 169, 23, 218, 3, 15, 224, 125, 135, 143, 185, 192, 61, 116, 213, 140, 10, 238, 101, 114, 113, 236, 115, 4, 123, 184, 73, 176, 151, 225, 249, 49, 173, 130, 231, 175, 113, 13, 52, 46, 85, 113, 42, 8, 142, 171, 12, 147, 245, 144, 198, 240, 213, 213, 249, 55, 7, 71, 59, 55, 48, 160, 17, 203, 192, 207, 0, 231, 180, 60, 46, 124, 221, 174, 56, 215, 240, 169, 169, 8, 60, 23, 81, 201, 46, 67, 119, 87, 144, 34, 70, 37, 173, 148, 206, 229, 63, 150, 194, 134, 166, 125, 37, 133, 47, 51, 46, 224, 109, 71, 17, 100, 21, 45, 18, 32, 214, 243, 203, 226, 52, 107, 252, 20, 215, 215, 18, 46, 173, 109, 174, 154, 107, 53, 58, 127, 185, 76, 216, 223, 83, 128, 159, 0, 31, 4, 65, 43, 173, 28, 223, 138, 127, 12, 73, 18, 190, 199, 41, 235, 45, 76, 147, 240, 179, 40, 200, 51, 84, 244, 74, 24, 114, 116, 9, 195, 78, 205, 87, 254, 134, 160, 225, 31, 111, 71, 33, 206, 197, 238, 83, 110, 67, 254, 223, 160, 86, 152, 246, 115, 114, 94, 76, 5, 144, 13, 195, 182, 68, 218, 225, 17, 222, 177, 216, 18, 237, 105, 214, 181, 204, 67, 244, 23, 201, 246, 156, 29, 15, 13, 254, 137, 172, 157, 162, 188, 169, 39, 194, 230, 172, 160, 50, 80, 242, 139],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x3b7217dc8a30>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12022333654747854199, 2189047073065291717],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5671936.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j5671936.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926827859, loc: nil},
NotAfter: {wall: 0, ext: 63942553259, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149],
AuthorityKeyId: [199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j5671936.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n \"name\": \"eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:05:57.84981301Z\",\n \"endTime\": \"2026-10-05T21:25:06.303015406Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:193]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
<*errors.joinError | 0x2243588ac018>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool cilium-np: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-dklbwx4k8h7p" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea",
"name": "4313eb46-0b05-4007-840d-8e81ff915eea",
"status": "Failed",
"startTime": "2026-10-05T20:52:58.706374258Z",
"endTime": "2026-10-05T21:12:06.475127472Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x2243588ac000>{
errs: [
<*fmt.wrapError | 0x224357647460>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x2243570fbc10>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x2243570ec8a0>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x2243570ec820>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x2243570ec740>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x2243570ec6e0>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x2243586cd060>{
msg: "failed to create NodePool cilium-np: failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-dklbwx4k8h7p\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\",\n \"name\": \"4313eb46-0b05-4007-840d-8e81ff915eea\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:52:58.706374258Z\",\n \"endTime\": \"2026-10-05T21:12:06.475127472Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x224357360000>{
msg: "failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-dklbwx4k8h7p\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\",\n \"name\": \"4313eb46-0b05-4007-840d-8e81ff915eea\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:52:58.706374258Z\",\n \"endTime\": \"2026-10-05T21:12:06.475127472Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x22435832c930>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"37082432-c7c9-4882-98ce-0027d6dea282",
],
"Date": [
"Mon, 05 Oct 2026 21:12:12 GMT",
],
"Content-Length": ["1218"],
"X-Envoy-Upstream-Service-Time": ["7"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x224356319ba0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 52, 51, 49, 51, 101, 98, 52, 54, 45, 48, 98, 48, 53, 45, 52, 48, 48, 55, 45, 56, 52, 48, 100, 45, 56, 101, 56, 49, 102, 102, 57, 49, 53, 101, 101, 97, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 52, 51, 49, 51, 101, 98, 52, 54, 45, 48, 98, 48, 53, 45, 52, 48, 48, 55, 45, 56, 52, 48, 100, 45, 56, 101, 56, 49, 102, 102, 57, 49, 53, 101, 101, 97, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 48, 58, 53, 50, 58, 53, 56, 46, 55, 48, 54, 51, 55, 52, 50, 53, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 49, 58, 49, 50, 58, 48, 54, 46, 52, 55, 53, 49, 50, 55, 52, 55, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 115, 120, 122, 98, 119, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 116, 116, 109, 103, 113, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 115, 120, 122, 98, 119, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 116, 116, 109, 103, 113, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1218,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5671936.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"c58f606d-d104-427c-a178-b7cb4021a6e9",
],
"X-Ms-Client-Request-Id": [
"66043e95-d8d0-4c18-ad76-32d33b54c78e",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T21:12:12Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5671936.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5671936.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x224356b65dd0>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\",\n \"name\": \"4313eb46-0b05-4007-840d-8e81ff915eea\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:52:58.706374258Z\",\n \"endTime\": \"2026-10-05T21:12:06.475127472Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:193]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
<*errors.joinError | 0x2243588ac018>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool cilium-np: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-dklbwx4k8h7p" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea",
"name": "4313eb46-0b05-4007-840d-8e81ff915eea",
"status": "Failed",
"startTime": "2026-10-05T20:52:58.706374258Z",
"endTime": "2026-10-05T21:12:06.475127472Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x2243588ac000>{
errs: [
<*fmt.wrapError | 0x224357647460>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x2243570fbc10>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x2243570ec8a0>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x2243570ec820>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x2243570ec740>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x2243570ec6e0>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x2243586cd060>{
msg: "failed to create NodePool cilium-np: failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-dklbwx4k8h7p\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\",\n \"name\": \"4313eb46-0b05-4007-840d-8e81ff915eea\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:52:58.706374258Z\",\n \"endTime\": \"2026-10-05T21:12:06.475127472Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x224357360000>{
msg: "failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-dklbwx4k8h7p\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\",\n \"name\": \"4313eb46-0b05-4007-840d-8e81ff915eea\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:52:58.706374258Z\",\n \"endTime\": \"2026-10-05T21:12:06.475127472Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x22435832c930>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"37082432-c7c9-4882-98ce-0027d6dea282",
],
"Date": [
"Mon, 05 Oct 2026 21:12:12 GMT",
],
"Content-Length": ["1218"],
"X-Envoy-Upstream-Service-Time": ["7"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x224356319ba0>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 52, 51, 49, 51, 101, 98, 52, 54, 45, 48, 98, 48, 53, 45, 52, 48, 48, 55, 45, 56, 52, 48, 100, 45, 56, 101, 56, 49, 102, 102, 57, 49, 53, 101, 101, 97, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 52, 51, 49, 51, 101, 98, 52, 54, 45, 48, 98, 48, 53, 45, 52, 48, 48, 55, 45, 56, 52, 48, 100, 45, 56, 101, 56, 49, 102, 102, 57, 49, 53, 101, 101, 97, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 48, 58, 53, 50, 58, 53, 56, 46, 55, 48, 54, 51, 55, 52, 50, 53, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 49, 58, 49, 50, 58, 48, 54, 46, 52, 55, 53, 49, 50, 55, 52, 55, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 115, 120, 122, 98, 119, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 116, 116, 109, 103, 113, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 115, 120, 122, 98, 119, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 116, 116, 109, 103, 113, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1218,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j5671936.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"c58f606d-d104-427c-a178-b7cb4021a6e9",
],
"X-Ms-Client-Request-Id": [
"66043e95-d8d0-4c18-ad76-32d33b54c78e",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T21:12:12Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j5671936.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j5671936.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x224356b65dd0>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\",\n \"name\": \"4313eb46-0b05-4007-840d-8e81ff915eea\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:52:58.706374258Z\",\n \"endTime\": \"2026-10-05T21:12:06.475127472Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurredContributing tests (7)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [svc] LeaderElectionLeaseStale firedfull failure pattern: alert [svc] LeaderElectionLeaseStale fired Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | alert | 5 | 6.49%5 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 5 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)alert fired 1 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-06T01:01:28Z Severity: Sev3 Labels: alertname="LeaderElectionLeaseStale", cluster="ci01-j6038912-mgmt-2", component="leader-election", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.64.230:8080", job="kube-state-metrics", lease="work-manager", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j6038912/providers/microsoft.monitor/accounts/services-j6038912", namespace="klusterlet-2t8uhfivnm450b2fl6uiq41b82l9m9fc", pod="arohcp-monitor-kube-state-metrics-7988dc648c-ws9wv", prometheus="prometheus/prometheus", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Leader election lease work-manager in namespace klusterlet-2t8uhfivnm450b2fl6uiq41b82l9m9fc on cluster ci01-j6038912-mgmt-2 has not been renewed for more than 37 minutes. The leadership election might be broken or the component stopped running. alert fired 1 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T22:41:11Z Severity: Sev3 Labels: alertname="LeaderElectionLeaseStale", cluster="ci01-j9458816-mgmt-1", component="leader-election", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.64.203:8080", job="kube-state-metrics", lease="work-manager", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j9458816/providers/microsoft.monitor/accounts/services-j9458816", namespace="klusterlet-2t8sos08t7f50ar87gub82859okilcug", pod="arohcp-monitor-kube-state-metrics-7988dc648c-pn8d2", prometheus="prometheus/prometheus", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Leader election lease work-manager in namespace klusterlet-2t8sos08t7f50ar87gub82859okilcug on cluster ci01-j9458816-mgmt-1 has not been renewed for more than 37 minutes. The leadership election might be broken or the component stopped running. alert fired 1 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T18:42:58Z Severity: Sev3 Labels: alertname="LeaderElectionLeaseStale", cluster="ci01-j1560448-mgmt-2", component="leader-election", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.64.53:8080", job="kube-state-metrics", lease="work-manager", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j1560448/providers/microsoft.monitor/accounts/services-j1560448", namespace="klusterlet-2t8p380dnntirukhp2rf1g7u6glr2fjq", pod="arohcp-monitor-kube-state-metrics-7988dc648c-pfx2c", prometheus="prometheus/prometheus", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: Leader election lease work-manager in namespace klusterlet-2t8p380dnntirukhp2rf1g7u6glr2fjq on cluster ci01-j1560448-mgmt-2 has not been renewed for more than 37 minutes. The leadership election might be broken or the component stopped running. Contributing tests (1)
Affected runs (5) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
cluster <resource-group>/<cluster> entered terminal state "Failed" after role assignment deployment; expected "Succeeded"full failure pattern: cluster <resource-group>/<cluster> entered terminal state "Failed" after role assignment deployment; expected "Succeeded" Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 4 | 5.19%4 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 4 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:227]: Timed out after 2580.002s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:223 with:
cluster delayed-rbac-pmvwvlccl4hc/delayed-rbac-cluster entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Expected
<armredhatopenshifthcp.ProvisioningState>: Failed
not to equal
<armredhatopenshifthcp.ProvisioningState>: Failed
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:227]: Timed out after 2580.002s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:223 with:
cluster delayed-rbac-pmvwvlccl4hc/delayed-rbac-cluster entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Expected
<armredhatopenshifthcp.ProvisioningState>: Failed
not to equal
<armredhatopenshifthcp.ProvisioningState>: Failedfail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:227]: Timed out after 2580.001s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:223 with:
cluster delayed-rbac-nzfbx8vgn7wz/delayed-rbac-cluster entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Expected
<armredhatopenshifthcp.ProvisioningState>: Failed
not to equal
<armredhatopenshifthcp.ProvisioningState>: Failed
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:227]: Timed out after 2580.001s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:223 with:
cluster delayed-rbac-nzfbx8vgn7wz/delayed-rbac-cluster entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Expected
<armredhatopenshifthcp.ProvisioningState>: Failed
not to equal
<armredhatopenshifthcp.ProvisioningState>: Failedfail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:227]: Timed out after 2580.000s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:223 with:
cluster delayed-rbac-gnhv4nf2dxjt/delayed-rbac-cluster entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Expected
<armredhatopenshifthcp.ProvisioningState>: Failed
not to equal
<armredhatopenshifthcp.ProvisioningState>: Failed
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:227]: Timed out after 2580.000s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:223 with:
cluster delayed-rbac-gnhv4nf2dxjt/delayed-rbac-cluster entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Expected
<armredhatopenshifthcp.ProvisioningState>: Failed
not to equal
<armredhatopenshifthcp.ProvisioningState>: FailedContributing tests (1)
Affected runs (4)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeadlineExceeded; detail message cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation "hypershift.openshi...full failure pattern: ERROR CODE: DeadlineExceeded; detail message cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation "hypershift.openshift.io/cluster-size-override" is "e2e_minimal; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | e2e | 3 | 3.90%3 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 6 · Oct 3: 0 · Oct 4: 0 · Oct 5: 18 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:157]: failed to enable immediate z-stream updates for cluster "cluster-zstream-4-22-lwxlkb" on minor version 4.22
Unexpected error:
<*fmt.wrapError | 0x2afb5dd946a0>:
failed waiting for hcpCluster="cluster-zstream-4-22-lwxlkb" in resourcegroup="rg-zstream-upgrade-4-22-5q7qc8tlh4kp" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec",
"name": "3cff28ee-8bd4-42d9-be1c-d9b8c03295ec",
"status": "Failed",
"startTime": "2026-10-06T00:22:51.891905144Z",
"endTime": "2026-10-06T01:06:59.493085695Z",
"error": {
"code": "DeadlineExceeded",
"message": "cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \"hypershift.openshift.io/cluster-size-override\" is \"e2e_minimal\", want unset"
}
}
--------------------------------------------------------------------------------
{
msg: "failed waiting for hcpCluster=\"cluster-zstream-4-22-lwxlkb\" in resourcegroup=\"rg-zstream-upgrade-4-22-5q7qc8tlh4kp\" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n \"name\": \"3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:22:51.891905144Z\",\n \"endTime\": \"2026-10-06T01:06:59.493085695Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x2afb5e2dcc30>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Tue, 06 Oct 2026 01:06:59 GMT",
],
"Content-Length": ["630"],
"X-Envoy-Upstream-Service-Time": ["7"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"65d4500a-52e6-47d9-8230-9c41799caff7",
],
},
Body: <*exported.nopClosingBytesReader | 0x2afb5dd94500>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 51, 99, 102, 102, 50, 56, 101, 101, 45, 56, 98, 100, 52, 45, 52, 50, 100, 57, 45, 98, 101, 49, 99, 45, 100, 57, 98, 56, 99, 48, 51, 50, 57, 53, 101, 99, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 51, 99, 102, 102, 50, 56, 101, 101, 45, 56, 98, 100, 52, 45, 52, 50, 100, 57, 45, 98, 101, 49, 99, 45, 100, 57, 98, 56, 99, 48, 51, 50, 57, 53, 101, 99, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 50, 58, 53, 49, 46, 56, 57, 49, 57, 48, 53, 49, 52, 52, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 54, 58, 53, 57, 46, 52, 57, 51, 48, 56, 53, 54, 57, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 117, 112, 100, 97, 116, 101, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 32, 97, 110, 110, 111, 116, 97, 116, 105, 111, 110, 32, 92, 34, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 46, 111, 112, 101, 110, 115, 104, 105, 102, 116, 46, 105, 111, 47, 99, 108, 117, 115, 116, 101, 114, 45, 115, 105, 122, 101, 45, 111, 118, 101, 114, 114, 105, 100, 101, 92, 34, 32, 105, 115, 32, 92, 34, 101, 50, 101, 95, 109, 105, 110, 105, 109, 97, 108, 92, 34, 44, 32, 119, 97, 110, 116, 32, 117, 110, 115, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 630,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j1885952.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Authorization": ["redacted"],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"188d1353-4bcc-4d38-8ca0-747098bc4fcc",
],
"X-Ms-Client-Request-Id": [
"1f54466c-09d6-4184-aa66-a979833d7d9c",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:06:59Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j1885952.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j1885952.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x2afb5d6a77f0>{
N: {
neg: false,
abs: [3068567393388915637, 16980575011879626626, 1143429630724641330, 4357716528635308419, 14509279396282781695, 8012192304601109313, 12731425424932449437, 16218207639835800800, 9142932487825696990, 16738473375682974529, 1473145742940968862, 10913254662357785291, 1856048742326068571, 8770402314205256839, 9228606020248993988, 557794537014387369, 3824968776435855308, 10957419960421347103, 7474943306238664987, 3047980741256319609, 14978025719175353246, 11663117024742676563, 5169280679099061512, 2777846026196397634, 5044857496703086169, 6968372143110153208, 338484629816585964, 718547086373088529, 10057371115081859903, 3762736957744799474, 1192345205811091089, 15945793549273525672],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12993975585620420545, 1688428045211159510],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926840348, loc: nil},
NotAfter: {wall: 0, ext: 63942565748, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [2, 5, 29, 15],
Critical: true,
Value: [3, 2, 5, 160],
},
{Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
{
Id: [2, 5, 29, 37],
Critical: false,
Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
},
{
Id: [2, 5, 29, 17],
Critical: false,
Value: [48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
},
{
Id: [2, 5, 29, 35],
Critical: false,
Value: [48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
},
{
Id: [2, 5, 29, 14],
Critical: false,
Value: [4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
AuthorityKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j1885952.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n \"name\": \"3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:22:51.891905144Z\",\n \"endTime\": \"2026-10-06T01:06:59.493085695Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:157]: failed to enable immediate z-stream updates for cluster "cluster-zstream-4-22-lwxlkb" on minor version 4.22
Unexpected error:
<*fmt.wrapError | 0x2afb5dd946a0>:
failed waiting for hcpCluster="cluster-zstream-4-22-lwxlkb" in resourcegroup="rg-zstream-upgrade-4-22-5q7qc8tlh4kp" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec",
"name": "3cff28ee-8bd4-42d9-be1c-d9b8c03295ec",
"status": "Failed",
"startTime": "2026-10-06T00:22:51.891905144Z",
"endTime": "2026-10-06T01:06:59.493085695Z",
"error": {
"code": "DeadlineExceeded",
"message": "cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \"hypershift.openshift.io/cluster-size-override\" is \"e2e_minimal\", want unset"
}
}
--------------------------------------------------------------------------------
{
msg: "failed waiting for hcpCluster=\"cluster-zstream-4-22-lwxlkb\" in resourcegroup=\"rg-zstream-upgrade-4-22-5q7qc8tlh4kp\" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n \"name\": \"3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:22:51.891905144Z\",\n \"endTime\": \"2026-10-06T01:06:59.493085695Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x2afb5e2dcc30>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Tue, 06 Oct 2026 01:06:59 GMT",
],
"Content-Length": ["630"],
"X-Envoy-Upstream-Service-Time": ["7"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"65d4500a-52e6-47d9-8230-9c41799caff7",
],
},
Body: <*exported.nopClosingBytesReader | 0x2afb5dd94500>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 51, 99, 102, 102, 50, 56, 101, 101, 45, 56, 98, 100, 52, 45, 52, 50, 100, 57, 45, 98, 101, 49, 99, 45, 100, 57, 98, 56, 99, 48, 51, 50, 57, 53, 101, 99, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 51, 99, 102, 102, 50, 56, 101, 101, 45, 56, 98, 100, 52, 45, 52, 50, 100, 57, 45, 98, 101, 49, 99, 45, 100, 57, 98, 56, 99, 48, 51, 50, 57, 53, 101, 99, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 50, 58, 53, 49, 46, 56, 57, 49, 57, 48, 53, 49, 52, 52, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 54, 58, 53, 57, 46, 52, 57, 51, 48, 56, 53, 54, 57, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 117, 112, 100, 97, 116, 101, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 32, 97, 110, 110, 111, 116, 97, 116, 105, 111, 110, 32, 92, 34, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 46, 111, 112, 101, 110, 115, 104, 105, 102, 116, 46, 105, 111, 47, 99, 108, 117, 115, 116, 101, 114, 45, 115, 105, 122, 101, 45, 111, 118, 101, 114, 114, 105, 100, 101, 92, 34, 32, 105, 115, 32, 92, 34, 101, 50, 101, 95, 109, 105, 110, 105, 109, 97, 108, 92, 34, 44, 32, 119, 97, 110, 116, 32, 117, 110, 115, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 630,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j1885952.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"Authorization": ["redacted"],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"188d1353-4bcc-4d38-8ca0-747098bc4fcc",
],
"X-Ms-Client-Request-Id": [
"1f54466c-09d6-4184-aa66-a979833d7d9c",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:06:59Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j1885952.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j1885952.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x2afb5d6a77f0>{
N: {
neg: false,
abs: [3068567393388915637, 16980575011879626626, 1143429630724641330, 4357716528635308419, 14509279396282781695, 8012192304601109313, 12731425424932449437, 16218207639835800800, 9142932487825696990, 16738473375682974529, 1473145742940968862, 10913254662357785291, 1856048742326068571, 8770402314205256839, 9228606020248993988, 557794537014387369, 3824968776435855308, 10957419960421347103, 7474943306238664987, 3047980741256319609, 14978025719175353246, 11663117024742676563, 5169280679099061512, 2777846026196397634, 5044857496703086169, 6968372143110153208, 338484629816585964, 718547086373088529, 10057371115081859903, 3762736957744799474, 1192345205811091089, 15945793549273525672],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12993975585620420545, 1688428045211159510],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926840348, loc: nil},
NotAfter: {wall: 0, ext: 63942565748, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [2, 5, 29, 15],
Critical: true,
Value: [3, 2, 5, 160],
},
{Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
{
Id: [2, 5, 29, 37],
Critical: false,
Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
},
{
Id: [2, 5, 29, 17],
Critical: false,
Value: [48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
},
{
Id: [2, 5, 29, 35],
Critical: false,
Value: [48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
},
{
Id: [2, 5, 29, 14],
Critical: false,
Value: [4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
AuthorityKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j1885952.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n \"name\": \"3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:22:51.891905144Z\",\n \"endTime\": \"2026-10-06T01:06:59.493085695Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:157]: failed to enable immediate z-stream updates for cluster "cluster-zstream-4-21-tj5kjf" on minor version 4.21
Unexpected error:
<*fmt.wrapError | 0x26f78b8967c0>:
failed waiting for hcpCluster="cluster-zstream-4-21-tj5kjf" in resourcegroup="rg-zstream-upgrade-4-21-crzxbjfcxnnm" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e",
"name": "7d946330-06af-4b31-849f-9e212d73904e",
"status": "Failed",
"startTime": "2026-10-06T00:22:04.312589503Z",
"endTime": "2026-10-06T01:06:09.501085874Z",
"error": {
"code": "DeadlineExceeded",
"message": "cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \"hypershift.openshift.io/cluster-size-override\" is \"e2e_minimal\", want unset"
}
}
--------------------------------------------------------------------------------
{
msg: "failed waiting for hcpCluster=\"cluster-zstream-4-21-tj5kjf\" in resourcegroup=\"rg-zstream-upgrade-4-21-crzxbjfcxnnm\" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\",\n \"name\": \"7d946330-06af-4b31-849f-9e212d73904e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:22:04.312589503Z\",\n \"endTime\": \"2026-10-06T01:06:09.501085874Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x26f78c3a4ff0>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"84a68013-7692-40c1-a42f-7a39ffeaa3d1",
],
"Date": [
"Tue, 06 Oct 2026 01:06:13 GMT",
],
"Content-Length": ["630"],
"X-Envoy-Upstream-Service-Time": ["9"],
},
Body: <*exported.nopClosingBytesReader | 0x26f78b896680>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 55, 100, 57, 52, 54, 51, 51, 48, 45, 48, 54, 97, 102, 45, 52, 98, 51, 49, 45, 56, 52, 57, 102, 45, 57, 101, 50, 49, 50, 100, 55, 51, 57, 48, 52, 101, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 55, 100, 57, 52, 54, 51, 51, 48, 45, 48, 54, 97, 102, 45, 52, 98, 51, 49, 45, 56, 52, 57, 102, 45, 57, 101, 50, 49, 50, 100, 55, 51, 57, 48, 52, 101, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 50, 58, 48, 52, 46, 51, 49, 50, 53, 56, 57, 53, 48, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 54, 58, 48, 57, 46, 53, 48, 49, 48, 56, 53, 56, 55, 52, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 117, 112, 100, 97, 116, 101, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 32, 97, 110, 110, 111, 116, 97, 116, 105, 111, 110, 32, 92, 34, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 46, 111, 112, 101, 110, 115, 104, 105, 102, 116, 46, 105, 111, 47, 99, 108, 117, 115, 116, 101, 114, 45, 115, 105, 122, 101, 45, 111, 118, 101, 114, 114, 105, 100, 101, 92, 34, 32, 105, 115, 32, 92, 34, 101, 50, 101, 95, 109, 105, 110, 105, 109, 97, 108, 92, 34, 44, 32, 119, 97, 110, 116, 32, 117, 110, 115, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 630,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j1885952.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"b9a056a1-262e-4e2f-8046-2cd90ed8ac37",
],
"Authorization": ["redacted"],
"X-Ms-Client-Request-Id": [
"0a0550d1-a804-40d5-8840-57f554281cdf",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:06:13Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j1885952.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j1885952.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x26f78c3e7600>{
N: {
neg: false,
abs: [3068567393388915637, 16980575011879626626, 1143429630724641330, 4357716528635308419, 14509279396282781695, 8012192304601109313, 12731425424932449437, 16218207639835800800, 9142932487825696990, 16738473375682974529, 1473145742940968862, 10913254662357785291, 1856048742326068571, 8770402314205256839, 9228606020248993988, 557794537014387369, 3824968776435855308, 10957419960421347103, 7474943306238664987, 3047980741256319609, 14978025719175353246, 11663117024742676563, 5169280679099061512, 2777846026196397634, 5044857496703086169, 6968372143110153208, 338484629816585964, 718547086373088529, 10057371115081859903, 3762736957744799474, 1192345205811091089, 15945793549273525672],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12993975585620420545, 1688428045211159510],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926840348, loc: nil},
NotAfter: {wall: 0, ext: 63942565748, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [2, 5, 29, 15],
Critical: true,
Value: [3, 2, 5, 160],
},
{Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
{
Id: [2, 5, 29, 37],
Critical: false,
Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
},
{
Id: [2, 5, 29, 17],
Critical: false,
Value: [48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
},
{
Id: [2, 5, 29, 35],
Critical: false,
Value: [48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
},
{
Id: [2, 5, 29, 14],
Critical: false,
Value: [4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
AuthorityKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j1885952.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\",\n \"name\": \"7d946330-06af-4b31-849f-9e212d73904e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:22:04.312589503Z\",\n \"endTime\": \"2026-10-06T01:06:09.501085874Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:157]: failed to enable immediate z-stream updates for cluster "cluster-zstream-4-21-tj5kjf" on minor version 4.21
Unexpected error:
<*fmt.wrapError | 0x26f78b8967c0>:
failed waiting for hcpCluster="cluster-zstream-4-21-tj5kjf" in resourcegroup="rg-zstream-upgrade-4-21-crzxbjfcxnnm" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e",
"name": "7d946330-06af-4b31-849f-9e212d73904e",
"status": "Failed",
"startTime": "2026-10-06T00:22:04.312589503Z",
"endTime": "2026-10-06T01:06:09.501085874Z",
"error": {
"code": "DeadlineExceeded",
"message": "cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \"hypershift.openshift.io/cluster-size-override\" is \"e2e_minimal\", want unset"
}
}
--------------------------------------------------------------------------------
{
msg: "failed waiting for hcpCluster=\"cluster-zstream-4-21-tj5kjf\" in resourcegroup=\"rg-zstream-upgrade-4-21-crzxbjfcxnnm\" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\",\n \"name\": \"7d946330-06af-4b31-849f-9e212d73904e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:22:04.312589503Z\",\n \"endTime\": \"2026-10-06T01:06:09.501085874Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x26f78c3a4ff0>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"84a68013-7692-40c1-a42f-7a39ffeaa3d1",
],
"Date": [
"Tue, 06 Oct 2026 01:06:13 GMT",
],
"Content-Length": ["630"],
"X-Envoy-Upstream-Service-Time": ["9"],
},
Body: <*exported.nopClosingBytesReader | 0x26f78b896680>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 55, 100, 57, 52, 54, 51, 51, 48, 45, 48, 54, 97, 102, 45, 52, 98, 51, 49, 45, 56, 52, 57, 102, 45, 57, 101, 50, 49, 50, 100, 55, 51, 57, 48, 52, 101, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 55, 100, 57, 52, 54, 51, 51, 48, 45, 48, 54, 97, 102, 45, 52, 98, 51, 49, 45, 56, 52, 57, 102, 45, 57, 101, 50, 49, 50, 100, 55, 51, 57, 48, 52, 101, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 50, 58, 48, 52, 46, 51, 49, 50, 53, 56, 57, 53, 48, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 54, 58, 48, 57, 46, 53, 48, 49, 48, 56, 53, 56, 55, 52, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 117, 112, 100, 97, 116, 101, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 32, 97, 110, 110, 111, 116, 97, 116, 105, 111, 110, 32, 92, 34, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 46, 111, 112, 101, 110, 115, 104, 105, 102, 116, 46, 105, 111, 47, 99, 108, 117, 115, 116, 101, 114, 45, 115, 105, 122, 101, 45, 111, 118, 101, 114, 114, 105, 100, 101, 92, 34, 32, 105, 115, 32, 92, 34, 101, 50, 101, 95, 109, 105, 110, 105, 109, 97, 108, 92, 34, 44, 32, 119, 97, 110, 116, 32, 117, 110, 115, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 630,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j1885952.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"b9a056a1-262e-4e2f-8046-2cd90ed8ac37",
],
"Authorization": ["redacted"],
"X-Ms-Client-Request-Id": [
"0a0550d1-a804-40d5-8840-57f554281cdf",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:06:13Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j1885952.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j1885952.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x26f78c3e7600>{
N: {
neg: false,
abs: [3068567393388915637, 16980575011879626626, 1143429630724641330, 4357716528635308419, 14509279396282781695, 8012192304601109313, 12731425424932449437, 16218207639835800800, 9142932487825696990, 16738473375682974529, 1473145742940968862, 10913254662357785291, 1856048742326068571, 8770402314205256839, 9228606020248993988, 557794537014387369, 3824968776435855308, 10957419960421347103, 7474943306238664987, 3047980741256319609, 14978025719175353246, 11663117024742676563, 5169280679099061512, 2777846026196397634, 5044857496703086169, 6968372143110153208, 338484629816585964, 718547086373088529, 10057371115081859903, 3762736957744799474, 1192345205811091089, 15945793549273525672],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12993975585620420545, 1688428045211159510],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926840348, loc: nil},
NotAfter: {wall: 0, ext: 63942565748, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [2, 5, 29, 15],
Critical: true,
Value: [3, 2, 5, 160],
},
{Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
{
Id: [2, 5, 29, 37],
Critical: false,
Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
},
{
Id: [2, 5, 29, 17],
Critical: false,
Value: [48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
},
{
Id: [2, 5, 29, 35],
Critical: false,
Value: [48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
},
{
Id: [2, 5, 29, 14],
Critical: false,
Value: [4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
AuthorityKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j1885952.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\",\n \"name\": \"7d946330-06af-4b31-849f-9e212d73904e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:22:04.312589503Z\",\n \"endTime\": \"2026-10-06T01:06:09.501085874Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:157]: failed to enable immediate z-stream updates for cluster "cluster-zstream-4-23-f5gz8r" on minor version 4.23
Unexpected error:
<*fmt.wrapError | 0x169cfe02ad60>:
failed waiting for hcpCluster="cluster-zstream-4-23-f5gz8r" in resourcegroup="rg-zstream-upgrade-4-23-7hzrtxfzqp8x" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9",
"name": "8a671219-b4b6-46d1-b97e-d8354f2e11d9",
"status": "Failed",
"startTime": "2026-10-06T00:25:50.933465836Z",
"endTime": "2026-10-06T01:09:59.469391187Z",
"error": {
"code": "DeadlineExceeded",
"message": "cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \"hypershift.openshift.io/cluster-size-override\" is \"e2e_minimal\", want unset"
}
}
--------------------------------------------------------------------------------
{
msg: "failed waiting for hcpCluster=\"cluster-zstream-4-23-f5gz8r\" in resourcegroup=\"rg-zstream-upgrade-4-23-7hzrtxfzqp8x\" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n \"name\": \"8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:25:50.933465836Z\",\n \"endTime\": \"2026-10-06T01:09:59.469391187Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x169cff39e300>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"b9c17f48-b284-45df-8122-30f6af52e540",
],
"Date": [
"Tue, 06 Oct 2026 01:09:59 GMT",
],
"Content-Length": ["630"],
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x169cfe02a040>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 56, 97, 54, 55, 49, 50, 49, 57, 45, 98, 52, 98, 54, 45, 52, 54, 100, 49, 45, 98, 57, 55, 101, 45, 100, 56, 51, 53, 52, 102, 50, 101, 49, 49, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 56, 97, 54, 55, 49, 50, 49, 57, 45, 98, 52, 98, 54, 45, 52, 54, 100, 49, 45, 98, 57, 55, 101, 45, 100, 56, 51, 53, 52, 102, 50, 101, 49, 49, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 53, 58, 53, 48, 46, 57, 51, 51, 52, 54, 53, 56, 51, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 57, 58, 53, 57, 46, 52, 54, 57, 51, 57, 49, 49, 56, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 117, 112, 100, 97, 116, 101, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 32, 97, 110, 110, 111, 116, 97, 116, 105, 111, 110, 32, 92, 34, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 46, 111, 112, 101, 110, 115, 104, 105, 102, 116, 46, 105, 111, 47, 99, 108, 117, 115, 116, 101, 114, 45, 115, 105, 122, 101, 45, 111, 118, 101, 114, 114, 105, 100, 101, 92, 34, 32, 105, 115, 32, 92, 34, 101, 50, 101, 95, 109, 105, 110, 105, 109, 97, 108, 92, 34, 44, 32, 119, 97, 110, 116, 32, 117, 110, 115, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 630,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j1885952.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"06805ff0-2822-403a-a554-832ea22c86a3",
],
"X-Ms-Client-Request-Id": [
"a742456a-0bbb-4dca-882a-af3f39e2ddd6",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:09:59Z\"}",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j1885952.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j1885952.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x169cff186df0>{
N: {
neg: false,
abs: [3068567393388915637, 16980575011879626626, 1143429630724641330, 4357716528635308419, 14509279396282781695, 8012192304601109313, 12731425424932449437, 16218207639835800800, 9142932487825696990, 16738473375682974529, 1473145742940968862, 10913254662357785291, 1856048742326068571, 8770402314205256839, 9228606020248993988, 557794537014387369, 3824968776435855308, 10957419960421347103, 7474943306238664987, 3047980741256319609, 14978025719175353246, 11663117024742676563, 5169280679099061512, 2777846026196397634, 5044857496703086169, 6968372143110153208, 338484629816585964, 718547086373088529, 10057371115081859903, 3762736957744799474, 1192345205811091089, 15945793549273525672],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12993975585620420545, 1688428045211159510],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926840348, loc: nil},
NotAfter: {wall: 0, ext: 63942565748, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [2, 5, 29, 15],
Critical: true,
Value: [3, 2, 5, 160],
},
{Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
{
Id: [2, 5, 29, 37],
Critical: false,
Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
},
{
Id: [2, 5, 29, 17],
Critical: false,
Value: [48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
},
{
Id: [2, 5, 29, 35],
Critical: false,
Value: [48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
},
{
Id: [2, 5, 29, 14],
Critical: false,
Value: [4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
AuthorityKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j1885952.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n \"name\": \"8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:25:50.933465836Z\",\n \"endTime\": \"2026-10-06T01:09:59.469391187Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:157]: failed to enable immediate z-stream updates for cluster "cluster-zstream-4-23-f5gz8r" on minor version 4.23
Unexpected error:
<*fmt.wrapError | 0x169cfe02ad60>:
failed waiting for hcpCluster="cluster-zstream-4-23-f5gz8r" in resourcegroup="rg-zstream-upgrade-4-23-7hzrtxfzqp8x" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9",
"name": "8a671219-b4b6-46d1-b97e-d8354f2e11d9",
"status": "Failed",
"startTime": "2026-10-06T00:25:50.933465836Z",
"endTime": "2026-10-06T01:09:59.469391187Z",
"error": {
"code": "DeadlineExceeded",
"message": "cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \"hypershift.openshift.io/cluster-size-override\" is \"e2e_minimal\", want unset"
}
}
--------------------------------------------------------------------------------
{
msg: "failed waiting for hcpCluster=\"cluster-zstream-4-23-f5gz8r\" in resourcegroup=\"rg-zstream-upgrade-4-23-7hzrtxfzqp8x\" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n \"name\": \"8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:25:50.933465836Z\",\n \"endTime\": \"2026-10-06T01:09:59.469391187Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x169cff39e300>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"b9c17f48-b284-45df-8122-30f6af52e540",
],
"Date": [
"Tue, 06 Oct 2026 01:09:59 GMT",
],
"Content-Length": ["630"],
"X-Envoy-Upstream-Service-Time": ["8"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x169cfe02a040>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 56, 97, 54, 55, 49, 50, 49, 57, 45, 98, 52, 98, 54, 45, 52, 54, 100, 49, 45, 98, 57, 55, 101, 45, 100, 56, 51, 53, 52, 102, 50, 101, 49, 49, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 56, 97, 54, 55, 49, 50, 49, 57, 45, 98, 52, 98, 54, 45, 52, 54, 100, 49, 45, 98, 57, 55, 101, 45, 100, 56, 51, 53, 52, 102, 50, 101, 49, 49, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 53, 58, 53, 48, 46, 57, 51, 51, 52, 54, 53, 56, 51, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 57, 58, 53, 57, 46, 52, 54, 57, 51, 57, 49, 49, 56, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 117, 112, 100, 97, 116, 101, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 32, 97, 110, 110, 111, 116, 97, 116, 105, 111, 110, 32, 92, 34, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 46, 111, 112, 101, 110, 115, 104, 105, 102, 116, 46, 105, 111, 47, 99, 108, 117, 115, 116, 101, 114, 45, 115, 105, 122, 101, 45, 111, 118, 101, 114, 114, 105, 100, 101, 92, 34, 32, 105, 115, 32, 92, 34, 101, 50, 101, 95, 109, 105, 110, 105, 109, 97, 108, 92, 34, 44, 32, 119, 97, 110, 116, 32, 117, 110, 115, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 630,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j1885952.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"06805ff0-2822-403a-a554-832ea22c86a3",
],
"X-Ms-Client-Request-Id": [
"a742456a-0bbb-4dca-882a-af3f39e2ddd6",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:09:59Z\"}",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j1885952.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j1885952.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x169cff186df0>{
N: {
neg: false,
abs: [3068567393388915637, 16980575011879626626, 1143429630724641330, 4357716528635308419, 14509279396282781695, 8012192304601109313, 12731425424932449437, 16218207639835800800, 9142932487825696990, 16738473375682974529, 1473145742940968862, 10913254662357785291, 1856048742326068571, 8770402314205256839, 9228606020248993988, 557794537014387369, 3824968776435855308, 10957419960421347103, 7474943306238664987, 3047980741256319609, 14978025719175353246, 11663117024742676563, 5169280679099061512, 2777846026196397634, 5044857496703086169, 6968372143110153208, 338484629816585964, 718547086373088529, 10057371115081859903, 3762736957744799474, 1192345205811091089, 15945793549273525672],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [12993975585620420545, 1688428045211159510],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
Names: [
{
Type: [..., ..., ..., ...],
Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926840348, loc: nil},
NotAfter: {wall: 0, ext: 63942565748, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [2, 5, 29, 15],
Critical: true,
Value: [3, 2, 5, 160],
},
{Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
{
Id: [2, 5, 29, 37],
Critical: false,
Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
},
{
Id: [2, 5, 29, 17],
Critical: false,
Value: [48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
},
{
Id: [2, 5, 29, 35],
Critical: false,
Value: [48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
},
{
Id: [2, 5, 29, 14],
Critical: false,
Value: [4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
AuthorityKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j1885952.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n \"name\": \"8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-06T00:25:50.933465836Z\",\n \"endTime\": \"2026-10-06T01:09:59.469391187Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
}
occurredContributing tests (6)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [svc] ArobitForwarderJobUp firedfull failure pattern: alert [svc] ArobitForwarderJobUp fired Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s) | alert | 3 | 3.90%3 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s) | Show trend detailsSep 29: 0 · Sep 30: 4 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 3 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)alert fired 1 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T23:34:44Z Severity: Sev3 Labels: alertname="ArobitForwarderJobUp", cluster="ci01-j0130560-svc", component="monitoring-infrastructure", region="canadacentral", severity="warning" Description: The Arobit forwarder metrics endpoint on cluster ci01-j0130560-svc has been unreachable for 15 minutes. alert fired 1 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T22:10:15Z Severity: Sev3 Labels: alertname="ArobitForwarderJobUp", cluster="ci01-j9785984-svc", component="monitoring-infrastructure", region="westus3", severity="warning" Description: The Arobit forwarder metrics endpoint on cluster ci01-j9785984-svc has been unreachable for 15 minutes. alert fired 1 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T19:07:43Z Severity: Sev3 Labels: alertname="ArobitForwarderJobUp", cluster="ci01-j8411136-svc", component="monitoring-infrastructure", region="westus3", severity="warning" Description: The Arobit forwarder metrics endpoint on cluster ci01-j8411136-svc has been unreachable for 15 minutes. Contributing tests (1)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [svc] KubeDaemonSetRolloutStuck firedfull failure pattern: alert [svc] KubeDaemonSetRolloutStuck fired Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s) | alert | 3 | 3.90%3 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s) | Show trend detailsSep 29: 0 · Sep 30: 5 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 3 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (3)alert fired 2 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T23:35:03Z Severity: Sev3 Labels: alertname="KubeDaemonSetRolloutStuck", cluster="ci01-j0130560-svc", component="kubernetes-infrastructure", container="kube-state-metrics", daemonset="arobit-forwarder", endpoint="http", environment="ci01", instance="10.128.64.53:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j0130560/providers/microsoft.monitor/accounts/services-j0130560", namespace="arobit", pod="arohcp-monitor-kube-state-metrics-79b88f5699-qz6vc", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: DaemonSet arobit/arobit-forwarder has not finished or progressed for at least 15 minutes. Firing 2: State: Fired (not resolved) Started: 2026-10-05T23:35:03Z Severity: Sev3 Labels: alertname="KubeDaemonSetRolloutStuck", cluster="ci01-j0130560-svc", component="kubernetes-infrastructure", container="kube-state-metrics", daemonset="arobit-forwarder", endpoint="http", environment="ci01", instance="10.128.64.53:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j0130560/providers/microsoft.monitor/accounts/services-j0130560", namespace="arobit", pod="arohcp-monitor-kube-state-metrics-79b88f5699-qz6vc", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: DaemonSet arobit/arobit-forwarder has not finished or progressed for at least 15 minutes. alert fired 2 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T22:10:28Z Severity: Sev3 Labels: alertname="KubeDaemonSetRolloutStuck", cluster="ci01-j9785984-svc", component="kubernetes-infrastructure", container="kube-state-metrics", daemonset="arobit-forwarder", endpoint="http", environment="ci01", instance="10.128.64.66:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j9785984/providers/microsoft.monitor/accounts/services-j9785984", namespace="arobit", pod="arohcp-monitor-kube-state-metrics-79b88f5699-dk89c", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: DaemonSet arobit/arobit-forwarder has not finished or progressed for at least 15 minutes. Firing 2: State: Fired (not resolved) Started: 2026-10-05T22:10:29Z Severity: Sev3 Labels: alertname="KubeDaemonSetRolloutStuck", cluster="ci01-j9785984-svc", component="kubernetes-infrastructure", container="kube-state-metrics", daemonset="arobit-forwarder", endpoint="http", environment="ci01", instance="10.128.64.66:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j9785984/providers/microsoft.monitor/accounts/services-j9785984", namespace="arobit", pod="arohcp-monitor-kube-state-metrics-79b88f5699-dk89c", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: DaemonSet arobit/arobit-forwarder has not finished or progressed for at least 15 minutes. alert fired 2 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T19:08:23Z Severity: Sev3 Labels: alertname="KubeDaemonSetRolloutStuck", cluster="ci01-j8411136-svc", component="kubernetes-infrastructure", container="kube-state-metrics", daemonset="arobit-forwarder", endpoint="http", environment="ci01", instance="10.128.64.44:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j8411136/providers/microsoft.monitor/accounts/services-j8411136", namespace="arobit", pod="arohcp-monitor-kube-state-metrics-79b88f5699-l989f", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: DaemonSet arobit/arobit-forwarder has not finished or progressed for at least 15 minutes. Firing 2: State: Fired (not resolved) Started: 2026-10-05T19:08:23Z Severity: Sev3 Labels: alertname="KubeDaemonSetRolloutStuck", cluster="ci01-j8411136-svc", component="kubernetes-infrastructure", container="kube-state-metrics", daemonset="arobit-forwarder", endpoint="http", environment="ci01", instance="10.128.64.44:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j8411136/providers/microsoft.monitor/accounts/services-j8411136", namespace="arobit", pod="arohcp-monitor-kube-state-metrics-79b88f5699-l989f", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning" Description: DaemonSet arobit/arobit-forwarder has not finished or progressed for at least 15 minutes. Contributing tests (1)
Affected runs (3)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get "<url>full failure pattern: clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get "<url> Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s) | e2e | 2 | 2.60%2 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s) | Show trend detailsSep 29: 1 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:356]: Timed out after 300.000s.
ClusterIssuer should become Ready (ACME account registered)
Expected success, but got an error:
<*errors.errorString | 0x5170293c200>:
clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get "https://acme-staging-v02.api.letsencrypt.org/directory": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.10:46939->172.30.0.10:53: read: connection refused
{
s: "clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get \"https://acme-staging-v02.api.letsencrypt.org/directory\": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.10:46939->172.30.0.10:53: read: connection refused",
}
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:356]: Timed out after 300.000s.
ClusterIssuer should become Ready (ACME account registered)
Expected success, but got an error:
<*errors.errorString | 0x5170293c200>:
clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get "https://acme-staging-v02.api.letsencrypt.org/directory": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.10:46939->172.30.0.10:53: read: connection refused
{
s: "clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get \"https://acme-staging-v02.api.letsencrypt.org/directory\": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.10:46939->172.30.0.10:53: read: connection refused",
}fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:356]: Timed out after 300.001s.
ClusterIssuer should become Ready (ACME account registered)
Expected success, but got an error:
<*errors.errorString | 0x559801b44d0>:
clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get "https://acme-staging-v02.api.letsencrypt.org/directory": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.11:56812->172.30.0.10:53: read: connection refused
{
s: "clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get \"https://acme-staging-v02.api.letsencrypt.org/directory\": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.11:56812->172.30.0.10:53: read: connection refused",
}
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:356]: Timed out after 300.001s.
ClusterIssuer should become Ready (ACME account registered)
Expected success, but got an error:
<*errors.errorString | 0x559801b44d0>:
clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get "https://acme-staging-v02.api.letsencrypt.org/directory": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.11:56812->172.30.0.10:53: read: connection refused
{
s: "clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get \"https://acme-staging-v02.api.letsencrypt.org/directory\": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.11:56812->172.30.0.10:53: read: connection refused",
}Contributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail message cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster still exists; [clusterServic...full failure pattern: ERROR CODE: InternalServerError; detail message cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster still exists; [clusterServiceStatus] state is "uninstalling"; [hostedCluster] HostedCluster still exists; [resourceTeardown] tearing down namespaces; [descendantResources] remaining resources: serviceProviderClusters; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 2 | 2.60%2 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
<*errors.joinError | 0xc8fdac18360>:
resource group "customer-rg-cs869d4j8jj9": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-hcp-cluster2" in resourcegroup="customer-rg-cs869d4j8jj9" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0",
"name": "b17ce299-24e5-4459-a33b-52d98a9b26e0",
"status": "Failed",
"startTime": "2026-10-05T20:41:18.783157102Z",
"endTime": "2026-10-05T21:05:28.437788206Z",
"error": {
"code": "InternalServerError",
"message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc8fdaf103c0>{
msg: "resource group \"customer-rg-cs869d4j8jj9\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc8fdaf103a0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc8fdaf10380>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc8fdaf10360>{
msg: "failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc8fdbb7c4e0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": [...],
"X-Envoy-Upstream-Service-Time": [...],
"Server": [...],
"Content-Type": [...],
"X-Ms-Request-Id": [...],
"Date": [...],
},
Body: <*exported.nopClosingBytesReader | 0xc8fdaf101c0>{
s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
i: 0,
},
ContentLength: 943,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j6160640.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j6160640.hcpsvc.osadev.cloud",
PeerCertificates: [...],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
<*errors.joinError | 0xc8fdac18360>:
resource group "customer-rg-cs869d4j8jj9": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-hcp-cluster2" in resourcegroup="customer-rg-cs869d4j8jj9" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0",
"name": "b17ce299-24e5-4459-a33b-52d98a9b26e0",
"status": "Failed",
"startTime": "2026-10-05T20:41:18.783157102Z",
"endTime": "2026-10-05T21:05:28.437788206Z",
"error": {
"code": "InternalServerError",
"message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0xc8fdaf103c0>{
msg: "resource group \"customer-rg-cs869d4j8jj9\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc8fdaf103a0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc8fdaf10380>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0xc8fdaf10360>{
msg: "failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0xc8fdbb7c4e0>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Length": [...],
"X-Envoy-Upstream-Service-Time": [...],
"Server": [...],
"Content-Type": [...],
"X-Ms-Request-Id": [...],
"Date": [...],
},
Body: <*exported.nopClosingBytesReader | 0xc8fdaf101c0>{
s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
i: 0,
},
ContentLength: 943,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j6160640.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j6160640.hcpsvc.osadev.cloud",
PeerCertificates: [...],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57ee760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
<*errors.joinError | 0x1dc907926ba0>:
resource group "admin-api-breakglass-wtffcnm884t4": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="sre-hcp-cluster" in resourcegroup="admin-api-breakglass-wtffcnm884t4" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0",
"name": "2f465ddd-f1b5-440a-870c-8ec05b0abdb0",
"status": "Failed",
"startTime": "2026-10-05T19:28:57.280324623Z",
"endTime": "2026-10-05T19:53:00.492724804Z",
"error": {
"code": "InternalServerError",
"message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0x1dc907f30260>{
msg: "resource group \"admin-api-breakglass-wtffcnm884t4\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1dc907f30240>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1dc907f30220>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1dc907f30200>{
msg: "failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x1dc908664870>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": [...],
"X-Ms-Request-Id": [...],
"Date": [...],
"Content-Length": [...],
"X-Envoy-Upstream-Service-Time": [...],
"Server": [...],
},
Body: <*exported.nopClosingBytesReader | 0x1dc907f30120>{
s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
i: 0,
},
ContentLength: 943,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j8110208.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j8110208.hcpsvc.osadev.cloud",
PeerCertificates: [...],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
<*errors.joinError | 0x1dc907926ba0>:
resource group "admin-api-breakglass-wtffcnm884t4": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="sre-hcp-cluster" in resourcegroup="admin-api-breakglass-wtffcnm884t4" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0",
"name": "2f465ddd-f1b5-440a-870c-8ec05b0abdb0",
"status": "Failed",
"startTime": "2026-10-05T19:28:57.280324623Z",
"endTime": "2026-10-05T19:53:00.492724804Z",
"error": {
"code": "InternalServerError",
"message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0x1dc907f30260>{
msg: "resource group \"admin-api-breakglass-wtffcnm884t4\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1dc907f30240>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1dc907f30220>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x1dc907f30200>{
msg: "failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x1dc908664870>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": [...],
"X-Ms-Request-Id": [...],
"Date": [...],
"Content-Length": [...],
"X-Envoy-Upstream-Service-Time": [...],
"Server": [...],
},
Body: <*exported.nopClosingBytesReader | 0x1dc907f30120>{
s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
i: 0,
},
ContentLength: 943,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j8110208.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j8110208.hcpsvc.osadev.cloud",
PeerCertificates: [...],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
},
},
],
}
occurredContributing tests (2)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: DeadlineExceeded; detail message node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hype...full failure pattern: ERROR CODE: DeadlineExceeded; detail message node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \>= 2 (autoscaling min); node pool condition AllNodesHealthy is False: <count> of <count> machines are not healthy Machine <node>: InspectionFailed: Waiting for AzureMachine to report spec.providerID; node pool condition AllMachinesReady is False: <count> of <count> machines are not ready Machine <node>: Creating: virtualmachine creating or updating; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | e2e | 2 | 2.60%2 of 77 job runs affected | IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
<*errors.joinError | 0x19372dd76210>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-mpvrctw9vt46" to finish creating: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e",
"name": "c6b0c5c6-e258-472c-9703-899e89bbd15e",
"status": "Failed",
"startTime": "2026-10-05T19:21:04.389518057Z",
"endTime": "2026-10-05T19:40:10.093617853Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x19372dd761f8>{
errs: [
<*fmt.wrapError | 0x19373010d360>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x19372f563a10>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x19373010c280>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x19373010c260>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x19373010c220>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x19373010c200>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x19372fdf4f20>{
msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-mpvrctw9vt46\" to finish creating: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n \"name\": \"c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:21:04.389518057Z\",\n \"endTime\": \"2026-10-05T19:40:10.093617853Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x19372fdf4340>{
msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-mpvrctw9vt46\" to finish creating: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n \"name\": \"c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:21:04.389518057Z\",\n \"endTime\": \"2026-10-05T19:40:10.093617853Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x19372e940960>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"47992352-ac2e-4611-b067-3f72722a8c50",
],
"Date": [
"Mon, 05 Oct 2026 19:40:17 GMT",
],
"Content-Length": ["1228"],
"X-Envoy-Upstream-Service-Time": ["6"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x19372fdf4260>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 99, 54, 98, 48, 99, 53, 99, 54, 45, 101, 50, 53, 56, 45, 52, 55, 50, 99, 45, 57, 55, 48, 51, 45, 56, 57, 57, 101, 56, 57, 98, 98, 100, 49, 53, 101, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 99, 54, 98, 48, 99, 53, 99, 54, 45, 101, 50, 53, 56, 45, 52, 55, 50, 99, 45, 57, 55, 48, 51, 45, 56, 57, 57, 101, 56, 57, 98, 98, 100, 49, 53, 101, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 50, 49, 58, 48, 52, 46, 51, 56, 57, 53, 49, 56, 48, 53, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 52, 48, 58, 49, 48, 46, 48, 57, 51, 54, 49, 55, 56, 53, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 114, 53, 57, 50, 104, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 119, 118, 118, 106, 107, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 114, 53, 57, 50, 104, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 119, 118, 118, 106, 107, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1228,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j8110208.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Client-Request-Id": [
"6a7c410b-746c-474b-8cb6-cd25d424b3f6",
],
"Authorization": ["redacted"],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T19:40:17Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"47e50e50-1ce1-4f96-9071-58db4b27781c",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j8110208.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j8110208.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x19372f93f320>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n \"name\": \"c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:21:04.389518057Z\",\n \"endTime\": \"2026-10-05T19:40:10.093617853Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
<*errors.joinError | 0x19372dd76210>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-mpvrctw9vt46" to finish creating: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e",
"name": "c6b0c5c6-e258-472c-9703-899e89bbd15e",
"status": "Failed",
"startTime": "2026-10-05T19:21:04.389518057Z",
"endTime": "2026-10-05T19:40:10.093617853Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x19372dd761f8>{
errs: [
<*fmt.wrapError | 0x19373010d360>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x19372f563a10>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x19373010c280>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x19373010c260>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x19373010c220>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x19373010c200>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x19372fdf4f20>{
msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-mpvrctw9vt46\" to finish creating: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n \"name\": \"c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:21:04.389518057Z\",\n \"endTime\": \"2026-10-05T19:40:10.093617853Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x19372fdf4340>{
msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-mpvrctw9vt46\" to finish creating: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n \"name\": \"c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:21:04.389518057Z\",\n \"endTime\": \"2026-10-05T19:40:10.093617853Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x19372e940960>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"47992352-ac2e-4611-b067-3f72722a8c50",
],
"Date": [
"Mon, 05 Oct 2026 19:40:17 GMT",
],
"Content-Length": ["1228"],
"X-Envoy-Upstream-Service-Time": ["6"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x19372fdf4260>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 99, 54, 98, 48, 99, 53, 99, 54, 45, 101, 50, 53, 56, 45, 52, 55, 50, 99, 45, 57, 55, 48, 51, 45, 56, 57, 57, 101, 56, 57, 98, 98, 100, 49, 53, 101, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 99, 54, 98, 48, 99, 53, 99, 54, 45, 101, 50, 53, 56, 45, 52, 55, 50, 99, 45, 57, 55, 48, 51, 45, 56, 57, 57, 101, 56, 57, 98, 98, 100, 49, 53, 101, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 50, 49, 58, 48, 52, 46, 51, 56, 57, 53, 49, 56, 48, 53, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 52, 48, 58, 49, 48, 46, 48, 57, 51, 54, 49, 55, 56, 53, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 114, 53, 57, 50, 104, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 119, 118, 118, 106, 107, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 114, 53, 57, 50, 104, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 119, 118, 118, 106, 107, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1228,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j8110208.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Client-Request-Id": [
"6a7c410b-746c-474b-8cb6-cd25d424b3f6",
],
"Authorization": ["redacted"],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T19:40:17Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"47e50e50-1ce1-4f96-9071-58db4b27781c",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j8110208.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j8110208.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x19372f93f320>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n \"name\": \"c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:21:04.389518057Z\",\n \"endTime\": \"2026-10-05T19:40:10.093617853Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurredfail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
<*errors.joinError | 0x240541336060>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-xjrskw5rbsb8" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937",
"name": "c3e6190f-6d0a-4437-b946-d5969f96f937",
"status": "Failed",
"startTime": "2026-10-05T16:07:16.344851872Z",
"endTime": "2026-10-05T16:26:24.47612917Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x240541336030>{
errs: [
<*fmt.wrapError | 0x240542de8500>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x240540c00e20>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x2405418c2280>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x2405418c2260>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x2405418c2220>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x2405418c21c0>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x24054117cac0>{
msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-xjrskw5rbsb8\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\",\n \"name\": \"c3e6190f-6d0a-4437-b946-d5969f96f937\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T16:07:16.344851872Z\",\n \"endTime\": \"2026-10-05T16:26:24.47612917Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x24054185ac80>{
msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-xjrskw5rbsb8\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\",\n \"name\": \"c3e6190f-6d0a-4437-b946-d5969f96f937\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T16:07:16.344851872Z\",\n \"endTime\": \"2026-10-05T16:26:24.47612917Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x2405415bcab0>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"810934bd-51d5-4b1d-8362-3515a979c5bc",
],
"Date": [
"Mon, 05 Oct 2026 16:26:29 GMT",
],
"Content-Length": ["1227"],
"X-Envoy-Upstream-Service-Time": ["10"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x24054185aa60>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 99, 51, 101, 54, 49, 57, 48, 102, 45, 54, 100, 48, 97, 45, 52, 52, 51, 55, 45, 98, 57, 52, 54, 45, 100, 53, 57, 54, 57, 102, 57, 54, 102, 57, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 99, 51, 101, 54, 49, 57, 48, 102, 45, 54, 100, 48, 97, 45, 52, 52, 51, 55, 45, 98, 57, 52, 54, 45, 100, 53, 57, 54, 57, 102, 57, 54, 102, 57, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 54, 58, 48, 55, 58, 49, 54, 46, 51, 52, 52, 56, 53, 49, 56, 55, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 54, 58, 50, 54, 58, 50, 52, 46, 52, 55, 54, 49, 50, 57, 49, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 106, 108, 113, 56, 100, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 118, 52, 112, 120, 54, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 106, 108, 113, 56, 100, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 118, 52, 112, 120, 54, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1227,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j4561920.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"df0ba451-c04d-46f0-895e-bc2e85d765e5",
],
"X-Ms-Client-Request-Id": [
"67ebdf96-cb38-4b47-90e6-8d990d752e02",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T16:26:29Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j4561920.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j4561920.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x240541bb34e0>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\",\n \"name\": \"c3e6190f-6d0a-4437-b946-d5969f96f937\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T16:07:16.344851872Z\",\n \"endTime\": \"2026-10-05T16:26:24.47612917Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
<*errors.joinError | 0x240541336060>:
VerifyNodesReady failed: no nodes found in the cluster
VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-xjrskw5rbsb8" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937",
"name": "c3e6190f-6d0a-4437-b946-d5969f96f937",
"status": "Failed",
"startTime": "2026-10-05T16:07:16.344851872Z",
"endTime": "2026-10-05T16:26:24.47612917Z",
"error": {
"code": "DeadlineExceeded",
"message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\n"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*errors.joinError | 0x240541336030>{
errs: [
<*fmt.wrapError | 0x240542de8500>{
msg: "VerifyNodesReady failed: no nodes found in the cluster",
err: <*errors.errorString | 0x240540c00e20>{
s: "no nodes found in the cluster",
},
},
<*fmt.wrapError | 0x2405418c2280>{
msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x2405418c2260>{
msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x2405418c2220>{
msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
err: <*fmt.wrapError | 0x2405418c21c0>{
msg: "client rate limiter Wait returned an error: context deadline exceeded",
err: <context.deadlineExceededError>{},
},
},
},
},
],
},
<*fmt.wrapError | 0x24054117cac0>{
msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-xjrskw5rbsb8\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\",\n \"name\": \"c3e6190f-6d0a-4437-b946-d5969f96f937\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T16:07:16.344851872Z\",\n \"endTime\": \"2026-10-05T16:26:24.47612917Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x24054185ac80>{
msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-xjrskw5rbsb8\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\",\n \"name\": \"c3e6190f-6d0a-4437-b946-d5969f96f937\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T16:07:16.344851872Z\",\n \"endTime\": \"2026-10-05T16:26:24.47612917Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x2405415bcab0>{
ErrorCode: "DeadlineExceeded",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"810934bd-51d5-4b1d-8362-3515a979c5bc",
],
"Date": [
"Mon, 05 Oct 2026 16:26:29 GMT",
],
"Content-Length": ["1227"],
"X-Envoy-Upstream-Service-Time": ["10"],
"Server": ["istio-envoy"],
},
Body: <*exported.nopClosingBytesReader | 0x24054185aa60>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 99, 51, 101, 54, 49, 57, 48, 102, 45, 54, 100, 48, 97, 45, 52, 52, 51, 55, 45, 98, 57, 52, 54, 45, 100, 53, 57, 54, 57, 102, 57, 54, 102, 57, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 99, 51, 101, 54, 49, 57, 48, 102, 45, 54, 100, 48, 97, 45, 52, 52, 51, 55, 45, 98, 57, 52, 54, 45, 100, 53, 57, 54, 57, 102, 57, 54, 102, 57, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 54, 58, 48, 55, 58, 49, 54, 46, 51, 52, 52, 56, 53, 49, 56, 55, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 54, 58, 50, 54, 58, 50, 52, 46, 52, 55, 54, 49, 50, 57, 49, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 106, 108, 113, 56, 100, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 118, 52, 112, 120, 54, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 106, 108, 113, 56, 100, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 118, 52, 112, 120, 54, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1227,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j4561920.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937",
Fragment: "",
RawQuery: "api-version=2025-12-23-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Correlation-Request-Id": [
"df0ba451-c04d-46f0-895e-bc2e85d765e5",
],
"X-Ms-Client-Request-Id": [
"67ebdf96-cb38-4b47-90e6-8d990d752e02",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T16:26:29Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"Authorization": ["redacted"],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j4561920.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j4561920.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x240541bb34e0>{N: ..., E: ...},
Version: 3,
SerialNumber: {neg: ..., abs: ...},
Issuer: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
Subject: {
Country: ...,
Organization: ...,
OrganizationalUnit: ...,
Locality: ...,
Province: ...,
StreetAddress: ...,
PostalCode: ...,
SerialNumber: ...,
CommonName: ...,
Names: ...,
ExtraNames: ...,
},
NotBefore: {wall: ..., ext: ..., loc: ...},
NotAfter: {wall: ..., ext: ..., loc: ...},
KeyUsage: 5,
Extensions: [..., ..., ..., ..., ..., ...],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [..., ...],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [...],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\",\n \"name\": \"c3e6190f-6d0a-4437-b946-d5969f96f937\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T16:07:16.344851872Z\",\n \"endTime\": \"2026-10-05T16:26:24.47612917Z\",\n \"error\": {\n \"code\": \"DeadlineExceeded\",\n \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
],
}
occurredContributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed to roll out Helm release: context deadline exceededfull failure pattern: failed to roll out Helm release: context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s) | provision | 2 | 2.60%2 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s) | Show trend detailsSep 29: 0 · Sep 30: 4 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (2)time=2026-10-05T23:18:10.703Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit description="Step arobit\n Kind: Helm\n" time=2026-10-05T23:18:11.131Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit values="map[forwarder:map[azureCloudEnvironmentName:AzurePublicCloud clusterName:ci01-j0130560-svc clusterType:svc dynamicConfig:false environment:dev fluentbit:map[image:map[digest:sha256:70dea5e158860b7b59a9e9aae0e79fc5ab51f2c356fcc14aef38ce1ff6d7d577 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:oss/v2/fluent/fluent-bit] resources:map[limits:map[memory:1248Mi] requests:map[cpu:450m memory:472Mi]]] geoShortId:ca kusto:map[blob_uri_length:128 buffer_dir:/var/kusto buffer_file_delete_early:false buffering:true buffering_enabled:true delete_on_max_upload_error:true enabled:true hostedControlPlaneLogsDatabase:HostedControlPlaneLogs ingestionEndpoint:https://ingest-hcp-dev-us-2.eastus2.kusto.windows.net io_timeout:60s scheduler_max_retries:9 serviceLogsDatabase:ServiceLogs store_dir_limit_size:1.8GB unify_tag:true upload_file_size:16M upload_timeout:1m] mdsd:map[enabled:false geneva:map[clusterLogsAccountName:placeholder clusterLogsNamespace: clusterLogsSan:empty-sentinel clusterLogsSecretName:clusterlogs configVersion:1 environment:Test region:canadacentral role:hcp-underlay-ci01-j0130560-svc rpAccountName:placeholder rpNamespace: rpSan:empty-sentinel rpSecretName:rplogs] image:map[digest:sha256:8dcdcbb193278f21587a96cb958ab100c6140c2284b1e95a98ddf749d3cc0703 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:geneva/distroless/mdsd]] msiClientId:07c7a7dc-f584-486c-8d39-ebf1e695ebed region:canadacentral secretProvider:map[keyVault:aro-hcp-dev-svc-kv] securityContext:map[enabled:true runAsGroup:65532 runAsUser:65532] serviceAccountName:arobit-forwarder tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX watchdog:map[image:map[digest:sha256:161971cdd3bfe66be6a9b96d67fabf8c4b54a88b841add1aaced26b0a00358b4 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:aks/command/runtime] intervalSeconds:15 timeoutSeconds:300]] watson:map[env:map[AUTHENTICATION_ID:MsiClientId#07c7a7dc-f584-486c-8d39-ebf1e695ebed INCOMING_QUEUE:/azure-watson/cores MDSD_ROLE_PREFIX:/var/run/mdsd/asa/ REPORT_QUEUE:/azure-watson/queue WA_CORE_PATTERN:/azure-watson/cores/%e.%p.%h.%t] image:map[digest:sha256:8e5ef3e76be33794cef7460712eb9ff0c73bce8b8e5ffc33c5c6bfe0762f5db0 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:azure-watson/agent/azlinux3] resources:map[limits:map[cpu:250m memory:512Mi] requests:map[cpu:50m memory:128Mi]] securityContext:map[privileged:true] volumes:map[crashdumpHostPath:/home/docker/azure-watson]]]" time=2026-10-05T23:18:11.131Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:18:11.331Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit namespace=arobit time=2026-10-05T23:18:11.538Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit dryRun=false time=2026-10-05T23:18:11.538Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:18:11.576Z level=INFO msg="No release history found, running the first release..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:28:15.149Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded" time=2026-10-05T23:28:15.149Z level=INFO msg="Retrying step" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit step=arobit error="error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded" time=2026-10-05T23:29:15.152Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit description="Step arobit\n Kind: Helm\n" time=2026-10-05T23:29:15.561Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit values="map[forwarder:map[azureCloudEnvironmentName:AzurePublicCloud clusterName:ci01-j0130560-svc clusterType:svc dynamicConfig:false environment:dev fluentbit:map[image:map[digest:sha256:70dea5e158860b7b59a9e9aae0e79fc5ab51f2c356fcc14aef38ce1ff6d7d577 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:oss/v2/fluent/fluent-bit] resources:map[limits:map[memory:1248Mi] requests:map[cpu:450m memory:472Mi]]] geoShortId:ca kusto:map[blob_uri_length:128 buffer_dir:/var/kusto buffer_file_delete_early:false buffering:true buffering_enabled:true delete_on_max_upload_error:true enabled:true hostedControlPlaneLogsDatabase:HostedControlPlaneLogs ingestionEndpoint:https://ingest-hcp-dev-us-2.eastus2.kusto.windows.net io_timeout:60s scheduler_max_retries:9 serviceLogsDatabase:ServiceLogs store_dir_limit_size:1.8GB unify_tag:true upload_file_size:16M upload_timeout:1m] mdsd:map[enabled:false geneva:map[clusterLogsAccountName:placeholder clusterLogsNamespace: clusterLogsSan:empty-sentinel clusterLogsSecretName:clusterlogs configVersion:1 environment:Test region:canadacentral role:hcp-underlay-ci01-j0130560-svc rpAccountName:placeholder rpNamespace: rpSan:empty-sentinel rpSecretName:rplogs] image:map[digest:sha256:8dcdcbb193278f21587a96cb958ab100c6140c2284b1e95a98ddf749d3cc0703 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:geneva/distroless/mdsd]] msiClientId:07c7a7dc-f584-486c-8d39-ebf1e695ebed region:canadacentral secretProvider:map[keyVault:aro-hcp-dev-svc-kv] securityContext:map[enabled:true runAsGroup:65532 runAsUser:65532] serviceAccountName:arobit-forwarder tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX watchdog:map[image:map[digest:sha256:161971cdd3bfe66be6a9b96d67fabf8c4b54a88b841add1aaced26b0a00358b4 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:aks/command/runtime] intervalSeconds:15 timeoutSeconds:300]] watson:map[env:map[AUTHENTICATION_ID:MsiClientId#07c7a7dc-f584-486c-8d39-ebf1e695ebed INCOMING_QUEUE:/azure-watson/cores MDSD_ROLE_PREFIX:/var/run/mdsd/asa/ REPORT_QUEUE:/azure-watson/queue WA_CORE_PATTERN:/azure-watson/cores/%e.%p.%h.%t] image:map[digest:sha256:8e5ef3e76be33794cef7460712eb9ff0c73bce8b8e5ffc33c5c6bfe0762f5db0 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:azure-watson/agent/azlinux3] resources:map[limits:map[cpu:250m memory:512Mi] requests:map[cpu:50m memory:128Mi]] securityContext:map[privileged:true] volumes:map[crashdumpHostPath:/home/docker/azure-watson]]]" time=2026-10-05T23:29:15.561Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:29:15.876Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit namespace=arobit time=2026-10-05T23:29:16.247Z level=INFO msg="Doing dry-run of Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:29:16.247Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:29:16.388Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=1 time=2026-10-05T23:29:17.014Z level=INFO msg="Removing old field manager from objects in release manifest." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:29:17.014Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ServiceAccount" namespace=arobit name=arobit-forwarder time=2026-10-05T23:29:17.353Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ConfigMap" namespace=arobit name=arobit-forwarder time=2026-10-05T23:29:17.822Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRole" namespace="" name=arobit-forwarder time=2026-10-05T23:29:18.380Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding" namespace="" name=arobit-forwarder time=2026-10-05T23:29:18.734Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=Service" namespace=arobit name=arobit-forwarder time=2026-10-05T23:29:19.084Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="apps/v1, Kind=DaemonSet" namespace=arobit name=arobit-forwarder time=2026-10-05T23:29:19.694Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="monitoring.coreos.com/v1, Kind=ServiceMonitor" namespace=arobit name=arobit-forwarder time=2026-10-05T23:29:19.902Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit dryRun=false time=2026-10-05T23:29:19.902Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:29:19.952Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=1 time=2026-10-05T23:39:21.321Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded" time=2026-10-05T23:39:21.321Z level=INFO msg="Retrying step" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit step=arobit error="error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded" time=2026-10-05T23:40:21.330Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit description="Step arobit\n Kind: Helm\n" time=2026-10-05T23:40:21.850Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit values="map[forwarder:map[azureCloudEnvironmentName:AzurePublicCloud clusterName:ci01-j0130560-svc clusterType:svc dynamicConfig:false environment:dev fluentbit:map[image:map[digest:sha256:70dea5e158860b7b59a9e9aae0e79fc5ab51f2c356fcc14aef38ce1ff6d7d577 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:oss/v2/fluent/fluent-bit] resources:map[limits:map[memory:1248Mi] requests:map[cpu:450m memory:472Mi]]] geoShortId:ca kusto:map[blob_uri_length:128 buffer_dir:/var/kusto buffer_file_delete_early:false buffering:true buffering_enabled:true delete_on_max_upload_error:true enabled:true hostedControlPlaneLogsDatabase:HostedControlPlaneLogs ingestionEndpoint:https://ingest-hcp-dev-us-2.eastus2.kusto.windows.net io_timeout:60s scheduler_max_retries:9 serviceLogsDatabase:ServiceLogs store_dir_limit_size:1.8GB unify_tag:true upload_file_size:16M upload_timeout:1m] mdsd:map[enabled:false geneva:map[clusterLogsAccountName:placeholder clusterLogsNamespace: clusterLogsSan:empty-sentinel clusterLogsSecretName:clusterlogs configVersion:1 environment:Test region:canadacentral role:hcp-underlay-ci01-j0130560-svc rpAccountName:placeholder rpNamespace: rpSan:empty-sentinel rpSecretName:rplogs] image:map[digest:sha256:8dcdcbb193278f21587a96cb958ab100c6140c2284b1e95a98ddf749d3cc0703 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:geneva/distroless/mdsd]] msiClientId:07c7a7dc-f584-486c-8d39-ebf1e695ebed region:canadacentral secretProvider:map[keyVault:aro-hcp-dev-svc-kv] securityContext:map[enabled:true runAsGroup:65532 runAsUser:65532] serviceAccountName:arobit-forwarder tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX watchdog:map[image:map[digest:sha256:161971cdd3bfe66be6a9b96d67fabf8c4b54a88b841add1aaced26b0a00358b4 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:aks/command/runtime] intervalSeconds:15 timeoutSeconds:300]] watson:map[env:map[AUTHENTICATION_ID:MsiClientId#07c7a7dc-f584-486c-8d39-ebf1e695ebed INCOMING_QUEUE:/azure-watson/cores MDSD_ROLE_PREFIX:/var/run/mdsd/asa/ REPORT_QUEUE:/azure-watson/queue WA_CORE_PATTERN:/azure-watson/cores/%e.%p.%h.%t] image:map[digest:sha256:8e5ef3e76be33794cef7460712eb9ff0c73bce8b8e5ffc33c5c6bfe0762f5db0 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:azure-watson/agent/azlinux3] resources:map[limits:map[cpu:250m memory:512Mi] requests:map[cpu:50m memory:128Mi]] securityContext:map[privileged:true] volumes:map[crashdumpHostPath:/home/docker/azure-watson]]]" time=2026-10-05T23:40:21.850Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:40:22.145Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit namespace=arobit time=2026-10-05T23:40:22.463Z level=INFO msg="Doing dry-run of Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:40:22.463Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:40:22.721Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=2 time=2026-10-05T23:40:23.339Z level=INFO msg="Removing old field manager from objects in release manifest." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:40:23.339Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ServiceAccount" namespace=arobit name=arobit-forwarder time=2026-10-05T23:40:23.556Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ConfigMap" namespace=arobit name=arobit-forwarder time=2026-10-05T23:40:23.818Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRole" namespace="" name=arobit-forwarder time=2026-10-05T23:40:24.356Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding" namespace="" name=arobit-forwarder time=2026-10-05T23:40:24.582Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=Service" namespace=arobit name=arobit-forwarder time=2026-10-05T23:40:24.826Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="apps/v1, Kind=DaemonSet" namespace=arobit name=arobit-forwarder time=2026-10-05T23:40:25.179Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="monitoring.coreos.com/v1, Kind=ServiceMonitor" namespace=arobit name=arobit-forwarder time=2026-10-05T23:40:25.516Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit dryRun=false time=2026-10-05T23:40:25.516Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T23:40:25.574Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=2 time=2026-10-05T23:48:10.601Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="context deadline exceeded" time=2026-10-05T23:48:10.601Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: context deadline exceeded" time=2026-10-05T18:51:40.028Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit description="Step arobit\n Kind: Helm\n" time=2026-10-05T18:51:40.439Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit values="map[forwarder:map[azureCloudEnvironmentName:AzurePublicCloud clusterName:ci01-j8411136-svc clusterType:svc dynamicConfig:false environment:dev fluentbit:map[image:map[digest:sha256:70dea5e158860b7b59a9e9aae0e79fc5ab51f2c356fcc14aef38ce1ff6d7d577 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:oss/v2/fluent/fluent-bit] resources:map[limits:map[memory:1248Mi] requests:map[cpu:450m memory:472Mi]]] geoShortId:us kusto:map[blob_uri_length:128 buffer_dir:/var/kusto buffer_file_delete_early:false buffering:true buffering_enabled:true delete_on_max_upload_error:true enabled:true hostedControlPlaneLogsDatabase:HostedControlPlaneLogs ingestionEndpoint:https://ingest-hcp-dev-us-2.eastus2.kusto.windows.net io_timeout:60s scheduler_max_retries:9 serviceLogsDatabase:ServiceLogs store_dir_limit_size:1.8GB unify_tag:true upload_file_size:16M upload_timeout:1m] mdsd:map[enabled:false geneva:map[clusterLogsAccountName:placeholder clusterLogsNamespace: clusterLogsSan:empty-sentinel clusterLogsSecretName:clusterlogs configVersion:1 environment:Test region:westus3 role:hcp-underlay-ci01-j8411136-svc rpAccountName:placeholder rpNamespace: rpSan:empty-sentinel rpSecretName:rplogs] image:map[digest:sha256:8dcdcbb193278f21587a96cb958ab100c6140c2284b1e95a98ddf749d3cc0703 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:geneva/distroless/mdsd]] msiClientId:f30e3043-eff4-4c01-8097-12e7408108fa region:westus3 secretProvider:map[keyVault:aro-hcp-dev-svc-kv] securityContext:map[enabled:true runAsGroup:65532 runAsUser:65532] serviceAccountName:arobit-forwarder tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX watchdog:map[image:map[digest:sha256:161971cdd3bfe66be6a9b96d67fabf8c4b54a88b841add1aaced26b0a00358b4 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:aks/command/runtime] intervalSeconds:15 timeoutSeconds:300]] watson:map[env:map[AUTHENTICATION_ID:MsiClientId#f30e3043-eff4-4c01-8097-12e7408108fa INCOMING_QUEUE:/azure-watson/cores MDSD_ROLE_PREFIX:/var/run/mdsd/asa/ REPORT_QUEUE:/azure-watson/queue WA_CORE_PATTERN:/azure-watson/cores/%e.%p.%h.%t] image:map[digest:sha256:8e5ef3e76be33794cef7460712eb9ff0c73bce8b8e5ffc33c5c6bfe0762f5db0 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:azure-watson/agent/azlinux3] resources:map[limits:map[cpu:250m memory:512Mi] requests:map[cpu:50m memory:128Mi]] securityContext:map[privileged:true] volumes:map[crashdumpHostPath:/home/docker/azure-watson]]]" time=2026-10-05T18:51:40.440Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T18:51:40.692Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit namespace=arobit time=2026-10-05T18:51:41.342Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit dryRun=false time=2026-10-05T18:51:41.342Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T18:51:41.468Z level=INFO msg="No release history found, running the first release..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T19:01:45.280Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded" time=2026-10-05T19:01:45.280Z level=INFO msg="Retrying step" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit step=arobit error="error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded" time=2026-10-05T19:02:45.281Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit description="Step arobit\n Kind: Helm\n" time=2026-10-05T19:02:45.868Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit values="map[forwarder:map[azureCloudEnvironmentName:AzurePublicCloud clusterName:ci01-j8411136-svc clusterType:svc dynamicConfig:false environment:dev fluentbit:map[image:map[digest:sha256:70dea5e158860b7b59a9e9aae0e79fc5ab51f2c356fcc14aef38ce1ff6d7d577 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:oss/v2/fluent/fluent-bit] resources:map[limits:map[memory:1248Mi] requests:map[cpu:450m memory:472Mi]]] geoShortId:us kusto:map[blob_uri_length:128 buffer_dir:/var/kusto buffer_file_delete_early:false buffering:true buffering_enabled:true delete_on_max_upload_error:true enabled:true hostedControlPlaneLogsDatabase:HostedControlPlaneLogs ingestionEndpoint:https://ingest-hcp-dev-us-2.eastus2.kusto.windows.net io_timeout:60s scheduler_max_retries:9 serviceLogsDatabase:ServiceLogs store_dir_limit_size:1.8GB unify_tag:true upload_file_size:16M upload_timeout:1m] mdsd:map[enabled:false geneva:map[clusterLogsAccountName:placeholder clusterLogsNamespace: clusterLogsSan:empty-sentinel clusterLogsSecretName:clusterlogs configVersion:1 environment:Test region:westus3 role:hcp-underlay-ci01-j8411136-svc rpAccountName:placeholder rpNamespace: rpSan:empty-sentinel rpSecretName:rplogs] image:map[digest:sha256:8dcdcbb193278f21587a96cb958ab100c6140c2284b1e95a98ddf749d3cc0703 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:geneva/distroless/mdsd]] msiClientId:f30e3043-eff4-4c01-8097-12e7408108fa region:westus3 secretProvider:map[keyVault:aro-hcp-dev-svc-kv] securityContext:map[enabled:true runAsGroup:65532 runAsUser:65532] serviceAccountName:arobit-forwarder tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX watchdog:map[image:map[digest:sha256:161971cdd3bfe66be6a9b96d67fabf8c4b54a88b841add1aaced26b0a00358b4 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:aks/command/runtime] intervalSeconds:15 timeoutSeconds:300]] watson:map[env:map[AUTHENTICATION_ID:MsiClientId#f30e3043-eff4-4c01-8097-12e7408108fa INCOMING_QUEUE:/azure-watson/cores MDSD_ROLE_PREFIX:/var/run/mdsd/asa/ REPORT_QUEUE:/azure-watson/queue WA_CORE_PATTERN:/azure-watson/cores/%e.%p.%h.%t] image:map[digest:sha256:8e5ef3e76be33794cef7460712eb9ff0c73bce8b8e5ffc33c5c6bfe0762f5db0 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:azure-watson/agent/azlinux3] resources:map[limits:map[cpu:250m memory:512Mi] requests:map[cpu:50m memory:128Mi]] securityContext:map[privileged:true] volumes:map[crashdumpHostPath:/home/docker/azure-watson]]]" time=2026-10-05T19:02:45.868Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T19:02:46.477Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit namespace=arobit time=2026-10-05T19:02:47.121Z level=INFO msg="Doing dry-run of Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T19:02:47.121Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T19:02:47.481Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=1 time=2026-10-05T19:02:48.530Z level=INFO msg="Removing old field manager from objects in release manifest." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T19:02:48.530Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ServiceAccount" namespace=arobit name=arobit-forwarder time=2026-10-05T19:02:49.268Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ConfigMap" namespace=arobit name=arobit-forwarder time=2026-10-05T19:02:49.829Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRole" namespace="" name=arobit-forwarder time=2026-10-05T19:02:50.750Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding" namespace="" name=arobit-forwarder time=2026-10-05T19:02:51.062Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=Service" namespace=arobit name=arobit-forwarder time=2026-10-05T19:02:51.630Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="apps/v1, Kind=DaemonSet" namespace=arobit name=arobit-forwarder time=2026-10-05T19:02:52.175Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="monitoring.coreos.com/v1, Kind=ServiceMonitor" namespace=arobit name=arobit-forwarder time=2026-10-05T19:02:52.824Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit dryRun=false time=2026-10-05T19:02:52.824Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T19:02:53.077Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=1 time=2026-10-05T19:12:55.941Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded" time=2026-10-05T19:12:55.941Z level=INFO msg="Retrying step" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit step=arobit error="error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded" time=2026-10-05T19:13:55.943Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit description="Step arobit\n Kind: Helm\n" time=2026-10-05T19:13:56.804Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit values="map[forwarder:map[azureCloudEnvironmentName:AzurePublicCloud clusterName:ci01-j8411136-svc clusterType:svc dynamicConfig:false environment:dev fluentbit:map[image:map[digest:sha256:70dea5e158860b7b59a9e9aae0e79fc5ab51f2c356fcc14aef38ce1ff6d7d577 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:oss/v2/fluent/fluent-bit] resources:map[limits:map[memory:1248Mi] requests:map[cpu:450m memory:472Mi]]] geoShortId:us kusto:map[blob_uri_length:128 buffer_dir:/var/kusto buffer_file_delete_early:false buffering:true buffering_enabled:true delete_on_max_upload_error:true enabled:true hostedControlPlaneLogsDatabase:HostedControlPlaneLogs ingestionEndpoint:https://ingest-hcp-dev-us-2.eastus2.kusto.windows.net io_timeout:60s scheduler_max_retries:9 serviceLogsDatabase:ServiceLogs store_dir_limit_size:1.8GB unify_tag:true upload_file_size:16M upload_timeout:1m] mdsd:map[enabled:false geneva:map[clusterLogsAccountName:placeholder clusterLogsNamespace: clusterLogsSan:empty-sentinel clusterLogsSecretName:clusterlogs configVersion:1 environment:Test region:westus3 role:hcp-underlay-ci01-j8411136-svc rpAccountName:placeholder rpNamespace: rpSan:empty-sentinel rpSecretName:rplogs] image:map[digest:sha256:8dcdcbb193278f21587a96cb958ab100c6140c2284b1e95a98ddf749d3cc0703 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:geneva/distroless/mdsd]] msiClientId:f30e3043-eff4-4c01-8097-12e7408108fa region:westus3 secretProvider:map[keyVault:aro-hcp-dev-svc-kv] securityContext:map[enabled:true runAsGroup:65532 runAsUser:65532] serviceAccountName:arobit-forwarder tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX watchdog:map[image:map[digest:sha256:161971cdd3bfe66be6a9b96d67fabf8c4b54a88b841add1aaced26b0a00358b4 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:aks/command/runtime] intervalSeconds:15 timeoutSeconds:300]] watson:map[env:map[AUTHENTICATION_ID:MsiClientId#f30e3043-eff4-4c01-8097-12e7408108fa INCOMING_QUEUE:/azure-watson/cores MDSD_ROLE_PREFIX:/var/run/mdsd/asa/ REPORT_QUEUE:/azure-watson/queue WA_CORE_PATTERN:/azure-watson/cores/%e.%p.%h.%t] image:map[digest:sha256:8e5ef3e76be33794cef7460712eb9ff0c73bce8b8e5ffc33c5c6bfe0762f5db0 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:azure-watson/agent/azlinux3] resources:map[limits:map[cpu:250m memory:512Mi] requests:map[cpu:50m memory:128Mi]] securityContext:map[privileged:true] volumes:map[crashdumpHostPath:/home/docker/azure-watson]]]" time=2026-10-05T19:13:56.804Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T19:13:57.232Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit namespace=arobit time=2026-10-05T19:13:58.023Z level=INFO msg="Doing dry-run of Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T19:13:58.023Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T19:13:58.259Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=2 time=2026-10-05T19:13:59.227Z level=INFO msg="Removing old field manager from objects in release manifest." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T19:13:59.228Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ServiceAccount" namespace=arobit name=arobit-forwarder time=2026-10-05T19:14:00.003Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ConfigMap" namespace=arobit name=arobit-forwarder time=2026-10-05T19:14:00.663Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRole" namespace="" name=arobit-forwarder time=2026-10-05T19:14:01.629Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding" namespace="" name=arobit-forwarder time=2026-10-05T19:14:02.281Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=Service" namespace=arobit name=arobit-forwarder time=2026-10-05T19:14:02.991Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="apps/v1, Kind=DaemonSet" namespace=arobit name=arobit-forwarder time=2026-10-05T19:14:03.683Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="monitoring.coreos.com/v1, Kind=ServiceMonitor" namespace=arobit name=arobit-forwarder time=2026-10-05T19:14:04.305Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit dryRun=false time=2026-10-05T19:14:04.305Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit time=2026-10-05T19:14:04.560Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=2 time=2026-10-05T19:21:40.183Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="context deadline exceeded" time=2026-10-05T19:21:40.183Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: context deadline exceeded" Contributing tests (1)
Affected runs (2)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail code SubscriptionRequestsThrottled; detail message Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor ...full failure pattern: ERROR CODE: InternalServerError; detail code SubscriptionRequestsThrottled; detail message Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '<uuid>' exceeded. Please try again after '<seconds>' seconds after additional tokens are available.; provider Microsoft.Compute Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s) | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s) | Show trend detailsSep 29: 4 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:165]: failed to create node pool npupgrade-4-20 with version 4.20.40
Unexpected error:
<*fmt.wrapError | 0x9537f6d3c20>:
failed to create NodePool npupgrade-4-20: failed waiting for nodepool="npupgrade-4-20" for cluster "np-version-upgrade-cluster-s84r9b" in resourcegroup="rg-np-version-upgrade-s84r9b-rcmjqbkj5bqh" to finish creating: GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866",
"name": "d8f8bca4-8c58-4590-9fe5-c6d7cc06e866",
"status": "Failed",
"startTime": "2026-10-05T19:07:58.071230128Z",
"endTime": "2026-10-05T19:08:38.680974136Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\"\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool npupgrade-4-20: failed waiting for nodepool=\"npupgrade-4-20\" for cluster \"np-version-upgrade-cluster-s84r9b\" in resourcegroup=\"rg-np-version-upgrade-s84r9b-rcmjqbkj5bqh\" to finish creating: GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n \"name\": \"d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:07:58.071230128Z\",\n \"endTime\": \"2026-10-05T19:08:38.680974136Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x9537f6d3760>{
msg: "failed waiting for nodepool=\"npupgrade-4-20\" for cluster \"np-version-upgrade-cluster-s84r9b\" in resourcegroup=\"rg-np-version-upgrade-s84r9b-rcmjqbkj5bqh\" to finish creating: GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n \"name\": \"d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:07:58.071230128Z\",\n \"endTime\": \"2026-10-05T19:08:38.680974136Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x95381335020>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Mon, 05 Oct 2026 19:08:48 GMT",
],
"Content-Length": ["1296"],
"X-Envoy-Upstream-Service-Time": ["7"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"bed67fbc-da19-4ff2-8581-7faaacde45b0",
],
},
Body: <*exported.nopClosingBytesReader | 0x9537f6d2500>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 100, 56, 102, 56, 98, 99, 97, 52, 45, 56, 99, 53, 56, 45, 52, 53, 57, 48, 45, 57, 102, 101, 53, 45, 99, 54, 100, 55, 99, 99, 48, 54, 101, 56, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 100, 56, 102, 56, 98, 99, 97, 52, 45, 56, 99, 53, 56, 45, 52, 53, 57, 48, 45, 57, 102, 101, 53, 45, 99, 54, 100, 55, 99, 99, 48, 54, 101, 56, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 48, 55, 58, 53, 56, 46, 48, 55, 49, 50, 51, 48, 49, 50, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 48, 56, 58, 51, 56, 46, 54, 56, 48, 57, 55, 52, 49, 51, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 115, 107, 117, 115, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 39, 32, 97, 99, 116, 111, 114, 32, 39, 52, 55, 102, 54, 57, 53, 48, 50, 45, 48, 48, 54, 53, 45, 52, 100, 57, 97, 45, 98, 49, 57, 98, 45, 100, 52, 48, 51, 101, 49, 56, 51, 100, 50, 102, 52, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 46, 32, 82, 101, 102, 101, 114, 32, 116, 111, 32, 104, 116, 116, 112, 115, 58, 47, 47, 97, 107, 97, 46, 109, 115, 47, 97, 114, 109, 45, 116, 104, 114, 111, 116, 116, 108, 105, 110, 103, 32, 102, 111, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 105, 110, 102, 111, 114, 109, 97, 116, 105, 111, 110, 46, 92, 34, 92, 110, 32, 32, 125, 92, 110, 125, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1296,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j4304000.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Client-Request-Id": [
"27c665b0-31fc-4d90-907b-4e83655f5e19",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T19:08:48Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"42212478-d84f-4f3c-ae6e-854ba7c22a6c",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j4304000.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j4304000.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 125, 192, 96, 114, 235, 108, 75, 38, 184, 104, 195, 248, 74, 253, 180, 160, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 55, 53, 56, 50, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 48, 56, 50, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 220, 221, 78, 29, 190, 112, 112, 255, 38, 124, 11, 20, 125, 211, 210, 18, 45, 168, 76, 62, 161, 192, 190, 51, 103, 192, 255, 19, 95, 130, 78, 124, 89, 122, 74, 217, 180, 17, 12, 33, 5, 75, 56, 140, 78, 114, 189, 252, 214, 146, 96, 176, 238, 143, 52, 56, 250, 86, 242, 106, 206, 14, 249, 153, 230, 120, 146, 61, 181, 68, 17, 178, 36, 209, 23, 184, 94, 168, 141, 111, 8, 249, 23, 254, 169, 227, 12, 28, 38, 129, 160, 150, 74, 151, 130, 23, 139, 109, 167, 254, 67, 217, 146, 133, 231, 177, 32, 180, 248, 144, 151, 215, 236, 235, 141, 204, 169, 160, 186, 119, 135, 231, 26, 79, 172, 208, 244, 178, 217, 226, 228, 207, 177, 217, 16, 220, 19, 64, 12, 90, 222, 69, 224, 177, 91, 96, 222, 205, 93, 182, 216, 141, 158, 13, 175, 230, 120, 112, 2, 177, 45, 192, 64, 36, 33, 203, 15, 239, 81, 163, 211, 164, 244, 118, 208, 41, 103, 149, 45, 89, 115, 49, 148, 152, 14, 237, 12, 59, 104, 164, 33, 11, 223, 178, 233, 66, 247, 66, 125, 98, 121, 59, 138, 81, 173, 33, 81, 15, 32, 124, 213, 21, 147, 50, 225, 32, 212, 153, 204, 237, 240, 201, 44, 129, 4, 197, 123, 120, 211, 156, 124, 10, 195, 53, 103, 40, 254, 30, 214, 242, 125, 52, 163, 207, 126, 81, 66, 102, 98, 231, 1, 106, 88, 213, 227, 69, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 199, 26, 90, 185, 59, 77, 86, 145, 220, 100, 188, 130, 194, 147, 184, 56, 242, 166, 222, 167, 132, 96, 238, 206, 248, 34, 68, 218, 178, 95, 120, 103, 233, 60, 32, 99, 139, 119, 119, 170, 247, 230, 151, 0, 29, 110, 243, 181, 255, 136, 101, 235, 201, 174, 50, 149, 201, 223, 50, 235, 91, 236, 210, 125, 230, 53, 108, 236, 78, 65, 59, 224, 131, 153, 146, 245, 128, 63, 113, 175, 83, 83, 29, 244, 20, 239, 43, 191, 253, 57, 97, 2, 236, 239, 22, 151, 207, 93, 22, 39, 187, 108, 26, 87, 41, 249, 184, 253, 91, 136, 72, 42, 179, 180, 222, 244, 221, 103, 189, 226, 59, 207, 248, 142, 140, 42, 237, 6, 166, 77, 156, 160, 37, 77, 229, 11, 198, 44, 216, 85, 45, 167, 155, 235, 124, 44, 220, 176, 225, 167, 173, 92, 243, 115, 136, 86, 179, 153, 173, 254, 28, 66, 81, 250, 103, 137, 60, 172, 247, 5, 236, 123, 65, 162, 240, 115, 218, 62, 130, 34, 215, 67, 39, 210, 131, 61, 204, 252, 27, 111, 89, 194, 250, 53, 86, 210, 166, 72, 19, 92, 143, 127, 48, 95, 182, 150, 150, 51, 97, 93, 195, 6, 120, 53, 115, 245, 152, 2, 104, 166, 141, 65, 255, 155, 63, 187, 126, 71, 210, 48, 207, 62, 81, 6, 239, 225, 76, 13, 49, 219, 166, 240, 200, 30, 182, 80, 148, 233, 253, 216, 196, 95, 79, 23, 29, 143],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 125, 192, 96, 114, 235, 108, 75, 38, 184, 104, 195, 248, 74, 253, 180, 160, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 55, 53, 56, 50, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 48, 56, 50, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 220, 221, 78, 29, 190, 112, 112, 255, 38, 124, 11, 20, 125, 211, 210, 18, 45, 168, 76, 62, 161, 192, 190, 51, 103, 192, 255, 19, 95, 130, 78, 124, 89, 122, 74, 217, 180, 17, 12, 33, 5, 75, 56, 140, 78, 114, 189, 252, 214, 146, 96, 176, 238, 143, 52, 56, 250, 86, 242, 106, 206, 14, 249, 153, 230, 120, 146, 61, 181, 68, 17, 178, 36, 209, 23, 184, 94, 168, 141, 111, 8, 249, 23, 254, 169, 227, 12, 28, 38, 129, 160, 150, 74, 151, 130, 23, 139, 109, 167, 254, 67, 217, 146, 133, 231, 177, 32, 180, 248, 144, 151, 215, 236, 235, 141, 204, 169, 160, 186, 119, 135, 231, 26, 79, 172, 208, 244, 178, 217, 226, 228, 207, 177, 217, 16, 220, 19, 64, 12, 90, 222, 69, 224, 177, 91, 96, 222, 205, 93, 182, 216, 141, 158, 13, 175, 230, 120, 112, 2, 177, 45, 192, 64, 36, 33, 203, 15, 239, 81, 163, 211, 164, 244, 118, 208, 41, 103, 149, 45, 89, 115, 49, 148, 152, 14, 237, 12, 59, 104, 164, 33, 11, 223, 178, 233, 66, 247, 66, 125, 98, 121, 59, 138, 81, 173, 33, 81, 15, 32, 124, 213, 21, 147, 50, 225, 32, 212, 153, 204, 237, 240, 201, 44, 129, 4, 197, 123, 120, 211, 156, 124, 10, 195, 53, 103, 40, 254, 30, 214, 242, 125, 52, 163, 207, 126, 81, 66, 102, 98, 231, 1, 106, 88, 213, 227, 69, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 220, 221, 78, 29, 190, 112, 112, 255, 38, 124, 11, 20, 125, 211, 210, 18, 45, 168, 76, 62, 161, 192, 190, 51, 103, 192, 255, 19, 95, 130, 78, 124, 89, 122, 74, 217, 180, 17, 12, 33, 5, 75, 56, 140, 78, 114, 189, 252, 214, 146, 96, 176, 238, 143, 52, 56, 250, 86, 242, 106, 206, 14, 249, 153, 230, 120, 146, 61, 181, 68, 17, 178, 36, 209, 23, 184, 94, 168, 141, 111, 8, 249, 23, 254, 169, 227, 12, 28, 38, 129, 160, 150, 74, 151, 130, 23, 139, 109, 167, 254, 67, 217, 146, 133, 231, 177, 32, 180, 248, 144, 151, 215, 236, 235, 141, 204, 169, 160, 186, 119, 135, 231, 26, 79, 172, 208, 244, 178, 217, 226, 228, 207, 177, 217, 16, 220, 19, 64, 12, 90, 222, 69, 224, 177, 91, 96, 222, 205, 93, 182, 216, 141, 158, 13, 175, 230, 120, 112, 2, 177, 45, 192, 64, 36, 33, 203, 15, 239, 81, 163, 211, 164, 244, 118, 208, 41, 103, 149, 45, 89, 115, 49, 148, 152, 14, 237, 12, 59, 104, 164, 33, 11, 223, 178, 233, 66, 247, 66, 125, 98, 121, 59, 138, 81, 173, 33, 81, 15, 32, 124, 213, 21, 147, 50, 225, 32, 212, 153, 204, 237, 240, 201, 44, 129, 4, 197, 123, 120, 211, 156, 124, 10, 195, 53, 103, 40, 254, 30, 214, 242, 125, 52, 163, 207, 126, 81, 66, 102, 98, 231, 1, 106, 88, 213, 227, 69, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [199, 26, 90, 185, 59, 77, 86, 145, 220, 100, 188, 130, 194, 147, 184, 56, 242, 166, 222, 167, 132, 96, 238, 206, 248, 34, 68, 218, 178, 95, 120, 103, 233, 60, 32, 99, 139, 119, 119, 170, 247, 230, 151, 0, 29, 110, 243, 181, 255, 136, 101, 235, 201, 174, 50, 149, 201, 223, 50, 235, 91, 236, 210, 125, 230, 53, 108, 236, 78, 65, 59, 224, 131, 153, 146, 245, 128, 63, 113, 175, 83, 83, 29, 244, 20, 239, 43, 191, 253, 57, 97, 2, 236, 239, 22, 151, 207, 93, 22, 39, 187, 108, 26, 87, 41, 249, 184, 253, 91, 136, 72, 42, 179, 180, 222, 244, 221, 103, 189, 226, 59, 207, 248, 142, 140, 42, 237, 6, 166, 77, 156, 160, 37, 77, 229, 11, 198, 44, 216, 85, 45, 167, 155, 235, 124, 44, 220, 176, 225, 167, 173, 92, 243, 115, 136, 86, 179, 153, 173, 254, 28, 66, 81, 250, 103, 137, 60, 172, 247, 5, 236, 123, 65, 162, 240, 115, 218, 62, 130, 34, 215, 67, 39, 210, 131, 61, 204, 252, 27, 111, 89, 194, 250, 53, 86, 210, 166, 72, 19, 92, 143, 127, 48, 95, 182, 150, 150, 51, 97, 93, 195, 6, 120, 53, 115, 245, 152, 2, 104, 166, 141, 65, 255, 155, 63, 187, 126, 71, 210, 48, 207, 62, 81, 6, 239, 225, 76, 13, 49, 219, 166, 240, 200, 30, 182, 80, 148, 233, 253, 216, 196, 95, 79, 23, 29, 143],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x95380cc9380>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [13288086171734095008, 9061348496961719078],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j4304000.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j4304000.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926819901, loc: nil},
NotAfter: {wall: 0, ext: 63942545301, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237],
AuthorityKeyId: [136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j4304000.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n \"name\": \"d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:07:58.071230128Z\",\n \"endTime\": \"2026-10-05T19:08:38.680974136Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:165]: failed to create node pool npupgrade-4-20 with version 4.20.40
Unexpected error:
<*fmt.wrapError | 0x9537f6d3c20>:
failed to create NodePool npupgrade-4-20: failed waiting for nodepool="npupgrade-4-20" for cluster "np-version-upgrade-cluster-s84r9b" in resourcegroup="rg-np-version-upgrade-s84r9b-rcmjqbkj5bqh" to finish creating: GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866",
"name": "d8f8bca4-8c58-4590-9fe5-c6d7cc06e866",
"status": "Failed",
"startTime": "2026-10-05T19:07:58.071230128Z",
"endTime": "2026-10-05T19:08:38.680974136Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n \"error\": {\n \"code\": \"SubscriptionRequestsThrottled\",\n \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\"\n }\n}\n--------------------------------------------------------------------------------\n"
}
}
--------------------------------------------------------------------------------
{
msg: "failed to create NodePool npupgrade-4-20: failed waiting for nodepool=\"npupgrade-4-20\" for cluster \"np-version-upgrade-cluster-s84r9b\" in resourcegroup=\"rg-np-version-upgrade-s84r9b-rcmjqbkj5bqh\" to finish creating: GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n \"name\": \"d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:07:58.071230128Z\",\n \"endTime\": \"2026-10-05T19:08:38.680974136Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x9537f6d3760>{
msg: "failed waiting for nodepool=\"npupgrade-4-20\" for cluster \"np-version-upgrade-cluster-s84r9b\" in resourcegroup=\"rg-np-version-upgrade-s84r9b-rcmjqbkj5bqh\" to finish creating: GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n \"name\": \"d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:07:58.071230128Z\",\n \"endTime\": \"2026-10-05T19:08:38.680974136Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x95381335020>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Date": [
"Mon, 05 Oct 2026 19:08:48 GMT",
],
"Content-Length": ["1296"],
"X-Envoy-Upstream-Service-Time": ["7"],
"Server": ["istio-envoy"],
"Content-Type": ["application/json"],
"X-Ms-Request-Id": [
"bed67fbc-da19-4ff2-8581-7faaacde45b0",
],
},
Body: <*exported.nopClosingBytesReader | 0x9537f6d2500>{
s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 100, 56, 102, 56, 98, 99, 97, 52, 45, 56, 99, 53, 56, 45, 52, 53, 57, 48, 45, 57, 102, 101, 53, 45, 99, 54, 100, 55, 99, 99, 48, 54, 101, 56, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 100, 56, 102, 56, 98, 99, 97, 52, 45, 56, 99, 53, 56, 45, 52, 53, 57, 48, 45, 57, 102, 101, 53, 45, 99, 54, 100, 55, 99, 99, 48, 54, 101, 56, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 48, 55, 58, 53, 56, 46, 48, 55, 49, 50, 51, 48, 49, 50, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 48, 56, 58, 51, 56, 46, 54, 56, 48, 57, 55, 52, 49, 51, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 115, 107, 117, 115, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 39, 32, 97, 99, 116, 111, 114, 32, 39, 52, 55, 102, 54, 57, 53, 48, 50, 45, 48, 48, 54, 53, 45, 52, 100, 57, 97, 45, 98, 49, 57, 98, 45, 100, 52, 48, 51, 101, 49, 56, 51, 100, 50, 102, 52, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 46, 32, 82, 101, 102, 101, 114, 32, 116, 111, 32, 104, 116, 116, 112, 115, 58, 47, 47, 97, 107, 97, 46, 109, 115, 47, 97, 114, 109, 45, 116, 104, 114, 111, 116, 116, 108, 105, 110, 103, 32, 102, 111, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 105, 110, 102, 111, 114, 109, 97, 116, 105, 111, 110, 46, 92, 34, 92, 110, 32, 32, 125, 92, 110, 125, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
i: 0,
},
ContentLength: 1296,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {
Scheme: "https",
Opaque: "",
User: nil,
Host: "rp.j4304000.hcpsvc.osadev.cloud",
Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866",
Fragment: "",
RawQuery: "api-version=2024-06-10-preview",
RawPath: "",
RawFragment: "",
ForceQuery: false,
OmitHost: false,
},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {
"X-Ms-Client-Request-Id": [
"27c665b0-31fc-4d90-907b-4e83655f5e19",
],
"X-Ms-Arm-Resource-System-Data": [
"{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T19:08:48Z\"}",
],
"X-Ms-Identity-Url": [
"https://dummyhost.identity.azure.net",
],
"Authorization": ["redacted"],
"User-Agent": [
"e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
],
"X-Ms-Correlation-Request-Id": [
"42212478-d84f-4f3c-ae6e-854ba7c22a6c",
],
},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j4304000.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j4304000.hcpsvc.osadev.cloud",
PeerCertificates: [
{
Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 125, 192, 96, 114, 235, 108, 75, 38, 184, 104, 195, 248, 74, 253, 180, 160, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 55, 53, 56, 50, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 48, 56, 50, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 220, 221, 78, 29, 190, 112, 112, 255, 38, 124, 11, 20, 125, 211, 210, 18, 45, 168, 76, 62, 161, 192, 190, 51, 103, 192, 255, 19, 95, 130, 78, 124, 89, 122, 74, 217, 180, 17, 12, 33, 5, 75, 56, 140, 78, 114, 189, 252, 214, 146, 96, 176, 238, 143, 52, 56, 250, 86, 242, 106, 206, 14, 249, 153, 230, 120, 146, 61, 181, 68, 17, 178, 36, 209, 23, 184, 94, 168, 141, 111, 8, 249, 23, 254, 169, 227, 12, 28, 38, 129, 160, 150, 74, 151, 130, 23, 139, 109, 167, 254, 67, 217, 146, 133, 231, 177, 32, 180, 248, 144, 151, 215, 236, 235, 141, 204, 169, 160, 186, 119, 135, 231, 26, 79, 172, 208, 244, 178, 217, 226, 228, 207, 177, 217, 16, 220, 19, 64, 12, 90, 222, 69, 224, 177, 91, 96, 222, 205, 93, 182, 216, 141, 158, 13, 175, 230, 120, 112, 2, 177, 45, 192, 64, 36, 33, 203, 15, 239, 81, 163, 211, 164, 244, 118, 208, 41, 103, 149, 45, 89, 115, 49, 148, 152, 14, 237, 12, 59, 104, 164, 33, 11, 223, 178, 233, 66, 247, 66, 125, 98, 121, 59, 138, 81, 173, 33, 81, 15, 32, 124, 213, 21, 147, 50, 225, 32, 212, 153, 204, 237, 240, 201, 44, 129, 4, 197, 123, 120, 211, 156, 124, 10, 195, 53, 103, 40, 254, 30, 214, 242, 125, 52, 163, 207, 126, 81, 66, 102, 98, 231, 1, 106, 88, 213, 227, 69, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 199, 26, 90, 185, 59, 77, 86, 145, 220, 100, 188, 130, 194, 147, 184, 56, 242, 166, 222, 167, 132, 96, 238, 206, 248, 34, 68, 218, 178, 95, 120, 103, 233, 60, 32, 99, 139, 119, 119, 170, 247, 230, 151, 0, 29, 110, 243, 181, 255, 136, 101, 235, 201, 174, 50, 149, 201, 223, 50, 235, 91, 236, 210, 125, 230, 53, 108, 236, 78, 65, 59, 224, 131, 153, 146, 245, 128, 63, 113, 175, 83, 83, 29, 244, 20, 239, 43, 191, 253, 57, 97, 2, 236, 239, 22, 151, 207, 93, 22, 39, 187, 108, 26, 87, 41, 249, 184, 253, 91, 136, 72, 42, 179, 180, 222, 244, 221, 103, 189, 226, 59, 207, 248, 142, 140, 42, 237, 6, 166, 77, 156, 160, 37, 77, 229, 11, 198, 44, 216, 85, 45, 167, 155, 235, 124, 44, 220, 176, 225, 167, 173, 92, 243, 115, 136, 86, 179, 153, 173, 254, 28, 66, 81, 250, 103, 137, 60, 172, 247, 5, 236, 123, 65, 162, 240, 115, 218, 62, 130, 34, 215, 67, 39, 210, 131, 61, 204, 252, 27, 111, 89, 194, 250, 53, 86, 210, 166, 72, 19, 92, 143, 127, 48, 95, 182, 150, 150, 51, 97, 93, 195, 6, 120, 53, 115, 245, 152, 2, 104, 166, 141, 65, 255, 155, 63, 187, 126, 71, 210, 48, 207, 62, 81, 6, 239, 225, 76, 13, 49, 219, 166, 240, 200, 30, 182, 80, 148, 233, 253, 216, 196, 95, 79, 23, 29, 143],
RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 125, 192, 96, 114, 235, 108, 75, 38, 184, 104, 195, 248, 74, 253, 180, 160, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 55, 53, 56, 50, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 48, 56, 50, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 220, 221, 78, 29, 190, 112, 112, 255, 38, 124, 11, 20, 125, 211, 210, 18, 45, 168, 76, 62, 161, 192, 190, 51, 103, 192, 255, 19, 95, 130, 78, 124, 89, 122, 74, 217, 180, 17, 12, 33, 5, 75, 56, 140, 78, 114, 189, 252, 214, 146, 96, 176, 238, 143, 52, 56, 250, 86, 242, 106, 206, 14, 249, 153, 230, 120, 146, 61, 181, 68, 17, 178, 36, 209, 23, 184, 94, 168, 141, 111, 8, 249, 23, 254, 169, 227, 12, 28, 38, 129, 160, 150, 74, 151, 130, 23, 139, 109, 167, 254, 67, 217, 146, 133, 231, 177, 32, 180, 248, 144, 151, 215, 236, 235, 141, 204, 169, 160, 186, 119, 135, 231, 26, 79, 172, 208, 244, 178, 217, 226, 228, 207, 177, 217, 16, 220, 19, 64, 12, 90, 222, 69, 224, 177, 91, 96, 222, 205, 93, 182, 216, 141, 158, 13, 175, 230, 120, 112, 2, 177, 45, 192, 64, 36, 33, 203, 15, 239, 81, 163, 211, 164, 244, 118, 208, 41, 103, 149, 45, 89, 115, 49, 148, 152, 14, 237, 12, 59, 104, 164, 33, 11, 223, 178, 233, 66, 247, 66, 125, 98, 121, 59, 138, 81, 173, 33, 81, 15, 32, 124, 213, 21, 147, 50, 225, 32, 212, 153, 204, 237, 240, 201, 44, 129, 4, 197, 123, 120, 211, 156, 124, 10, 195, 53, 103, 40, 254, 30, 214, 242, 125, 52, 163, 207, 126, 81, 66, 102, 98, 231, 1, 106, 88, 213, 227, 69, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237],
RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 220, 221, 78, 29, 190, 112, 112, 255, 38, 124, 11, 20, 125, 211, 210, 18, 45, 168, 76, 62, 161, 192, 190, 51, 103, 192, 255, 19, 95, 130, 78, 124, 89, 122, 74, 217, 180, 17, 12, 33, 5, 75, 56, 140, 78, 114, 189, 252, 214, 146, 96, 176, 238, 143, 52, 56, 250, 86, 242, 106, 206, 14, 249, 153, 230, 120, 146, 61, 181, 68, 17, 178, 36, 209, 23, 184, 94, 168, 141, 111, 8, 249, 23, 254, 169, 227, 12, 28, 38, 129, 160, 150, 74, 151, 130, 23, 139, 109, 167, 254, 67, 217, 146, 133, 231, 177, 32, 180, 248, 144, 151, 215, 236, 235, 141, 204, 169, 160, 186, 119, 135, 231, 26, 79, 172, 208, 244, 178, 217, 226, 228, 207, 177, 217, 16, 220, 19, 64, 12, 90, 222, 69, 224, 177, 91, 96, 222, 205, 93, 182, 216, 141, 158, 13, 175, 230, 120, 112, 2, 177, 45, 192, 64, 36, 33, 203, 15, 239, 81, 163, 211, 164, 244, 118, 208, 41, 103, 149, 45, 89, 115, 49, 148, 152, 14, 237, 12, 59, 104, 164, 33, 11, 223, 178, 233, 66, 247, 66, 125, 98, 121, 59, 138, 81, 173, 33, 81, 15, 32, 124, 213, 21, 147, 50, 225, 32, 212, 153, 204, 237, 240, 201, 44, 129, 4, 197, 123, 120, 211, 156, 124, 10, 195, 53, 103, 40, 254, 30, 214, 242, 125, 52, 163, 207, 126, 81, 66, 102, 98, 231, 1, 106, 88, 213, 227, 69, 2, 3, 1, 0, 1],
RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
Signature: [199, 26, 90, 185, 59, 77, 86, 145, 220, 100, 188, 130, 194, 147, 184, 56, 242, 166, 222, 167, 132, 96, 238, 206, 248, 34, 68, 218, 178, 95, 120, 103, 233, 60, 32, 99, 139, 119, 119, 170, 247, 230, 151, 0, 29, 110, 243, 181, 255, 136, 101, 235, 201, 174, 50, 149, 201, 223, 50, 235, 91, 236, 210, 125, 230, 53, 108, 236, 78, 65, 59, 224, 131, 153, 146, 245, 128, 63, 113, 175, 83, 83, 29, 244, 20, 239, 43, 191, 253, 57, 97, 2, 236, 239, 22, 151, 207, 93, 22, 39, 187, 108, 26, 87, 41, 249, 184, 253, 91, 136, 72, 42, 179, 180, 222, 244, 221, 103, 189, 226, 59, 207, 248, 142, 140, 42, 237, 6, 166, 77, 156, 160, 37, 77, 229, 11, 198, 44, 216, 85, 45, 167, 155, 235, 124, 44, 220, 176, 225, 167, 173, 92, 243, 115, 136, 86, 179, 153, 173, 254, 28, 66, 81, 250, 103, 137, 60, 172, 247, 5, 236, 123, 65, 162, 240, 115, 218, 62, 130, 34, 215, 67, 39, 210, 131, 61, 204, 252, 27, 111, 89, 194, 250, 53, 86, 210, 166, 72, 19, 92, 143, 127, 48, 95, 182, 150, 150, 51, 97, 93, 195, 6, 120, 53, 115, 245, 152, 2, 104, 166, 141, 65, 255, 155, 63, 187, 126, 71, 210, 48, 207, 62, 81, 6, 239, 225, 76, 13, 49, 219, 166, 240, 200, 30, 182, 80, 148, 233, 253, 216, 196, 95, 79, 23, 29, 143],
SignatureAlgorithm: 4,
PublicKeyAlgorithm: 1,
PublicKey: <*rsa.PublicKey | 0x95380cc9380>{
N: {
neg: false,
abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
E: 65537,
},
Version: 3,
SerialNumber: {
neg: false,
abs: [13288086171734095008, 9061348496961719078],
},
Issuer: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j4304000.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
Subject: {
Country: nil,
Organization: nil,
OrganizationalUnit: nil,
Locality: nil,
Province: nil,
StreetAddress: nil,
PostalCode: nil,
SerialNumber: "",
CommonName: "rp.j4304000.hcpsvc.osadev.cloud",
Names: [
{Type: ..., Value: ...},
],
ExtraNames: nil,
},
NotBefore: {wall: 0, ext: 63926819901, loc: nil},
NotAfter: {wall: 0, ext: 63942545301, loc: nil},
KeyUsage: 5,
Extensions: [
{
Id: [..., ..., ..., ...],
Critical: true,
Value: [..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
{
Id: [..., ..., ..., ...],
Critical: false,
Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
},
],
ExtraExtensions: nil,
UnhandledCriticalExtensions: nil,
ExtKeyUsage: [1, 2],
UnknownExtKeyUsage: nil,
BasicConstraintsValid: true,
IsCA: false,
MaxPathLen: -1,
MaxPathLenZero: false,
SubjectKeyId: [136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237],
AuthorityKeyId: [136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237],
OCSPServer: nil,
IssuingCertificateURL: nil,
DNSNames: [
"rp.j4304000.hcpsvc.osadev.cloud",
],
EmailAddresses: nil,
IPAddresses: nil,
URIs: nil,
PermittedDNSDomainsCritical: false,
PermittedDNSDomains: nil,
ExcludedDNSDomains: nil,
PermittedIPRanges: nil,
ExcludedIPRanges: nil,
PermittedEmailAddresses: nil,
ExcludedEmailAddresses: nil,
PermittedURIDomains: nil,
ExcludedURIDomains: nil,
CRLDistributionPoints: nil,
PolicyIdentifiers: nil,
Policies: nil,
InhibitAnyPolicy: 0,
InhibitAnyPolicyZero: false,
InhibitPolicyMapping: 0,
InhibitPolicyMappingZero: false,
RequireExplicitPolicy: 0,
RequireExplicitPolicyZero: false,
PolicyMappings: nil,
},
],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n \"name\": \"d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T19:07:58.071230128Z\",\n \"endTime\": \"2026-10-05T19:08:38.680974136Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n \\\"error\\\": {\\n \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\\\"\\n }\\n}\\n--------------------------------------------------------------------------------\\n\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [svc] MaestroAgentMetricsProxyDown firedfull failure pattern: alert [svc] MaestroAgentMetricsProxyDown fired Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s) | alert | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s) | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)alert fired 1 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T22:07:54Z Severity: Sev3 Labels: alertname="MaestroAgentMetricsProxyDown", cluster="ci01-j9785984-mgmt-2", component="monitoring-infrastructure", region="westus3", severity="3" Description: Prometheus has not scraped maestro-agent /metrics through the metrics-proxy sidecar (namespace=maestro, endpoint=metrics) for 10 minutes, while a kube-state-metrics scrape series still exists for this management cluster. Maestro agent metrics and any alerts that depend on them may be missing. Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ERROR CODE: InternalServerError; detail message cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster still exists; [clusterServic...full failure pattern: ERROR CODE: InternalServerError; detail message cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster still exists; [clusterServiceStatus] state is "uninstalling"; [hostedCluster] HostedCluster still exists; [resourceTeardown] tearing down namespaces; [descendantResources] remaining resources: nodePools, serviceProviderClusters, serviceProviderNodePools; provider Microsoft.RedHatOpenShift Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s) | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
<*errors.joinError | 0x3eb60aa820c0>:
resource group "rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cp-ystream-deny-pods-5-0-wsc7r8" in resourcegroup="rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3",
"name": "d60bbb6e-33ce-417d-9990-65dcd65901f3",
"status": "Failed",
"startTime": "2026-10-05T21:11:20.151469184Z",
"endTime": "2026-10-05T21:35:24.10560305Z",
"error": {
"code": "InternalServerError",
"message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0x3eb60b558400>{
msg: "resource group \"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3eb60b5583c0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3eb60b5583a0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3eb60b558340>{
msg: "failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x3eb60c412720>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Server": [...],
"Content-Type": [...],
"X-Ms-Request-Id": [...],
"Date": [...],
"Content-Length": [...],
"X-Envoy-Upstream-Service-Time": [...],
},
Body: <*exported.nopClosingBytesReader | 0x3eb60b558200>{
s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
i: 0,
},
ContentLength: 1087,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j8926720.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j8926720.hcpsvc.osadev.cloud",
PeerCertificates: [...],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
},
},
],
}
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
<*errors.joinError | 0x3eb60aa820c0>:
resource group "rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cp-ystream-deny-pods-5-0-wsc7r8" in resourcegroup="rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3",
"name": "d60bbb6e-33ce-417d-9990-65dcd65901f3",
"status": "Failed",
"startTime": "2026-10-05T21:11:20.151469184Z",
"endTime": "2026-10-05T21:35:24.10560305Z",
"error": {
"code": "InternalServerError",
"message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)"
}
}
--------------------------------------------------------------------------------
{
errs: [
<*fmt.wrapError | 0x3eb60b558400>{
msg: "resource group \"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3eb60b5583c0>{
msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3eb60b5583a0>{
msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*fmt.wrapError | 0x3eb60b558340>{
msg: "failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
err: <*exported.ResponseError | 0x3eb60c412720>{
ErrorCode: "InternalServerError",
StatusCode: 200,
RawResponse: {
Status: "200 OK",
StatusCode: 200,
Proto: "HTTP/2.0",
ProtoMajor: 2,
ProtoMinor: 0,
Header: {
"Server": [...],
"Content-Type": [...],
"X-Ms-Request-Id": [...],
"Date": [...],
"Content-Length": [...],
"X-Envoy-Upstream-Service-Time": [...],
},
Body: <*exported.nopClosingBytesReader | 0x3eb60b558200>{
s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
i: 0,
},
ContentLength: 1087,
TransferEncoding: nil,
Close: false,
Uncompressed: false,
Trailer: nil,
Request: {
Method: "GET",
URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
Proto: "HTTP/1.1",
ProtoMajor: 1,
ProtoMinor: 1,
Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
Body: nil,
GetBody: nil,
ContentLength: 0,
TransferEncoding: nil,
Close: false,
Host: "rp.j8926720.hcpsvc.osadev.cloud",
Form: nil,
PostForm: nil,
MultipartForm: nil,
Trailer: nil,
RemoteAddr: "",
RequestURI: "",
TLS: nil,
Cancel: nil,
Response: nil,
Pattern: "",
ctx: <suppressed context>,
pat: nil,
matches: nil,
otherValues: nil,
},
TLS: {
Version: 772,
HandshakeComplete: true,
DidResume: false,
CipherSuite: 4865,
CurveID: 29,
NegotiatedProtocol: "h2",
NegotiatedProtocolIsMutual: true,
ServerName: "rp.j8926720.hcpsvc.osadev.cloud",
PeerCertificates: [...],
VerifiedChains: nil,
SignedCertificateTimestamps: nil,
OCSPResponse: nil,
TLSUnique: nil,
ECHAccepted: false,
HelloRetryRequest: false,
ekm: 0x57bc760,
testingOnlyPeerSignatureAlgorithm: 2052,
},
},
errMsg: "GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n \"status\": \"Failed\",\n \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n \"error\": {\n \"code\": \"InternalServerError\",\n \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n }\n}\n--------------------------------------------------------------------------------\n",
},
},
},
},
},
],
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
alert [hcp] HCPClusterOperatorUnavailable firedfull failure pattern: alert [hcp] HCPClusterOperatorUnavailable fired Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | alert | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s) | Show trend detailsSep 29: 0 · Sep 30: 2 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)alert fired 1 time(s) Firing 1: State: Fired (not resolved) Started: 2026-10-05T02:45:49Z Severity: Sev3 Labels: alertname="HCPClusterOperatorUnavailable", cluster="ci01-j0780544-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8bd601duipv6rqvbm3to5tnsv67dll-d0u0b4t7n2l9k0b", region="westus3", severity="warning" Description: 2 cluster operator(s) on hosted cluster ocm-arohcpci01-2t8bd601duipv6rqvbm3to5tnsv67dll-d0u0b4t7n2l9k0b (management cluster ci01-j0780544-mgmt-1) have been reporting Available=false for more than 30 minutes. The version and console operators are excluded from this alert; the affected cluster has worker nodes present. An unavailable operator means the component it manages is down, not merely degraded. Contributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: context deadline exceededfull failure pattern: failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: context deadline exceeded Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s) | e2e | 1 | 1.30%1 of 77 job runs affected | IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s) | Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1 | none | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Full failure examples (1)fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:198]: failed to create node pool version 4.20.32 for back-level cluster
Unexpected error:
<*fmt.wrapError | 0x1875a59d7800>:
failed waiting for nodepool="np-ver-4-20-32" for cluster "cluster-ver-4-20" in resourcegroup="rg-cluster-back-version-bmqkjhjjvzkv" to finish creating: context deadline exceeded
{
msg: "failed waiting for nodepool=\"np-ver-4-20-32\" for cluster \"cluster-ver-4-20\" in resourcegroup=\"rg-cluster-back-version-bmqkjhjjvzkv\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:198]: failed to create node pool version 4.20.32 for back-level cluster
Unexpected error:
<*fmt.wrapError | 0x1875a59d7800>:
failed waiting for nodepool="np-ver-4-20-32" for cluster "cluster-ver-4-20" in resourcegroup="rg-cluster-back-version-bmqkjhjjvzkv" to finish creating: context deadline exceeded
{
msg: "failed waiting for nodepool=\"np-ver-4-20-32\" for cluster \"cluster-ver-4-20\" in resourcegroup=\"rg-cluster-back-version-bmqkjhjjvzkv\" to finish creating: context deadline exceeded",
err: <context.deadlineExceededError>{},
}
occurredContributing tests (1)
Affected runs (1)
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||