Results deduplicated across retry runs (best result per test)
Run History
| Suite | Run # | Mode | Time | Pass | Fail | Skip | Status |
|---|---|---|---|---|---|---|---|
| mc | 1 | Initial run | 2026-04-24 23:53 | 4 | 0 | 0 | PASS |
| rclone | 1 | Initial run | 2026-04-25 00:21 | 1 | 4 | 0 | FAIL |
| zs3 | 1 | Initial run | 2026-04-25 00:41 | 9 | 6 | 2 | FAIL |
Suite Summary
| Suite | Pass | Fail | Skip | Running | Runs | Log |
|---|---|---|---|---|---|---|
| API | 123 | 9 | 1 | 3 | 1 | log |
| CLI | 35 | 10 | 2 | 1 | 1 | log |
| ZS3 | 36 | 15 | 3 | 0 | 1 | log |
| MC | 15 | 0 | 0 | 0 | 1 | log |
| RCLONE | 4 | 12 | 0 | 0 | 1 | log |
| TPCDS | not started | |||||
| TOTAL | 213 | 46 | 6 | |||
Subtest Detail
| # | Suite | Test | Status | Duration | Source | Output / Error |
|---|---|---|---|---|---|---|
| 1 | api | Test0BoxTranscoder | FAIL | 202.83s | [run 1] | wait.go:44: Wait condition has succeed api_client.go:2784: Funding wallet 306517a2de8b1d994d0951ba45e276cedc1d1dca32c0e9b731066791eaf8dedc with tokens from faucet (2/3)... api_client.go:1836: Get wallet balance... api_client.go:352: Provider https://test2.zus.network/sharder01. Response: {"error":"unexpected end of JSON input"} api_client.go:352: Provider https://test2.zus.network/sharder02. Response: {"error":"unexpected end of JSON input"} api_client.go:609: Transient confirmation error (retry 1/8): execution consensus is not reached wait.go:44: Wait condition has succeed api_client.go:2784: Funding wallet 306517a2de8b1d994d0951ba45e276cedc1d1dca32c0e9b731066791eaf8dedc with tokens from faucet (3/3)... api_client.go:1836: Get wallet balance... api_client.go:352: Provider https://test2.zus.network/sharder01. Response: {"error":"unexpected end of JSON input"} api_client.go:352: Provider https://test2.zus.network/sharder02. Response: {"error":"unexpected end of JSON input"} api_client.go:609: Transient confirmation error (retry 1/8): execution consensus is not reached wait.go:44: Wait condition has succeed api_client.go:1836: Get wallet balance... api_client.go:1012: Create alloc txn hash: 2613271259e6c957c66227d93006cf07d1d0aaa26652cf5bdd6ef89c1029659f, nonce used: 57 api_client.go:352: Provider https://test2.zus.network/sharder01. Response: {"error":"unexpected end of JSON input"} api_client.go:352: Provider https://test2.zus.network/sharder02. Response: {"error":"unexpected end of JSON input"} api_client.go:609: Transient confirmation error (retry 1/8): execution consensus is not reached wait.go:44: Wait condition has succeed 0box_transcoder_test.go:46: Created allocation 2613271259e6c957c66227d93006cf07d1d0aaa26652cf5bdd6ef89c1029659f for transcoder tests |
| 2 | api | Test0BoxTranscoder Upload AVI and trigger transcode metadata | FAIL | 0.01s | [run 1] | 0box_transcoder_test.go:127: Test case [Upload AVI and trigger transcode metadata] scheduled at [04-25-2026 01:00:48] system_test_framework.go:148: Test case [Upload AVI and trigger transcode metadata] start at [04-25-2026 01:00:48] sdk.go:268: fileMeta { /tmp/4164913861.avi 1024 0 sample_1777071648938280313.avi /sample_1777071648938280313.avi } assertions.go:363: Error Trace: /root/Code/system_test/internal/api/util/client/sdk.go:222 Error: Received unexpected error: 0box_transcoder_test.go:127: Test case [Upload AVI and trigger transcode metadata] exit at [04-25-2026 01:00:48] |
| 3 | api | Test0BoxTranscoder Non-video file graceful handling | FAIL | 0.00s | [run 1] | 0box_transcoder_test.go:189: Test case [Non-video file graceful handling] scheduled at [04-25-2026 01:00:48] system_test_framework.go:148: Test case [Non-video file graceful handling] start at [04-25-2026 01:00:48] sdk.go:268: fileMeta { /tmp/1905914105.mp3 512 0 audio_1777071648947487350.mp3 /audio_1777071648947487350.mp3 } assertions.go:363: Error Trace: /root/Code/system_test/internal/api/util/client/sdk.go:222 Error: Received unexpected error: 0box_transcoder_test.go:189: Test case [Non-video file graceful handling] exit at [04-25-2026 01:00:48] |
| 4 | api | Test0BoxTranscoder Full metadata create-update-get round-trip | FAIL | 0.02s | [run 1] | 0box_transcoder_test.go:266: Test case [Full metadata create-update-get round-trip] scheduled at [04-25-2026 01:00:48] system_test_framework.go:148: Test case [Full metadata create-update-get round-trip] start at [04-25-2026 01:00:48] sdk.go:268: fileMeta { /tmp/576669607.mp4 1024 0 roundtrip_1777071648954090272.mp4 /roundtrip_1777071648954090272.mp4 } assertions.go:363: Error Trace: /root/Code/system_test/internal/api/util/client/sdk.go:222 Error: Received unexpected error: 0box_transcoder_test.go:266: Test case [Full metadata create-update-get round-trip] exit at [04-25-2026 01:00:48] |
| 5 | api | TestMultiOperationRollback | FAIL | 76.42s | [run 1] | No error details |
| 6 | api | TestMultiOperationRollback Multi different operations rollback should work | FAIL | 12.23s | [run 1] | api_client.go:1836: Get wallet balance... api_client.go:1012: Create alloc txn hash: eb9b1cd6eac5cc7e285d47a49db1b0e48c53f2bc0edfd5cf4d07cd133ea829ea, nonce used: 37 api_client.go:352: Provider https://test2.zus.network/sharder01. Response: {"error":"unexpected end of JSON input"} api_client.go:352: Provider https://test2.zus.network/sharder02. Response: {"error":"unexpected end of JSON input"} api_client.go:609: Transient confirmation error (retry 1/8): execution consensus is not reached wait.go:44: Wait condition has succeed sdk.go:268: fileMeta { /tmp/3877919466 1024 0 3877919466 /3877919466 } sdk.go:268: fileMeta { /tmp/525241255 1024 0 525241255 /525241255 } sdk.go:268: fileMeta { /tmp/2387795705 1024 0 2387795705 /2387795705 } sdk.go:268: fileMeta { /tmp/4018820357 1024 0 4018820357 /4018820357 } sdk.go:268: fileMeta { /tmp/1562262092 1024 0 1562262092 /1562262092 } sdk.go:268: fileMeta { /tmp/112370037 1024 0 112370037 /112370037 } sdk.go:268: fileMeta { /tmp/4060064470 1024 0 4060064470 /4060064470 } sdk.go:268: fileMeta { /tmp/3494189911 1024 0 3494189911 /3494189911 } sdk.go:268: fileMeta { /tmp/1335197498 1024 0 1335197498 /1335197498 } sdk.go:268: fileMeta { /tmp/1136405271 1024 0 1136405271 /1136405271 } assertions.go:363: Error Trace: /root/Code/system_test/internal/api/util/client/sdk.go:222 Error: Received unexpected error: multiop_rollback_test.go:126: Test case [Multi different operations rollback should work] exit at [04-25-2026 01:09:20] |
| 7 | api | TestMultiOperation | FAIL | 785.14s | [run 1] | No error details |
| 8 | api | TestMultiOperation Multi update operations should work | FAIL | 92.38s | [run 1] | api_client.go:609: Transient confirmation error (retry 2/8): execution consensus is not reached api_client.go:352: Provider https://test2.zus.network/sharder01. Response: {"error":"unexpected end of JSON input"} api_client.go:352: Provider https://test2.zus.network/sharder02. Response: {"error":"unexpected end of JSON input"} api_client.go:609: Transient confirmation error (retry 3/8): execution consensus is not reached wait.go:44: Wait condition has succeed sdk.go:268: fileMeta { /tmp/2871372616 1024 0 2871372616 /2871372616 } sdk.go:268: fileMeta { /tmp/1110641135 1024 0 1110641135 /1110641135 } sdk.go:268: fileMeta { /tmp/3317812416 1024 0 3317812416 /3317812416 } sdk.go:268: fileMeta { /tmp/462008637 1024 0 462008637 /462008637 } sdk.go:268: fileMeta { /tmp/899095654 1024 0 899095654 /899095654 } sdk.go:268: fileMeta { /tmp/2444283672 1024 0 2444283672 /2444283672 } sdk.go:268: fileMeta { /tmp/931004541 1024 0 931004541 /931004541 } sdk.go:268: fileMeta { /tmp/4278765523 1024 0 4278765523 /4278765523 } sdk.go:268: fileMeta { /tmp/3230577537 1024 0 3230577537 /3230577537 } sdk.go:268: fileMeta { /tmp/2591212622 1024 0 2591212622 /2591212622 } multiop_test.go:366: Multi upload operations took 895.892818ms assertions.go:363: Error Trace: /root/Code/system_test/internal/api/util/client/sdk.go:222 Error: Received unexpected error: multiop_test.go:52: Test case [Multi update operations should work] exit at [04-25-2026 01:11:24] |
| 9 | api | TestMultiOperation Multi different operations should work | FAIL | 87.83s | [run 1] | api_client.go:352: Provider https://test2.zus.network/sharder02. Response: {"error":"unexpected end of JSON input"} api_client.go:609: Transient confirmation error (retry 1/8): execution consensus is not reached api_client.go:352: Provider https://test2.zus.network/sharder01. Response: {"error":"unexpected end of JSON input"} api_client.go:352: Provider https://test2.zus.network/sharder02. Response: {"error":"unexpected end of JSON input"} api_client.go:609: Transient confirmation error (retry 2/8): execution consensus is not reached wait.go:44: Wait condition has succeed sdk.go:268: fileMeta { /tmp/3108158219 1024 0 3108158219 /3108158219 } sdk.go:268: fileMeta { /tmp/2823683829 1024 0 2823683829 /2823683829 } sdk.go:268: fileMeta { /tmp/3399951385 1024 0 3399951385 /3399951385 } sdk.go:268: fileMeta { /tmp/348244930 1024 0 348244930 /348244930 } sdk.go:268: fileMeta { /tmp/2375958115 1024 0 2375958115 /2375958115 } sdk.go:268: fileMeta { /tmp/1609885146 1024 0 1609885146 /1609885146 } sdk.go:268: fileMeta { /tmp/3626588303 1024 0 3626588303 /3626588303 } sdk.go:268: fileMeta { /tmp/3536465359 1024 0 3536465359 /3536465359 } sdk.go:268: fileMeta { /tmp/4189378544 1024 0 4189378544 /4189378544 } sdk.go:268: fileMeta { /tmp/1236908097 1024 0 1236908097 /1236908097 } assertions.go:363: Error Trace: /root/Code/system_test/internal/api/util/client/sdk.go:222 Error: Received unexpected error: multiop_test.go:60: Test case [Multi different operations should work] exit at [04-25-2026 01:14:21] |
| 10 | cli | TestExpiredAllocation | FAIL | 649.61s | [run 1] | zwalletcli_register_wallet_test.go:161: Executing faucet... zwalletcli_storage_update_config_test.go:301: Updating storage config... system_test_framework.go:70: Test setup [register wallet and get blobbers] scheduled at [04-25-2026 00:57:33] system_test_framework.go:80: Test setup [register wallet and get blobbers] start at [04-25-2026 00:57:33] system_test_framework.go:93: Test setup [register wallet and get blobbers] exit at [04-25-2026 00:57:33] |
| 11 | cli | TestExpiredAllocation Download File using Expired Allocation Should Fail | FAIL | 94.43s | [run 1] | utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 01:04:06.306433 http.go:770: NewConnectionRequest: baseUrl: http://test1.zus.network/blobber01/, allocationID: 64e46eac01335a600c46e3b98eb0d24dc19d3c6f81309533bb51bf7c630e2881, allocationTx: 64e46eac01335a600c46e3b98eb0d24dc19d3c6f81309533bb51bf7c630e2881, sig: utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 01:04:06.306463 http.go:243: setClientInfoWithSign: wallet details: {ClientID:669059e73393c004e89ab811740eb93115065216fcb6b6cb671372f17775f8a0 ClientKey:a4b2744a58824ec879c7ffb3cb66593d16f9a8aeabd94f67cb1d0150a7b6841ad754992caf3dde877f74669b63da617c86c11c795a11e8f8a8d8bd635a6cc51b PeerPublicKey: Keys:[{PublicKey:a4b2744a58824ec879c7ffb3cb66593d16f9a8aeabd94f67cb1d0150a7b6841ad754992caf3dde877f74669b63da617c86c11c795a11e8f8a8d8bd635a6cc51b PrivateKey:6b28affb2c6c511238e32ad86e19b6e7535fed52122c777c1907eaf4a10e5a02}] Mnemonic:clutch find stomach country much barrel delay fashion middle beyond lemon come knife gallery heavy humor side pistol frame equal pond human wagon camp Version:1.0 DateCreated:2023-11-26T01:23:58Z Nonce:1 IsSplit:false} utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 01:04:06.306466 http.go:243: setClientInfoWithSign: wallet details: {ClientID:669059e73393c004e89ab811740eb93115065216fcb6b6cb671372f17775f8a0 ClientKey:a4b2744a58824ec879c7ffb3cb66593d16f9a8aeabd94f67cb1d0150a7b6841ad754992caf3dde877f74669b63da617c86c11c795a11e8f8a8d8bd635a6cc51b PeerPublicKey: Keys:[{PublicKey:a4b2744a58824ec879c7ffb3cb66593d16f9a8aeabd94f67cb1d0150a7b6841ad754992caf3dde877f74669b63da617c86c11c795a11e8f8a8d8bd635a6cc51b PrivateKey:6b28affb2c6c511238e32ad86e19b6e7535fed52122c777c1907eaf4a10e5a02}] Mnemonic:clutch find stomach country much barrel delay fashion middle beyond lemon come knife gallery heavy humor side pistol frame equal pond human wagon camp Version:1.0 DateCreated:2023-11-26T01:23:58Z Nonce:1 IsSplit:false} utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 01:04:06.306429 http.go:770: NewConnectionRequest: baseUrl: http://test1.zus.network/blobber03/, allocationID: 64e46eac01335a600c46e3b98eb0d24dc19d3c6f81309533bb51bf7c630e2881, allocationTx: 64e46eac01335a600c46e3b98eb0d24dc19d3c6f81309533bb51bf7c630e2881, sig: utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 01:04:06.306557 http.go:243: setClientInfoWithSign: wallet details: {ClientID:669059e73393c004e89ab811740eb93115065216fcb6b6cb671372f17775f8a0 ClientKey:a4b2744a58824ec879c7ffb3cb66593d16f9a8aeabd94f67cb1d0150a7b6841ad754992caf3dde877f74669b63da617c86c11c795a11e8f8a8d8bd635a6cc51b PeerPublicKey: Keys:[{PublicKey:a4b2744a58824ec879c7ffb3cb66593d16f9a8aeabd94f67cb1d0150a7b6841ad754992caf3dde877f74669b63da617c86c11c795a11e8f8a8d8bd635a6cc51b PrivateKey:6b28affb2c6c511238e32ad86e19b6e7535fed52122c777c1907eaf4a10e5a02}] Mnemonic:clutch find stomach country much barrel delay fashion middle beyond lemon come knife gallery heavy humor side pistol frame equal pond human wagon camp Version:1.0 DateCreated:2023-11-26T01:23:58Z Nonce:1 IsSplit:false} utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:04:06.307384 multi_operation_worker.go:155: http://test1.zus.network/blobber03/Response: {"code":"invalid_parameters","error":"invalid_parameters: Invalid allocation id passed.verify_allocation: use of expired allocation"} utils.go:140: utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:04:06.307402 allocation.go:1145: response_error: {"code":"invalid_parameters","error":"invalid_parameters: Invalid allocation id passed.verify_allocation: use of expired allocation"} utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:04:06.307386 multi_operation_worker.go:155: http://test1.zus.network/blobber02/Response: {"code":"invalid_parameters","error":"invalid_parameters: Invalid allocation id passed.verify_allocation: use of expired allocation"} utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:04:06.307422 allocation.go:1145: response_error: {"code":"invalid_parameters","error":"invalid_parameters: Invalid allocation id passed.verify_allocation: use of expired allocation"} utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:04:06.307391 multi_operation_worker.go:155: http://test1.zus.network/blobber01/Response: {"code":"invalid_parameters","error":"invalid_parameters: Invalid allocation id passed.verify_allocation: use of expired allocation"} utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:04:06.307431 allocation.go:1145: response_error: {"code":"invalid_parameters","error":"invalid_parameters: Invalid allocation id passed.verify_allocation: use of expired allocation"} utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:04:06.307453 allocation.go:1153: Multioperation: create connection failed. Required consensus not met{consensusThresh 11 3 <nil>} {operationMask 11 0 <nil>} {connectionErrors 1 0 [response_error: {"code":"invalid_parameters","error":"invalid_parameters: Invalid allocation id passed.verify_allocation: use of expired allocation"} response_error: {"code":"invalid_parameters","error":"invalid_parameters: Invalid allocation id passed.verify_allocation: use of expired allocation"} response_error: {"code":"invalid_parameters","error":"invalid_parameters: Invalid allocation id passed.verify_allocation: use of expired allocation"}]} utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:04:06.307462 allocation.go:848: Error in multi upload consensus_not_met: Multioperation: create connection failed. Required consensus 3 got 0. Major error: response_error: {"code":"invalid_parameters","error":"invalid_parameters: Invalid allocation id passed.verify_allocation: use of expired allocation"} utils.go:140: Upload failed. consensus_not_met: Multioperation: create connection failed. Required consensus 3 got 0. Major error: response_error: {"code":"invalid_parameters","error":"invalid_parameters: Invalid allocation id passed.verify_allocation: use of expired allocation"} assertions.go:363: Error Trace: /root/Code/system_test/tests/cli_tests/zboxcli_file_upload_test.go:1050 Error: Expected nil, but got: &exec.ExitError{ProcessState:(*os.ProcessState)(0xc000c00090), Stderr:[]uint8(nil)} Messages: Upload file failed due to error %!(EXTRA *exec.ExitError=exit status 1, string=Upload failed. consensus_not_met: Multioperation: create connection failed. Required consensus 3 got 0. Major error: response_error: {"code":"invalid_parameters","error":"invalid_parameters: Invalid allocation id passed.verify_allocation: use of expired allocation"}) 0_expired_allocation_test.go:97: Test case [Download File using Expired Allocation Should Fail] exit at [04-25-2026 01:04:06] |
| 12 | cli | TestFreeReads | FAIL | 161.09s | [run 1] | zboxcli_stake_unstake_token_test.go:270: Requesting blobber list... zwalletcli_register_wallet_test.go:116: Getting wallet... 0_free_read_test.go:50: Skipping blobber ba7f2443899efa627167510860644924c135ac8608c94a558363440e2b701ba5 - delegate_wallet 6d6d29d4b6c4c3fd2f5c4aa8d3551050e030b64e816e7dfe276902b427907eed != our wallet 0_free_read_test.go:50: Skipping blobber efa30806488d1022596bf4bdf676ae562166274e647afebde24b7c6a17c003c1 - delegate_wallet 6d6d29d4b6c4c3fd2f5c4aa8d3551050e030b64e816e7dfe276902b427907eed != our wallet 0_free_read_test.go:50: Skipping blobber 53afab3d5b5f902cedf9d5cb8e037dcb37f524a34d3ca39dcf3b4ea695ace01c - delegate_wallet 6d6d29d4b6c4c3fd2f5c4aa8d3551050e030b64e816e7dfe276902b427907eed != our wallet 0_free_read_test.go:50: Skipping blobber 1dbac506cb931a31fe896d10b64c835b30bea931c3b63c943e2b5a866c2ec875 - delegate_wallet 6d6d29d4b6c4c3fd2f5c4aa8d3551050e030b64e816e7dfe276902b427907eed != our wallet 0_free_read_test.go:50: Skipping blobber 31ce6ecd6466787ba201a1639654f2389bd4ac4297632d03af2a7993ea4ebb4b - delegate_wallet 6d6d29d4b6c4c3fd2f5c4aa8d3551050e030b64e816e7dfe276902b427907eed != our wallet 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... system_test_framework.go:93: Test setup [Create wallet, execute faucet, get blobber details] exit at [04-25-2026 01:09:43] |
| 13 | cli | TestFreeReads Free reads should work | FAIL | 97.72s | [run 1] | 0_free_read_test.go:74: Test case [Free reads should work] scheduled at [04-25-2026 01:09:43] |
| 14 | cli | TestFreeReads Free read by authticket should Work | FAIL | 124.69s | [run 1] | 0_free_read_test.go:115: Test case [Free read by authticket should Work] scheduled at [04-25-2026 01:09:43] system_test_framework.go:148: Test case [Free reads should work] start at [04-25-2026 01:09:43] system_test_framework.go:148: Test case [Free read by authticket should Work] start at [04-25-2026 01:09:43] zwalletcli_register_wallet_test.go:161: Executing faucet... |
| 15 | cli | TestFreeReads Free read by authticket should Work/Share File from Another Wallet for free read | FAIL | 101.49s | [run 1] | utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 01:11:48.547490 sdk.go:338: ******* Storage SDK Version: v1.17.0-lfb-1-83-g1753c1fe ******* utils.go:140: auth_ticket_decode_error: Error decoding the auth ticket.illegal base64 data at input byte 0 assertions.go:363: Error Trace: /root/Code/system_test/tests/cli_tests/0_free_read_test.go:167 Error: Expected nil, but got: &exec.ExitError{ProcessState:(*os.ProcessState)(0xc000c001c8), Stderr:[]uint8(nil)} Messages: auth_ticket_decode_error: Error decoding the auth ticket.illegal base64 data at input byte 0 0_free_read_test.go:115: Test case [Free read by authticket should Work] exit at [04-25-2026 01:11:48] zwalletcli_register_wallet_test.go:116: Getting wallet... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... 0_free_read_test.go:180: Updating blobber info using wallet wallets/blobber_owner_cli... |
| 16 | cli | TestOwnerUpdate | FAIL | 42.18s | [run 1] | system_test_framework.go:70: Test setup [Create new owner wallet] scheduled at [04-25-2026 01:13:02] system_test_framework.go:80: Test setup [Create new owner wallet] start at [04-25-2026 01:13:02] zwalletcli_register_wallet_test.go:161: Executing faucet... zwalletcli_register_wallet_test.go:116: Getting wallet... system_test_framework.go:93: Test setup [Create new owner wallet] exit at [04-25-2026 01:13:07] |
| 17 | cli | TestOwnerUpdate should allow update of owner: MinerSC | FAIL | 6.65s | [run 1] | 0_owner_update_config_test.go:94: Test case [should allow update of owner: MinerSC] scheduled at [04-25-2026 01:13:38] system_test_framework.go:148: Test case [should allow update of owner: MinerSC] start at [04-25-2026 01:13:38] zwalletcli_register_wallet_test.go:161: Executing faucet... zwalletcli_miner_update_config_test.go:647: Retrieving miner config... 0_owner_update_config_test.go:114: MinerSC owner on chain (e984e37602ecd8ac5201638b45bc63d73bd2416bf8b91d9deb514bd6819b16fc) does not match expected owner (f63ae119774f4b91a43a8ad6650199184d6420a618a71d18a660bff6326ffc2e) in miner_sc_owner_wallet.json — run deploy_local.sh chain to fix 0_owner_update_config_test.go:94: Test case [should allow update of owner: MinerSC] exit at [04-25-2026 01:13:44] |
| 18 | cli | TestResumeDownload | FAIL | 0.00s | [run 1] | No error details |
| 19 | cli | TestResumeDownload Resume download should work | FAIL | 394.24s | [run 1] | utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:32:06.573995 chunked_upload.go:718: error during sendUploadRequestbad request: <html> utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:32:06.574153 chunked_upload.go:718: error during sendUploadRequestbad request: <html> utils.go:140: 0 / 3145728000 0.00% 10s utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:32:06.574160 chunked_upload.go:718: error during sendUploadRequestbad request: <html> utils.go:140: Error in file operation: upload_failed: Upload failed. bad request: <html> utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:32:06.574216 chunked_upload.go:718: error during sendUploadRequestbad request: <html> utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:32:06.574250 chunked_upload.go:718: error during sendUploadRequestbad request: <html> utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:32:06.574301 chunked_upload.go:718: error during sendUploadRequestbad request: <html> utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:32:06.574351 chunked_upload.go:718: error during sendUploadRequestbad request: <html> utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:32:06.574936 upload_worker.go:49: UploadOperation Failed{name 15 0 IAdICuJ3zn_test.txt <nil>} {error 26 0 upload_failed: Upload failed. bad request: <html> utils.go:140: </html>} utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:32:06.575302 multi_operation_worker.go:204: upload_failed: Upload failed. bad request: <html> utils.go:140: </html> utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 01:32:06.575471 allocation.go:848: Error in multi upload upload_failed: Upload failed. bad request: <html> utils.go:140: Upload failed. upload_failed: Upload failed. bad request: <html> assertions.go:363: Error Trace: /root/Code/system_test/tests/cli_tests/zboxcli_file_upload_test.go:1050 Error: Expected nil, but got: &exec.ExitError{ProcessState:(*os.ProcessState)(0xc000782000), Stderr:[]uint8(nil)} Messages: Upload file failed due to error %!(EXTRA *exec.ExitError=exit status 1, string=0 / 3145728000 0.00% 26214400 / 3145728000 0.83% 01m58s 39321600 / 3145728000 1.25% 01m33s 65536000 / 3145728000 2.08% 01m04s 65536000 / 3145728000 2.08% 01m03s 104857600 / 3145728000 3.33% 01m25s 117964800 / 3145728000 3.75% 01m21s 157286400 / 3145728000 5.00% 01m02s 170393600 / 3145728000 5.42% 01m08s 170393600 / 3145728000 5.42% 01m07s 183500800 / 3145728000 5.83% 01m17s 196608000 / 3145728000 6.25% 01m13s 196608000 / 3145728000 6.25% 01m12s 222822400 / 3145728000 7.08% 01m18s 249036800 / 3145728000 7.92% 01m21s 262144000 / 3145728000 8.33% 01m17s 275251200 / 3145728000 8.75% 01m17s 314572800 / 3145728000 10.00% 01m10s 314572800 / 3145728000 10.00% 01m09s 327680000 / 3145728000 10.42% 01m16s 327680000 / 3145728000 10.42% 01m15s 367001600 / 3145728000 11.67% 01m12s 380108800 / 3145728000 12.08% 01m09s 380108800 / 3145728000 12.08% 01m08s 419430400 / 3145728000 13.33% 01m05s 432537600 / 3145728000 13.75% 01m07s 445644800 / 3145728000 14.17% 01m07s 458752000 / 3145728000 14.58% 01m07s 458752000 / 3145728000 14.58% 01m06s 471859200 / 3145728000 15.00% 01m06s 484966400 / 3145728000 15.42% 01m09s 550502400 / 3145728000 17.50% 01m02s 550502400 / 3145728000 17.50% 01m01s 589824000 / 3145728000 18.75% 01m01s 616038400 / 3145728000 19.58% 00m58s 616038400 / 3145728000 19.58% 00m57s 655360000 / 3145728000 20.83% 00m54s 668467200 / 3145728000 21.25% 00m56s 668467200 / 3145728000 21.25% 00m55s 720896000 / 3145728000 22.92% 00m55s 720896000 / 3145728000 22.92% 00m54s 734003200 / 3145728000 23.33% 00m57s 760217600 / 3145728000 24.17% 00m57s 773324800 / 3145728000 24.58% 00m56s 812646400 / 3145728000 25.83% 00m55s 825753600 / 3145728000 26.25% 00m55s 838860800 / 3145728000 26.67% 00m57s 838860800 / 3145728000 26.67% 00m56s 891289600 / 3145728000 28.33% 00m56s 891289600 / 3145728000 28.33% 00m55s 904396800 / 3145728000 28.75% 00m56s 904396800 / 3145728000 28.75% 00m55s 943718400 / 3145728000 30.00% 00m52s 956825600 / 3145728000 30.42% 00m52s 956825600 / 3145728000 30.42% 00m51s 969932800 / 3145728000 30.83% 00m54s 996147200 / 3145728000 31.67% 00m53s 1048576000 / 3145728000 33.33% 00m50s 1048576000 / 3145728000 33.33% 00m49s 1048576000 / 3145728000 33.33% 00m48s 1101004800 / 3145728000 35.00% 00m51s 1101004800 / 3145728000 35.00% 00m50s 1114112000 / 3145728000 35.42% 00m50s 1153433600 / 3145728000 36.67% 00m49s 1166540800 / 3145728000 37.08% 00m49s 1179648000 / 3145728000 37.50% 00m49s 1179648000 / 3145728000 37.50% 00m48s 1205862400 / 3145728000 38.33% 00m48s 1271398400 / 3145728000 40.42% 00m44s 1336934400 / 3145728000 42.50% 00m41s 1402470400 / 3145728000 44.58% 00m38s 1454899200 / 3145728000 46.25% 00m35s 1468006400 / 3145728000 46.67% 00m35s 1494220800 / 3145728000 47.50% 00m34s 1507328000 / 3145728000 47.92% 00m34s 1507328000 / 3145728000 47.92% 00m33s 1533542400 / 3145728000 48.75% 00m33s 1546649600 / 3145728000 49.17% 00m33s 1572864000 / 3145728000 50.00% 00m33s 1572864000 / 3145728000 50.00% 00m32s 1572864000 / 3145728000 50.00% 00m31s 1585971200 / 3145728000 50.42% 00m34s 1625292800 / 3145728000 51.67% 00m33s 1625292800 / 3145728000 51.67% 00m32s 1677721600 / 3145728000 53.33% 00m32s 1677721600 / 3145728000 53.33% 00m31s 1690828800 / 3145728000 53.75% 00m32s 1690828800 / 3145728000 53.75% 00m31s 1703936000 / 3145728000 54.17% 00m31s 1730150400 / 3145728000 55.00% 00m31s 1730150400 / 3145728000 55.00% 00m30s 1743257600 / 3145728000 55.42% 00m30s 1756364800 / 3145728000 55.83% 00m30s 1756364800 / 3145728000 55.83% 00m29s 1808793600 / 3145728000 57.50% 00m29s 1821900800 / 3145728000 57.92% 00m29s 1821900800 / 3145728000 57.92% 00m28s 1835008000 / 3145728000 58.33% 00m28s 1874329600 / 3145728000 59.58% 00m27s 1887436800 / 3145728000 60.00% 00m27s 1900544000 / 3145728000 60.42% 00m27s 1913651200 / 3145728000 60.83% 00m27s 1913651200 / 3145728000 60.83% 00m26s 1939865600 / 3145728000 61.67% 00m26s 1952972800 / 3145728000 62.08% 00m26s 1952972800 / 3145728000 62.08% 00m25s 1966080000 / 3145728000 62.50% 00m27s 1979187200 / 3145728000 62.92% 00m26s 2018508800 / 3145728000 64.17% 00m25s 2057830400 / 3145728000 65.42% 00m23s 2070937600 / 3145728000 65.83% 00m23s 2070937600 / 3145728000 65.83% 00m22s 2110259200 / 3145728000 67.08% 00m22s 2123366400 / 3145728000 67.50% 00m23s 2123366400 / 3145728000 67.50% 00m22s 2123366400 / 3145728000 67.50% 00m21s 2162688000 / 3145728000 68.75% 00m22s 2202009600 / 3145728000 70.00% 00m21s 2215116800 / 3145728000 70.42% 00m21s 2215116800 / 3145728000 70.42% 00m20s 2254438400 / 3145728000 71.67% 00m20s 2267545600 / 3145728000 72.08% 00m20s 2267545600 / 3145728000 72.08% 00m19s 2280652800 / 3145728000 72.50% 00m19s 2293760000 / 3145728000 72.92% 00m19s 2293760000 / 3145728000 72.92% 00m18s 2346188800 / 3145728000 74.58% 00m18s 2346188800 / 3145728000 74.58% 00m17s 2346188800 / 3145728000 74.58% 00m16s 2346188800 / 3145728000 74.58% 00m15s 2346188800 / 3145728000 74.58% 00m14s 2346188800 / 3145728000 74.58% 00m13s 2346188800 / 3145728000 74.58% 00m12s 2346188800 / 3145728000 74.58% 00m11s 2346188800 / 3145728000 74.58% 00m10s 2346188800 / 3145728000 74.58% 1m3s zboxcli_file_download_resume_test.go:25: Test case [Resume download should work] exit at [04-25-2026 01:32:06] |
| 20 | zs3 | TestZs3serverCrossProtocolWrite | FAIL | 20.72s | [run 1] | No error details |
| 21 | zs3 | TestZs3serverCrossProtocolWrite S3 PUT → NFS read | FAIL | 10.63s | [run 1] | 12_cross_protocol_write_test.go:63: Test case [S3 PUT → NFS read] scheduled at [04-25-2026 01:56:12] system_test_framework.go:148: Test case [S3 PUT → NFS read] start at [04-25-2026 01:56:12] 12_cross_protocol_write_test.go:86: NFS did not see S3-written key s3-to-nfs-1777074972937998671.bin within 10s 12_cross_protocol_write_test.go:63: Test case [S3 PUT → NFS read] exit at [04-25-2026 01:56:23] |
| 22 | zs3 | TestZs3serverCrossProtocolWrite NFS write → S3 GET | FAIL | 10.03s | [run 1] | 12_cross_protocol_write_test.go:97: Test case [NFS write → S3 GET] scheduled at [04-25-2026 01:56:23] system_test_framework.go:148: Test case [NFS write → S3 GET] start at [04-25-2026 01:56:23] 12_cross_protocol_write_test.go:122: S3 did not see NFS-written key nfs-to-s3-1777074983570108567.bin within 10s 12_cross_protocol_write_test.go:97: Test case [NFS write → S3 GET] exit at [04-25-2026 01:56:33] |
| 23 | zs3 | TestZs3serverWritePressure | FAIL | 1.14s | [run 1] | No error details |
| 24 | zs3 | TestZs3serverWritePressure concurrent S3+NFS same-key pressure | FAIL | 1.11s | [run 1] | 13_write_pressure_test.go:77: Test case [concurrent S3+NFS same-key pressure] scheduled at [04-25-2026 01:56:33] system_test_framework.go:148: Test case [concurrent S3+NFS same-key pressure] start at [04-25-2026 01:56:33] 13_write_pressure_test.go:157: ops: 103/200 complete, errors=0, writers s3=4 nfs=4 13_write_pressure_test.go:190: final NFS read hotkey_006.bin: open /mnt/zus_nfs/zs3-write-pressure/hotkey_006.bin: no such file or directory 13_write_pressure_test.go:77: Test case [concurrent S3+NFS same-key pressure] exit at [04-25-2026 01:56:34] |
| 25 | zs3 | TestZs3serverListCoverage | FAIL | 610.51s | [run 1] | No error details |
| 26 | zs3 | TestZs3serverListCoverage pagination (1500 objects) | FAIL | 600.00s | [run 1] | 14_list_coverage_test.go:51: Test case [pagination (1500 objects)] scheduled at [04-25-2026 01:56:34] system_test_framework.go:148: Test case [pagination (1500 objects)] start at [04-25-2026 01:56:34] 14_list_coverage_test.go:51: Test case [pagination (1500 objects)] timed out after [10m0s] 14_list_coverage_test.go:51: Test case [pagination (1500 objects)] exit at [04-25-2026 02:06:34] |
| 27 | zs3 | TestZs3serverListCoverage prefix filter | FAIL | 4.58s | [run 1] | 14_list_coverage_test.go:101: Test case [prefix filter] scheduled at [04-25-2026 02:06:34] system_test_framework.go:148: Test case [prefix filter] start at [04-25-2026 02:06:34] 14_list_coverage_test.go:137: prefix (ambiguous) expected ≥4, got 0 14_list_coverage_test.go:101: Test case [prefix filter] exit at [04-25-2026 02:06:39] |
| 28 | zs3 | TestZs3serverPorcupineCopyMoveRename | FAIL | 186.78s | [run 1] | No error details |
| 29 | zs3 | TestZs3serverPorcupineCopyMoveRename s3/copy | FAIL | 61.97s | [run 1] | 15_porcupine_copy_move_rename_test.go:76: Test case [s3/copy] scheduled at [04-25-2026 02:06:45] system_test_framework.go:148: Test case [s3/copy] start at [04-25-2026 02:06:45] 15_porcupine_copy_move_rename_test.go:416: op=copy collected 400 ops in 61.962s (errors=30) throughput=6.5 ops/s 15_porcupine_copy_move_rename_test.go:424: RESULT op=copy: NON-LINEARIZABLE 15_porcupine_copy_move_rename_test.go:76: Test case [s3/copy] exit at [04-25-2026 02:07:47] |
| 30 | zs3 | TestZs3serverPorcupineCopyMoveRename s3/move | FAIL | 64.76s | [run 1] | 15_porcupine_copy_move_rename_test.go:82: Test case [s3/move] scheduled at [04-25-2026 02:07:47] system_test_framework.go:148: Test case [s3/move] start at [04-25-2026 02:07:47] 15_porcupine_copy_move_rename_test.go:416: op=move collected 400 ops in 64.746s (errors=25) throughput=6.2 ops/s 15_porcupine_copy_move_rename_test.go:424: RESULT op=move: NON-LINEARIZABLE 15_porcupine_copy_move_rename_test.go:82: Test case [s3/move] exit at [04-25-2026 02:08:52] |
| 31 | zs3 | TestZs3serverPorcupineCopyMoveRename s3/rename | FAIL | 60.01s | [run 1] | 15_porcupine_copy_move_rename_test.go:88: Test case [s3/rename] scheduled at [04-25-2026 02:08:52] system_test_framework.go:148: Test case [s3/rename] start at [04-25-2026 02:08:52] 15_porcupine_copy_move_rename_test.go:93: rename backend: logical (CopyObject+DeleteObject) — no native S3 RENAME on zs3server 15_porcupine_copy_move_rename_test.go:416: op=rename collected 400 ops in 59.999s (errors=16) throughput=6.7 ops/s 15_porcupine_copy_move_rename_test.go:424: RESULT op=rename: NON-LINEARIZABLE 15_porcupine_copy_move_rename_test.go:88: Test case [s3/rename] exit at [04-25-2026 02:09:52] 15_porcupine_copy_move_rename_test.go:101: ZS3_NFS_MOUNT unset, skipping fs/* subtests |
| 32 | zs3 | TestZs3serverDirectZusNFSVisibility | FAIL | 0.20s | [run 1] | No error details |
| 33 | zs3 | TestZs3serverDirectZusNFSVisibility direct-upload via rclone-zus → NFS readdir surfaces | FAIL | 0.20s | [run 1] | 16_direct_zus_nfs_visibility_test.go:90: Test case [direct-upload via rclone-zus → NFS readdir surfaces] scheduled at [04-25-2026 02:09:52] system_test_framework.go:148: Test case [direct-upload via rclone-zus → NFS readdir surfaces] start at [04-25-2026 02:09:52] 16_direct_zus_nfs_visibility_test.go:102: rclone-zus upload direct-1777075792030481552-a.bin: exit status 1: 2026/04/25 02:09:52 CRITICAL: Failed to create file system for destination "automation1k:zs3-direct-nfs/": allocation_fetch_error: Error fetching the allocation.internal_error: can't get allocation: error retrieving allocation: c7da617ff56df930beb58ba384d79de4e87a4688e029b12c3908e60b58981761, error: record not found 16_direct_zus_nfs_visibility_test.go:90: Test case [direct-upload via rclone-zus → NFS readdir surfaces] exit at [04-25-2026 02:09:52] |
| 34 | zs3 | TestZs3serverDualAccess | FAIL | 18.81s | [run 1] | No error details |
| 35 | rclone | TestRcloneZusBasicOperations | FAIL | 459.47s | [run 1] | No error details |
| 36 | rclone | TestRcloneZusBasicOperations Upload and download a file | FAIL | 172.45s | [run 1] | 1_basic_operations_test.go:148: Test case [Upload and download a file] scheduled at [04-25-2026 01:59:32] system_test_framework.go:148: Test case [Upload and download a file] start at [04-25-2026 01:59:32] utils.go:117: Command failed on attempt [1/3] due to error [exit status 1]. Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/1 sharders -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=716d1d5665f79b5171d35634f93c60c62a48594d69c5e111047d5446a9a0daff: [400] {"error":"unexpected end of JSON input"}] utils.go:117: Command failed on attempt [2/3] due to error [exit status 1]. Output: [failed to get fees table: request failed, url: https://test2.zus.network/miner02/v1/fees_table, err: Get "https://test2.zus.network/miner02/v1/fees_table": dial tcp 198.18.0.72:7072: i/o timeout,request failed, url: https://test2.zus.network/miner03/v1/fees_table, err: Get "https://test2.zus.network/miner03/v1/fees_table": dial tcp 198.18.0.73:7073: i/o timeout,request failed, url: https://test2.zus.network/miner01/v1/fees_table, err: Get "https://test2.zus.network/miner01/v1/fees_table": dial tcp 198.18.0.71:7071: i/o timeout] utils.go:133: Command failed on final attempt [3/3] due to error [exit status 1]. Command String: [] Output: [failed to get fees table: request failed, url: https://test2.zus.network/miner02/v1/fees_table, err: Get "https://test2.zus.network/miner02/v1/fees_table": dial tcp 198.18.0.72:7072: connect: no route to host,request failed, url: https://test2.zus.network/miner04/v1/fees_table, err: Get "https://test2.zus.network/miner04/v1/fees_table": dial tcp 198.18.0.74:7074: connect: no route to host,request failed, url: https://test2.zus.network/miner01/v1/fees_table, err: Get "https://test2.zus.network/miner01/v1/fees_table": dial tcp 198.18.0.71:7071: connect: no route to host] utils.go:136: The verbose output for the command is: utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:02:21.630479 wallet_base.go:192: ******* Wallet SDK Version:v1.17.0-lfb-1-64-g86186876 ******* (SetLogFile) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:02:21.630632 sdk.go:110: ******* Storage SDK Version: v1.17.0-lfb-1-64-g86186876 ******* utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:02:24.631538 init_node.go:166: Node offline during initialization{url 15 0 https://test2.zus.network/miner03 <nil>} utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:02:24.631546 init_node.go:166: Node offline during initialization{url 15 0 https://test2.zus.network/miner01 <nil>} utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:02:24.631538 init_node.go:166: Node offline during initialization{url 15 0 https://test2.zus.network/miner04 <nil>} utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:02:24.631656 init_node.go:166: Node offline during initialization{url 15 0 https://test2.zus.network/miner02 <nil>} utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:02:24.632371 init_node.go:181: Not enough online miners found, supplementing with random miners{online 11 0 <nil>} {required 11 4 <nil>} utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 02:02:24.683897 entity.go:591: failed to estimate txn fee{error 26 0 failed to get fees table: request failed, url: https://test2.zus.network/miner02/v1/fees_table, err: Get "https://test2.zus.network/miner02/v1/fees_table": dial tcp 198.18.0.72:7072: connect: no route to host,request failed, url: https://test2.zus.network/miner01/v1/fees_table, err: Get "https://test2.zus.network/miner01/v1/fees_table": dial tcp 198.18.0.71:7071: connect: no route to host,request failed, url: https://test2.zus.network/miner04/v1/fees_table, err: Get "https://test2.zus.network/miner04/v1/fees_table": dial tcp 198.18.0.74:7074: connect: no route to host} {txn 23 0 0xc0001521c0} utils.go:140: failed to get fees table: request failed, url: https://test2.zus.network/miner02/v1/fees_table, err: Get "https://test2.zus.network/miner02/v1/fees_table": dial tcp 198.18.0.72:7072: connect: no route to host,request failed, url: https://test2.zus.network/miner01/v1/fees_table, err: Get "https://test2.zus.network/miner01/v1/fees_table": dial tcp 198.18.0.71:7071: connect: no route to host,request failed, url: https://test2.zus.network/miner04/v1/fees_table, err: Get "https://test2.zus.network/miner04/v1/fees_table": dial tcp 198.18.0.74:7074: connect: no route to host assertions.go:363: Error Trace: /root/Code/system_test/tests/cli_tests/rclone_zus_tests/1_basic_operations_test.go:83 Error: Expected nil, but got: &exec.ExitError{ProcessState:(*os.ProcessState)(0xc0000104e0), Stderr:[]uint8(nil)} Messages: faucet failed: failed to get fees table: request failed, url: https://test2.zus.network/miner02/v1/fees_table, err: Get "https://test2.zus.network/miner02/v1/fees_table": dial tcp 198.18.0.72:7072: connect: no route to host,request failed, url: https://test2.zus.network/miner04/v1/fees_table, err: Get "https://test2.zus.network/miner04/v1/fees_table": dial tcp 198.18.0.74:7074: connect: no route to host,request failed, url: https://test2.zus.network/miner01/v1/fees_table, err: Get "https://test2.zus.network/miner01/v1/fees_table": dial tcp 198.18.0.71:7071: connect: no route to host 1_basic_operations_test.go:148: Test case [Upload and download a file] exit at [04-25-2026 02:02:24] |
| 37 | rclone | TestRcloneZusBasicOperations List directories and check size | FAIL | 135.49s | [run 1] | 1_basic_operations_test.go:186: Test case [List directories and check size] scheduled at [04-25-2026 02:02:24] system_test_framework.go:148: Test case [List directories and check size] start at [04-25-2026 02:02:24] utils.go:117: Command failed on attempt [1/3] due to error [exit status 1]. Output: [failed to get fees table: request failed, url: https://test2.zus.network/miner03/v1/fees_table, err: Get "https://test2.zus.network/miner03/v1/fees_table": dial tcp 198.18.0.73:7073: connect: no route to host,request failed, url: https://test2.zus.network/miner01/v1/fees_table, err: Get "https://test2.zus.network/miner01/v1/fees_table": dial tcp 198.18.0.71:7071: connect: no route to host,request failed, url: https://test2.zus.network/miner04/v1/fees_table, err: Get "https://test2.zus.network/miner04/v1/fees_table": dial tcp 198.18.0.74:7074: connect: no route to host] utils.go:117: Command failed on attempt [2/3] due to error [exit status 1]. Output: [failed to get fees table: request failed, url: https://test2.zus.network/miner02/v1/fees_table, err: Get "https://test2.zus.network/miner02/v1/fees_table": dial tcp 198.18.0.72:7072: connect: no route to host,request failed, url: https://test2.zus.network/miner01/v1/fees_table, err: Get "https://test2.zus.network/miner01/v1/fees_table": dial tcp 198.18.0.71:7071: connect: no route to host,request failed, url: https://test2.zus.network/miner03/v1/fees_table, err: Get "https://test2.zus.network/miner03/v1/fees_table": dial tcp 198.18.0.73:7073: connect: no route to host] utils.go:133: Command failed on final attempt [3/3] due to error [exit status 1]. Command String: [] Output: [failed to get fees table: request failed, url: https://test2.zus.network/miner02/v1/fees_table, err: Get "https://test2.zus.network/miner02/v1/fees_table": dial tcp 198.18.0.72:7072: connect: no route to host,request failed, url: https://test2.zus.network/miner01/v1/fees_table, err: Get "https://test2.zus.network/miner01/v1/fees_table": dial tcp 198.18.0.71:7071: connect: no route to host,request failed, url: https://test2.zus.network/miner03/v1/fees_table, err: Get "https://test2.zus.network/miner03/v1/fees_table": dial tcp 198.18.0.73:7073: connect: no route to host] utils.go:136: The verbose output for the command is: utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:04:37.119550 wallet_base.go:192: ******* Wallet SDK Version:v1.17.0-lfb-1-64-g86186876 ******* (SetLogFile) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:04:37.119670 sdk.go:110: ******* Storage SDK Version: v1.17.0-lfb-1-64-g86186876 ******* utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:04:40.121758 init_node.go:166: Node offline during initialization{url 15 0 https://test2.zus.network/miner02 <nil>} utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:04:40.121767 init_node.go:166: Node offline during initialization{url 15 0 https://test2.zus.network/miner01 <nil>} utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:04:40.121768 init_node.go:166: Node offline during initialization{url 15 0 https://test2.zus.network/miner03 <nil>} utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:04:40.121785 init_node.go:166: Node offline during initialization{url 15 0 https://test2.zus.network/miner04 <nil>} utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:04:40.123199 init_node.go:181: Not enough online miners found, supplementing with random miners{online 11 0 <nil>} {required 11 4 <nil>} utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 02:04:40.171739 entity.go:591: failed to estimate txn fee{error 26 0 failed to get fees table: request failed, url: https://test2.zus.network/miner02/v1/fees_table, err: Get "https://test2.zus.network/miner02/v1/fees_table": dial tcp 198.18.0.72:7072: connect: no route to host,request failed, url: https://test2.zus.network/miner01/v1/fees_table, err: Get "https://test2.zus.network/miner01/v1/fees_table": dial tcp 198.18.0.71:7071: connect: no route to host,request failed, url: https://test2.zus.network/miner04/v1/fees_table, err: Get "https://test2.zus.network/miner04/v1/fees_table": dial tcp 198.18.0.74:7074: connect: no route to host} {txn 23 0 0xc000000000} utils.go:140: failed to get fees table: request failed, url: https://test2.zus.network/miner02/v1/fees_table, err: Get "https://test2.zus.network/miner02/v1/fees_table": dial tcp 198.18.0.72:7072: connect: no route to host,request failed, url: https://test2.zus.network/miner01/v1/fees_table, err: Get "https://test2.zus.network/miner01/v1/fees_table": dial tcp 198.18.0.71:7071: connect: no route to host,request failed, url: https://test2.zus.network/miner04/v1/fees_table, err: Get "https://test2.zus.network/miner04/v1/fees_table": dial tcp 198.18.0.74:7074: connect: no route to host assertions.go:363: Error Trace: /root/Code/system_test/tests/cli_tests/rclone_zus_tests/1_basic_operations_test.go:83 Error: Expected nil, but got: &exec.ExitError{ProcessState:(*os.ProcessState)(0xc000210120), Stderr:[]uint8(nil)} Messages: faucet failed: failed to get fees table: request failed, url: https://test2.zus.network/miner02/v1/fees_table, err: Get "https://test2.zus.network/miner02/v1/fees_table": dial tcp 198.18.0.72:7072: connect: no route to host,request failed, url: https://test2.zus.network/miner01/v1/fees_table, err: Get "https://test2.zus.network/miner01/v1/fees_table": dial tcp 198.18.0.71:7071: connect: no route to host,request failed, url: https://test2.zus.network/miner03/v1/fees_table, err: Get "https://test2.zus.network/miner03/v1/fees_table": dial tcp 198.18.0.73:7073: connect: no route to host 1_basic_operations_test.go:186: Test case [List directories and check size] exit at [04-25-2026 02:04:40] |
| 38 | rclone | TestRcloneZusBasicOperations Tree shows directory structure | FAIL | 151.53s | [run 1] | utils.go:117: Command failed on attempt [1/3] due to error [exit status 1]. Output: [failed to get fees table: request failed, url: https://test2.zus.network/miner02/v1/fees_table, err: Get "https://test2.zus.network/miner02/v1/fees_table": dial tcp 198.18.0.72:7072: connect: no route to host,request failed, url: https://test2.zus.network/miner01/v1/fees_table, err: Get "https://test2.zus.network/miner01/v1/fees_table": dial tcp 198.18.0.71:7071: connect: no route to host,request failed, url: https://test2.zus.network/miner03/v1/fees_table, err: Get "https://test2.zus.network/miner03/v1/fees_table": dial tcp 198.18.0.73:7073: connect: no route to host] utils.go:117: Command failed on attempt [2/3] due to error [exit status 1]. Output: [failed to get fees table: request failed, url: https://test2.zus.network/miner03/v1/fees_table, err: Get "https://test2.zus.network/miner03/v1/fees_table": dial tcp 198.18.0.73:7073: connect: no route to host,request failed, url: https://test2.zus.network/miner02/v1/fees_table, err: Get "https://test2.zus.network/miner02/v1/fees_table": dial tcp 198.18.0.72:7072: connect: no route to host,request failed, url: https://test2.zus.network/miner04/v1/fees_table, err: Get "https://test2.zus.network/miner04/v1/fees_table": dial tcp 198.18.0.74:7074: connect: no route to host] utils.go:133: Command failed on final attempt [3/3] due to error [exit status 1]. Command String: [] Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=e32793f650e4db22bd6d11e8bf83b8c2d6238b861258a230bf2ee2013f58ee15: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=e32793f650e4db22bd6d11e8bf83b8c2d6238b861258a230bf2ee2013f58ee15: [400] {"error":"unexpected end of JSON input"}] utils.go:136: The verbose output for the command is: utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:07:00.644925 wallet_base.go:192: ******* Wallet SDK Version:v1.17.0-lfb-1-64-g86186876 ******* (SetLogFile) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:07:00.645038 sdk.go:110: ******* Storage SDK Version: v1.17.0-lfb-1-64-g86186876 ******* utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:07:00.653612 node.go:238: LFB refresh: 2/2 sharders healthy (within 3 blocks of LFB 100428) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:07:00.655191 entity.go:635: executing transaction 'pour' with hash 2df87781b30271daa335bb7f2f74a7e23c3dea4769779bb8ea920f063b7622cd utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:07:00.655219 entity.go:636: estimated txn fee: 0 utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:07:10.689426 node.go:238: LFB refresh: 2/2 sharders healthy (within 3 blocks of LFB 100428) utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 02:07:11.693908 entity.go:666: Error verifying the transaction[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders utils.go:140: https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=2df87781b30271daa335bb7f2f74a7e23c3dea4769779bb8ea920f063b7622cd: [400] {"error":"unexpected end of JSON input"} utils.go:140: https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=2df87781b30271daa335bb7f2f74a7e23c3dea4769779bb8ea920f063b7622cd: [400] {"error":"unexpected end of JSON input"} utils.go:140: 2df87781b30271daa335bb7f2f74a7e23c3dea4769779bb8ea920f063b7622cd utils.go:140: [txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders assertions.go:363: Error Trace: /root/Code/system_test/tests/cli_tests/rclone_zus_tests/1_basic_operations_test.go:83 Error: Expected nil, but got: &exec.ExitError{ProcessState:(*os.ProcessState)(0xc000210468), Stderr:[]uint8(nil)} Messages: faucet failed: [txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders 1_basic_operations_test.go:219: Test case [Tree shows directory structure] exit at [04-25-2026 02:07:11] |
| 39 | rclone | TestRcloneZusSyncOperations | FAIL | 493.60s | [run 1] | No error details |
| 40 | rclone | TestRcloneZusSyncOperations Sync local directory to remote | FAIL | 164.41s | [run 1] | utils.go:117: Command failed on attempt [1/3] due to error [exit status 1]. Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=c9f061494d4a98509aa299d50f09c788b7aa45b2720833aa842e150389f8a92a: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=c9f061494d4a98509aa299d50f09c788b7aa45b2720833aa842e150389f8a92a: [400] {"error":"unexpected end of JSON input"}] utils.go:117: Command failed on attempt [2/3] due to error [exit status 1]. Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=a302dcdfc29b9e8a5d080b87c46c6417ba65da9d2d753708a2856120ccdf616a: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=a302dcdfc29b9e8a5d080b87c46c6417ba65da9d2d753708a2856120ccdf616a: [400] {"error":"unexpected end of JSON input"}] utils.go:133: Command failed on final attempt [3/3] due to error [exit status 1]. Command String: [] Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=42859c71304110e65a189630a3efbaf323e6b89127434dc0cbd719fa40b3f2c6: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=42859c71304110e65a189630a3efbaf323e6b89127434dc0cbd719fa40b3f2c6: [400] {"error":"unexpected end of JSON input"}] utils.go:136: The verbose output for the command is: utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:09:45.040688 wallet_base.go:192: ******* Wallet SDK Version:v1.17.0-lfb-1-64-g86186876 ******* (SetLogFile) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:09:45.040807 sdk.go:110: ******* Storage SDK Version: v1.17.0-lfb-1-64-g86186876 ******* utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:09:45.052263 node.go:238: LFB refresh: 2/2 sharders healthy (within 3 blocks of LFB 100428) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:09:45.057774 entity.go:635: executing transaction 'pour' with hash c3aeab34116dcecbcc86d2e89c1d3ecfdc0a303583cd9c01119a87c973b47af3 utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:09:45.057815 entity.go:636: estimated txn fee: 0 utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:09:55.103593 node.go:238: LFB refresh: 2/2 sharders healthy (within 3 blocks of LFB 100428) utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 02:09:56.106118 entity.go:666: Error verifying the transaction[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders utils.go:140: https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=c3aeab34116dcecbcc86d2e89c1d3ecfdc0a303583cd9c01119a87c973b47af3: [400] {"error":"unexpected end of JSON input"} utils.go:140: https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=c3aeab34116dcecbcc86d2e89c1d3ecfdc0a303583cd9c01119a87c973b47af3: [400] {"error":"unexpected end of JSON input"} utils.go:140: c3aeab34116dcecbcc86d2e89c1d3ecfdc0a303583cd9c01119a87c973b47af3 utils.go:140: [txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders assertions.go:363: Error Trace: /root/Code/system_test/tests/cli_tests/rclone_zus_tests/1_basic_operations_test.go:83 Error: Expected nil, but got: &exec.ExitError{ProcessState:(*os.ProcessState)(0xc000210810), Stderr:[]uint8(nil)} Messages: faucet failed: [txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders 2_sync_operations_test.go:30: Test case [Sync local directory to remote] exit at [04-25-2026 02:09:56] |
| 41 | rclone | TestRcloneZusSyncOperations Sync dry-run detects changes | FAIL | 164.61s | [run 1] | utils.go:117: Command failed on attempt [1/3] due to error [exit status 1]. Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=81d75f938b77595f6a836bba20af9474262c5620ccecf9437cd01bdd7ada5d8b: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=81d75f938b77595f6a836bba20af9474262c5620ccecf9437cd01bdd7ada5d8b: [400] {"error":"unexpected end of JSON input"}] utils.go:117: Command failed on attempt [2/3] due to error [exit status 1]. Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=f34d4262e7c19324abd834251a11243cdb8fee428949e472f9016abcd7f085bc: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=f34d4262e7c19324abd834251a11243cdb8fee428949e472f9016abcd7f085bc: [400] {"error":"unexpected end of JSON input"}] utils.go:133: Command failed on final attempt [3/3] due to error [exit status 1]. Command String: [] Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=932b3d0653e62b07147e574176f742f0d7e5842f5ccd4e2b6d7422e2e1f4ade4: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=932b3d0653e62b07147e574176f742f0d7e5842f5ccd4e2b6d7422e2e1f4ade4: [400] {"error":"unexpected end of JSON input"}] utils.go:136: The verbose output for the command is: utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:12:29.556036 wallet_base.go:192: ******* Wallet SDK Version:v1.17.0-lfb-1-64-g86186876 ******* (SetLogFile) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:12:29.556333 sdk.go:110: ******* Storage SDK Version: v1.17.0-lfb-1-64-g86186876 ******* utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:12:29.574144 node.go:238: LFB refresh: 2/2 sharders healthy (within 3 blocks of LFB 100428) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:12:29.578711 entity.go:635: executing transaction 'pour' with hash 2dd30f6c130bc137320fc36b79fe4eacbec807e25ef01d9b6766f4ac21eb1474 utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:12:29.578816 entity.go:636: estimated txn fee: 0 utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:12:39.700810 node.go:238: LFB refresh: 2/2 sharders healthy (within 3 blocks of LFB 100428) utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 02:12:40.713873 entity.go:666: Error verifying the transaction[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders utils.go:140: https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=2dd30f6c130bc137320fc36b79fe4eacbec807e25ef01d9b6766f4ac21eb1474: [400] {"error":"unexpected end of JSON input"} utils.go:140: https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=2dd30f6c130bc137320fc36b79fe4eacbec807e25ef01d9b6766f4ac21eb1474: [400] {"error":"unexpected end of JSON input"} utils.go:140: 2dd30f6c130bc137320fc36b79fe4eacbec807e25ef01d9b6766f4ac21eb1474 utils.go:140: [txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders assertions.go:363: Error Trace: /root/Code/system_test/tests/cli_tests/rclone_zus_tests/1_basic_operations_test.go:83 Error: Expected nil, but got: &exec.ExitError{ProcessState:(*os.ProcessState)(0xc000210b58), Stderr:[]uint8(nil)} Messages: faucet failed: [txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders 2_sync_operations_test.go:73: Test case [Sync dry-run detects changes] exit at [04-25-2026 02:12:40] |
| 42 | rclone | TestRcloneZusSyncOperations Download synced files and verify content | FAIL | 164.58s | [run 1] | utils.go:117: Command failed on attempt [1/3] due to error [exit status 1]. Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=ae308f13343668855bb7c21e48bab1cd9aa91027145bba047334001a444f08c1: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=ae308f13343668855bb7c21e48bab1cd9aa91027145bba047334001a444f08c1: [400] {"error":"unexpected end of JSON input"}] utils.go:117: Command failed on attempt [2/3] due to error [exit status 1]. Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=e48b5e9d7190f8193fb8b7728eaa1e74185ae914e94172e2175bf0995233f070: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=e48b5e9d7190f8193fb8b7728eaa1e74185ae914e94172e2175bf0995233f070: [400] {"error":"unexpected end of JSON input"}] utils.go:133: Command failed on final attempt [3/3] due to error [exit status 1]. Command String: [] Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=ce4c112a7a3555a5ed14d237e5350696ed610e70e1508207feecccce6745cef1: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=ce4c112a7a3555a5ed14d237e5350696ed610e70e1508207feecccce6745cef1: [400] {"error":"unexpected end of JSON input"}] utils.go:136: The verbose output for the command is: utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:15:14.244925 wallet_base.go:192: ******* Wallet SDK Version:v1.17.0-lfb-1-64-g86186876 ******* (SetLogFile) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:15:14.245068 sdk.go:110: ******* Storage SDK Version: v1.17.0-lfb-1-64-g86186876 ******* utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:15:14.254932 node.go:238: LFB refresh: 2/2 sharders healthy (within 3 blocks of LFB 100428) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:15:14.257038 entity.go:635: executing transaction 'pour' with hash 9dab2de798e3cb6fe99f97d1bb79e3d6e357a1983be093d19d3e3d7094b0537d utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:15:14.257130 entity.go:636: estimated txn fee: 0 utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:15:24.297573 node.go:238: LFB refresh: 2/2 sharders healthy (within 3 blocks of LFB 100428) utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 02:15:25.300700 entity.go:666: Error verifying the transaction[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders utils.go:140: https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=9dab2de798e3cb6fe99f97d1bb79e3d6e357a1983be093d19d3e3d7094b0537d: [400] {"error":"unexpected end of JSON input"} utils.go:140: https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=9dab2de798e3cb6fe99f97d1bb79e3d6e357a1983be093d19d3e3d7094b0537d: [400] {"error":"unexpected end of JSON input"} utils.go:140: 9dab2de798e3cb6fe99f97d1bb79e3d6e357a1983be093d19d3e3d7094b0537d utils.go:140: [txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders assertions.go:363: Error Trace: /root/Code/system_test/tests/cli_tests/rclone_zus_tests/1_basic_operations_test.go:83 Error: Expected nil, but got: &exec.ExitError{ProcessState:(*os.ProcessState)(0xc00011a1b0), Stderr:[]uint8(nil)} Messages: faucet failed: [txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders 2_sync_operations_test.go:107: Test case [Download synced files and verify content] exit at [04-25-2026 02:15:25] |
| 43 | rclone | TestRcloneZusCrossAllocationTransfer | FAIL | 164.42s | [run 1] | No error details |
| 44 | rclone | TestRcloneZusCrossAllocationTransfer Cross-wallet transfer via local staging | FAIL | 164.42s | [run 1] | utils.go:117: Command failed on attempt [1/3] due to error [exit status 1]. Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=993237d3bfe4e2274e38a340602ac64f87829cb99d2221b66a2adf7f60965775: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=993237d3bfe4e2274e38a340602ac64f87829cb99d2221b66a2adf7f60965775: [400] {"error":"unexpected end of JSON input"}] utils.go:117: Command failed on attempt [2/3] due to error [exit status 1]. Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=e920c05f5ece431bac6e0363c16ddf99a286aa602b721ff8d621a5a9088a6705: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=e920c05f5ece431bac6e0363c16ddf99a286aa602b721ff8d621a5a9088a6705: [400] {"error":"unexpected end of JSON input"}] utils.go:133: Command failed on final attempt [3/3] due to error [exit status 1]. Command String: [] Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=4149077b71b2e8d1fca6d2630b2a1a79808ddd1f0bd50c029be018892e6af35f: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=4149077b71b2e8d1fca6d2630b2a1a79808ddd1f0bd50c029be018892e6af35f: [400] {"error":"unexpected end of JSON input"}] utils.go:136: The verbose output for the command is: utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:17:58.665846 wallet_base.go:192: ******* Wallet SDK Version:v1.17.0-lfb-1-64-g86186876 ******* (SetLogFile) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:17:58.665960 sdk.go:110: ******* Storage SDK Version: v1.17.0-lfb-1-64-g86186876 ******* utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:17:58.675867 node.go:238: LFB refresh: 2/2 sharders healthy (within 3 blocks of LFB 100428) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:17:58.677452 entity.go:635: executing transaction 'pour' with hash 412eaa3c21912861b8d5e6139ff9483d0d02e57b0147a2f955abedf01a78370e utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:17:58.677488 entity.go:636: estimated txn fee: 0 utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:18:08.721394 node.go:238: LFB refresh: 2/2 sharders healthy (within 3 blocks of LFB 100428) utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 02:18:09.724710 entity.go:666: Error verifying the transaction[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders utils.go:140: https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=412eaa3c21912861b8d5e6139ff9483d0d02e57b0147a2f955abedf01a78370e: [400] {"error":"unexpected end of JSON input"} utils.go:140: https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=412eaa3c21912861b8d5e6139ff9483d0d02e57b0147a2f955abedf01a78370e: [400] {"error":"unexpected end of JSON input"} utils.go:140: 412eaa3c21912861b8d5e6139ff9483d0d02e57b0147a2f955abedf01a78370e utils.go:140: [txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders assertions.go:363: Error Trace: /root/Code/system_test/tests/cli_tests/rclone_zus_tests/1_basic_operations_test.go:83 Error: Expected nil, but got: &exec.ExitError{ProcessState:(*os.ProcessState)(0xc000210ea0), Stderr:[]uint8(nil)} Messages: faucet failed: [txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders 3_cross_allocation_test.go:30: Test case [Cross-wallet transfer via local staging] exit at [04-25-2026 02:18:09] |
| 45 | rclone | TestRcloneZusSplitKeyWallet | FAIL | 164.47s | [run 1] | No error details |
| 46 | rclone | TestRcloneZusSplitKeyWallet Split-key wallet config is loaded | FAIL | 164.47s | [run 1] | utils.go:117: Command failed on attempt [1/3] due to error [exit status 1]. Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=0ed128c531b6511a14c1aeb9deb091edadeb12b730a8a32bcd13a1678f711466: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=0ed128c531b6511a14c1aeb9deb091edadeb12b730a8a32bcd13a1678f711466: [400] {"error":"unexpected end of JSON input"}] utils.go:117: Command failed on attempt [2/3] due to error [exit status 1]. Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=424cfbb07b9dc921ca6f7c284dc72993dcc11c0c2dad57168a5baabb9656892e: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=424cfbb07b9dc921ca6f7c284dc72993dcc11c0c2dad57168a5baabb9656892e: [400] {"error":"unexpected end of JSON input"}] utils.go:133: Command failed on final attempt [3/3] due to error [exit status 1]. Command String: [] Output: [[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders -<NEWLINE>- https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=23c1c1b4af6e0cab61093f860c2b6fa721627d5efdf85cd1ff6f2158986c5863: [400] {"error":"unexpected end of JSON input"} -<NEWLINE>- https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=23c1c1b4af6e0cab61093f860c2b6fa721627d5efdf85cd1ff6f2158986c5863: [400] {"error":"unexpected end of JSON input"}] utils.go:136: The verbose output for the command is: utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:20:43.139395 wallet_base.go:192: ******* Wallet SDK Version:v1.17.0-lfb-1-64-g86186876 ******* (SetLogFile) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:20:43.139590 sdk.go:110: ******* Storage SDK Version: v1.17.0-lfb-1-64-g86186876 ******* utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:20:43.148399 node.go:238: LFB refresh: 2/2 sharders healthy (within 3 blocks of LFB 100428) utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:20:43.149766 entity.go:635: executing transaction 'pour' with hash 408f7bda476cf6aae8f35239cd21998814ccad6bdfc7e3474ef374d7fa9fcd53 utils.go:140: 0chain-core-sdk [INFO] 2026/04/25 02:20:43.149790 entity.go:636: estimated txn fee: 0 utils.go:140: 0chain-core-sdk [DEBUG] 2026/04/25 02:20:53.189294 node.go:238: LFB refresh: 2/2 sharders healthy (within 3 blocks of LFB 100428) utils.go:140: 0chain-core-sdk [ERROR] 2026/04/25 02:20:54.192647 entity.go:666: Error verifying the transaction[txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders utils.go:140: https://test2.zus.network/sharder01/v1/transaction/get/confirmation?hash=408f7bda476cf6aae8f35239cd21998814ccad6bdfc7e3474ef374d7fa9fcd53: [400] {"error":"unexpected end of JSON input"} utils.go:140: https://test2.zus.network/sharder02/v1/transaction/get/confirmation?hash=408f7bda476cf6aae8f35239cd21998814ccad6bdfc7e3474ef374d7fa9fcd53: [400] {"error":"unexpected end of JSON input"} utils.go:140: 408f7bda476cf6aae8f35239cd21998814ccad6bdfc7e3474ef374d7fa9fcd53 utils.go:140: [txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders assertions.go:363: Error Trace: /root/Code/system_test/tests/cli_tests/rclone_zus_tests/1_basic_operations_test.go:83 Error: Expected nil, but got: &exec.ExitError{ProcessState:(*os.ProcessState)(0xc00011a4c8), Stderr:[]uint8(nil)} Messages: faucet failed: [txn] too less sharders to confirm it: min_confirmation is 10%, but got 0/2 sharders 4_split_key_test.go:25: Test case [Split-key wallet config is loaded] exit at [04-25-2026 02:20:54] |
| 47 | api | TestRepairAllocation Repair allocation after single upload should work | RUNNING | ... | [live] | in progress... |
| 48 | api | TestRepairAllocation Repair allocation after multiple uploads should work | RUNNING | ... | [live] | in progress... |
| 49 | api | TestRepairAllocation Repair allocation after update should work | RUNNING | ... | [live] | in progress... |
| 50 | cli | TestRepairSize repair size should work | RUNNING | ... | [live] | in progress... |
| 51 | api | TestDatalakeAPI | SKIP | 0.00s | [run 1] | 0box_datalake_test.go:26: Datalake API not available at http://localhost:8088 (got , err=Get "http://localhost:8088/api/v1/health-check": dial tcp 127.0.0.1:8088: connect: connection refused) — skipping |
| 52 | cli | TestGetStakableProviders get stakable blobbers should work | SKIP | 70.77s | [run 1] | list_stakable_providers_test.go:330: Test case [get stakable blobbers should work] exit at [04-25-2026 01:17:35] |
| 53 | cli | TestGetStakableProviders get stakable validators should work | SKIP | 87.82s | [run 1] | list_stakable_providers_test.go:409: Test case [get stakable validators should work] exit at [04-25-2026 01:19:03] |
| 54 | zs3 | TestZs3serverWriteThroughFallback | SKIP | 0.00s | [run 1] | 10_write_through_fallback_test.go:56: ZS3_UPSTREAM_ENDPOINT unset — write-through requires an upstream to observe |
| 55 | zs3 | TestZs3serverListCoverage cross-protocol LIST S3→NFS | SKIP | 0.00s | [run 1] | 14_list_coverage_test.go:145: ZS3_NFS_MOUNT unset, skipping cross-protocol LIST |
| 56 | zs3 | TestZs3serverFallbackS3 | SKIP | 0.00s | [run 1] | 6_fallback_s3_test.go:62: ZS3_ALLOC_ID env var not set |
| 57 | api | Test0BoxActivitySync | PASS | 1.23s | [run 1] | OK |
| 58 | api | Test0BoxActivitySync Wallet creation is tracked and persisted | PASS | 0.19s | [run 1] | OK |
| 59 | api | Test0BoxActivitySync Allocation creation is tracked and persisted | PASS | 0.19s | [run 1] | OK |
| 60 | api | Test0BoxActivitySync Shareinfo create and delete are tracked and persisted | PASS | 0.18s | [run 1] | OK |
| 61 | api | Test0BoxActivitySync Wallet update is tracked and persisted | PASS | 0.25s | [run 1] | OK |
| 62 | api | Test0BoxActivitySync Multiple sequential operations are all tracked | PASS | 0.23s | [run 1] | OK |
| 63 | api | Test0BoxActivitySync Cross-app-type tracking isolation | PASS | 0.19s | [run 1] | OK |
| 64 | api | Test0BoxDex | PASS | 0.38s | [run 1] | OK |
| 65 | api | Test0BoxDex Create dex should work | PASS | 0.20s | [run 1] | OK |
| 66 | api | Test0BoxDex Update dex should work | PASS | 0.18s | [run 1] | OK |
| 67 | api | Test0BoxGroup | PASS | 1.81s | [run 1] | OK |
| 68 | api | Test0BoxGroup Create group should work | PASS | 0.18s | [run 1] | OK |
| 69 | api | Test0BoxGroup Create group without group name should fail validation | PASS | 0.21s | [run 1] | OK |
| 70 | api | Test0BoxGroup Get my groups should work | PASS | 0.25s | [run 1] | OK |
| 71 | api | Test0BoxGroup Add member to group should work | PASS | 0.19s | [run 1] | OK |
| 72 | api | Test0BoxGroup Get group members should work | PASS | 0.19s | [run 1] | OK |
| 73 | api | Test0BoxGroup Update group should work | PASS | 0.21s | [run 1] | OK |
| 74 | api | Test0BoxGroup Delete group should work | PASS | 0.20s | [run 1] | OK |
| 75 | api | Test0BoxGroup Search public groups should work | PASS | 0.20s | [run 1] | OK |
| 76 | api | Test0BoxGroup Search groups without query should fail | PASS | 0.00s | [run 1] | OK |
| 77 | api | Test0BoxGroup Delete non-existent group should return appropriate response | PASS | 0.19s | [run 1] | OK |
| 78 | api | Test0BoxOwner | PASS | 0.41s | [run 1] | OK |
| 79 | api | Test0BoxOwner create owner without existing userID should work | PASS | 0.09s | [run 1] | OK |
| 80 | api | Test0BoxOwner create owner with existing userID should not work | PASS | 0.09s | [run 1] | OK |
| 81 | api | Test0BoxOwner update owner with existing owner should work | PASS | 0.12s | [run 1] | OK |
| 82 | api | Test0BoxOwner update owner without existing owner should not work | PASS | 0.11s | [run 1] | OK |
| 83 | api | Test0BoxPublicShare | PASS | 0.75s | [run 1] | OK |
| 84 | api | Test0BoxPublicShare Create public share should work | PASS | 0.19s | [run 1] | OK |
| 85 | api | Test0BoxPublicShare Check public share exists should work | PASS | 0.18s | [run 1] | OK |
| 86 | api | Test0BoxPublicShare Get public share recipients should work | PASS | 0.19s | [run 1] | OK |
| 87 | api | Test0BoxPublicShare Revoke public share should work | PASS | 0.18s | [run 1] | OK |
| 88 | api | Test0BoxReferral | PASS | 0.68s | [run 1] | OK |
| 89 | api | Test0BoxReferral Get referral code with owner should work | PASS | 0.19s | [run 1] | OK |
| 90 | api | Test0BoxReferral Rank referrals with no referrer should work properly | PASS | 0.21s | [run 1] | OK |
| 91 | api | Test0BoxReferral Create wallet for first time with the referral code should work | PASS | 0.29s | [run 1] | OK |
| 92 | api | Test0BoxReferralLeaderBoard | PASS | 0.48s | [run 1] | OK |
| 93 | api | Test0BoxReferralLeaderBoard Testing LeaderBoard | PASS | 0.48s | [run 1] | OK |
| 94 | api | Test0BoxShareinfo | PASS | 0.82s | [run 1] | OK |
| 95 | api | Test0BoxShareinfo Create shareinfo valid auth ticket should work | PASS | 0.28s | [run 1] | OK |
| 96 | api | Test0BoxShareinfo Create shareinfo invalid auth ticket should not work | PASS | 0.32s | [run 1] | OK |
| 97 | api | Test0BoxShareinfo get shareinfo valid auth ticket should work | PASS | 0.21s | [run 1] | OK |
| 98 | api | Test0BoxShortIO | PASS | 1.21s | [run 1] | OK |
| 99 | api | Test0BoxShortIO Create short link for public file share URL | PASS | 0.20s | [run 1] | OK |
| 100 | api | Test0BoxShortIO Create short link for private file share URL | PASS | 0.19s | [run 1] | OK |
| 101 | api | Test0BoxShortIO Create short link for folder share URL | PASS | 0.20s | [run 1] | OK |
| 102 | api | Test0BoxShortIO Empty URL should return error | PASS | 0.21s | [run 1] | OK |
| 103 | api | Test0BoxShortIO Malformed URL should return error | PASS | 0.20s | [run 1] | OK |
| 104 | api | Test0BoxShortIO Very long URL should be handled gracefully | PASS | 0.21s | [run 1] | OK |
| 105 | api | Test0BoxShortIO Request without auth headers should return error | PASS | 0.00s | [run 1] | OK |
| 106 | api | Test0BoxTranscoder Upload MP4 and trigger transcode lifecycle | PASS | 180.14s | [run 1] | OK |
| 107 | api | Test0BoxTranscoder Get metadata for non-existent file returns error | PASS | 0.00s | [run 1] | OK |
| 108 | api | Test0BoxWalletAuth | PASS | 0.92s | [run 1] | OK |
| 109 | api | Test0BoxWalletAuth Full split-key wallet flow: store in zvault, split key, share, verify keys | PASS | 0.31s | [run 1] | OK |
| 110 | api | Test0BoxWalletAuth Wallet verify with real wallet data should respond with valid status | PASS | 0.18s | [run 1] | OK |
| 111 | api | Test0BoxWalletAuth Register wallet auth for metamask provider with authenticated request | PASS | 0.21s | [run 1] | OK |
| 112 | api | Test0BoxWalletAuth Register wallet auth for zus provider with authenticated request | PASS | 0.22s | [run 1] | OK |
| 113 | api | Test0BoxWalletAuth Unauthenticated wallet auth registration should fail | PASS | 0.00s | [run 1] | OK |
| 114 | api | Test0BoxWalletLogin | PASS | 0.01s | [run 1] | OK |
| 115 | api | Test0BoxWalletLogin Get wallet nonce should return nonce | PASS | 0.00s | [run 1] | OK |
| 116 | api | Test0BoxWalletLogin Verify wallet signature with invalid address should fail | PASS | 0.00s | [run 1] | OK |
| 117 | api | Test0BoxWalletLogin Verify wallet signature with invalid provider should fail | PASS | 0.00s | [run 1] | OK |
| 118 | api | Test0BoxWalletLogin Verify wallet signature with expired nonce should fail | PASS | 0.00s | [run 1] | OK |
| 119 | api | Test0BoxWalletLogin Full nonce then verify round-trip with dummy signature should return Invalid signature | PASS | 0.00s | [run 1] | OK |
| 120 | api | Test0BoxWallet | PASS | 0.92s | [run 1] | OK |
| 121 | api | Test0BoxWallet create wallet without owner should not work | PASS | 0.13s | [run 1] | OK |
| 122 | api | Test0BoxWallet create wallet without existing wallet should work | PASS | 0.12s | [run 1] | OK |
| 123 | api | Test0BoxWallet create wallet with existing wallet should not work | PASS | 0.14s | [run 1] | OK |
| 124 | api | Test0BoxWallet create wallet with existing wallet another apptype should not work | PASS | 0.16s | [run 1] | OK |
| 125 | api | Test0BoxWallet create wallet with existing wallet same apptype should not work | PASS | 0.12s | [run 1] | OK |
| 126 | api | Test0BoxWallet update wallet with existing wallet should work | PASS | 0.12s | [run 1] | OK |
| 127 | api | Test0BoxWallet update wallet without existing wallet should not work | PASS | 0.14s | [run 1] | OK |
| 128 | api | Test0BoxZusLogin | PASS | 0.42s | [run 1] | OK |
| 129 | api | Test0BoxZusLogin Firebase sign-in should have provided valid ID token at startup | PASS | 0.00s | [run 1] | OK |
| 130 | api | Test0BoxZusLogin CSRF token endpoint should work | PASS | 0.00s | [run 1] | OK |
| 131 | api | Test0BoxZusLogin Full login flow: Firebase -> CSRF -> create wallet should succeed | PASS | 0.13s | [run 1] | OK |
| 132 | api | Test0BoxZusLogin Headers without Firebase token should fail wallet creation in production mode | PASS | 0.00s | [run 1] | OK |
| 133 | api | Test0BoxZusLogin JWT token creation after login should work | PASS | 0.28s | [run 1] | OK |
| 134 | api | TestAllocationUpdateLockAmount | PASS | 83.60s | [run 1] | OK |
| 135 | api | TestAllocationUpdateLockAmount Extend Allocation Size with used size > 0 | PASS | 21.31s | [run 1] | OK |
| 136 | api | TestAllocationUpdateLockAmount Extend Allocation Duration with used size > 0 | PASS | 33.67s | [run 1] | OK |
| 137 | api | TestAllocationUpdateLockAmount Add blobber to allocation with used size > 0 | PASS | 28.61s | [run 1] | OK |
| 138 | api | TestAllocationUpdateLockAmount Extend Allocation Duration | PASS | 28.17s | [run 1] | OK |
| 139 | api | TestAllocationUpdateLockAmount Replace blobber | PASS | 43.62s | [run 1] | OK |
| 140 | api | TestAllocationUpdateLockAmount Add blobber to allocation | PASS | 43.63s | [run 1] | OK |
| 141 | api | TestAllocationUpdateLockAmount Extend Allocation Size | PASS | 48.61s | [run 1] | OK |
| 142 | api | TestObjectTree | PASS | 142.19s | [run 1] | OK |
| 143 | api | TestObjectTree Get object tree with allocation id, remote path should work | PASS | 3.25s | [run 1] | OK |
| 144 | api | TestObjectTree Get file ref for empty allocation should work | PASS | 58.68s | [run 1] | OK |
| 145 | api | TestObjectTree Get file ref with invalid allocation id should fail | PASS | 3.21s | [run 1] | OK |
| 146 | api | TestObjectTree Get file ref with invalid sign should fail | PASS | 6.25s | [run 1] | OK |
| 147 | api | TestObjectTree Get file ref with invalid remotepath should fail | PASS | 70.79s | [run 1] | OK |
| 148 | api | TestBlobberFileRefs | PASS | 138.95s | [run 1] | OK |
| 149 | api | TestBlobberFileRefs Get file ref with allocation id, remote path with reftype as regular or updated should work | PASS | 10.83s | [run 1] | OK |
| 150 | api | TestBlobberFileRefs Get file ref with incorrect allocation id should fail | PASS | 76.86s | [run 1] | OK |
| 151 | api | TestBlobberFileRefs Get file ref with invalid remote file path should fail | PASS | 7.23s | [run 1] | OK |
| 152 | api | TestBlobberFileRefs Get file ref with invalid refType should fail | PASS | 6.70s | [run 1] | OK |
| 153 | api | TestBlobberFileRefs Get file ref with no path should fail | PASS | 3.46s | [run 1] | OK |
| 154 | api | TestBlobberFileRefs Get file ref with no refType should fail | PASS | 7.42s | [run 1] | OK |
| 155 | api | TestBlobberFileRefs Get file ref with no path and no refType should fail | PASS | 6.40s | [run 1] | OK |
| 156 | api | TestBlobberFileRefs Get file ref with invalid client signature should fail | PASS | 6.58s | [run 1] | OK |
| 157 | api | TestBlobberFileRefs Get file ref with invalid client id should fail | PASS | 6.98s | [run 1] | OK |
| 158 | api | TestBlobberFileRefs Get file ref with invalid client key should fail | PASS | 6.49s | [run 1] | OK |
| 159 | api | TestMultiDownload | PASS | 7.48s | [run 1] | OK |
| 160 | api | TestMultiDownload Multi download should work | PASS | 7.48s | [run 1] | OK |
| 161 | api | TestMultiOperationRollback Multi upload operations rollback should work | PASS | 28.22s | [run 1] | OK |
| 162 | api | TestMultiOperationRollback Multi delete operations rollback should work | PASS | 23.25s | [run 1] | OK |
| 163 | api | TestMultiOperationRollback Multi rename operations rollback should work | PASS | 24.95s | [run 1] | OK |
| 164 | api | TestMultiOperation Multi upload operations should work | PASS | 12.94s | [run 1] | OK |
| 165 | api | TestMultiOperation Multi delete operations should work | PASS | 18.01s | [run 1] | OK |
| 166 | api | TestMultiOperation Multi rename operations should work | PASS | 89.17s | [run 1] | OK |
| 167 | api | TestMultiOperation Multi move operations should work | PASS | 104.22s | [run 1] | OK |
| 168 | api | TestMultiOperation Multi copy operations should work | PASS | 94.81s | [run 1] | OK |
| 169 | api | TestMultiOperation Multi create dir operations should work | PASS | 80.73s | [run 1] | OK |
| 170 | api | TestMultiOperation Nested move operation should work | PASS | 82.01s | [run 1] | OK |
| 171 | api | TestMultiOperation Nested copy operation should work | PASS | 35.40s | [run 1] | OK |
| 172 | api | TestMultiOperation Nested rename directory operation should work | PASS | 87.63s | [run 1] | OK |
| 173 | api | TestRegisterBlobber | PASS | 239.18s | [run 1] | OK |
| 174 | api | TestRegisterBlobber Register blobber with storage version | PASS | 48.23s | [run 1] | OK |
| 175 | api | TestRegisterBlobber Write price lower than min write price should not allow register | PASS | 42.10s | [run 1] | OK |
| 176 | api | TestRegisterBlobber Write price higher than max write price should not allow register | PASS | 35.23s | [run 1] | OK |
| 177 | api | TestRegisterBlobber Read price higher than max read price should not allow register | PASS | 38.07s | [run 1] | OK |
| 178 | api | TestRegisterBlobber Service charge higher than max service charge should not allow register | PASS | 36.22s | [run 1] | OK |
| 179 | api | TestRegisterBlobber Capacity lower than min blobber capacity should not allow register | PASS | 39.34s | [run 1] | OK |
| 180 | cli | TestExpiredAllocation Finalize Expired Allocation Should Work after challenge completion time + expiry | PASS | 147.32s | [run 1] | OK |
| 181 | cli | TestExpiredAllocation Cancel Expired Allocation Should Fail | PASS | 151.29s | [run 1] | OK |
| 182 | cli | TestExpiredAllocation Update Expired Allocation Should Fail | PASS | 144.55s | [run 1] | OK |
| 183 | cli | TestExpiredAllocation Unlocking tokens from finalized allocation should work | PASS | 101.50s | [run 1] | OK |
| 184 | cli | TestOwnerUpdate should allow update of owner: StorageSC | PASS | 30.86s | [run 1] | OK |
| 185 | cli | TestTxVerificationNonBlocking | PASS | 16.19s | [run 1] | OK |
| 186 | cli | TestTxVerificationNonBlocking Faucet transaction confirms without blocking for LFB query timeout | PASS | 16.19s | [run 1] | OK |
| 187 | cli | TestLFBCacheReducesPerTxOverhead | PASS | 13.20s | [run 1] | OK |
| 188 | cli | TestLFBCacheReducesPerTxOverhead N back-to-back balance queries complete within N * single-op budget | PASS | 13.20s | [run 1] | OK |
| 189 | cli | TestLFBFallbackWithMinimumSharders | PASS | 17.71s | [run 1] | OK |
| 190 | cli | TestLFBFallbackWithMinimumSharders Balance check succeeds on cold LFB cache (fallback to Healthy) | PASS | 6.94s | [run 1] | OK |
| 191 | cli | TestLFBFallbackWithMinimumSharders Faucet + confirm succeeds when only one sharder is active | PASS | 10.77s | [run 1] | OK |
| 192 | cli | TestLFBSharderDistributionAcrossTopologies | PASS | 25.17s | [run 1] | OK |
| 193 | cli | TestLFBSharderDistributionAcrossTopologies Discover and log active miner+sharder topology | PASS | 5.62s | [run 1] | OK |
| 194 | cli | TestLFBSharderDistributionAcrossTopologies Transaction flow succeeds for active topology | PASS | 19.54s | [run 1] | OK |
| 195 | cli | TestLFBBackgroundRefreshTiming | PASS | 9.54s | [run 1] | OK |
| 196 | cli | TestLFBBackgroundRefreshTiming Call immediately after TTL expiry is non-blocking | PASS | 9.54s | [run 1] | OK |
| 197 | cli | TestGetStakableProviders | PASS | 236.58s | [run 1] | OK |
| 198 | cli | TestGetStakableProviders get stakable miners should work | PASS | 41.65s | [run 1] | OK |
| 199 | cli | TestGetStakableProviders get stakable sharders should work | PASS | 36.33s | [run 1] | OK |
| 200 | cli | TestBlobberAvailability | PASS | 185.04s | [run 1] | OK |
| 201 | cli | TestBlobberAvailability blobber is available switch controls blobber use for allocations | PASS | 185.04s | [run 1] | OK |
| 202 | cli | TestBlobberConfigUpdate | PASS | 249.42s | [run 1] | OK |
| 203 | cli | TestBlobberConfigUpdate update blobber managing wallet should be able to update delegate wallet | PASS | 20.15s | [run 1] | OK |
| 204 | cli | TestBlobberConfigUpdate update blobber capacity should work | PASS | 16.67s | [run 1] | OK |
| 205 | cli | TestBlobberConfigUpdate update blobber number of delegates should work | PASS | 19.46s | [run 1] | OK |
| 206 | cli | TestBlobberConfigUpdate update blobber service charge should work | PASS | 11.57s | [run 1] | OK |
| 207 | cli | TestBlobberConfigUpdate update no params should work | PASS | 9.42s | [run 1] | OK |
| 208 | cli | TestBlobberConfigUpdate update without blobber ID should fail | PASS | 25.00s | [run 1] | OK |
| 209 | cli | TestBlobberConfigUpdate update with invalid blobber ID should fail | PASS | 26.81s | [run 1] | OK |
| 210 | cli | TestBlobberConfigUpdate update with invalid blobber wallet/owner should fail | PASS | 15.57s | [run 1] | OK |
| 211 | cli | TestBlobberConfigUpdate update blobber read price should work | PASS | 21.30s | [run 1] | OK |
| 212 | cli | TestBlobberConfigUpdate update blobber write price should work | PASS | 9.97s | [run 1] | OK |
| 213 | cli | TestBlobberConfigUpdate update all params at once should work | PASS | 19.17s | [run 1] | OK |
| 214 | cli | TestBlobberConfigUpdate update base url should work | PASS | 8.64s | [run 1] | OK |
| 215 | zs3 | TestZs3serverCacheEvictionPolicy | PASS | 0.69s | [run 1] | OK |
| 216 | zs3 | TestZs3serverCacheEvictionPolicy xattr invariants | PASS | 0.01s | [run 1] | OK |
| 217 | zs3 | TestZs3serverCacheEvictionPolicy usage & LRU order | PASS | 0.02s | [run 1] | OK |
| 218 | zs3 | TestZs3serverCacheEvictionPolicy tracker stats endpoint | PASS | 0.67s | [run 1] | OK |
| 219 | zs3 | TestZs3serverListCoverage post-delete LIST | PASS | 2.77s | [run 1] | OK |
| 220 | zs3 | TestZs3serverListCoverage delimiter hierarchy | PASS | 3.06s | [run 1] | OK |
| 221 | zs3 | TestZs3serverListCoverage empty bucket LIST | PASS | 0.06s | [run 1] | OK |
| 222 | zs3 | TestZs3ServerEnterpriseBasic | PASS | 35.42s | [run 1] | OK |
| 223 | zs3 | TestZs3ServerEnterpriseBasic S3 PUT/GET round-trip via enterprise blobbers | PASS | 0.71s | [run 1] | OK |
| 224 | zs3 | TestZs3ServerEnterpriseBasic S3 multipart PUT large file via enterprise blobbers | PASS | 33.97s | [run 1] | OK |
| 225 | zs3 | TestZs3ServerEnterpriseBasic S3 DELETE via enterprise blobbers | PASS | 0.72s | [run 1] | OK |
| 226 | zs3 | TestZs3serverMixedWarpTests | PASS | 37.57s | [run 1] | OK |
| 227 | zs3 | TestZs3serverMixedWarpTests Warp Mixed Benchmark | PASS | 37.57s | [run 1] | OK |
| 228 | zs3 | TestZs3serverPutWarpTests | PASS | 34.74s | [run 1] | OK |
| 229 | zs3 | TestZs3serverFanoutTests | PASS | 33.44s | [run 1] | OK |
| 230 | zs3 | TestZs3serverListTests | PASS | 72.33s | [run 1] | OK |
| 231 | zs3 | TestZs3serverListTests Warp List Benchmark | PASS | 38.71s | [run 1] | OK |
| 232 | zs3 | TestZs3serverListTests Warp List Benchmark Concurrent | PASS | 33.17s | [run 1] | OK |
| 233 | zs3 | TestZs3serverDualAccess S3 PUT then NFS READ small file | PASS | 2.59s | [run 1] | OK |
| 234 | zs3 | TestZs3serverDualAccess NFS WRITE then S3 READ small file | PASS | 0.00s | [run 1] | OK |
| 235 | zs3 | TestZs3serverDualAccess S3 PUT 100KB then NFS READ checksum | PASS | 2.60s | [run 1] | OK |
| 236 | zs3 | TestZs3serverDualAccess NFS WRITE 100KB then S3 READ checksum | PASS | 0.00s | [run 1] | OK |
| 237 | zs3 | TestZs3serverDualAccess S3 LIST sees NFS written files | PASS | 0.04s | [run 1] | OK |
| 238 | zs3 | TestZs3serverDualAccess NFS LIST sees S3 written files | PASS | 0.00s | [run 1] | OK |
| 239 | zs3 | TestZs3serverDualAccess S3 DELETE then NFS verify gone | PASS | 2.07s | [run 1] | OK |
| 240 | zs3 | TestZs3serverDualAccess NFS DELETE then S3 verify gone | PASS | 0.00s | [run 1] | OK |
| 241 | zs3 | TestZs3serverDualAccess S3 overwrite then NFS sees new content | PASS | 5.17s | [run 1] | OK |
| 242 | zs3 | TestZs3serverDualAccess NFS overwrite then S3 sees new content | PASS | 4.08s | [run 1] | OK |
| 243 | zs3 | TestZs3serverMLPerfThroughput | PASS | 626.05s | [run 1] | OK |
| 244 | zs3 | TestZs3serverMLPerfThroughput MLPerf resnet | PASS | 552.31s | [run 1] | OK |
| 245 | zs3 | TestZs3serverMLPerfThroughput MLPerf bert | PASS | 19.05s | [run 1] | OK |
| 246 | zs3 | TestZs3serverMLPerfThroughput MLPerf cosmoflow | PASS | 54.66s | [run 1] | OK |
| 247 | zs3 | TestZs3serverPorcupineLinearizability | PASS | 362.51s | [run 1] | OK |
| 248 | zs3 | TestZs3serverPorcupineLinearizability s3/zs3server | PASS | 362.51s | [run 1] | OK |
| 249 | zs3 | TestZs3serverLlama3Checkpoint | PASS | 678.07s | [run 1] | OK |
| 250 | zs3 | TestZs3serverLlama3Checkpoint Llama3 ckpt 4 × 1.50 GB rotate=false | PASS | 678.04s | [run 1] | OK |
| 251 | mc | TestZs3Server | PASS | 2.11s | [run 1] | OK |
| 252 | mc | TestZs3Server Should list the buckets | PASS | 0.04s | [run 1] | OK |
| 253 | mc | TestZs3Server Test Bucket Creation | PASS | 0.06s | [run 1] | OK |
| 254 | mc | TestZs3Server Test Copying File Upload | PASS | 0.63s | [run 1] | OK |
| 255 | mc | TestZs3Server Test for moving file | PASS | 0.72s | [run 1] | OK |
| 256 | mc | TestZs3Server Test for copying file | PASS | 0.58s | [run 1] | OK |
| 257 | mc | TestZs3Server Test for removing file | PASS | 0.06s | [run 1] | OK |
| 258 | mc | TestZs3ServerBucket | PASS | 0.09s | [run 1] | OK |
| 259 | mc | TestZs3ServerBucket Test for moving file from testbucket to testbucket2 | PASS | 0.09s | [run 1] | OK |
| 260 | mc | TestZs3ServerReplication | PASS | 0.00s | [run 1] | OK |
| 261 | mc | TestZs3ServerReplication Test for replication | PASS | 1.82s | [run 1] | OK |
| 262 | mc | TestZs3ServerEnterprise | PASS | 1.42s | [run 1] | OK |
| 263 | mc | TestZs3ServerEnterprise Create bucket on enterprise zs3server | PASS | 0.05s | [run 1] | OK |
| 264 | mc | TestZs3ServerEnterprise Upload and download via enterprise zs3server | PASS | 0.66s | [run 1] | OK |
| 265 | mc | TestZs3ServerEnterprise Delete object from enterprise zs3server | PASS | 0.69s | [run 1] | OK |
| 266 | rclone | TestRcloneEnterpriseBasic | PASS | 64.18s | [run 1] | OK |
| 267 | rclone | TestRcloneEnterpriseBasic Upload and download via enterprise blobbers | PASS | 0.56s | [run 1] | OK |
| 268 | rclone | TestRcloneEnterpriseBasic Delete file from enterprise allocation | PASS | 0.92s | [run 1] | OK |
| 269 | rclone | TestRcloneEnterpriseBasic Parallel upload (--transfers=4) to enterprise blobbers | PASS | 62.70s | [run 1] | OK |