[Bug]: error code: 2, reason: incomplete query result, missing id xxxxxx, len(searchIDs) = 10, len(queryIDs) = 9, collection=456252365239748630: inconsistent requery result #40412

vanga999 · 2025-03-06T07:09:47Z

Is there an existing issue for this?

I have searched the existing issues

Environment

- Milvus version: Build Version v2.5.2
- Deployment mode(standalone or cluster):standalone
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2): milvus-sdk-java 2.5.4
- OS(Ubuntu or CentOS): CentOS 7.9
- CPU/Memory: 32C/128G
- GPU: RTX4090 * 2
- Others:

Current Behavior

Milvus java sdk 2.5.4 version
blow is my query code

        //Dynamic config
        HybridConfig config = AgentPrompt.searchConfig();
        List<AnnSearchReq> searchRequests = new ArrayList<>();
        // dense_vector
        searchRequests.add(AnnSearchReq.builder()
                .vectorFieldName("dense_vector")
                .vectors(denseQueryVector)
                .metricType(IndexParam.MetricType.COSINE)
                .params(config.getDenseParam())
                .topK(config.getTopK() * 2)
                .build());
        //metadata_dense_vector
        searchRequests.add(AnnSearchReq.builder()
                .vectorFieldName("metadata_vector")
                .vectors(denseQueryVector)
                .metricType(IndexParam.MetricType.COSINE)
                .params(config.getDenseParam())
                .topK(config.getTopK())
                .build());
        // sparse_vector
        searchRequests.add(AnnSearchReq.builder()
                .vectorFieldName("sparse_vector")
                .vectors(sparseQueryVector)
                .metricType(IndexParam.MetricType.IP)
                .params(config.getSparseParam())
                .topK(config.getTopK() * 2)
                .build());
        //ranker
        BaseRanker reranker = null;
        if (config.weightMode()) {
            reranker = new WeightedRanker(Arrays.asList(config.getDenseWeight(), config.getMetadataWeight(), config.getSparseWeight()));
        } else {
            reranker = new RRFRanker(config.getRrfK());
        }

        //hubirdSearch
        HybridSearchReq hybridSearchReq = HybridSearchReq.builder()
                .collectionName(workspace)
                .searchRequests(searchRequests)
                .ranker(reranker)
                .outFields(List.of("metadata", "text", "id"))
                .topK(config.getTopK())
                .consistencyLevel(ConsistencyLevel.BOUNDED)
                .build();

        SearchResp searchResp = client.hybridSearch(hybridSearchReq);

client side receives the exception log

 error code: 2, reason: incomplete query result, missing id xxxxxxx, len(searchIDs) = 10, len(queryIDs) = 7, collection=456252365239748630: inconsistent requery result

Expected Behavior

No response

Steps To Reproduce

Milvus Log

{"log":"I20250306 14:50:28.923635 32656 thread_pool.h:68] [KNOWHERE][operator()][knowhere_search] Successfully set priority of knowhere thread.\n","stream":"stdout","time":"2025-03-06T06:50:28.923706325Z"}
{"log":"I20250306 14:50:28.923789 32657 thread_pool.h:68] [KNOWHERE][operator()][knowhere_search] Successfully set priority of knowhere thread.\n","stream":"stdout","time":"2025-03-06T06:50:28.923847751Z"}
{"log":"I20250306 14:50:28.923879 32658 thread_pool.h:68] [KNOWHERE][operator()][knowhere_search] Successfully set priority of knowhere thread.\n","stream":"stdout","time":"2025-03-06T06:50:28.9239136Z"}
{"log":"I20250306 14:50:28.924010 32659 thread_pool.h:68] [KNOWHERE][operator()][knowhere_search] Successfully set priority of knowhere thread.\n","stream":"stdout","time":"2025-03-06T06:50:28.92406476Z"}
{"log":"I20250306 14:50:28.924261 32660 thread_pool.h:68] [KNOWHERE][operator()][knowhere_search] Successfully set priority of knowhere thread.\n","stream":"stdout","time":"2025-03-06T06:50:28.92440791Z"}
{"log":"[2025/03/06 14:50:28.924 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221637656] [replicaID=456252365371343237] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.924543563Z"}
{"log":"[2025/03/06 14:50:28.924 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221637656] [replicaID=456252365371343237] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.924547715Z"}
{"log":"I20250306 14:50:28.924484 32661 thread_pool.h:68] [KNOWHERE][operator()][knowhere_search] Successfully set priority of knowhere thread.\n","stream":"stdout","time":"2025-03-06T06:50:28.924549999Z"}
{"log":"[2025/03/06 14:50:28.925 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221658488] [replicaID=456252365371343238] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.925667117Z"}
{"log":"[2025/03/06 14:50:28.925 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221658488] [replicaID=456252365371343238] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.92568869Z"}
{"log":"[2025/03/06 14:50:28.925 +08:00] [WARN] [proxy/task_search.go:767] [\"failed to requery\"] [traceID=1a4158c42033e4d34fffdd6bd71c4e55] [nq=1] [error=\"incomplete query result, missing id  prj_Test-315-1740531584_chunk_0, len(searchIDs) = 10, len(queryIDs) = 7, collection=456252365239748630: inconsistent requery result\"] [errorVerbose=\"incomplete query result, missing id  prj_Test-315-1740531584_chunk_0, len(searchIDs) = 10, len(queryIDs) = 7, collection=456252365239748630: inconsistent requery result\\n(1) attached stack trace\\n  -- stack trace:\\n  | github.com/milvus-io/milvus/pkg/util/merr.WrapErrInconsistentRequery\\n  | \\t/workspace/source/pkg/util/merr/utils.go:1104\\n  | github.com/milvus-io/milvus/internal/proxy.(*searchTask).Requery\\n  | \\t/workspace/source/internal/proxy/task_search.go:941\\n  | github.com/milvus-io/milvus/internal/proxy.(*searchTask).PostExecute\\n  | \\t/workspace/source/internal/proxy/task_search.go:765\\n  | github.com/milvus-io/milvus/internal/proxy.(*taskScheduler).processTask\\n  | \\t/workspace/source/internal/proxy/task_scheduler.go:485\\n  | github.com/milvus-io/milvus/internal/proxy.(*taskScheduler).queryLoop.func1\\n  | \\t/workspace/source/internal/proxy/task_scheduler.go:566\\n  | github.com/milvus-io/milvus/pkg/util/conc.(*Pool[...]).Submit.func1\\n  | \\t/workspace/source/pkg/util/conc/pool.go:82\\n  | github.com/panjf2000/ants/v2.(*goWorker).run.func1\\n  | \\t/go/pkg/mod/github.com/panjf2000/ants/[email protected]/worker.go:67\\n  | runtime.goexit\\n  | \\t/go/pkg/mod/golang.org/[email protected]/src/runtime/asm_amd64.s:1695\\nWraps: (2) incomplete query result, missing id  prj_Test-315-1740531584_chunk_0, len(searchIDs) = 10, len(queryIDs) = 7, collection=456252365239748630\\nWraps: (3) inconsistent requery result\\nError types: (1) *withstack.withStack (2) *errutil.withPrefix (3) merr.milvusError\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.925753354Z"}
{"log":"[2025/03/06 14:50:28.925 +08:00] [WARN] [proxy/task_scheduler.go:488] [\"Failed to post-execute task: \"] [traceID=1a4158c42033e4d34fffdd6bd71c4e55] [error=\"incomplete query result, missing id  prj_Test-315-1740531584_chunk_0, len(searchIDs) = 10, len(queryIDs) = 7, collection=456252365239748630: inconsistent requery result\"] [errorVerbose=\"incomplete query result, missing id  prj_Test-315-1740531584_chunk_0, len(searchIDs) = 10, len(queryIDs) = 7, collection=456252365239748630: inconsistent requery result\\n(1) attached stack trace\\n  -- stack trace:\\n  | github.com/milvus-io/milvus/pkg/util/merr.WrapErrInconsistentRequery\\n  | \\t/workspace/source/pkg/util/merr/utils.go:1104\\n  | github.com/milvus-io/milvus/internal/proxy.(*searchTask).Requery\\n  | \\t/workspace/source/internal/proxy/task_search.go:941\\n  | github.com/milvus-io/milvus/internal/proxy.(*searchTask).PostExecute\\n  | \\t/workspace/source/internal/proxy/task_search.go:765\\n  | github.com/milvus-io/milvus/internal/proxy.(*taskScheduler).processTask\\n  | \\t/workspace/source/internal/proxy/task_scheduler.go:485\\n  | github.com/milvus-io/milvus/internal/proxy.(*taskScheduler).queryLoop.func1\\n  | \\t/workspace/source/internal/proxy/task_scheduler.go:566\\n  | github.com/milvus-io/milvus/pkg/util/conc.(*Pool[...]).Submit.func1\\n  | \\t/workspace/source/pkg/util/conc/pool.go:82\\n  | github.com/panjf2000/ants/v2.(*goWorker).run.func1\\n  | \\t/go/pkg/mod/github.com/panjf2000/ants/[email protected]/worker.go:67\\n  | runtime.goexit\\n  | \\t/go/pkg/mod/golang.org/[email protected]/src/runtime/asm_amd64.s:1695\\nWraps: (2) incomplete query result, missing id  prj_Test-315-1740531584_chunk_0, len(searchIDs) = 10, len(queryIDs) = 7, collection=456252365239748630\\nWraps: (3) inconsistent requery result\\nError types: (1) *withstack.withStack (2) *errutil.withPrefix (3) merr.milvusError\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.925769187Z"}
{"log":"[2025/03/06 14:50:28.925 +08:00] [WARN] [proxy/impl.go:3389] [\"HybridSearch failed to WaitToFinish\"] [traceID=1a4158c42033e4d34fffdd6bd71c4e55] [role=proxy] [db=default] [collection=anythingllm_late_chunking_embedding_all] [partitions=\"[]\"] [OutputFields=\"[metadata,text,id]\"] [ConsistencyLevel=Bounded] [useDefaultConsistency=false] [error=\"incomplete query result, missing id  prj_Test-315-1740531584_chunk_0, len(searchIDs) = 10, len(queryIDs) = 7, collection=456252365239748630: inconsistent requery result\"] [errorVerbose=\"incomplete query result, missing id  prj_Test-315-1740531584_chunk_0, len(searchIDs) = 10, len(queryIDs) = 7, collection=456252365239748630: inconsistent requery result\\n(1) attached stack trace\\n  -- stack trace:\\n  | github.com/milvus-io/milvus/pkg/util/merr.WrapErrInconsistentRequery\\n  | \\t/workspace/source/pkg/util/merr/utils.go:1104\\n  | github.com/milvus-io/milvus/internal/proxy.(*searchTask).Requery\\n  | \\t/workspace/source/internal/proxy/task_search.go:941\\n  | github.com/milvus-io/milvus/internal/proxy.(*searchTask).PostExecute\\n  | \\t/workspace/source/internal/proxy/task_search.go:765\\n  | github.com/milvus-io/milvus/internal/proxy.(*taskScheduler).processTask\\n  | \\t/workspace/source/internal/proxy/task_scheduler.go:485\\n  | github.com/milvus-io/milvus/internal/proxy.(*taskScheduler).queryLoop.func1\\n  | \\t/workspace/source/internal/proxy/task_scheduler.go:566\\n  | github.com/milvus-io/milvus/pkg/util/conc.(*Pool[...]).Submit.func1\\n  | \\t/workspace/source/pkg/util/conc/pool.go:82\\n  | github.com/panjf2000/ants/v2.(*goWorker).run.func1\\n  | \\t/go/pkg/mod/github.com/panjf2000/ants/[email protected]/worker.go:67\\n  | runtime.goexit\\n  | \\t/go/pkg/mod/golang.org/[email protected]/src/runtime/asm_amd64.s:1695\\nWraps: (2) incomplete query result, missing id  prj_Test-315-1740531584_chunk_0, len(searchIDs) = 10, len(queryIDs) = 7, collection=456252365239748630\\nWraps: (3) inconsistent requery result\\nError types: (1) *withstack.withStack (2) *errutil.withPrefix (3) merr.milvusError\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.925801423Z"}
{"log":"[2025/03/06 14:50:28.925 +08:00] [WARN] [retry/retry.go:130] [\"retry func failed\"] [traceID=1a4158c42033e4d34fffdd6bd71c4e55] [retried=0] [error=\"incomplete query result, missing id  prj_Test-315-1740531584_chunk_0, len(searchIDs) = 10, len(queryIDs) = 7, collection=456252365239748630: inconsistent requery result\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.925808586Z"}
{"log":"[2025/03/06 14:50:28.926 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221673483] [replicaID=456252365371343239] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.92660807Z"}
{"log":"[2025/03/06 14:50:28.926 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221673483] [replicaID=456252365371343239] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.926634244Z"}
{"log":"[2025/03/06 14:50:28.927 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221686377] [replicaID=456252365371343240] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.927471157Z"}
{"log":"[2025/03/06 14:50:28.927 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221686377] [replicaID=456252365371343240] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.927498022Z"}
{"log":"[2025/03/06 14:50:28.928 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221756557] [replicaID=456252365371343241] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.928298375Z"}
{"log":"[2025/03/06 14:50:28.928 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221756557] [replicaID=456252365371343241] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.928325015Z"}
{"log":"[2025/03/06 14:50:28.929 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221757211] [replicaID=456252365371343242] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.929124834Z"}
{"log":"[2025/03/06 14:50:28.929 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221757211] [replicaID=456252365371343242] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2104.000000, CurrentScore: 2314.400000, Priority: 210}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.929149886Z"}
{"log":"[2025/03/06 14:50:28.929 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221757865] [replicaID=456252365371343243] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.929945946Z"}
{"log":"[2025/03/06 14:50:28.929 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221757865] [replicaID=456252365371343243] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2100.000000, CurrentScore: 2310.000000, Priority: 210}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.929970886Z"}
{"log":"[2025/03/06 14:50:28.930 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221828890] [replicaID=456252365371343244] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.930769717Z"}
{"log":"[2025/03/06 14:50:28.930 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221828890] [replicaID=456252365371343244] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.930796404Z"}
{"log":"[2025/03/06 14:50:28.931 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221848110] [replicaID=456252365371343245] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.931586648Z"}
{"log":"[2025/03/06 14:50:28.931 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221848110] [replicaID=456252365371343245] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.931610516Z"}
{"log":"[2025/03/06 14:50:28.932 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221874673] [replicaID=456252365371343246] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.932406259Z"}
{"log":"[2025/03/06 14:50:28.932 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221874673] [replicaID=456252365371343246] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2099.000000, CurrentScore: 2308.900000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.932431121Z"}
{"log":"[2025/03/06 14:50:28.933 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221882417] [replicaID=456252365371343247] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.933212697Z"}
{"log":"[2025/03/06 14:50:28.933 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221882417] [replicaID=456252365371343247] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.933236174Z"}
{"log":"[2025/03/06 14:50:28.934 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221916357] [replicaID=456252365371343248] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.934036273Z"}
{"log":"[2025/03/06 14:50:28.934 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221916357] [replicaID=456252365371343248] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.934066562Z"}
{"log":"[2025/03/06 14:50:28.934 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221947165] [replicaID=456252365371343249] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.934864052Z"}
{"log":"[2025/03/06 14:50:28.934 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221947165] [replicaID=456252365371343249] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.934889704Z"}
{"log":"[2025/03/06 14:50:28.935 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221961813] [replicaID=456252365371343250] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.935705952Z"}
{"log":"[2025/03/06 14:50:28.935 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221961813] [replicaID=456252365371343250] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2098.000000, CurrentScore: 2307.800000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.935733251Z"}
{"log":"[2025/03/06 14:50:28.936 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221963067] [replicaID=456252365371343251] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.936543126Z"}
{"log":"[2025/03/06 14:50:28.936 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221963067] [replicaID=456252365371343251] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.936573269Z"}
{"log":"[2025/03/06 14:50:28.937 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221964937] [replicaID=456252365371343252] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.937368529Z"}
{"log":"[2025/03/06 14:50:28.937 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221964937] [replicaID=456252365371343252] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.937391802Z"}
{"log":"[2025/03/06 14:50:28.938 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221970099] [replicaID=456252365371343253] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.938194075Z"}
{"log":"[2025/03/06 14:50:28.938 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221970099] [replicaID=456252365371343253] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2098.000000, CurrentScore: 2307.800000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.938215447Z"}
{"log":"[2025/03/06 14:50:28.939 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365221975085] [replicaID=456252365371343254] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.939027903Z"}
{"log":"[2025/03/06 14:50:28.939 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365221975085] [replicaID=456252365371343254] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.939054621Z"}
{"log":"[2025/03/06 14:50:28.939 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222003943] [replicaID=456252365371343255] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.939822868Z"}
{"log":"[2025/03/06 14:50:28.939 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222003943] [replicaID=456252365371343255] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2099.000000, CurrentScore: 2308.900000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.939843249Z"}
{"log":"[2025/03/06 14:50:28.940 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222005818] [replicaID=456252365371343256] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.940630439Z"}
{"log":"[2025/03/06 14:50:28.940 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222005818] [replicaID=456252365371343256] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.940651825Z"}
{"log":"[2025/03/06 14:50:28.941 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222008929] [replicaID=456252365371343257] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.941448974Z"}
{"log":"[2025/03/06 14:50:28.941 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222008929] [replicaID=456252365371343257] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2099.000000, CurrentScore: 2308.900000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.941470992Z"}
{"log":"[2025/03/06 14:50:28.942 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222049851] [replicaID=456252365371343258] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.942345679Z"}
{"log":"[2025/03/06 14:50:28.942 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222049851] [replicaID=456252365371343258] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.942375251Z"}
{"log":"[2025/03/06 14:50:28.943 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222078087] [replicaID=456252365371343259] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.943253443Z"}
{"log":"[2025/03/06 14:50:28.943 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222078087] [replicaID=456252365371343259] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.943277215Z"}
{"log":"[2025/03/06 14:50:28.944 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222099630] [replicaID=456252365371343260] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.944155091Z"}
{"log":"[2025/03/06 14:50:28.944 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222099630] [replicaID=456252365371343260] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.944178126Z"}
{"log":"[2025/03/06 14:50:28.945 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222101539] [replicaID=456252365371343261] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.945051044Z"}
{"log":"[2025/03/06 14:50:28.945 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222101539] [replicaID=456252365371343261] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.945073162Z"}
{"log":"[2025/03/06 14:50:28.946 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222103426] [replicaID=456252365371343262] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.946524468Z"}
{"log":"[2025/03/06 14:50:28.946 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222103426] [replicaID=456252365371343262] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2098.000000, CurrentScore: 2307.800000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.946575514Z"}
{"log":"[2025/03/06 14:50:28.947 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222145144] [replicaID=456252365371343263] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.947948068Z"}
{"log":"[2025/03/06 14:50:28.947 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222145144] [replicaID=456252365371343263] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.94798002Z"}
{"log":"[2025/03/06 14:50:28.949 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222172899] [replicaID=456252365371343264] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.94921356Z"}
{"log":"[2025/03/06 14:50:28.949 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222172899] [replicaID=456252365371343264] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.949246501Z"}
{"log":"[2025/03/06 14:50:28.950 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222217947] [replicaID=456252365371343265] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.950494533Z"}
{"log":"[2025/03/06 14:50:28.950 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222217947] [replicaID=456252365371343265] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.950535816Z"}
{"log":"[2025/03/06 14:50:28.951 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222246222] [replicaID=456252365371343266] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.951805954Z"}
{"log":"[2025/03/06 14:50:28.951 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222246222] [replicaID=456252365371343266] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.951837773Z"}
{"log":"[2025/03/06 14:50:28.953 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222251846] [replicaID=456252365371343267] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.953066808Z"}
{"log":"[2025/03/06 14:50:28.953 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222251846] [replicaID=456252365371343267] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.953097709Z"}
{"log":"[2025/03/06 14:50:28.954 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222265646] [replicaID=456252365371343268] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.95430529Z"}
{"log":"[2025/03/06 14:50:28.954 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222265646] [replicaID=456252365371343268] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.954337123Z"}
{"log":"[2025/03/06 14:50:28.955 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222271295] [replicaID=456252365371343269] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.955550323Z"}
{"log":"[2025/03/06 14:50:28.955 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222271295] [replicaID=456252365371343269] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.955581313Z"}
{"log":"[2025/03/06 14:50:28.956 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222291595] [replicaID=456252365371343270] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.956800513Z"}
{"log":"[2025/03/06 14:50:28.956 +08:00] [INFO] [balance/score_based_balancer.go:514] [\"node segment workload status\"] [collectionID=456252365222291595] [replicaID=456252365371343270] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2097.000000, CurrentScore: 2306.700000, Priority: 209}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.956831098Z"}
{"log":"[2025/03/06 14:50:28.957 +08:00] [INFO] [balance/score_based_balancer.go:582] [\"node channel workload status\"] [collectionID=456252365222307600] [replicaID=456252365371343271] [nodes=\"[\\\"{NodeID: 10, AssignedScore: 2316.000000, CurrentScore: 2316.000000, Priority: 0}\\\"]\"]\n","stream":"stdout","time":"2025-03-06T06:50:28.95774046Z"}

Anything else?

No response

The text was updated successfully, but these errors were encountered:

dosubot · 2025-03-06T07:13:11Z

Hey @vanga999, I'm here to help you out with any bugs, questions, or contributions you have in mind. Let's get to the bottom of this issue together!

I found a similar open issue related to the error you're encountering. The issue is titled "[Bug]: [benchmark][cluster] hybrid_search raises error incomplete query result, missing id %!s(int64=0), len(searchIDs) = 100, len(queryIDs) = 99, collection=***: inconsistent requery result in concurrent DML & DQL scene" ^[1].

The root cause of this issue was identified as a two-step execution of the Hybrid search. The Hybrid search task is separated into two major steps:

Execute each sub-search (returning only primary keys) and rerank.
Query other output fields data.

During the execution, if there are updates such as deletions or compactions between these two steps, it can lead to inconsistent query results. This was observed in a problematic request where the search step and the query step were separated by a significant time, during which updates occurred, causing the error. A fix is being worked on by the team, as mentioned by a contributor ^[2].

Additionally, the Requery function in Milvus is designed to handle cases where vector fields are requested as part of the search results. It constructs a new query request to fetch the necessary vector data based on the primary keys of the initial search results and ensures that the order of the results is maintained ^[3].

You might want to check if there are any updates or patches available for your version that address this issue.

To continue talking to Dosu, mention @dosu.

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}

yanliang567 · 2025-03-06T07:19:32Z

@vanga999 please upgrade Milvus to v2.5.5, I believe we have fixed this issue in v2.5.4 and later.

/assign @vanga999
/unassign

vanga999 added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Mar 6, 2025

vanga999 assigned yanliang567 Mar 6, 2025

sre-ci-robot assigned vanga999 and unassigned yanliang567 Mar 6, 2025

yanliang567 added triage/needs-information Indicates an issue needs more information in order to work on it. and removed needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Mar 6, 2025

congqixia mentioned this issue Mar 6, 2025

[Bug]: query error #38831

Closed

1 task

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Bug]: error code: 2, reason: incomplete query result, missing id xxxxxx, len(searchIDs) = 10, len(queryIDs) = 9, collection=456252365239748630: inconsistent requery result #40412

[Bug]: error code: 2, reason: incomplete query result, missing id xxxxxx, len(searchIDs) = 10, len(queryIDs) = 9, collection=456252365239748630: inconsistent requery result #40412

vanga999 commented Mar 6, 2025

dosubot bot commented Mar 6, 2025

yanliang567 commented Mar 6, 2025

[Bug]: error code: 2, reason: incomplete query result, missing id xxxxxx, len(searchIDs) = 10, len(queryIDs) = 9, collection=456252365239748630: inconsistent requery result #40412

[Bug]: error code: 2, reason: incomplete query result, missing id xxxxxx, len(searchIDs) = 10, len(queryIDs) = 9, collection=456252365239748630: inconsistent requery result #40412

Comments

vanga999 commented Mar 6, 2025

Is there an existing issue for this?

Environment

Current Behavior

Expected Behavior

Steps To Reproduce

Milvus Log

Anything else?

dosubot bot commented Mar 6, 2025

yanliang567 commented Mar 6, 2025