Milvus query failing with text having \n or % or any other special characters

[karthikeyan-balu]

• we are using pymilvus library in python to connect to milvus and perform some operations. so whenever we query some text which is having text with special, milvus is throwing, saying invalid expression for the query.

how to solve this issue ?

[yhmo]

Could you show your query expression?

[aladeen57]

Hello,
I'm currently having the same issue, I'm trying to query with prefix filtering, but also have "%" in my expression. Milvus thinks i'm trying to do prefix and suffix, even with using "\" before the "%" in the middle of the expression.
When I don't have any "%" in the expression besides the one at the end to do prefix filtering it works perfectly.

Maybe a fix has been done since then, any news ? I'm not able to find any solution on the documentation.

[xiaofan-luan]

you need to escape %.
search for %a you get aa,ba,%a
search for %a you will only get "%a"

[yhmo]

@aladeen57
Could you show your expressions?

[aladeen57]

@xiaofan-luan Thanks for the reply, I'm sorry but I didn't get what you meant by escape %. I also don't understand the difference between your two examples, which also seem to be suffixes.

@yhmo Here are my current tries that don't work :

First exemple of query expression :
field1== 'XXXX' and field2== 'XXXX' and field3 like "{\"h2\": \"Performance sur 5 ans +33,9% +29,7% +6,2% -9,5% -1,53%\"%"

associated error :
pymilvus.decorators - ERROR - RPC error: [query], <MilvusException: (code=65535, message=cannot parse expression: field1== 'XXXX' and field2== 'XXXX' and field3 like "{\"h2\": \"Performance sur 5 ans +33,9% +29,7% +6,2% -9,5% -1,53%\"%" error: unsupported pattern: {\"h2\": \"Performance sur 5 ans +33,9% +29,7% +6,2% -9,5% -1,53%\"%, only prefix pattern match like ab% and equal match like ab(no wildcards) are supported)>

second exemple of query expression :
same as first exemple but with \ or \ in front my intermediat "%" (in this exemple only one )
field1== 'XXXX' and field2== 'XXXX' and field3 like "{\"h2\": \"Performance sur 5 ans +33,9\% +29,7\% +6,2\% -9,5\% -1,53\%\"%"

associated error :
no error but query doesn't work I don't have any match altho I'm sure there should be (I used this query and have results : field1== 'XXXX' and field2== 'XXXX' and field3 like "{\"h2\": \"Performance %", same prefix query but without the intermediate %).

[xiaofan-luan]

you have to use a ="99.9%" or "a like "99.9%""

[xiaofan-luan]

% is a wildcard match token, if you do want a real %, you need to add \ as escape before it