Indexing Accent Characters

Great. Thanks Rob .

Harsh , could you please share a similar screenshot of what current setting are enabled on the FTS dtSearch within current application?

Thanks,

Morgan 

Hi Harsh ,

Following-up on below, could you provide a screenshot showing the current setting on the FTS dtSearch?

Thanks,

Morgan

Morgan / Harsh , Please send a few sample documents with foreign language diacritics for testing purposes.

Hi Rob ,

Sure, I'll run a few tests on the FTS and share the results.

Morgan

Hi everyone,

I performed a few tests with the FTS within the existing application, and the video below summarizes the results. The results are exactly what I'd like to see, so when Harsh confirms what settings are enabled for dtSearch within the existing FTS, let's ensure the same settings are enabled for all dtSearches within the new application.

Thanks,

Morgan

dtSearch results within existing application (27-Oct-20).mp4 9.43 MB • Download

Hi Rob ,

As per your above screenshot, We need to check checkbox while we are going to create new indexes. But, we have already generated the indexing.

How can we check now that checkbox is enabled or not ?

Radomir has access of our server (10.68.138.10). so could you please check on your end on server for these 2 indexes that checkbox is enable or not ?

DTSearchIndexs.png 102 KB • Download

Harsh , you can do a quick check in dtSearch Desktop. Look at the indexed terms in the Word Wheel. Or, do some sample searches with and without accents. 

Hi Harsh ,

As a first step, could you please provide the screenshot of what the settings are in the current ISLG application (not the new application). I believe the screenshot above is for the new application.

Also, I believe the settings you're looking for are within Create Index (Advanced)... based on Rob screenshot above:

image.png 215 KB • Download

Thanks,

Morgan

Hi Morgan ,

The above screenshot for existing ISLG application. For New ILG, We are not using DTSearch Desktop.

Rob , We are not getting that where we find Index Termed in Word Wheel. Could you provide step or Screenshot to how to check in DTSearch Desktop ?

Please take note that We have already generated Indexing. IF we will go to generate new index then we can able to see checkbox. but, how will check the accent character checkbox is enable or not in already created indexed.

Hi Harsh , let us check your config files and get back to you. 

Hi Harsh ,
Could you please send us files history.ix and indexlog.dat from the existing FTS index folder?
In these files we can see API options corresponding to the options in UI mentioned by Rob. What's of our interest here is the presence of dtsIndexCreateAccentSensitive and dtsIndexCreateOptionalAccentSensitive options in the "IndexingFlags" line.
Thanks.

As of changing the checkbox state for already created index, I think that's not possible because this options affects how terms are stored in the index - changing the option for an existing index would result in search-time issues (documents not found or false positives).

Hi Radomir ,

Here, I have attached history and indexlog.dat files from existing FTS indexing files.

We need to just confirm that Accent-Sensitive checkbox is enable or not for currently existing FTS indexing.

history.ix 5.42 KB • Download

indexlog.dat 5.68 KB • Download

As far as I can see, accent-sensitive option was not enabled for the old FTS. As search worked as desired, we don't need to enable these options in new indexes. (We can easily enable them later.)