...
For the Squirro SmartFilters to produce accurate results, a list of term frequency of all documents in your various indexes has to be maintained.
This is called GDF or Global Document Frequency . or GDFS
Squirro offers a good starting GDF set for all supported languages.
...