We have improved the performance of the Search Highlighting. We have achieved this by
Computing the fragment size dynamically based on highlightable query-term length.
Changing the default highlighter type to use Elastic's new default unified highlighter that brings up to 10x faster highlighting compared to previous default to fvh. In case of any discrepancies, it is possible to revert back to the old highlighter.
We have added a new sales insight pipelet which creates the insight cards based on a company's sentiment score. We compute this sentiment score by aggregating sentiments across all the items associated to that company.
We have switched to a new and more robust HTML extractor by default for our indexing and NLP processing steps.
We have splitted our Salesforce connector split into a Salesforce sales cloud connector and a Salesforce service cloud connector for a more intuitive user experience.
We have also introduced now a Microsoft Sharepoint connector. This functionality was previously available in the Microsoft Onedrive connector. Sharepoint data is no longer part of the Onedrive connector.
We have added initial ground work for rerunning a pipeline workflow from indexed data. This feature will be usable from our Squirro Frontend in the upcoming releases.
We have added language to layer visibility conditions.
We have improved the query parsing for content-based typeahead (RegexQueryParser). This now handles the phrases and non-word characters in facet-values.
We have also been working on improving the support of proximity rules in our AI studio. This would be made available in an upcoming release.
Pipelets which were part of existing Pipeline Workflows during the upgrade to 3.2.10 will display a configuration text area widget on the new Pipeline Editor (something that was happening only for newly added pipelets).
AIS: Load text for detailed validation screen directly from elastic search to unload database.
We now set the number of items to 0 for trending communities if there are no items in that community in our Newsletters.
The Starred items are now returned with the starred flag also on the "For You" Dashboard of Cognitive Search.
Filebeat config now points to correct elastic URI. This was broken in the previous releases. Also, Filebeat is disabled by default.
NLP docs have also been rebuilt again and reflect the latest documentation of all the newly added steps.
1-click connectors now include a source_type facet by default.
We don't highlight words in an already highlighted sentence on PDFs.
Cards Widget vertical mode: We no longer group items if the property Group by Date is disabled in the widget settings.
Project welcome screen no longer shows up after dismissing it.
Projects without dashboards can now be accessed again.
Fixed cancel action on disabled add data modal.
Fixed Explore screen not loading right after empty project creation.
Makes sure all sorting options in Sort by panel are exposed and translated.
We have improved the loading performance for the validation screen in AI Studio.
Pipeline clone should work now as expected.
Make query conditions "equal" and "not equal" consistent when it comes to handling parenthesis.
The configuration option item_transformation_in_pipeline in section pipeline of /etc/squirro/common.ini has been changed from false to true in this release. Some blocking issues have been observed with the ingestion of data that are being loaded with 1-click connectors (e.g. Confluence, Salesforce Sales Cloud) now that this option is enabled by default. If you experience data ingestion issues while using this release, please try the following steps:
Open the /etc/squirro/common.ini file and change the option item_transformation_in_pipeline in the pipeline section from true to false.
Restart the following Squirro services:
systemctl restart sqdatasourced
systemctl restart sqingesterd
selectolax – Used for HTML Extraction
You will have to resolve at least the following config files when upgrading from Squirro 3.3.0
/etc/nginx/conf.d/ssl.inc
/etc/squirro/common.ini
For new installations please follow the Setup on Linux instructions.
To upgrade an existing installation, please consult the Upgrades for Squirro 3.2.0 and later guide.