Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Note

With Squirro 3.3.9 the support for Microsoft's Internet Explorer has been dropped. This is in line with Microsoft’s own developments of not supporting Internet Explorer anymore. See System Requirements for the currently supported clients.

...

  • A high-quality rule-based sentiment tagger, optimized for social media or domains like editorials, movie reviews, and product reviews. This is available as part of the NLP Tagger.

  • Pre-trained models such as FinBERT or DistilBERT can be used in libnlp. See specifically the BERTSentiment classifier.

  • An AI Studio model template which can be used to train models specialized for sentiment analysis.

...

On the libnlp level, the PdfSentencesTokenizer extracts the required information from PDF files, and the SquirroEntityFilter has been extended to be able to extract sentences from PDF documents.

Insight generation

The Insights Generator /wiki/spaces/WIP/pages/2630845842 data connector is exposed in the new Data Analytics category when creating data sources. The Insights Generator data connector is used to run a pipeline workflow, containing the Insights Generator /wiki/spaces/WIP/pages/2630845842Pipelet, periodically to analyze and store insights on already indexed data.

...

Pipeline rerunning

We have added Pipeline rerunning capability of a pipeline workflow on previously indexed data.

...

Configuration service for easy configuration of advanced settings through the user interface. See Configuration service for details.

Breaking and High-Impact Changes

  • Internet Explorer (IE) is no longer supported.

  • Query templates have been changed. They are now appended to the query instead of modifying the query string. If you have existing query templates, they will need to be adjusted. See Query Templates for details.

  • We have split the Salesforce connector into a Salesforce sales cloud connector and a Salesforce service cloud connector for a more intuitive user experience. The two connectors have a different 1-click default configuration. Existing configurations are not impacted by this.

  • The Microsoft SharePoint connector has been split out from the Microsoft OneDrive connector. SharePoint data is no longer loaded as part of the OneDrive connector.

  • The default value configuration option item_transformation_in_pipeline in section pipeline of /etc/squirro/common.ini has been changed from false to true in this release. Please ensure that this value is also set to that value on your installations, to ensure the Pipeline rerunning functionality works.

  • The Content Standardization step has been split into 3 steps: Sanitize HTML, Remove HTML and Content Standardization. The existing configurations should automatically be migrated when updating.

...

  • We have switched to a new and more robust HTML extractor by default for our indexing and NLP processing steps.

  • NLP Tagger improvements:

    • Performance improvement for big PDFs by processing only a subset of pages.

    • Allow usage of not installed / custom SpaCy language models.

    • Add a simple Topic Tagger based on key-phrase de-duplication and more aggressive cleaning.

    • Add a term/phrase filter step to exclude unwanted Named-Entities or Sentiment-Terms.

    • Extend text-cleaning to remove Emails & HTTP-Links.

...

  • Removed the demo user type.

  • Introduce a feature flag for the Content-Security-Policy header. This can be used to prevent Squirro from being embedded as an iFrame and introduces other security improvements. See the Squirro Secure Config Guide for more information.

  • Query templates have been changed to always be added to the user’s query, rather than overwriting it. This increases security as it reduces the potential for introducing query-rewriting attacks.

...

This lists above lists only the most important bug fixes since the previous LTS release. All the other bug fixes can be found in the intermediate release notes since 3.2.11:

Installation and Upgrading

For new installations please follow the Setup on Linux instructions.

To upgrade an existing installation, please consult the Upgrades for Squirro 3.2.0 and later guide.