Versions Compared

Old Version 7

changes.mady.by.user Tzanetos Balitsaris

Saved on

compared with

New Version Current

changes.mady.by.user Nathan Gosse

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents

What’s New

Squirro Monitoring This page can now be selected from the Application Setup screen.

...

Highlights of Squirro Monitoring features and improvements include:

  • An out of the box Activity Tracking dashboard with a plethora of statistics to gain visibility into users' activity.

...

  • Added user activity logs for Question Answering (QA) and SimilarSearches widgets.

  • Exposed configuration options in the Activity Tracking step to dynamically enrich activity logs with specified User Data. Information is then stored in labels within the Monitoring Project.

  • An updated Data ingestion Logs dashboard with:

    • Display names for facets, and a few new facets: Step Name, Step Execution Mode, Successful Items, and Errored Items.

    • Step Duration is now displayed in milliseconds.

    • Two metrics widgets for number of logs and number of errors.

    • Start and finish messages of pipeline steps are now more descriptive.

    • When an error occurs from a built-in step executed in the ingester service, a stack trace is included in the body.

...

Improvements

  • Added logic to augment community data using external sources.

  • Now a loading bar is shown during the collection fetch of React widgets.

  • Added pagination to community subscriptions.

  • Aggregations communities collection factory is now exposed for custom widgets API.

  • Added visibility conditions to the Global Search state (NLP Search / is empty / is not empty).

  • Changed the Lets Go button in the Communities Widget to show on left.

  • Now the filesystem_plugin has better MIME type detection and will include the body field for text documents.

  • Set up proper project type for automatically created monitoring projects via the newly exposed project type parameter in the topic API.

  • Enhanced context search across all dashboards.

  • The CommunitiesList widget was migrated to React from Backbone.js.

  • Improvements to the Items detail SidePanel hide and show logic.

  • New React Custom Widget documentation added to the Squirro Docs site.

  • Added searchable and visible properties when creating and modifying dashboards.

  • Improved React widgets performance and optimized collection fetching.

  • Now ES_TMPDIR allows you specify the default temp directory within the Elasticsearch config file.

  • Rewrite the SaveQuery and Share dialogs to React.

  • Rewrite the Actions widget to React.

  • [Document level feedback] Restore icons on document keywords instead of highlights.

  • Add 'More button dropdown' mode to Actions widget.

  • Include active dashboard query in Global Search typeahead suggestion query.

  • Add 'Share' and 'Save to Excel' options to Actions widget.

  • [Search] Add documentation for content-based typeahead configuration.

  • [Search] Multi-word-matching: Expose shortcut project-configuration.

  • [Search] Popular Query Typeahead: Enable config to match on user's dashboard filter, or match on all popular queries without using the provided filter_query.

  • [Search] Introduced an optional synonym-health-check that fixes projects with an invalid synonym configuration. The check is enabled per default and runs on topic-service start time (closes & re-opens affected project's elasticsearch indices to apply setting changes). The check can get disabled via the server-configuration topic.search.run-synonym-health-check.

  • [Frontend] Use font file for icons instead of importing them to decrease build size.

  • Button for Excel Export action in ActionsWidget is disabled when there are no items to export.

  • Add pagination to the Following list of communities.

  • [Security] Updated packaged cryptography pkg (fixes CVE-2022-3602 and CVE-2022-3786).

Bug Fixes

  • Fixed a bottom padding issue for the Items widget.

  • Fixed functionality issues with the carousel layer mode.

  • Fixed an issue with tags not displaying in the Items widget cards.

  • Changed default from none to a specified config value for fetching community subscriptions from the topicproxy service.

  • Fixed a bug that prevented Item detail SidePanel from showing when entities are disabled.

  • Fixed a typo in the overridden post method that led to a 404 error in the Figma data loader plugin.

  • Fixed a display issues with chips. The text in the chips is now ellipsed when it is too long, the chip height is set to 24px, and the chips are left-aligned to the Filters header text.

  • Failing individual import steps no longer cause the import process to break.

  • Fixed an issue with the arrow breaking in horizontal mode in global search.

  • Now labels placeholder in an item’s details are hidden when there are no labels to display.

  • Added additional logic to the import dashboard role for community 360 from project templates.

  • Fixed validation error messaging for pipeline workflows with duplicated ML models.

  • Fixed an issue with importing projects from the Create Project dialog box where the imported project also had a project description.

  • Fixed an issue with match-any-word order in the AI Studio Ground Truth view.

  • Now communities_count and communities_item_count for newsletter use the same default config as specified under the newsletter section.

  • Fixed an issue with fingerprint service folder permissions.

  • Stabilisation: Don't break project reset when incorrect Synonym config is around (DB not in sync with Index).

  • SpacyNormalizer: Disable wrong cache handling (pickling) of SpaCy documents (very slow).

  • Enable "View All" button for horizontal mode only for these wisgets: Items, Community List, Community Item, and Favorite Filters.

  • [Search] Lemmatised search works now correctly together with part-of-speech based term boosting.

  • Fix squirro-cluster-node installation erroring out on secure.sh script.

  • Don't show facets suggestions if facet is non typeaheadable.

  • Removed the styling coming from item detail placeholder and removed the unnecessary boxShadow which does not exist in design.

  • Global Search: In page search detection stops working after switching spaces.

  • Fix dashboard more button, jumping on loading and being mispositioned.

  • Fix deserialization of automatically serialized datetime objects in items from data loaders.

  • Fix issues with Items widget border stying in vertical list mode.

  • Disable concept search if global search is not enabled for this project.

  • Remove "View all" button from the widget header of certain widgets. If in the widget properties it is not possible to define the behavior of the "View All" button, then the value of showViewAll is undefined. When this is the case, the button is now not shown anymore.

  • Fix left alignment of widgets inside layers in accordion mode. I modified the padding for the collapsible-body class. Additionally the predQueryWidget.less needed a minor change to make it consistent with other widgets.

  • Fix bug where after a Synonym deletion, the table is not updated.

  • Fix styling of carousel mode layers, carousel top bar.

  • Fix pipeline step rerun to work with all queries.

  • Fix Items widget side panel styling issues.

  • Adjust Horizontal Tabs styles.

  • Fixes Groups not rerendering on user addition.

  • Rework pinned scrolling on dashboard right panel.

  • [Search] Query Endpoint (Items Widget): Use the mapped (possible custom) summary to create the item-preview again (in case that no highlighted matches are present).

  • Timeline selection filter not aligned in Reset Filters widget. Add time-selection class to timeline selection filter element and add rule for padding to widget.less.

  • Fixes Community List Horizontal scroll.

  • Added newsletter config to digestmailer.

  • Fix size of compact searchbar and align tabs to the right.

  • [Search] Query Processing: don't perform part-of-speech (POS) based query transformation if the query is too short. Introduced new setting on the POSBooster step min_query_length.

  • Fixed a bug that caused endless item to fetch inside the focus view in AI Studio labeling.

  • Communities List not showing followed Communities.

  • Fix react widgets don't re-fetch data after dashboard layer visibility change.

  • Fix item detail highlights not showing for non pdf items in react.

  • Reflect following state on community banner widget after interacting.

  • [Items Widget] Fix widget header styling with "disable card styling" mode enabled.

  • Fixes blank modal when title is undefined.

  • Visualise tab: Space between dashboard tab columns missing, column headers wrong.

  • Fix Squirro systemd services not being enabled after install.

  • Fix Date format "learn more" link: replace --brand-color with --highlight-color.

  • Fixed the margin and height of global search chips.

  • Never show explain icon (light bulb) in the item detail view of the Items widget.

Breaking Changes

  • Implemented pagination to the community subscription endpoint. The default API call will no longer return all subscribed communities.

  • Upgraded squirro-platform to work with Elasticsearch 7.17.6. This requires an Elasticsearch upgrade. This is covered below in the upgrade instructions.

  • Removed the gdfs_plugin package as it is no longer used.

  • [Search] More precise default search settings for keyword queries topic.search.query-strategy#term_sequence. For a query with up to 3 tokens all terms have to match in a document, for longer queries only 75% have to match. Note: Default setting changes are not automatically applied on your project configuration in case the setting was already changed before manually (customized settings overrule default settings).

  • [Search] Document embedding used in similar searches widget is now disabled by default. To enable document embedding, check the topic.search.document-embedder-queries-workflow-enabled option in the project configuration.

  • [Search] Query processing is now disabled per default. To enable query processing, check the topic.search.query-workflow-enabled option in the project configuration. (Query processing is required for the following features: language specific spell-checking; lemmatised search; question answering; removal of non relevant query terms).

  • [Search] Multi-word-matching: Changed default scoring mode to more robust cross-fields.

  • Add ES_TMPDIR to the ES config file.

Installation and Upgrade

You will have to resolve at least the following config files when upgrading from Squirro 3.3.0

  • /etc/nginx/conf.d/ssl.inc

  • /etc/squirro/common.ini

For new installations, please follow the Setup on Linux instructions.

To upgrade an existing installation, please consult the Upgrades for Squirro 3.5.3 and later guidefound at 3.6.6 Release Notes on the Squirro Docs site.