Versions Compared

Old Version 79

changes.mady.by.user Felix Hürlimann

Saved on

compared with

New Version Current

changes.mady.by.user Saurabh Jain

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Excerpt

We're excited to announce Squirro 2.6.3, released on January 22nd 2019.


Warning
titleKnown upgrade limitations:
  • If you are using custom widgets based on the horizontal result widget in one of your projects, do not update to 2.6.3 yet, but please contact support. to clarify required steps.

Contents -What's in the release?

Table of Contents
minLevel2
excludeContents

New Features

...

New libNLP steps and features

  • Query multiple Squirro instances in Squirro query loader
  • Threshold filter step for predicted facet
  • Squirro entity filter to create Squirro entities
  • Tracking facet to record which model has been applied
  • Smartfilter classifier
  • Regex filter

Return of "Import Project" Functionality

...

Expand
titleClick here to see all deprecated and modified python client methods ...


Class / Method Signature 2.6.2 (old)Signature 2.6.3 (new)Note
ItemUploader(..., processing_config=None, ... , object_id=None, ... , source_secret=None, ..., )ItemUploader(...)
  • object_id is deprecated and no longer needed
  • source_secret is deprecated and will be ignored
  • processing_config is deprecated and will be ignored
DocumentUploader(..., processing_config=None, ... )DocumentUploader(...)
  • processing_config is deprecated and will be ignored
delete_item(project_id, item_id, object_ids=None)delete_item(project_id, item_id)object_ids is no longer supported as input parameter
get_enrichment(project_id, enrichment_id, type=None)get_enrichment(project_id, enrichment_id)type is no longer supported as input parameter
update_enrichment(project_id, enrichment_id, type, name, config)update_enrichment(project_id, enrichment_id, name, config)type is no longer supported as input parameter
get_preview(project_id, provider, config)get_preview(project_id, config)provider is no longer supported as input parameter
get_entities_properties(project_id)get_entities_properties(project_id, query=None)New parameter query to filter entities
n.a.get_machinelearning_workflow_assets(project_id, ml_workflow_id,New method to return all binary assets like trained models associated with a ML workflow.
n.a.run_machinelearning_job(project_id, ml_workflow_id, ml_job_id)New method to schedule a machine learning job to run now
get_user_objects(...)n.a.deprecated
get_object(project_id, object_id)n.a.deprecated
new_object(...)n.a.deprecated
modify_object(...)n.a.deprecated
delete_object(...)n.a.deprecated
pause_object(...)n.a.deprecated
resume_object(...)n.a.deprecated
get_object_signals(...)n.a.deprecated
update_object_signals(...)n.a.deprecated
export_project(..., export_sources_dataloaders=True, ...)export_project(..., export_sources_dataloader_plugins=True, ...)parameter export_sources_dataloaders is now called export_sources_dataloader_plugins
n.a.import_project(...)New method to import parts or all configuration or metadata of a project
get_project_smartfilter_scores(project_id, tags, object_id=None, fields=None)get_project_smartfilter_scores(project_id, tags, fields=None)Parameter object_id is deprecated
get_object_subscriptions(...)get_sources(project_id, include_config=None, include_run_stats=None)deprecated, use get_sources instead
get_subscription(...)get_source(project_id, source_id, include_config=None, include_run_stats=None)deprecated, use get_source instead
new_subscription(...)new_source(project_id, name, config, scheduling_options, pipeline_workflow_id=None, source_id=None)deprecated, use new_source instead
modify_subscription(...)modify_source(project_id, source_id, name=None, config=None, scheduling_options=None, pipeline_workflow_id=None)deprecated, use modify_source instead
delete_subscription(...)delete_source(project_id, source_id)deprecated, use delete_source instead
pause_subscription(...)pause_source(project_id, source_id)deprecated, use pause_source instead
resume_subscription(...)resume_source(project_id, source_id)deprecated, use resume_source instead
n.a.run_source(project_id, source_id)New method to run a source now
n.a.reset_source(project_id, source_id, delete_source_data=None)New method to reset and run a source now


...

Added on February 18, 2019 (build 232 - patch 5-11)

  • Fix load more in result list.
  • Fix metric widget cutoff.
  • Fix HTTP method for pipeline workflow moving.
  • Force validation via docstring Parameters in libNLP.
  • Fix result list in explore screen.
  • Ensure detail event on cards widget.
  • Fix name scoping of keys in KV cache/store in DL plugins.
  • Don't open edit mode when passing dash params.
  • Speed up weighted keyword aggregations.
  • Detach frozen widgets collections.
  • Allow disabling of job locking by cli dataloader.
  • Tune scheduler settings for datasource.
  • Add force_cache_clear for item updates.
  • Move ML job runs into a separate process (sqml).
  • Optional mode selection for libNLP steps. Allow renaming of entity property values.
  • Remove linkedinservice.
  • Improve group members loading performance by improving sql joins.
  • Fix ES migration for empty projects and Squirro's filter index.
  • More fair scheduling of sources by Ingester (Processes one batch of each source at a time).
  • Added a copy filter in libNLP for name spacing.
  • Migrate types to type in ML workflows. Catch validation errors before ML job runs.
  • Fix bug where entities are no longer showing in explore view.
  • Annotation workbench fixes.
  • Scheduler fixes.
  • Add tracking property to entities.
  • Fixes for parallel sections in ML workflows.

Added on February 21, 2019 (build 234 - patch 12)

  • Fix force_cache_clear for modify_items

Added on March 4, 2019 (build 236 - patch 13)

  • Add config options to rename axis labels
  • Item detail widget title aligned with star icon
  • Cards widget: Apply card style only to the header
  • Item Detail widget: Have option to configure pre-defined tags
  • Show item title in two lines if needed
  • Ability to sort facet values
  • More robust scheduling policies for ingester
  • Fix dashboard save
  • Improve dashboards print
  • Fix mobile dashboard bottom widget cut off
  • Fix item detail widget padding on mobile
  • Open in place for cards widget
  • Hide space changer until permissions load
  • Breadcrumbs widget doesnt display query from tab (bookmark) widget
  • Fixing typeahead overflow
  • Improved default time bucketing for line charts and time aggregations

Added on March 5, 2019 (build 237 - patch 14)

  • Add feed plugin by default to globally shipped plugins

Added on March 11, 2019 (build 239 - patch 15)

  • Fix broken sdk on Squirro servers.
  • Fix ingester bug where sources with empty pipelet config will not be processed.
  • Support select on non created-at facets in timeline.
  • Isolate materialize navs and subnavs.

Added on March 12, 2019 (build 240 - patch 16)

  • Fix ingester bug where sources with empty pipelet config will not be processed.

Added on March 12, 2019 (build 242 - patch 17)

  • Fix an issue with dashboards throwing occasional error

Added on March 13, 2019 (build 243 - patch 18)

  • Fix an issue with smartfilter upload

Added on March 15, 2019 (build 244 - patch 19)

  • Item detail widget store controlled fails to show item if not in collection
  • Do not export data checkpoints when exporting ML Models

Added on March 20, 2019 (build 245 - patch 20)

  • Fix an issue config file encryption in a cluster setup.

Added on March 25, 2019 (build 247 - patch 21)

  • Fix an issue with deduplicating items caused by the source refactoring.

Added on March 26, 2019 (build 248 - patch 22)

  • Fix another issue with deduplicating items caused by the source refactoring.

Added on March 31, 2019 (build 249 - patch 23)

  • Update link for downloading fasttext language detection model
  • Fix project import/export on IE
  • Improve ES query for many duplicates

Added on March 31, 2019 (build 249 - patch 23)

  • Typeahead fixes
    • Facet name suggestions in typeahead results are now alphabetically sorted.
    • Properly quote typeahead suggestions to generate a valid Squirro query if the typeahead suggestions contain special characters (like parantheses)
  • Alphabetical sorting of facet values on dashboards.


...

Installation & Upgrade

Fresh Installation Instructions

...

Warning

Please ensure that your current version is 2.6.2. If you are on a version older than 2.6.2, please contact support.


Note

Due to the source and provider framework refactoring the update instructions are more involved than usual. Please make sure you follow each step in the update instructions carefully.
During the upgrade some of the data in elasticsearch will be modified. This leads to a temporary increase of disk space use. Please ensure that you have enough free disks space available before you commence.

The default location of the index files is: /var/lib/elasticsearch

In this example the overall index size is 28 GB:

Code Block
languagetext
# du -sch /var/lib/elasticsearch/
28G	/var/lib/elasticsearch/
28G	total

For the migration to succeed, we recommend you ensure you have at least another 28 GB of free disk space available.

...