New Features

• Dashboard:

  • Introduction of custom widgets. See Dashboard Custom Widgets API for a detailed descriptions and examples on how to use it.

• Include data loader in Squirro toolbox

Improvements

• Search bar alignment and buttons improved

• Better HTTP and object cache management

• Generate a stable item identifier to improve bulk loading

• Remove Save option from Search Bar widget

• Remove foreground limit for significant terms widget

Bug Fixes

• Fix sub items view in dashboard modal view

• Set correct item creation date for bulk loading

• Fix double quotes handling in facet values

• Fix highlighting for proximity searches

• Fix field search for language specific fields (e.g. title or body)

• Use correct facets for heat-map facet value formatting

Updates

• Updated Elasticsearch to version 2.2

Fresh Installation Instructions

When you follow the installation steps, please perform the following while you install the storage node. After you install the storage node, but before you bring up Elastic Search, do the following:

For a fresh installation on a single node, the number_of_shards and number_of_replicas need to be adjusted to the /etc/elasticsearch/elasticsearch.yml configuration file:

# set number of shards to two
root$ echo index.number_of_shards: 2 >> /etc/elasticsearch/elasticsearch.yml

# set number of replicas to zero for single-node squirro setup
root$ echo index.number_of_replicas: 0 >> /etc/elasticsearch/elasticsearch.yml

In addition for fresh installations the following four elasticsearch related permissions need to be set manually like so:

root$ chmod 644 /etc/elasticsearch/elasticsearch.yml
root$ chmod 644 /etc/elasticsearch/logging.yml
root$ chown elastic:elastic /var/lib/elasticsearch
root$ chown elastic:elastic /var/log/elasticsearch
root$ chown elastic:elastic /var/run/elasticsearch

These issues will be addressed with the upcoming release 2.3.3 .

Upgrade Instructions

root$ monit stop sqclusterd

root$ rpm -Uvh --nodeps $(repoquery --location squirro-elasticsearch-templates)

root$ rpm -Uvh --nodeps $(repoquery --location elasticsearch)

warning: /etc/elasticsearch/elasticsearch.yml created as /etc/elasticsearch/elasticsearch.yml.rpmnew
warning: /etc/init.d/elasticsearch created as /etc/init.d/elasticsearch.rpmnew
warning: /etc/sysconfig/elasticsearch created as /etc/sysconfig/elasticsearch.rpmnew
warning: /usr/lib/systemd/system/elasticsearch.service created as /usr/lib/systemd/system/elasticsearch.service.rpmnew

network.bind_host: _eth0_,127.0.0.1
network.publish_host: _eth0_

root$ rm -rf /usr/share/elasticsearch/plugins/*

root$ curl -s -XPOST http://localhost:9200/_bulk --data-binary "@/tmp/elasticsearch/squirro_v5_filter.out"

root$ yum update 

On each cluster node, run:

root$ yum update
root$ yum reinstall squirro-python-squirro.api.topic

Resolve /etc/squirro/topic.ini.rpmnew

root$ mkdir -p /mnt/gv0/widgets
root$ chown -R sqtopic:squirro /mnt/gv0/widgets
root$ sed -e 's|^custom_widgets_directory = .*|custom_widgets_directory = /mnt/gv0/widgets/|' -i /etc/squirro/topic.ini
root$ sed -i -e 's/db_endpoint_discovery = false/db_endpoint_discovery = true/' /etc/squirro/topic.ini
root$ if [[ ! -L "/var/lib/squirro/topic/widgets" && -d "/var/lib/squirro/topic/widgets" ]]; then rm -ir /var/lib/squirro/topic/widgets; fi
root$ ln -s /mnt/gv0/widgets /var/lib/squirro/topic/widgets
root$ service sqtopicd restart

For the cluster node (or in a multi-cluster-node environment all cluster nodes), please run the following steps needed to exercise the new custom widgets extension with release 2.3.2

root$ CUSTOM_WIDGET_SYMLINK="/opt/squirro/virtualenv/lib/python2.7/site-packages/squirro/integration/frontend/userapp/static/min/custom"
root$ if [[ -d "$CUSTOM_WIDGET_SYMLINK" && ! -L "$CUSTOM_WIDGET_SYMLINK" ]]; then rm -rf "$CUSTOM_WIDGET_SYMLINK"; fi
root$ ln -s /var/lib/squirro/topic/widgets "$CUSTOM_WIDGET_SYMLINK"

Then start Squirro again:

root$ monit start sqclusterd
root$ monit restart sqfrontendd