Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Info

As a rule of thumb, it is advisable to have at least two weeks worth of data.

Dataset Used

We are going to cover two different scenarios of setting up trend-detection and we are going to use two different datasets to demonstrate it.

In the first scenario, we will set up trend detection on the number of items arriving in the project over time. For this scenario, we are going to use the bug-tracking dataset from the bugtrackers. Please download this dataset from here if you want to follow along with the tutorial.

In the second scenario, we will set up trend detection on change in the values of numerical facet of a Squirro item over time. For this scenario, we are going to use an anonymized ITSM dataset. Please download the csv dataset from here if you want to follow along with the tutorial. Every row in the dataset contains three fields i.e. "date", "title" and "calls". Please note that this dataset does not contain any textual data because trend-analysis is done purely on numerical data. 

Scenario 1 - Setting up Trend Detection on item counts & visualization

A new trend-detection can now be set up using the Squirro UI. Please follow the screenshots below that will guide through the process of setting up new trend-detection one by one. Once set up, the detected anomalies can then be visualised on the dashboard using a Trend widget (covered later).

Moreover, a new trend-detection can be set up in two different modes i.e. on the item-count over time for items coming into a project & the changes in the values of a numerical facet over time.

set up a Trend Detection

...

without query

  • On the "Search" tab of Squirro UI, select the "Create Trend" option from the "Save" button drop down.

...

  • This will present the user with a "Create Trend" modal, which needs to be filled with the necessary information described below.


    where, 
    • Title: is the name of the name of the trend-detection you are setting up.
    • Query: is an optional Squirro Query which will be used to filter down the item-counts.
    • Data Aggregation Interval: is the length (in time units) of one time bucket.
    • Create Alert: is the email-address for sending alert emails whenever something unusual is detected
  • Click on the "Save" button to complete setting up the Trend-Detection.

 

visualization

pass

set up Trend-Detection with query

pass

visualizations

pass

Scenario 2 - Setting up Trend Detection on numerical facets & visualization

  • One can also use the "Create Trend" modal to create a new trend detection on a numerical facet.
  • In the presence of a numerical facet, the "Create Trend" dialog will have an extra checkbox to set up the trend detection on a numerical facet rather than the item counts
  • Using this "Numerical Aggregation" checkbox, one can select a particular numerical facet of interest.
  • Once a numerical facet has been selected, one can choose the aggregation method to be used on the numerical facet before setting up the trend detection. Possible options for aggregation are: Sum, Average, and Minimum.
  • The rest of the workflow for setting up the Trend Detection is similar to the workflow for setting up the Trend Detection on the item-counts.

visualizations

pass

Trend visualization on the dashboard

...