Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

ExcerptThe This page can now be found at filtering.ini config file, located at /etc/squirro/filtering.ini configures the filtering process, which is responsible for search tagging, alerts and trend updates.

Table of Contents

Table of Contents
outlinetrue
excludeTable of Contents

Batching

The filtering process runs asynchronously, batching the actual execution of filtering steps. See Asynchronous Processing in Filtering for details.

The [batch] section in the filtering.ini configuration file, can be used to change the default of this batching.

...

Key

...

Usage

...

Default

...

size

...

How many items to collect for each batch.

It is recommended to increase this for high-throughput setups, which can profit from bigger batches.

...

20

...

flush_timeout_in_seconds

...

Number of seconds to wait before triggering a batch, even if the batch size has not been reached yet.

Can be decreased, especially when the item delivery is very bursty. So if the items of a batch usually come together, and then the pipeline will be quiet for a while, reducing this can reduce latency.

...

60

Applying Changes

After editing this configuration file, the service sqfilteringd has to be restarted (see Restarting services) on the Squirro Docs site.