...
Items are only displayed to the users once the full pipeline - with exception of Search Tagging - has run through. For details on the search tagging delay, see the Filtering step.
Stages
The pipeline splits its work into stages. These come into play for pipelets, when the ordering has to be enforced. A pipelet can then be configured to execute before a certain stage. The following stages comprise the Squirro pipeline:
- deduplication
- content
- processing
- indexing
The documentation of each step in the built-in enrichments also documents the stage in which this step is executed.
Configuration
The steps to be executed is configurable partially on a per-project basis and partially for each subscription. For built-in enrichments, the Processing Config is used to enable and disable those steps.
...