Documentation
Data Logger
All matching documents (see how Matchers work in Content Transformation ) will be dumped to the hard disk prior to sending them to the search engine. Depending where you configure this stage, you can also see, how the content evolves during content processing.
Within the defined folder you will see json files which contain the respective document states.
The filename as calculated as follows. The stage uses the document id, which you also see in the log files and State View but will truncate any dashes or disallowed characters from the file name.
Please note that only documents which have changed will be logged to the folder. Also note that this feature is of course for debugging reasons and should never be used on large data sets and on sensible data.
Configuration Parameters
The only configuration parameter, which you need to add is path. This must be an accessible path where the logger can write the content items to.