Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • "mode" (from v0.3) is only applied in JSON/XML/*sv modes
    • In "normal" mode: any time a file containing records is modified then all already-imported records from that file are deleted/updated
    • In "streaming" mode: the enclosing file of the records is ignored

 

Warning

One use case that is not well handled by the current file harvester is ingesting log files that are continuously being written to (as opposed to streamed into a succession of smaller files). The script here provides a sample workaround for that sort of issue.

Locations

The File Extractor is capable of ingesting files from the following locations:

...