Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

By category

Harvest Types
  • Feed
    • RSS
    • HTML
    • Following Links
  • File
    • "office"
    • XML
    • JSON
  • Database
    • SQL
Search and update cycles
  • Search cycles
  • Update cycles
Generating metadata
  • Using regex
  • Using javascript
    • Global functions
    • Accessing external content
  • Using xpath
  • Metadata pipelines
Generating entities from metadata
  • With strings/replacement
  • With javascript
    • Global functions
  • From metadata arrays
Generating associations from metadata
  • With strings/replacement
  • With javascript
    • Global functions
  • From metadata arrays
Generating associations from entities
  • With strings
  • With javascript
Retaining and discarding metadata for storage and/or indexing
  • Retaining/discarding metadata for storage
  • Retaining/discarding entities, associations, metadata

By source

GNIP (twitter)

Source, example documents and output

...

  • File
  • JSON
  • Unstructured Analysis
    • Javascript
  • Structured Analysis
    • Entities
    • Associations
    • iterateOver (metadata)
    • Javascript
WITS (TODO)

Source, example documents and output

...

  • File
  • XML
  • Structured Analysis
    • Entities
    • Associations
    • iterateOver (entities)
    • Javascript
DC crime data (TODO)

Source, example documents and output

...