Using the Feed Harvester

There is a seperate reference for the Feed Harvester configuration object.

Infinit.e supports harvesting data from RSS feeds in a number of common formats (Atom, RSS 1.0, RSS 2.0, etc.). The Sample Feed Harvester Specification below demonstrates how to connect to and extract data from a feed using the harvester:

source : {
   ... 
   "extractType" : "Feed",
   "authentication" : {
       "username" : "username", 
       "password" : "password"},
   "url" : "http://www.mayoclinic.com/rss/blog.xml",
   ...
}

Note: A complete example of the above source including a sample feed document harvested from the source can be found here: Feed Source.

• extractType
  The extractType field is used to tell the harvester the type of source to extract from, i.e.: Feed. Other valid values include: Database, Feed, etc.
• authentication (optional)
  The Authentication object of the Source document is a subset of the full Authentication object in that it only uses the 'username' and 'password' fields. The Feed Harvester uses the username and password from the Authentication object as feed credentials (if needed).
  • username
  • password
    Note: The password field in the Authentication object is currently clear text. If the string value placed in password is clear text it is not encrypted by Infinit.e. Encryption of the password field is planned for a future release.
• url
  The URL to retrieve the RSS feed from.