...
In the following example, the web extractor is used to run extraUrls parameter against the web content.
| Code Block |
|---|
{
"description": "For cyber demo",
"isPublic": false,
"mediaType": "Log",
"searchCycle_secs": 3600,
"tags": [
"cyber",
"structured"
],
"title": "Cyber Logs Test",
"processingPipeline": [
{
"feed": {
"extraUrls": [
{
"url": "http://INFINITE_ENDPOINT/api/share/get/51ad28a440b4a4f0f757824c?infinite_api_key=API_KEY"
}
]
}
},
|
In this example,the updateCycle_secs parameter is also used to specify the refresh rate of the harvested urls.
| Code Block |
|---|
{
"description": "wiy",
"isPublic": true,
"mediaType": "News",
"tags": [
"tag1"
],
"title": "aaa xml test",
"processingPipeline": [
{
"feed": {
"extraUrls": [
{
"url": "http://www.w3schools.com/xml/simple.xml"
}
],
"updateCycle_secs": 86400
}
}, |
Legacy documentation:
...