...
Suspending and deleting sources
TODO basic outline ("as
| Widget Connector | ||
|---|---|---|
|
As outlined in the video below, it is simple to suspend and re-activate Infinit.e sources, and this automatically stops/restarts the corresponding Datasift push subscriptions)
TODO mention to delete/suspend sources before shutting system down
TODO something about exporting data?
TODO dev.datasift console...above, once Datasift sources have been created, as detailed here (video and documentation), then they can be controlled from the source editor.
The following operations can be performed:
- Suspend active sources
- Re-activate suspended sources
- Delete sources
- Modify sources
These are described below.
| Warning |
|---|
Sources should be suspended or deleted before terminating or shutting down an instance. It is not catastrophic if you forget, Datasift will time-out the push subscription after a few minutes, but you will incur costs during that period. |
| Info |
|---|
As a fall-back scenario, you can always view and delete sources from the Datasift Developer Console. |
Suspend active sources
To suspend an active source, simply navigate to the source editor tab of the manager, select the desired source from the list on the left, and select the "Disable Source" button (clicking "OK" to confirm publishing the source when prompted).
This will have 2 effects:
- The Datasift push subscription that was generating documents for this source will be suspended within a minute.
- Infinit.e will immediately stop checking for new documents for this source.
Suspended sources can be re-activated as described below.
Re-active suspended sources
Re-activating a suspended source is the same operation: the source will have a "Enable Source" button in the same place, and clicking on it and confirming will perform the following:
- The Datasift push subscription will be re-activated within a minute
- (the contents of the source description field will be used to generate the filter, see below under "Modify Sources"; if unchanged this will be the JCSDL generated by the original filter of course)
- Infinit.e will immediately start checking for new documents from this source
Delete sources
To delete a source follow the steps from the source editor documentation. Deleting a source will automatically delete the corresponding Datasift push subscription.
Modify sources
Although this is not strictly recommended, there is a potentially consequence of the Infinit.e source containing the JCSDL in its description field so that it can use it to reconstruct sources when suspended sources are re-activated.
If it is necessary to make minor modifications to the JCSDL then this can be done without deleting and re-creating the source. Instead, suspend the source, wait two minutes (to be sure the existing Datasift push subscription has been terminated), modify the JCSDL in the subscription (this is one of the fields in the source editor), and then activate it (which will automatically publish the change).
| Info |
|---|
If it is requested enough then we will add a graphical editor into the Datasift connector widget so as to be able to modify sources more formally. |
Further reading:
Creating aliases and discarding unwanted entities
...