Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Info

This page is the bonus dev page for getting the graph data. Welcome to my happy place.


A good example doc to look at with all the changes is: http://nsight-api-1.rr.ikanow.com/nsight/event/53680852e4b08812fcb36d61?graph_data=true&fake_geo=true&fake_mediatype=true

...

&hide_data=true

...

&num_feed_items=1&max_ents=20&fake_date_spread=24

Query Options

graph_data=true*you can also add on a &
required to get the new data model

fake_geo=true to have it create a
turn on to get random docGeo item for every document*you can also add on a &fake_mediatype=true to have it loop over the list of mediatypes and assign them to each documentinternal doc and the event if they do not exist

fake_mediatype=true
turn on to get random mediatypes for every internal doc, rotates across the 9 mediatypes for an even distribution

hide_data=true
turn on to remove the "data" field from the root response object because it is redundant

num_feed_items=25
overrides the default number of documents that will have a url/desc in the doc_info_aggregation results (they cannot be guaranteed to be the first xx results)

geo_spread_degrees=5
forces fake_geo to pick lat/lng only this far apart (in degrees) - will result in all geos being: +-X/2 (because this will split them across the equator/perimeter) also im using ints so if you send an odd number it'll drop a degree because im lazy

min_docs=10
pastes the first doc a number of extra times until we get to X docs total

max_ents=20
overrides the maximum number of entities that will be added per document

fake_date_spread=24
adds a random date that is between NOW and the previous number of hours you send (e.g. if you send 24 a date can be between now and 24 hours ago)

fake_imagery=5
adds random image urls to the doc_info objects, as many as the number supplied (the images are on a short list and will rotate, some are valid, some are not for testing what happens).

 

This will turn on the api to add the new data model (eventually I'll just roll the regular call over to default graph_data to true so we don't have to make any changes, I just didn't want to break the current UI).

...

Code Block
2. Depending on what visualizations are turned on in the above list, the data will be aggregated in new fields currently:
doc_info_aggregation
ent_info_aggregation
...more if we need them

They are located at the root level e.g.
{
	"doc_info_aggregation":[],
	"ent_info_aggregation":[]
}

doc_info will be objects like:
{
	public String mediatype;
    public String publishedDate;
    public GeoPojo docGeo; //only exists if doc had a docGeo
    public String docTitle;
    public String docId;
	public String docUrl; //not always present
	public String docDescription; //not always present
}

ent_info will be objects like:
{
	public EntityPojo entity; //entire normal entity objects just copied in here
    public String arch_type;
    public Double aggregated_sentiment;
    public Long aggregated_frequency;
    public Double average_relevance;    
    public List<ObjectId> doc_ids;
}

...