Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Tip 1: Start with the

...

Query Metrics Widget

The general visualization approach is to highlight aggregated statistics i.e. .  For example:

  • the frequency/significance of entities & associations,
  • document & entity counts by hour/day/week or clustered by geo, etc.

Before diving into the graphical views, however, the Query Metrics widget is  widget is useful for getting an overview of the data and the ontology used to index entities and associations.

...

The 'Entities' view lists all the different types of entities extracted from either the document metadata, or text using NLP (i.e. VulnerabilityCategory, OperatingSystem, PrivateDNS), as well as their document counts

The 'Associations' view lists the different the top level "verb categories" between entities (i.e. vulnerability_detected, affects, indicates).

...

When you find an entity/association of interest, click the  button to add to query, or  to run an external google search.

Tip 2: Other useful widgets

Doc Viewer: View the individual documents/events and their metadata, ranked by score or date, along with a breakdown of entities, geotags, and associations.

    • Useful for analyzing specific documents once filtering or querying has reduced the dataset to manageable size.

Entity Significance: View the entities across all documents, ranked by score or frequency.

    • Useful for identifying the entities that are most common or significant within a dataset.

Map: Geographic display of geo-tagged documents and events, as well as locations mentioned in content.

...

    • Useful for viewing large volumes of aggregated log events 

Event Graph: Automated link analysis chart of associations.

    • Useful for identifying intersection points/nodes between entities

Event Timeline: Displays timestamped associations between entities over time, including the start/end times of long running events

...

Custom Map/Bar Graph Viewer: The equivalent of the "Entity Significance"/"Map" widgets but on the results of custom analytics generated from the Plugin Manager.

Tip 3: Using

...

The Source Manager and Auto-complete

Infinit.eCommunity Edition's Community/Source data model allows for querying across multiple data silos at once, or a narrow search against one single data source.

Access the Source Manager from the 'Sources' button to the right of the query bar.

Image Removed

Access the Community list, and select the appropriate communities for your query.

Mouse over the Image Removed icon and 'Select All' or 'Select None', then check the individual communities for your query.

Image Removed

By default, all sources in a selected community are activated for querying. To narrow the scope of your search, turn off sources by clicking on their row in the source list, or 'Select None' from the drop-down, and select only those sources you want to query.

Once you've finalized your community and source selections, you must run a search in order to update your workspace.

Image Removed

When entering a query term in the search bar or the advanced query builder, a drop-down will populate with recommended entities indexed within the selected communities. The first two options are always Exact Text or Free Text search. The following entity categories (dimensions) are Who (i.e.person, company, organization), What (product, operatingsystem, vulnerability), or Where (city, state, region). 

Image Removed

Info

Note: When querying across multiple sources/communities that do not have a unified ontology, do not rely on indexed entities (i.e. keywords) to return all matching results. In these cases, using Exact Text searches will ensure all matching results are returned. 

For more information, see Introduction to Visualization.  

Tip 4: "Show only" Widget vs. Workspace filtering

Widget Filtering

Image Removed

Each widget contains a Show Only: text box which allows the user to drill down on specific entity names or entity types. Most common uses for this are in Entity Significance, Event Graph, and Doc Viewer. 

i.e. In Entity Significance, enter company or product in the Show only: text box

Image Removed

Info

Two useful tips for using "Show only" text:

  • To avoid matching unwanted substrings, put a space at the end of the string, eg "Vulnerability" (my quotes) will match on Vulnerability and VulnerabilityCategory entities, but "Vulnerability " will only match on the former.
  • You can use regex tricks, eg "Vulnerability|Incident" (my quotes) will match on either of those 2 strings, "https?://" will match on "http://" or "https://" etc

Workspace Filtering

Another option is to filter your result set across the entire workspace, think of this as a temporary sub-query within your query results. Examples:

Entity Significance: Double click on an entity to filter, the other widgets in your workspace will populate with only the documents that contain that particular entity.

Map: Click the Image Removed icon to 'enter click-to-filter' mode, then click on a document cluster Image Removed to investigate the corresponding documents in the Doc Viewer or Entity Significance.

Doc Viewer: Select an entity from one of the document data tables, mouse over the Image Removed icon at the top left of the section header and select 'Filter Selected Items' from the list.

Image Removed Image Removed

To remove a filter, click the Image Removed button located just below the query bar, this will revert the workspace back to the original query results.

...

For in depth information concerning the difference between widget filtering and workspace filtering, see Common Functionality.

Tip 5: Common Use Cases for Dragging Between Widgets

The following widgets support drag & drop of entities and/or associations into the Case Visualizer OR into the query bar:

...

Entity Significance: Individual or multiple entities can be selected and dragged out of the widget by holding Ctrl + clicking the desired entities, then dragging the Image Removed to the query bar or Case Visualizer. Drag all ten entities by deselecting any individual  and dragging the Image Removed button. Multiple terms are ORd together.

Event Graph: to drag individual associations (edges) from the Event Graph to the query bar or Case Visualizer, click on the edge label and drag. Also, copy all nodes/edges currently displayed in the Event Graph by dragging and dropping the Image Removed button.

...

Also, the following widgets provide non-drag mechanisms for adding queries:

  • The Significance/Sentiment/Custom Bar Graph widgets let you press the "+" button in the header to add the currently selected entities/text to the query. Note this differs from drag in that all terms are "AND"ed together, whereas dragging "OR"s multiple terms.
  • The Map and Custom Map widgets let you drag a radius box on the map and then add that to the query.
  • The document and event timeline widgets let you select a time range and then use the "+" button in the header to add to the query.

Tip 6: Exporting data as text or images

Image Removed

Workspace Link: 'Copy workspace link to clipboard' URL to the clipboard that will return you (or other users) to the current query, community/source selections, and widget configuration when pasted into a browser. 

JSON: 'Export JSON for current data' saves a file to local disk containing the JSON returned from the query. The format is described here.

CSV: From within the Entity Significance widget, export a CSV including all entities list on the graph along with the entity type, significance/relevance score, doc counts and coverage, etc.

RSS: 'Create RSS feed for current query' opens a new tab in the browser containing a URL that generates an RSS feed for the current query. This feed can be used in RSS readers or alerting tools supporting RSS (an access key is embedded in the URL so no authentication is required on the RSS reader side).

Screenshots: Each widget contains a Image Removed button at the top right of the widget toolbar (when moused over) that generates a .png of the widget contents - this .png will display in front of your browser window - it can be dragged and dropped into a Powerpoint or email, or you can right-click and save to local disk.

For more information, see "Export Options" in section Workspace

Tip 7: Saving your working using the Case Visualizer and Case Manager

The Case Visualizer provides a blank canvas for dragging and dropping entities and documents from the other visualization tools to develop a link analysis diagram.

Before dragging any entities into the Case Visualizer, open the widget and click '+ Add New Case', give the case a title and click 'Create'. This generates a corresponding case folder in the Case Manager webapp.

Image Removed

As a you create link diagram, convert entities (nodes) to 'Targets' to create a profile in the case folder: this archives the query used to locate the entity or the document the entity was pulled from, and provides a space for analysts to comment and add manual relationships.

Image Removed

Documents related to the case can be dropped onto the middle of the graph and saved as 'Supporting Evidence' in the case folder.

Image RemovedFor more information, see section Case Visualizer (Enterprise).