/
v2 Documentation Progress

v2 Documentation Progress

Owned by andrew johnston (Unlicensed)
Last updated: Jun 10, 2016

 

 

ComponentSub FormsDescriptionStatus/Discussion/ActionsWIKI Docs.GithubBuild Files
Schema Components    https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settings 
       
All schema   /wiki/spaces/A2DOCS/pages/88932415https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settingshttps://www.dropbox.com/s/rmyrntpl3cwjvwf/all_schema.json?dl=0
elasticsearch(technology overrides)  
  • first iteration of elasticsearchform and wiki docs

Alex:

  • reviewelasticsearchoverrides wiki and buildobject

March 8th:

  • adding tech. overrides for data warehouse schema
/wiki/spaces/A2DOCS/pages/87031839https://github.com/IKANOW/Aleph2/wiki/Service-schema:-technology-overrideshttps://www.dropbox.com/s/xk5qto3609kq0y2/elasticsearch.json?dl=0
search index schema  

Alex:

  • review docs and build object
/wiki/spaces/A2DOCS/pages/88932415https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settingshttps://www.dropbox.com/s/yf8u2ewrt5lzza3/search_index_schema_generic.json?dl=0
columnar   /wiki/spaces/A2DOCS/pages/88932415https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settingshttps://www.dropbox.com/s/fj9i77oxm6n661c/columnar_schema.json?dl=0
temporal   /wiki/spaces/A2DOCS/pages/88932415https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settingshttps://www.dropbox.com/s/os30qtuzlj4yktb/temporal_schema.json?dl=0
document   /wiki/spaces/A2DOCS/pages/88932415https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settings

https://www.dropbox.com/s/iqk7goncswu63tc/document_schema.json?dl=0

ALEX: basic card here: https://github.com/Alex-Ikanow/aleph2_bucket_builder/tree/master/assets/json

storage schema   /wiki/spaces/A2DOCS/pages/88932415https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settingshttps://www.dropbox.com/s/lc6w2tifksbtnyr/storage_schema.json?dl=0
generic writer configuration  See storage schema   
data warehouse schema   /wiki/spaces/A2DOCS/pages/88932415https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settingshttps://www.dropbox.com/s/49vkyl6rcq3gzsg/data_warehouse_schema.json?dl=0
       
       
Analytics      
General analytics forms   /wiki/spaces/A2DOCS/pages/91815941https://github.com/IKANOW/Aleph2/wiki/General-Analytics-Overview

https://www.dropbox.com/s/plgmx274mufsezf/analytic_thread.json?dl=0

ALEX: Some basic forms here: https://github.com/IKANOW/Aleph2-examples/tree/master/aleph2_enrichment_utils/assets

Hadoop  TODO   
Storm  TODO   
Spark  TODO   
Harvester      
Logstash Build object for logstash harvester with inline documentation.

Completed first draft of Logstash Harvester top level build object.

  • using RAW JSON write_settings_override is not showing up in the form.

 

  • third iteration is ready for review.
TODOhttps://github.com/IKANOW/Aleph2-examples/wiki/LogstashHarvestTechnology:-Logstash-Harvest-Component

logstash harvester 3:

https://www.dropbox.com/s/48kpfe9pllt5vv5/logstash_harvester_3.json?dl=0

ALEX: there's a basic card here: https://github.com/IKANOW/Aleph2-examples/tree/master/aleph2_logstash_harvester/assets

v1 harvester  ALEX: can remove this, we've decided not to build this component for now   
Flume harvester  

TODO

ALEX: this and the script harvester are probably the highest prio ones that don't have any UI support

 https://github.com/IKANOW/Aleph2-examples/wiki/FlumeHarvestTechnology:-Flume-Harvest-Component 
Script harvester  

TODO

ALEX: this and the script harvester are probably the highest prio ones that don't have any UI support

 https://github.com/IKANOW/Aleph2-examples/wiki/ScriptHarvestTechnology:-Script-Harvest-Component 
Enrichment      
Batch enrichment   /wiki/spaces/A2DOCS/pages/94797860https://github.com/IKANOW/Aleph2/wiki/Batch-Enrichment

https://www.dropbox.com/s/yyb64q1tvdz3p4q/batch_enrichment_configuration.json?dl=0

ALEX: Some basic forms here: https://github.com/IKANOW/Aleph2-examples/tree/master/aleph2_enrichment_utils/assets

JS enrichment element (passthrough)    https://github.com/IKANOW/Aleph2-examples/wiki/FlumeHarvestTechnology:-Flume-Harvest-ComponentALEX: basic form here: https://github.com/IKANOW/Aleph2-examples/tree/master/aleph2_enrichment_utils/assets
document (deduplication)  TODO   
Scala analytic thread/enrichment  TODO TODO; action on AlexALEX: some forms here: https://github.com/IKANOW/Aleph2-contrib/tree/master/aleph2_analytic_services_spark/assets and https://github.com/IKANOW/Aleph2-examples/tree/master/aleph2_spark_script_engine/assets
Apps/Functionality      
see harvesters (flume, JS etc.      
       

 

TODO populate this table with discrete pieces of functionality/apps that need forms built for them.