| Component | Sub Forms | Description | Status/Discussion/Actions | WIKI Docs. | Github | Build Files |
|---|
| Schema Components | | | | | https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settings | |
| | | | | | | |
| All schema | | | | /wiki/spaces/A2DOCS/pages/88932415 | https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settings | https://www.dropbox.com/s/rmyrntpl3cwjvwf/all_schema.json?dl=0 |
| elasticsearch(technology overrides) | | | first iteration of elasticsearchform and wiki docs
Alex:
- reviewelasticsearchoverrides
wiki and buildobject
March 8th:
adding tech. overrides for data warehouse schema
| /wiki/spaces/A2DOCS/pages/87031839 | https://github.com/IKANOW/Aleph2/wiki/Service-schema:-technology-overrides | https://www.dropbox.com/s/xk5qto3609kq0y2/elasticsearch.json?dl=0 |
| search index schema | | | Alex:
review docs and build object
| /wiki/spaces/A2DOCS/pages/88932415 | https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settings | https://www.dropbox.com/s/yf8u2ewrt5lzza3/search_index_schema_generic.json?dl=0 |
| columnar | | | | /wiki/spaces/A2DOCS/pages/88932415 | https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settings | https://www.dropbox.com/s/fj9i77oxm6n661c/columnar_schema.json?dl=0 |
| temporal | | | | /wiki/spaces/A2DOCS/pages/88932415 | https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settings | https://www.dropbox.com/s/os30qtuzlj4yktb/temporal_schema.json?dl=0 |
| document | | | | /wiki/spaces/A2DOCS/pages/88932415 | https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settings | https://www.dropbox.com/s/iqk7goncswu63tc/document_schema.json?dl=0 ALEX: basic card here: https://github.com/Alex-Ikanow/aleph2_bucket_builder/tree/master/assets/json |
| storage schema | | | | /wiki/spaces/A2DOCS/pages/88932415 | https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settings | https://www.dropbox.com/s/lc6w2tifksbtnyr/storage_schema.json?dl=0 |
| generic writer configuration | | | See storage schema | | | |
| data warehouse schema | | | | /wiki/spaces/A2DOCS/pages/88932415 | https://github.com/IKANOW/Aleph2/wiki/Service-schema:-generic-settings | https://www.dropbox.com/s/49vkyl6rcq3gzsg/data_warehouse_schema.json?dl=0 |
| | | | | | | |
| | | | | | | |
| Analytics | | | | | | |
| General analytics forms | | | | /wiki/spaces/A2DOCS/pages/91815941 | https://github.com/IKANOW/Aleph2/wiki/General-Analytics-Overview | https://www.dropbox.com/s/plgmx274mufsezf/analytic_thread.json?dl=0 ALEX: Some basic forms here: https://github.com/IKANOW/Aleph2-examples/tree/master/aleph2_enrichment_utils/assets |
| Hadoop | | | TODO | | | |
| Storm | | | TODO | | | |
| Spark | | | TODO | | | |
| Harvester | | | | | | |
| Logstash | | Build object for logstash harvester with inline documentation. | Completed first draft of Logstash Harvester top level build object.
using RAW JSON write_settings_override is not showing up in the form.
- third
iteration is ready for review.
| TODO | https://github.com/IKANOW/Aleph2-examples/wiki/LogstashHarvestTechnology:-Logstash-Harvest-Component | logstash harvester 3: https://www.dropbox.com/s/48kpfe9pllt5vv5/logstash_harvester_3.json?dl=0 ALEX: there's a basic card here: https://github.com/IKANOW/Aleph2-examples/tree/master/aleph2_logstash_harvester/assets |
| v1 harvester | | | ALEX: can remove this, we've decided not to build this component for now | | | |
| Flume harvester | | | TODO ALEX: this and the script harvester are probably the highest prio ones that don't have any UI support | | https://github.com/IKANOW/Aleph2-examples/wiki/FlumeHarvestTechnology:-Flume-Harvest-Component | |
| Script harvester | | | TODO ALEX: this and the script harvester are probably the highest prio ones that don't have any UI support | | https://github.com/IKANOW/Aleph2-examples/wiki/ScriptHarvestTechnology:-Script-Harvest-Component | |
| Enrichment | | | | | | |
| Batch enrichment | | | | /wiki/spaces/A2DOCS/pages/94797860 | https://github.com/IKANOW/Aleph2/wiki/Batch-Enrichment | https://www.dropbox.com/s/yyb64q1tvdz3p4q/batch_enrichment_configuration.json?dl=0 ALEX: Some basic forms here: https://github.com/IKANOW/Aleph2-examples/tree/master/aleph2_enrichment_utils/assets |
| JS enrichment element (passthrough) | | | | | https://github.com/IKANOW/Aleph2-examples/wiki/FlumeHarvestTechnology:-Flume-Harvest-Component | ALEX: basic form here: https://github.com/IKANOW/Aleph2-examples/tree/master/aleph2_enrichment_utils/assets |
| document (deduplication) | | | TODO | | | |
| Scala analytic thread/enrichment | | | TODO | | TODO; action on Alex | ALEX: some forms here: https://github.com/IKANOW/Aleph2-contrib/tree/master/aleph2_analytic_services_spark/assets and https://github.com/IKANOW/Aleph2-examples/tree/master/aleph2_spark_script_engine/assets |
| Apps/Functionality | | | | | | |
| see harvesters (flume, JS etc. | | | | | | |
| | | | | | | |