Recomendados
Recomendados
Más contenido relacionado
La actualidad más candente
La actualidad más candente (20)
Destacado
Destacado (14)
Similar a Data Tactics and Nervve Integrated Big Data v3
Similar a Data Tactics and Nervve Integrated Big Data v3 (20)
Más de DataTactics
Más de DataTactics (11)
Data Tactics and Nervve Integrated Big Data v3
- 1. http://www.data-tactics.com Data Tactics Corporation Proprietary Material Data Tactics FMV and Imagery Entity Extraction and Analytics Joint Presentation Integrating Data Tactics GM Stack and Technology OCT 17, 2012
- 2. Government Cloud Capabilities • Government Investment in Cloud Technologies and Data Analytics • Secure, Operational Systems providing deep analytics into Petabyte level data sets for National Agencies • Based on Government Off the Shelf (GOTS) and Open Source Software running on commodity hardware • Coalescing of technologies into a Government Standard Cloud Architecture based on standards, security, and capabilities • Fruits of large investments available to all Federal Agencies • USD(I) – DI2E • ODNI – I2 Pilot • NGA – FMV Archive & Exploitation* • NSA – GhostMachine - SIGINT Cloud Node • DIA – Orion • CIA – Commercial Cloud • Army – DCGS-A • DARPA – Advanced Indexing and Analytic Research
- 3. Single Solution for Multiple Missions • Big Data Storage is ALREADY A COMMODITY • No Need for expensive non-interoperable Stovepipe Systems • Single Data Store supporting multiple missions • multiple data projections • complex and integrated analytics •Concentrate mission effort where it is NEEDED • DO Build customized user interfaces, workflows, and business logic • DO NOT build another data stovepipe and non-reusable application stack
- 4. NGA FMV and Imagery Data Analytics Cloud FMV and Imagery Sources Analytic Environment -Linearly Scalable - Commodity Hardware - GOTS and Open Source - Interoperable - Cost Efficient Complex Analytics - Rapid Iteration Time - Advanced Query and Analysis - Explore Non-obvious Relationships based on: - Temporal - Geospatial - Entity - other attributes - Canonical Analysis - Multiple Data Sets - Multiple Dimensions - Anomaly Detection - Prediction - Link Analysis - Statistical Analysis Data Tactics Corporation Proprietary Material
- 5. Nervve Visual Indexing Capabilities • Nervve Visual Index allows rapid indexing of PBs of Video and Imagery in Seconds!!! – Rapid Iteration time (seconds to minutes) enabling easier iterative filtering or several “what if” scenarios – Query using single image or image model – Directly Analogous to text querying of document store • Infinitely Scalable Architecture with Tunable Indexing – Can Index streaming or archived video from 10s to 100s times speed – Linearly scalable no memory shared architecture – Runs on Commodity Nvidia GPU systems • 2D Image Based Query Model Generation – Ability to create Object Model visually representing an Entity (e.g. “White Truck”) – Ability to Query the Visual Index using Image Models – Sub-second to seconds result set return time over Petabytes of original Video and Imagery – Can create for EO, IR, and LIDAR – algorithm is raster based • Negative Filters – Do not send images or video containing “Just Unmoving Desert” Data Tactics Corporation Proprietary Material
- 6. Data Tactics Enterprise Analytics • Complex Event Processing Based on Video Content – Identify and Alert Video and Imagery containing “Person of Interest” – Tag Video (in-stream or metadata) – Contact Alerting Engine • Single Dataspace Ontology “maps” all Imagery and FMV sources to common model – Enables apples to apples comparisons across various data sets – Over time creates a “Video Content Log” – What you are interested is the prioritization of the logging • Ability to use Semantic Queries on Entities (e.g. People, Cargo, Vessels) over time periods and within geographic regions – Complex Descriptions of Entities combining IMINT, VIDINT, SIGINT, HUMINT, etc… – Can Federate Imagery and FMV Queries across the IC – Semantic Queries Based NOT on the METADATA but on the CONTENT in the Video Data Tactics Corporation Proprietary Material
- 7. NGA FMV Enhanced GM Architecture Data Tactics Corporation Proprietary Material NiFi Ingest IC Standard Ghost Machine Cloudbase TUIC OWF - Alerts -Queries -Analytics Model Generation Structured Unstructured Semi-Structured Video and Image Transformation Semantic Ontology Advanced Analytics
- 8. NGA FMV Enhanced GM Benefits • Single Dataspace allows for analysis of complete data sets of NGA • Complex algorithms can be more easily applied to dataspace using distributed technologies to support NGA Missions • Greatly improved access to the large volume and variety of geospatial knowledge at all security domains • Open and IC ITE Standards Based Architecture enabling, cross domain and cross agency sharing and fusion • Cutting Edge Analytic Capabilities enabling rapid iterations and hypothesis led analysis and Activity Based Intelligence • Customer Service aligned data stores, services, and common user interfaces enabling timely and accurate access to all data on all domains • Affordability at Scale – Commodity Hardware Scales Linearly – Software costs can be minimized by leveraging GOTS and Open Source Data Tactics Corporation Proprietary Material
- 9. FMV ingestion into IC GM
- 10. FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index Library of User Created Object Models FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distribu ted Index FMV Distributed Index FMV Distribut ed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distribute d Index In ad-hoc, collaborative fashion, users may create, use, modify and refine object models Build and Share Image Object Models
- 11. Object Models are comprised of a single or multiple images of what you are looking for Alert! - Object [White Car] - Video Clip Transmitted Time Start: 14:38:03 Time Stop: 14:39:27 Lat/Long: 32.3333/44.4333 + Object Models are the input/patterns for Queries and Alerts
- 12. Complex Multi-Dimension Queries FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index Secure, Multi-Domain, Distributed FMV Content Index in GM FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index FMV Distributed Index Image Models “Search for within 5 km of 31.5058° N, 65.8478° E