Technology

Logscape has four main components that turn your existing infrastructure into a distributed data fabric. Services running on these managed by the VScape orchestration layer.

Logscape Manager

Orchestrates the logging infrastructure. Distributes, consolidates and visualizes analytics and search result.

Forwarder

Monitors logs and operational data as it's generated and streams deltas to a bank of Index Stores

Local Indexer

Indexes and searches logs as well as operational data locally in-place on the machines where it is generated

Central Index Store

Stores, indexes and searches log files as well as operational data collected by the Forwarders

Add

When a new Datasource is added, Logscape will dynamically discover the data on-the-fly. Live-streaming data will be monitored, and historical data will be imported.

Index

Local Indexers and Central Index Stores will automatically index the data and build a profile of search-related information.

Search

When a Search is executed, it's distributed across all Local Indexers and Central Index Stores, the analytics are then rolled-up via a multi-stage map reduce.

VScape

VScape is a distributed run-time compute fabric utilizing self healing fabric based methods and intelligent end-points to provide a scalable infrastructure Fundamental to the fabric is the ability to run services using component oriented SLAs - these SLAs provide the ability to express many attributes about how a service or component is to be deployed, which machines to execute on and when to ramp-up, ramp-down instances to allow 'right-sizing' of instances. If a machine crashes or is switched off-line the infrastructure will automatically recover and reconfigure the application runtime.

Logscape components run on top of VScape. VScape manages the life cycle of all major and sub components of Logscape, Apps and services. The health and status of each component is monitored by VScape and tracked within the ./work/vsaudit.log.