LOGIQ platform Overview LOGIQ Insights LOGIQ Insights is a complete observability platform for monitoring, log aggregation, and analytics with infinite storage scale. The LOGIQ platform comprises of a User interface, a command line toolkit, a monitoring stack for time series metrics and a log analytics stack for log data. Monitoring LOGIQ's monitoring stack is powered by Prometheus. LOGIQ has it's own user interface and does not use Grafana. LOGIQ's monitoring stack also allows data from additional data sources like Elasticsearch, Postgres, MySQL, MariaDB, MongoDB, Athena etc. to be queried, analyzed and visualized. Log Insights LOGIQ Log Insights is a comprehensive log aggregation stack. It allows users to ingest, organize, analyze and, search through log data. The Log Insights stack is unique in its ability to use any S3 compatible store as its primary data store. It is best suited for ingesting log and time-series data directly into your S3 compatible store. The ingested data is written in an open format for ready consumption by other software. Examples of common uses are ingesting log and time-series data from Rsyslogd, Syslog, Syslog-ng, Logstash, Fluentd, Docker and ECS logging drivers, Kafka, influxDB etc. The LOGIQ log ingest server is natively written in the Go programming language and compiles into a single binary. This makes it light enough to be bundled with any application stack. The server also can be configured to run in clustered, HA mode that can tolerate 1 or 2 node failures making it ideal for creating larger clusters. Communities LOGIQ is a member of the CNCF Releases 2.1.11 - 2020-12-13 Log aggregation Support for and expressions in search Event rules designer support for && and || for individual parameters Performance and memory improvements Data convergence Support for Apache DRUID connector Optionally deploy Grafana with the LOGIQ stack UI Logs compare view to select 2 logs to be viewed side by side Easy toggle for activating/deactivating periodic queries 2.1.9 - 2020-11-28 Added Log aggregation Support for full data/metadata recovery on service restarts Log analytics Support for application and process/pod context in log and search views Deployment and Infrastructure Support for node selectors. Both taints and node selectors are supported Support for using spot instances on EKS/AWS Support for using S3 compatible buckets directly without a caching gateway to optimize for region optimized deployments UI Multi cluster support License management UI Ingest configuration settings exposed in the UI Logs page and search now have application and process/pod level contexts 2.1 - 2020-09-28 Added Log aggregation Parquet with Snappy compression for data at REST Log analytics Log view supports full JSON view for ingested log data like Search view Performance improvements for faster search, logs, and tailing Monitoring Event deduplication that can reduce event data by up to 1000x at peak data rates Deduplication of monitoring events at Namespace granularity Deployment and Infrastructure Separation of LOGIQ server into microservices for data ingestion, ML/UI and S3/Metadata management Support for taints in HELM chart for more control over large-scale deployments e.g. schedule ingest pods on dedicated nodes etc. Log tailing infrastructure using Redis switches to diskless replication/no persistence 2.0 - 2020-08-12 Added Log aggregation Support for AWS Fargate, Firelens, Fluent forward Protocol LOGIQ Fluent-bit daemon-set for K8S clusters Data extraction via Grok patterns, compatible with Logstash Grok patterns using the Grokky library Log analytics Redesigned - Elastic/Kibana like search UI that scales to infinite data from S3 compatible object store Real-time alertable events and alerts from log data Real-time extraction of log data facets using Grok expressions 1-Click conversion of log data events to time series visualization Logiqctl Logiqctl command-line toolkit Works with SAML users via API Key Monitoring Prometheus alert manager integration into LOGIQ alerts for unified alerting across logs and metrics Built-in Logiq dashboard for LOGIQ cluster performance and health monitoring LOGIQ Data platform Connect numerous popular data sources into the LOGIQ platforms such as Postgres, MySql, Elasticsearch, Athena, MongoDB, Prometheus, and more. JSON Data source for easily converting arbitrary JSON data into tables, widgets, and alerts Role-based access control Namespace RBAC for log data from K8S namespaces SAML Integration for RBAC allowing SAML Attributes to map to RBAC groups Security and Compliance Fully secured HELM deployment using Role, RoleBindings, ServiceAccounts and Pod Security policies for all service Cryptographically verified JWT token for API communication Built-in audit logging for the entire product and infrastructure 1.2.1 - 2020-05-11 Added K8S Add support for ingress with http and optionally have https ServiceMonitor for ingest server if prometheus is installed UI Logs modal ordering to match how developers view logs from a file Highlight log line from search Misc Bug fixes for performance, graceful failure handling/recovery 1.2.0 - 2020-04-28 Official GA of LOGIQ's complete Observability platform with support for metrics and log analytics Added K8S Scale-out and HA deployment for Kubernetes via HELM 3 chart ( https://github.com/logiqai/helm-charts ) UI Monitoring of time series metrics New Log viewer Log viewer integration with faceted search Log time machine to go back in time to log state CLI logiqctl is now GA with support for log tailing, historical queries and search 1.1.0 - 2020-02-27 Fixed Fluentd sends error logs as info - fixed with grok patterns to extract proper severity strings from incoming messages Added Anomaly detection via Eventing with built-in and custom rules Built-in UI Help with Intercomm chat Expand and collapse search facets Changed New AMI's for AWS marketplace 1.0.0 - 2020-01-21 Official GA of LOGIQ's Log Insights platform Added AWS Marketplace AMI for all regions including Gov cloud regions AWS CloudFormation 1-click deployment Rsyslog, Syslog protocol support for data ingest via Rsyslogd, syslogd, syslog-ng, logstash, fluentd, fluentbit, docker logging syslog driver. Built-in UI with SQL Queries, Faceted search, Alerts, Dashboards EULA End User License Agreement IMPORTANT: USE OF THE LOGIQ SOFTWARE CONSTITUTES ACCEPTANCE OF THIS AGREEMENT. IF YOU DO NOT AGREE TO THIS AGREEMENT, DO NOT USE THE SOFTWARE. This END USER LICENSE Agreement (the “Agreement”) is made effective by and among end-customer (“Customer”), and Logiq.ai Inc. with a place of business at 2216 Emerald Hills Cir, San Jose, CA The parties agree as follows: 1. DEFINITIONS 1.1. “Intellectual Property Rights” means worldwide common law and statutory rights associated with (i) patents and patent applications; (ii) works of authorship, including copyrights, copyright applications, copyright registrations and “moral” rights; (iii) the protection of trade and industrial secrets and confidential information; (iv) other proprietary rights relating to intangible intellectual property (specifically excluding trademarks, tradenames and service marks); (v) analogous rights to those set forth above; and (vi) divisions, continuations, renewals, reissuances and extensions of the foregoing (as applicable) now existing or hereafter filed, issued or acquired. 1.2. "Cloud Provider" means the provider of computing resources for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. The definition "Cloud Provider" includes both public and private Cloud Provider. 1.3. “Software” means the LOGIQ.ai software, LOGIQ Log Insights, LOGIQ Insights via Cloud Provider to Customer including all Updates related thereto. 1.4. “Update” means a release of the Software containing substantially only Error Corrections, minor new features, functionality and/or performance enhancements. 1.5. “Customer” is a user who subscribes to or deploys Logiq.ai Software using any Cloud Provider. 1.6. “Customer data” is all data created by Customer using the Software and/or stored on Cloud Provider machines operating the Software. 2. OWNERSHIP AND PROPRIETARY NOTICES 2.1. Ownership. The Software and associated elements are licensed, not sold – they remain property of LOGIQ.ai Inc. 2.2. Notices. The parties will not remove, alter, or obscure any copyright or intellectual property notice on the intellectual property of the other party. 2.3. Customer data. Customer data is property of Customer and cannot be accessed by Logiq.ai Inc. unless access rights are granted by Customer. 3. PAYMENTS AND ACCOUNTING 3.1. Fees. Customer shall pay Logiq.ai Inc. the fees set in accordance with the conditions published on the Cloud Provider Marketplace. Customer may use multiple instances of the Software paying for each instance separately. 3.2. Taxes. The Customer shall pay VAT, howsoever designated, to the extent attributable to this Agreement or to any part, service or material furnished hereunder. 3.3. Refunds. The customer may terminate the Cloud Provider instances at anytime to stop incurring charges. Annual subscription cancellations or downgrades are not supported. 4. MAINTENANCE AND SUPPORT SERVICES 4.1. Updates. Logiq.ai Inc. shall provide to Customer the Updates as they become available without additional charges. 4.2. Support. Support is offered to Customer via Email and serves the purpose of resolving product defects. At Logiq.ai Inc. discretion, initial installation support for a Customer may be offered at extra charges. Please contact [email protected] for further details. 5. LICENSE GRANTS AND RESTRICTIONS 5.1. Grants. Logiq.ai Inc. grants to Customer a limited, non-exclusive, non-transferable license under Logiq.ai Inc. Intellectual Property Rights to the Software. This agreement enables Customer to use the LOGIQ log analytics solution in the Cloud Provider environment so as to provide service offerings directly and indirectly to Customer’s subscribers, customers and clients. 5.2.