Category: 5 SPL Learning Material

This article illustrates scenarios of querying files directly in SQL and provides sample programs written with esProc SPL.

This article explains methods of performing distinct operation on small files and big files, and offers sample program in esProc SPL. Those methods include removing or retaining duplicates by rows or by key filed.

This article illustrates the comparison of two text files to find their commons and differences and offers sample programs in esProc SPL.

This article explains how to merge multiple text files or Excel files into one file, and split a text file or Excel file into multiple smaller ones. It illustrates several types of scenarios and offers sample programs in esProc SPL.Samples of Merging and Splitting Files!

Filter out the records that meet the conditions from the data table.

Elasticsearch is a distributed search server that provides Restful API to update and search data. The submitted data and search results are both in JSON format. And the calculation engine language–SPL–can parse the JSON strings with the json()function, which can convert the JSON strings into an SPL table sequence for easy data calculation. Therefore, it also provides the es_rest() function to call Elasticsearch API in order to access the data.

InfluxDB is a time series database, where data is stored in its bucket and multiple buckets form an organization. Every piece of data consists of measurement, multiple dimensions, multiple filed values, and a timestamp:

Kafka is a distributed flow information platform, of which there are two kinds of clients, producers and consumers respectively. The former submit data, while the latter read data. There is also no fixed format for the event message delivered in Kafka.

Cassandra is a distributed NoSQL database. In JAVA, DataStax can be used to execute the CQL of Cassandra. This language can maintain and access data in a simple way, but does not support operations such as association, grouping and aggregation, etc.

FTP is a commonly-used file transfer service. Although JAVA provides APIs for reading and writing files from an FTP server, it is not convenient enough to use. Therefore, SPL provides some functions for further convenience.