Tag: Data Source

SPL offers two ways to connect to databases: direct connection via JDBC/ODBC and JNDI connection pooling. Suppose there is employees table (below) in MyCompany database in Mysql. Let’s use the two ways to connect to it. Direct connection JDBC Download the corresponding JDBC driver, such as Mysql-connector-java-***.jar, from MySQL official website, put it under {SPL installation directory}/common/jdbc/, and start the SPL Desktop. Quick connection Directly connect to MyCompany database by using Mysql driver class to connect to the URL in a SPL script: A 1 =connect(“com.Mysql.jdbc.Driver”,“jdbc:Mysql://127.0.0.1:3306/MyCompany?user=root&password=123456”) 2 =A1.query(“select * from employees”) 3 >A1.close() After execution, A2 retrieves data from employees

This article explains various operations over a big file, illustrates how to make the computation faster using parallel processing, and gives concise sample programs in esProc SPL.

In real-world businesses, we often need to generate Excel files of various formats based on structured data of different sources. Those Excel formats include pure data export, export of huge amounts of data, specifying display properties, fill of fixed rows and columns, property display according to dynamic condition, groups with detailed data and aggregates, crosstab, etc.

This article illustrates how to parse Excel files of different formats and sizes, including the common row-wise format, complicated table headers, free-style format, crosstab, main & sub tables, and big files, into structured data, and provides sample programs in esProc SPL.

This article illustrates scenarios of querying files directly in SQL and provides sample programs written with esProc SPL.

This article explains methods of performing distinct operation on small files and big files, and offers sample program in esProc SPL. Those methods include removing or retaining duplicates by rows or by key filed.

This article illustrates the comparison of two text files to find their commons and differences and offers sample programs in esProc SPL.

This article explains how to merge multiple text files or Excel files into one file, and split a text file or Excel file into multiple smaller ones. It illustrates several types of scenarios and offers sample programs in esProc SPL.Samples of Merging and Splitting Files!

Filter out the records that meet the conditions from the data table.

Elasticsearch is a distributed search server that provides Restful API to update and search data. The submitted data and search results are both in JSON format. And the calculation engine language–SPL–can parse the JSON strings with the json()function, which can convert the JSON strings into an SPL table sequence for easy data calculation. Therefore, it also provides the es_rest() function to call Elasticsearch API in order to access the data.