Performance Testing

SPL computing performance test series: TPCH
SPL computing performance test series: associate tables and wide table
SPL computing performance test series: multi-index aggregating
SPL computing performance test series: position association
SPL computing performance test series: funnel statistics
SPL computing performance test series: in-group accumulation

Comparison of esProc composite table, ORC, Parquet
ClickHouse is fast, esProc SPL is faster

Comparison test of Python and SPL in data reading and computing performance
Performance comparison of Python and SPL in data processing

How to conduct database computing performance testing?

Case Analysis

Performance Optimization

Open-source SPL optimizes bank pre-calculated fixed query to real-time flexible query
Open-source SPL Speeds up Query on Detail Table of Group Insurance by 2000+ Times
Open-source SPL improves bank’s self-service analysis from 5-concurrency to 100-concurrency
Open-source SPL turns pre-association of query on bank mobile account into real-time association
Open-source SPL speeds up batch operating of bank loan agreements by 10+ times
Open-source SPL optimizes batch operating of insurance company from 2 hours to 17 minutes
Open-source SPL speeds up intersection calculation of customer groups in bank user profile by 200+ times
SPL optimizes funnel analysis of e-commerce from more than 3 minutes to 10 seconds

Programming Languages Comparison

Example codes for comparing SPL, SQL, and Python

SQL

Comparison of SQL & SPL: Set-oriented Operations
Comparison of SQL & SPL: Select Operation
Comparison of SQL & SPL: Order-based Computations
Comparison of SQL & SPL: Equi-grouping
Comparison of SQL & SPL: Non-equi-grouping
Comparison of SQL & SPL: Order-based Grouping
Comparison of SQL & SPL: Join Operations (Ⅰ)
Comparison of SQL & SPL: Join Operations (Ⅱ)
Comparison of SQL & SPL: Join Operations (Ⅲ)
Comparison of SQL & SPL: Static Transposition
Comparison of SQL & SPL: Complicated Static Transposition
Comparison of SQL & SPL: Dynamic Transposition
Comparison of SQL & SPL: Recursion Operation

Python

Python vs. SPL 1–Download and Installation
Python vs. SPL 2–Set
Python vs. SPL 3–Loop Function
Python vs. SPL 4– Selection and Positioning
Python vs. SPL 5 – Order-related Operation
Python vs. SPL 6 – Equivalence Grouping
Python vs. SPL 7 – Alignment Grouping & Enumeration Grouping
Python vs. SPL 8 – Ordered Grouping
Python vs. SPL 9 – Inverse Grouping & Transpose
Python vs. SPL 10 – One-to-N Association
Python vs. SPL 11 – Many-to-One Association
Python vs. SPL 12 – Big Data Processing

Overview Comparison

Prorgam

Looking for the Best SQL-On-File Tool for Analyst
Looking for the Best Programming Language for Processing Excel Files
Looking for the Best Class Library for Computing JSON Data
From JsonPath to SPL
Looking for the Best Class Library for Computing XML Data
From XPath to SPL
Looking for the Best Class Library for Computing MongoDB Data

Looking for the Best Java Data Computation Layer Tool
Are You Trying to Replace SQL with Java 8 Stream?
Are You Trying to Replace SQL with Kotlin?
From Stream to Kotlin to SPL

Looking for the Best Post-SQL Scripting Tool
Looking for the Best External Analytic Technique for Salesforce
Looking for the Best Technique of Processing Retrieved WebService/RESTful Data

Looking for the Best Tool for Using Non-RDB Data Sources in Reporting Tools
Looking for the Best Tool for Handling Diverse/Multiple Data Sources for Report Building
Looking for the Best Method of Handling Multistep Data Preparation for Reporting Tools

Looking for the Best Scripting Tool for Computing Time Series Data

Framework

Just How Slow is Data Retrieval via JDBC
Methods of dumping data among databases
Is ORM a Convenient Option for Data Migration between Databases?
The technologies for SQL migration

Cross-database Computing Methods
Implementation technologies of T+0 query
Looking for the Best Report Data Source Hot-Swapping Technique

Drawbacks of Using Stored Procedures to Compute Data
Methods for implementing data processing in microservice

Application Solutions

Efficient Data Analysis Engine
High-performance Batch Job

HPC (2022)
DCM (2022)

High Performance Computing Database
High Performance Batch Running (Batch Computing Task) Solution
High Performance Online Computing Scheme
High Performance Multidimensional Analysis Solution
High Performance Computing Application Scenario

Agile data computing middleware