AS2 Performance Report
Performance Test Description
- Performance Test, different message size and frequency to test AS2 server performance.
- Stability Test, different message size and frequency to test AS2 server stability.
Test Environment
Hardware
| Configuration | CPU | Memory | Network | Disk | OS |
|---|---|---|---|---|---|
| Configuration 1 2 Core | i7-11800H 2.3GHz 2 Cores | 2G | 1000M | 60G | Window Server 2019 Standard |
| Configuration 2 4 Core | i7-11800H 2.3GHz 4 Cores | 2G | 1000M | 60G | Window Server 2019 Standard |
Software
| Name | Version | Description |
|---|---|---|
| Eclipse Temurin Open JER | 17.0.12+7 | Java RunTime |
| PostgreSQL DataBase | 14.11.1 | DataBase |
| chinlink-edi-core.jar | 25.1.1164.423 | The ChinLink Core Library |
| chinlink-edi-ultron.jar | 25.1.1164.1181 | The ChinLink Data Integration Platform |
Test Target
Excepted Performance Indicators
| Scenario Name | Indicator Name | Expected Value Range | Actual Value | Is it Satisfied (Yes/No) |
|---|---|---|---|---|
| 1000 messages | Complete Time | 60s | 40s | Yes |
| 2000 messages | Complete Time | 120s | 73s | Yes |
| 3000 messages | Complete Time | 180s | 95s | Yes |
| 1000 messages | Success Rate | 100% | 100% | Yes |
| 2000 messages | Success Rate | 100% | 100% | Yes |
| 3000 messages | Success Rate | 100% | 100% | Yes |
| 100 messages 1K size | Complete Time | 10s | 7s | Yes |
| 100 messages 5M size | Complete Time | 60s | 49s | Yes |
| 100 messages 20M size | Complete Time | 180s | 127s | Yes |
Excepted Performance Status
- More CPU will reduce the time of processing. PASS
- It's linear relationship between the number of messages and the processing time. PASS
- It's linear relationship between the file size and the processing time. PASS
- CPU, Memory, Network, Disk, File Handles Occupation is Stable. PASS
- No frequent thread lock, thread number is stable. PASS
Test Script
- Use 2 cores and 4 cores to test.
- 10 Threads 100 Send Data Test AS2 Server.
- 20 Threads 100 Send Data Test AS2 Server.
- 20 Threads 100 Send Data Test AS2 Server.
Test Result
The test results of different configurations of computers are as follows:
| Configuration | File Count | Success Rate | File Size | Average Time(s) | First | Second | Third |
|---|---|---|---|---|---|---|---|
| Configuration 1 2 Core | 1000 | 100% | 1K | 39.506 | 40.468 | 37.396 | 40.656 |
| Configuration 1 2 Core | 2000 | 100% | 1K | 73.800 | 71.176 | 73.822 | 76.402 |
| Configuration 1 2 Core | 3000 | 100% | 1K | 95.927 | 103.770 | 89.576 | 94.436 |
| Configuration 2 4 Core | 1000 | 100% | 1K | 26.009 | 26.803 | 25.596 | 25.630 |
| Configuration 2 4 Core | 2000 | 100% | 1K | 53.982 | 56.069 | 50.594 | 55.283 |
| Configuration 2 4 Core | 3000 | 100% | 1K | 81.717 | 79.316 | 81.040 | 84.796 |
The test results of different file sizes are as follows:
| Configuration | File Count | Success Rate | File Size | Average Time(s) | First | Second | Third |
|---|---|---|---|---|---|---|---|
| Configuration 1 2 Core | 100 | 100% | 1K | 7.104 | 9.036 | 6.192 | 6.084 |
| Configuration 1 2 Core | 100 | 100% | 5M | 49.779 | 52.123 | 49.621 | 47.593 |
| Configuration 1 2 Core | 100 | 100% | 20M | 127.441 | 128.891 | 130.865 | 122.568 |
Test Analysis
Performance Analysis
ChinLink AS2 Server performance test conclusion is passed. From the test results, it can be verified that the performance of the server can be improved by increasing the number of CPU cores. 
From the test results, when the number of files increases, the average processing time also increases, and the processing time is linear with the number of files. When the bottleneck of disk read and write is present, the response time of the server has a large delay. It is recommended to increase the read and write capabilities of the disk or use a distributed file system. 