Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
416 changes: 416 additions & 0 deletions TIMESNET_REPRODUCTION_GUIDE.md

Large diffs are not rendered by default.

76 changes: 76 additions & 0 deletions TIMESNET_REPRODUCTION_RESULTS.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,76 @@
# TimesNet Reproduction Summary

This file is generated by `scripts/summarize_timesnet_results.py`.

## Long-Term Forecasting

| Dataset | Ours MSE | Paper MSE | Delta | Ours MAE | Paper MAE | Delta | Runs |
| --- | --- | --- | --- | --- | --- | --- | --- |
| ETTm1 | - | 0.400 | - | - | 0.406 | - | - |
| ETTm2 | - | 0.291 | - | - | 0.333 | - | - |
| ETTh1 | - | 0.458 | - | - | 0.450 | - | - |
| ETTh2 | - | 0.414 | - | - | 0.427 | - | - |
| Electricity | - | 0.192 | - | - | 0.295 | - | - |
| Traffic | - | 0.620 | - | - | 0.336 | - | - |
| Weather | - | 0.259 | - | - | 0.287 | - | - |
| Exchange | - | 0.416 | - | - | 0.443 | - | - |
| ILI | - | 2.139 | - | - | 0.931 | - | - |

## Short-Term Forecasting

| Metric | Ours | Paper | Delta |
| --- | --- | --- | --- |
| SMAPE | - | 11.829 | - |
| MASE | - | 1.585 | - |
| OWA | - | 0.851 | - |

## Imputation

| Dataset | Ours MSE | Paper MSE | Delta | Ours MAE | Paper MAE | Delta | Runs |
| --- | --- | --- | --- | --- | --- | --- | --- |
| ETTm1 | - | 0.027 | - | - | 0.107 | - | - |
| ETTm2 | - | 0.022 | - | - | 0.088 | - | - |
| ETTh1 | - | 0.078 | - | - | 0.187 | - | - |
| ETTh2 | - | 0.049 | - | - | 0.146 | - | - |
| Electricity | - | 0.092 | - | - | 0.210 | - | - |
| Weather | - | 0.030 | - | - | 0.054 | - | - |

## Classification

| Dataset | Ours Acc(%) | Paper Acc(%) | Delta | Runs |
| --- | --- | --- | --- | --- |
| EthanolConcentration | - | 35.7 | - | - |
| FaceDetection | - | 68.6 | - | - |
| Handwriting | - | 32.1 | - | - |
| Heartbeat | - | 78.0 | - | - |
| JapaneseVowels | - | 98.4 | - | - |
| PEMS-SF | - | 89.6 | - | - |
| SelfRegulationSCP1 | - | 91.8 | - | - |
| SelfRegulationSCP2 | - | 57.2 | - | - |
| SpokenArabicDigits | - | 99.0 | - | - |
| UWaveGestureLibrary | - | 85.3 | - | - |

| Dataset | Ours Acc(%) | Paper Acc(%) | Delta | Covered |
| --- | --- | --- | --- | --- |
| Average | - | 73.6 | - | 0 |

## Anomaly Detection

| Dataset | Ours F1(%) | Paper F1(%) | Delta | Runs |
| --- | --- | --- | --- | --- |
| SMD | - | 85.12 | - | - |
| MSL | - | 84.18 | - | - |
| SMAP | - | 70.85 | - | - |
| SWAT | - | 92.10 | - | - |
| PSM | - | 95.21 | - | - |

| Dataset | Ours F1(%) | Paper F1(%) | Delta | Covered |
| --- | --- | --- | --- | --- |
| Average | - | 85.49 | - | 0 |

## Notes

- Long-term forecasting and imputation paper values are the averages reported in the main paper tables.
- Classification and anomaly detection values in the repository logs are ratios in `[0, 1]`; this summary converts them to percentages to match the paper.
- For anomaly detection, if a dataset has multiple runs, this summary keeps the best F1 because `SWaT` is searched over several settings in the provided script.
- If a row is `-`, the corresponding experiment has not been completed yet.
Binary file added article/TimesNet.pdf
Binary file not shown.
1 change: 1 addition & 0 deletions reproduction_logs/latest
7 changes: 7 additions & 0 deletions reproduction_logs/timesnet_20260321T083059Z/metadata.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
start_utc=2026-03-21T08:30:59Z
root_dir=/root/zm/Time-Series-Library-meter-main_success
conda_env=timesnet
gpu=0
hostname=ubuntu2204-cygtest-hgxtest

[python]
Original file line number Diff line number Diff line change
@@ -0,0 +1,76 @@
# TimesNet Reproduction Summary

This file is generated by `scripts/summarize_timesnet_results.py`.

## Long-Term Forecasting

| Dataset | Ours MSE | Paper MSE | Delta | Ours MAE | Paper MAE | Delta | Runs |
| --- | --- | --- | --- | --- | --- | --- | --- |
| ETTm1 | - | 0.400 | - | - | 0.406 | - | - |
| ETTm2 | - | 0.291 | - | - | 0.333 | - | - |
| ETTh1 | - | 0.458 | - | - | 0.450 | - | - |
| ETTh2 | - | 0.414 | - | - | 0.427 | - | - |
| Electricity | - | 0.192 | - | - | 0.295 | - | - |
| Traffic | - | 0.620 | - | - | 0.336 | - | - |
| Weather | - | 0.259 | - | - | 0.287 | - | - |
| Exchange | - | 0.416 | - | - | 0.443 | - | - |
| ILI | - | 2.139 | - | - | 0.931 | - | - |

## Short-Term Forecasting

| Metric | Ours | Paper | Delta |
| --- | --- | --- | --- |
| SMAPE | - | 11.829 | - |
| MASE | - | 1.585 | - |
| OWA | - | 0.851 | - |

## Imputation

| Dataset | Ours MSE | Paper MSE | Delta | Ours MAE | Paper MAE | Delta | Runs |
| --- | --- | --- | --- | --- | --- | --- | --- |
| ETTm1 | - | 0.027 | - | - | 0.107 | - | - |
| ETTm2 | - | 0.022 | - | - | 0.088 | - | - |
| ETTh1 | - | 0.078 | - | - | 0.187 | - | - |
| ETTh2 | - | 0.049 | - | - | 0.146 | - | - |
| Electricity | - | 0.092 | - | - | 0.210 | - | - |
| Weather | - | 0.030 | - | - | 0.054 | - | - |

## Classification

| Dataset | Ours Acc(%) | Paper Acc(%) | Delta | Runs |
| --- | --- | --- | --- | --- |
| EthanolConcentration | - | 35.7 | - | - |
| FaceDetection | - | 68.6 | - | - |
| Handwriting | - | 32.1 | - | - |
| Heartbeat | - | 78.0 | - | - |
| JapaneseVowels | - | 98.4 | - | - |
| PEMS-SF | - | 89.6 | - | - |
| SelfRegulationSCP1 | - | 91.8 | - | - |
| SelfRegulationSCP2 | - | 57.2 | - | - |
| SpokenArabicDigits | - | 99.0 | - | - |
| UWaveGestureLibrary | - | 85.3 | - | - |

| Dataset | Ours Acc(%) | Paper Acc(%) | Delta | Covered |
| --- | --- | --- | --- | --- |
| Average | - | 73.6 | - | 0 |

## Anomaly Detection

| Dataset | Ours F1(%) | Paper F1(%) | Delta | Runs |
| --- | --- | --- | --- | --- |
| SMD | - | 85.12 | - | - |
| MSL | - | 84.18 | - | - |
| SMAP | - | 70.85 | - | - |
| SWAT | - | 92.10 | - | - |
| PSM | - | 95.21 | - | - |

| Dataset | Ours F1(%) | Paper F1(%) | Delta | Covered |
| --- | --- | --- | --- | --- |
| Average | - | 85.49 | - | 0 |

## Notes

- Long-term forecasting and imputation paper values are the averages reported in the main paper tables.
- Classification and anomaly detection values in the repository logs are ratios in `[0, 1]`; this summary converts them to percentages to match the paper.
- For anomaly detection, if a dataset has multiple runs, this summary keeps the best F1 because `SWaT` is searched over several settings in the provided script.
- If a row is `-`, the corresponding experiment has not been completed yet.
36 changes: 36 additions & 0 deletions reproduction_logs/timesnet_20260321T083250Z/metadata.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
start_utc=2026-03-21T08:32:48Z
root_dir=/root/zm/Time-Series-Library-meter-main_success
conda_env=timesnet
gpu=0
hostname=ubuntu2204-cygtest-hgxtest

[python]
Python 3.10.19

[torch]
torch_version= 2.6.0+cu124
cuda_available= True
device_count= 1
device0= NVIDIA A800 80GB PCIe

[nvidia-smi]
Sat Mar 21 08:32:50 2026
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.144.03 Driver Version: 550.144.03 CUDA Version: 12.4 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA A800 80GB PCIe Off | 00000000:00:1A.0 Off | 0 |
| N/A 55C P0 69W / 300W | 1MiB / 81920MiB | 0% Default |
| | | Disabled |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| No running processes found |
+-----------------------------------------------------------------------------------------+
Binary file not shown.
2 changes: 1 addition & 1 deletion scripts/long_term_forecast/ETT_script/TimesNet_ETTh1.sh
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
export CUDA_VISIBLE_DEVICES=2
export CUDA_VISIBLE_DEVICES=0

model_name=TimesNet

Expand Down
Loading