RLMs/advanced_results.txt at main · Soum-Code/RLMs · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
Running smart convergence detection experiments against Ollama (gpt-oss:20b)...
Connecting to Ollama model: gpt-oss:20b at http://localhost:11434

################################################################################
COMPARISON TEST 1
################################################################################

============================================================
SMART CONVERGENCE EXPERIMENT
Prompt: Explain quantum computing in simple terms
============================================================

Iteration 1:
Output: ## Quantum Computing in Plain English

### 1. WhatΓÇÖs a ΓÇ£bitΓÇ¥ vs a ΓÇ£qubitΓÇ¥?

| Classical | Quantum |
|-----------|---------|
| **Bit** ΓÇô the tiny unit of information in a regular computer. It can be **...

Iteration 2:
Output: ## Quantum Computing ΓÇô A Simple, Accurate Overview

| **Concept** | **Classical** | **Quantum** |
|-------------|---------------|-------------|
| **Information unit** | **Bit** ΓÇô can be **0** *or* **1...
Stopping decision: Continue iterating

Iteration 3:
Output: ## Quantum Computing ΓÇô A Simple, Accurate Overview

| **Concept**...
Stopping decision: Continue iterating

Iteration 4:
Output: **Quantum Computing ΓÇô A PlainΓÇæEnglish, Accurate Overview**

| Section | What It Means | Why It Matters |
|---------...
Stopping decision: Detected oscillation
≡ƒ¢æ STOPPING at iteration 4

========================================
FINAL ANALYSIS
========================================
Total iterations: 4
Execution time: 268.00s
Statistical convergence: {'converged': np.False_, 'confidence': np.float64(0.875688164196108), 'variance': np.float64(0.0022949603697036817), 'mean_similarity': np.float64(0.7618183692296346)}

Results saved for 'Explain quantum computing in simple terms...'

################################################################################
COMPARISON TEST 2
################################################################################

============================================================
SMART CONVERGENCE EXPERIMENT
Prompt: What caused the Great Depression?
============================================================

Iteration 1:
Output: ...

Iteration 2:
Output: ...
Stopping decision: Continue iterating

Iteration 3:
Output: ...
Stopping decision: Continue iterating

Iteration 4:
Output: **What caused the Great Depression?**

The Great Depression was not the result of a single event...
Stopping decision: Continue iterating

Iteration 5:
Output: ...
Stopping decision: Continue iterating

Iteration 6:
Output: **The Great Depression was not caused by a single event or policy,...
Stopping decision: Max iterations reached
≡ƒ¢æ STOPPING at iteration 6

========================================
FINAL ANALYSIS
========================================
Total iterations: 6
Execution time: 214.71s
Statistical convergence: {'converged': np.False_, 'confidence': np.float64(0.0), 'variance': np.float64(0.0), 'mean_similarity': np.float64(0.0)}

Results saved for 'What caused the Great Depression?...'

################################################################################
COMPARISON TEST 3
################################################################################

============================================================
SMART CONVERGENCE EXPERIMENT
Prompt: Describe the process of photosynthesis
============================================================

Iteration 1:
Output: **Photosynthesis...

Iteration 2:
Output: ...
Stopping decision: Continue iterating

Iteration 3:
Output: **Photosynthesis** is the biochemical process by which green plants, algae, and some bacteria convert light energy into chemical energy stored in...
Stopping decision: Continue iterating

Iteration 4:
Output: ...
Stopping decision: Continue iterating

Iteration 5:
Output: ...
Stopping decision: Continue iterating

Iteration 6:
Output: ...
Stopping decision: Max iterations reached
≡ƒ¢æ STOPPING at iteration 6

========================================
FINAL ANALYSIS
========================================
Total iterations: 6
Execution time: 214.73s
Statistical convergence: {'converged': np.False_, 'confidence': np.float64(0.0), 'variance': np.float64(0.0), 'mean_similarity': np.float64(0.0)}

Results saved for 'Describe the process of photosynthesis...'

TEST_1 REPORT:
  total_iterations: 4
  average_semantic_similarity: 0.7618183692296346
  oscillation_tendency: 1.0
  keyword_stability: 0.2904977375565611
  converged_quick_check: False

TEST_2 REPORT:
  total_iterations: 6
  average_semantic_similarity: 0.0
  oscillation_tendency: 0.0
  keyword_stability: 0.0
  converged_quick_check: False

TEST_3 REPORT:
  total_iterations: 6
  average_semantic_similarity: 0.0
  oscillation_tendency: 0.0
  keyword_stability: 0.0
  converged_quick_check: False