Skip to content

Commit 306f69a

Browse files
amakropoulosamakropoulos
committed
set the number of parallel prompts to 1 by default in the samples
1 parent 43f0729 commit 306f69a

7 files changed

Lines changed: 32 additions & 8 deletions

File tree

‎Samples~/ChatBot/Scene.unity‎

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -657,7 +657,7 @@ MonoBehaviour:
657657
_SSLKey:
658658
_numThreads: -1
659659
_numGPULayers: 0
660-
_parallelPrompts: -1
660+
_parallelPrompts: 1
661661
_contextSize: 8192
662662
_batchSize: 512
663663
_model:
@@ -1152,6 +1152,9 @@ MonoBehaviour:
11521152
ignoreEos: 0
11531153
save:
11541154
debugPrompt: 0
1155+
overflowStrategy: 1
1156+
overflowTargetRatio: 0.5
1157+
overflowSummarizePrompt:
11551158
_slot: -1
11561159
_systemPrompt: A chat between a curious human and an artificial intelligence assistant.
11571160
The assistant gives helpful, detailed, and polite answers to the human's questions.

‎Samples~/FunctionCalling/Scene.unity‎

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -738,6 +738,9 @@ MonoBehaviour:
738738
ignoreEos: 0
739739
save:
740740
debugPrompt: 0
741+
overflowStrategy: 1
742+
overflowTargetRatio: 0.5
743+
overflowSummarizePrompt:
741744
_slot: -1
742745
_systemPrompt: You are an AI assistant and your task is to answer multiple choice
743746
questions
@@ -1455,7 +1458,7 @@ MonoBehaviour:
14551458
_SSLKey:
14561459
_numThreads: -1
14571460
_numGPULayers: 0
1458-
_parallelPrompts: -1
1461+
_parallelPrompts: 1
14591462
_contextSize: 8192
14601463
_batchSize: 512
14611464
_model:

‎Samples~/KnowledgeBaseGame/Scene.unity‎

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2125,7 +2125,7 @@ MonoBehaviour:
21252125
_SSLKey:
21262126
_numThreads: -1
21272127
_numGPULayers: 0
2128-
_parallelPrompts: -1
2128+
_parallelPrompts: 1
21292129
_contextSize: 8192
21302130
_batchSize: 512
21312131
_model:
@@ -4377,6 +4377,9 @@ MonoBehaviour:
43774377
ignoreEos: 0
43784378
save:
43794379
debugPrompt: 0
4380+
overflowStrategy: 1
4381+
overflowTargetRatio: 0.5
4382+
overflowSummarizePrompt:
43804383
_slot: -1
43814384
_systemPrompt: A chat between a curious human and an artificial intelligence assistant.
43824385
The assistant gives helpful, detailed, and polite answers to the human's questions.
@@ -7556,7 +7559,7 @@ MonoBehaviour:
75567559
_SSLKey:
75577560
_numThreads: -1
75587561
_numGPULayers: 0
7559-
_parallelPrompts: -1
7562+
_parallelPrompts: 1
75607563
_contextSize: 8192
75617564
_batchSize: 512
75627565
_model:

‎Samples~/MobileDemo/Scene.unity‎

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -924,6 +924,9 @@ MonoBehaviour:
924924
ignoreEos: 0
925925
save:
926926
debugPrompt: 0
927+
overflowStrategy: 1
928+
overflowTargetRatio: 0.5
929+
overflowSummarizePrompt:
927930
_slot: -1
928931
_systemPrompt: A chat between a curious human and an artificial intelligence assistant.
929932
The assistant gives helpful, detailed, and polite answers to the human's questions.
@@ -1599,7 +1602,7 @@ MonoBehaviour:
15991602
_SSLKey:
16001603
_numThreads: -1
16011604
_numGPULayers: 0
1602-
_parallelPrompts: -1
1605+
_parallelPrompts: 1
16031606
_contextSize: 8192
16041607
_batchSize: 512
16051608
_model:

‎Samples~/MultipleCharacters/Scene.unity‎

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1003,6 +1003,9 @@ MonoBehaviour:
10031003
ignoreEos: 0
10041004
save:
10051005
debugPrompt: 0
1006+
overflowStrategy: 1
1007+
overflowTargetRatio: 0.5
1008+
overflowSummarizePrompt:
10061009
_slot: -1
10071010
_systemPrompt: A chat between a curious human and an artificial intelligence assistant
10081011
named Eve. The assistant gives helpful, detailed, and polite answers to the human's
@@ -1814,7 +1817,7 @@ MonoBehaviour:
18141817
_SSLKey:
18151818
_numThreads: -1
18161819
_numGPULayers: 0
1817-
_parallelPrompts: -1
1820+
_parallelPrompts: 2
18181821
_contextSize: 8192
18191822
_batchSize: 512
18201823
_model:
@@ -2542,6 +2545,9 @@ MonoBehaviour:
25422545
ignoreEos: 0
25432546
save:
25442547
debugPrompt: 0
2548+
overflowStrategy: 1
2549+
overflowTargetRatio: 0.5
2550+
overflowSummarizePrompt:
25452551
_slot: -1
25462552
_systemPrompt: A chat between a curious human and an artificial intelligence assistant
25472553
named Adam. The assistant gives helpful, detailed, and polite answers to the

‎Samples~/RAG/RAGAndLLM_Scene.unity‎

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -400,6 +400,9 @@ MonoBehaviour:
400400
ignoreEos: 0
401401
save:
402402
debugPrompt: 0
403+
overflowStrategy: 1
404+
overflowTargetRatio: 0.5
405+
overflowSummarizePrompt:
403406
_slot: -1
404407
_systemPrompt: 'You are an assistant that answers with phrases from Hamlet.
405408
@@ -1313,7 +1316,7 @@ MonoBehaviour:
13131316
_SSLKey:
13141317
_numThreads: -1
13151318
_numGPULayers: 0
1316-
_parallelPrompts: -1
1319+
_parallelPrompts: 1
13171320
_contextSize: 8192
13181321
_batchSize: 512
13191322
_model:

‎Samples~/SimpleInteraction/Scene.unity‎

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -542,6 +542,9 @@ MonoBehaviour:
542542
ignoreEos: 0
543543
save:
544544
debugPrompt: 0
545+
overflowStrategy: 1
546+
overflowTargetRatio: 0.5
547+
overflowSummarizePrompt:
545548
_slot: -1
546549
_systemPrompt: A chat between a curious human and an artificial intelligence assistant.
547550
The assistant gives helpful, detailed, and polite answers to the human's questions.
@@ -952,7 +955,7 @@ MonoBehaviour:
952955
_SSLKey:
953956
_numThreads: -1
954957
_numGPULayers: 0
955-
_parallelPrompts: -1
958+
_parallelPrompts: 1
956959
_contextSize: 8192
957960
_batchSize: 512
958961
_model:

0 commit comments

Comments
 (0)