Skip to content

Commit 608ac68

Browse files
author
Chris Warren-Smith
committed
LLAMA: reset token_generate at start of message
1 parent dbd4dfb commit 608ac68

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

llama/llama-sb.cpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -312,6 +312,7 @@ bool Llama::add_message(LlamaIter &iter, const string &role, const string &conte
312312
}
313313
}
314314

315+
iter._tokens_generated = 0;
315316
iter._t_start = std::chrono::high_resolution_clock::now();
316317
iter._llama = this;
317318
iter._has_next = true;

0 commit comments

Comments
 (0)