Skip to content

README.md

Latest commit

 

History

History
8 lines (6 loc) · 520 Bytes

README.md

File metadata and controls

8 lines (6 loc) · 520 Bytes

compact_llm_test

The repository contains the code (template) used for testing compact LLM models.

  • The QAData.json file contains all 570 questions used to test models from Polish history.
  • The judge_belik.ipynb file contains the code used to evaluate the responses of all tested models in “LLM as judge” mode.
  • The check_response_times.ipynb file contains the code used to determine the normalized response times of the models.
  • Files with the prefix 0experiment_ contain logs from the model tests.