✅ examples test from subfolder()[jvm]
✅ examples test()[jvm]

✅ test for splitByNonEscaped()[jvm]
✅ basic test()[jvm]
✅ should resolve placeholders()[jvm]
✅ should join multiline directives()[jvm]

✅ example for findAllFilesMatching()[jvm]
✅ create relative path in case of branchy file tree()[jvm]
✅ example for findDescendantDirectoriesBy()[jvm]
✅ create relative path when config and test resource located in the same directory()[jvm]

✅ simple check with redirection()[jvm]
✅ change multiple echo commands with redirections 2()[jvm]
✅ change multiple echo commands with redirections 3()[jvm]
✅ simple check with redirection without whitespaces at all()[jvm]
✅ check stdout()[jvm]
✅ one long echo()[jvm]
✅ check stdout with redirection()[jvm]
✅ change multiple echo commands with redirections()[jvm]
✅ extra whitespaces shouldn't influence to echo()[jvm]
✅ simple check with redirection without first whitespace()[jvm]
✅ simple check()[jvm]
✅ command without echo()[jvm]
✅ empty command()[jvm]

✅ check stderr with additional warning()[jvm]
✅ check stderr()[jvm]

✅ basic test[mingwX64]
✅ should resolve placeholders[mingwX64]
✅ should join multiline directives[mingwX64]
✅ test for splitByNonEscaped[mingwX64]

✅ example for findAllFilesMatching[mingwX64]
✅ example for findDescendantDirectoriesBy[mingwX64]
✅ create relative path when config and test resource located in the same directory[mingwX64]
✅ create relative path in case of branchy file tree[mingwX64]

✅ empty command[mingwX64]
✅ check stdout[mingwX64]
✅ check stdout with redirection[mingwX64]
✅ command without echo[mingwX64]
✅ simple check[mingwX64]
✅ simple check with redirection[mingwX64]
✅ simple check with redirection without first whitespace[mingwX64]
✅ simple check with redirection without whitespaces at all[mingwX64]
✅ one long echo[mingwX64]
✅ change multiple echo commands with redirections[mingwX64]
✅ change multiple echo commands with redirections 2[mingwX64]
✅ change multiple echo commands with redirections 3[mingwX64]
✅ extra whitespaces shouldn't influence to echo[mingwX64]

✅ checking escaping of percents[mingwX64]

✅ check stderr[mingwX64]
✅ check stderr with additional warning[mingwX64]

✅ config detector regression test on directories()[jvm]

✅ should fail on the invalid file()[jvm]
✅ should detect single file from a directory()[jvm]
✅ should detect multiple files starting from the middle()[jvm]
✅ should detect starting from bottom with multiple parent configs()[jvm]
✅ should detect starting from bottom()[jvm]
✅ should detect single file()[jvm]
✅ should detect config file from single Test file()[jvm]
✅ should detect multiple files starting from top()[jvm]

✅ execute fix plugin on separate files()[jvm]
✅ execute fix plugin in sarif mode()[jvm]
✅ executing fix plugin on save-toml file in directory()[jvm]
✅ executing fix plugin on parental save-toml file()[jvm]
✅ execute fix plugin on folder()[jvm]
✅ check NoIgnoreLines()[jvm]
✅ check IgnoreLines()[jvm]
✅ tests with the same name()[jvm]
✅ check IgnoreLinesIsEmpty()[jvm]

✅ execute warn-plugin with expected warnings from SARIF()[jvm]
✅ executing warn plugin so that no resources will be found()[jvm]
✅ lines that match ignoreLines should be ignored()[jvm]
✅ execute warn-plugin with actual and expected warnings from SARIF()[jvm]
⚪ execute warn plugin with default testFiles()[jvm]
✅ test output file set()[jvm]
⚪ executing warn plugin on parental directory()[jvm]
✅ tests should have a relative path()[jvm]
✅ execute warn plugin on separate files()[jvm]
✅ executing warn plugin on directory()[jvm]
⚪ execute warn plugin with timeout()[jvm]
✅ executing warn plugin on parental save-toml file()[jvm]
✅ executing warn plugin on directory when files are set with regex()[jvm]
⚪ execute warn plugin with included and excluded suites()[jvm]
✅ execute warn-plugin with actual warnings from SARIF()[jvm]
⚪ executing warn plugin on save-toml file in directory()[jvm]

✅ execute fix-and-warn plugin on the directory chapter1()[jvm]
✅ execute fix-and-warn plugin on the directory chapter2()[jvm]
✅ execute fix-and-warn plugin on the directory chapter3()[jvm]

✅ execute fix plugin()[jvm]
✅ execute fix plugin on the directory chapter1()[jvm]

⚪ execute warn plugin on root directory()[jvm]
⚪ execute warn plugin on the directory chapter1()[jvm]
⚪ execute warn plugin on the directory chapter2()[jvm]
⚪ execute warn plugin on the directory chapter3()[jvm]
⚪ execute warn plugin on the directory chapter4()[jvm]

✅ load save toml from middle hierarchy()[jvm]
✅ merge and override two incomplete configs 2()[jvm]
✅ merge and override general configs()[jvm]
✅ merge and override two configs with different fields()[jvm]
✅ merge configs with many parents()[jvm]
✅ override real toml configs()[jvm]
✅ merge real toml configs with empty execFlag in child()[jvm]
✅ merge and override two incomplete configs()[jvm]

✅ should execute single test()[jvm]
✅ detect plugins()[jvm]

✅ resolve value()[jvm]
✅ parse properties file()[jvm]
✅ read not existed properties file()[jvm]
✅ read properties file()[jvm]
✅ read invalid properties file()[jvm]
✅ parse properties file from not existed folder()[jvm]

✅ validate warn section()[jvm]
✅ invalid general section()[jvm]
✅ set defaults to warn section()[jvm]
✅ set defaults to general section()[jvm]
✅ set defaults to fix section()[jvm]
✅ validate warn section 2()[jvm]
✅ validate warn section 3()[jvm]
✅ validate warn section 4()[jvm]

✅ config detector regression test on directories[mingwX64]

✅ should detect single file[mingwX64]
✅ should fail on the invalid file[mingwX64]
✅ should detect single file from a directory[mingwX64]
✅ should detect starting from bottom[mingwX64]
✅ should detect starting from bottom with multiple parent configs[mingwX64]
✅ should detect multiple files starting from top[mingwX64]
✅ should detect multiple files starting from the middle[mingwX64]
✅ should detect config file from single Test file[mingwX64]

✅ execute fix plugin on separate files[mingwX64]
✅ executing fix plugin on save-toml file in directory[mingwX64]
✅ executing fix plugin on parental save-toml file[mingwX64]
✅ execute fix plugin on folder[mingwX64]
✅ check NoIgnoreLines[mingwX64]
✅ check IgnoreLinesIsEmpty[mingwX64]
✅ check IgnoreLines[mingwX64]
✅ execute fix plugin in sarif mode[mingwX64]
✅ tests with the same name[mingwX64]

⚪ execute warn plugin with default testFiles[mingwX64]
✅ execute warn plugin on separate files[mingwX64]
⚪ execute warn plugin with timeout[mingwX64]
✅ executing warn plugin on directory[mingwX64]
✅ executing warn plugin on directory when files are set with regex[mingwX64]
✅ lines that match ignoreLines should be ignored[mingwX64]
✅ test output file set[mingwX64]
⚪ executing warn plugin on parental directory[mingwX64]
⚪ executing warn plugin on save-toml file in directory[mingwX64]
✅ executing warn plugin on parental save-toml file[mingwX64]
✅ executing warn plugin so that no resources will be found[mingwX64]
⚪ execute warn plugin with included and excluded suites[mingwX64]
✅ tests should have a relative path[mingwX64]
✅ execute warn-plugin with expected warnings from SARIF[mingwX64]
✅ execute warn-plugin with actual warnings from SARIF[mingwX64]
✅ execute warn-plugin with actual and expected warnings from SARIF[mingwX64]

✅ execute fix-and-warn plugin on the directory chapter1[mingwX64]
✅ execute fix-and-warn plugin on the directory chapter2[mingwX64]
✅ execute fix-and-warn plugin on the directory chapter3[mingwX64]

✅ execute fix plugin[mingwX64]
✅ execute fix plugin on the directory chapter1[mingwX64]

⚪ execute warn plugin on the directory chapter1[mingwX64]
⚪ execute warn plugin on the directory chapter2[mingwX64]
⚪ execute warn plugin on the directory chapter3[mingwX64]
⚪ execute warn plugin on the directory chapter4[mingwX64]
⚪ execute warn plugin on root directory[mingwX64]

✅ merge and override general configs[mingwX64]
✅ merge and override two incomplete configs[mingwX64]
✅ merge and override two incomplete configs 2[mingwX64]
✅ merge and override two configs with different fields[mingwX64]
✅ merge configs with many parents[mingwX64]
✅ merge real toml configs with empty execFlag in child[mingwX64]
✅ override real toml configs[mingwX64]
✅ load save toml from middle hierarchy[mingwX64]

✅ detect plugins[mingwX64]
✅ should execute single test[mingwX64]

✅ parse properties file[mingwX64]
✅ parse properties file from not existed folder[mingwX64]
✅ resolve value[mingwX64]
✅ read properties file[mingwX64]
✅ read invalid properties file[mingwX64]
✅ read not existed properties file[mingwX64]

✅ set defaults to general section[mingwX64]
✅ invalid general section[mingwX64]
✅ set defaults to warn section[mingwX64]
✅ validate warn section[mingwX64]
✅ validate warn section 2[mingwX64]
✅ validate warn section 3[mingwX64]
✅ validate warn section 4[mingwX64]
✅ set defaults to fix section[mingwX64]

✅ base test()[jvm]

✅ base test[mingwX64]

✅ should detect two files()[jvm]
✅ should calculate diff of discovered files()[jvm]
✅ should detect two files - among other files()[jvm]
✅ test for batchSize()[jvm]

✅ should detect two files[mingwX64]
✅ should detect two files - among other files[mingwX64]
✅ should calculate diff of discovered files[mingwX64]
✅ test for batchSize[mingwX64]

✅ should filter out warnings from other files - absolute paths with testRoot being relative()[jvm]
✅ should filter out warnings from other files - relative paths()[jvm]
✅ should filter out warnings from other files()[jvm]
✅ should convert SARIF report to SAVE warnings()[jvm]
✅ should filter out warnings from other files - absolute paths with testRoot being absolute()[jvm]

✅ should compare warnings()[jvm]

✅ checking the creation of regex messages from strings()[jvm]
✅ regression with regular expressions()[jvm]
✅ checking the search of delimiters in the string()[jvm]

✅ should extract warnings from different text with no line but col()[jvm]
✅ should extract warnings from different text with line and col()[jvm]
✅ should extract warnings from different text with line but no col()[jvm]

✅ warn-plugin test exception()[jvm]
⚪ warn-plugin test - multiple warnings and ignore technical comments()[jvm]
✅ warn-plugin test - multiple warnings and no line-col()[jvm]
✅ warn-plugin test for batchSize()[jvm]
✅ basic warn-plugin test with exactWarningsMatch = false()[jvm]
✅ regression - test resources in multiple directories()[jvm]
✅ warn-plugin test with default warning without line()[jvm]
⚪ basic warn-plugin test with ignoreTechnicalComments=true()[jvm]
✅ warn-plugin test - multiple warnings()[jvm]
✅ basic warn-plugin test()[jvm]
✅ warn-plugin test for all mods()[jvm]

✅ should convert SARIF report to SAVE warnings[mingwX64]
✅ should filter out warnings from other files[mingwX64]
✅ should filter out warnings from other files - relative paths[mingwX64]
✅ should filter out warnings from other files - absolute paths with testRoot being relative[mingwX64]
✅ should filter out warnings from other files - absolute paths with testRoot being absolute[mingwX64]

✅ should compare warnings[mingwX64]

✅ checking the search of delimiters in the string[mingwX64]
✅ checking the creation of regex messages from strings[mingwX64]
✅ regression with regular expressions[mingwX64]

✅ should extract warnings from different text with line and col[mingwX64]
✅ should extract warnings from different text with no line but col[mingwX64]
✅ should extract warnings from different text with line but no col[mingwX64]

✅ basic warn-plugin test[mingwX64]
✅ warn-plugin test with default warning without line[mingwX64]
✅ warn-plugin test for all mods[mingwX64]
✅ basic warn-plugin test with exactWarningsMatch = false[mingwX64]
⚪ basic warn-plugin test with ignoreTechnicalComments=true[mingwX64]
✅ warn-plugin test - multiple warnings[mingwX64]
⚪ warn-plugin test - multiple warnings and ignore technical comments[mingwX64]
✅ warn-plugin test - multiple warnings and no line-col[mingwX64]
✅ warn-plugin test for batchSize[mingwX64]
✅ regression - test resources in multiple directories[mingwX64]
✅ warn-plugin test exception[mingwX64]

✅ should produce valid serialized Report when plugin crashes()[jvm]
✅ should produce valid serialized Report from ordinary data()[jvm]

✅ should produce valid serialized Report from ordinary data[mingwX64]
✅ should produce valid serialized Report when plugin crashes[mingwX64]