Fix a wrong expected SPARQL protocol test result#191
Fix a wrong expected SPARQL protocol test result#191
Conversation
|
I agree the answer should be Not to do with the PR as proposed Test setup in index.html is unclear what "The following RDF files are loaded as appropriate" means. It can mean all read into the same (default) graph, it can mean as named graphs (the implication of this test). It might be better to have a TriG file. Another assumption is that "FROM" picks graphs from the dataset's named graphs. This is, in my experience, the most common behaviour of systems but it isn't the only one permitted. cc @kasei |
|
This seems to be an old error in copying the actual tests from the code into the README file describing the tests. Apparently nobody noticed until you did. Here is the original test code. It shows that the expected behavior is to load rdf files into named graphs before the test run, and then to run a very different query + HTTP parameters than the ones that were mistakenly in the adjacent README markdown document. Since this error seems to have been reproduced whenever the tests were transcribed into what is now the manifest.ttl file (apparently from the README, not the code), I'm not sure the current state is even providing good test coverage compared to the original validator. It might be a good idea to try to dig up what tests were actually approved by the 1.1 WG and figure out if they were (mistakenly) the ones with the error, or if they were approving the tests as encoded in the working code. Then we'll have some fun work in fixing things so that we have the coverage we expect along with whatever WG approvals might be necessary to fix the past mistakes. |
|
Unfortunately, the WG approval does appear to have been on the tests in the README with the mistakes. I'll try to go through the code and the manifest and see if there are any other tests that have mistakes. |
The tests in this manifest were originally meant to declaratively encode the tests implemented in the code: https://github.com/kasei/sparql11-protocolvalidator/blob/master/protocol_validator.cgi#L1104C10-L1120 The tests encoded in that code was used as the basis for approval during the SPARQL 1.1 WG (e.g. here: https://www.w3.org/2009/sparql/meeting/2012-11-20#resolution_3). However, during the attempt to transcrive the tests from code to manifest, many changes were introduced. This commit attempts to update the manifest with an accurate accounting of the requests the original code actually makes when run. Resolves w3c#191.
The tests in this manifest were originally meant to declaratively encode the tests implemented in the code: https://github.com/kasei/sparql11-protocolvalidator/blob/master/protocol_validator.cgi The tests encoded in that code was used as the basis for approval during the SPARQL 1.1 WG (e.g. here: https://www.w3.org/2009/sparql/meeting/2012-11-20#resolution_3). However, during the attempt to transcrive the tests from code to manifest, many changes were introduced. This commit attempts to update the manifest with an accurate accounting of the requests the original code actually makes when run. Resolves w3c#191.
The tests in this manifest were originally meant to declaratively encode the tests implemented in the perl code: https://github.com/kasei/sparql11-protocolvalidator/blob/master/protocol_validator.cgi The tests encoded in that code was used as the basis for approval during the SPARQL 1.1 WG (e.g. here: https://www.w3.org/2009/sparql/meeting/2012-11-20#resolution_3). However, during the attempt to transcrive the tests from code to manifest, many changes were introduced. This commit attempts to update the manifest with an accurate accounting of the requests the original code actually makes when run. Resolves #191.
The tests in this manifest were originally meant to declaratively encode the tests implemented in the perl code: https://github.com/kasei/sparql11-protocolvalidator/blob/master/protocol_validator.cgi The tests encoded in that code was used as the basis for approval during the SPARQL 1.1 WG (e.g. here: https://www.w3.org/2009/sparql/meeting/2012-11-20#resolution_3). However, during the attempt to transcrive the tests from code to manifest, many changes were introduced. This commit attempts to update the manifest with an accurate accounting of the requests the original code actually makes when run. Resolves #191.
The test case "query specifying dataset in both query string and protocol; test for use of protocol-specified dataset"
reads as follows originally:
As far as I understand, the expected result of
trueis wrong, becausedefault-graph-uri) the default graph...data2.rdfdata1.rdf<...data2.rdf>falseAdditionally, the IRI in the query body doesn't use an absolute IRI and there is no base declaration, I have also added the full IRI for thi PR.
An alternative way to fix this would be to leave the expected result at "true" and change the query s.t. it asks for
data2.rdfin the WHERE clause.Please let me know what you think, and (possibly if so) were I am mistaken.
Best regards