New version of form-processing script for updated schema - #191
New version of form-processing script for updated schema#191Dvermetten wants to merge 11 commits into
Conversation
|
Now adresses #186 |
There was a problem hiding this comment.
Github action generate_html fails:
- when running
uv run yaml_to_html.py, becauseproblems.yamlcontains'?'where input should be'yes', 'no', 'some' or 'unknown'. - Happens at least for:
suite_morepoandsuite_cec2015_dmoo - Maybe these are ouput of the form processing script? Otherwise we can just change them to
unknownand that should fix it
Github action check_new_problems fails:
- it cannot find module
pydantic_yaml - Maybe the problem is that:
pydantic_yamlis inrequirements.txtbut not inutils/requirements.txt - When running with
uv run utils/validate_yaml.py problems.yaml(rather thanpython utils/validate_yaml.py problems.yamlas in the action), the action fails withImportError: cannot import name 'default_columns' from 'yaml_to_html'
Execution of formresponse_to_yaml.py fails:
- When run with
uv run formresponse_to_yaml.py, the errorNo such file or directory: 'responses_OPL.csv'comes up - Suggestion: Change the default file name to the correct one
- Suggestion 2: Add instructions in a README (maybe in
utils? Perhaps this entire script should go there?) on how thi should be executed. - When run with
uv run formresponse_to_yaml.py --csv OPL_form.csvexecution fails with 44 validation errors -- Seemingly about execution times not being in the format expected by pydantic (but maybe not limited to that)
|
Merging main back in did no resolve any of these issues. |
These are not from the processing, but I did change them to unknown anyway
I tried changing this to uv, but I think I overlooked something, will check this next week. The column naming this is fixed now
It seems I forgot to upload the readme last time, that is included now (should also fix the wrong default name for the csv). The validation errors remain an issue, I tried changing how the times are handled but either way I do it the validator complains: If I make it a string:
If I make it a set:
@olafmersmann Do you maybe know what I'm missing here? |
New (generated) script for converting the form responses (csv file) to the updated schema.