Currently in the code if the splitted_dataset folder doesn't exist, it gets regenerated regardless of import_mode in config.yaml. But if import_mode is True then this shouldn't be necessary because only array_files is used; could add something in pipeline.py later to address this
Currently in the code if the splitted_dataset folder doesn't exist, it gets regenerated regardless of import_mode in config.yaml. But if import_mode is True then this shouldn't be necessary because only array_files is used; could add something in pipeline.py later to address this