Skip to content

Some pytest tests fail locally following docs #18072

@GregoryComer

Description

@GregoryComer

🐛 Describe the bug

On Apple Silicon, there are some tests that fail or spit out warnings when following docs and running pytest -n auto. This is likely an env setup issue, but we should make sure that the tests are clean on a fresh install.

[method.cpp:74] Backend BackendWithCompilerDemo is not registered.
============================================================================================================== short test summary info ==============================================================================================================
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR backends/xnnpack/test/quantizer/test_pt2e_quantization.py - AttributeError: '_OpNamespace' 'mkldnn' object has no attribute '_is_mkldnn_acl_supported'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_fetch_execu_torch_data_failure - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_fetch_execu_torch_data_success - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_filter_out_failure_only - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_filter_private_results - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_filter_public_result - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_get_base_url - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_init - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_invalid_iso8601 - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_normalize_string - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_output_data - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_output_type_values - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_run_no_data - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_run_with_failure_report - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_run_with_filters - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_run_with_public_match - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_run_without_public_match - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_to_csv - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_to_df - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_to_dict - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_to_excel - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_to_json - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_to_output_type - ModuleNotFoundError: No module named 'yaspin'
ERROR .ci/scripts/tests/test_get_benchmark_analysis_data.py::TestBenchmarkAnalysis::test_valid_iso8601 - ModuleNotFoundError: No module named 'yaspin'
FAILED exir/backend/test/test_compatibility.py::TestCompatibility::test_compatibility_in_runtime - RuntimeError: Failed to execute method forward, error: 0x20
FAILED exir/backend/test/test_compatibility.py::TestCompatibility::test_compatibility_in_runtime_edge_program_manager - RuntimeError: Failed to execute method forward, error: 0x20
FAILED exir/backend/test/test_lowered_backend_module.py::TestBackendAPI::test_emit_lowered_backend_module_end_to_end - RuntimeError: Failed to execute method forward, error: 0x20
FAILED exir/backend/test/test_to_backend_multi_method.py::TestToBackendMultiMethod::test_multi_method_end_to_end - RuntimeError: Failed to execute method forward, error: 0x20

Versions

Nightly

cc @mergennachin @byjlw

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Status

To triage

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions