Exit code is 1 when whole file fails, but 0 when individual tests fail about pytest HOT 2 CLOSED

This exits with code 1:

class TestBug
    def test_bug(self) -> None:
        assert True

ERROR tests/unit/server/util/garbo_test.py

This is a SyntaxError during collection, causing no tests to ever run, and pytest to exit with exit status 2. After fixing the missing :, this is a passing test. There is no reason why it should fail.

edit: Ah, I suppose the syntax error might have been intended, and I see how you could get the output you posted. However, I don't see why this should exit with exit code 1 rather than 2. Are you actually running pytest, or some wrapper script around it?

This exits with code 0:

class TestBug:
    def test_bug(self) -> None:
        a = fake_var

ERROR tests/unit/server/util/garbo_test.py::TestBug::test_bug - NameError: name 'fake_var' is not defined

I see no reason why it should, this seems like an issue in your environment of some sort (e.g. a wrapper script around pytest).

If the SyntaxError wasn't intended, please show a complete, runnable example that actually exhibits the problem you're describing- and in any case, please show the full output of running pytest and getting the exit code on it.

from pytest.

You were right! I found a sneaky conftest that was manipulating the reports in an incorrect way. Thanks

from pytest.