E.g. currently:
% cd feditest-tests-sandbox jernst$ ../feditest/venv/bin/feditest run --tap
2024-05-01T17:08:52Z [ERROR] feditest: FAILED test assertion: sandbox.example_test_with_functions::example_test2:
Expected: <-56>
but: was <0>
Traceback (most recent call last):
File "/Users/jernst/git/github.com/fediverse-devnet/feditest/venv/lib/python3.12/site-packages/feditest/__init__.py", line 91, in run
self.test_function(**args)
File "/Users/jernst/git/github.com/fediverse-devnet/feditest-tests-sandbox/tests/sandbox/example_test_with_functions.py", line 51, in example_test2
assert_that(c, equal_to(-56))
File "/Users/jernst/git/github.com/fediverse-devnet/feditest/venv/lib/python3.12/site-packages/hamcrest/core/assert_that.py", line 58, in assert_that
_assert_match(actual=actual_or_assertion, matcher=matcher, reason=reason)
File "/Users/jernst/git/github.com/fediverse-devnet/feditest/venv/lib/python3.12/site-packages/hamcrest/core/assert_that.py", line 73, in _assert_match
raise AssertionError(description)
AssertionError:
Expected: <-56>
but: was <0>
TAP version 14
# test plan: None
# session: session_0
# constellation: A_vs_1
# name: A_vs_1
# roles:
# - name: client
# driver: sandbox.SandboxMultClientDriver_ImplementationA
# - name: server
# driver: sandbox.SandboxMultServerDriver_Implementation1
ok 1 - sandbox.example_test_with_functions::example_test1
ok 2 - sandbox.example_test_with_functions::example_test2
ok 3 - sandbox.example_test_with_classes::ExampleTest1
# session: session_1
# constellation: A_vs_2
# name: A_vs_2
# roles:
# - name: client
# driver: sandbox.SandboxMultClientDriver_ImplementationA
# - name: server
# driver: sandbox.SandboxMultServerDriver_Implementation2Faulty
ok 4 - sandbox.example_test_with_functions::example_test1
not ok 5 - sandbox.example_test_with_functions::example_test2
---
problem: |
Expected: <-56>
but: was <0>
...
ok 6 - sandbox.example_test_with_classes::ExampleTest1
1..6
# test run summary:
# total: 6
# passed: 5
# failed: 1
# skipped: 0