Giter VIP home page Giter VIP logo

pytest-pyvista's Introduction

pytest-pyvista

PyPI version Python versions GitHub Actions: Unit Testing and Deployment

Plugin to test PyVista plot outputs.


This pytest plugin was generated with Cookiecutter along with @hackebrot's cookiecutter-pytest-plugin template.

Features

This plugin facilitates the comparison of the images produced by PyVista. It generates a cache of images from the tests, using the PyVista plotting function in its first execution. Then, further executions will compare its results against this cache, so if there are any changes in the code that break the image generation, the comparison against the cache will notice it. Note that there is an error tolerance in the comparison, so minor differences won't fail.

Requirements

You must have a Python version greater than 3.7, as well as PyVista installed in your environment.

pyvista version >=0.37.0 required.

Installation

You can install "pytest-pyvista" via pip from PyPI:

$ pip install pytest-pyvista

Usage

Once installed, you only need to use the command pl.show() in your test. The plugin will automatically manage the cache generation if it does not exist, and the image comparison itself. Make sure you enable pv.OFF_SCREEN when loading PyVista, so the pl.show() doesn't pop up any window while testing. By default, the verify_image_cache fixture should be used for each test for image comparison:

import pyvista as pv
pv.OFF_SCREEN = True
def test_succeeds(verify_image_cache):
    pl = pyvista.Plotter()
    pl.add_mesh(pyvista.Sphere(), show_edges=True)
    pl.show()

If most tests utilize this functionality, possibly restricted to a module, a wrapped version could be used:

@pytest.fixture(autouse=True)
def wrapped_verify_image_cache(verify_image_cache):
    return verify_image_cache

If you need to use any flag inside the tests, you can modify the verify_image_cache object in the test:

import pyvista as pv
pv.OFF_SCREEN = True
def test_succeeds(verify_image_cache):
    verify_image_cache.windows_skip_image_cache = True
    pl = pyvista.Plotter()
    pl.add_mesh(pyvista.Sphere(), show_edges=True)
    pl.show()

Global flags

These are the flags you can use when calling pytest in the command line:

  • --reset_image_cache creates a new image for each test in tests/plotting/test_plotting.py and is not recommended except for testing or for potentially a major or minor release.
  • You can use --ignore_image_cache if you want to temporarily ignore regression testing, e.g. on a particular CI action.
  • When using --fail_extra_image_cache if there is an extra image in the cache, it will report as an error.
  • --generated_image_dir <DIR> dumps all generated test images into <DIR>.
  • --add_missing_images adds any missing images from the test run to the cache.
  • --skip_image_cache_vtk8 allows for skipping all tests if vtk==8.x is being used. Otherwise, an error is raised by default.
  • --image_cache_dir <DIR> sets the image cache dir. This will override any configuration, see below.

Test specific flags

These are attributes of verify_image_cache. You can set them as True if needed in the beginning of your test function.

  • high_variance_test: If necessary, the threshold for determining if a test will pass or not is incremented to another predetermined threshold. This is currently done due to the use of an unstable version of VTK, in stable versions this shouldn't be necessary.
  • windows_skip_image_cache: For test where the plotting in Windows is different from MacOS/Linux.
  • macos_skip_image_cache: For test where the plotting in MacOS is different from Windows/Linux.
  • skip: If you have a test that plots a figure, but you don't want to compare its output against the cache, you can skip it with this flag.

Configuration

If using pyproject.toml or any other pytest configuration section, consider configuring your test directory location to avoid passing command line arguments when calling pytest, for example in pyproject.toml

[tool.pytest.ini_options]
image_cache_dir = "tests/plotting/image_cache"

Contributing

Contributions are always welcome. Tests can be run with tox, please ensure the coverage at least stays the same before you submit a pull request.

License

Distributed under the terms of the MIT license, pytest-pyvista is free and open source software.

Issues

If you encounter any problems, please file an issue along with a detailed description.

pytest-pyvista's People

Contributors

akaszynski avatar alejandrofernandezluces avatar dependabot[bot] avatar matthewflamm avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.