msporna / lava-test-coverage Goto Github PK

Test coverage tool supporting unity games (c#), android apps (java) and javascript. Gathers coverage on the fly, as software is being tested.

Home Page: https://msporna.github.io/LAVA-test-coverage/

License: MIT License

Python 12.15% Batchfile 0.01% JavaScript 5.45% CSS 0.64% HTML 80.95% C# 0.47% Java 0.33%

test-coverage code-coverage selenium-test-coverage unity-test-coverage selenium unity3d flask android-test-coverage runtime-coverage

lava-test-coverage's Introduction

WHAT IS THIS?

This is a test coverage tool that is intended to work with black box functional tests. It does not matter what language your tests are written in or if you perform manual testing instead of automated. Source code of app under test is modified to contain probes (and then it's compiled along with them) that report back to LAVA's backend which processes the statistics. It gathers coverage stats on the fly, as app is running and testing is being done.

The tool is aimed for QA engineers that want to see what % of the tested app's code their functional tests cover.

FEATURES

measure how much code of application under tests was executed by testing activity (manual or automated)
- it can be done for:
  - Unity3D games (c#)
  - Android (Java) apps
  - Javascript web apps (vanilla)
web based dashboard for viewing coverage reports and managing coverage sessions
html report is automatically saved to drive after each coverage session and can be easily shared
exposed rest API allows easy integration with any CI tool
source files are instrumented automatically
detected source files are grouped into modules - gather coverage only for source files relevant to test session
view timeline of code execution - see sources & executed lines sorted by execution time
assign tag, owner and build number to the coverage session to relate it to the build being covered and easily integrate with your existing CI process
view total coverage for specific build within specific release and see if your testing improved from build to build

DOCUMENTATION

--> Getting Started

Head over to the Wiki section for more.

Article on how to get it running with a sample Unity3D game: Treasure hunting in video game testing: a tale about using a test coverage tool with Unity3D…

TRY IT IN THE BROWSER

WEBGL UNITY GAME

I prepared a webGL game that simulates the tool and allows you to see how it works directly in your browser

You can play it here: https://msporna.github.io/LAVA-test-coverage/lava_game/

It's just a simulation to give you an overview. Note that the game shows version 2 of the tool which varies slightly from the most recent version.

EXAMPLES

There are 3 examples available:

CURRENT VERSION

lava-test-coverage's People

Contributors

Stargazers

Watchers

Forkers

as3mbus icyace shivam294

lava-test-coverage's Issues

add support for multiple projects

Lava should support multiple projects in 1 instance.

Could not find a version that satisfies the requirement re (from versions: none)

the pip reqiuirement cant be installed. is there any replacement for this thanks

migrate to python 3

it is time to move on to python 3.

In version-3, can it support for Angular app

Hi Michal,
Greeting , I hope your doing well.
can it support for Angular app and Web services as well in version 3.

thanks for you help!!

Introduce endpoints to automate lava processes

create or modify endpoints for users to be able to do the whole Lava cycle automatically.

based on task #26

IndexError: list index out of range, cause unknown

Particular scripts in my project are causing the formatting process to throw an error.

I believe it's caused by scripts using these calls:

StartCoroutine(Util.RoutineTimer.WaitForFrames(1, () => {
                            //do logic
		}));

Util.RoutineTimer.WaitForFrames:

public static IEnumerator WaitForFrames(int frames, Action callback)
		{
			for(int i=0; i<frames; i++)
			{
				yield return new WaitForEndOfFrame();
			}
			callback();

		}

Gives me the following error when formatting the file with the above call:

Traceback (most recent call last):
  File "D:\Programs\LAVA-test-coverage-master\client\instrument_client.py", line 922, in <module>
    instrumenter.prepare(json_path)
  File "D:\Programs\LAVA-test-coverage-master\client\instrument_client.py", line 172, in prepare
    self.insert_instrument_function()  # to js or source files
  File "D:\Programs\LAVA-test-coverage-master\client\instrument_client.py", line 601, in insert_instrument_function
    self.insert_instrument_function_into_csharp()
  File "D:\Programs\LAVA-test-coverage-master\client\instrument_client.py", line 642, in insert_instrument_function_into_csharp
    1]
IndexError: list index out of range

It works fine when trying it with folders that don't contain these scripts.

Documentation on API usage

I am trying to automate the process through unity test runner command line combined with lava.

i did able to do unity test runner with lava through using coroutine to wait till lava request are sent to server. (which i think isnt ideal for my case tbh.)

for now i just try to automate UI i needed to apply in lava dashboard so i wont need to set things up like, module, and assgined files.

so i ended up looking at server code and find out that most of the stuff are done through api call. but there are still no api documentation for it which troubles me figuring stuff out since i never developed flask before.

i do could try using api call for each stuff but it isnt clear enough

create documentation for api endpoints that can be used by 3rd party

create swagger or other doc for current and future endpoints usable by 3rd party.

related to task #27