nirizr / pytest-idapro Goto Github PK

• Run inside IDA to allow testing in a real environment (PR #28).
• Automatically try IDA testing for tests that fail on mocked environment.
• Record and replay results of all IDAPython API calls while running inside IDA (PR #35).

• Mockup/internal only marker
• Prevent recording marker
• Dialog fixture

Doing this manually is too slow and annoying.

Using one or more of the following options:

• 1. Record all idapython functions being called while running in IDA, log responses and mock them up.
• 2. Parse the idapython repo, the IDA sdk or something similar to autogenerate the APIs.
• 3. Using https://github.com/williballenthin/python-idb and a few IDBs, mock API calls by implementing them as pyidb calls (not sure this actually saves time).

Currently when running in IDA (i.e. specifying the --ida flag) coverage is properly recorded but:

• Result summary is not properly displayed in external pytest session (it is displayed inside IDA).
• External pytest instance (in internal mode) overwrites the internal session's .coverage file with it's own results which are mostly empty.

There may be other minor issues with some pytest-cov flags.

• exception handling for virtual functions.
• Qt App process events wrapper/fixture/test context

Bonus points: record return values from ida api functions to replay them when mocking

From https://github.com/nirizr/rematch/blob/master/tests/idaplugin/test_plugin.py#L7
to this repo as a utility

Right now pytest runs in IDA's main thread. It may be beneficial to spawn a secondary thread (Qt thread? Python thread?) for pytest before starting it.

See https://stackoverflow.com/q/51737378/1146713 for more information

The following items are nice-to-haves now that basic record/replay functionality is in.

• replay multiple files in a single test run.
• support replay for python 3 although record was done with python 2.
• support external execution from python 3 although IDA instance runs with python 2.
• Proxy classes themselves to get class attributes This seems unnecessary for now.
• return correct class proxy for __class__ attributes. This seems unnecessary for now.
• support __subclasses__, __bases__, __mro__ and the likes. This seems unnecessary for now.
• Selecting the proper callback recoding (if more than one) in function callback replaying?
• Include a test identifier (such as test name or index) in "instance_desc" dictionaries.
• catch replay exceptions for missing attributes or key dict names and translate them to the correct record meaning.
• Fix remaining issues with instance matching for instances involved in callbacks.