Is your feature request related to a problem? Please describe.

When running mypy across a project that imports diffit, the follow error is reported:

error: Skipping analyzing "diffit": module is installed, but missing library stubs or py.typed marker  [import]
note: See https://mypy.readthedocs.io/en/stable/running_mypy.html#missing-imports

As per the mypy documentation:

If you are getting a Skipping analyzing X: module is installed, but missing library stubs or py.typed marker, error, this means mypy was able to find the module you were importing, but no corresponding type hints.

Describe the solution you would like.

Add type hints to diffit and a corresponding py.typed.

Describe alternatives you have considered.

Set ignore_missing_imports in the project.

Additional context

Add any other context or screenshots about the feature request here.

Describe the bug.

Error installing diffit as a package dependency to my project's setup.cfg. Error produced:

/config/setupcfg.py", line 598, in _parse_version
          raise DistutilsOptionError(tmpl.format(**locals()))
      distutils.errors.DistutilsOptionError: Version loaded from file: src/diffit/VERSION does not comply with PEP 440:
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

Steps to reproduce the behavior.

1. Add diffit to setup.cfg using git style format:

   [options.extras_require]
   dev =
       diffit @ git+https://github.com/loum/[email protected]
   

2. Install:

pip install -e .[dev]

Expected behavior.

diffit installs into my project.

Screenshots.

If applicable, add screenshots to help explain your problem.

Additional context.

Add any other context about the problem here.

Is your feature request related to a problem? Please describe.

Generating Spark DataFrames can be a drag. Having a tool that could create one dynamically for testing and analysis purposes would be handy.

Describe the solution you would like.

An extension of the diffit tool with a dataframe create subsystem.

Describe alternatives you have considered.

Creating Spark DataFrames manually.

Additional context

Add any other context or screenshots about the feature request here.

• Switch argparse for Typer.

Describe the bug.

The container image build process does not run to completion.

Steps to reproduce the behavior.

1. Run make image-build
2. See error:

...
 => ERROR [ 9/10] COPY src/bin/diff.py /scripts/diff.py                                                                      0.0s
------
 > [ 9/10] COPY src/bin/diff.py /scripts/diff.py:
------
failed to compute cache key: "/src/bin/diff.py" not found: not found

Expected behavior.

The container image should be created.

Screenshots.

If applicable, add screenshots to help explain your problem.

Additional context.

Add any other context about the problem here.

Spark's logging consumes the root logger and suppresses valid diffit log messages.

Is your feature request related to a problem? Please describe.

diffit currently supports dropping columns from a row level check. However, there is not support for selecting columns to add to the differential engine.

Describe the solution you would like.

Analogous to the drop switch, provide capability to add columns to the differential engine.

Describe alternatives you have considered.

In the case of running the differential engine on a subset of columns, we have to resort to multiple drop assignments. This is not practical for large data sets.

Additional context

Add any other context or screenshots about the feature request here.

Makester 0.2.2 is available.