Add code coverage to Janssen about home HOT 3 OPEN

Successfully integrated code coverage for fork of jans-auth-server with codacy. Now Codacy is reporting code coverage.

from home.

After integrating code coverage, when I looked at Codacy code analysis and coverage reports I found them lacking in few key aspects. Few of them are as below:

• Doesn't present code in a hierarchical structure. Just lists file names with relative path. So, if you want to see which package is having least code coverage, you can't.
• On the coverage detail page, Codacy doesn't give clear idea about how many lines of code that class has. This is important as smaller classes tend to have more coverage and larger classes tend to lag. Aspect of size is missing in the file listing.
• Doesn't show branch/condition coverage anywhere

So, I am evaluating better alternatives.

After Codacy, second tool that we are familiar with is Codeov.com. But this is only code coverage tool and not static code analysis. What we need is a tool that gives a complete view of code quality, all at one place. So, eliminating this option.

Third tool is SonarCloud. Below is comparative feature analysis of Codacy and SonarCloud.

Few more points:

• IDE integration: Sonar has better IDE integration via SonarLint plug-in. Specially because it can connect to central SonarCloud project from where we can enable/disable rules which would then percolate to IDEs of all contributing developers. This is not possible in Codacy where you have to use PMD plug-in to see analysis locally in IDE.
• Lower learning curve: Sonar and SonarLint are widely used and most of the developers are
• Rule set: SonarCloud seems to have more robust rule set. When I tried both tools on few obvious issues (like possible NullPointer), Sonar did catch it but not Codacy.
• Inline issue reporting in PR:
  Codacy is better at this. It annotates issues in code within Github itself. So, you don't have to leave your PR page on Github to check what issues were reported. Against this, Sonar provides summary of issues found in PR conversion tab with links that take you to SonarCloud. Once you are on SonarCloud, you can see code annotated with issues and give comments. This feature is being worked by SonarCloud team and would be available in some future release.

My view is that we should use SonarCloud instead of Codacy for Janssen. Please do chime in with your thoughts.

from home.

Post monorepo move:
Plan is to move away from Jenkins CI-CD and use GH actions. We need to be able to run tests and report code coverage to sonar for further reporting.

from home.