Lens is a comprehensive assessment framework for AI systems. Lens standardizes model and data assessment, and acts as a central gateway to assessments created in the open source community. In short, Lens connects arbitrary AI models and datasets with Responsible AI tools throughout the ecosystem.

Lens can be run in a notebook, a CI/CD pipeline, or anywhere else you do your ML analytics. It is extensible, and easily customized to your organizations assessments if they are not supported by default.

Though it can be used alone, Lens shows its full value when connected to your organization's Credo AI App. Credo AI is an end-to-end AI Governance App that supports multi-stakeholder alignment, AI assessment (via Lens) and AI risk assessment.

• Credo AI Lens supports Python 3.7+
• Sphinx (optional for local docs site)

The latest stable release (and required dependencies) can be installed from PyPI. Note this installation only includes dependencies needed for a small set of modules

pip install credoai-lens

To include additional dependencies needed for some modules and demos, use the following installation command.

On Mac

pip install 'credoai-lens[extras]'

On Windows

pip install credoai-lens[extras]

Modules that require extras include:

• nlp_generator

Installation sometimes fails on M1 macbooks. Specifically, pandas, scipy, and scikit-learn may fail to build. Installing these packages with the anaconda package manager seems to be the easiest way to circumvent this issue.

For development, the easiest way to interact with Lens is to use anaconda.

conda env create --file environment.yml

To get started, see the quickstart demo.

If you are using the Credo AI Governance App, also check out the governance integration demo.

A listing and overview of all the demonstration notebooks are available here.

Documentation is hosted by readthedocs.

For dev documentation, see latest.

To connect to Credo AI's Governance App, enter your connection info in ~/.credoconfig (".credoconfig" in the root directory) using the below format.

TENANT={tenant name} # Example: credoai
API_KEY=<your api key> # Example: JSMmd26...