Giter VIP home page Giter VIP logo

casper-smet / harvard-gf-quantization Goto Github PK

View Code? Open in Web Editor NEW

This project forked from harvard-ophthalmology-ai-lab/harvard-gf

0.0 0.0 0.0 2.28 MB

Investigating the effects of quantization on: [IEEE Transactions on Medical Imaging 2024] Harvard Glaucoma Fairness: A Retinal Nerve Disease Dataset for Fairness Learning and Fair Identity Normalization

Home Page: https://ophai.hms.harvard.edu/datasets/harvard-gf3300/

License: MIT License

Shell 0.27% Python 17.40% Jupyter Notebook 82.33%

harvard-gf-quantization's Introduction

Harvard-GF

The dataset and code for the paper entitled Harvard Glaucoma Fairness: A Retinal Nerve Disease Dataset for Fairness Learning and Fair Identity Normalization. The abbreviation of our dataset is Harvard-GF, which stands for Harvard Glaucoma Fairness. Note that, the modifier word “Harvard” only indicates that our dataset is from the Department of Ophthalmology of Harvard Medical School and does not imply an endorsement, sponsorship, or assumption of responsibility by either Harvard University or Harvard Medical School as a legal identity.

Dataset

The dataset can be accessed via this link. This dataset can only be used for non-commercial research purposes. At no time, the dataset shall be used for clinical decisions or patient care. The data use license is CC BY-NC-ND 4.0.

The glaucoma data of 3,300 patients includes 3,300 OCT RNFLT maps (dimensions 200 x 200 x 200). The visual field, patient age, sex, race, and glaucoma label information are also included in the data. 2100 samples are for training, 300 samples for validation, and 900 samples for testing. A unique strength of this dataset is that we have equal numbers for the three racial groups Asian, Black, and White.

Each data contains the following attributes:

  1. rnflt: OCT RNFLT map of size 200 x 200.
  2. oct_bscans: 3D OCT B-scans image of size 200 x 200 x 200.
  3. glaucoma: glaucomatous status, 0 for non-glaucoma and 1 for glaucoma.
  4. md: mean deviation value of visual field.
  5. tds: 52 total deviation values of visual field.
  6. age: patient age.
  7. male: patient sex, 0 for female and 1 for male.
  8. race: patient race, 0 for Asian, 1 for Black or African American, and 2 for White or Caucasian.
  9. marital status: 0 for Married/Civil Union, Life Partner, 1: Single, 2: Divorced, 3: Widowed, 4: Legally Separated, and -1: Unknown
  10. ethnicity: 0: Non-Hispanic, 1: Hispanic, and -1: Unknown
  11. language: 0: English, 1: Spanish, 2: Others, and -1: Unknown

Abstract

Fairness (also known as equity interchangeably) in machine learning is important for societal well-being, but limited public datasets hinder its progress. Currently, no dedicated public medical datasets with imaging data for fairness learning are available, though minority groups suffer from more health issues. To address this gap, we introduce Harvard Glaucoma Fairness (Harvard-GF), a retinal nerve disease dataset with both 2D and 3D imaging data and balanced racial groups for glaucoma detection. Glaucoma is the leading cause of irreversible blindness globally with Blacks having doubled glaucoma prevalence than other races. We also propose a fair identity normalization (FIN) approach to equalize the feature importance between different identity groups. Our FIN approach is compared with various the-state-of-the-art fairness learning methods with superior performance in both racial and gender fairness tasks with 2D and 3D imaging data, which demonstrate the utilities of our dataset Harvard-GF for fairness learning. To facilitate fairness comparisons between different models, we propose an equity-scaled performance measure, which can be flexibly used to compare all kinds of performance metrics in the context of fairness.

Requirements

The project is based on PyTorch 1.13.1+. To install, execute

conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia

Experiments

To run the experiments, execute the scripts in scripts, e.g.,

./scripts/train_glaucoma_fair_fin.sh

Acknowledgement & Citation

If you find this repository useful for your research, please consider citing our paper:

@article{luo2024harvard,
  title={Harvard Glaucoma Fairness: A Retinal Nerve Disease Dataset for Fairness Learning and Fair Identity Normalization},
  author={Luo, Yan and Tian, Yu and Shi, Min and Elze, Tobias and Wang, Mengyu},
  journal={IEEE Transactions on Medical Imaging},
  year={2023}
}

harvard-gf-quantization's People

Contributors

harvardophai avatar platelminto avatar casper-smet avatar luoyan407 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.