Giter VIP home page Giter VIP logo

jpwahle / emnlp23-citation-field-influence Goto Github PK

View Code? Open in Web Editor NEW
3.0 1.0 0.0 3.81 MB

The official implementation of the EMNLP 2023 paper "We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fields"

Home Page: https://aclanthology.org/2023.emnlp-main.797/

License: Apache License 2.0

Python 7.30% Jupyter Notebook 92.63% Dockerfile 0.07%

emnlp23-citation-field-influence's Introduction

We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fields

arXiv HuggingFace Demo

The Repository

This repository implements the EMNLP'23 paper "We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fields"

Getting Started

Data

First, you need to download a recent dump from Semantic Scholar. Therefore, set your API key under YOUR_API_KEY, and request the following two endpoints:

curl --location 'https://api.semanticscholar.org/datasets/v1/release/2023-01-03/dataset/citations' \
--header 'x-api-key: ${YOUR_API_KEY}' \
-o citations/citations.json
curl --location 'https://api.semanticscholar.org/datasets/v1/release/2023-01-03/dataset/papers' \
--header 'x-api-key: ${YOUR_API_KEY}' \
-o papers/papers.json

Next, execute the following command to download the entire dataset.

Note: This will take up significant space 108G+ for papers and 534G+ for citations compressed.

python3 src/download.py

Pre-Processing

To convert the dataset into Apache Spark's native format which increases processing speeds significantly, execute:

python3 src/preprocess.py

Analysis

To reproduce the analysis, execute:

Note: Because some operations require filtering and joining millions of papers, they can take sometimes 24h+. You can choose which functions to run in the main() function.

python3 src/analysis.py

Contributing

There are many ways in which you can participate in this project, for example:

Citation

@inproceedings{wahle-etal-2023-cite,
    title = "We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fields",
    author = "Wahle, Jan Philip  and
      Ruas, Terry  and
      Abdalla, Mohamed  and
      Gipp, Bela  and
      Mohammad, Saif",
    editor = "Bouamor, Houda  and
      Pino, Juan  and
      Bali, Kalika",
    booktitle = "Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing",
    month = dec,
    year = "2023",
    address = "Singapore",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.emnlp-main.797",
    doi = "10.18653/v1/2023.emnlp-main.797",
    pages = "12896--12913",
    abstract = "Natural Language Processing (NLP) is poised to substantially influence the world. However, significant progress comes hand-in-hand with substantial risks. Addressing them requires broad engagement with various fields of study. Yet, little empirical work examines the state of such engagement (past or current). In this paper, we quantify the degree of influence between 23 fields of study and NLP (on each other). We analyzed {\textasciitilde}77k NLP papers, {\textasciitilde}3.1m citations from NLP papers to other papers, and {\textasciitilde}1.8m citations from other papers to NLP papers. We show that, unlike most fields, the cross-field engagement of NLP, measured by our proposed Citation Field Diversity Index (CFDI), has declined from 0.58 in 1980 to 0.31 in 2022 (an all-time low). In addition, we find that NLP has grown more insular{---}citing increasingly more NLP papers and having fewer papers that act as bridges between fields. NLP citations are dominated by computer science; Less than 8{\%} of NLP citations are to linguistics, and less than 3{\%} are to math and psychology. These findings underscore NLP{'}s urgent need to reflect on its engagement with various fields.",
}

Also make sure to cite the following paper if you use SemanticScholar data:

@inproceedings{lo-wang-2020-s2orc,
    title = "{S}2{ORC}: The Semantic Scholar Open Research Corpus",
    author = "Lo, Kyle  and Wang, Lucy Lu  and Neumann, Mark  and Kinney, Rodney  and Weld, Daniel",
    booktitle = "Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics",
    month = jul,
    year = "2020",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://www.aclweb.org/anthology/2020.acl-main.447",
    doi = "10.18653/v1/2020.acl-main.447",
    pages = "4969--4983"
}

License

Licensed under the Apache 2.0 license.

emnlp23-citation-field-influence's People

Contributors

jpwahle avatar

Stargazers

Douglas Lewis avatar Clifford avatar  avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.