nardien / kala Goto Github PK
View Code? Open in Web Editor NEWOfficial Code Repository for the paper "KALA: Knowledge-Augmented Language Model Adaptation" (NAACL 2022)
Official Code Repository for the paper "KALA: Knowledge-Augmented Language Model Adaptation" (NAACL 2022)
Hello, I am coming over a few problems, and I suggest to help others.
@Nardien @JinheonBaek Specifically, I am interested in understanding how KALA handles unseen data that was not included in the training set by utilizing a knowledge graph to retrieve the neighborhood of the unseen entity from entity memory and perform weight aggregation with its neighbors.
Relational Retrieval which leverages a KG G to retrieve entity embeddings from the memory, according to the relations defined in the given KG
However, I am curious to know how KALA handles cases where the unseen entity does not have a neighborhood that can be retrieved from entity memory (has no relations about that unseen entity defined in given KG).
In that case, does KALA treat the unseen entity as a null entity and handle it using fixed gamma and beta values, similar to when using entity memory alone? (point-wise) or is there another mechanism to handle such case ? I would greatly appreciate any information you can provide regarding this aspect of KALA.
Thank you in advance.
Hi, could you supply the well-preprocessed ner dataset, please?
I want to ask that where can i get a token representation from KALA for my analysis of seen and unseen entites which is similar to what you analyze in the paper, but i have no idea of how and where to get it from KALA. Can you please give me a guidance to do it ?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.