kotlinx.ast is a generic AST (Abstract Syntax Tree) parsing library, Kotlin is currently the only supported language.
The library is designed that other languages can be easily added.
kotlinx.ast does not use the Kotlin Compiler for parsing,
it is using ANTLR (the Kotlin variant: https://github.com/Strumenta/antlr-kotlin)
using the official Kotlin Grammar (https://kotlinlang.org/docs/reference/grammar.html).
One Component is Klass, a collection of language independent data classes used to represent and easily access the AST.
The Project is in an early stage, but it is already possible to parse Kotlin code. Bug reports, feature requests and pull requests are very welcome.
kotlinx.ast is a multiplatform project, but currently, JVM is the only supported target.
Support for JS and native is planned.
antlr-java, antlr-optimized and antlr-kotlin are supported on the JVM.
Multiplatform support (Kotlin Native and Kotlin JavaScript) for antlr-kotlin is planned.
Because antlr-java and antlr-optimized are JVM-only, support for other platforms is not possible.
kastree is using the kotlin compiler for parsing,
it can only parse kotlin files.
JS and native support is not possible. kastree is currently not under active development.
This Kotlin Code:
@Annotation1("abc")
// line comment between annotations
@Annotation2("\${123}")
fun parse() {}
will be parsed as:
PackageHeader()
importList
KlassDeclaration(fun parse)
KlassAnnotation(Annotation1)
KlassArgument()
KlassString
"abc"
KlassAnnotation(Annotation2)
KlassArgument()
KlassString
Escape("\$")
"{123}"
There are more examples in directory testdata.
- Files named "*.kt.txt" contains the kotlin source to parse
- Files named "*.raw.txt" contains the parsed raw kotlin AST as defined by the official Kotlin Grammar
- Files named "*.summary.txt" contains the AST summary
There are some parts missing, for example the importList is not converted into an easy-to-use data class
Currently, there are some libraries that are part of kotlinx.ast:
kotlinx.ast:commoncontains the code that can later be reused by other grammar parserskotlinx.ast:common-testcontains the dependencies to test frameworks, used bykotlinx.astunit testskotlinx.ast:parser-antlr-javacontains the shared code required to parse grammars using the official antlr4 JVM implementation.kotlinx.ast:parser-antlr-kotlincontains the shared code required to parse grammars using antlr-kotlinkotlinx.ast:parser-antlr-optimizedcontains the shared code required to parse grammars using the optimized fork of antlr.kotlinx.ast:grammar-kotlin-parser-commoncontains the shared code required to parse kotlin sourcekotlinx.ast:grammar-kotlin-parser-antlr-javaprovides a kotlin ast parsed using antlr-javakotlinx.ast:grammar-kotlin-parser-antlr-kotlinprovides a kotlin ast parsed using antlr-kotlinkotlinx.ast:grammar-kotlin-parser-testcontains the test data used by the kotlin parserskotlinx.ast:grammar-antlr4-parser-commoncontains the shared code required to parse antlr4 grammar fileskotlinx.ast:grammar-antlr4-parser-antlr-javaprovides an antlr4 grammar ast parser using antlr-javakotlinx.ast:grammar-antlr4-parser-testcontains the test data used by the antlr4 grammar parsers
${Versions.antlrKotlinGroup}:antlr-kotlin-runtime:${Versions.antlrKotlin}is required at runtime to be able to parse kotlin code into an AST when usingkotlinx.ast:grammar-kotlin-parser-antlr-kotlin.
org.antlr:antlr4:${Versions.antlrJava}is required at runtime to be able to parse kotlin code into an AST when usingkotlinx.ast:grammar-kotlin-parser-antlr-java.
com.tunnelvisionlabs:antlr4:${Versions.antlrOptimized}is required at runtime to be able to parse kotlin code into an AST when usingkotlinx.ast:grammar-kotlin-parser-antlr-optimized. NOTE:antlr-optimizedis a drop-in replacement ofantlr-java. Both jars provide the same API, namely the packageorg.antlr.v4, so you can't use both at the same time.kotlinx.ast:parser-antlr-optimizeddepends onkotlinx.ast:parser-antlr-java, both provide the samekotlinx.astAPI. The difference is thatparser-antlr-optimizedwill exclude the dependency toorg.antlr:antlr4and instead includecom.tunnelvisionlabs:antlr4. The generated code of these two libraries is not equal, therefore two different grammar modules are required:- kotlinx.ast:parser-antlr-java
- kotlinx.ast:parser-antlr-optimized (the generated code is linked, for the case that you want to compare it)
(Versions can be found here: Versions.kt)
There is a small example to get started:
- for
antlr-kotlinExampleMain.kt - for
antlr-javaExampleMain.kt - for
antlr-optimizedExampleMain.kt
kotlinx.ast is accessible on Maven & Gradle through Jitpack. In Jitpack basically you can use every commit or tag as a version number. You can find recent versions on the Jitpack page for kotlinx.ast.
You have to add this line to settings.gradle.kts if use Gradle lower than 5.3: (otherwise, the jars are not resolved):
// Enables KotlinMultiplatform publication and resolving (in dependencies)
enableFeaturePreview("GRADLE_METADATA")
You have to add Jitpack to build.gradle.kts:
repositories {
maven("https://jitpack.io")
}
Add the dependency to kotlinx.ast into your project:
kotlin {
jvm()
sourceSets {
val commonMain by getting {
dependencies {
// please look at https://jitpack.io/#drieks/antlr-kotlin to find the latest version
api("com.github.kotlinx.ast:grammar-kotlin-parser-antlr-kotlin:0123456789")
}
}
}
}
If you don't use kotlin-multiplatform add this line:
// please look at https://jitpack.io/#drieks/antlr-kotlin to find the latest version
implementation("com.github.kotlinx.ast:grammar-kotlin-parser-antlr-kotlin:0123456789")
Or, if you prefer to use the antlr-java parser (JVM only):
// please look at https://jitpack.io/#drieks/antlr-kotlin to find the latest version
implementation("com.github.kotlinx.ast:grammar-kotlin-parser-antlr-java:0123456789")
The latest version can be be seen in the Jitpack-Badge at the top of this page.
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot]")
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent