• This is a Spring Boot application that demonstrates the usage of Apache OpenNLP for natural language processing (NLP) tasks such as language detection, sentence detection, and tokenization. The service processes HTML text, converts it to plain text, detects the language, tokenizes the text, and maps tokens to their types and IDs using database data.
• I had to implement this feature to enhance recommendations in my end of studies project so i decided to share it with you

• Features
• Getting Started
  • Prerequisites
  • Installation
• Configuration
• Contributing

• Convert HTML text to plain text ( job-offer description is saved in a html format in the db)
• Detect the language of the text
• Detect sentences in the text
• Tokenize the text into individual tokens
• Map tokens to their types and IDs using data from a database

To build and run this project, you will need:

• Java 11 or higher
• Maven
• A database (configured in application.yml)
• Configure your database connection in src/main/resources/application.yml:

  database:
    url: your_database_url
    user: your_database_username
    password: your_database_password
  

1. Clone the repository:

   git clone https://github.com/Oussemasahbeni/spring-boot-openNLP.git
   cd spring-boot-opennlp-demo

2. Build the project using Maven:

  mvn clean install

Ensure you have the necessary model files for OpenNLP:

• langdetect-183.bin
• Sentence and tokenizer model files for the languages you want to support:
  • opennlp-en-ud-ewt-sentence-1.0-1.9.3.bin
  • opennlp-en-ud-ewt-tokens-1.0-1.9.3.bin.

Contributions are welcome! Please fork the repository and create a pull request with your changes.