A simple image search engine using CLIP feature.

Also have a look at my blog post: 基于 CLIP 模型特征搭建简易的个人图像搜索引擎

We need python3, mongodb and CLIP model library to run this project.

pip3 install -r requirements.txt

Start MongoDB server separately and save the address into config.json file.

You can also start a seperate MongoDB server by start.sh script in mongo_sample folder.

Install CLIP python library by following the instruction in openai/CLIP

There a two stages in this project. Make sure you have already started the MongoDB server.

There are two modes on importing images into database: import mode and copy mode. import mode do not copy file, and you have to keep the original file later. copy mode is useful when you need to scan temp or cache folder, and you can delete the original file after importing. In both mode, the script will scan folder recursively and import all images files into database.

# import mode
python3 import_images.py /path/to/folder

# copy mode
python3 import_images.py /path/to/folder --copy

python3 server.py

• Test cases
• Support for OCR text, using PaddleOCR
• ElasticSearch for text search engine backend
• Change to a vector database backend: Faiss
• Import and search EXIF
• Multi-language support for OCR model
• Multi-language support for Text Search