🧩 / 🕸 WebsiteCrawler - This plugin automatically crawls the main content of a specified URL webpage and uses it as context input.
Home Page: http://web-crawler.chat-plugin.lobehub.com
License: MIT License
macOS
Chrome
希望可以根据当前剩余token来限制读取内容的长度
No response
No response
macOS
Chrome
调用插件，然后只是消耗大量的token,没有任何返回信息，或者无效返回信息
No response
提问“搜索eccDNA的最新发现”，调用gpt-4-32k模型，输入28981提示词，消耗3$额度，返回为“无法提供“。
提问”搜索GeminiPro的最新消息“，调用gpt-4-1106-preview, 输入29052和29498提示词，消耗2$额度，返回为空
No response
macOS
Chrome
在部分非文档类的网站中，使用内容提取插件会返回不正确结果：
https://platform.openai.com/docs/api-reference/chat/create
No response
No response
No response
当前商店里提供的插件, 非常好用, 可以解决很多问题, 但是有些时候, 需要抓非公开的, 内网里的文件, 此时本插件就派不上用场, 希望能提供方式, 把插件部署至内网, 让他可以抓取内网的内容.
另外实现方式中, 是调用了 browserless 的 token, 这样肯定是能适配很多的 SPA 应用, 但同时也让部署变得复杂, 希望能提供不使用 browserless 的实现.
提供 docker 等通用部署方案, 提供非 broserless 的实现
我自己尝试了下自己做一个, LeoQuote/lobe-webcrawer-self-host#1 但老是报请求失败.
本地开发的时候, 也是非要先过服务端的网关, 非常的不方便, 难道我必须要 lobe 和插件都在本地运行才可正常进行调试?
Windows
Chrome
如题，访问https://web-crawler.chat-plugin.lobehub.com/api/v1页面会显示500错误-This Serverless Function has crashed.
No response
No response
No response
Windows
Chrome
在使用gemini1.5 pro的情况下无法使用
No response
No response
No response
Windows
Chrome
With dolphin-mixtral, I contend that it's not able to use the plugin and crawl a web page.
No response
No response
No response
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.
