Comments (8)
make sure REDIS_URL and REDIS_RATE_LIMIT_URL switched to redis://redis:6379
and see if the bug still happens
from firecrawl.
make sure REDIS_URL and REDIS_RATE_LIMIT_URL switched to
redis://redis:6379
and see if the bug still happens
Ah, that fixed it! Thanks a lot!
from firecrawl.
Just added to the docker compose as well. Thank you everyone!
from firecrawl.
I had a similar issue, I fixed it by creating a network to host redis
docker network create my-network
docker run -d --name my-redis-stack --network my-network -p 6379:6379 redis/redis-stack-server:latest
and in your .env use
REDIS_URL=redis://localhost:6379
from firecrawl.
I believe we forgot to add to the .env.example the new Redis variable for the rate limits. Just edited the .env.local and .env.example to reflect the change we did yesterday. Let me know if this fixes it.
from firecrawl.
I believe we forgot to add to the .env.example the new Redis variable for the rate limits. Just edited the .env.local and .env.example to reflect the change we did yesterday. Let me know if this fixes it.
So I still tried to launch it but I still get the same error
I'm suspecting the env variables are not updating. I noticed if I put a custom redis connection string that it's still using 127.0.0.1. Perhaps that could be it?
EDIT: After reading the docker-compose file, it should be giving access to the host network... I'm not sure what it could be. I've also made sure that my redis instance works
PS: Also tried nagendrakumar02's solution, still didn't work but it did change it's state. Running it does give me a dashboard but no queues:
from firecrawl.
I added REDIS_RATE_LIMIT_URL=${REDIS_RATE_LIMIT_URL}
as an environment in docker compose file and the error seems to dissapear, haven't tried if it actually work or not tho
from firecrawl.
REDIS_RATE_LIMIT_URL=${REDIS_RATE_LIMIT_URL}
That lines up with the fixes that @nickscamara pushed.
from firecrawl.
Related Issues (20)
- [BUG] Certain videos in Iframe's aren't being captured HOT 1
- [Feat] Improve Handling of Sitemap Structure for URLs with Include Paths
- [BUG] go-sdk module name does not match with project structure HOT 5
- Strange behaviors in concurrency HOT 5
- v1: Better dx for params that don't exist in options
- [BUG] https://www.solvhealth.com/privacy Only main content causing no content to be returned?
- No data return for some JavaScript-rendered websites. HOT 2
- [Feat] Send "cancel" to fire-engine on timeout | Retry logic | Timeout HOT 1
- [BUG] /scrape gamelandia.fun not working
- [Question] Do you support crawling pages requires login? HOT 8
- [BUG] The encoding is not correct for some Chinese language sites
- [BUG] Getting 408 when trying to run firecrawl locally HOT 4
- [Question] Where does the crawl job status data store? HOT 3
- How to set the api key when running locally? HOT 6
- [Feat] Not supporting <meta name="FirecrawlAgent" content="noindex">
- [Feat] Dedup duplicate links in sitemap
- [BUG] ERR wrong number of arguments for 'sadd' command HOT 2
- [BUG] docs.stripe.com return null after 2800 scrapes HOT 1
- [BUG] Search endpoint includes extra content in extracted titles
- [Feat] Firecrawl Example Project Bounty Program HOT 34
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from firecrawl.