Giter VIP home page Giter VIP logo

Comments (11)

envisean avatar envisean commented on August 10, 2024 1

@davlhd I went through the exact problem. You're probably adding a lot of input context as time goes along (that's the beauty of this thing). I added $100, then $200 and Claude bumps up your tiers. Then I spoke with sales and I'm on t4 now. It only takes a day or so to get unleashed again.

I also highly recommend that you save your chat, review the md file and optimize the context that flows back in. In earlier versions of this repo, it didn't remove files from its input context as it picked up more work, so I think there's definitely some context-management that needs to be added.

@Doriandarko is killing it though with this repo, it's insane. Hope that helps!

from claude-engineer.

PierrunoYT avatar PierrunoYT commented on August 10, 2024

You would need OpenRouter

from claude-engineer.

ovachiever avatar ovachiever commented on August 10, 2024

I have OpenRouter working through a new API menu but tools not working well due to request/response differences. Going to look into it more and/or just have it route main and not tools through OR as an option when that endpoint is selected.

Another option, OP, is to set the tools usage to the haiku model, that'll reduce usage quite a bit and haiku seems to work well for tools.

from claude-engineer.

ff781 avatar ff781 commented on August 10, 2024

How long do they take to respond for your request to upgrade tiers?

from claude-engineer.

PierrunoYT avatar PierrunoYT commented on August 10, 2024

How long do they take to respond for your request to upgrade tiers?

They dont upgrade Tiers. I also asked for it.

from claude-engineer.

ff781 avatar ff781 commented on August 10, 2024

Well rip, what do we do then? How are people using this tool, self-hosted? LLAMA 405B?

from claude-engineer.

ovachiever avatar ovachiever commented on August 10, 2024

Anthropic sales/support is extremely lackluster. That being said, usage over time will raise your Tier level; I believe at Tier 3 I got to 5mm requests per day for 3.5; don't think it changed at Tier 4 which I'm now at. So keep using it and at least it'll rise over time.

from claude-engineer.

ff781 avatar ff781 commented on August 10, 2024

Oh, so the "solution" is to just max out the usage everyday, go take a break, then come back and repeat tomorrow and it goes up eventually?

from claude-engineer.

ff781 avatar ff781 commented on August 10, 2024

Another option, OP, is to set the tools usage to the haiku model, that'll reduce usage quite a bit and haiku seems to work well for tools.

@ovachiever

also, haiku apparently has a very low output limit?

Error in tool response: Error code: 400 - {'type': 'error', 'error': {'type': 'invalid_request_error', 'message': 'max_tokens: 8000 > 4096, which is the maximum allowed number of │
│ output tokens for claude-3-haiku-20240307'}}

from claude-engineer.

ovachiever avatar ovachiever commented on August 10, 2024

Oh, so the "solution" is to just max out the usage everyday, go take a break, then come back and repeat tomorrow and it goes up eventually?

Correct, here are the tiers: https://docs.anthropic.com/en/api/rate-limits

They finally got back to me from contacting a couple weeks ago and bumped me to Tier 5 50,0000,000, a 10x increase. I'd min/max usage AND reach out with a plea and what you're working on and see if they don't perhaps kick you up a few tiers. May help to find a few Benjamins in account as well, to show you're serious?

from claude-engineer.

ovachiever avatar ovachiever commented on August 10, 2024

Another option, OP, is to set the tools usage to the haiku model, that'll reduce usage quite a bit and haiku seems to work well for tools.

@ovachiever

also, haiku apparently has a very low output limit?

Error in tool response: Error code: 400 - {'type': 'error', 'error': {'type': 'invalid_request_error', 'message': 'max_tokens: 8000 > 4096, which is the maximum allowed number of │

│ output tokens for claude-3-haiku-20240307'}}

Ya you'd need to exit the script and bump tool output tokens to 4096, when using Haiku.

from claude-engineer.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.