Comments (18)
@rotello should we start a club? maybe a support group... "Brian Petro's Annoying Fans Anonymous"
from obsidian-smart-connections.
i think we could :-P
from obsidian-smart-connections.
I really appreciate it, but also couldn't imagine keeping this thing going if it weren't for such enthusiastic and helpful people like yourselves. Thank you @smartguy1196 @rotello 👏
from obsidian-smart-connections.
I am doing more test. it seems that the kindle clipping are working, while the mobi / loooong form MD i imported (it s basically a full book i ve ) is not indexed.
Great to know, thanks! This type of feedback is really helpful.
In the background, "parsing," breaking the notes into logical chunks, plays a big role in the plugin's effectiveness. So less common formatting is more likely to run into issues.
I do have a lot of improvements I want to make to the parser. A lot of them are designed to handle long-form content better. So, in time, the plugin will improve at handling these cases.
Lastly, I know it's incredibly frustrating when software doesn't work as expected, and it's easier to walk away than to contribute to its improvements. So thanks again for your continued assistance!
Brian 🌴
from obsidian-smart-connections.
@dartungar which language is this occuring with?
I have two ideas for changes that will both contribute to solving this:
There is now a language setting in Smart Connections, and with that, we can adjust how the tokens are estimated. Some languages use characters that make the "divide by 4" estimate unreliable. This calculation should be easy to adjust based on the language selected in the settings.
Additionally, I plan on implementing a method to catch this error, reduce the amount of context, and resubmit the request automatically. This should prevent bad estimates from causing a fatal error like this.
After making those two changes, I think this issue will be solved.
from obsidian-smart-connections.
Hey @leips , thank you for taking the time to bring this to my attention!
Are you able to take a screenshot of the error in the console?
Is this happening after the first, or many, messages?
Thanks for your help in solving this issue :)
from obsidian-smart-connections.
The screenshot,
I try with a few notes, everything works, but after I put the of the notes in my vault (500 notes) this error appears every time I'm asking something about the notes.
from obsidian-smart-connections.
Thanks for the quick follow-up.
The plus sign in the top right of the chat window will clear the current context. This will be necessary until I implement a manual pruning of past messages.
but after I put the of the notes in my vault (500 notes)
Can you clarify what you mean by this?
Thanks,
Brian 🌴
from obsidian-smart-connections.
Same error after click the plus sign.
Can you clarify what you mean by this?
I made two test. First, with a few notes, everything works. Second, with a 500 notes. After refresh the embeddings, this message appears when I ask something.
from obsidian-smart-connections.
Is the 500 note vault something you'd be comfortable sending me so I can test it out? Otherwise I'll have to think on it a bit, not sure what's up. [email protected]
from obsidian-smart-connections.
It's personal information.
Yesterday I deleted the embeddings and started over all the process. There is something about the embeddings that change every time I refresh the process. I'll continue testing.
Thanks!
from obsidian-smart-connections.
@leips I think I might have an idea what's up.
Do you have some really long notes? Maybe ones that don't use a lot of headings? Like, large text blocks (>1000 chars) without and headings?
If so, the logic for limiting lengths of notes in the context window is probably the problem.
This is something that I can improve to better handle cases like I mentioned above.
Thanks for your help in figuring this out!
from obsidian-smart-connections.
I am doing more test. it seems that the kindle clipping are working, while the mobi / loooong form MD i imported (it s basically a full book i ve ) is not indexed. I ve not got any error.
I updated the plugin. closed the Vault and it seems to work. I am excited
from obsidian-smart-connections.
Thank for bearing my obnoxiousness :-)
from obsidian-smart-connections.
Issue reported again in comment: #88 (comment)
from obsidian-smart-connections.
Yeah, for sake of convenience here is my comment:
from obsidian-smart-connections.
@brianpetro well, most of my notes are in Russian (hope that doesn't put you off! 😶 ). That does seem like a potential cause, will check the new setting. Cheers!
from obsidian-smart-connections.
Closing in favor of this FR #126
from obsidian-smart-connections.
Related Issues (20)
- Invalid API Key OpenApi HOT 7
- Under selling it? HOT 3
- Plugin (turned off) and says "cannot load plugin" HOT 15
- Smart Chat should handle code in the chat input HOT 2
- Smart Connections Supporter HOT 2
- How to prevent Dataview, Inline fields affects Smart Connections? HOT 1
- Issues with Claude HOT 5
- Enter Chinese to display no permission to search the database
- Smart connections keeps embedding the same vault whenever I open Obsidian HOT 3
- Gemini 1.5 error HOT 1
- Smart Connections can't find where a given information is in my vault HOT 1
- Getting very short output from Opus all of a sudden HOT 2
- Obsidian black screen on Google Drive Sync HOT 2
- TypeError: Cannot read properties of undefined (reading 'slice') HOT 6
- Feature request / Question: allow a configuration for the number of "connections" HOT 1
- Feature request / Question: Allow configuration to connect only to notes and not blocks HOT 2
- Question about embedding models HOT 2
- Crashing Obsidian all of a sudden. HOT 18
- Getting TypeError: vector1.reduce is not a function when using Smart Chat HOT 1
- Linking Canvas files in Chat HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from obsidian-smart-connections.