Comments (5)
I was able to quickly verify what you report. Seems very unfortunate to me that
there is no way to free the
memory from the stream context resource. Using a new context seemed cleaner
code wise, but its obviously not
acceptable. I'll move to reusing a single context.
Original comment by [email protected]
on 19 Oct 2009 at 4:29
- Changed state: Started
from solr-php-client.
Moved to reusing a get and post context instead of creating a new one for each
request in r21
Original comment by [email protected]
on 9 Nov 2009 at 10:09
- Changed state: Fixed
from solr-php-client.
further fix in r22 (wrong stream context function used to set options)
Original comment by [email protected]
on 9 Nov 2009 at 10:52
from solr-php-client.
I am having a rather large performance issue which I think is related to this.
I am using the newest code however I think this is leaking. I am trying to
index between 6 and 10 million documents and even with a memory limit on php of
4 G, I get to maybe 1 million before it eats up the memory. I have tried doing
this in chunks of 100,000, 10,000, and 1,000 and it all just dies and seems to
be around this function.
Thoughts? better approaches?
Original comment by [email protected]
on 30 Aug 2010 at 3:51
from solr-php-client.
Are you using the SVN version of the code? it now reuses a context. If you are
and are still seeing memory climb - then I'd check whether you're holding onto
documents somewhere. If that still doesn't work, then you could try breaking
the work into several processes.
Original comment by [email protected]
on 30 Aug 2010 at 4:05
from solr-php-client.
Related Issues (20)
- How to enable wildcard HOT 1
- Cannot use root-level URL Solr servers HOT 2
- Basic Auth HOT 5
- Added feature. Get Solr system information HOT 1
- SOLR - 1 writer server 1 search server work on realtime HOT 4
- Basic Auth r64 Does Not Support Distributed Searches HOT 2
- keep alive connection HOT 1
- Support for proxy
- Composer support HOT 1
- Update copyrights to reflect PTC ownership HOT 1
- incorrect implementation of "ping" HOT 10
- Facet Query problem HOT 1
- Patch for /branches/response_parsing/Apache/Solr/Service.php HOT 2
- Search handler resolution HOT 1
- getting problem in configuring the solr-php-cline HOT 1
- Solr 4.3.0 HOT 3
- Get Spell Check Suggestions in frontend.
- Solr Indexing errror:Fatal error: Uncaught exception 'Apache_Solr_HttpTransportException' with message ''400' Status: Bad Request' HOT 1
- Add support to set search servlet [other than "select"] HOT 1
- PERFORMANCE WARNING: Overlapping onDeckSearchers=2 &Error opening new searcher.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from solr-php-client.