Recommended papers is empty about arxiv-sanity-preserver HOT 18 OPEN

I see, I think this is related to the fact that I forget to log in and recompute arxiv-sanity. I have to do this manually every ~2-3 days right now and sometimes I forget. I'm going to move arxiv-sanity to a more permanent location soon and these issues will go away.

from arxiv-sanity-preserver.

I've been using it for months (it's wonderful) but the last 3 weeks or so I'm not getting new papers. I can still get earlier papers though - have you tried setting the retrieval window to be 1 month or more?

from arxiv-sanity-preserver.

@seandoyle can you clarify what the issue is? I'm not able to reproduce any problems with my own account, and I have a number of recommended papers over last week/month etc.

from arxiv-sanity-preserver.

I'm not sure what the issue is - here's what I observe:

• When I select recommended for one week I get zero hits. I've been getting zero hits for the last few weeks when I use the 1 week window.
• But when I click on last month - I get a bunch - including one from 1/24. Since today is 1/31 - I would have expected this to show up sometime in the last week but I don't remember seeing it.
• The frequency of papers really fell off starting about 3 week ago. Most of what is in my library is medical image CNNs or segmentation which are pretty active areas.
• When I use the one month window - there are 8 papers. 5 of them are on the dates 1/3, 1/4, and 1/5. This is an odd clustering of dates.

So - maybe this is just some type of random occurrence. Or maybe the selection of papers in my library is excluding papers in some way.

If there is something I should try here (deleting/adding papers &etc) I'd be happy to try. This is such a wonderful resource & I really appreciate you making this available.

from arxiv-sanity-preserver.

btw I finished the migration today and this should never happen again. If it does, definitely a bug.

from arxiv-sanity-preserver.

Works perfectly now. Thank you - this is wonderful.

from arxiv-sanity-preserver.

Looks like I'm facing the issue once again

from arxiv-sanity-preserver.

Yes - I'm having the same symptom again. I don't have any new papers in the last few weeks. In early April I added a few more papers to my library and the total was ~40. I deleted some of these yesterday in case I had hit a limit or there was something about those papers that was causing the algorithm to fail - but this doesn't seem to be the issue.

from arxiv-sanity-preserver.

ping @karpathy

from arxiv-sanity-preserver.

sorry, i was on a vacation and memory started exploding on the machine for some reason that I think has to do with mongodb taking over the RAM. I'll have to figure it out later. Resolving now with a hack by making the codes a bit smaller... Should be up and functional again in ~2hrs

from arxiv-sanity-preserver.

@karpathy sorry to bother, but looks like it's happening once again. For "top resent" too

from arxiv-sanity-preserver.

@Randl Have you tried to switch to different periods (say, last month or last year). In may case, last day and last 3 days are empty, too, but I don't think it is a bug

from arxiv-sanity-preserver.

@karelin I've never had empty 3-day period except when the bug occurred. The fact that yours is empty too is additional evidence.

Obviously for one-month period there will be papers until one month passes :)

from arxiv-sanity-preserver.

I think this is happening because no arxiv papers get published over the weekend. So "last 3 days" ends up empty.

from arxiv-sanity-preserver.

I have an idea for this: as the site (both recommendations and main data base) are updated 'offline', perhaps the header of the main page could contain the "last updated" dates?

from arxiv-sanity-preserver.

@karpathy Well, today is Tuesday, so I suppose that's not the reason

from arxiv-sanity-preserver.

@karpathy Just want to note that the same thing still happens from time to time (i.e. today), and last week too

from arxiv-sanity-preserver.

After launching a local instance, I've noted that sometimes when I try to update PDFs, arxiv bans me (makes sense given I downloaded order of 100000 papers from there). If this indeed the case, maybe just stopping update if a number of downloads failed and rerunning it in an hour can solve the issue

from arxiv-sanity-preserver.