ryyaan2004 / constable-reggie Goto Github PK

Many redditors submit the same post to multiple subreddits. These come in two forms, rapid submissions which are duplicates detectible during a single invocation of the constable, and reposts over time which happen between invocations.

Rapid duplicate submissions can likely be avoided by the constable by checking the post content. For image based posts maybe we can download the image and store a shasum. This may require more network bandwidth than we want to pay for. For text based submissions we can probably store and compare the text. This will only work when the text is identical.

Reposts over time will require persistence. We should be able to provide the ability to configure and use persistence, although it shouldn't be mandatory.