nehalh / raisin Goto Github PK

Cannot decode RIGHT SINGLE QUOTATION MARK, displays '\xe2\x80\x99s' instead.

This is a logic error.
What happens is, the program reads from the file and encodes perfectly. But while decoding, it simply is unable to decode the 'single quotation' symbol (and also escape characters like \n).

I assume the issue probably lies in the functions participating in decoding (unpack(), read_from_raisin_file(), write_to_file() )

I have fixed this temporarily by doing the following in the level_1 module:

Manually replaced right and left apostrophes with placeholders,
accommodated for escape sequences using .decode('unicode_escape')
replaced placeholders with actual characters.

NOTE: This is just a temporary fix. I believe there is a better solution for this logic error.

The size of the frequency dictionary varies depending on the scope. If the size is measured outside the for loop, the size increases by a few kilobytes.