Giter VIP home page Giter VIP logo

wikireader / wikireader Goto Github PK

View Code? Open in Web Editor NEW
185.0 22.0 31.0 45.69 MB

Official Source code for the WikiReader (by Openmoko)

Home Page: http://thewikireader.com

License: Other

Makefile 0.36% C 7.88% C++ 0.80% Objective-C 0.04% Python 3.70% PHP 82.91% Shell 0.15% HTML 2.17% CSS 0.20% Perl 0.41% ApacheConf 0.01% OCaml 0.17% Standard ML 0.01% JavaScript 0.24% Smarty 0.02% QMake 0.01% Assembly 0.44% Forth 0.48% Awk 0.03% Scilab 0.01%

wikireader's Introduction

Contents of root directory
==========================

binutils*  [Created during build]

  Stamp files for make

COPYING

  GPLV3 License information this covers most of the code in the
  wiki-app directory.  Other files/directories may have their own
  license information.

doc

  Various documents including explanation of how to set up a chroot
  for compiling the application

gcc*  [Created during build]

  Stamp files for make

host-tools

  Programs that are used during building the software including cross
  compiler, simulator and utilities to create the data files.

  See: host-tools/00ReadMe.text

Licenses

  Some of the licenses used in various parts of the system, normally
  the individual files/sub-directories will have their own
  copyright/license information.

Makefile

  The master make file that controls all stages of the building process.

samo-lib

  Programs and libraries that run on the WikiReader Hardware

  See: samo-lib/00ReadMe.text

scripts

  Some scripts to handle building on multiple machines and/ore multiple
  cores.  The "Run" script is the actual build script and the "progress"
  script is used to control and monitor the remote servers.

testudo

  Python programs and scripts for production testing

TODO

  Some notes about things to think about

wiki-app

  This is the main application code and is compiled both for inclusion
  on the device and for the simulator.

xml-file-samples

  Some XML files for testing the offline rendering process

XML-Licenses

  Language specific source files. Includes wiki.nls source
  and the XML sources for terms and license that are built
  into the individual wiki data files.

wikireader's People

Contributors

9072997 avatar akoehn avatar hanksudo avatar hxw avatar max-posedon avatar moskovich avatar nzmichaelh avatar roguelazer avatar siebrand avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

wikireader's Issues

make mbr fails

make mbr
awk: cmd. line:1: fatal: cannot open file work/counts.text' for reading (No such file or directory) make -C samo-lib/mini-libc/ make[1]: Entering directory/home/jcolbert/wikireader-wikireader-fcd515c/samo-lib/mini-libc'
mkdir -p "lib"
make[1]: Leaving directory /home/jcolbert/wikireader-wikireader-fcd515c/samo-lib/mini-libc' make -C samo-lib/drivers/ make[1]: Entering directory/home/jcolbert/wikireader-wikireader-fcd515c/samo-lib/drivers'
c33-epson-elf-gcc -M -Wall -Werror -I. -gstabs -mlong-calls -fno-builtin -Os -mc33pe -I/home/jcolbert/wikireader-wikireader-fcd515c/samo-lib/drivers/include -I/home/jcolbert/wikireader-wikireader-fcd515c/samo-lib/fatfs/src -I/home/jcolbert/wikireader-wikireader-fcd515c/samo-lib/fatfs/config/c33/read-only -I/home/jcolbert/wikireader-wikireader-fcd515c/samo-lib/mini-libc/include -I/home/jcolbert/wikireader-wikireader-fcd515c/samo-lib/include -I/home/jcolbert/wikireader-wikireader-fcd515c/samo-lib/mahatma src/sd_spi.c > build/sd_spi.d
In file included from src/sd_spi.c:14:
/home/jcolbert/wikireader-wikireader-fcd515c/samo-lib/include/samo.h:88:2: #error "unsupported board type - see config.h"
make[1]: *** [build/sd_spi.o] Error 1
make[1]: Leaving directory `/home/jcolbert/wikireader-wikireader-fcd515c/samo-lib/drivers'
make: *** [drivers] Error 2

WikiReader software development and testing

I would, perhaps, help tremendously if other people could easily help developing and testing WikiReader software.

Could you put together a Virtual Machine that:

  • Boots into a Linux variant
  • Has shell scripts to get the source from whereever it is stored
  • Has shell scripts to easily build the sources into executables
  • Has an emulator so that the executables (and articles) can be tested
  • Make it possible to install (some) custom tools (like editors...)

That way, interested developers don't have to setup lots of stuff on their own computers, and can help developing, debugging and testing easily.

Base files

I am having problems with the 20120424 base files. I have tried updating my wikireader to the newest ones but the wikireader will turn on and sit on the load screen for a while and then just shut off. Anyone know what may be happening? I have tried downloading a new copy of every thing to make sure that nothing was missing, but to no avail. Any help would be great thanks.

How to update (Windows)

Hello,

Can someone please help me update my wikireader because I have just gotten it. I am having trouble understanding the git and need atleast a few steps to guide me. I would appreciate Windows steps, but Mac is fine as well.

The automatic downloader failed "card full" where the Wikipedia is already on your SD card

I have the full version of the Wkipedia including all sub projects eg Quotes, Dictionary etc. on a 16GB SD card. On using the auto download software I experienced a fail after downloading for several hours. The message advised me my card was full and to obtain a 16GB card. All of this was of little use to me obviously.

If the following isn't already inbulit and I was just unlucky I'd suggest the addition of a precheck of space available as against the size of the data to be sent with an advice to the user that insufficient space is available. Far better than a fail after much time wasting and useless downloading has been experienced.

Perhaps then a warning that files will need to be deleted by the program to make space and/or a request for an alternate download location would be a good solution.

Only first article of the dump is visible

When doing

make WIKI_LANGUAGE="de" XML_FILES="dewiki-minimal.xml" DESTDIR=/home/arne/wikireader/image WORKDIR=/home/arne/wikireader/work index parse render combine hash install

with this xml dump: http://gist.github.com/333153

I am only able to view the first article, the second one is empty.
There is just the copyright template, which has only the general part of the url.

I tried to debug it, but was unable to find the cause. It seems like the complete text of the non-first articles are in the image, they are just not shown.

What am I doing wrong?

Rendering issue

The article on 'IOCCC' does not render correctly on screen. One of the example programs is rendered with one line on top of the other. Consequently, the links at the bottom of the article are not clickable. The clickable area of the links are about 1.5cm down the screen from the link text.

Can't make sim4

I get an error when I try to make sim4:

true 
true 
cd /home/pierre/Bureau/wikireader/host-tools/qt4-simulator && qmake && make
make[1]: entrant dans le répertoire « /home/pierre/Bureau/wikireader/host-tools/qt4-simulator »
cd src/ && make -f Makefile 
make[2]: entrant dans le répertoire « /home/pierre/Bureau/wikireader/host-tools/qt4-simulator/src »
make[2]: *** Pas de règle pour fabriquer la cible « ../../../wiki-app/bigram.c », nécessaire pour « bigram.o ». Arrêt.
make[2]: quittant le répertoire « /home/pierre/Bureau/wikireader/host-tools/qt4-simulator/src »
make[1]: *** [sub-src-make_default] Erreur 2
make[1]: quittant le répertoire « /home/pierre/Bureau/wikireader/host-tools/qt4-simulator »
make: *** [qt4-simulator] Erreur 2

using wikiversity with other wikis

I've downloaded the updates from (http://dev.thewikireader.com/beta-language-packs/) and they all work fine. I copied based file, english wikipedia, quotes and dictionary.
I also wanted to add wikiversity, which I compiled using the source from the git. The image works fine on it's own but it won't work if I also add it along other wikis. Could you please help me with what I need to do so that I can also have an option to select wikiversity when I start wikireader?
Thank you very much.

Where can I update now?

cant find the website of the wikireader as it used to be, everything redirects to github, I was wondering if there were any updates of wikipedia or any other files.

thanks!

./00run.sh: line 150: time: command not found

Looks like 00run.sh not compatible at least with bash

max_posedon@max_posedon wikireader % time
shell 13.32s user 1.00s system 0% cpu 3:17:53.95 total
children 423.36s user 55.36s system 4% cpu 3:17:53.95 total
max_posedon@max_posedon wikireader % ./00run.sh
00run.sh: needs update
refusing to pull with rebase: your working tree is not up-to-date
./00run.sh: line 150: time: command not found
./00run.sh: line 162: time: command not found

Error

(jaunty_i386)root@lutux:/home/lutux/workspace/wikireader# make
make -C samo-lib/mini-libc/
make[1]: Entering directory /home/lutux/workspace/wikireader/samo-lib/mini-libc' mkdir -p "lib" make[1]: Leaving directory/home/lutux/workspace/wikireader/samo-lib/mini-libc'
make -C samo-lib/drivers/
make[1]: Entering directory /home/lutux/workspace/wikireader/samo-lib/drivers' c33-epson-elf-gcc -M -Wall -Werror -I. -gstabs -mlong-calls -fno-builtin -Os -mc33pe -I/home/lutux/workspace/wikireader/samo-lib/drivers/include -I/home/lutux/workspace/wikireader/samo-lib/fatfs/src -I/home/lutux/workspace/wikireader/samo-lib/fatfs/config/c33/read-only -I/home/lutux/workspace/wikireader/samo-lib/mini-libc/include -I/home/lutux/workspace/wikireader/samo-lib/include -I/home/lutux/workspace/wikireader/samo-lib/mahatma src/mmc.c > build/mmc.d c33-epson-elf-gcc -Wall -Werror -I. -gstabs -mlong-calls -fno-builtin -Os -mc33pe -I/home/lutux/workspace/wikireader/samo-lib/drivers/include -I/home/lutux/workspace/wikireader/samo-lib/fatfs/src -I/home/lutux/workspace/wikireader/samo-lib/fatfs/config/c33/read-only -I/home/lutux/workspace/wikireader/samo-lib/mini-libc/include -I/home/lutux/workspace/wikireader/samo-lib/include -I/home/lutux/workspace/wikireader/samo-lib/mahatma -c -o build/mmc.o -Wa,-ahl=build/mmc.asm33 src/mmc.c src/mmc.c: In functionchk_power':
src/mmc.c:134: warning: implicit declaration of function check_card_power' make[1]: *** [build/mmc.o] Error 1 make[1]: Leaving directory/home/lutux/workspace/wikireader/samo-lib/drivers'
make: *** [drivers] Error 2

Error importing wikipedia-database

I try to compile the wikireader sonftware and import the german wikipedia database.

I am using the last release of the wikireader-software, because this is the only one which I get compiled without error.
Everything works fine, I can import the demo-XML files, put them on the sd-card and so on.
Whe I try to import the german article database, I get the following error:


......
Count: 822000
Count: 823000
Count: 824000
Count: 825000
Count: 826000
Count: 827000
Count: 828000
Count: 829000
Count: 830000
Count: 831000
Count: 832000
Traceback (most recent call last):
File "./ArticleParser.py", line 203, in
main()
File "./ArticleParser.py", line 168, in main
process_article_text(title.encode('utf-8'), f.read(length), newf)
File "./ArticleParser.py", line 197, in process_article_text
newf.write(text + '\n')
IOError: [Errno 32] Broken pipe
make[1]: *** [parse] Fehler 1
make[1]: Verlasse Verzeichnis '/home/mnag/Dokumente/wikireader/wikireader-wikireader-fd058f6/host-tools/offline-renderer'
make: *** [parse] Fehler 2
mnag@mnag-desktop:~/Dokumente/wikireader/wikireader-wikireader-fd058f6$


Any Idea ?

Regards
Michael

There is no seeder for Base and Data files in updating wikireader...

The SD card inserted to my wikireader was broken and I bought new SD card. So, I need All files for my Wikireader.
The "wikireader update" PGM for PC did not work anymore.
so, I tried to download Base and Data files by torrent.
but, there is no seeder for them.
Please, let me know other method to download Base and Data files.
I need base pgm and data files in English, Korean, Japanese and Chinese at least.
Please, help me~
PS) When I used "wikireader update program for PC", I could get all files. and the speed of download was very fast.
PS2) I would like you to give me the seed for base pgm and all data files by yourself only for a week. please...

request: only one torrent tracker for a set of file

enpedia is a set of 5 files (enpedia-20120502.7z.001, enpedia-20120502.7z.002, enpedia-20120502.7z.003, enpedia-20120502.7z.004, enpedia-20120502.7z.005).

Could we have only one torrent (enpedia-20120502.7z.all.torrent for example) instead of 5 .torrent files ? A single file is not usefull, and bittorrent can manage more than one file in a torrent.

Search fail

When I render the database with the huwiki-XXXXXXXX-pages-articles.xml and install it to the device, it seems to work while you touch th 4th letter at the article finder, the the device freezes the letter you touched remains "dark". If you turn it off and on works again:)

error

At the end of building source, I get following error. I'm not sure what the error is. When i run the simulator, articles didn't load but only the titles. Can anyone please suggest what is happening or what I should do? Thank you very much.

...
.....
File "./ArticleRenderer.py", line 1055, in
main()
File "./ArticleRenderer.py", line 215, in main
WrProcess(f)
File "./ArticleRenderer.py", line 461, in init
self.feed(block)
File "/usr/lib/python2.6/HTMLParser.py", line 108, in feed
self.goahead(0)
File "/usr/lib/python2.6/HTMLParser.py", line 148, in goahead
k = self.parse_starttag(i)
File "/usr/lib/python2.6/HTMLParser.py", line 268, in parse_starttag
self.handle_starttag(tag, attrs)
File "./ArticleRenderer.py", line 656, in handle_starttag
self.li_cnt[self.level] += 1
KeyError: 0
make[1]: *** [render] Error 1
make[1]: Leaving directory `/home/sujan/wikireader/host-tools/offline-renderer'
make: *** [render] Error 2

How to convert a Mediawiki (e.g. non-public Wikis, Wikitravel)?

I did not find instructions for how to convert an existing Mediawiki for use on the Wikireader.

It may well be that I did not find them because I am unexperienced in the open source community and many of its tools. It would be very nice if someone could point me to a howto (or other documentation) on converting a very small non-public Mediawiki without any extensions for a start. I searched the developer pages and the support section of wikireader.com, but did not find any pointers.

I would also like to put Wikitravel on my Reader (and provide it to the community) at some point, but I am unsure if this is an easy enough task, having read about some of the issues occuring with other wikis. Wikitravel would make the Wikireader even more of a Hitchhiker's Guide, if not to the galaxy, at least to big portions of the earth :-) Has anyone else tried this yet?

Calculator issues

When calculating the expression 10 - 2 - 2, the calculator gives the answer 2.

Here are the series of calculator key presses that will reproduce the problem:

1 0 - 2 - 2 =

Possibly related to this is the following bug:

-75 + 5 = 99999930.00000000

Calculator key presses: - 7 5 + 5 =

The calculator seems to behave correctly only in the following 2 situations:

  1. Expressions involving positive numbers with only +, * and / operators used.

Or:

  1. Expressions involving negative numbers with only -, * and / operators used.

Coincidentally, when I run the calculator in the WikiReader Forth Simulator, I get a stack underflow when I try to perform one of the buggy calculations above, but correct behaviour otherwise.

The WikiReader Forth Simulator is available here:

http://createuniverses.blogspot.com/2011/03/wikireader-forth-simulator.html

EDIT:

Here is a patch for calc.4th that fixes the problem for me on the device and simulator:

http://createuniverses.googlecode.com/files/calc.patch

Or here is calc.4th with the patch applied:

http://createuniverses.googlecode.com/files/calc.4th

Lists of related articles (categories)

Would be nice if the category functionality could be preserved, somehow. The usual way I use it on Wikipedia is

  • look up article
  • click on linked category for that article
  • see other related articles

Also, it would be really nice to be able to see a list of Featured articles/Good articles!

Blank Article

The article "Minecraft" is empty except for the "External links" heading and it's contents:

Official website
Minecraft Forum
Minecraft Wiki, official Minecraft Wiki
Persson's development blog on Tumblr

Followed by the terms of use text at the bottom of every article.
I'm using the 2012-04-24 base files and 2012-01-04 English Wikipedia files.

In previous releases (June 2011 base/enwiki) this article was completely absent and could not be accessed, along with other video game related articles such as "Half Life 2".

Request clarification on RS-232 console

Under the hardware section, could somebody add some specifics on the console access?
I know from the curent docs about the debug connector, and about TXD/RXD. But there's
no GND pin, so which other pin should I use as the ground reference for the RS-232?

Their levels are, I assume, 3.3v TTL? Is it OK to directly connect a 3.3v TTL UART, or are
there any other buffering considerations?

Thanks much!

error: Missing python module: python-gd

"make" gives me this error:

make[1]: Entering directory /home/saasbook/git/wikireader/samo-lib/flash' /home/saasbook/git/wikireader/host-tools/imagetool/image2header --inverted --header-file="ok.h" --variable-name="ok_image" "ok.png" error: Missing python module: python-gd sudo apt-get install python-gd make[1]: *** [ok.h] Error 1 make[1]: Leaving directory/home/saasbook/git/wikireader/samo-lib/flash'
make: *** [flash] Error 2

I have already installed the python-gd module.

saasbook@saasbook:~/git/wikireader$ sudo apt-get install python-gd
Reading package lists... Done
Building dependency tree
Reading state information... Done
python-gd is already the newest version.
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

They python version I have installed is 2.7.4:

saasbook@saasbook:~/git/wikireader$ python --version
Python 2.7.4

Is it possible to convert text or ebook files?

I have downloaded the repo and been looking at the scripts in host-tools/offline-renderer. I haven't gotten those tools working yet due to dependency issues on my system but I expect to be able to get that working soon.

However, offline-renderer only appears to convert mediawiki xml dumps.

I would like to convert plain text and/or ebook formats.

Does anyone have any insights on the best way to approach this?

Any information or documentation about the file formats the device uses would be helpful. I was able to torrent the enwiki built by zhongfu, but am unsure about how those file formats work. My best guess is that the .dat files are lzma compressed because the offline-renderer scripts use the lzma module. As for the other files I'm not sure where to start.

I'll be digging into this, but any tips or pointers would be helpful to get me started.

A text converter tool without the mediawiki dependencies would be nice.

Quality indicator

Would be nice if there was a way to display a kind of quality indicator, both positive and negative, based on if the article was Featured/Good, or if it had some warning templates on it originally.

UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 14: ordinal not in range(128)

I am getting this error when trying to create an image.

Here is the log :

rm -f -r "/home/pierre/Téléchargements/wikireader-wikireader-be8e680/image/enpedia"
rm -f -r "/home/pierre/Téléchargements/wikireader-wikireader-be8e680/work/tmp/enpedia"
rm -f -r "/home/pierre/Téléchargements/wikireader-wikireader-be8e680/work/enpedia"
mkdir -p "/home/pierre/Téléchargements/wikireader-wikireader-be8e680/image"
mkdir -p "/home/pierre/Téléchargements/wikireader-wikireader-be8e680/image/enpedia"
mkdir -p "/home/pierre/Téléchargements/wikireader-wikireader-be8e680/work"
mkdir -p "/home/pierre/Téléchargements/wikireader-wikireader-be8e680/work/enpedia"
mkdir -p "/home/pierre/Téléchargements/wikireader-wikireader-be8e680/work/tmp"
mkdir -p "/home/pierre/Téléchargements/wikireader-wikireader-be8e680/work/tmp/enpedia"
make -C "/home/pierre/Téléchargements/wikireader-wikireader-be8e680/host-tools/offline-renderer" index \
        WIKI_LANGUAGE="en" \
        WIKI_LANGUAGE_VARIANT="" \
        WIKI_FILE_PREFIX="wiki" \
        WIKI_DIR_SUFFIX="pedia" \
        XML_FILES="/home/pierre/Téléchargements/wikireader-wikireader-be8e680/XML-Licenses/en/license.xml /home/pierre/Téléchargements/wikireader-wikireader-be8e680/XML-Licenses/en/terms.xml /home/pierre/Téléchargements/wikireader-wikireader-be8e680/xml-file-samples/japanese_architects.xml" RENDER_BLOCK="0" \
        WIKI_VERSION="20110609" \
        TEMPDIR="/home/pierre/Téléchargements/wikireader-wikireader-be8e680/work/tmp" \
        WORKDIR="/home/pierre/Téléchargements/wikireader-wikireader-be8e680/work" DESTDIR="/home/pierre/Téléchargements/wikireader-wikireader-be8e680/image"
make[1]: entrant dans le répertoire « /home/pierre/Téléchargements/wikireader-wikireader-be8e680/host-tools/offline-renderer »
./ArticleIndex.py  \
        --article-index="/home/pierre/Téléchargements/wikireader-wikireader-be8e680/work/enpedia/articles.db" \
        --article-offsets="/home/pierre/Téléchargements/wikireader-wikireader-be8e680/work/enpedia/offsets.db" \
        --article-counts="/home/pierre/Téléchargements/wikireader-wikireader-be8e680/work/enpedia/counts.text" \
        --templates="/home/pierre/Téléchargements/wikireader-wikireader-be8e680/work/enpedia/templates.db" \
        --ignore-templates="templates-to-ignore" \
        --language="en" \
        --prefix="/home/pierre/Téléchargements/wikireader-wikireader-be8e680/image/enpedia/wiki"  /home/pierre/Téléchargements/wikireader-wikireader-be8e680/XML-Licenses/en/license.xml /home/pierre/Téléchargements/wikireader-wikireader-be8e680/XML-Licenses/en/terms.xml /home/pierre/Téléchargements/wikireader-wikireader-be8e680/xml-file-samples/japanese_architects.xml
Articles:           39
Redirects:           3
Sum:                42
Merged:             42
Difference:          0
Restricted:          0
Templates:          91
rTemplates:         10
Characters:     173022
Traceback (most recent call last):
  File "./ArticleIndex.py", line 740, in <module>
    main()
  File "./ArticleIndex.py", line 191, in main
    output_fnd(fnd_name, processor, language_convert, truncate_title)
  File "./ArticleIndex.py", line 608, in output_fnd
    PrintLog.message(u'Writing bigrams: {0:s}'.format(out_f.current_filename))
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 14: ordinal not in range(128)
Flushing databases
Writing: files
Time:     0.0s
Writing: articles
Time:     0.0s
Writing: offsets
Time:     0.0s
Loading: articles
Time:     0.1s
Loading: offsets and files
Time:     0.2s
make[1]: **\* [index] Erreur 1
make[1]: quittant le répertoire « /home/pierre/Téléchargements/wikireader-wikireader-be8e680/host-tools/offline-renderer »
make: **\* [index] Erreur 2

Wikireader (and simulator) fails with "index file open error"

I've built WikiReader files for the 20140903 enwiki dump along with enbooks, endict and enquote. However, when I try to open the wikis, both my WikiReader and the simulator (make DESTDIR=image wiki-simulate) would show "index file open error":

cd "image" && ./wiki.app
Framebuffer 240 x 208

starting wiki app
Display version.txt

VERSION: 20141001
FATAL: ../search.c:194: index file open error
Exit 

Could this be because I edited the enwiki dump manually (to fix something else)?

Files can be found here if anyone's interested: https://znx.cc/wikireader/20141001/

updates on adding custom content to SD

Hello, I'm a very happy wikireader user for almost 2 years now, and I'm very grateful for its existence and the work being done by you and everyone involved, but It's been a bit frustrating since I got it into my hands every time I tried to add other media wiki content into it or generate my own. I know this is free software / open source (meaning we all work for it and I shouldn’t expect others to solve my problems if I didn’t tried hard enough) and that is why I waited so long to come down here to ask for help.

I believe the documentation (as in "Command sequence to build an image") is not enough to work with, I mean, the commands are there, but -at least for me and some people I've tried with- they dont seem to work. I tried websites like www.hitchwiki.org (their xml dumps are available online) or my own install of a mediawiki with just a few articles and failed every time.

I'm not sure what the solution could be like, I guess it would be nice to have an easier way to put stuff into the device, as so far its been very difficult to understand the current tool and also for friends who have much better skills than myself.

I have no expectations of having this solved overnight, I actually waited a long time as I was hoping that over time there would be more people trying the same and discussing it in forums or solutions from the dev team, but as none of that happened I wanted to let know my opinion on how great would it be for wikireader users to be able to load custom content.

As soon as this is a possible task for me, I promise there will be lots of torrent files and direct download links for various different kinds of content that people could find useful on their readers, as im very active at using it an know many mediawiki websites that have lots of cool info, till then, I just hope you understand that this is not a demand but just a friendly comment.

Thanks!

Parsing en-wikipedia appears to freeze

I'm building files (20140811) for en-pedia with 1 machine and 16 threads.
The 5th parsing thread has hung for two days still using 100% CPU, while everything else has finished building.

Unable to create new SD Card with recent wikipedia

I cannot create a new SD Card.
On step 1 of this page i get this content

<Error><Code>NoSuchBucket</Code><Message>The specified bucket does not exist</Message><BucketName>wrmlbeta</BucketName><RequestId>6C285953714CB083</RequestId><HostId>yNLl/JZWpXK0A8trYCz4piSdSdRXTFozvSrp5BLHZSXiTO/J+HW87V0yCEph1Pfp</HostId></Error>

Does not build on Mac OS X 10.6.2

The readlink binary shipped with Mac OS X 10.6 is not the same as the linux one, so "readlink -m" will not work.
After installing the coreutilities through macports and changing the the file to "greadlink -m" it proceeded but said that the installed gcc was not able to produce executable binaries. Latest Xcode is installed.

QuickStart outdated or some files missing

doc/QuickStart says smth about

  1. host-tools/rendering
  2. host-tools/indexing
    but they are missing in repository

also Makefile doesn't know webkit goal, so make webkit is impossible

Issue building spanish database

Hi,

I'm getting the following error while trying to build the spanish database during the render phase:

Render[0]: 102.98s 236000
Traceback (most recent call last):
File "./ArticleRenderer.py", line 1055, in
main()
File "./ArticleRenderer.py", line 215, in main
WrProcess(f)
File "./ArticleRenderer.py", line 461, in init
self.feed(block)
File "/usr/lib/python2.6/HTMLParser.py", line 108, in feed
self.goahead(0)
File "/usr/lib/python2.6/HTMLParser.py", line 148, in goahead
k = self.parse_starttag(i)
File "/usr/lib/python2.6/HTMLParser.py", line 268, in parse_starttag
self.handle_starttag(tag, attrs)
File "./ArticleRenderer.py", line 656, in handle_starttag
self.li_cnt[self.level] += 1
KeyError: 0
make[1]: *** [render] Error 1
make[1]: Leaving directory `/home/rigo/Desktop/wikireader-wikireader-f61d917/host-tools/offline-renderer'
make: *** [render] Error 2

Any ideas?
Thanks a lot,

Update instructions reference file in nonexistent bucket

The wiki page on updating the reader reference wrmlbeta.s3.amazonaws.com to get an xml file. Amazon reports that bucket as being nonexistent.

Is there another place to obtain this file? Are there long-form instructions on archiving Wikipedia properly for the device or obtaining an archive from a standard, long-lived location?

how to make data of e-book

I dump wikibooks xml data and make data for wikireader.
but in searching phrase, all data looked.
when searching enguten data, only book title was looked.
why?

i

Incorrect line breaks between spans of text in one font and another

When a puctuation character is rendered in the normal font, and the text before it is rendered in another fonr (italic or underline), and the punctuation character does not fit on the same line as the text preceding it, the punctuation character is rendered on the line following its preceding text.

That means that
, in some cases
, the text is rendered
like this,

which looks bad.

make index fails with xml-file-samples

I'm getting the following error when I attempt to make image work index
python --version output is
Python 2.5.4

joachimp@chaboo:/usr/local/src/wikireader$ make DESTDIR=image WORKDIR=work XML_FILES=xml-file-samples/japanese_architects.xml index
cd host-tools/offline-renderer && make index
XML_FILES="/usr/local/src/wikireader/xml-file-samples/japanese_architects.xml" RENDER_BLOCK="0"
WORKDIR="/usr/local/src/wikireader/work" DESTDIR="/usr/local/src/wikireader/image"
make[1]: Entering directory /usr/local/src/wikireader/host-tools/offline-renderer' mkdir -p "/usr/local/src/wikireader/work/templates/" ./ArticleIndex.py \ --article-index="/usr/local/src/wikireader/work/articles.db" \ --article-offsets="/usr/local/src/wikireader/work/offsets.db" \ --article-counts="/usr/local/src/wikireader/work/counts.text" \ --template-prefix="/usr/local/src/wikireader/work/templates/" \ --prefix="/usr/local/src/wikireader/image/pedia" /usr/local/src/wikireader/xml-file-samples/japanese_architects.xml ./ArticleIndex.py:279: Warning: 'with' will become a reserved keyword in Python 2.6 File "./ArticleIndex.py", line 279 with open(self.file_import, 'w',) as f: ^ SyntaxError: invalid syntax make[1]: *** [index] Error 1 make[1]: Leaving directory/usr/local/src/wikireader/host-tools/offline-renderer'
make: *** [index] Error 2

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.