Comments (5)
Could you show me the python code you used to create the table and the rows in the first place?
from scraperwiki-python.
Sure, I'm just using the save() method to store each pair of values.
for i, subtext in zip([i for i in range(60) if i % 2 != 0], subtexts):
title = titles[i].cssselect('a')[0].text_content()
if 'points' in subtext.text_content():
score_text = subtext.cssselect('span')[0].text_content()
score = int(score_text[:score_text.find('p'):])
else:
score = 0
scraperwiki.sql.save(['title'], {'title': title, 'score': score})
from scraperwiki-python.
What happens if you run:
print scraperwiki.sql.select('sql from sqlite_master')[0]['sql']
(assuming you only have one table)
from scraperwiki-python.
I get this:
CREATE TABLE `swdata` (
`score` text,
`title` text)
So indeed the problem must be the score column taking on a 'text' type. Is the table_info() method no longer a part of the library?
from scraperwiki-python.
No, there's no table_info function any more.
On Fri, Jul 05, 2013 at 11:14:20AM -0700, Sean Duffy wrote:
I get this:
REATE TABLE `swdata` ( `score` text , `title` text)
So indeed the problem must be the score column taking on a 'text' type. Is the table_info() method no longer a part of the library?
Reply to this email directly or view it on GitHub:
#24 (comment)
from scraperwiki-python.
Related Issues (20)
- Error on `atexit` event when using only pdftoxml util function HOT 3
- Fix test failure in Python 3.5 and up
- `unique_keys` doesn't work for buffered data
- scraperwiki does not support python version 3.10.7
- pdftoxml() docs inconsistent with code HOT 4
- pdftoxml in utils.py is not portable to Windows. HOT 3
- utils.py uses both urllib2 and requests to make requests HOT 3
- cannot `import scraperwiki` on read only directory HOT 3
- doubleflush bug HOT 11
- No new release since July HOT 2
- INSERT OR REPLACE INTO is sqlite-specific HOT 10
- Cannot change the columns after the first save. HOT 5
- Can't save lxml strings. HOT 6
- mysterious "no such table" crash HOT 4
- SQLAlchemy error storing empty strings HOT 2
- Not Python 3 compatible HOT 6
- Unicode column names fail the second time you use them.
- sqlalchemy.exc.OperationalError on writing to a table `details` HOT 5
- Dependency on pdftohtml HOT 2
- sql.save has weird functionality with existing data
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from scraperwiki-python.