galvanizedatascience / george Goto Github PK
View Code? Open in Web Editor NEWHelpers for Zipfian Academy curriculum and whatnot
Helpers for Zipfian Academy curriculum and whatnot
Each check of the sprint or project structure should run exactly once, like a normal test suite.
When I run it on zipfian/nytimes@9a92fc3503760050908b5e3a80bbdcd0732b9893, it checks the presence of \n## Glossary
several times.
cd nlp-feature-selection
$ george check-sprint
# ...
======================================================================
FAIL: runTest (george._helpers.FooTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/tlevine/Zipfian/george/george/_helpers.py", line 7, in runTest
func()
File "/home/tlevine/Zipfian/george/george/check_sprint.py", line 31, in <lambda>
add_test(_suite, lambda: check_readme_has_section(sectionname))
File "/home/tlevine/Zipfian/george/george/check_sprint.py", line 79, in check_readme_has_section
n.assert_in('\n## %s' % section, readme)
AssertionError: '\n## Glossary' not found in "This is an introduction to NLP that doesn't discuss machine learning.\n\nOutline\n----------\nI think we should break this into two or three sprints or do it after another\nsprint that has already touched on some of these concepts.\n\n1. Motivate the applications of NLP\n * Sentiment analysis\n * Autocorrect\n * Information retrieval and question-answering\n * Machine translation\n * SPAM\n * ...\n2. Fundamental paradigms\n * Bags of words\n * N-grams\n * String similarity metrics\n * Tokenization\n3. Examples of the use of the above paradigms in practice\n\nExercise\n----------\nHere's a shorter one that naturally keeps a tabular structure:\nWe have a dataset for which each row has an associated text file.\nStudents extract some simple features from each and write about\ntheir methodology. I'm thinking things like\n* Number of sentences and paragraphs\n* Prominent named entities\n* Prominent N-grams (Yelp does this.)\n* An interesting paragraph or section. For example,\n * Given some emails, find the salutation and the valediction.\n * Given some planning licence applications, find the paragraph that\n mentions the size of the proposed development.\n * Given some documents of highly variable structure, find the\n postal addresses\n\nAnother possibility: Students are given a bunch of documents to group.\nHere are some approaches\n* String similarity\n* Topic modelling\n* Extract any interesting features, then use any unsupervised\n classification algorithm.\n\n"
======================================================================
FAIL: runTest (george._helpers.FooTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/tlevine/Zipfian/george/george/_helpers.py", line 7, in runTest
func()
File "/home/tlevine/Zipfian/george/george/check_sprint.py", line 31, in <lambda>
add_test(_suite, lambda: check_readme_has_section(sectionname))
File "/home/tlevine/Zipfian/george/george/check_sprint.py", line 79, in check_readme_has_section
n.assert_in('\n## %s' % section, readme)
AssertionError: '\n## Glossary' not found in "This is an introduction to NLP that doesn't discuss machine learning.\n\nOutline\n----------\nI think we should break this into two or three sprints or do it after another\nsprint that has already touched on some of these concepts.\n\n1. Motivate the applications of NLP\n * Sentiment analysis\n * Autocorrect\n * Information retrieval and question-answering\n * Machine translation\n * SPAM\n * ...\n2. Fundamental paradigms\n * Bags of words\n * N-grams\n * String similarity metrics\n * Tokenization\n3. Examples of the use of the above paradigms in practice\n\nExercise\n----------\nHere's a shorter one that naturally keeps a tabular structure:\nWe have a dataset for which each row has an associated text file.\nStudents extract some simple features from each and write about\ntheir methodology. I'm thinking things like\n* Number of sentences and paragraphs\n* Prominent named entities\n* Prominent N-grams (Yelp does this.)\n* An interesting paragraph or section. For example,\n * Given some emails, find the salutation and the valediction.\n * Given some planning licence applications, find the paragraph that\n mentions the size of the proposed development.\n * Given some documents of highly variable structure, find the\n postal addresses\n\nAnother possibility: Students are given a bunch of documents to group.\nHere are some approaches\n* String similarity\n* Topic modelling\n* Extract any interesting features, then use any unsupervised\n classification algorithm.\n\n"
======================================================================
FAIL: runTest (george._helpers.FooTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/tlevine/Zipfian/george/george/_helpers.py", line 7, in runTest
func()
File "/home/tlevine/Zipfian/george/george/check_sprint.py", line 31, in <lambda>
add_test(_suite, lambda: check_readme_has_section(sectionname))
File "/home/tlevine/Zipfian/george/george/check_sprint.py", line 79, in check_readme_has_section
n.assert_in('\n## %s' % section, readme)
AssertionError: '\n## Glossary' not found in "This is an introduction to NLP that doesn't discuss machine learning.\n\nOutline\n----------\nI think we should break this into two or three sprints or do it after another\nsprint that has already touched on some of these concepts.\n\n1. Motivate the applications of NLP\n * Sentiment analysis\n * Autocorrect\n * Information retrieval and question-answering\n * Machine translation\n * SPAM\n * ...\n2. Fundamental paradigms\n * Bags of words\n * N-grams\n * String similarity metrics\n * Tokenization\n3. Examples of the use of the above paradigms in practice\n\nExercise\n----------\nHere's a shorter one that naturally keeps a tabular structure:\nWe have a dataset for which each row has an associated text file.\nStudents extract some simple features from each and write about\ntheir methodology. I'm thinking things like\n* Number of sentences and paragraphs\n* Prominent named entities\n* Prominent N-grams (Yelp does this.)\n* An interesting paragraph or section. For example,\n * Given some emails, find the salutation and the valediction.\n * Given some planning licence applications, find the paragraph that\n mentions the size of the proposed development.\n * Given some documents of highly variable structure, find the\n postal addresses\n\nAnother possibility: Students are given a bunch of documents to group.\nHere are some approaches\n* String similarity\n* Topic modelling\n* Extract any interesting features, then use any unsupervised\n classification algorithm.\n\n"
----------------------------------------------------------------------
Ran 15 tests in 0.013s
FAILED (failures=6)
George should set up continuous integration for each repository so that we can tell how complete things are.
Here's a list of possible services.
http://blog.testnoir.com/ciaas-roundup-11-hosted-continuous-integration-services/
The checks are helping me keep track of what's finished, but I'm having trouble getting a bigger picture, and I think CI will help with that. On the other hand, this might only be an issue for the next month, so if this seems like too much work, I'll skip it.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.