There's an error in line 909 of Ask Ubuntu Corpus - the text of an intent's entity is "Xubuntu 12.04 LTS?" instead "Xubuntu 12.04 LTS". The error is probably caused by an error in "LTS?" tokenization, as the value of stop property looks OK.

Line 357, "SoftwareType" intent's entity is "Project" instead "Microsoft Project".

WebApplicatonCorpus, line 826, the web service annotated as Google instead Google Apps. Note that "Google Apps" is annotated as a service in other examples. It may be related to tokenization problem again ("...Google Apps?").

Hi, could you please provide corpora in format you were using to test other systems. Depending on the way you convert data results may be different.

Hi, do you still have the train/test splits you used in the paper?

Hey you mentioned that Web Applications Corpus has 100 data sets, but only 89 (30 for train and 59 for test) is included in your json file. Can you explain why there is a difference.

thanks

greg

The entity "StationStart" of "how can i get from moosach to quiddestraße?" in ChatbotCorpus.json seems incorrect

There are some utterances that perhaps does not have the correct intent:

AskUbuntuCorpus

• Utterance "Is there a Document scanning and archiving software?", is classified as "None", perhaps should be classified as "Software Recommendation"
• Utterance "Is it recommended to upgrade to Lubuntu 15.04?" is classified as "Software Recommendation", perhaps should be classified as "Make Update"
• Utterance "On really old Ubuntu 6.06 - How to upgrade" is classified as "Software Recommendation", perhaps should be classified as "Make Update"

WebApplicationsCorpus

• The utterance "Good wireframing apps?" is classified as "None", but In my oppinion a better classification can be "Find Alternative". Basically if the utterance was "Good wireframing apps like balsamiq" this will be clearly a "Find Alternative". By ommiting the entity the intent should remain the same.
• The utterance "What are alternatives to Postini for spam filtering?" is classified as "Filter Spam", perhaps should be classified as "Find Alternative"

Hi, is the benchmark code going to be released?

Below are two sentences from AskUbuntuCorpus.json. For the entity in the first sentence the start and stop have same value and point to the same word. However, for the second sentence start and stop should also have the same values. One increment can be explained by the dot, the other cannot.

{
    "author": "Tom Brito",
    "url": "http://askubuntu.com/questions/102675/is-there-a-project-management-software-for-ubuntu-like-microsoft-project",
    "text": "Is there a project management software for Ubuntu like Microsoft Project?",
    "entities": [
        {
            "text": "Project",
            "entity": "SoftwareName",
            "stop": 10,
            "start": 10
        }
    ],
    "intent": "Software Recommendation",
    "answer": {
        "text": "<p>I can also suggest <a href=\"http://apt.ubuntu.com/p/planner\" rel=\"nofollow noreferrer\">planner</a> <a href=\"http://apt.ubuntu.com/p/planner\" rel=\"nofollow noreferrer\"><img src=\"https://hostmar.co/software-small\" alt=\"Install planner\"></a>.  It's available in Ubuntu software-center.</p>\n\n<p><a href=\"http://www.taskjuggler.org/\" rel=\"nofollow noreferrer\">TaskJuggler</a> is really powerful but also a bit harder to use and is not available in Software Center.</p>\n",
        "author": "roadmr"
    },
    "training": false
},

{
    "author": "C.S Oren",
    "url": "http://askubuntu.com/questions/95328/how-to-partially-upgrade-ubuntu-11-10-from-ubuntu-11-04",
    "text": "How to partially upgrade Ubuntu 11.10 from Ubuntu 11.04?",
    "entities": [
        {
            "text": "11.10",
            "entity": "UbuntuVersion",
            "stop": 7,
            "start": 5
        },
        {
            "text": "11.04",
            "entity": "UbuntuVersion",
            "stop": 12,
            "start": 10
        }
    ],
    "intent": "Make Update",
    "answer": {
        "text": "<p>Upgrade using alternate-ubuntu iso \nit is better for slower connections\nit may solve your problem</p>\n",
        "author": "Tachyons"
    },
    "training": false
},