Darija Open Dataset (DODa) is an open-source project for the Moroccan dialect. With more than 18,000 entries DODa is arguably the largest open-source collaborative project for Darija <=> English translation built for Natural Language Processing purposes.

In fact, besides semantic categorization, DODa also adopts a syntactic one, presents words under different spellings, offers verb-to-noun and masculine-to-feminine correspondences, contains the conjugation of hundreds of verbs in different tenses, as well as more that 7000 translated sentences.

This open source project aims to be a reference in NLP Darija. We hope for the contribution of the Moroccan IT community in order to provide a pedestal for any future application of NLP for the benefit of Moroccans.

We've made a tutorial for you in DODa's website

• 3ndk ح dir ح xD (shout-out to this guy 😆), often try to use:

• Try to use capitalization to differentiate between the following letters:

• Arabic characters with two-letters Latin equivalent:

• Double characters to refer to the emphasis or "الشدة":

• We usually don't add "e" in the end of darija words : louz instead of louze

• We usually don't use "Z" or "th" for ظ ، ذ ، ث , because we generally don't use these letters in darija (except in northern Morocco, but for the sake of simplicity, we are focusing primarily on standard darija)

• When using apostrophes or commas, don't forget to surround the expression by quotation marks (as we are working on csv files)

"don't"

• We use spaces as word delimiters, not _ nor - : thank you instead of thank_you

• Respect the number of columns in every row you add, you can use empty quotation marks "" in case you don't have extra variations

• In every row, always start with the most used form (in your opinion of course) of the word in question

• For future use of this dataset to train deep neural networks, try to reserve each row to similar variations of the same word. For instance, "sou9" and "marchi" both translate to "market", yet it's better to separate them into two different rows:

"sou9","souk","souq","market"

"marchi","","","market"

• verbs.csv: The darija translation is reserved to the past tense of the third pronoun "he", whereas the other pronouns and tenses are handled in separate files. The English translation present the basic form (or root) of the English verb.

"ghnna","ghenna","ghanna","","","","sing"

• masculine_feminine_plural.csv: If it does exist, feminine-plural translation column is for nouns. Regarding adjectives feminine-plural = feminine.

@misc{outchakoucht2021moroccan,
      title={Moroccan Dialect -Darija- Open Dataset},
      author={Aissam Outchakoucht and Hamza Es-Samaali},
      year={2021},
      eprint={2103.09687},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}