Gulf Arabic Language Data
Gulf Arabic, also called Khaliji, is a continuum of Arabic dialects spoken around the coasts of the Persian Gulf in Kuwait, Bahrain, Quatar, UAE and some parts of Saudi Arabia, Oman and Iraq. There is no standardized version of the dialect, but there is a high degree of mutual intelligibility between its various sub-dialects.
As with Modern Standard Arabic, the main orthographic convention for Gulf Arabic is to omit tashkil (used to indicate short vowels), and to include only consonant marking (i’jam) to indicate long vowels.
Volume of Language Data
Total number of forms
The total number of forms is approximately 18,000,000
The following is a breakdown of the approximate number of forms in the Gulf Arabic Language Data:
- Non-inflectional morphology:
- About 5,000 forms for prepositions, conjunctions, interjections…
- Note: this will include forms constructed using the pronominal suffixes, but will not include definite article or any other prefixes.
- Inflectional and derivational morphology:
- Nouns: 750,000 forms
- Verbs: 1,000,000 forms
- Adjectives: 250,000 forms
Total number of lemmas
Inflectional Morphology Data
The Lexical Resource for Gulf Arabic contains all the forms for all POSs: nouns, verbs, adjectives, adverbs, pronouns, prepositions, conjunctions, numerals and particles.
Derivational Morphology Data
It also includes all derivational forms including adjectives derived from nouns (nisba) and verbal nouns or adverbs derived from adjectives.
Extended Morphology Data
The data also covers the result of extending the inflectional and derivational forms lists as a result of considering additional morphological phenomena such as common combinations of productive prefixes.
Frequency Indication includes relative frequency information for words in a corpus. Frequency expressed in the form of logarithmic “buckets” or “frequency groups” (from 255, the most common forms, to 0, the least common forms).
Complementary Semantic Annotations
The usage of specific forms or lemmas information is included. Words that are rarely used will be tagged as “rare”.
Words borrowed from foreign languages that are not widely understood, or which are only meaningful as part of a larger phrase, will be tagged as “foreign”.
Words or spelling variations which are not officially recognized but are widely used in texting communication will be tagged as “non-standard”.
Bitext provides data regarding offensive, vulgar and sensitive words with all the lemmas, POS and attributes. Offensive and vulgar words will be marked as “offensive” (highly offensive derogatory slurs based on race, sexual orientation, etc.). Vulgar words should be marked as “vulgar” (strong curse words).
Words that are sensitive should be marked “sensitive” (clinical names of genitalia, politically charged words, light curse words, etc.) Words that are not themselves offensive, vulgar, or sensitive, but could be part of potentially disturbing phrases will be marked as “sensitive-in-context”.
Categories includes the data regarding frequently used words with all the lemmas, POS and attributes. Frequently used words are considered to fall under, and will be tagged with the categories specified bellow:
- Apple Product (Apple-owned trademarks and product names)
- Brandname (Well-known brands and products)
- Body part
- Family name
- Female first name
- Georegion (Names of regions not covered by the geopolitical names in the country/state/city/waterway categories)
- Greetings (including multi-word expressions)
- Male first name
- Waterway (Names of rivers, lakes, oceans, etc.)