Skip to content
View in the app

A better way to browse. Learn more.

Thailand News and Discussion Forum | ASEANNOW

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

Counting Words

Featured Replies

How consistent are Thais at counting the number of words in a sentence or a paragraph? How natural is the task?

I ask because of the problem of splitting Thai text into words, which many word processors and line layout systems attempt to do. One can tell these systems where word boundaries are by inserting what LibreOffice calls a 'no-width break' and can often tell them where they aren't by inserting what LibreOffice calls a 'no-width no-break'. Techies will know these characters as ZERO WIDTH SPACE (ZWSP) and WORD JOINER (WJ). From next week, the Unicode standard will only allow WJ to mark places where a new line cannot be started; it will definitely not be a valid indicator that the letters on either side belong to the same word. The Unicode Technical Committee (UTC) claim that it is already not such an indicator, but that was not the belief of many people who write the software. Consequently, this change is not going through a process of international approval, but has been decided upon by the UTC, largely on the basis that it doesn't upset algorithms which don't work on Thai.

One argument for preserving the functionality is that it is needed so that the number of words can be counted correctly when software attempts to find word boundaries without any help from these 'no width' indicators. However, I am not sure that Thais agree on how many words there are in a paragraph. Europeans get regular training through the use of spaces, but Thais do not.

I think with educated people the counts are going to be pretty consistent. With the less educated, less so.

One of the major problems is the treatment of คำคู่ and other words that may be a single word in their own right or may be a collocation. For example, how many words is เร็วด่วน?

Thankfully the issue isn't as much as a problem as it is with Vietnamese where it's traditionally been taught that Vietnamese is a monosyllabic language, even though there clearly are polysyllabic words.

As for "software ... to find word boundaries without any help from these ... indicators", the reality is that even when backed by a dictionary, the available parsing algorithms are not particularly good - particularly where the text contains words which are not in the dictionary. See, for example thai-language.com's and thai-notes.com's "bulk lookup", and thai2english.com's equivalent function.

  • Author

My fundamental question, though, is whether the counting error due to unrecognised or misidentified words is significant compare to the variation resulting from different people doing the counting.

Create an account or sign in to comment

Recently Browsing 0

  • No registered users viewing this page.

Account

Navigation

Search

Search

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.