Incorporating Multi-granularity Linguistic Units in Character-based Word Segmentation

Digital data available（東京工業大学リサーチリポジトリ）

学術機関リポジトリデータベース（IRDB）（機関リポジトリ）

Incorporating Multi-granularity Linguistic Units in Character-based Word Segmentation

Material type: 博士論文

Author: CHAY-INTR, Thodsapornほか

Publisher: -

Publication date: 2023-09

Material Format: Digital

Capacity, size, etc.: -

Name of awarding university/degree: 東京工業大学,博士(工学)

View All

Notes on use

Note (General)：: A character sequence tends to comprise segmentation alternatives, leading to segmentation ambiguity. Properly handling this ambiguity using multi-gran...

Search by Bookstore

Holdings of Libraries in Japan

This page shows libraries in Japan other than the National Diet Library that hold the material.

List of Cooperating Institutions and Databases

Please contact your local library for information on how to use materials or whether it is possible to request materials from the holding libraries.

other

Tokyo Tech Research Repository
Digital
You can check the holdings of institutions and databases with which Institutional Repositories DataBase(IRDB)(Institutional Repository) is linked at the site of Institutional Repositories DataBase(IRDB)(Institutional Repository).
Tokyo Tech Research Repository

Search by Bookstore

Bibliographic Record

You can check the details of this material, its authority (keywords that refer to materials on the same subject, author's name, etc.), etc.

Digital

Material Type: 博士論文
Title: Incorporating Multi-granularity Linguistic Units in Character-based Word Segmentation
Author/Editor: CHAY-INTR, Thodsaporn
Chay-intr, Thodsaporn
Author Heading: CHAY-INTR, Thodsaporn
Chay-intr, Thodsaporn
Publication Date: 2023-09
Publication Date (W3CDTF): 2023-09
Degree grantor/type: 東京工業大学
Date Granted: 2023-09-22
Dissertation Number: 甲第12542号
Degree Type: 博士(工学)
Text Language Code: eng
Subject Heading: Word segmentation
Representation learning
Linguistic units
Target Audience: 一般
Note (General): A character sequence tends to comprise segmentation alternatives, leading to segmentation ambiguity. Properly handling this ambiguity using multi-granularity linguistic units, such as character clusters, subwords, and words, can improve word segmentation performance and lessen ambiguous boundary decisions. We conduct a study to investigate the potential of using various linguistic units and leveraging segmentation alternatives for character-based word segmentation. Our experimental results demonstrated improvements in segmentation performance, outperforming previous work on the BCCWJ, CTB6, and BEST2010 datasets in Japanese, Chinese, and Thai, respectively.
identifier:oai:t2r2.star.titech.ac.jp:50672947
Source: fulltext
http://t2r2.star.titech.ac.jp/rrws/file/CTT100902372/ATD100000413/19D10554_CHAY-INTR-Thodsaporn_thesis.pdf
Access Restrictions: インターネット公開
Data Provider (Database): 国立情報学研究所 : 学術機関リポジトリデータベース（IRDB）（機関リポジトリ）
https://irdb.nii.ac.jp
Original Data Provider (Database): 東京工業大学 : 東京工業大学リサーチリポジトリ