|
Abstract
|
Article Information:
Percentage Discounting: A New Good Turing Smoothing Technique
Rakhshanda Yousaf, Waqas Anwar, Usama Ijaz Bajwa and Ali Nawaz Khan
Corresponding Author: Rakhshanda Yousaf
Submitted: October 12, 2011
Accepted: February 09, 2012
Published: April 15, 2012 |
Abstract:
|
In this study, we have applied percentage discounting technique to overcome a drawback in Good-
Turing smoothing technique. Data sparseness is an inherent and a severe problem in language modeling.
Smoothing is one of the important processes to handle this problem. There are several well-known smoothing
techniques which are used to solve data sparseness problem. In general, smoothing techniques ignore linguistic
knowledge and are particularly based on statistical hypotheses. Good Turing is very effective for data
sparseness problem but it has a drawback that it calculates zero probability if frequency of next frequency is
zero. Consequently a new technique is presented in this study, which is percentage discounting technique and
this technique can overcome the drawback of Good Turing smoothing.
Key words: Percentage discounting, smoothing methods, statistical language model, , , ,
|
|
Abstract
|
PDF
|
HTML |
|
Cite this Reference:
Rakhshanda Yousaf, Waqas Anwar, Usama Ijaz Bajwa and Ali Nawaz Khan, . Percentage Discounting: A New Good Turing Smoothing Technique. Research Journal of Applied Sciences, Engineering and Technology, (08): 902-905.
|
|
|
|
 |
ISSN (Online): 2040-7467
ISSN (Print): 2040-7459 |
 |
| Information |
|
|
|
|
| Sales & Services |
|
|
|
|
