Home            Contact us            FAQs
    
      Journal Home      |      Aim & Scope     |     Author(s) Information      |      Editorial Board      |      MSP Download Statistics

     Research Journal of Applied Sciences, Engineering and Technology

    Abstract
2012(Vol.4, Issue:08)
Article Information:

Percentage Discounting: A New Good Turing Smoothing Technique

Rakhshanda Yousaf, Waqas Anwar, Usama Ijaz Bajwa and Ali Nawaz Khan
Corresponding Author:  Rakhshanda Yousaf 
Submitted: October 12, 2011
Accepted: February 09, 2012
Published: April 15, 2012
Abstract:
In this study, we have applied percentage discounting technique to overcome a drawback in Good- Turing smoothing technique. Data sparseness is an inherent and a severe problem in language modeling. Smoothing is one of the important processes to handle this problem. There are several well-known smoothing techniques which are used to solve data sparseness problem. In general, smoothing techniques ignore linguistic knowledge and are particularly based on statistical hypotheses. Good Turing is very effective for data sparseness problem but it has a drawback that it calculates zero probability if frequency of next frequency is zero. Consequently a new technique is presented in this study, which is percentage discounting technique and this technique can overcome the drawback of Good Turing smoothing.

Key words:  Percentage discounting, smoothing methods, statistical language model, , , ,
Abstract PDF HTML
Cite this Reference:
Rakhshanda Yousaf, Waqas Anwar, Usama Ijaz Bajwa and Ali Nawaz Khan, . Percentage Discounting: A New Good Turing Smoothing Technique. Research Journal of Applied Sciences, Engineering and Technology, (08): 902-905.
ISSN (Online):  2040-7467
ISSN (Print):   2040-7459
Submit Manuscript
   Information
   Sales & Services
Home   |  Contact us   |  About us   |  Privacy Policy
Copyright © 2024. MAXWELL Scientific Publication Corp., All rights reserved