CLUSTERING NEWS ARTICLES USING K-MEANS AND N-GRAMS
- Project Research
- 1-5 Chapters
- Abstract : Available
- Table of Content: Available
- Reference Style: APA
- Recommended for : Student Researchers
- NGN 3000
ABSTRACT
Document clustering is an automatic unsupervised machine learning technique that aimed at grouping related set of items into clusters or subsets. The target is creating clusters with high internal coherence, but different from each other substantially. Simply, items within the same cluster should be highly similar, while maintaining high dissimilarity with items within other clusters. Automatic clustering of documents has played a very significant role in many fields including data mining and information retrieval. This thesis aimed to improve the overall efficiency of a document clustering technique using N-grams and efficient similarity measure. The thesis improves the purity and accuracy of the obtained clusters. The preprocessing method is based on N-grams (sequence of N consecutive characters) which do not give consideration to stop-words or other special punctuations but creates and overlap among the content of a document which further gives room to ignore errors thereby increasing the quality of the clusters to a great extent. This approach clusters the news articles based on their N-grams representation, thereby reducing noise and increase the probability of occurrences of the sequences within the articles document. The proposed clustering technique has parameters which can be changed accordingly at the document representation level in order to improve the efficiency and quality of the generated clusters. The results from the experiment using R programming environment were carried out on real datasets of the Reuters21578 and 20Newsgropus proved the effectiveness of the proposed clustering technique at different levels of N-grams in terms of the accuracy and purity of the generated clusters. The results also showed that the proposed clustering technique perform averagely better than the baseline technique both in terms of accuracy and purity with a best results when the window of N-grams = 3.
Related Project Materials
PROPAGANDA IN POLITICS THE USE OF LANGUAGE FOR EFFECT IN ELECTIONEERING CAMPAIGN ( A case study of 2015 General election)
Abstract
The words perform actions. Language and, in fact, words have different functions and, according to J.L A...
A STYLISTIC STUDY OF ADICHIE'S THE THINGS AROUND YOUR NECK AND PURPLE HIBISCUS.
Background to the Study
A lot of similarities exist in the...
MODELLING OF WATER QUALITY DETERIORATION IN THE DISTRIBUTION NETWORK USING MATLAB
ABSTRACT
Public water supply is distributed through water pipe network, which affects the quality of water that gets to the consumers whe...
IMPACT OF PERSONALITY TRAITS ON INTERPERSONAL DEPENDENCE AMONG UNDERGRADUATES IN IMO STATE
ABSTRACT
This study is to examine the impact of personality traits on interpersonal dependence among undergraduates in I...
NETWORK RESTRICTION TO TWITTER PLATFORM: A BRIDGE TO FUNDAMENTAL RIGHTS OF NIGERIAN CITIZENS (A CASE STUDY OF TWITTER BAN)
The focus of the study is to examine network restriction to twitter platform: a bridge to fundamental rights of Nigerian citizens...
TAXATION AS AN INSTRUMENT OF FISCAL POLICY IN NIGERIA
ABSTRACT
This research work is an attempt to examine how taxation is used as a fiscal policy tool in planning, controlli...
THE USE OF FORENSIC ACCOUNTING IN REGULATORY COMPLIANCE IN THE MANUFACTURING SECTOR
Abstract: THE USE OF FORENSIC ACCOUNTING IN REGULATORY COMPLIANCE IN THE MANUFACTURING SECTOR
This research explores the...
AN ASSESSMENT OFGODFATHERISM AND GOVERNANCE IN ANAMBRA STATE, NIGERIA: THE CHRISTIAN RELIGION AS A PANACEA
Background of Study
In a democratic government, a lot of factors predict the travails of this sys...
TRENDS IN CURRICULUM DEVELOPMENT IN VOCATIONAL SCHOOLS
Abstract: This study explores trends in curriculum development in vocational schools in Nig...
PRODCUTION OF WOOD ADHESIVE LETTER OF TRANSMITTAL
-
-
HISTORICAL BACKGROUND (PREAMBLE)
-
Technology has played an...
