A hybrid Hadoop-based sentiment analysis classifier for tweets associated with COVID-19 utilizing two machine learning algorithms: CNN, and fuzzy C4.5

dc.contributor.authorEs-sabery, Fatima
dc.contributor.authorEs-sabery, Ibrahim
dc.contributor.authorQadir, Junaid
dc.contributor.authorSainz de Abajo, Beatriz
dc.contributor.authorGarcía-Zapirain, Begoña
dc.date.accessioned2025-02-20T11:55:52Z
dc.date.available2025-02-20T11:55:52Z
dc.date.issued2024-12
dc.date.updated2025-02-20T11:55:52Z
dc.description.abstractIn recent years, research on opinion mining from X (formerly Twitter) has rapidly advanced, focusing on processing tweets to determine user sentiments about events. Many researchers prefer using machine and deep learning techniques for this analysis. This work proposes a novel approach integrating the C4.5 procedure, fuzzy rule patterns, and convolutional neural networks. The approach involves six steps: pre-processing to remove noisy data, vectorizing tweets with word embedding, extracting sentiment and contextual features using convolutional neural networks, fuzzifying outputs with a Gaussian fuzzifier to handle ambiguity, constructing a fuzzy tree and rule base using a fuzzy version of C4.5, and classifying tweets with fuzzy General Reasoning. This method combines the benefits of convolutional neural networks and C4.5 while addressing imprecise data with fuzzy logic. Implemented on a Hadoop framework-based cluster with five computing units, the approach was extensively tested. The results showed that the model performs exceptionally well on the COVID-19_Sentiments dataset, surpassing other classification algorithms with a precision rate of 94.56%, false-negative rate of 5.28%, classification rate of 95.15%, F1-score of 94.63%, kappa statistic of 95.12%, execution time of 11.81 s, false-positive rate of 4.26%, error rate of 4.26%, specificity of 95.74%, recall of 94.72%, stability with a mean deviation standard of 0.09%, convergence starting around the 75th round, and significantly reduced complexity in terms of time and space.en
dc.description.sponsorshipThis work is supported by the eVida Research Group, University of Deusto, Bilbao, Spain, under Grant IT 905-16en
dc.identifier.citationEs-sabery, F., Es-sabery, I., Qadir, J., Sainz-de-Abajo, B., & Garcia-Zapirain, B. (2024). A hybrid Hadoop-based sentiment analysis classifier for tweets associated with COVID-19 utilizing two machine learning algorithms: CNN, and fuzzy C4.5. Journal of Big Data, 11(1). https://doi.org/10.1186/S40537-024-01014-4
dc.identifier.doi10.1186/S40537-024-01014-4
dc.identifier.eissn2196-1115
dc.identifier.urihttp://hdl.handle.net/20.500.14454/2343
dc.language.isoeng
dc.publisherSpringer Nature
dc.rights© The Author(s) 2024
dc.subject.otherConvolutional neural network
dc.subject.otherFuzzy rule pattern
dc.subject.otherFuzzy version of C4.5 procedure
dc.subject.otherHadoop framework
dc.subject.otherSentiment analysis
dc.subject.otherX opinion mining
dc.titleA hybrid Hadoop-based sentiment analysis classifier for tweets associated with COVID-19 utilizing two machine learning algorithms: CNN, and fuzzy C4.5en
dc.typejournal article
dcterms.accessRightsopen access
oaire.citation.issue1
oaire.citation.titleJournal of Big Data
oaire.citation.volume11
oaire.licenseConditionhttps://creativecommons.org/licenses/by-nc-nd/4.0/
oaire.versionVoR
Archivos
Bloque original
Mostrando 1 - 1 de 1
Cargando...
Miniatura
Nombre:
essabery_hybrid_2024.pdf
Tamaño:
4.68 MB
Formato:
Adobe Portable Document Format
Colecciones