The Research Trend of Statistical Significance Test: Bibliometric Analysis

Authors

  • Dwi Fitria Al Husaeni Universitas Pendidikan Indonesia Author
  • Dwi Novia Al Husaeni Universitas Pendidikan Indonesia Author
  • Meli Fiandini Universitas Pendidikan Indonesia Author
  • Asep Bayu Dani Nandiyanto Universitas Pendidikan Indonesia Author

Keywords:

Bibliometric analysis, Significance test, Statistics

Abstract

A significance test is a test that can determine whether a research hypothesis is accepted or not. Therefore, significance tests need to be carried out, especially for researchers who will conduct research related to hypothesis testing. This research discusses publication trends regarding significance tests. This research aims to analyze research trends regarding statistical significance tests using bibliometric analysis methods assisted by mapping analysis. Bibliometric analysis methods and mapping analysis with VOSviewer were used in this research. The data source was taken from the Google Scholar database in the period 2013 - 2023. The total number of documents found during the last 10 years was 1000 documents. Based on the research results, it was found that the number of publications regarding statistical significance tests has decreased every year. From a total of 281 documents in 2013 to 7 documents in 2023. The results of article data mapping produce three forms of visualization, namely network, overlay, and density visualization. The mapping results show that research on statistics still needs to be carried out, especially regarding significance tests. This research concluded that the trend of research discussing statistical significance tests is decreasing, although in terms of its use, it is still very important, especially in processing quantitative research data.

 

Author Biographies

  • Dwi Fitria Al Husaeni, Universitas Pendidikan Indonesia

    Departemen Pendidikan Ilmu Komputer

  • Dwi Novia Al Husaeni, Universitas Pendidikan Indonesia

    Departemen Pendidikan Ilmu Komputer

  • Meli Fiandini, Universitas Pendidikan Indonesia

     Departemen Pendidikan Ilmu Pengetahuan Alam

  • Asep Bayu Dani Nandiyanto, Universitas Pendidikan Indonesia

    Departemen Kimia

References

Akoglu, H. (2018). User's guide to correlation coefficients. Turkish Journal of Emergency

Medicine, 18(3), 91-93.

Al Husaeni, D. F., and Nandiyanto, A. B. D. (2022). Bibliometric using Vosviewer with Publish

or Perish (using google scholar data): From step-by-step processing for users to the

practical examples in the analysis of digital learning articles in pre and post Covid-19

pandemic. ASEAN Journal of Science and Engineering, 2(1), 19-46.

Al Husaeni, D.F., and Munir, M. (2023). Literature review and bibliometric mapping analysis:

Philosophy of science and technology education. Indonesian Journal of Multidiciplinary

Research, 3(2), 219-234

Al Husaeni, D.N. (2022). Bibliometric analysis of briquette research trends during the covid

pandemic. ASEAN Journal for Science and Engineering in Materials, 1(2), 99-106.

Amrhein, V., Greenland, S., and McShane, B. (2019). Scientists rise up against statistical

significance. Nature, 567(7748), 305-307.

Andrade, C. (2019). The P value and statistical significance: misunderstandings, explanations,

challenges, and alternatives. Indian Journal of Psychological Medicine, 41(3), 210-215. Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E. J., Berk, R., and

Johnson, V. E. (2018). Redefine statistical significance. Nature Human Behaviour, 2(1), 6

Blevins, C. A., Weathers, F. W., Davis, M. T., Witte, T. K., and Domino, J. L. (2015). The

posttraumatic stress disorder checklist for DSM‐5 (PCL‐5): Development and initial

psychometric evaluation. Journal of Traumatic Stress, 28(6), 489-498.

Carrasco, J., García, S., Rueda, M. M., Das, S., and Herrera, F. (2020). Recent trends in the use

of statistical tests for comparing swarm and evolutionary computing algorithms:

Practical guidelines and a critical review. Swarm and Evolutionary Computation, 54,

Chen, G., Wu, D. I., Guo, W., Cao, Y., Huang, D., Wang, H., Wang, t., Zhang, X., Chen, H., Yu, h.,

Zhang, X., Zhang, M., Wu, S., Song, J., Chen, T., Meifang, H., Li, S., Luo, X., Zhao, J., and

Ning, Q. (2020). Clinical and immunological features of severe and moderate coronavirus

disease 2019. The Journal of Clinical Investigation, 130(5), 2620-2629.

Cox, D. R. (1982). Statistical significance tests. British Journal of Clinical Pharmacology, 14(3),

-331.

Everingham, M., Eslami, S. A., Van Gool, L., Williams, C. K., Winn, J., and Zisserman, A. (2015).

The pascal visual object classes challenge: A retrospective. International Journal of

Computer Vision, 111, 98-136.

Fernández-Delgado, M., Cernadas, E., Barro, S., and Amorim, D. (2014). Do we need hundreds

of classifiers to solve real world classification problems?. The Journal of Machine

Learning Research, 15(1), 3133-3181.

Hinshaw, G., Larson, D., Komatsu, E., Spergel, D. N., Bennett, C., Dunkley, J., Nolta, m. R.,

Halpern, M., Hill, R. S., and Wright, E. L. (2013). Nine-year Wilkinson Microwave

Anisotropy Probe (WMAP) observations: cosmological parameter results. The

Astrophysical Journal Supplement Series, 208(2), 19.

Hofifah, S. N., and Nandiyanto, A. B. D. (2024). Water hyacinth and education research trends

from the scopus database: A bibliometric literature review. ASEAN Journal of Science

and Engineering Education, 4(2), 121-132.

Kim, B. J., Jeong, S., and Chung, J. B. (2021). Research trends in vulnerability studies from 2000

to 2019: Findings from a bibliometric analysis. International Journal of Disaster Risk

Reduction, 56, 102141.

Kuznetsova, A., Brockhoff, P. B., and Christensen, R. H. (2017). lmerTest package: tests in

linear mixed effects models. Journal of Statistical Software, 82, 1-26.

Lenth, R. V. (2016). Least-squares means: the R package lsmeans. Journal of Statistical

Software, 69, 1-33.

Nandiyanto, A. B. D., Fiandini, M., and Al Husaeni, D. N. (2024). Research trends from the

scopus database using keyword water hyacinth and ecosystem: A bibliometric literature

review. ASEAN Journal of Science and Engineering, 4(1), 33-48.

Nandiyanto, A. B. D., Ragadhita, R., Al Husaeni, D. N., and Nugraha, W. C. (2023). Research

trend on the use of mercury in gold mining: Literature review and bibliometric analysis.

Moroccan Journal of Chemistry, 11(1), 11-1.

Neal, B., Perkovic, V., Mahaffey, K. W., De Zeeuw, D., Fulcher, G., Erondu, N., Shaw, W., Law,

G., Desai, M., and Matthews, D. R. (2017). Canagliflozin and cardiovascular and renal

events in type 2 diabetes. New England Journal of Medicine, 377(7), 644-657.

Niknejad, N., Ismail, W., Bahari, M., Hendradi, R., and Salleh, A. Z. (2021). Mapping the

research trends on blockchain technology in food and agriculture industry: A

bibliometric analysis. Environmental Technology and Innovation, 21, 101272.

Nurrahma, A. H. I., Putri, H. H., and Syahadat, R. M. (2023). Scientific research trends of

flooding stress in plant science and agriculture subject areas (1962-2021). ASEAN Journal

of Science and Engineering, 3(2), 163-178.

Onwuegbuzie, A. J., and Leech, N. L. (2004). Enhancing the interpretation of “significant”

findings: The role of mixed methods research. The Qualitative Report, 9(4), 770-792.

Ragadhita, R., and Nandiyanto, A. B. D. (2022). Computational bibliometric analysis on

publication of techno-economic education. Indonesian Journal of Multidiciplinary

Research, 2(1), 213-222.

Ruzmetov, A., and Ibragimov, A. (2023). Past, current and future trends of salicylic acid and

its derivatives: A bibliometric review of papers from the Scopus database published from

to 2021. ASEAN Journal for Science and Engineering in Materials, 2(1), 53-68.

Soegoto, H., Soegoto, E.S., Luckyardi, S., and Rafdhi, A.A. (2022). A bibliometric analysis of

management bioenergy research using vosviewer application. Indonesian Journal of

Science and Technology, 7(1), 89-104.

Suprapto, N., Sukarmin, S., Puspitawati, R. P., Erman, E., Savitri, D., Ku, C. H., and Mubarok, H.

(2021). Research Trend on TPACK through Bibliometric Analysis (2015-2019).

International Journal of Evaluation and Research in Education, 10(4), 1375-1385.

Zhang, W. (2022). p-value based statistical significance tests: Concepts, misuses, critiques,

solutions and beyond. Computational Ecology and Software, 12(3), 80-122.

Zinman, B., Wanner, C., Lachin, J. M., Fitchett, D., Bluhmki, E., Hantel, S., Mattheus, M.,

Devins, T., Johansen, O. E/. Woerle, H. J., broedl, U. C.,and Inzucchi, S. E. (2015).

Empagliflozin, cardiovascular outcomes, and mortality in type 2 diabetes. New England

Journal of Medicine, 373(22), 2117-2128.

Downloads

Published

2024-03-01