Are you interested in contributing to HLWIKI International? contact
To browse other articles on a range of HSL topics, see the A-Z index.
- 27 May 2017
See also Altmetrics | Author impact metrics | Bibliometrics | Impact factors | ImpactStory | Scopus vs. Web of Science | Webometrics
- "...citation analysis is a bibliometric tool that is becoming increasingly popular to evaluate the performance of different actors in the academic and scientific arena, ranging from individual scholars (1–3), to journals, departments, universities (4), and national institutions (5), up to whole countries (6). The outcome of such analysis often plays a crucial role in deciding which grants are awarded, how applicants for a position are ranked, and even the fate of scientific institutions. It is then crucial that citation analysis is carried out in the most precise and unbiased way...." — Radicchi, 2008
Citation analysis (also citation indexing) is a type of bibliographic tracking activity (or subset of bibliometrics). CA is typically performed to evaluate published articles within the academic and scholarly communities. As a field and discipline, it was originally described by Eugene Garfield at the Institute for Scientific Information (ISI) which subsequently created citation indexes in 1961 (see the Scopus vs. Web of Science). Due to changes in scholarly publishing and open access, newer statistical citation methods (including combining them) have emerged in recent years. Google's PageRank algorithm, for example, is a kind of web-based tracking tool based on popularity, first and foremost, but also on citation analysis principles, where links leading to similar articles provide a higher pagerank. It is possible to do simple citation analysis using Google scholar, for example. Some recent methods have been performed using Google scholar and social media such as Mendeley and Zotero but come under criticism by various academics such as Peter Jacso.
- a model for assessment of research impact
Background to citation analysis
For promotion and tenure, faculty are expected to track articles citing their academic outputs whether they are papers, books or book chapters. Bibliometrics, or cited reference searching, is a way to analyze the scholarly output of authors within specified disciplines. This tracking is a quantitative method of determining impact, and a kind of ego-surfing. While Google scholar provides free access to some of this data via its cited by feature, generally this type of data-mining requires a structured database with cited reference search features. Finding occurences of authors and articles in footnotes and bibliographies of publications in print and digital formats is the main purpose of these tools. One of the best sources for this type of searching is Scientific Thomson's Web of Science (WoS). As a proprietary tool it requires a subscription to access it. The Web of Science (WoS) is a multidisciplinary database that contains the Science Citation Index, Social Sciences Citation Index and Arts & Humanities Citation Index. Another important proprietary tool for citation analysis is Scopus developed by the European publisher, Elsevier. Scopus provides cited reference searching for a range of scientific, technical, medical and social sciences literature. In 2014, Scopus announced a new journal metric called Impact per Publication (IPP). IPP measures the ratio of citations per article published, and provides an additional metric for comparing and evaluating journals. Access the IPP metric from the "Compare journals" tool in Scopus.
According to Acharya A et al. Rise of the rest: the growing impact of non-elite journals. arXiv. 16 October 2014, the idea of non-elite journal articles (traditionally, those that have not been cited much) have started to be cited more in the last ten years due to Google scholar.
- Bartneck C, Kokkelmans S. Detecting h-index manipulation through self-citation analysis. Scientometrics. 2011 Apr;87(1):85–98.
- Colaco M, Svider PF, Mauro KM, Eloy JA, Jackson-Rosario I. Is there a relationship between NIH funding and research impact in academic urology? J Urology. 1 March 2013.
- Craig ID, Plume AM, McVeigh ME, Pringle J, Amin M. Do open access articles have greater citation impact? A critical review of the literature. J Informetrics. 2007;1:239–48.
- Cronin B. Bibliometrics and beyond: some thoughts on web-based citation analysis. J Information Science. 2001;27(1):1–7.
- Davis PM, Price JS. eJournal interface can influence usage statistics: implications for libraries, publishers, and project COUNTER. J Am Soc Inf Sci Technol. 2006;57:1243–8.
- Davis PM. For electronic journals, total downloads can predict number of users: a multiple regression analysis. Portal: Libr Acad. 2004;4:379–92.
- Eysenbach G. Citation advantage of open access articles. PLoS Biol. 2006;4:e157.
- Franceschet M. A comparison of bibliometric indicators for computer science scholars and journals on Web of Science and Google scholar. Scientometrics. 2010;(3):243–258.
- Garfield E. Impact factors, and why they won't go away. Nature. 2001;411(6837):522.
- Garfield E. Citation analysis as a tool in journal evaluation. Science. 1972;(178):471–479
- Glassman NR, Sorensen K. Citation management. J Elec Res Med Libr. 2012;9(3):223–231.
- Jacso P. The h-index, h-core citation rate and the bibliometric profile of the Scopus database. Online Information Review. 2011;35(3):492–501.
- Jacso P. Grim tales about the impact factor and the h-index in the Web of Science and the Journal Citation Reports databases: reflections on Vanclay's criticism. Scientometrics. 2012;92(2):325–354.
- Lawrence S. Online or invisible. Nature. 2001;411(6837):521.
- Lapinski S, Piwowar H, Priem J. Riding the crest of the altmetrics wave: how librarians can help prepare faculty for the next generation of research impact metrics. Coll Res Libr News . 2013;74(6):292-300.
- Leydesdorff L, Opthof T. Citation analysis using the Medline database at the Web of Knowledge: searching "times cited" with Medical Subject Headings (MeSH). arXiv.org.
- Li X, Thelwall M, Giustini D. Validating online reference managers for scholarly impact measurement. Scientometrics. 2011;91(2):461–471.
- Pickard KT. Impact of open access and social media on scientific research. J Participat Med. 2012 Jul 18;4:e15.
- Priem J, Hemminger B. Scientometrics 2.0: New metrics of scholarly impact on the social web. First Monday. 2010;15(7).
- Rad AE, Brinjikji W, Cloft HJ, Kallmes DF. The h-index in academic radiology. Acad Radiol. 2010 May 14.
- Radicchi F, Fortunato S, Castellano C. Universality of citation distributions: toward an objective measure of scientific impact. Proc Natl Acad Sci USA. 2008;105(45):17268–72.
- Spearman CM, Quigley MJ, Quigley MR, Wilberger JE. Survey of the h-index for all of academic neurosurgery: another power-law phenomenon? J Neurosurg. 2010 May 14.
- Van Noorden R. Metrics: a profusion of measures. Nature. 2010;465:864.
- Zhao L. How librarians used e-resources: an analysis of citations in CCQ. Cataloging & Classification Quarterly. 2006;42(1):117–131.