Are you interested in contributing to HLWIKI International – hlwiki.ca? contact:
dean.giustini@ubc.ca
To browse other articles on a range of HSL topics, see the A-Z index.
Last Update
18 May 2013
Introduction
See also Altmetrics | Author impact metrics | Bibliometrics | Impact factors | ImpactStory | Scopus vs. Web of Science | Webometrics
- "...citation analysis is a bibliometric tool that is becoming increasingly popular to evaluate the performance of different actors in the academic and scientific arena, ranging from individual scholars (1–3), to journals, departments, universities (4), and national institutions (5), up to whole countries (6). The outcome of such analysis often plays a crucial role in deciding which grants are awarded, how applicants for a position are ranked, and even the fate of scientific institutions. It is then crucial that citation analysis is carried out in the most precise and unbiased way...." — Radicchi, 2008
Citation analysis (also called citation indexing) is a bibliographic tracking activity commonly performed in the academic and scholarly communities. Citation analysis was originally described by Eugene Garfield and his company, the Institute for Scientific Information (ISI), subsequently created the Citation Indexes in 1961 (now Web of Science). Due to changes in scholarly publishing and open access, newer citation tracking methods (including combining various methods) have emerged. Google's PageRank, for example, is based on similar citation analysis principles, where links leading to the same article provide a higher pagerank in Google. It is possible to do rudimentary citation analysis using Google scholar. More recent methods have been performed using Google scholar and social media such as Mendeley and Zotero, however those methods have come under sharp criticism by various academics such as Peter Jacso.
- a model for assessment of research impact
Background to citation analysis
For promotion and tenure, faculty are expected to track articles that cite their work whether they are papers, books or book chapters. Bibliometrics, or cited reference searching, is a way to analyze the scholarly output of authors within specified disciplines. This tracking is a quantitative method of determining impact, and a kind of ego-surfing. While Google scholar provides free access to some of this data via its cited by feature, generally this type of data-mining requires a structured database with cited reference search features. Finding occurences of authors and articles in footnotes and bibliographies of publications in print and digital formats is the main purpose of these tools. One of the best sources for this type of searching is Scientific Thomson's Web of Science (WoS). As a proprietary tool it requires a subscription to access it. The Web of Science (WoS) is a multidisciplinary database that contains the Science Citation Index, Social Sciences Citation Index and Arts & Humanities Citation Index. Another important proprietary tool for citation analysis is Scopus developed by the European publisher, Elsevier. Scopus provides cited reference searching for a range of scientific, technical, medical and social sciences literature.
References
- Bartneck C, Kokkelmans S. Detecting h-index manipulation through self-citation analysis. Scientometrics. 2011 Apr;87(1):85–98.
- Colaco M, Svider PF, Mauro KM, Eloy JA, Jackson-Rosario I. Is there a relationship between NIH funding and research impact in academic urology? J Urology. 1 March 2013.
- Craig ID, Plume AM, McVeigh ME, Pringle J, Amin M. Do open access articles have greater citation impact? A critical review of the literature. J Informetrics. 2007;1:239–48.
- Cronin B. Bibliometrics and beyond: some thoughts on web-based citation analysis. J Information Science. 2001;27(1):1–7.
- Davis PM, Price JS. eJournal interface can influence usage statistics: implications for libraries, publishers, and project COUNTER. J Am Soc Inf Sci Technol. 2006;57:1243–8.
- Davis PM. For electronic journals, total downloads can predict number of users: a multiple regression analysis. Portal: Libr Acad. 2004;4:379–92.
- Eysenbach G. Citation advantage of open access articles. PLoS Biol. 2006;4:e157.
- Franceschet M. A comparison of bibliometric indicators for computer science scholars and journals on Web of Science and Google scholar. Scientometrics. 2010;(3):243–258.
- Garfield E. Impact factors, and why they won't go away. Nature. 2001;411(6837):522.
- Garfield E. Citation analysis as a tool in journal evaluation. Science. 1972;(178):471–479
- Glassman NR, Sorensen K. Citation management. J Elec Res Med Libr. 2012;9(3):223–231.
- Jacso P. The h-index, h-core citation rate and the bibliometric profile of the Scopus database. Online Information Review. 2011;35(3):492–501.
- Jacso P. Grim tales about the impact factor and the h-index in the Web of Science and the Journal Citation Reports databases: reflections on Vanclay's criticism. Scientometrics. 2012;92(2):325–354.
- Lawrence S. Online or invisible. Nature. 2001;411(6837):521.
- Leydesdorff L, Opthof T. Citation analysis using the Medline database at the Web of Knowledge: searching "times cited" with Medical Subject Headings (MeSH). arXiv.org.
- Li X, Thelwall M, Giustini D. Validating online reference managers for scholarly impact measurement. Scientometrics. 2011;91(2):461–471.
- Pickard KT. Impact of open access and social media on scientific research. J Participat Med. 2012 Jul 18;4:e15.
- Priem J, Hemminger B. Scientometrics 2.0: Toward new metrics of scholarly impact on the social web. First Monday. 2010;15(7).
- Rad AE, Brinjikji W, Cloft HJ, Kallmes DF. The h-index in academic radiology. Acad Radiol. 2010 May 14.
- Radicchi F, Fortunato S, Castellano C. Universality of citation distributions: toward an objective measure of scientific impact. Proc Natl Acad Sci USA. 2008;105(45):17268–72.
- Spearman CM, Quigley MJ, Quigley MR, Wilberger JE. Survey of the h-index for all of academic neurosurgery: another power-law phenomenon? J Neurosurg. 2010 May 14.
- Van Noorden R. Metrics: a profusion of measures. Nature. 2010;465:864.
- Zhao L. How librarians used e-resources: an analysis of citations in CCQ. Cataloging & Classification Quarterly. 2006;42(1):117–131.