Team

Fil Menczer
Diep Thi Hoang
Jasleen Kaur
Mohsen JafariAsbagh
Xiaoling Sun
Lino Possamai
Snehal Patil

How It Works
To Learn More

For more details on our approach for system implementation, analysis and plans for future development, please look at the publications.

Features

An interactive platform independent interface

Since Scholarometer is a browser extension that provides a smart interface for Google Scholar, it does not have the limitations of server based citation analysis tools that sit between the user and Google Scholar. At the same time Scholarometer is not an application, such as Publish or Perish, and therefore it is platform independent and runs on every system that supports the Firefox or the Chrome browser. Still, Scholarometer uses Google Scholar, which provides the most comprehensive source of citation data across the sciences and social sciences.
Back to top

Empowers non-experts to submit complex queries and maintains their history

Scholarometer exposes advanced query syntax in a simple way to empower non-experts to submit complex queries such as boolean combinations (and/or/not) of author names and keywords. For example you can search for articles by Jane Smith or JM Smith-White but not JF Smith at Cornell or Stanford. Scholarometer also maintains a history of recent queries to help you remember those complex queries.
Back to top

Allows filtering, sorting, deleting and live search to compute error free impact measures

Scholarometer provides many advanced features that make it easier and less error prone to compute impact measures based on citations. For example, the user can merge multiple versions of the same paper; exclude papers by different authors with the same name, or other noisy data; filter papers by many criteria such as years, disciplines, name variations, and coauthors; and perform live search over the results. The impact measures are dynamically recalculated based on the user's manipulations.
Back to top

Enables users to export individual or bulk bibliographic data

Scholarometer users can save the finding into formats appropriate for local reference management software (e.g., EndNote), or for social publication sharing systems (e.g., BibSonomy). Currently, our system supports the following export formats: BibTex (BIB), RefMan (RIS), EndNote (ENW), comma-separated values (CSV), tab-separated values (XLS), and BibJSON. Export data is dynamically generated in response to any filter, merge or delete actions performed by the user.
Back to top

A social application with tagging functionality

Scholarometer is a social (crowdsourcing) application that leverages the wisdom of the crowds. It requires users to tag their queries with one or more discipline names, choosing from predefined ISI subject categories or arbitrary tags. This generates annotations that go into a database, which collects statistics about the various disciplines, such as average number of citations per paper, average number of papers per authors, etc. This data is publicly available.
Back to top

API, widget, Linked Data and other ways to share data

The Scholarometer API makes it easy to integrate citation-based impact analysis data and annotations into other applications, and/or to gain access to the data collected by Scholarometer. You can get information about authors, disciplines, and even relationships among authors and among disciplines. Another way to share data is by embedding the Scholarometer widget into an author's homepage. Scholarometer is also integrated with Twitter to share information about queried authors. Finally, Scholarometer data is published as Linked Data, which makes information about authors and disciplines available on the Semantic Web.
Back to top

Interactive Visualization

Scholarometer makes visualization of author and discipline networks available on the web site. You can search and navigate the discipline network, in which nodes are connected based on common authors. You can also view the top authors and their impact measures for a discipline, or search and view the network of similar authors. Authors are connected based on common disciplines. These visualizations can help you find potential referees, members of program committees, grant panels, collaborations, and so on.
Back to top

Computes the universal hs index

The tagging of authors with disciplines allows Scholarometer to compute the universal hs impact metric, proposed by Kaur, Radicchi and Menczer (doi:10.1016/j.joi.2013.09.002 or arxiv:1305.6339). The hs index allows to quantitatively compare the impact of authors in different disciplines, with different citation patterns. Scholarometer also computes Hirsch's original h-index (doi:10.1073/pnas.0507655102).
Back to top

Caveats

Careful interpretation of impact measures

While Scholarometer helps authors and academic administrators evaluate the impact of someone's research publications, citation-based impact measures must be carefully interpreted in the context of an author's discipline. Weak impact measures may be explained by factors such as linguistic, geographic, cultural, and disciplinary traditions.
Back to top

Noise, errors, and unreliable data in impact analysis

Another caveat in the use of Scholarometer is that the analysis can only be as good as the data source. Google Scholar provides excellent coverage, in many cases better than ISI Web of Science, for example in disciplines such as computer science, which are dominated by conference proceedings; or the social sciences, which are dominated by books. Nevertheless, Google Scholar is based on automatic crawling, parsing, and indexing algorithms, and therefore its data is subject to noise, errors, and possibly incomplete, outdated, and unreliable citation information. For example, it has been shown that by generating fake papers it is possible to trick Google Scholar into boosting an author's citation counts, and therefore to boost the author's impact measures computer by Scholarometer and similar tools. Therefore one should not blindly assume that Scholarometer data is reliable and one should always check the underlying data before making any decisions on the basis of citation based impact analysis.
Back to top

Limitations of citation based impact measures

Many impact measures have been proposed and criticized for their limitations, and new ones are being introduced all the time. There is a growing literature on citation analysis, bibliometrics, and scientometrics, and if you are going to base important decisions (such as academic tenure & promotion) on impact measures such as those computed by Scholarometer, we recommend that you consult reputable studies on the effectiveness and limitations of such measures. Citation-based impact analysis is supposed to be just one of a number of tools in the academic administrator's toolbox.
Back to top