As we said last year, we can only welcome that the American company has decided to keep supporting GSM, a free product which is also very different from traditional journal rankings. Competition is healthy, and scientists can only be pleased about this variety of search and ranking tools, especially when they are offered free of charge.
The main differences respect to last year's version is the inclusion of five additional language rankings (Russian, Korean, Polish, Ukrainian & Indonesian) and the removal of two language rankings: Italian, and Dutch. The addition of new language rankings is welcome as they enrich the product. That's why we don't understand why they decided to remove the Italian and Dutch rankings.
Another important change in this new version of Google Scholar Metrics is the removal of many Working Papers and Discussion Papers series. If users search "working papers", "discussion papers", "working paper", or "discussion paper" in GSM's search box, they will only get 7 results in total.
For example, in the previous edition of Scholar Metrics, the CEPR Discussion Papers (h5-index: 112) was ranked #4 in the general category Business, Economics & Management. This series even made it to the top 100 publications in the English ranking (93rd position). Similarly, the IZA Discussion Papers (h5-index: 82) was ranked #8 in the general category Business, Economics & Management. These two series are not to be found in the new edition of Scholar Metrics.
One might think this has been caused by a change in GSM's inclusion policies . They may have decided to remove all working papers and discussion papers, but if that were the case, they shouldn't have included other working paper series, like NBER Working Papers, currently #1 in the general category Business, Economics & Management, and also #1 in the subcategory Economics. They have also maintained all the subcategories available at arXiv. This is clearly inconsistent.
There are three different entries for the Brazilian Journal of Anestesiology.
One of the main source of errors in GSM are the journals published in several languages. Journals published in their original native language and, at the same time, in English, are quite common. GSM has decided ti create separate entries for each of the languages in which a journal is published.
This decision is arguable, but at the very least, it should be applied consistently to all journals. The journal Revista Española de Cardiología, however, received a different treatment: the Spanish and English versions were merged.
In the case of Revista Española de Enfermedades Digestivas and Revista Portuguesa de Neumología, they weren't able to successfully separate the two versions, since both versions present articles in the original languages (Spanish and Portuguese, respectively), and English.
In the case of Giornale italiano di medicina del lavoro ed ergonomia, they only identified the English version, but not the Italian one.
There are also several errores related to the correct linking of documents, which point to references or incorrect full-texts.
In some cases, like the journal Nutrición Hospitalaria, we find dead links, links to the PDFs in Scielo, links to Dialnet, and links to the various repositories where authors have archived their articles. Probably for this reason the title of the journal presents up to three variants.
Lastly, it should be reminded that journals not always present an uniform typographic design in their titles or the titles of the articles.
Having said that, there are fewer errors than in previous years.
- Lastly, reducing the mininimum number of articles published in the last 5 years from 100 to 50 might be a good idea. 20 articles per year is not a difficult goal for journals written in English, especially in areas like natural sciences and health. However, there are many local journals published in non-English-speaking countries, especially in the Arts & Humanities, that just can't reach that amount of articles.
1. Delgado López-Cózar, Emilio & Robinson-García, Nicolás (2012). Repositories in Google Scholar Metrics or what is this document type doing in a place as such? Cybermetrics, 16(1), paper 4. http://digibug.ugr.es/bitstream/10481/22019/1/repositorios_cybermetrics.pdf
7. Martín-Martín, A.; Ayllón, J.M.; Orduña-Malea, E.; Delgado López-Cózar, E. (2015). G2015 Google Scholar Metrics: happy monotony. EC3 Google Scholar Digest, 26 Jun 2015. http://googlescholardigest.blogspot.com.es/2015/06/google-scholar-metrics-2015-happy.html