Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

27
Il ruolo degli editori: criteri per valutare l’informazione scientifica di qualità

Transcript of Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Page 1: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Il ruolo degli editori: criteri per valutare l’informazione scientifica di qualità

Page 2: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

72,876

Diamo un pò di numeri

Page 3: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

12,750.000

Diamo un pò di numeri

Page 4: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Diamo un pò di numeri

25,500 articoli fraudolenti per anno (Fanelli 2009)

975 predatory journals (Beall 2016)

969 predatory publishers (Beall 2016)

Page 5: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Come gestire questi numeri ?

Rispetto a questi numeri abbiamo due possibili

approcci: “the largest, the broadest, the

biggest..” oppure essere selettivi.

Page 6: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Spigolando qua e là........

Page 7: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

I numeri parlano

WoS-CC Journals (main indexes) January 2016

WoS Journals

SCOPUS

~23,000 January 2016

12,760

22,460 January 2016

N°records (Scopus, WoS-CC) ~61M January 2016

Page 8: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

A parte la filosofia.....

0

20

40

60

80

100

120

0 1000 2000 3000 4000 5000 6000

% o

f d

ata

base

# of journals

Articles Citations

As a result, the core literature of all scientific disciplines involved a group of not

more than 1,000 journals and may even possibly be reduced to as few as 500

journals (1972). A relatively small number of journals account for the bulk of what

is published and what is cited.

“The tail of the literature of one discipline

consists, in large part, of the cores of the

literature of other disciplines.”

-E. Garfield

Page 9: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Il nuoco processo di selezione

Source: Thomson Reuters internal

Page 10: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

I criteri di selezione alla luce di ESCI

Source: Thomson Reuters internal

• Does this journal

target an

international

audience or

specifically a

regional audience?

• Is international

representation

among authors and

board members at

an appropriate

level for such a

journal?

• Total citations

• Recent citation

activity

• Author and

editorial board

members’ citations

in the literature

• Integration of the

journal into the

literature over time

Orange = ESCI selection requirements

• Peer review

• Ethical

publishing

practices

• Meets technical

requirements

(XML / PDF)

• Timeliness of

publication

• International

editorial

conventions

• English-language

bibliographic

information

• Has a scholarly

audience

searched for or

requested this

content?

• How does this

journal compare

with covered

journals of similar

scope?

• Is this subject

already well

covered?

• Will this journal

enrich WoS with

novel content?

Black = SCIE/SSci/AHCI selection

Page 11: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

“Imitation is the highest form of flattery”

Page 12: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Acceptance Rate

11% vs 48%

~2000 titoli l’anno

Page 13: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

L’ editorial Team

EDITORIAL TEAM

18 Full Time

Editors

Thomson Reuters

employees

12 main languages covered

with fluency

No one of the editors

publish

No one of the editors

edit a journal

Bi-weekly meetings

No conflict of interest No national boards. Regionalism

covered with a different strategy.

See REGIONAL INDEXES

Around 150 years of

experience in the role.

12 Master’s degree.

Full time job

Uniformity of

judgement

Continuous check

during different

process steps.

Monitoring

current content

Source: Thomson Reuters internal

Page 14: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

L’altro editorial Team (CSAB)

12 journals al

mese a testa !

Si riuniscono

due volte l’anno!

Page 15: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

I dati del 2015

Source: Thomson Reuters internal

Page 16: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

43 titoli rimossi

Page 17: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Advances in Cardiology

Not included in Scopus

Advances in Imaging and Electron Physics Included

Advances in the Physics of Particles and Nuclei Not included in Scopus

African Journal of Psychiatry Included

American Journal of Geriatric Pharmacotherapy Not included in Scopus

Analele Stiintifice ale Universitatii Al I Cuza din Iasi-Serie Noua-Matematica included ANNUAL REVIEW OF INFORMATION SCIENCE AND TECHNOLOGY

Not included in Scopus

ART INSTITUTE OF CHICAGO MUSEUM STUDIES Not included in Scopus

Asian Journal of Chemistry included Asian Pacific Journal of Cancer Prevention included BIOFUTUR included Boletim de Ciencias Geodesicas included CFI-CERAMIC FORUM INTERNATIONAL included

COMMENTARY Not included in Scopus

DESCANT included European Integration Online Papers-EIOP included Feuillets de Radiologie included

Forum of Nutrition Not included in Scopus

Frontiers of Radiation Therapy and Oncology Not included in Scopus

ILLINOIS JOURNAL OF MATHEMATICS included

Journal de Radiologie Diagnostique et Interventionnelle

Not included in Scopus

Journal of Applied Research and Technology included

Journal of Clinical and Experimental Cardiology Not included in Scopus

JOURNAL OF CLINICAL ETHICS included JOURNAL OF MEDICAL SPEECH-LANGUAGE PATHOLOGY

Not included in Scopus

JOURNAL OF NEURAL TRANSMISSION-SUPPLEMENT included JOURNAL OF PSYCHOHISTORY included Journal of the Historical Society included JUDICATURE included Korrozios Figyelo included MATERIALS RESEARCH INNOVATIONS included MATHEMATICAL AND COMPUTER MODELLING included Nobel Medicus included Pakistan Journal of Statistics included PHYSICS ESSAYS included Plant Omics included POPULATION BULLETIN included Problems of Atomic Science and Technology included Revista Chilena de Cirugia included Revista Romana de Bioetica included THEATRE RESEARCH IN CANADA-RECHERCHES THEATRALES AU CANADA included Turkderm-Archives of the Turkish Dermatology and Venerology

Not included in Scopus

32 su 43

E in Scopus ?

Page 18: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

L’ultimo rifuto....

Acta Geologica Slovaca Very low citation impact, near-bottom estimated subject category ranking; very low total cities. Very little international

diversity among Editorial Board members Journal aspires to be international according to its scope notes, but there are very

few contributing authors outside the country, or even the university where it’s published.

In actual content, journal is very regional or even localized with little research beyond very circumscribed area

Page 19: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Anche Scopus rimuove i journals !

Titles indicated in bold red do not meet the

Scopus quality criteria anymore and therefore

Scopus discontinued the forward capturing

Coverage

Diversity and Equality in Health and Care 2012-2015

(cancelled)

English Language Teaching 2012-2015

(cancelled)

International Education Studies 2012-2015

(cancelled)

Journal of Language Teaching and Research 2014 (cancelled)

Journal of Sustainable Development 2014-2015

(cancelled)

Journal of Veterinary Science and Technology 2012-2014

(cancelled)

Middle East Journal of Scientific Research 2012-2014

(cancelled)

Ben 7 titoli !

Page 20: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

African Journal of Traditional Complementary and Alternative Medicines

International Journal of Electrochemical Science

Journal of Environmental Biology

Journal of Physical Therapy Science

Oncotarget

Romanian Biotechnological Letters

I titoli della lista di Beall in WoS-CC

6

Page 21: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

International Journal of Electrochemical Science

Journal of Environmental Biology

Journal of Physical Therapy Science

Oncotarget Romanian Biotechnological Letters

Actual Problems of Economics

Aging

Asian Journal of Chemistry

Asian Journal of Pharmaceutical Research and

Health Care

Asian Pacific Journal of Tropical Disease

Biosciences Biotechnology Research Asia

Der Pharma Chemica

European Journal of Science and Theology

Genes and Cancer

Interdisciplinary Toxicology

International Journal of Applied Research in Natural

Products

International Journal of Biomedical Science

International Journal of Communication Networks and

Information Security

International Journal of Current Pharmaceutical

Review and Research

International Journal of Engineering and Technology

International Journal of Pharma and Bio Sciences

International Journal of Pharmaceutical and Clinical

Research

International Journal of Pharmaceutical and

Phytopharmacological Research

International Journal of Pharmacognosy and

Phytochemical Research

International Journal of Pharmacy and Pharmaceutical

Sciences

International Journal of Pharmacy and Technology

International Journal of Research in Ayurveda and

Pharmacy

Journal of Chemical and Pharmaceutical Sciences

Journal of Electrical Engineering

Journal of Environmental Hydrology

Journal of Language and Literature

Journal of Natural Products

Journal of Pharmacy Research

Journal of Theoretical and Applied Information Technology

Mathematical and Computational Applications

Pharmacologyonline

Research Journal of Pharmaceutical, Biological and

Chemical Sciences

Shiraz E Medical Journal

Sport Science

I titoli della lista di Beall in SCOPUS

39

Page 22: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

E in termini di valutazione ?

614 titoli italiani su WoS-CC

345 nel solo 2015

1,320* su Scopus “selezionabili” per la VQR

*203 su WOS-CC

Page 23: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Un’occhio alle citazioni (metrics misbehaviour)

Page 24: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Un’occhio alle citazioni (metrics misbehaviour)

Page 25: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Amfiteatru Economic 73% 37%

Anatomical Sciences Education 59% 28%

Applied Intelligence 70% 46%

Arabian Journal for Science and Engineering 65% 33%

Archives of Mining Sciences 69% 32%

Bulletin of Indonesian Economic Studies 77% 54%

Business Lawyer 74% 35%

CytoJournal 64% 48%

Electric Power Components and Systems 74% 46%

Emerging Markets Finance and Trade 75% 37%

Forensic Toxicology 54% 37%

Geotextiles and Geomembranes 54% 29%

International Journal of Communication Systems 61% 35%

International Journal of Electrical Power & Energy Systems 54% 29%

Journal Self-Citation: 29 (2015) 1/2

Page 26: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

International Journal of Machine Learning and Cybernetics 54% 32%

International Journal of Sustainable Development and World Ecology 61% 32%

Interlending & Document Supply 73% 35%

Journal of Plant Interactions 59% 31%

Journal of Real Estate Research 73% 51%

Language Culture and Curriculum 78% 46%

Microsurgery 56% 31%

North American Journal of Economics and Finance 72% 48%

Organization & Environment 68% 38%

Polymer Plastics Technology and Engineering 56% 31%

Soils and Foundations 58% 29%

Standards in Genomic Sciences 60% 50%

Transactions on Emerging Telecommunications Technologies 59% 30%

Turkish Journal of Botany 57% 29%

Videosurgery and Other Miniinvasive Techniques 79% 49%

Journal Self-Citation: 29 (2015) 2/2

Page 27: Il ruolo degli editori: criteri per valutare l'informazione scientifica di qualità

Stacking: 10 (2015)

JPC-Journal of Planar

Chromatography-

Modern TLC

Central European

Journal of Chemistry 42% 84%

Enterprise Information

Systems

IEEE Transactions on

Industrial Informatics 43% 82%

Pakistan Veterinary

Journal

International Journal of

Agriculture and Biology 19% 90%

Human Factors and

Ergonomics in

Manufacturing &

Service Industries

Journal of Vibration

and Control 49% 90%

Enterprise Information

Systems

Systems Research and

Behavioral Science 16% 89%

Information Technology

& Management

IEEE Transactions on

Industrial Informatics 19% 94%

Digital Pheromone Based Patrolling Algorithm in Wireless Sensor and Actuator Networks