In 2018, the SciELO Program will celebrate 20 years of operation, in full alignment with the advances of open science.
The SciELO 20 Years Conference will address and debate – during its three-day program – the main political, methodological and technological issues that define today’s state of the art in scholarly communication and the trends and innovations that is shaping the future of the universal openness of scholarly publishing and its relationship with today’s Open Access journals, in particular those of the SciELO Network.
The program of the conference is organized around the alignment of SciELO journals and operations with the best practices on communication of open science, such as publishing research data, expediting editorial processes and communication through the continuous publication of articles and the adoption of preprints, maximizing the transparency of research evaluation and the flow of scholarly communication, and searching for more comprehensive systems for assessing research, articles and journals.
A two-day meeting of the coordinators of the national collections of the SciELO Network will take place prior to the Conference with focus on the evaluation of SciELO journals and the SciELO Program and their improvement following the lines of action that will guide their development in the forthcoming five years.
The celebration of SciELO’s 20-year anniversary constitutes an important landmark in SciELO’s evolution, and an exceptional moment to promote the advancement of an inclusive, global approach to scholarly communication and to the open access movement while respecting the diversities of thematic and geographic areas, as well as of languages of scientific research.
2. Agenda
● Definitions
○ Are we on the same page?
● The power of interoperability
● Visibility and the indexing of all titles
● Credibility of metrics
● The end
3. Definitions
● Interoperability
○ The ability of computer systems or software to exchange and
make use of information
○ A capacidade de sistemas de computador ou software para
trocar e fazer uso de informações
○ La capacidad de los sistemas informáticos o software para
intercambiar y hacer uso de la información
4. Definitions
● Visibility
○ The state of being able to see or be seen or the degree to which
something has attracted general attention; prominence
○ O estado de ser capaz de ver ou ser visto ou o grau em que algo
atraiu a atenção geral; proeminência
○ El estado de poder ver o ser visto o el grado en que algo ha
atraído la atención general; prominencia
5. Definitions
● Credibility
○ The quality of being trusted and believed in
○ A qualidade de ser confiável e acreditado em
○ La calidad de ser confiable y creer en
7. What is Dimensions? A Networked Research Knowledge System
• Connects data across the different elements of research (for discovery and analysis)
• Built in collaboration with 100+ research organization development partners worldwide
• Basic publications discovery version free for individual researchers
• Full data versions licensed to institutions, publishers, funders and corporate customers
• Features a variety of article-level metrics such as:
○ Altmetrics, total number of of citations, recent citations, FCR, RCR
21. We do not want
to impose
metrics ...
… metrics
should be
developed by
the community
… at the
discipline,
national or
institutional
level.
Example of a
partner metric:
Relative
Citation Ration
(RCR) … please join
the efforts for
more and / or
better metrics!
Dimensions and metrics
First I want to touch quickly on definitions -
Often in the space we are not all speaking the same language.
One of these definition might mean something slightly different to a researcher or publisher or they may mean different things depending on your research area. Math or Religious Studies can have very different view on what it i
I highlight these to note that if we are to achieve the goals the ecosystem is interest in, we need to be sure we are all talking about the same definitions.
I say this as I have frequently seen two people think they are talking about the same thing when in reality they are not. Happens all the time in my marriage ;)
Visibility Definitions
Credibility
As we are looking at these 3 attributes from the lens of Dimensions, First we need to know more about Dimensions as it was just launched in January this year.
Dimensions is a Networked Knowledge Research System. Not only do we collect citation data, we also we also link the citation data to other data points so that we get the “full research story”.
What makes it differnet? The indexing of grants, content, patents etc is based on full text so we can really get a full understanding of the piece of work and thus categorize the objects and get better information to link them to build a full picture.. Additionally Dimensions indexes all articles.
Let’s talk a little bit about interoperability
Our data by definition is interoperable - we have pulled in a huge amount of data from other places in order to connect it and make it more useful
We can also connect this data with other data sets
Powerful API so you can extract data sets and further analyze
Work with other institutional identifiers
Pull in new taxonomies so organizations can analyze their own space
Just a quick snapshot of the linkages here and some numbers on the data.
Quick snapshot of the interface itself.
Landing page for an article
We have started with other Digital Science tools that many organizations already use to start our journey on interoperability.
If you drill down further, you have links to the actual citations, policy, or patent reference.
As example of interoperability beyond our own tools, we are integrated with ORCID.
Built for researchers to discover content - with full text index you can find even more content related to your subject area.
All SciELO content indexed Dimensions - everyone can find SciELO articles in the platform. Due to the full text index, natural language processing etc, we can get more accurate with a subject area. This will mean that SciELO content has a higher chance of being
Also, all content in Dimensions is picking up citation data.
In the interface you can filter further by source title to see what is going on with your exact content. You can also see the linkages if you drill down.
Moving onto Credibility
First I want to say something on Metrics and how we view them. I considered this as we have talked a lot about metrics at this conference. I think this slide says it all
We don’t want to impose metrics
Metrics should be developed by the community
At the discipline, national, or institutional level.
We even have partnered with organizations like the NIH to develop metrics
Credibility can be very subjective - however we have a few things that make us credible.
First I want to touch on the fact that we just signed onto DORA. In case you have not heard of DORA it is an initiative within the community to promote and develop best practice in the assessment of research.
If you have not read the declaration I encourage you to do so. Explain what this means and why it is important.
Additionally we are very transparent about how we are accomplishing this and have put out a guide called the Dimensions Data Approach. It is located on Figshare so please do feel free to look it up.
Dimensions comes out a group of companies that already have good reputations in community. However what really means you have arrive is when those in the community start to use and evaluate your tools to give their perspective.
One of the early adopter of Dimensions was the the University of Zurich. They show citation from several providers as a comparison point. You can see the numbers are similar.
We also have some third party evaluations. Some of these were a complete but positive surprise to us and others were more like interviews and discussions.
We also have some third party evaluations. Some of these were a complete but positive surprise to us and others were more like interviews and discussions.
Earlier - Working Group 4 on the performance of SciELO Journals
Citations - Chat from Dimensions - Relative to what is going on with publications - Citations keep going up while publications are steady
This database is partially free so please do take a look at Dimensions.ai.
Right now you do not even have to register.