This document provides an overview of information retrieval and management techniques for PhD students. It discusses search techniques like keyword mapping to develop comprehensive search strategies. It also covers topics like choosing appropriate databases, identifying core journals, and managing references. The overall goal is to help PhD students work systematically to uncover relevant literature and stay organized throughout their research process.
1. Information Retrieval &
Information Management
Gina Bay, Iben Brøndum,
Solveig Sandal Johnsen
1 AU Library, BSS
2. Purpose
Enhance the efficiency of your search
process during your PhD project
Methods & tools for:
Working systematically
Making informed choices
Gina Bay, Iben Brøndum,
Solveig Sandal Johnsen,
AU Library, BSS
2
3. At the end of the day, you will…
Have a toolkit for developing
a comprehensive search strategy
(and be acquainted with several search techniques)
Be aware of different ways of organising your
literature, information and notes
(and have an idea of how you can benefit from a
reference management tool)
Think of information retrieval & management
as one of many methodological choices
Gina Bay, Iben Brøndum,
Solveig Sandal Johnsen,
AU Library, BSS
3
4. Agenda
Search techniques – an overview
Stages in a systematic literature review
Conventional subject searching
Building search strategies (keyword mapping)
Reference lists & Citations
Choosing the right databases
Identifying core journals
Managing Information
Your own personal to do list Workshop
Gina Bay, Iben Brøndum,
Solveig Sandal Johnsen,
AU Library, BSS
4
6. Hermeneutic approach*
Searching for literature and developing a
literature review is an integrated part of
an ongoing process of developing
understanding and knowledge about
a research area.
Gina Bay, Iben Brøndum
AU Library, BSS
6
*Boell & Cecez-Kecmanovic, 2014
7. Initial exploratory stage
Texts dealing with concepts,
definitions and ideas that you
need to explore
eg. use encyclopedias as a supplement to
explore relationships between different concepts,
definitions and theories
“Quick & dirty”, internet searching, literature
reviews etc.
Gina Bay, Iben Brøndum
AU Library, BSS
7
*Boell & Cecez-Kecmanovic, 2014
8. Focused stage
Working systematically to uncover the
literature in your research area
Conventional subject searching, citation
searching, reference lists, checking core journals,
maybe identifying new core journalls
Consulting your network, social media etc.
Gina Bay, Iben Brøndum
AU Library, BSS
8
*Boell & Cecez-Kecmanovic, 2014
9. Conventional subject searching
- searching databases using keywords / subject terms
Build a search strategy that describes:
”…the databases used, the reasons
for their use and the … words used in
the keyword searches.” (White, 2011)
Keyword map
Gina Bay, Iben Brøndum
AU Library, BSS
9
10. Building a search strategy – keywords
Identify the main keywords for your research area
Brainstorm:
Think of related terms, synonyms, acronyms, antonyms,
narrower terms, broader terms etc.
”Keyword mapping”
organise your keywords
into the different aspects
of your project
Combine keywords in
Boolean searching
using truncation
Gina Bay, Iben Brøndum
AU Library, BSS
10
11. Keyword mapping - example
How do we choose our partner?
Gina Bay, Iben Brøndum
AU Library, BSS
11
13. Why do this?
To improve your search vocabulary
to minimise the risk of missing important material
”terms within social sciences is often ambiguous
and changes constantly” (Papaioannou et al. 2009)
To keep track of different keywords for different
aspects of you project
you may need different types of texts in different
stages of you project.
you might have to use different databases for
different aspects & texts Gina Bay, Iben Brøndum
AU Library, BSS
13
14. Do your own keyword map:
– group keywords in themes
Identify the main keywords for your thesis
Brainstorm on the different aspects of your project:
Synonyms / Antonyms
Acronyms
Broader terms
Narrower terms
Related terms etc.
Organise your keywords into groups
Gina Bay, Iben Brøndum
AU Library, BSS
14
17. Search strategy - choosing databases
Build a search strategy that describes:
”…the databases used, the reasons for
their use and the … words used in the
keyword searches.”
(White, 2011)
Gina Bay, Iben Brøndum
AU Library, BSS
17
18. Choosing relevant sources to search
Coverage:
Eg subject, years, geography, languages
Types of publications: books, journals,
academic / public
Specific databases or vendors
Ebscohost (Business Source Complete,
Communication & Mass Media Complete,
Academic Search Elite)
Proquest (ABI/Inform, Econlit, Psycinfo, Eric,
Sociological abstracts)
Scopus / Web of Science Gina Bay, Iben Brøndum
AU Library, BSS
18
19. Create profiles in the databases:
Gina Bay, Iben Brøndum
AU Library, BSS
19
20. Summing up
Stages of information searching for a systematic
literature review
Identify:
Authors/Journals/”Schools of
thought”/Sources (databases,
conferences, publishers,
institutions)/Keywords/Search
vocabulary
Supplement with:
•Internet Searching
•Browsing
•Reference/Citation Searching
•Asking Colleagues/other
researchers
Gina Bay, Iben Brøndum
AU Library, BSS
Exploratory searching
•Background information
•Browsing
•Reference lists/citation searching
•Quick’n’Dirty querying
•Internet searching
Subject searching:
•Group keywords (synonyms, acronyms, antonyms)
•Choose relevant sources to search systematically
•Combine facets in Boolean searching – combine different facets
ASSESS RESULTS – ADJUST SEARCH - REITERATE
Organising literature in e.g. EndNote, RefWorks or other reference
management software
Put up Alerts, to be notified on new articles
Project
Moulding
Stage
Literature
Collection
Stage
Literature
Management
Stage
UseMULTIPLE sources
When reading and analyzing pay attention to:
Authors/Journals/”Schools of thought”/Sources
(databases, conferences, publishers,
institutions)/Keywords/Search vocabulary
20
21. Searching without keywords
Reference lists
Citation searching
Gina Bay, Iben Brøndum
AU Library, BSS
21
22. Citation indexes
= databases that index reference lists and link to the
cited articles
Built on the presumption that there is a degree of
subject relation between source articles and cited
articles.
Reference searching
Find articles that cite the same articles
Co-citations find literature both forwards and backwards in time
Find cited articles
Checking reference lists can only find information backwards in time
Citation searching
Find articles that have cited a certain article
Citations to articles will find more recent literature
Gina Bay, Iben Brøndum
AU Library, BSS
22
24. When are the methods best
utilized?
At the beginning of any search for…
Getting started on a subject
Inspiration for alternative search terms
Identification of principal authors within a given
subject field
Continually for…
Finding articles from alternative subject areas
Finding articles that complements your source
material
Keeping up to date
Gina Bay, Iben Brøndum
AU Library, BSS
24
25. One must presume that…
“[…] bibliographies are lists of influences and that authors
cite in order to give credit where credit is due; that is, when
an author uses information from another’s work, he will cite
that work [...].
The reason that scientists cite this way is that the norms of
science require them to cite the work that they have found
useful in pursuing their own research, and it is assumed that
they abide by these norms... “
[MacRoberts & MacRoberts, 1989, p. 342]
Gina Bay, Iben Brøndum
AU Library, BSS
25
26. But…
… there are limitations
Gina Bay, Iben Brøndum
AU Library, BSS
26
[MacRoberts & MacRoberts, 1989, p. 343]
Multiple functions:
- Negative critique
- Positive critique
- Persuasion
- Documentation
- Recommendation
27. The purpose of the reference
is not evident from the citation
Gina Bay, Iben Brøndum
AU Library, BSS
27
32. Database coverage
Journal and subject coverage will vary across
databases
Overlapping information
Exclusive information
To cover a specific journal cover-to-cover
check coverage in the selected database or
use UlrichsWeb
For broad coverage of a subject search
several sources
Gina Bay, Iben Brøndum
AU Library, BSS
32
33. UlrichsWeb
Directory of over 300.000 serials worldwide
900 subject areas
Research, browse, compare journals
Check for open access, peer review and
indexing/accessibility in databases
Gina Bay, Iben Brøndum
AU Library, BSS
33
34. Try Ulrichsweb
Look up a journal in Ulrichsweb
Check the coverage in your favorite
database – any surprizes?
Are there databases in the list, you ought to
take a look at?
No favorite journal yet?
Browse the subject categories in Ulrichsweb
and try to locate an interesting journal.
Gina Bay, Iben Brøndum
AU Library, BSS
34
35. Identify and assess (core) journals
Journal Impact Factor (JIF)
Danish Bibliometric Research Indicator
Subject specific journal rankings
UlrichsWeb – Global Serials Directory
Sorting by source title in Web of Science
or Scopus
Gina Bay, Iben Brøndum
AU Library, BSS
35
37. Journal Impact Factor
Citable items = articles, reviews, notes
Citations to = articles, reviews, notes, editorials,
comments, book reviews, letters, news
Differences in referencing practices across research fields
makes it difficult to compare across different subejct
categories
Find Journal Impact Factors in Journal Citation Reports
Gina Bay, Iben Brøndum
AU Library, BSS
37
# Citations in 2011
# Citable items 2009-2010
= 2011 Journal Impact Factor
38. Danish Bibliometric Resarch Indicator
Part of university funding is based on performance – i.e. number of
publications in preferred outlets
Two lists of preferred outlets – journals/serials and publishers
Journals/serials can only be part of the list if they have some form of
peer review during the publication process
Lists are weighed in two levels – With Level 2 giving the highest
number of points
1(normal level) and 2 (highest level outlets).
67 groups of researchers maintaining the lists (qualitative
assessments)
Divided in 67 subject areas
Find the list of serials (journals) and publishers at the Danish Agency
for Science Technology and Innovation (only in Danish)
Gina Bay, Iben Brøndum
AU Library, BSS
38
39. Subject specific journal rankings
Geographic and academic diversity
Different functionalities
Local vs. general acceptance
Different groupings – Different lenghts
Better equiped to embrace specific research areas
Both qualitative assessments and quantitative calculations
– or a combination
Methods applied: quantitative – e.g. citation or journal impact factor scores,
qualitative – e.g. surveys
Find a list comparing 22 rankings within business and social
sciences at Professor Anne-Will Harzings homepage
Gina Bay, Iben Brøndum
AU Library, BSS
39
40. Sorting by souce title in Web of
Science or Scopus
Gina Bay, Iben Brøndum
AU Library, BSS
40
43. Start your personal to-do-list
- and take a few minutes to reflect on your outcome
What I need to do know
Brainstorm for …
Get time to…
Check citations for …
Check out the database…
Ask the librarian…
…
…
…
Gina Bay, Iben Brøndum
AU Library, BSS
43
44. Read more
References
Literature
Michael H. MacRoberts & Barbara R. MacRoberts. (1988).
Author motivation for not citing influences: A methodological
note. In: Journal of the American Society for Information
Science, Vol. 39, Iss. 6, pp. 432-433.
http://ez.statsbiblioteket.dk:2048/login?url=http://dx.doi.org/1
0.1002/(SICI)1097-4571(198811)39:6<432::AID-ASI8>3.0.CO;2-2
Ismael Rafols et al (2012)
How journal rankings can suppress interdisciplinary research: A
comparison between Innovation Studies and Business &
Management. In: Research Policy, Vol. 41, Iss. 7, pp. 1262-1282
http://ez.statsbiblioteket.dk:2048/login?url=http://www.scienc
edirect.com/science/article/pii/S0048733312000765
Gina Bay, Iben Brøndum
AU Library, BSS
44
45. Read more
Journal information
Information about the Danish Bibliometric Indicator at the
homepage of the Danish Agency for Science Technology
and Innovation: http://www.fi.dk/viden-og-politik/tal-og-analyser/
den-bibliometriske-forskningsindikator
Journal Impact Factors from Journal Citation Reports:
http://ez.statsbiblioteket.dk:2048/login?url=http://webofknowl
edge.com/jcr
Professor Anne-Will Harzings homepage:
http://www.harzing.com/jql.htm
Ulrichsweb:
http://ez.statsbiblioteket.dk:2048/login?url=https://ulrichsweb.s
erialssolutions.com/
Gina Bay, Iben Brøndum
AU Library, BSS
45
46. Read more
Tutorials
http://www.phdontrack.net
http://en.startpublicering.nu
Gina Bay, Iben Brøndum
AU Library, BSS
46
47. Read more
Literature reviews:
Boell, Sebastian K.; Cecez-Kecmanovic, Dubravka (2014). A
Hermeneutic Approach for Conducting Literature Reviews
and Literature Searches. Communications of the
Association for Information Systems, Vol. 34, pp. 257-286
Hart, C. (1998). Doing a literature review: releasing the
social science research imagination
Jesson, J.K. (2011). Doing your literature review: traditional
and systematic techniques
Littell, J.H. (2008). Systematic reviews and meta-analysis
White, B (2011) Mapping Your Thesis: The Comprehensive
Manual of Theory and Techniques for Masters' and Doctoral
Research
Gina Bay, Iben Brøndum
AU Library, BSS
47
48. Read more
Article databases
Proquest – Social Sciences
http://ez.statsbiblioteket.dk:2048/login?url=http://search.proq
uest.com.ez.statsbiblioteket.dk:2048/?accountid=14468
In Proquest you might find it useful to search simultaneously
across several databases in Business and Social Sciences. You
can choose this from the subject areas icons or from the
database list.
Scopus
http://ez.statsbiblioteket.dk:2048/login?url=http://www.scopus
.com/scopus/
Scopus is the largest abstract and citation database, covering
15,000 peer-reviewed journals from more than 4,000
international publishers, including coverage of over 1,000
Open Access journals, 500 Conference Proceedings and over
125 Book Series adding to 33 million records.
Gina Bay, Iben Brøndum
AU Library, BSS
48
Notas del editor
LAV OM FORMÅL + AT THE END OF THE DAY SLÅS SAMMEN??
Appetizers to go home and work indepth
In this first part before lunch we are going to focus on methods and tools – and not so much practical searches and so on …For that we have made the workshop this afternoonDuring this mornings lecture – maybe have a think about what you want to focus on in the workshop
Pind 5: given todays knowledge explosion - it is all about making informed choices (Holbrook, 2007, s.4)Do you have any questions or comments – so far …
Even though you are not doing a literature review its a good idea to make a precise documentation of your search process / search strategy – as it is useful in you general considerations reg. methodological choicesAt the end of the day we would like you to make your own personal to do list
In the article that we sent to you it is stated you need to use a lot of different search techniques to
To do a comprehensive search in the social sciences s.121
It is not enough just using one search techniqueBut at the same time you’ll have to keep track of what you are doing – and make the process manageable. And today we are going to focus on these four search techniques:Where you can actually work systematically ad keep track of the processThats: 1. Conv. SS 2.Citation searches 3. checking reference lists 4. identify and assess core journals .This is what could be called “formal” IR – where you work systematically– whereas the others could be said to be more informal – and maybe some of these are coming to you more or less intuitively … building on your own network and knowledge about the field.
Se Littell s.56 Bl.a. Hand searching ~ browsing / core journalss.57-58 sources of gray literature (government, working papers, conference proceedings, organisations etc. - not controlled by commercial publishers)
My own approach to IR and doing a syst. LR resembles a hermeneutic approach.[inspired by the article here by Boell]
That IR and developing your LR is an integrated part of an ongoing process of developing understanding and knowledge about your research area
And in this view, you cannot decide do you LR in day 3&4 in week 2 and then you are done.It could be useful to divide your IR into smaller parts targeted to the different aspects and stages of your research project. To follow your own development of understanding of the topic.
I am aware that some of you are prob. thinking differently about this, and some of you prob. have to work with a well defined body of literature from the beginning.But this just so you know my way of thinking about IR, so that you can adjust this to your own …
One example of this approach is that you might need different types of text & information during different stages of your process.Eg in the initial exploratory stage you might need texts dealing with concepts definitions …
and here maybe you can benefit from checking out encylopedias as a splment to explore relations between concepts …And maybe discover new researchers you werent aware of …. One of the standard works is IESBS … example?
In a more focused stage you will need to start collecting literature in a systematic wayAnd here the methods for working systematically would be the more formal search techniques like
Does this make sense at all – or …?
Ok so then lets move to concentrate at the first of the formal search techniques:
Conventional subject searching is a search technique that - opposite checking reference lists and citationsis taking the starting point: that I dont necessarilly know any literature about this topic – but I am going to try to uncover the literature in a research area
Using the keywods that I consider to be covering the topic.And to do a comprehensive CSS it is useful to consider how you will build your search strategy.
Online program called popplet – easy to use …
Here is an example of a master thesis – where the initial rq was something like this … I don’t remember the exact title … - the first thing is to think of related terms and different kinds of spelling – like this – and then I started searching some Q&D searches for this
Next thing I did some brainstorming of different aspects of choosing a partner– there is probably a lot more …!the thing to think about in regard to performing searches is – that the words inside your groups
Here I ‘ve got my two main search terms – in all other forms of the word and synonyms etc.
But around those main search terms I have a lot of other facets – or aspects of this subject … which could be relevant for the project
– and then I got inspired along the way from searching databases – and found those related terms – from subject terms in the databases and so on … which might be relevant for me … – there are all of those possible aspects of this … and of course this is in the exploratory stage – from here I would have to choose which aspects I will focus on … and search those more focused in the databases
And why is it a good idea to do this??
Papaio …. S. 116:terms within social sciences is often ambiguous & changes constantly
And why is it a good idea to do this??pind 2: maybe you have to use a different search term in Scopus – if you are used to search Ebscohost or Proquest – because the database coverage is different …Dittes Example: the importance of synonymes – pitfalls across research fields:
Now try for yourselves – if you have already started this – maybe it can be refined empty popplet for those who want to write …Opsamling
Hvis nogen allerede har lavet mindmap: ”man er aldrig færdig”; [quote DSS]
OPSAMLING vis søgehistorie og fortæl om overvejelser
Next thing I did some brainstorming of different aspects of choosing a partner– there is probably a lot more …!the thing to think about in regard to performing searches is – that the words inside your groups
Here I ‘ve got my two main search terms – in all other forms of the word and synonyms etc.
But around those main search terms I have a lot of other facets – or aspects of this subject … which could be relevant for the project
– and then I got inspired along the way from searching databases – and found those related terms – from subject terms in the databases and so on … which might be relevant for me … – there are all of those possible aspects of this … and of course this is in the exploratory stage – from here I would have to choose which aspects I will focus on … and search those more focused in the databases
And why is it a good idea to do this??
Opsamling: Is it difficult – did this method work for you?The next step is to choose which databases to search – again a matter of choices think about database coverage, types of publications – and could you benefit from using a vendor – searching across several databases at the same time disadvantage – not to be able to use thesauri – but check them out before!
Creating a profile – you can modify searches, create alerts etc.
Keep track of your searches
You can combine your searches in the Search History divide your searches into parts / clusters
So again just a few words on this – do it step by step – to be able to adjust …
Sorting / filtering results from your exclusion / inclusion criteria.But be careful not to have too strict criterias (not in the initial phase anyway) that make you ignore studies that could be interesting.“… sometimes we encounter studies that raise issues not yet considered.” Littell et al. s.61
A reference B, C and D
A have references in common with both Y and Z
A is cited by E F
You will need to agree with this in order to use this technique
Example: ”I’ll limit my search results – and just include the articles cited more than 20 times” (problems: defining the value of a citation; publications years; what about books?; what about applications outside journal literature/database coverage; sleeping beauties)
Example: Penkowa - Lomborg
Remember: coverage (how much of the literature is elegible to provide citations), time (it takes time for an article to be published – new articles cannot have a lot of citations), types of publications (books and conference proceedings are not that well covered in the databases – and cannot give or get measurable citations)
You can refine in the left side – subject areas – you can search within and so on – but one special feature in Scopus is the citation part …. The 559 are clickable over to Ditte …
Example: ”Topic of research – missings links between/or parallel research across ”regional science” and ”entrepreneurship”. All the relevant journals are indexed in Scopus! Some researching confirmed that the journals where indeed covered – but very scattered with several years omitted in the relevant period of time. We ended up having to search across seven different database in order to cover 20 journals in a 30-year timespan.”
Reason for the overlapping information: database licenses – the library purchases large information collections from different vendors. The collections often have a very broad subject specific profile (e.g. ”communication” or ”economics and mangement” or ”psychology”). The vendors have contracts with the publishers about indexing their journals in different products. Many publishers have contracts with many vendors the library often purchases the same journal several times (but with different coverage depending on the product).
Core journal – basket of eight – key journals – a-journals – relevant journals – subject specific journals
xample: ”I want to find everything about this topic! – at some point in time, you have to stop searching. But preferably you have searched systematically and consciously.”
“the law of diminishing returns”