![Mining science from the plant
literature
ContentMine
Open Plant Forum, Norwich,
UK, 2016-07-27
Peter Murray-Rust
[1]University of Cambridge [2]TheContentMine
10,000 scholarly publications every day.
How many relate to plants?](https://image.slidesharecdn.com/rothamsted2016-160913093511/85/Mining-facts-from-the-plant-science-iterature-1-320.jpg)
Recomendados
Recomendados
Más contenido relacionado
La actualidad más candente
La actualidad más candente (20)
Destacado
Destacado (11)
Similar a Mining facts from the plant science iterature
Similar a Mining facts from the plant science iterature (20)
Más de petermurrayrust
Más de petermurrayrust (20)
Último
Último (20)
Mining facts from the plant science iterature
- 1. Mining science from the plant literature ContentMine Open Plant Forum, Norwich, UK, 2016-07-27 Peter Murray-Rust [1]University of Cambridge [2]TheContentMine 10,000 scholarly publications every day. How many relate to plants?
- 2. (2x digital music industry!) Non-profit Downloading several thousand papers per day and making search results open for everyone http://contentmine.org Downloadable Open source
- 3. MozFest 2015 ContentMine + TGAC / hack
- 4. Terpinome Phytochemists! Salvia officinalis Salvia microphylla Origanum vulgare Ocimum basilicum Laurus nobilis [1] [1] Lauraceae
- 5. We can search for • Plants • Compounds • Other species • Diseases • Frequent terms • We’ll need: sources, dictionaries, software
- 6. Europe PubMedCentral Over 1 million biomedical papers
- 11. catalogue getpapers query Daily Crawl EuPMC, arXiv CORE , HAL, (UNIV repos) PDF HTML DOC ePUB TeX XML PNG EPS CSV XLSURLs DOIs quickscrape norma Normalizer Structurer Semantic Tagger Text Data Figures ami search Lookup CONTENT MINING Chem Phylo Trials Crystal Plants COMMUNITY plugins Visualization and Analysis PloSONE, BMC, peerJ… Nature, IEEE, Elsevier… Publisher Sites scrapers queries taggers abstract methods references Captioned Figures Fig. 1 HTML tables 100, 000 pages/day Semantic ScholarlyHTML (W3C community group) Facts Latest 20150908 CONTENTMINE SOFTWARE Crossref
- 12. What plants produce Carvone? https://en.wikipedia.org/wiki/Carvone https://en.wikipedia.org/wiki/Carvone
- 14. Carvone in Wikidata Also SPARQL endpoint WP identifier Chemical type Chemical identifier
- 15. ARTICLES FACETS gene disease drug Phyto chem species genus words
- 16. Suggest the title of this article
- 25. (2x digital music industry!) Non-profit Downloading several thousand papers per day and making search results open for everyone http://contentmine.org Downloadable Open source
- 26. end
- 27. Mining for phytochemicals • getpapers –q carvone –o carvone –x –k 100 Search “carvone”, output to carvone/, fmt XML, limit 100 hits • cmine carvone Normalize papers; search locally for species, sequences, diseases, drugs Results in dataTables.html and results/…/results.xml (includes W3C annotation) • python cmhypy.py carvone/ -u petermr <key> send annotations -> hypothes.is
- 28. Annotation (entity in context) prefix surface label location suffix
- 31. Mining for phytochemicals • getpapers –q carvone –o carvone –x –k 100 Search “carvone”, output to carvone/, fmt XML, limit 100 hits • cmine carvone Normalize papers; search locally for species, sequences, diseases, drugs Results in dataTables.html and results/…/results.xml (includes W3C annotation) • python cmhypy.py carvone/ -u petermr <key> send IUCN redlist plant annotations -> hypothes.is
- 32. Annotation (entity in context) prefix surface label location suffix
- 33. of plant-microbe interactions. Richard Smith-Unna, PhD student, Plant Sci Cambridge. Peter Murray-Rust, a (retired but highly active) chemist in Cam University. Report of 2-day workshop (hack) held at TGAC 2016-03-10/11 The workshop centered on novel methods for discovering information ab from the existing literature (“Content Mining”). We prepared ContentMin specifically for the workshop on the basis that “anyone can run it and get “. Everyone was asked to install the software on whatever platform they c used (Mac, Windows, Unix). There were few problems and most people w within an hour. A typical example was “find all you can about diseases of o EuropePubMedCentral (with over 1 million Open Access papers). This retr 500 papers, which were further filtered for chemicals, diseases, species, e displayed within a minute or two, significantly increasing the speed of kno driven scientific discovery. We also jointly made considerable improveme software and have agreed to meet regularly to take this forward.