Giovanni Ciavarra (ISS Innovative Science Solutions, USA) Neglecting key scientific developments can translate to missed opportunities and increased risks in the legal and business industries. The scientific and medical literature provides a significant source of information for stakeholders in these industries, but the ever-increasing pace and sophistication of emerging science can be daunting to track and review. In our years of experience working closely with regulated product manufacturers and their counsel, we continually encounter teams that struggle to keep up with new science in a systematic and organized fashion. However, when firms integrate systematic literature monitoring in their processes, these firms are up-to-date on the science and rather than playing catch-up, these teams are hard at work analyzing and developing new strategies based on the emerging science. This latter group is exemplary of the advantages offered to those firms and companies closely tracking key scientific developments. Technological developments are making literature monitoring and evaluation more effective and relevant to the intended audience. To enhance our work, we have recently initiated various collaborations to integrate new human-assisted big data and machine learning approaches to the identification and review of the literature. In this presentation, we will present our experiences working closely with attorneys handling complex scientific cases and how we support them in maintaining an awareness of the science, including some of the technologies we are integrating with our existing processes.

1. Technology-Assisted
Literature Monitoring
in the Legal and
Business Industries:
Maximizing
Opportunity and
Minimizing Risk
ICIC - Heidelberg
October 24, 2017

2. What does Innovative Science Solutions Do?
2

3. Overview
- Scientific information awareness is key to business and
litigation success
- New tools can facilitate identification and review of
scientific information
- Integrated solution that can help with better risk and
opportunity identification
3

4. Scientific Information can Inform about Emerging Risks
and Opportunities
4

5. Identify trends and be prepared before they become a
headline
5

6. Well-Established Risks Potential/Emerging Risks
6

7. PubMed Indexed “GD Brain Deposition”
7

8. Proactive Horizon Scanning Requires
Systematic Approach (right tools and
knowing where to look)
✓ Evaluate the science behind the risk
✓ Take action to minimize risk or
maximize opportunity
8
Awareness of Scientific Information is Key

9. 9

10. 10

11. 300.000
400.000
500.000
600.000
700.000
800.000
900.000
1996
1997
1998
1999
2000
2001
2002
2003
2004
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
Explosive Growth of Scientific Literature
11

12. Increasing Number of Relevant Data Streams
Science / Regulatory Consumer Sentiment News / Popular PressCitizen Science
12

13. 1. Target and Identify
2. Alert
3. Archive/Store
4. Compile/Tabulate
5. Analyze
Steps of Effective Scientific Information
Management
13

14. INEFFICIENT
14

15. Technology Assisted Literature Monitoring
and
Rapid Reviews of Bodies of Literature
15

16. “Our machine learning algorithms work in
the background to present the most
relevant papers to each individual user
from our corpus of over 48 million pieces
of scientific content, without needing a
lengthy list of precise keywords.”
16

17. Social listening can provide an early indicator of emerging risk and uncover novel
opportunities
17

18. 18

19. Scientific Literature Analysis
19

20. “Producing [Systematic Reviews] requires researchers to identify the
entirety of the relevant literature and then extract from this the
information to be synthesized; a hugely laborious and expensive
exercise. Moreover, the unprecedented growth of the biomedical
literature has increased the burden on those trying to make sense
of the published evidence base.”
20

21. SWIFT-Review puts the systematic review expert in the driver’s seat by
providing several features that can be used to search, categorize, and
prioritize large (or small) bodies of literature in an interactive manner.
SWIFT-Review utilizes newly developed statistical text mining and
machine learning methods that allow users to uncover over-represented
topics within the literature corpus and to rank order documents for
manual screening.
21

22. Machine Learning for Prospective
Scientific Information Identification
22

23. Why Use “Technology Assistance” for
Prospective Literature Identification?
Manual review is:
✓ Expensive
✓ Error-prone
✓ Resource intensive
Benefits of TAR:
✓ Reduced cost and effort
✓ Improved accuracy
✓ Improved scalability
23

24. Supervised Machine Learning and Continuous
Active Learning
Establish initial set of
documents for review
Seed set
TestTestSMESME
Train Rank Documents
24

25. Unified Platform
- Horizon Scanning Dashboard
- TAR
- Analyses
25
Integrated Horizon Scanning Platform for Risk
and Opportunity Evaluation
Relevant Data Streams
- Scientific Literature
- Social Media
- News
Relevant Audience
- Inside/Outside Legal
- Industry
- Insurance
Proactively Address Identified
Risks and Opportunities

26. • Staying on top of scientific information is critical to business
and litigation success
• New tools are necessary to monitor scientific information
and enhance ability of detecting rare signals
• Integration of new tools can allow for better risk and
opportunity identification
Summary
26

27. 27
Giovanni Ciavarra, Ph.D.
(973) 889-1600 x110
Ciavarra@innovativescience.net
David H. Schwartz, Ph.D.
(973) 889-1600 x104
schwartz@innovativescience.net