System Update (2011 CrossRef Workshops)

System Update

Chuck Koscher
ckoscher@crossref.org

CrossRef team working on system re-write

http://www.jokeroo.com/videos/extreme/tire-change-moving-car.html 2

Rewrite status

 2011 was a transitional year for core services
 QS rewrite defined a new software architecture.
Removal of proprietary software & CrossRef full ownership.

Performance improvement but essentially the same service.

 Reconfigured our datacenter (virtual servers, more power, replaced hardware)

 2011 focus on base platform enables future focus on new services,

 QS and DS development/deployment taking a lot longer than predicted
 Variety of end user problems not predicted
 New architectural features are complicated

(Active MQ, BoneCP, Java configuration, local repositories)
 Fixing bugs really impacts making progress
 Too optimistic?

 Other demands (life gets in the way)
3

System status

 Core operations are solid
 Availability
is over 99.9%
 Query throughput is great!
 Deposit trough put is good, challenged by large Elsevier re-deposit

 Some long standing issues continue to await attention
 Emailnotifications to be augmented/replaced by a messaging service
 Deposit visibility, when things go wrong requires too much detective work
 Simple text query API (let members send in textual references)
 Separate DOI registration and metadata ingestion

 Some improvements still happening
 Implemented a secondary query mode
 Modified control of the deposit queue
 Fixed cited-by count values
 Created publisher groups (allow deposit of any prefix to a given title)
4

 Example of a user problem
 Old system (EDS) produced name-space deficient XML
 QS initially included namespace declaration (allows validation)
 We took it out because non-XML processing got broken
 But we’re going to put it back.

<?xml version="1.0" encoding="UTF-8"?>

<doi_recordsxmlns="http://www.crossref.org/xschema/1.0"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.crossref.org/xschema/1.0http://www.crossref.org/schema/u
nixref1.0.xsd">

<doi_records>
<doi_record owner="10.1002" timestamp="2007-07-25 13:08:17">
<crossref>
<journal>
<journal_metadata>
<full_title>Applied Cognitive Psychology</full_title>
<abbrev_title>Appl. Cognit. Psychol.</abbrev_title>
<issnmedia_type="print">08884080</issn>
<issnmedia_type="electronic">10990720</issn>
</journal_metadata>

5

 Example of a bug fix
EDS had un-resolvable bug, could not maintain accuracy of “fl_count”
Now fixed in the QS

http://doi.crossref.org/search/doi?pid=…&format=xsd_xml&doi=10.1002/….
<?xml version="1.0" encoding="UTF-8"?>
<crossref_resultxmlns="http://www.crossref.org/qrschema/2.0" version="2.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-
instance" xsi:schemaLocation="http://www.crossref.org/qrschema/2.0
http://www.crossref.org/schema/queryResultSchema/crossref_query_output2.0.xsd">
<query_result>
<head>
<doi_batch_id>none</doi_batch_id>
</head>
<body>
<query status="resolved" fl_count="5">

http://cdoi.crossref.org/servlet/getForwardLinks?doi=10.1002/…
<crossref_result version="2.0" xsi:schemaLocation="http://www.crossref.org/qrschema/2.0
http://www.crossref.org/qrschema/crossref_query_output2.0.xsd">
<query_result><head><doi_batch_id>none</doi_batch_id></head><body>
<forward_linkdoi="10.1002/(SICI)1099-0720(199911)13:1+<S41::AID-ACP632>3.0.CO;2-A"></forward_link>
</body>

6

2012

 Develop a local repository dedicated to metadata queries
 Off load query processing from main Oracle DB
 Provide separation from deposit DB and query operation
 More scalable

 Deposit rewrite phase 2
 Better user/member/publisher/prefix model
 Better title management
 Improve deposit processing visibility and logging
 Fix years of data mistakes and make current ‘evolved’ data

 Maintenance, maintenance and more maintenance
 Fix bugs (of course)
 Attend to disaster data center
 Take care of those things that have been waiting
 Start thinking about the next big thing

7

System Update (2011 CrossRef Workshops)

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (20)

Similar a System Update (2011 CrossRef Workshops)

Similar a System Update (2011 CrossRef Workshops) (20)

Más de Crossref

Más de Crossref (20)

Último

Último (20)

System Update (2011 CrossRef Workshops)