In this session, we will look first at the rich metadata that documents in your repository have, how to control the mapping of this on to your content model, and some of the interesting things this can deliver. We'll then move on to the content transformation and rendition services, and see how you can easily and powerfully generate a wide range of media from the content you already have.

1. Metadata Extraction and Content Transformations 2 Nick Burch Software Engineer, Alfresco twitter: @gagravarr

2. Introduction – 3 Content Related Services 3 Covering Uses Interfaces Calling the Services Java & JavaScript APIs Demos Extensions Apache Tika Metadata Extractor Content Transformer Renditions

4. Document Metadata is converted into the content model

5. Typically used with uploaded binary files

6. Upload a PDF, extract out the Title and Description, save these as the properties on the Alfresco Node

7. Powered internally by a number of different extractors

8. Service picks the appropriate extractor for you

10. Driven by mime types, source and destination

11. Used to generate plain text versions for indexing

12. Used to generate SWF versions for preview

13. Used to generate PDF versions for web download

14. Powered by a large number of different transformers

15. Transformers can be linked together, eg .doc -> .pdf via Open Office, then .pdf -> .swf via pdf2swf

17. Or can just alter some content as-is

18. Used to manipulate images, eg crop and resize

19. Used to generate HTML .docx previews in Web Quick Start

20. Often uses the Content Transformation Service

21. Replaced the Thumbnail Service

23. Grew out of the Lucene community, now widely used

24. Provides detection of files – eg this binary blob is really a word file

25. Plain text, HTML and XHTML versions of a wide range of different file formats

26. Consistent Metadata from different files

27. Tika hides the complexity of the different formats, and presents a simple, powerful API

30. Word, PowerPoint, Excel

31. HTML

32. Open Document Formats (OpenOffice)

33. RFC822 Email

35. DWG (CAD)

36. Epub

37. RSS and ATOM Feeds

38. True Type Fonts

39. HTML

40. Images – JPEG, GIF, PNG, TIFF, Bitmap (including EXIF where found)

41. iWork (Keynote, Pages etc)

43. Microsoft Office (Binary) – Word, PowerPoint, Excel, Visio, Publisher, Works

44. Microsoft Office (OOXML) – Word, PowerPoint, Excel

45. MP3 (id3 v1 and v2)

46. CDF (Scientific Data)

47. Open Document Format (Open Office)

48. Old-style Open Office (.sxw etc)

50. RDF

51. Plain Text

52. FLV Video

53. XML

54. Java class filesAnd I probably forgot one...!

55. Calling Apache Tika 13 // Get a content detector, and an auto-selecting Parser TikaConfigconfig = TikaConfig.getDefaultConfig(); ContainerAwareDetector detector = new ContainerAwareDetector( config.getMimeRepository() ); Parser parser = new AutoDetectParser(detector); // We’ll only want the plain text contents ContentHandler handler = new BodyContentHandler(); // Tell the parser what we have Metadata metadata = new Metadata(); metadata.set(Metadata.RESOURCE_NAME_KEY, filename); // Have it processed parser.parse(input, handler, metadata, new ParseContext());

56. Metadata Extractor – Java Use 14 MetadataExtractorRegistry registry = (MetadataExtractorRegistry)context.getBean(“metadataExtracterRegistry”); MetadataExtracter extractor = registry.getExtracter(“application/vnd.ms-excel”); Map<QName, Serializable> properties = new HashMap<QName, Serializable>(); ContentReader reader = contentService.getReader(nodeRef, ContentModel.PROP_CONTENT); extractor.extract(reader, properties); System.err.println(properties);

57. Metadata Extractor – JavaScript Use 15 JavaScript var action = actions.create("extract-metadata"); action.execute(document); Full access is not directly available You can’t get at the raw properties You can, however, trigger extraction and saving to the node easily Available via an action

58. Metadata Extractor – Geo Content Model 16 <aspect name="cm:geographic"> <title>Geographic</title> <properties> <property name="cm:latitude"> <title>Latitude</title> <type>d:double</type> </property> <property name="cm:longitude"> <title>Longitude</title> <type>d:double</type> </property> </properties> </aspect>

59. Metadata Extractor – Geo Mapping 17 # Namespaces namespace.prefix.cm=http://www.alfresco.org/model/content/1.0 # Geo Mappings geolat=cm:latitude geolong=cm:longitude # Normal Mappings author=cm:author title=cm:title description=cm:description created=cm:created

60. Demo:Geo Tagged Image in Share 18

61. Content Transformation Service 19

63. PDF to Image

64. PDF to SWF (for preview)

65. Office File Formats to PDF (via Open Office, using JODConverter in Enterprise)

66. Plain Text and XML to PDF

67. Zip listing to Text

69. Content Transformer – Java Use 22 ContentTransformerRegistry registry = (ContentTransformerRegistry)context.getBean(“contentTransformerRegistry”); ContentTransformer transformer = registry.getTransformer(“application/vnd.ms-excel”,”text/csv”, new TransformationOptions()); ContentReader reader = contentService.getReader(sourceNodeRef, ContentModel.PROP_CONTENT); ContentWriter writer = contentService.getReader(destNodeRef, ContentModel.PROP_CONTENT); transformer.transform(reader, writer);

70. Content Transformer – JavaScript Use 23 JavaScript var action = actions.create("transform"); // Transform into the same folder action.parameters["destination-folder"] = document.parent; action.parameters["assoc-type"] = "{http://www.alfresco.org/model/content/1.0}contains"; action.parameters["assoc-name"] = document.name + "transformed"; action.parameters["mime-type"] = "text/html"; // Execute action.execute(document); Full access is not directly available You can’t control which property is transformed, it’s always Content You can control where the transformed version goes Triggering the transformation is easier than in Java Available via an action

71. Custom Tika Parsers - Interface 24 Interface public interface Parser { Set<MediaType> getSupportedTypes(ParseContext context); void parse( InputStream stream, ContentHandler handler, Metadata metadata, ParseContext context) throws IOException, SAXException, TikaException; } The Tika Parser interface is quite simple Need to provide a list of supported mime types, so that auto-detection can work Accept an input stream, populate the Metadata object, and fire SAX events to the supplied handler That’s it!

72. Custom Tika Parser – Hello World Parser 25 public class HelloWorldParser implements Parser { public Set<MediaType> getSupportedTypes(ParseContext context) { Set<MediaType> types = new HashSet<MediaType>(); types.add(MediaType.parse("hello/world")); return types; } public void parse(InputStream stream, ContentHandler handler, Metadata metadata, ParseContext context) throws SAXException { XHTMLContentHandlerxhtml = new XHTMLContentHandler(handler, metadata); xhtml.startDocument(); xhtml.startElement("h1"); xhtml.characters("Hello, World!"); xhtml.endElement("h1"); xhtml.endDocument(); metadata.set("hello","world"); metadata.set("title","Hello World!"); } }

73. Custom Command Line Transformer 26 <bean id="transformer.worker.helloWorldCMD" class="org.alfresco.repo.content.transform.RuntimeExecutableContentTransformerWorker"> <property name="mimetypeService“><ref bean="mimetypeService"/></property> <property name="transformCommand"> <bean class="org.alfresco.util.exec.RuntimeExec"> <property name="commandsAndArguments“><map> <entry key=".*“><list> <value>/bin/bash</value> <value>-c</value> <value>/bin/echo 'Hello World - ${source}' &gt; ${target}</value> </list></entry> </map></property> <property name="errorCodes“><value>1,127</value></property> </bean> </property <property name="explicitTransformations"> <list><bean class="org.alfresco.repo.content.transform.ExplictTransformationDetails"> <property name="sourceMimetype“><value>text/plain</value></property> <property name="targetMimetype“><value>hello/world</value></property> </bean></list> </property> </bean> <bean id="transformer.helloWorldCMD" class="org.alfresco.repo.content.transform.ProxyContentTransformer" parent="baseContentTransformer"> <property name="worker"><ref bean="transformer.worker.helloWorldCMD"/></property> </bean>

75. Use our Tikatransfomer to turn this back into plain text

77. Rendition Service 29

79. image – crop, resize, etc

80. freemarker – runs a Freemarker Template against the content of the node

81. html – turns .docx files into clean HTML + images

82. xslt – runs a XSLT Transformation against the content of the node, XML content nodes only!

84. Then set all the parameters against it

85. Finally execute it against a node

86. For very complicated / common renditions, you can save the definition to the data dictionary

87. It can then be retrieved and run

89. QNamerenditionName = QName.createQName( NamespaceService.CONTENT_MODEL_1_0_URI, "myRendDefn");

90. RenditionDefinitionrenditionDef = loadRenditionDefinition(renditionName);

91. // Make some changes.

92. renditionDef.setParameterValue(AbstractRenderingEngine.PARAM_MIME_TYPE, MimetypeMap.MIMETYPE_PDF);

93. renditionDef.setParameterValue(RenditionService.PARAM_ORPHAN_EXISTING_RENDITION, true);

94. // Persist the changes.

95. renditionService.saveRenditionDefinition(renditionDef);

96. // Run the Rendition

98. renditionDef.parameters["destination-path-template"] = "/Company Home/Cropped Images/${name}.jpg";

99. renditionDef.parameters["isAbsolute"] = true;

100. renditionDef.parameters["xsize"] = 50;

101. renditionDef.parameters["ysize"] = 50;

102. renditionService.render(nodeRef, renditionDef);

104. They won’t show up in Share when defining Rules, or in Explorer for running a Custom Action

105. Solution – create a JS Script, or some custom Java

106. Use this from your Rule / to run as an Action

107. No dedicated REST API, but Renditions are available through CMIS

109. This delivers lots of flexibility, and means anyone who can write Custom Actions already knows enough to write Custom Rendition Engines!

110. org.alfresco.repo.rendition.executer.AbstractRenderingEngine provides a helpful superclass

112. Demo 2:Video Rendition 37

113. Demo 3:Word .docx -> HTML & Images(Using Web Quick Start) 38

114. Any Questions? 39

115. Learn More 40 wiki.alfresco.com forums.alfresco.com blogs.alfresco.com/wp/nickb/ twitter: @AlfrescoECM @Gagravarr