1. Mobile Ontology Cloud- Semantic Post-IT- IT Life and Ontology Key-Sun Choi (kschoi@kaist.edu) http://kschoi.kaist.ac.kr/ CILab & Semantic Web Research

3. Demo and Downloadable (5 min)

4. Enabling Technologies (15 min)

5. APIs for Technologies (5 min)

6. ontocore.org (what you can do),

7. Protégé API

8. Remaining in your home

10. Personal Ontology Editors

12. Personal randomized message

13. Organizing by interpreting messages

14. Table information extraction from text

15. Relevant table information grouping

16. Personal information space

17. Usage of ontology that user can edit

18. Collective intelligence

20. Motivation Motivating Scenario Reading an article on “Omnia 2” Another similar Smartphone? More details on OS What is the recent trend of it? Company in competition What should we do?

21. Motivation Motivating Scenario CPU clock Reading an article on “Omnia 2” Another similar Smartphone? OS, platform More details on OS What is the recent trend of it? Manufacturer, design Company in competition Products of the company We have to think of what type of information are involved

22. Motivation Motivating Scenario nationality Reading an article on “Immanuel Kant” Where is he from? ? ? ? If new to philosophers, we are likely to have no idea about relevant information

24. Data set that specifies attributes for each concepts is needed

25. Smartphone : manufacturer, OS, memory, …

26. Philosophers : nationality, follower, teacher, …

27. However, no one guy can describe every concepts

28. We can obtain the data set from collective intelligenceauthor politician scientist engineer Philosophers Artist

29. Established February 16, 1971 Type Government-run President Nam-Pyo Suh … … Motivation Wikipedia Wikipedia documents (2010/01/29) 3,175,836 (ENG) - 11,527,437 users 125,801 (KOR) - 100,498 users ④ ① ② ① Inter-page link ② Inter-Language link ③ Category ④ Infobox: table information ③

31. Semantic Web

32. A machine-readable web

33. Ontology

35. The meaning (semantics) of information and services on the web is defined

36. For the web to "understand" and satisfy the requests of people and machines to use the web contentOur focus Adapted from Wikipedia (http://en.wikipedia.org/wiki/Semantic_Web)

38. Background Technologies Ontology A formal specification of knowledge to be interpreted by computers Company isManufacturedBy supportSoftware OS releaseDate rdfs:subPropertyOf runsOn cameraPixelOf Mobile Phone hasMemorySize supportOnlineSoftware hasWebsite Mobile PhoneSoftware rdfs:subClassOf rdfs:subClassOf rdfs:subClassOf PDA Cellular Phone SmartPhone Cellular Phone Smart Phone PDA Schema Instance releaseDate 2008 Samsung i900 Omnia cameraPixelOf 5 megapixels supportOnlineSoftware hasWebsite Skype www.skype.com hasMemorySize 128 MB runsOn Windows Mobile 6.1 isManufacturedBy Samsung

39. Illustrative Example Content Space -> Message Space Semantic Post-It (Message List) Typical Web Browser External Contents KAIST is located in Daejeon, South Korea. KAIST was established by Korean government in 1971 Scrap Related Problems : Mash-Up How to extract text from heterogeneous contents (in a context, not a scientific issue)

40. Illustrative Example Message Space -> Triple Message Space (1/2) Semantic Post-It (Message List) Semantic Post-It (Detail View) Semantic Post-It (Detail View) KAIST is located in Daejeon, South Korea. KAIST was established by Korean government in 1971 KAIST is located in Daejeon, South Korea. KAIST was established by Korean government in 1971.… The current KAIST President Nam Pyo Suhtaught for… KAIST is located in Daejeon, South Korea. KAIST was established by Korean government in 1971.… The current KAIST President Nam Pyo Suhtaught for… Person Smatphone’s UI is limited. Information should be shown by one-click. Related Problems : ISA relation recognition

41. Estabilshed 1971 Province Daejeon Country South Korea … … Illustrative Example Message Space -> Triple Message Space(2/2) Semantic Post-It (Table View) Semantic Post-It (Message List) Semantic Post-It (Message View) KAIST is located in Daejeon, South Korea. KAIST was established by Korean government in 1971 KAIST is located in Daejeon, South Korea. KAIST was established by Korean government in 1971.… The current KAIST President Nam Pyo Suhtaught for… KAIST Summarization Display size is too small to do full browsing. Related Problems : Triple extraction from text

42. Illustrative Example Triple Message Space ->Linked Triple Message Space Semantic Post-It (Graph View) Semantic Post-It (Message List) Semantic Post-It (Message View) Suh was born in Korea on April 22, 1936, and immigrated to the U.S. in 1954…. KAIST is located in Daejeon, South Korea. KAIST was established by Korean government in 1971 KAIST is located in Daejeon, South Korea. KAIST was established by Korean government in 1971.… The current KAIST President Nam Pyo Suhtaught for… president KAIST is located in Daedeok… province Daejeon is a center of transportation in South Korea, where two major, Relevant messages Display size is too small to show text Related Problems : Relevant keyword search by traversing Ontology

43. Illustrative Example Linked Triple Message Space Semantic Post-It (Using Ontology 1) Semantic Post-It (Using Ontology 2) Ontology 1 Ontology 2 Suh was born in Korea on April 22, 1936, and immigrated to the U.S. in 1954…. Suh was born in Korea on April 22, 1936, and immigrated to the U.S. in 1954…. University University president president president president KAIST is located in Daedeok… KAIST is located in Daedeok… Person Person province province province locatedAt Settlement Country Daejeon is a center of transportation in South Korea, where two major, South Korea is a presidential republic consisting of 16 administrative… Related Problems : Personal ontology editing, logical consistency checking

45. If you wish to see another label in the link

46. Ex) isManufacturedBy -> manufacturer

47. Modify constraints

48. If you wish to see the country name rather than the city name

49. Ex)

50. Remove : University-province-Settlement

51. Add : University-locatedAt-Country

52. Use the modified ontology in your Semantic Post-ItHow to embed this complex UI into Smartphone? http://protege.stanford.edu/

53. System architecture (1/2) Message Interpretation Services HTTP request Semantic Post-IT Server (HTTP server) Semantic Post-IT client TABLEGEN CAT2ISA HTTP response Ontology Access DBpedia Access Personal Ontology Local Message DB External Message Service System Message DB Twitter, Blog, Email, Calendar, …

55. Message input interface

56. Message list viewer

57. HTTP service controller

58. Semantic Post-IT server

59. External message service

60. Message relation graph viewer

61. Personal ontology editorSemantic Post-IT client Personal Ontology Local Message DB

62. Demo and Downloadable http://swrc.kaist.ac.kr/SemanticToolkits/

63. What is Semantic Post-It? Memo Admin Service Evernote, quickies, etc. Semantic Service Mash-Up

64. Semantic Service Mash-up Definition of 3 types of applications Type 1 Application: Information zooming on specific ‘word’ of a memo Type 2 Application: Memo Contents Analysis Type 3 Application: Information zooming on whole context of a memo

65. Type 1 Application: Example DEMO: Semantic Post-It

66. Type 2 Application: Demo DEMO: Semantic Post-It

67. Type 3 Application: Demo DEMO: Semantic Post-It

69. Support for Semantic Post-It:OntoCloud Ontology derived from Wikipedia infoboxes Official Website:http://swrc.kaist.ac.kr/ontocloud/

70. Support for Type 2 Application:Semantic Annotation One of possible type 2 application: Table-form summary generator Semantic Annotation: Mark on the documents – ‘which part’ could be transformed into table?

71. Semantic Annotation Toolkit: COAT DEMO: COAT

72. From annotated data to Application: Machine Learning Feature Support Vector Machine(SVM)

73. Ontology Feature Modern GSM-based BlackBerry handhelds incorporate an ARM 7 or 9 processor, while older BlackBerry 950 and 957 handheldsused Intel 80386 processors. IT Ontology Package Gathering semantic Info Using Ontology CPU Intel 80386 Modern GSM-based BlackBerry handhelds incorporate an ARM 7 or 9 processor, while older BlackBerry 950 and 957 handheldsused Intel 80386 processors. useCPU

74. Data Authority Policy Annotators can check his/her documents ONLY! To prevent cheating Simple annotation data viewer is available For administrators DEMO: COAT Viewer

75. Support for Type 3 Application:300M Wikipedia articles into Database Provide baseline for shared memo For type 3 application Build shared memo database with 300M wikipedia articles as its part

76. Screenshots 3) Table information extraction 1) User inputs message 2) Ontology recommendation 4) Relevant message grouping

79. Technologies Ontology inference Text Text Samsung releases Omnia Text Apple releases iPhone IPTV service is launched Environmental Technology Apple supports Green technologies support ISA beginService Service TV Service Company instanceOf instanceOf instanceOf manufacture use instanceOf Samsung Apple Product instanceOf beginService Green Technology IPTV support manufacture manufacture ISA ISA HDTV Device Omnia Software ISA instanceOf iPhone Smartphone instanceOf

80. Technologies Ontology construction from Wikipedia Infobox class instance properties university

81. Technologies Ontology construction from text 2. Taxonomy Construction is-a 3. Relation Addition not is-a 1. Term extraction and conceptualization The other Final Ontology Existing Ontology Part-of equipment-of 4. Integration 5. Verification Part-of equipment-of

83. Further reduction could be possible if we can automate the processCOAT Auto COAT Before COAT

86. A instanceOf B: A is a member of set B

87. A is called 'instance', B is called 'concept'

88. A and B must share 'essential properties': Properties that makes something as itself

89. Example: <Key-Sun Choi, instanceOf, Professor>: X<Key-Sun Choi, instanceOf, Human>: O

92. Ontology: Formal representation of a set of concepts within a domain and the relationships between those concepts

94. Berners-Lee, Tim; Fischetti, Mark (1999). Weaving the Web. HarperSanFrancisco.

95. The Semantic Web

96. Berners-Lee, Tim; James Hendler and Ora Lassila (May 17, 2001). "The Semantic Web". Scientific American Magazine.

97. Grigoris Antoniou, Frank van Harmelen (March 31, 2008). A Semantic Web Primer, 2nd Edition

98. Ontology

100. [2] Max Van Kleek, Michael Bernstein, Katrina Panovich, Greg Vargas, David Karger, and mc schraefel, Note-to-Self: Examining Personal Information Keeping in a Lightweight Note-Taking Tool.. CHI, 2009

101. [3] The Tabulator, http://www.w3.org/2005/ajar/tab

102. Read [1,2,3] and use the system [2,3]

103. Try also the following system

104. http://www.evernote.com/

106. Wikipedia DbpediaOntocloud (kekeeo@world.kaist.ac.kr)

107. What are the upside?

108. Email 3.0

109. Information Zooming

110. Mobile hyperlink

111. Personal Preference Ontology and its use

112. Collective semantic intelligence of LOD + ontology cloud

113. Another demo (5 min)

114. What you can do immediately (review)

115. What you can contribute (review)

116. Big picture

117. Function, society

119. IT Campus Domain Ontology (Partial)

121. An online, collaboratively edited encyclopedia

122. Articles are available in over 250 languages

123. Freely available and freely distributable

125. A community effort to extract structured information from Wikipedia

126. Available on the Web

127. Different types of structured information

128. Infobox templates: summaries of the most relevant facts contained in an article

129. Categorization information

130. Images

131. Geo-coordinates

133. Goals

134. Making more intelligent IT systems focusing on devices and resources

135. Key classes

137. Constructing the Pivot dataset

138. The infobox dataset from DBpedia3.4 (semi-automated)

139. IT CUO (IT Core Upper Ontology)

140. A middle level ontology for integration

141. Ontologies under IT domains

142. IT Service Ontology

143. IT Device Ontology

145. Information Zooming

146. Mobile hyperlink

147. Personal Preference Ontology and its use

150. Local file indexingThe Samsung Group is composed of numerous international affiliated businesses, most of them united under the Samsung brand including Samsung Electronics, the world's largest electronics company,

153. Show small amount of information first

154. When user requires more information about one part, shows more detailed information about that part.

155. Why is it necessary?

156. Mobile environment: small display

158. Represent URL as barcode

159. Take a picture of the barcode using camera in cellphone and you move to that URL!

160. Why is it necessary?

161. Mobile environment: small interface

162. Hard to type all the URL

166. Takes a concept and extract the relations

168. Interactive Service

170. The Linked Open Data Cloud

171. What you can do immediately review discussion

173. Synchronization is a data transfer between computer and mobile device that aims to keep both of components in a coherent state

174. Knowledge-driven Security Handling for Mobile Applications

175. Several mobile applications attacks have beenrecently reported

176. Device and environment

177. Ontology Packaging for Mobile field

179. Windows Mobile isDevelopedBy Microsoft Omnia 2 ISA smartphone Flash memory ISA computer storage Omnia 2 hasOS Windows Mobile Omnia 2 hasMemory Flash memory Big Picture Message generation Linked Triple Message Space hasMemory hasOS Personalized Message Space Omnia 2 is a multimedia smartphone announced at Samsung. Omnia 2 runs Windows Mobile developed by Microsoft and comes with flash memory which is a computer storage. How to do so? Do you have an idea how to utilize personalized ontology to generate sentences? Personalized ontology

181. Challenges

182. Semantic Tagging to Image

183. Refer to http://www.image-net.org/KAIST is located in Daejeon, South Korea. KAIST was established by Korean government in 1971 KAIST established 1971 province Daejeon Country South Korea Table information Table information + images

185. Generate NL text by traversing table

186. KAIST-Province-Daejeon

187. Daejeon-Districts-fifth

188.  KAIST is located in Daejeon. Daejeon is the fifth largest city in the country.

189. Challenges

190. Transform a predicate into verb phrases

192. Big Picture Technologies to study(interdisciplinary) Architecture /Urban design Software Engineering Graphics IR, AI, MachineLearning HCI CognitiveScience Internet of Things Cloud Computing Design DB & Data Mining ConvergenceNetworks Sociology Middleware Handle huge amount of messages Ex) manipulating Wikipedia documents Find person of my interests Ex) References in papers Which layout is suitable for the display? Ex) Table-memo for a tiny display Plug-in architecture Ex) Collect personal documents by using Google Desktop APIs How to extract table data from memo? Ex) information extraction from document Which type of memo? Writing style anaylsys Ex) To-do list, contact, documents Write message anywhere and anytime Ex) RFID-equipped notes

193. Deep story about semantic technology discussion!

194. Credits Dong-Hyun Choi, cdh4696@world.kaist.ac.kr Eun-Kyung Kim, kekeeo@world.kaist.ac.kr JinhyunAhn, jhahn@world.kaist.ac.kr Key-Sun Choi, kschoi@kaist.edu http://swrc.kaist.ac.kr/ontocloud http://swrc.kaist.ac.kr/SemanticToolkits/