An overview of simple techniques for bringing non-spatial business data into ArcGIS Server applications.

1. Strategies for Integrating Utility System Operational Data into ArcGIS Server ApplicationsDavid SpeightTrue North Geographic TechnologiesSCARC 2011 – Columbia, SC

3. Esri Gold Partner

4. BP of the Year 2010 for Southeast Region

5. Located in Murfreesboro, TN

6. Business Partner with Azteca, Microsoft

7. Me

8. Electric distribution utility background

9. 18+ yrs experience with ESRI/Esri

10. IT manager for water utility

12. Utility/public works GIS users

13. ArcGIS Server users

14. Web API users

15. Flex Viewer, Resource Center templates, Sharepoint Web Parts

16. Developers and non-developers

17. Outline

18. Definitions

19. Considerations

20. Strategies

21. Scenarios*

23. Most examples are Flex/Flex Viewer, but applicable to all web APIs

24. Assuming some experience with ArcGIS Server – publishing services, customizing templates

26. Base layers

27. Background data…i.e. street, topo, imagery

28. Cached for performance

29. Operational layers

30. Frequently edited/changed…i.e. infrastructure, inspections, work activity

31. DynamicArcGIS Server in Practice Series: ArcGIS Server Web Mapping Application for Municipal/Local Govt. http://downloads2.esri.com/support/whitepapers/other_/ArGISWebMapMuni_LocalGovt.pdf

33. “Stuff that doesn’t normally live in your geodatabase”

34. CIS – billing transactions, account activities, consumption data

35. AVL – current and historical vehicle locations

36. SCADA – system status, performance, and load

37. Document Management

38. Work Management – work history, costs, asset conditions, performance reporting, inspections

39. Security – camera feeds, facility access

42. “Where does this data live?”

43. “How often does it change?”

44. “How big is it?”

45. “Is it inherently spatial? If not, can we make it spatial?” a.k.a “Does it have geometry?”

46. Understand the end user

47. “How do we want to present this? How will the user interact with the data?”

48. “Where will the end user be? Office? Field?”

49. “What is the expectation for update frequency?”

51. Task scheduling

52. Web server

53. ArcGIS Server (assumed)

54. Publish services

55. Run GP scripts

56. Enterprise geodatabase (assumed)

57. DB job scheduling

58. Spatial data types?

59. Tools for data import/export

61. Flex Viewer

62. Silverlight Viewer (coming soon)

63. ArcGIS Explorer Online

64. ArcGIS for Sharepoint

65. Others……

68. How do we connect?

69. What tables, columns do we need?

70. How do we acquire geometry?

71. Geocode?

72. Relate to geodatabase feature?

73. How does this data change?

74. How much data is there?

75. Business Documents

77. Add geometry if needed

78. Existing XY

79. Geocode

80. Look up from existing GDB features

81. Geoprocessing

82. Calculate new attributes

83. Push into output format

84. Spatial data types are handyTransform

86. Published feature class in a map service

87. GeoRSS feed

88. Custom XML feed

89. Web service with XML or JSON responsePublish

91. Symbology

92. Standard cartography

93. Custom graphics

94. Heat map

95. Clustering

96. Refresh rate

97. Transparency

98. Custom codingPresent

99. Define Common Steps (cont.) Transform Sometimes the steps happen differently… Publish Present

100. Scenarios Configuration Push data into db table and publish as XY events Push data into GDB feature class Export custom XML feeds Build .NET web service Customization

102. Electric cooperative

103. Telvent Outage Management

104. GIS Environment

105. ArcGIS Desktop 9.3.1

106. ArcGIS Server 9.3.1

107. SQL Server 2005

108. Needs

110. Scenario #1 - Outage Management Data LiveLayer Widget (Flex Sample Viewer) Query Widget (Flex Viewer)

112. Municipal public works department

113. Stormwater, wastewater, streets, traffic, trash

114. Cityworks MMS

115. GIS Environment

116. ArcGIS Desktop 9.3.1/10

117. ArcGIS Server 10

118. SQL Server 2008

119. Needs

120. Managers need to view active and historical work history in a web-based dashboard (no desktop software)

121. Service Requests

123. Cityworks work tables have existing XY values from geocoding

124. Want maximum flexibility to use data in multiple clients

125. Dataset is large (500K+ points in one table) – too big for XY layer?

126. Want to update incrementally throughout the workday

127. Have full control over the structure of the transformed dataset

128. Approach

129. Create a geodatabase using SQL geometry instead of native SDE geometry

130. Create feature classes in the geodatabase for service request and work orders

131. Use T-SQL to write stored procedures to update the geodatabase feature classes from the source Cityworks tables

132. Schedule stored procedure to run throughout the day to update the geodatabase – KEEP FEATURES AS NON-VERSIONED

134. Scenario #2 - Work Management Data Flex Sample Viewer / LiveLayer Widget

135. Scenario #2 - Work Management Data ArcGIS for Sharepoint / ArcGIS Explorer Online

137. Water utility district

138. Radio-based vehicle tracking system

139. GIS Environment

140. ArcGIS Desktop 9.3.1

141. ArcGIS Server 9.3.1

142. SQL Server 2005

143. Needs

144. Supervisors and field technicians need to be able to see locations of crews and other techs

146. Both field and office accessing web application

147. Keep app security simple

148. Need frequent updates (every minute)

149. AVL data in existing SQL Server database, but coordinates are WGS84, not State Plane

150. Approach

151. Create SQL stored procedure to transform & output current AVL records as XML dataset

152. Schedule task to execute stored procedure and write the XML file to a web-accessible location

155. Electric cooperative

156. SAP CIS

157. GIS Environment

158. ArcGIS Desktop 9.3.1

159. ArcGIS Server 9.3.1

160. SQL Server 2005

161. Needs

163. Need to be able to search against multiple attributes

164. Complex multi-table join to navigate from customer record to actual GDB feature in order to find geometry

165. Multi-step process

166. Approach

167. Create a .NET web service that can be called from Flex

168. Method to search SAP tables

169. Method to navigate tables to find geometry from GDB feature

171. Scenario #4 – Customer Information Data Custom Web Service / Custom Flex Widget

173. Maximize out-of-the-box functionality