Architecture, Historical Data Conversion and Management Process
•
1 like•505 views
SCAUG 2010 Ft. Worth, TX
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to Architecture, Historical Data Conversion and Management Process
Similar to Architecture, Historical Data Conversion and Management Process (20)
Recently uploaded
Recently uploaded (20)
Architecture, Historical Data Conversion and Management Process
- 1. as a part of an enterprise project,as a part of an enterprise project, ““Historical Site ManagementTool”Historical Site ManagementTool”
- 2. Amy Gwin GIS Analyst The Geospatial Group, a division of Information Management Systems, Inc. Jackson, MS agwin@thegeospatialgroup.com Mississippi Department of Archives and History (MDA&H) Historic Preservation Division – National Historic Preservation Act of 1966 Jackson, MS THE GEOSPATIAL GROUP
- 3. the official list of the Nation’s historic places worthy of preservation THE GEOSPATIAL GROUP
- 4. the official list of the Mississippi’s historic places that are worthy of documentation THE GEOSPATIAL GROUP
- 5. Digital Preservation has benefits • Documents can be destroyed • Less than ideal archival situation • Internal processing, archival work, etc • Recession– government resources Photo is courtesy of GulfCoastNews.com MDA&H Historic Resource Inventory • Consultants, Researchers have to come into the building to get information by appointment only • Traveling costs, limited access • Staff must organize files, give tours, provide assistance Management of internal resources • Difficult to analyze the historical resources • Prove need for additional funding • Better decision making, etc THE GEOSPATIAL GROUP
- 6. • SQL database solution with a web browser interface, include access to scanned documents, pictures, and webmap • internal administration able to approval data being inputted into SQL database, instead of retyping it all • consultants to submit reports and information • public to view the architectural heritage in the State of Mississippi THE GEOSPATIAL GROUP
- 9. • Recession--- less money, more work • Accurate Locations • Short amount of time • Which records do we look for first? • cabinets of files, organized by county • 47,000 of properties • 13% with addresses • Point Feature Class created from historical properties THE GEOSPATIAL GROUP
- 10. • Divided database record: • w/address • without an address • Divided w/o address by county • Use a variety or ‘precisions’ to locate the property • Created a basemap with data to search • MS GNIS point data • Geocode the properties that have an address THE GEOSPATIAL GROUP
- 11. • Allowed the work flow to continue • Process more files in a shorter time period • Get a overall sense of the type of information available in the files THE GEOSPATIAL GROUP
- 12. • Domain classification created in each fGDB • Standard symbology used • Standard labeling • Monitor progress, find additional data (PLSS) • Continued for two months • Altered as needed during data conversion THE GEOSPATIAL GROUP
- 13. • Key properties were not added • Obvious, well-known, frequently searched properties were not in the GIS WHY?? Located 201+ district maps, many with Surveyed properties plotted and labeled , 19,021 properties THE GEOSPATIAL GROUP
- 14. • Polygon Feature Class created from district maps, added a unique ID to link to table • Scan • Georeference • Draw polygon, add unique ID, and precision • “District” Precision value created in point feature class Precision field THE GEOSPATIAL GROUP
- 15. • Conferred with historians to develop a priority ranking to the properties in the GIS • From the ‘most difficult to obtain’ designation to least difficult 1. National Historic Landmark (NHL) 2. Mississippi Landmark (MSL) 3. National Register Individually Listed Property (NRI) 4. National Register District (NRD) 5. Not designated property THE GEOSPATIAL GROUP
- 16. • Applied the Historical Priority to the data in GIS • Applied the Historical Priority to the data table from Access • Divided out the properties by county THE GEOSPATIAL GROUP
- 17. • 93% of database entries have a recorded location • Locations vary in precision, from geocoded, to aerial- match. • Recommendations: clean up, do additional research THE GEOSPATIAL GROUP One person + constant influx of work responsibilities = where towhere to begin?begin? • Revamp the department requirements regarding location • Add new architecture properties • Gather data to update the website with archeological and architecture GIS data updates • Update, research properties in the architecture GIS database
- 18. Ranking work tasksRanking work tasks • Considering several attributes • NEED to import tables, redo joins, update fields, calculate fields, etc, each time • Time consuming THE GEOSPATIAL GROUP Python Script ‘update’ toolPython Script ‘update’ tool • Replaces tables in local fGDB with those in SQL DB • Syncs important fields from fGDB to the SQL DB • Calculates the ‘GIS Priority’ and assigns each property a ‘GIS Priority’ rank
- 19. • Considering: • INGIS status (yes, no, new) • Historical Priority Status (15 All designations 0 No designation) • Precision (A1_GPS G3_PLSS) • 1104 unique combinations of the attributes, assigned to 47,000 + properties 24 A1_GPS GPS, center location B NEWLY ADDED, NOT IN THE GIS (2) 14 NHL, MSL, NRI GIS Priority GIS Precision Value GIS Precision Description INGIS Value INGIS Description Historical Priority Value Historical Priority Description 815 C2_GOCD Geocoded, topo verified C IN THE GIS (1) 3 NRI, NRD 411 A NOT IN GIS (0) 14 NHL, MSL, NRI THE GEOSPATIAL GROUP
- 20. • Point is joined to many tables of information which can be view while editing • No need for joining tables , functions as a “one-to-many” permanent join THE GEOSPATIAL GROUP
- 21. Data Conversion 93% of records located, with recorded accuracy Precision was recorded and maintained for 100% of the 93% obtained locations Management Process Prioritized the data, used existing resources and research that had been done Streamline Script/model used for frequently used tasks THE GEOSPATIAL GROUP
- 22. Questions? Slideshow will be available for download on my personal blog: THE GEOSPATIAL GROUP
Editor's Notes
- This project dealt with specifically the data in the Historic Preservation Division – A large part of their [Historic Preservation] work is due to Section 106 of the National Historic Preservation Act of 1966. This bill requires that any government construction or development must be reviewed for its effect on historic properties and that the government agency funding the construction must attempt to avoid adverse effects on properties eligible for the National Register.
- Similarly, here is an example of the types of historical data that was is in the Historic Resource Inventory. It becomes obvious that capturing a building, site, or object is possible to do with a point feature class, depending on the size of the building, site, or object. Capturing a point for a district is not appropriate, since a district can range in size from a few buildings to over 200 buildings. Also, capturing a point for civil war earthworks… not as easily done with a point, but the ‘zoom to’ location would be there.
- Digital Preservation has benefits Documents lost- The Biloxi Public Library, which is located one block from the Gulf, was heavily damaged by Hurricane Katrina. The local history collection, which contained architectural records, oral history recordings, family archives, photographs, maps, and other materials documenting the history of the MS Gulf Coast region was submerged by flood water to an estimate of 50%. Cleaning of the records, salvage is very expensive. Things will be lost. If a copy is added online, it is saved for future generations. MDA&H Historic Resource Inventory Consultants are hired to research areas, and must submit forms, information, photos, etc via postal mail, which is delayed, but then must be inputed manually into the system once it arrives. At that point, research what is already in the database and files to update the records property by property. Also, the public, educators, town managers, librarians, researchers from their office or home can have access to these resources– which, since they are tax payer paid, are truly their resources and certain their shared history. Management of internal resources- What do we have in this neighborhood of Smithtown, MS? Difficult to say, need to look at multiple maps, archaeology maps, architecture maps, smaller maps in the file cabinet. Takes time. Time is money, right?
- Seamless integration between SQL website and Flex web map.
- Seamless integration between SQL website and Flex web map.
- There are many ways of doing a flat file to spatial data conversion, but we were on time and money constraints. Scanning all the files was not an option. Basemap layers provide context for GIS workflows, in this case, creating and editing data. SID orthophotography, ESRI base data
- Domains reduce the entry errors. Symbology set will ‘flip’ the symbol immediately if matched correctly. Ex: Typing in C1 GOCD instead of just clicking on Geocoded, aerial verified. Most of the maps show the properties on USGS Quad maps that were copied, and organizationally, this is pretty much their standard working scale. CLICK As we worked, adjusted this precision. The GNIS wasn’t super accurate, and often we could match the property after using the GNIS to get in the proximity of area. Matching aerially could be done because many files contained photos if not a floorplan that could be matched to the building’s aerial roofline or distinct features. CLICK We found that often researchers would sketch out a map or enclose a map when reporting the property. Sometimes this was a brochure with a map in it, or sometimes a campus map online would allow us to locate the properties and match them aerially. CLICK Later on we will talk about this precision, which was the last to be added to the domain. CLICK
- Not that anyone would say that the 47,000 entries contained ‘unimportant’ properties, but there were key properties missing. During the data conversion process, there was an even distribution of work being done per property. Since only 43% of the properties were designated, it appeared clear that the most familiar and for lack of a better word… important properties were not being added. Since 94% of those 43% were National Register District properties, we needed to target those properties. Fortunately, they had large maps that often included survey points for the districts that we could scan in and reference. You can see from this screenshot that this street is in a district, and there are many properties on the street that have been geocoded, but not adjusted further. AFTER, BEFORE
- After confirming how the database identifies these various designations, I was able to apply this approved historical priority to the data in the GIS And also to the data in their database inventory table with records yet to be located. This map shows, not the concentration of points, but the historical priority of those points. It is clear that rural areas of Mississippi contain many properties, but are not designated.
- After months of work, 93% of the records had a recorded location with varying degrees of precision. Great! In fact, in the final analysis, 96% of the records that weren’t located were also records with no historical designation.
- Considering several attributes, would need to update fields, calculate fields, etc, each time he sat down to work.
- Saves time while editing
- In conclusion Although a high level of accuracy wasn’t obtainable for 93% of the records, Precision was recorded and maintained for 100% of the obtained locations. This will allows realistic use of the data and future expansion and improvement efforts. Prioritizing the data, no matter how daunting of impossible is crucial to achieving success. In this case, getting the locations of the most frequently searched and referenced properties in the MDAH Historic Resource Inventory. In creating Management Processes, it was important that we gave a realistic run of the data management tasks then simplify and prioritize them to reduce time. Streamlining the ArcMap editing environment with simple database relationships, intuitive symbology sets, and preset basemap layers allows the data maintenance to continue with fewer mouse clicks, and information at hand.