In an effort to speed the process of entering proposed developer infrastructure into it's geospatial database, the City of Henderson Department of Utility Services recently began requiring civil engineering designs to be submitted electronically using CAD files following newly developed CAD standards. The City teamed with Consortech to create an FME Workbench to automate validation processing and generate a report to let users know how well the CAD file adheres to the City standards. This presentation will show the results of this FME automated CAD validation project.

1. DUS GIS
FME World Tour 2018
April 10, 2018
Los Angeles

2. Who We Are

3. Problem/Background
• Streamlining Requests for Data
– Data Delivery (Due Diligence)
– Data Submittal (CAD)

4. Solution
• Asset Handover Process
– CAD Standards
– Clip-n-Ship
– CAD Validator

5. Clip-n-Ship

6. CAD Validator
• Software Used to Complete the Process
– Amazon Web Services
– Python
– FME
• Goal:
– Simplified Submittal Process for Customer
– Automated Quality Control
– Automated Data Conversion (CAD to SDE)
– Re-Allocate Resources

7. Web Portal
• WWW.COHDUS.COM
– Utility Submittal Portal
– User Account Required

8. CAD Standards

9. Web Forms & Parameters
• Submittal Type
– Validate A CAD File Submittal
– Submit A CAD File as Final
– Determines the Extent the File will be Processed
• Web Form Uses
– Populates Parameters for Python & WB
– Dynamic Web Reporting
– General Information Gathering

10. Python
• Python as Orchestrator
• Passes Files Between Servers
• Launches Workbench
• Feeds Process & Reporting Parameters to
Workbench
• Compresses Error Files
• Return Results to Server for Dynamic Reporting

11. FME Workbench
• CADValidator.fmw
• Dual Purpose Contract
– Training & Development

12. Spatial Validation
• Reads CAD File
• Filters for Valid Geometry Types
• Spatial Filter Boundary Test
– Fail Here Stops the Process
• Coordinate System Validation
– Fail but Continue

13. CAD Processors By Attribute Type
• Parse Files by CAD Attribute Type
– Parameter From Web Form
• Accepted options
– Object Data
– Extended Entity Data
– Comma Delimited
– ArcGIS for
AutoCAD Plugin

14. Restricted Data Validation
• MS Excel Reader
• This Section Verifies
– Layer Names
– If Null Value are Acceptable
– If a Valid Range Value Provided
– Values Provided Match Acceptable Domains by Layer
• Prepares Results for JSON Reporting

15. JSON Reporting
• Produces Final Status JSON for Web Reporting
– Aggregates All Pass/Fail Errors Together
– Reads in the Manifest JSON
– Uses String Replacer Transformer to Update JSON
Status File

16. JSON Reporting By Layer
• Pass/Fail Reporting Grouped by Layer
– Used for ‘Details’ Reporting at www.cohdus.com
• Transformers
– Feature Mergers
– List Builders
– Concatenators
• Restricted Data Tests Grouped by Layer
• First Failed Feature Fails Layer
• Has Separate Layer Status JSON File

17. Error File Generator
• Error Files Produced by WB
– CAD DWG
– ESRI Shapefile
– GeoJSON File
• Detailed Text File
– MS Excel Error Report
• Null, Range & Domain Errors by Entity

18. Data Conversion & Next Steps
• Converts All Submitted Data to FGDB
– No Restrictions
– Minimize Failures During Initial Public Delivery
• Future Enhancements
– Accepted Layers Only
– Assign Default Values
– Dynamically Update SDE repository

19. The My Uploads Page
• All Processing Results Published to My Uploads
• Portal Page Provides:
– File Status
– Upload Date & Time
– Submittal Type
• Validation Only
• Final
– Link to Details Report

20. Dynamic Details by Layer
• Reports Submittal Details
– Matched (Expected) Layers
– Unmatched (Unexpected) Layers
– Pass/Fail Results for Matched Layers
– Link to Download Error Files
• Files Retained by Host

21. EXTRA GRAPHICS