Identifying Candidate Routines for Robotic Process Automation From Unsegmented UI Logs
•Download as PPTX, PDF•
0 likes•449 views
Research paper presentation delivered by Volodymyr Leno at the International Conference on Process Mining (ICPM'2020).
Recommended
Recommended
More Related Content
Similar to Identifying Candidate Routines for Robotic Process Automation From Unsegmented UI Logs
Similar to Identifying Candidate Routines for Robotic Process Automation From Unsegmented UI Logs (20)
More from Marlon Dumas
More from Marlon Dumas (20)
Recently uploaded
Recently uploaded (20)
Identifying Candidate Routines for Robotic Process Automation From Unsegmented UI Logs
- 1. Identifying candidate routines for Robotic Process Automation from unsegmented UI logs Volodymyr Leno, Adriano Augusto, Marlon Dumas, Marcello La Rosa, Fabrizio Maria Maggi, Artem Polyvyanyy
- 2. 3 What is Robotic Process Automation (RPA)? Robotic Process Automation – emerging technology that allows organizations to automate repetitive clerical work by executing scripts (RPA bots) that encode sequences of fine-grained interactions with Web and desktop applications 2
- 3. 33 How to identify candidates for automation? Interviews Workshops Observation Requires a lot of time Information about routine can be incomplete
- 4. V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of Demonstration Track at BPM 2019, 124–128, 2019 Alternative: logging user interactions 4
- 5. Approach outline UI Log Preprocessing and normalization Control-flow graph construction Back Edges detection Segments identification Candidate selection Candidates discovery Candidate routines Segmentation Routines identification 5
- 6. Preprocessing and normalization Remove all data parameters Remove redundant actions UI parameters Data parameters • Copied content • Cell value • Field value Context parameters • Field name • Button label • Spreadsheet Unique value for each trace Same value for all traces 6
- 7. Control-flow graph construction Entry point Normalized UI Directly-follows relation 7
- 9. Segments identification Target nodes Source nodes Seg 1 Seg 2 9
- 10. Routines identification <U1, Uy, U2, U3, Ux, U4, Uz> <U1, Uy, U2, Ux, U3, Uz, U4> <U1, Ux, Uz, U2, U3, U4> 10
- 11. Routines identification <U1, Uy, U2, U3, Ux, U4, Uz> <U1, Uy, U2, Ux, U3, Uz, U4> <U1, Ux, Uz, U2, U3, U4> Pattern1: {U1, U2, U3, U4} <U1, Uy, U2, U3, Ux, U4, Uz> <U1, Uy, U2, Ux, U3, Uz, U4> <U1, Ux, Uz, U2, U3, U4> Pattern2: {U1, Ux, U4} <U1, Uy, U2, U3, Ux, U4, Uz> <U1, Uy, U2, Ux, U3, Uz, U4> <U1, Ux, Uz, U2, U3, U4> Pattern3: {U1, Uy, U2, U3, U4} 10
- 12. Routines identification <U1, Uy, U2, U3, Ux, U4, Uz> <U1, Uy, U2, Ux, U3, Uz, U4> <U1, Ux, Uz, U2, U3, U4> Pattern1: {U1, U2, U3, U4} <U1, Uy, U2, U3, Ux, U4, Uz> <U1, Uy, U2, Ux, U3, Uz, U4> <U1, Ux, Uz, U2, U3, U4> Pattern2: {U1, Ux, U4} <U1, Uy, U2, U3, Ux, U4, Uz> <U1, Uy, U2, Ux, U3, Uz, U4> <U1, Ux, Uz, U2, U3, U4> Pattern3: {U1, Uy, U2, U3, U4} One UI can only belong to one routine! 10
- 13. Routines identification <U1, Uy, U2, U3, Ux, U4, Uz> <U1, Uy, U2, Ux, U3, Uz, U4> <U1, Ux, Uz, U2, U3, U4> Solution: Discover frequent patterns as usual Rank them accordingly to a certain metric (e.g., length, frequency, coverage) Select the best pattern and remove its occurrences from the segments Repeat the procedure until no more frequent patterns left 11
- 14. Routines identification <Uy, Ux, Uz> <Uy, Ux, Uz> <Ux, Uz> <U1, Uy, U2, U3, Ux, U4, Uz> <U1, Uy, U2, Ux, U3, Uz, U4> <U1, Ux, Uz, U2, U3, U4> Pattern1: {U1, U2, U3, U4} Solution: Discover frequent patterns as usual Rank them accordingly to a certain metric (e.g., length, frequency, coverage) Select the best pattern and remove its occurrences from the segments Repeat the procedure until no more frequent patterns left 11
- 15. Routines identification <Uy> <Uy> <> <Uy, Ux, Uz> <Uy, Ux, Uz> <Ux, Uz> <U1, Uy, U2, U3, Ux, U4, Uz> <U1, Uy, U2, Ux, U3, Uz, U4> <U1, Ux, Uz, U2, U3, U4> Pattern1: {U1, U2, U3, U4} Pattern2: {Ux, Uz} Solution: Discover frequent patterns as usual Rank them accordingly to a certain metric (e.g., length, frequency, coverage) Select the best pattern and remove its occurrences from the segments Repeat the procedure until no more frequent patterns left 11
- 16. Datasets 13 Synthetic logs 1 Supervised recording 2 Unsupervised recording 1 A. Bosco, A. Augusto, M. Dumas, M. La Rosa, and G. Fortino, “Discovering automatable routines from user interaction logs,” in BPM Forum. Springer, 2019. 2 We created four more logs by combining SR and RT
- 18. Results: rediscovery 15 7.71 17.66 11.5 17.67 0 2 4 6 8 10 12 14 16 18 20 Routine length 0.89 0.93 0.91 0.93 0.87 0.88 0.89 0.9 0.91 0.92 0.93 0.94 Total coverage 0.468 0.957 0.644 0.958 0 0.2 0.4 0.6 0.8 1 1.2 Jaccard coefficient 7.571 7.791 6.252 11.057 0 2 4 6 8 10 12 Execution time (sec)
- 19. Real-life logs 16 Scholarship allocation process Different workers 93 min of work 53 cases handled 1202 actions recorded
- 20. Results: real-life logs Scholarships 1: Scholarships 2: Segments: 35 Routines: 2 Routine variants: 5 Execution time: 41.686 sec The second log describes more complex and unstructured behavior Segments: 3 Routines: 0 Routine variants: 0 Execution time: 426.319 sec 17
- 21. Limitations and future work 18 The approach relies on data quality of the log Requires expert knowledge to identify context parameters Several variants of the same routine may be discovered (e.g., actions are in different order) Routines recorded in the log should not overlap All routine executions should start from the same action Limitations Devise a technique to automatically identify context parameters Improve the approach to ease requirements to recorded routines Add post-processing to remove redundant variants of routine Future work
Editor's Notes
- No “process” automation but “task” automation Not “physical” robots but “software” robots
- No “process” automation but “task” automation Not “physical” robots but “software” robots
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
- V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019 Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc. In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet