To view recording of this webinar please use the below URL: http://wso2.com/library/webinars/2016/04/managed-file-transfer-with-wso2-enterprise-service-bus/ Managed file transfer (MFT) is a key element in an enterprise service bus (ESB) environment. For one of Yenlo’s clients the functionality of the WSO2 Virtual File System (VFS - part of the WSO2 ESB) was extended in order to make it faster and have more functionality. A highly scalable and available MFT solution was created by building an environment with Azure (as the cloud platform of choice), Suse Enterprise Linux (as the operating system) and WSO2 ESB (for enhanced functionality that is available to the WSO2 community). This allowed them to create an MFT environment from scratch in a matter of minutes rather than days. In this webinar we will explore how these changes, including skipping subdirectories and enhanced mediation while performing MFT, were made.

1. Managed File Transfer: backbone
of your opera7ons
Chinmaya Tripathy, Integra1on Consultant, Yenlo
Rob Blaauboer, Integra1on Consultant Yenlo
Senduran Balasubramaniyam, So<ware Engineer WSO2
April 5th 2016

2. About the presenters
2
Chinmaya Tripathy
Senior Consultant, Yenlo
Chinmaya Tripathy is an Integra1on Consultant with WSO2 knowledge stack along with 9 years of
experiance in cross domain projects and technologies like Java, J2EE, WebServices, Spring, SOA
Architecture, JS, AJAX, DOJO, GWT. He has a Master degree in Computer Applica1on, followed by
gradua1on of science as Mathema1cs as special course.
Rob Blaauboer
Senior Consultant, Yenlo
Rob is a Senior Business Consultant and Solu1on Architect with more than twenty years experience. In
addi1on to his work he is an ac1ve blogger working on a number of ar1cles on the 'Internet of Things'
and a WSO2 'GeRng Started with ...' series in which he talks about WSO2 components and their purpose
especially aimed at non technical readers.
Senduran Balasubramaniyam
So:ware Engineer, WSO2
Senduran is a software Engineer at WSO2 and part of WSO2 Enterprise Service Bus engineering team.

3. 3
• Premier Partner of WSO2
• Global Organiza1on
• Offices in the Netherlands, Germany,
Belgium, United Kingdom and United
States
• Experts is Integra1on Solu1ons
• Experts in a ‘Connected Business’
• WSO2 project & consultancy services
• WSO2 support services:
• Product Support
• Development Support
• Opera1onal Support
• WSO2 Training services
• Enterprise & Solu1on Architecture
Who we are What we deliver
More info about us and our pre-build (WSO2) solu1ons: www.yenlo.com

4. Topics Webinar
4
Managed File Transfer = SGll one of the backbone’s of many operaGons
• Introduc1on to ‘File Transfer’ in general
• File transfer in WSO2 ESB (Transports)
• What about Managed File Transfer?
• Benefits of our MFT solu1on based on WSO2
• Demonstra1on & Technical details
• You have ques1ons? We have answers!

5. The longevity of File Transfer

6. For many organiza1ons file transfer is s1ll
part of their daily opera1ons, for
example:
o Transfer files between systems
o Interact with business partners
o Managing Laws (publishing)
o Tax returns to consumers
File transfer is here to stay….
6

7. o Files can be really big, up to several GB, and really
small, some kilobytes, for example
Big files and small files
7

8. o Files can be PDF, XML, Plain text, and-so-on
o Files can be encrypted or even need to be encrypted
XML, PDF, DOC, DOCX …
All kind of files
8

9. o A<er uploading you might need to send the uploader a receipt
o Calcula1ng a hash might be necessary for audit purposes
ab34e562acd
Receipt
We have received…
Files may need receipt or hash
9

10. o Check for malicious content, is there any unwanted
payload?
Receipt
Warning! We have received…
Malicious content
10

11. o Ac1ve/Passive or Ac1ve/Ac1ve setup
o Make it scalable
o Making sure one ESB picks up the file, not two or more
o Needs to be a dead leher channel (EIP)
Setup can be challenging
11

12. File transfer in WSO2 ESB
(Transports)

13. Transports in WSO2 ESB
For the complete list: hRps://docs.wso2.com/display/ESB490/ESB+Transports
o HTTP/S NIO Transport
o HTTP PassThrough Transport
o HTTP/S Servlet Transport
o JMS Transport
o VFS Transport
o FIX Transport
o and more...
13

14. VFS Transport
Supported Protocols
o Local File System
o FTP
o FTPS
o SFTP
o Windows Share (SMB)
14

15. File Transports in ESB
15
o VFS Transport
o File Inbound protocol
o File Connector
File Handling Components

16. VFS Transport
o File processing is done through Virtual File System (VFS)
transport.
o VFS Transport has two parts
o VFS Transport Listener
o VFS Transport Sender
o Enabling by Uncommen1ng the following entries in axis2.xml
<transportreceiver name="vfs"
class="org.apache.synapse.transport.vfs.VFSTransportListener"/>
<transportSender name="vfs"
class="org.apache.synapse.transport.vfs.VFSTransportSender"/>
16

17. o This is a much improved alterna1ve to VFS Transport
o Supports mul1-tenancy
o Supports coordina1on in clustered environment
File Inbound
File Connector
o Speed file copy
17

18. VFS use cases
18
HTTP to VFS

19. VFS use cases
19
VFS to HTTP

20. The Yenlo
Managed File Transfer
solu1on based on WSO2

21. o A robust MFT solu1on based on WSO2 ESB
o Many out-of-the-box features to address men1oned
challenges, and much more…
o Added high availability by adding 2 or more ESB nodes
So Yenlo created...
21

22. In almost all cases guaranteed delivery is a necessity. The
Yenlo Managed File Transfer offers:
o SLA’s
o Possible guaranteed delivery
o Delivery only once
o Receipt with or without hash
o Possibility to work with encrypted files
Guaranteed Delivery
22

23. For con1nuous opera1on a HA setup is necessary:
o HA in Ac1ve/Passive single setup
o HA in Ac1ve/Passive group setup (2+ groups)
A
P
A
P
High availability
23

24. Content and metadata control
Making content based rou1ng possible using simple rules
based on, for example:
o RegEX
o Metadata (1mestamp)
o Inclusion and exclusion criteria (size, type, extension)
o Encryp1on or the absence of encryp1on
o Virus scanning
24

25. Clustered setup
Managing mul1ple ESB’s and mul1ple drop directories
25

26. RegEx Sample
Example of Metadata based rou1ng
26

27. Transport variables (current version)
27

28. Future developments
o Encryp1on – Decryp1on
o Hash crea1on for audit purposes
o Malicous Payload scanning
o Receipt to sender / uploader
o Poten1al Valida1on of payload (internal)
28

29. Managed File Transfer
What are the benefits?

30. Benefits are clear
o High availability
o Mul1 tenant
o Monitoring & Tracing
o Guaranteed delivery
o MFT is a service; So no headaches for the end-user
30

31. Managed File Transfer
Demonstra1on & Technical stuff

32. Demo
o Running on local machine: two WSO2 ESB’s (4.9.0)
o Clustered (Hazelcast) with two workers
o 10000 (dummy) files
o 7 too big
o 13 corrupt
o 8000 XML files
o 2000 PDF files
o Es1mated 1me to finish: less then 120 seconds
32

33. Managed File Transfer
You have ques1ons?
We have answers!

34. Contact & Download
34
Interested in our Managed File Transfer soluGon?
Download this presenta1on:
hhps://www.yenlo.com/en/free-advice/webinars
Or
Contact us:
hhps://www.yenlo.com/en/contact

35. 35
THANK YOU
FOR
YOUR
ATTENTION