Ruby Meditation #1 February 23, 2013 Kyiv

1. Data transformation.
Using kettle transformation
■ Andriy Kyrylenko (Gera-IT)
How to manage import files from different vendors?
What are the common transformations?
How Kettle can help with managing different
transformations?

2. Import records standard feeds
NEWS
PRODUCTS
RSS feed
ATOM feed
???

3. Import products
Vendor1
Vendor2
Vendor3
Vendor4
Products1
Products3
Products4
Products2 Shop
productsShop

4. Import products: source and file types
FTP
HTTP/HTTPS
Local file
Service API
Source file
file
Records
XML file
Shop Products
DB

5. Import products: source and file types
Source type1
Source type2
Source type3
Service API
File format1
File format3
Records
File format2
Shop Products
DB

6. Import products:
several readers
Fieldset1
Fieldset2
FieldsetN
Service API
Converter1
ConverterN
ReaderS
Converter2
Shop Products
DB

7. Import products:
several ruby classes
Fieldset1
Fieldset2
FieldsetN
Service API
RubyClass1
RubyClassN
RubyClassS
RubyClass2
Shop Products
DB

8. Converting records:
simple cases
■ Filtering fields
■ Filtering records by field value
■ Cloning records
■ Splitting fields into several fields
■ Joining fields
■ Creating new fields
■ Merging two files

9. Import products:
several ruby classes
FileSet1
FileSet2
FileSetN
Service API
Kettle1
KettleN
KettleS
Kettle2
Shop Products
DB
http://kettle.pentaho.com

11. Pentaho Kettle Transformations
■ http://kettle.pentaho.com
■
■ Download data-integration packager
■ Run ”Spoon”
■ Enjoy