SlideShare a Scribd company logo
1 of 8
Download to read offline
6/8/2013
XRec – Extended
Reconciliation
using Excel VBA
White Paper
Senthil Murugan Sundaresan
IT Consultant – BI, SQL, Python, VBA
XRec – Extended Reconciliation using Excel VBA
ABSTRACT
This paper describes the use of an Excel Application
which was developed during the Testing phase of the project
[Mainframe Information Delivery Management System – It’s a
Reverse engineering project where in we have to migrate the
existing FEEDS from Mainframes to Open Systems (ETL)]. We
have developed two applications; each will have its own
Advantages and uniqueness in terms of generating output. This
document describes one of the applications. The Name of the
Application is ComparX-R. Prior to the development of this
application we had to compare the Mainframe Feed data with
ETL Generated Feed data manually. This was time consuming
in terms of judging the accuracy of the output data. With the use
of this application we were able to present the comparison,
mismatched, statistics reports to our client successfully. This
application is used to automate the comparison process [of Data
from Legacy systems and Data generated by Open systems -
ETL]. It’s created with the help of Excel and VBA codes and
was very much handy at the time of Testing, Implementation. It
can be used for MIS related presentations too.
TARGET AUDIENCE
End Users, Testers, ETL/Report Developers, Data Migration
Developers, and Managers
1. INTRODUCTION
ComparX – R [Compare eXcel Row wise] is a
Comparison Tool which is primarily helpful for you when
you have to comparing huge data. Normally in Day to day
activities Excel is very much a part of our both Official work
and personal work.
Here we can put the data in source sheets and execute the
options available in Menu to perform any operation on the
data. This tool will generate 10 Reports which can be for
used for analysis further.
Process:
It takes the first row from ETL source data and
compares it with first row of Mainframes source data. Both
Mainframes and ETL data should be sorted in the same order
based on same number of columns. If Mainframe has one
record in row number 2 then ETL also should have the same
row in the same row number. [You may or may not have
mismatched columns in that rows] But Key [Columns used
for sorting] should be synchronized between Mainframe
system and ETL.
2. CHALLENGES
 Display the data in readable format so that the same is handy
at the time of presentation to the users
 Understand the requirement and choose the optimum logic
 Generate the various reports in quick succession
 Make it as user friendly
 Optimize the Report Running time
3. REQUIRED COMPONENTS
The following table lists these identified Components.
Table 1: Components
S. No Component Name Type
1. MS EXCEL Application
2. Windows XP or
higher
OS
4. CONTENTS
Comprises of Sheets like Navigation, Steps, Sample
Data, Colors List, Mainframe, ETL, and Compare Data. Each
sheet has its own options and descriptions. Compare Data is a
Main menu option where we can generate reports, Format the
reports, and Export the reports in various formats like TXT,
HTML and CSV.
5. FEATURES
 Statistics - This will be useful for analysis and
presentation.
 Gives Report Generation Time, Reports Count
 We can Load External Files.
 Formatting the reports for presentation
 Converting the Excel Data into HTML, CSV, Delimited
TXT file formats
 Row and Column count - To decide whether to go for
the result set or not.
 Colors list generation to see what colors can be used for
the report formatting.
 Loading external delimited data files, loading the
sample data for testing.
 Save Sources and Reports alone in a new file.
 Exported reports will be saved in the same folder of
application.
 Deletion of Reports, Navigation to all reports
6. REPORTS
Compared Report:
Gives the comparison of two sheets with format.
Layout attached in Appendix A.
Compared > 2000 Rows Report:
Gives the comparison of two sheets without format.
Layout attached in Appendix A.
[This is for Greater than 2000 Rows].
Matched Report:
Gives the comparison of two sheets, but only
the MATCHED Records with format.
Layout attached in Appendix A.
Matched > 2000 Rows Report:
Gives the comparison of two sheets, but only
the MATCHED Records without format.
Layout attached in Appendix A.
[This is for Greater than 2000 Rows]
MisMatched Report:
Gives the comparison of two sheets, but only
the MISMATCHED Records with format.
Layout attached in Appendix A.
MisMatched > 2000 Rows Report:
Gives the comparison of two sheets, but only the
MISMATCHED Records without format.
Layout attached in Appendix A.
[This is for Greater than 2000 Rows]
Mismatched_Cols Report:
Gives the MISMATCHES between two sheets,
but only the MISMATCHED Columns with format.
Layout attached in Appendix A.
Mismatched_Cols > 2000:
Gives the MISMATCHES between two sheets,
but only the Rows Report MISMATCHED
Columns without format.
Layout attached in Appendix A.
[This is for Greater than 2000 Rows]
Stats Report:
Gives the STATISTICS of two sheets like
Total Rows and Columns, Matched/Mismatched
Rows and columns. MisMatched Column names
and Column Number etc. You can find the layout
in Appendix A.
Stats > 2000 Rows Report:
Gives the STATISTICS of two sheets like
Total Rows and Columns, Matched/ Mismatched
Rows and columns. MisMatched Column names
and Column Number etc. You can find the layout
in Appendix A. [This is for Greater than 2000 Rows]
7. REPORT LAYOUTS
Compared Report and Compared > 2000 Rows Report:
[MF] <Mainframe data> = <ETL data> [ETL] if both data
are equal - This will be displayed in Single cell.
[MF] <Mainframe data> <> <ETL data> [ETL] {Row #: |
Column :} if both data are NOT equal - This will be
displayed in single cell.
Status Column will have value as MATCHED if both data
are matched, MISMATCHED if both data are not matched.
Status Rows:
1st Row:
No. of Rows in mainframe = No. of Rows in ETL.
Row count matched or not matched.
Completely matched Records.
2nd Row: No. of Mismatched Records
Report Generation time.
3rd Row:
Link to Top Row of the Report, to Compare
Data Menu, to Steps Sheet.
Compared Report generates with format
Compared > 2000 Rows Report generates
without format
Refer Appendix A
Matched Report and Matched > 2000 Rows Report:
[MF] <Mainframe data> = <ETL data> [ETL] if both data
are equal - This will be displayed in single cell.
Status Column will only have values MATCHED if both
data are matched.
Status Rows:
1st Row:
No. of Rows in mainframe = No. of Rows in ETL.
Completely matched Records.
2nd Row: No. of Matched Records
Report Generation time.
3rd Row:
Link to Top Row of the Report, to Compare
Data Menu, to Steps Sheet.
Matched Report generates with format
Matched > 2000 Rows Report generates
without format
Refer Appendix A
MisMatched Report and MisMatched > 2000 Rows
Report:
[MF] <Mainframe data> <> <ETL data> [ETL] if both data
are equal - This will be displayed in single cell.
[MF] <Mainframe data> = <ETL data> [ETL] if both data
are equal - This will be displayed in Single cell.
Status Column will only have value as MISMATCHED if
both data are NOT matched.
Status Rows:
1st Row:
No. of Rows in mainframe = No. of Rows in ETL.
MISMATCHED Records Count.
2nd Row: No. of MisMatched Records
Report Generation time.
3rd Row:
Link to Top Row of the Report, to Compare
Data Menu, to Steps Sheet.
MisMatched Report generates with format
MisMatched > 2000 Rows Report generates
without format
Refer Appendix A
Mismatched_Cols Report and Mismatched_Cols > 2000
Rows Report:
[MF] <Mainframe data> <> <ETL data> [ETL] if both data
are equal - This will be displayed in single cell.
[MF] <Mainframe data> = <ETL data> [ETL] if both data
are equal - This will be displayed in single cell.
If Entire Column has matching value that column will be
deleted.
Status Column will only have values MISMATCHED if both
data are NOT matched.
Status Rows:
1st Row:
No. of Rows in mainframe = No. of Rows in ETL.
MISMATCHED Records Count.
2nd Row: No. of MisMatched Records
Report Generation time.
3rd Row:
Link to Top Row of the Report, to Compare
Data Menu, to Steps Sheet.
MisMatched Report generates with format
MisMatched > 2000 Rows Report
generates without format
Refer Appendix A
Stats Report and Stats > 2000 Rows Report:
Table 1
Mismatched Column's Number
Mismatched Column's Name
Mismatched Records for Each column
Total Mismatched Values <Sum>
Table 2
<Count of Records for each category >
<Percentage of Records for each category>
Total Rows
Total Columns
Mismatched Rows
Mismatched columns of Mismatched Rows
Matched columns of Mismatched Rows
Matched Rows
Matched columns
Link to Compare Data Menu, Link to MisMatched Report,
Link to Compared Report
Refer Appendix A
8. LIMITAIONS
 Can process 255 columns as excel column limit per
sheet is 255 plus one status column.
 Can process 65533 rows as excel sheet limit is 65536
rows and status will take 3 rows.
 Row Count should be equal in both sources to get the
desired result.
 Source files should be sorted properly.
 This is really helpful for Sequential Comparison and
gives accurate result.
 Not as fast as than UNIX or other scripts, as it has to
compare each cell of one sheet against each cell in other
sheet in a sequential manner
 But Comparison wise it gives Accurate results with a
good look and feel.
 Rejected records will not be saved in separate file.
Even if there are columns with no values when comparing
columns, it displays the status as Mismatched only.
9. SUMMARY
It can be used as a Standard and Standalone Reporting
Tool. Various complex Reporting features like Statistics, Matched
and Mismatched, Export Options, etc. can be clubbed using the
integrated solution which ComparX Offers.
The solution is ideal for users who:
 Want a single Reporting solution that incorporates all of their
Comparison and Presentation Requirements.
 Need to compare Mainframe and ETL data
 Want to see Comparison report
 Need to reconcile data across systems to gain a complete
view of customers.
 Want to Export generated reports in HTML formats
 Want to supplement Comparison reporting with a full breadth
of other options like Matched vs. Mismatched, Statistics reports
etc.
 Wants to load external text files into excel for comparison.
 Wants to format the reports.
Appendix A
Compared Report
Matched Report
Mismatched Report
Mismatched_Cols report
Stats Report

More Related Content

What's hot

Application of excel and spss programme in statistical
Application of excel and spss programme in statisticalApplication of excel and spss programme in statistical
Application of excel and spss programme in statisticalVeenaV29
 
Sap abap-data structures and internal tables
Sap abap-data structures and internal tablesSap abap-data structures and internal tables
Sap abap-data structures and internal tablesMustafa Nadim
 
Creation of spreadsheets
Creation of spreadsheetsCreation of spreadsheets
Creation of spreadsheetsNITISH SADOTRA
 
CCPRO 2016 Power Presentation
CCPRO 2016 Power PresentationCCPRO 2016 Power Presentation
CCPRO 2016 Power PresentationDavid Onder
 
Internal tables
Internal tablesInternal tables
Internal tableswaseem27
 
Excel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for MerchandisersExcel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for Merchandiserswebhostingguy
 
Internal tables
Internal tables Internal tables
Internal tables Jibu Jose
 
Introduction to spreadsheets
Introduction to spreadsheetsIntroduction to spreadsheets
Introduction to spreadsheetsCasey Robertson
 
Reports Dashboards SQL Demo
Reports Dashboards SQL DemoReports Dashboards SQL Demo
Reports Dashboards SQL DemoHong-Bing Li
 
RDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion Process
RDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion ProcessRDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion Process
RDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion ProcessASIS&T
 
Power ups non standard column names
Power ups non standard column namesPower ups non standard column names
Power ups non standard column namesJohann Krugell
 

What's hot (16)

Application of excel and spss programme in statistical
Application of excel and spss programme in statisticalApplication of excel and spss programme in statistical
Application of excel and spss programme in statistical
 
Sap abap-data structures and internal tables
Sap abap-data structures and internal tablesSap abap-data structures and internal tables
Sap abap-data structures and internal tables
 
Creation of spreadsheets
Creation of spreadsheetsCreation of spreadsheets
Creation of spreadsheets
 
CCPRO 2016 Power Presentation
CCPRO 2016 Power PresentationCCPRO 2016 Power Presentation
CCPRO 2016 Power Presentation
 
Internal tables
Internal tablesInternal tables
Internal tables
 
'Spreadsheet'
'Spreadsheet''Spreadsheet'
'Spreadsheet'
 
Excel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for MerchandisersExcel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for Merchandisers
 
05 internal tables
05 internal tables05 internal tables
05 internal tables
 
Internal tables
Internal tables Internal tables
Internal tables
 
Spreadsheet Concepts
Spreadsheet ConceptsSpreadsheet Concepts
Spreadsheet Concepts
 
Introduction to spreadsheets
Introduction to spreadsheetsIntroduction to spreadsheets
Introduction to spreadsheets
 
Reports Dashboards SQL Demo
Reports Dashboards SQL DemoReports Dashboards SQL Demo
Reports Dashboards SQL Demo
 
Spreadsheet
SpreadsheetSpreadsheet
Spreadsheet
 
Chapter 4
Chapter 4Chapter 4
Chapter 4
 
RDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion Process
RDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion ProcessRDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion Process
RDAP 15 Excel Archival Tool: Automating the Spreadsheet Conversion Process
 
Power ups non standard column names
Power ups non standard column namesPower ups non standard column names
Power ups non standard column names
 

Similar to X rec extened reconciliation using excel vba

C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003Hong-Bing Li
 
Ssis Ssas Ssrs Sp Pps Hong Bing Li
Ssis Ssas Ssrs Sp Pps Hong Bing LiSsis Ssas Ssrs Sp Pps Hong Bing Li
Ssis Ssas Ssrs Sp Pps Hong Bing LiHong-Bing Li
 
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing LiSSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing LiHong-Bing Li
 
4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf
4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf
4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdfNitish Nagar
 
SSIS_SSAS_SSRS_SP_PPS_HongBingLi
SSIS_SSAS_SSRS_SP_PPS_HongBingLiSSIS_SSAS_SSRS_SP_PPS_HongBingLi
SSIS_SSAS_SSRS_SP_PPS_HongBingLiHong-Bing Li
 
ReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliHong-Bing Li
 
Reports Dashboards ETL SQL_HBLI
Reports Dashboards ETL SQL_HBLIReports Dashboards ETL SQL_HBLI
Reports Dashboards ETL SQL_HBLIHong-Bing Li
 
ReportsDashboardsSQLDemoHBLI
ReportsDashboardsSQLDemoHBLIReportsDashboardsSQLDemoHBLI
ReportsDashboardsSQLDemoHBLIHong-Bing Li
 
Reports Dashboards SQL SSIS Demo
Reports Dashboards SQL SSIS DemoReports Dashboards SQL SSIS Demo
Reports Dashboards SQL SSIS DemoHong-Bing Li
 
ReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliHong-Bing Li
 
Ssis sql ssrs_sp_ssas_mdx_hb_li
Ssis sql ssrs_sp_ssas_mdx_hb_liSsis sql ssrs_sp_ssas_mdx_hb_li
Ssis sql ssrs_sp_ssas_mdx_hb_liHong-Bing Li
 
Automating Test File Creation
Automating Test File CreationAutomating Test File Creation
Automating Test File Creationbdebruin
 
Itm310 problem solving #7 complete solutions correct answers key
Itm310 problem solving #7 complete solutions correct answers keyItm310 problem solving #7 complete solutions correct answers key
Itm310 problem solving #7 complete solutions correct answers keySong Love
 
Chapter 29Foundations of Family CareFamily DefinedT.docx
Chapter 29Foundations of Family CareFamily DefinedT.docxChapter 29Foundations of Family CareFamily DefinedT.docx
Chapter 29Foundations of Family CareFamily DefinedT.docxcravennichole326
 

Similar to X rec extened reconciliation using excel vba (20)

C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
 
Ssis Ssas Ssrs Sp Pps Hong Bing Li
Ssis Ssas Ssrs Sp Pps Hong Bing LiSsis Ssas Ssrs Sp Pps Hong Bing Li
Ssis Ssas Ssrs Sp Pps Hong Bing Li
 
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing LiSSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
 
4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf
4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf
4b6c1c5c-e913-4bbf-b3a4-41e23cb961ba-161004200047.pdf
 
Advanced Excel ppt
Advanced Excel pptAdvanced Excel ppt
Advanced Excel ppt
 
SSIS_SSAS_SSRS_SP_PPS_HongBingLi
SSIS_SSAS_SSRS_SP_PPS_HongBingLiSSIS_SSAS_SSRS_SP_PPS_HongBingLi
SSIS_SSAS_SSRS_SP_PPS_HongBingLi
 
Chapter.07
Chapter.07Chapter.07
Chapter.07
 
ReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliReportsDashboardsSql_hbli
ReportsDashboardsSql_hbli
 
Reports Dashboards ETL SQL_HBLI
Reports Dashboards ETL SQL_HBLIReports Dashboards ETL SQL_HBLI
Reports Dashboards ETL SQL_HBLI
 
ReportsDashboardsSQLDemoHBLI
ReportsDashboardsSQLDemoHBLIReportsDashboardsSQLDemoHBLI
ReportsDashboardsSQLDemoHBLI
 
Reports Dashboards SQL SSIS Demo
Reports Dashboards SQL SSIS DemoReports Dashboards SQL SSIS Demo
Reports Dashboards SQL SSIS Demo
 
ReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliReportsDashboardsSql_hbli
ReportsDashboardsSql_hbli
 
ITB - UNIT 4.pdf
ITB - UNIT 4.pdfITB - UNIT 4.pdf
ITB - UNIT 4.pdf
 
Ssis sql ssrs_sp_ssas_mdx_hb_li
Ssis sql ssrs_sp_ssas_mdx_hb_liSsis sql ssrs_sp_ssas_mdx_hb_li
Ssis sql ssrs_sp_ssas_mdx_hb_li
 
BIWorkDemos
BIWorkDemosBIWorkDemos
BIWorkDemos
 
Fg d
Fg dFg d
Fg d
 
Automating Test File Creation
Automating Test File CreationAutomating Test File Creation
Automating Test File Creation
 
Oracle report from ppt
Oracle report from pptOracle report from ppt
Oracle report from ppt
 
Itm310 problem solving #7 complete solutions correct answers key
Itm310 problem solving #7 complete solutions correct answers keyItm310 problem solving #7 complete solutions correct answers key
Itm310 problem solving #7 complete solutions correct answers key
 
Chapter 29Foundations of Family CareFamily DefinedT.docx
Chapter 29Foundations of Family CareFamily DefinedT.docxChapter 29Foundations of Family CareFamily DefinedT.docx
Chapter 29Foundations of Family CareFamily DefinedT.docx
 

Recently uploaded

VK Business Profile - provides IT solutions and Web Development
VK Business Profile - provides IT solutions and Web DevelopmentVK Business Profile - provides IT solutions and Web Development
VK Business Profile - provides IT solutions and Web Developmentvyaparkranti
 
Precise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalPrecise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalLionel Briand
 
PREDICTING RIVER WATER QUALITY ppt presentation
PREDICTING  RIVER  WATER QUALITY  ppt presentationPREDICTING  RIVER  WATER QUALITY  ppt presentation
PREDICTING RIVER WATER QUALITY ppt presentationvaddepallysandeep122
 
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Andreas Granig
 
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanySuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanyChristoph Pohl
 
MYjobs Presentation Django-based project
MYjobs Presentation Django-based projectMYjobs Presentation Django-based project
MYjobs Presentation Django-based projectAnoyGreter
 
CRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceCRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceBrainSell Technologies
 
Simplifying Microservices & Apps - The art of effortless development - Meetup...
Simplifying Microservices & Apps - The art of effortless development - Meetup...Simplifying Microservices & Apps - The art of effortless development - Meetup...
Simplifying Microservices & Apps - The art of effortless development - Meetup...Rob Geurden
 
Ahmed Motair CV April 2024 (Senior SW Developer)
Ahmed Motair CV April 2024 (Senior SW Developer)Ahmed Motair CV April 2024 (Senior SW Developer)
Ahmed Motair CV April 2024 (Senior SW Developer)Ahmed Mater
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsAhmed Mohamed
 
Post Quantum Cryptography – The Impact on Identity
Post Quantum Cryptography – The Impact on IdentityPost Quantum Cryptography – The Impact on Identity
Post Quantum Cryptography – The Impact on Identityteam-WIBU
 
Recruitment Management Software Benefits (Infographic)
Recruitment Management Software Benefits (Infographic)Recruitment Management Software Benefits (Infographic)
Recruitment Management Software Benefits (Infographic)Hr365.us smith
 
A healthy diet for your Java application Devoxx France.pdf
A healthy diet for your Java application Devoxx France.pdfA healthy diet for your Java application Devoxx France.pdf
A healthy diet for your Java application Devoxx France.pdfMarharyta Nedzelska
 
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...Matt Ray
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfAlina Yurenko
 
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...Natan Silnitsky
 
SpotFlow: Tracking Method Calls and States at Runtime
SpotFlow: Tracking Method Calls and States at RuntimeSpotFlow: Tracking Method Calls and States at Runtime
SpotFlow: Tracking Method Calls and States at Runtimeandrehoraa
 
React Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaReact Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaHanief Utama
 
How To Manage Restaurant Staff -BTRESTRO
How To Manage Restaurant Staff -BTRESTROHow To Manage Restaurant Staff -BTRESTRO
How To Manage Restaurant Staff -BTRESTROmotivationalword821
 
Cyber security and its impact on E commerce
Cyber security and its impact on E commerceCyber security and its impact on E commerce
Cyber security and its impact on E commercemanigoyal112
 

Recently uploaded (20)

VK Business Profile - provides IT solutions and Web Development
VK Business Profile - provides IT solutions and Web DevelopmentVK Business Profile - provides IT solutions and Web Development
VK Business Profile - provides IT solutions and Web Development
 
Precise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalPrecise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive Goal
 
PREDICTING RIVER WATER QUALITY ppt presentation
PREDICTING  RIVER  WATER QUALITY  ppt presentationPREDICTING  RIVER  WATER QUALITY  ppt presentation
PREDICTING RIVER WATER QUALITY ppt presentation
 
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024
 
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanySuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
 
MYjobs Presentation Django-based project
MYjobs Presentation Django-based projectMYjobs Presentation Django-based project
MYjobs Presentation Django-based project
 
CRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceCRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. Salesforce
 
Simplifying Microservices & Apps - The art of effortless development - Meetup...
Simplifying Microservices & Apps - The art of effortless development - Meetup...Simplifying Microservices & Apps - The art of effortless development - Meetup...
Simplifying Microservices & Apps - The art of effortless development - Meetup...
 
Ahmed Motair CV April 2024 (Senior SW Developer)
Ahmed Motair CV April 2024 (Senior SW Developer)Ahmed Motair CV April 2024 (Senior SW Developer)
Ahmed Motair CV April 2024 (Senior SW Developer)
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML Diagrams
 
Post Quantum Cryptography – The Impact on Identity
Post Quantum Cryptography – The Impact on IdentityPost Quantum Cryptography – The Impact on Identity
Post Quantum Cryptography – The Impact on Identity
 
Recruitment Management Software Benefits (Infographic)
Recruitment Management Software Benefits (Infographic)Recruitment Management Software Benefits (Infographic)
Recruitment Management Software Benefits (Infographic)
 
A healthy diet for your Java application Devoxx France.pdf
A healthy diet for your Java application Devoxx France.pdfA healthy diet for your Java application Devoxx France.pdf
A healthy diet for your Java application Devoxx France.pdf
 
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
 
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...
 
SpotFlow: Tracking Method Calls and States at Runtime
SpotFlow: Tracking Method Calls and States at RuntimeSpotFlow: Tracking Method Calls and States at Runtime
SpotFlow: Tracking Method Calls and States at Runtime
 
React Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaReact Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief Utama
 
How To Manage Restaurant Staff -BTRESTRO
How To Manage Restaurant Staff -BTRESTROHow To Manage Restaurant Staff -BTRESTRO
How To Manage Restaurant Staff -BTRESTRO
 
Cyber security and its impact on E commerce
Cyber security and its impact on E commerceCyber security and its impact on E commerce
Cyber security and its impact on E commerce
 

X rec extened reconciliation using excel vba

  • 1. 6/8/2013 XRec – Extended Reconciliation using Excel VBA White Paper Senthil Murugan Sundaresan IT Consultant – BI, SQL, Python, VBA
  • 2. XRec – Extended Reconciliation using Excel VBA ABSTRACT This paper describes the use of an Excel Application which was developed during the Testing phase of the project [Mainframe Information Delivery Management System – It’s a Reverse engineering project where in we have to migrate the existing FEEDS from Mainframes to Open Systems (ETL)]. We have developed two applications; each will have its own Advantages and uniqueness in terms of generating output. This document describes one of the applications. The Name of the Application is ComparX-R. Prior to the development of this application we had to compare the Mainframe Feed data with ETL Generated Feed data manually. This was time consuming in terms of judging the accuracy of the output data. With the use of this application we were able to present the comparison, mismatched, statistics reports to our client successfully. This application is used to automate the comparison process [of Data from Legacy systems and Data generated by Open systems - ETL]. It’s created with the help of Excel and VBA codes and was very much handy at the time of Testing, Implementation. It can be used for MIS related presentations too. TARGET AUDIENCE End Users, Testers, ETL/Report Developers, Data Migration Developers, and Managers 1. INTRODUCTION ComparX – R [Compare eXcel Row wise] is a Comparison Tool which is primarily helpful for you when you have to comparing huge data. Normally in Day to day activities Excel is very much a part of our both Official work and personal work. Here we can put the data in source sheets and execute the options available in Menu to perform any operation on the data. This tool will generate 10 Reports which can be for used for analysis further. Process: It takes the first row from ETL source data and compares it with first row of Mainframes source data. Both Mainframes and ETL data should be sorted in the same order based on same number of columns. If Mainframe has one record in row number 2 then ETL also should have the same row in the same row number. [You may or may not have mismatched columns in that rows] But Key [Columns used for sorting] should be synchronized between Mainframe system and ETL. 2. CHALLENGES  Display the data in readable format so that the same is handy at the time of presentation to the users  Understand the requirement and choose the optimum logic  Generate the various reports in quick succession  Make it as user friendly  Optimize the Report Running time 3. REQUIRED COMPONENTS The following table lists these identified Components. Table 1: Components S. No Component Name Type 1. MS EXCEL Application 2. Windows XP or higher OS 4. CONTENTS Comprises of Sheets like Navigation, Steps, Sample Data, Colors List, Mainframe, ETL, and Compare Data. Each sheet has its own options and descriptions. Compare Data is a Main menu option where we can generate reports, Format the reports, and Export the reports in various formats like TXT, HTML and CSV.
  • 3. 5. FEATURES  Statistics - This will be useful for analysis and presentation.  Gives Report Generation Time, Reports Count  We can Load External Files.  Formatting the reports for presentation  Converting the Excel Data into HTML, CSV, Delimited TXT file formats  Row and Column count - To decide whether to go for the result set or not.  Colors list generation to see what colors can be used for the report formatting.  Loading external delimited data files, loading the sample data for testing.  Save Sources and Reports alone in a new file.  Exported reports will be saved in the same folder of application.  Deletion of Reports, Navigation to all reports 6. REPORTS Compared Report: Gives the comparison of two sheets with format. Layout attached in Appendix A. Compared > 2000 Rows Report: Gives the comparison of two sheets without format. Layout attached in Appendix A. [This is for Greater than 2000 Rows]. Matched Report: Gives the comparison of two sheets, but only the MATCHED Records with format. Layout attached in Appendix A. Matched > 2000 Rows Report: Gives the comparison of two sheets, but only the MATCHED Records without format. Layout attached in Appendix A. [This is for Greater than 2000 Rows] MisMatched Report: Gives the comparison of two sheets, but only the MISMATCHED Records with format. Layout attached in Appendix A. MisMatched > 2000 Rows Report: Gives the comparison of two sheets, but only the MISMATCHED Records without format. Layout attached in Appendix A. [This is for Greater than 2000 Rows] Mismatched_Cols Report: Gives the MISMATCHES between two sheets, but only the MISMATCHED Columns with format. Layout attached in Appendix A. Mismatched_Cols > 2000: Gives the MISMATCHES between two sheets, but only the Rows Report MISMATCHED Columns without format. Layout attached in Appendix A. [This is for Greater than 2000 Rows] Stats Report: Gives the STATISTICS of two sheets like Total Rows and Columns, Matched/Mismatched Rows and columns. MisMatched Column names and Column Number etc. You can find the layout in Appendix A. Stats > 2000 Rows Report: Gives the STATISTICS of two sheets like Total Rows and Columns, Matched/ Mismatched Rows and columns. MisMatched Column names and Column Number etc. You can find the layout in Appendix A. [This is for Greater than 2000 Rows] 7. REPORT LAYOUTS Compared Report and Compared > 2000 Rows Report: [MF] <Mainframe data> = <ETL data> [ETL] if both data are equal - This will be displayed in Single cell. [MF] <Mainframe data> <> <ETL data> [ETL] {Row #: | Column :} if both data are NOT equal - This will be displayed in single cell. Status Column will have value as MATCHED if both data are matched, MISMATCHED if both data are not matched. Status Rows: 1st Row: No. of Rows in mainframe = No. of Rows in ETL. Row count matched or not matched. Completely matched Records. 2nd Row: No. of Mismatched Records
  • 4. Report Generation time. 3rd Row: Link to Top Row of the Report, to Compare Data Menu, to Steps Sheet. Compared Report generates with format Compared > 2000 Rows Report generates without format Refer Appendix A Matched Report and Matched > 2000 Rows Report: [MF] <Mainframe data> = <ETL data> [ETL] if both data are equal - This will be displayed in single cell. Status Column will only have values MATCHED if both data are matched. Status Rows: 1st Row: No. of Rows in mainframe = No. of Rows in ETL. Completely matched Records. 2nd Row: No. of Matched Records Report Generation time. 3rd Row: Link to Top Row of the Report, to Compare Data Menu, to Steps Sheet. Matched Report generates with format Matched > 2000 Rows Report generates without format Refer Appendix A MisMatched Report and MisMatched > 2000 Rows Report: [MF] <Mainframe data> <> <ETL data> [ETL] if both data are equal - This will be displayed in single cell. [MF] <Mainframe data> = <ETL data> [ETL] if both data are equal - This will be displayed in Single cell. Status Column will only have value as MISMATCHED if both data are NOT matched. Status Rows: 1st Row: No. of Rows in mainframe = No. of Rows in ETL. MISMATCHED Records Count. 2nd Row: No. of MisMatched Records Report Generation time. 3rd Row: Link to Top Row of the Report, to Compare Data Menu, to Steps Sheet. MisMatched Report generates with format MisMatched > 2000 Rows Report generates without format Refer Appendix A Mismatched_Cols Report and Mismatched_Cols > 2000 Rows Report: [MF] <Mainframe data> <> <ETL data> [ETL] if both data are equal - This will be displayed in single cell. [MF] <Mainframe data> = <ETL data> [ETL] if both data are equal - This will be displayed in single cell. If Entire Column has matching value that column will be deleted. Status Column will only have values MISMATCHED if both data are NOT matched. Status Rows: 1st Row: No. of Rows in mainframe = No. of Rows in ETL. MISMATCHED Records Count. 2nd Row: No. of MisMatched Records Report Generation time. 3rd Row: Link to Top Row of the Report, to Compare Data Menu, to Steps Sheet. MisMatched Report generates with format MisMatched > 2000 Rows Report generates without format Refer Appendix A Stats Report and Stats > 2000 Rows Report: Table 1 Mismatched Column's Number Mismatched Column's Name Mismatched Records for Each column Total Mismatched Values <Sum> Table 2 <Count of Records for each category > <Percentage of Records for each category>
  • 5. Total Rows Total Columns Mismatched Rows Mismatched columns of Mismatched Rows Matched columns of Mismatched Rows Matched Rows Matched columns Link to Compare Data Menu, Link to MisMatched Report, Link to Compared Report Refer Appendix A 8. LIMITAIONS  Can process 255 columns as excel column limit per sheet is 255 plus one status column.  Can process 65533 rows as excel sheet limit is 65536 rows and status will take 3 rows.  Row Count should be equal in both sources to get the desired result.  Source files should be sorted properly.  This is really helpful for Sequential Comparison and gives accurate result.  Not as fast as than UNIX or other scripts, as it has to compare each cell of one sheet against each cell in other sheet in a sequential manner  But Comparison wise it gives Accurate results with a good look and feel.  Rejected records will not be saved in separate file. Even if there are columns with no values when comparing columns, it displays the status as Mismatched only. 9. SUMMARY It can be used as a Standard and Standalone Reporting Tool. Various complex Reporting features like Statistics, Matched and Mismatched, Export Options, etc. can be clubbed using the integrated solution which ComparX Offers. The solution is ideal for users who:  Want a single Reporting solution that incorporates all of their Comparison and Presentation Requirements.  Need to compare Mainframe and ETL data  Want to see Comparison report  Need to reconcile data across systems to gain a complete view of customers.  Want to Export generated reports in HTML formats  Want to supplement Comparison reporting with a full breadth of other options like Matched vs. Mismatched, Statistics reports etc.  Wants to load external text files into excel for comparison.  Wants to format the reports.