SlideShare una empresa de Scribd logo
1 de 11
Business Intelligence Portfolio Aaron Moffat aarongmoffat@yahoo.com 704.614.0471
SQL Server 2005 Integration Services Project     	Project Summary	 	Build and Design a SQL Server 2005 database for Allworks Construction Company . Excel Spreadsheets and CSV files provided data for employee and customer information . 	Project Overview   	Create DTS packages to read each source file (Extraction), made conversions or (Transformation), and load them into the designated tables within AllWorks SQL Database (Loading).  Emails were generated for the results of each package. Nightly schedules  were create to midnight processing for all updates and new records. Create separate package to handle indexing and file truncation. Schedule the packages to run nightly at midnight to update the database with any new or changed data. Create a separate package to handle nightly database backups.
Division Master Table  This package loads the division data from an Excel Spreadsheet, ClientGeographies.xls. Data cleansing takes place to verify that the data is in a useable format. Divisions can be added or updated to the division table. Database integrity is upheld through referencing the division identification number with the data provided from the source data file.  A log is created to quantify the number of updated and inserted records which are sent to a specific destination.  The records are sent to a mail recipient who will tell them if the package was a success along with the file name, user who performed action, and record results. In the event of a failure of the package during execution an error would be sent to specific address alerting them of the failure.
Client Grouping Master Table This package loads the division data from an Excel Spreadsheet, ClientGeographies.xls. Data cleansing takes place to verify that the data is in a useable format. Divisions can be added or updated to the division table. Sorting of like data was used to help in avoiding repetitive or duplicates from data source. Database integrity is upheld through referencing the Grouping primary key and the grouping identification number with the data provided from the source data file.  A log is created to quantify the number of updated and inserted records which are sent to a specific destination.  The records are sent to a mail recipient who will tell them if the package was a success along with the file name, user who performed action, and record results. In the event of a failure of the package during execution an error would be sent to specific address alerting them of the failure.
Project(“Job”)Time Sheets (Labor) Table 	This package loads the employee data from a comma separated value file which contained several files with different data. A counting mechanism was used to create an accumulation function on all the files that were processed. Data cleansing takes place to verify that the data is in a useable format. Errors are avoided by referencing the employeePK, job masterPK, worked hours with the client number on the source data file. If the record is null it will error that record to prevent corruption within database table. The error log will report the error to the error log table in the database which records the description and time of error. A log is created to quantify the number of updates, inserts and error records which are sent to a specific destination. The records are sent to a mail recipient who will tell them if the package was a success along with the file name, user who performed action, and record results. In the event of a failure of the package during execution an error would be sent to specific address alerting them of the failure.
Project(“Job”)Time Sheets (Labor) Table cont.
Client GroupingXref Table 	This package loads the Special Grouping data from an Excel Spreadsheet, ClientGeographies.xls. Data cleansing takes place to verify that the data is in a useable format. Grouping is updated to the GroupingsXClients table. Database integrity is upheld through referencing the client’s account number with the data provided from the source data file. A second integrity search is performed through referencing the client’s grouping with the data provided from the source data file. A log is created to quantify the number of updated records which are sent to a specific destination.  The records are sent to a mail recipient who will tell them if the package was a success along with the file name, user who performed action, and record results. In the event of a failure of the package during execution an error would be sent to specific address alerting them of the failure.
Employee Rate Table   	This package loads the employee data from an Excel Spreadsheet, Employees.XLS. Data cleansing takes place to verify that the data is in a useable format. Errors are avoided by referencing the employee’s and rate with the data provided from the source data file. If the record is null it will error that record to prevent corruption within database table.   A log is created to quantify the number of updates, inserts and error records which are sent to a specific destination.  The records are sent to a mail recipient who will tell them if the package was a success along with the file name, user who performed action, and record results. In the event of a failure of the package during execution an error would be sent to specific address alerting them of the failure.
Project(“Job”) Master Table 	This package loads the employee data from an Excel Project master, ProjectMaster.XLS. Data cleansing takes place to verify that the data is in a useable format. Errors are avoided by referencing the client number with the client number on the source data file. If the record is null it will error that record to prevent corruption within database table. The error log will report the error to the error log table in the database which records the description and time of error. A log is created to quantify the number of updates, inserts and error records which are sent to a specific destination. The records are sent to a mail recipient who will tell them if the package was a success along with the file name, user who performed action, and record results. In the event of a failure of the package during execution an error would be sent to specific address alerting them of the failure.
Master Package 	This is a simple control flow task that creates order for each package to be executed. The purpose of this packaged is to align the packages so data dependencies would not be missing when other packages are ran. An example of this is the county table, which is a simple insert that checks data if it exists and if not it is inserted. However if not run at specific time package would fail.
Maintenance Package After ETL process completion a backup of the database and also to perform some maintenance tasks such as indexing and truncating  the database. This SQL Server Agent job was added to execute a Database Maintenance Package daily at midnight. Completion of this job is sent via email to Developer and database administrator.  

Más contenido relacionado

La actualidad más candente

ELT Publishing Tool Overview V3_Jeff
ELT Publishing Tool Overview V3_JeffELT Publishing Tool Overview V3_Jeff
ELT Publishing Tool Overview V3_JeffJeff McQuigg
 
Working with informtiaca teradata parallel transporter
Working with informtiaca teradata parallel transporterWorking with informtiaca teradata parallel transporter
Working with informtiaca teradata parallel transporterAnjaneyulu Gunti
 
Optimize access
Optimize accessOptimize access
Optimize accessAla Esmail
 
Ssis ssas sps_mdx_hong_bingli
Ssis ssas sps_mdx_hong_bingliSsis ssas sps_mdx_hong_bingli
Ssis ssas sps_mdx_hong_bingliHong-Bing Li
 
Ssis sql ssas_sps_mdx_hong_bingli
Ssis sql ssas_sps_mdx_hong_bingliSsis sql ssas_sps_mdx_hong_bingli
Ssis sql ssas_sps_mdx_hong_bingliHong-Bing Li
 
Ssis sql ssas_sps_mdx_hong_bingli
Ssis sql ssas_sps_mdx_hong_bingliSsis sql ssas_sps_mdx_hong_bingli
Ssis sql ssas_sps_mdx_hong_bingliHong-Bing Li
 
Oracle DB Performance Tuning Tips
Oracle DB Performance Tuning TipsOracle DB Performance Tuning Tips
Oracle DB Performance Tuning TipsAsanka Dilruk
 
Twp Upgrading 10g To 11g What To Expect From Optimizer
Twp Upgrading 10g To 11g What To Expect From OptimizerTwp Upgrading 10g To 11g What To Expect From Optimizer
Twp Upgrading 10g To 11g What To Expect From Optimizerqiw
 
Oracle DBA interview_questions
Oracle DBA interview_questionsOracle DBA interview_questions
Oracle DBA interview_questionsNaveen P
 
Designing Database Solutions for Microsoft SQL Server 2012 2012 Microsoft 70-...
Designing Database Solutions for Microsoft SQL Server 2012 2012 Microsoft 70-...Designing Database Solutions for Microsoft SQL Server 2012 2012 Microsoft 70-...
Designing Database Solutions for Microsoft SQL Server 2012 2012 Microsoft 70-...ChristopherBow2
 
Steps for upgrading the database to 10g release 2
Steps for upgrading the database to 10g release 2Steps for upgrading the database to 10g release 2
Steps for upgrading the database to 10g release 2nesmaddy
 
Introduction to SQL Report tool
Introduction to SQL Report toolIntroduction to SQL Report tool
Introduction to SQL Report toolRussell Frearson
 
Disconnected Architecture and Crystal report in VB.NET
Disconnected Architecture and Crystal report in VB.NETDisconnected Architecture and Crystal report in VB.NET
Disconnected Architecture and Crystal report in VB.NETEverywhere
 

La actualidad más candente (16)

ELT Publishing Tool Overview V3_Jeff
ELT Publishing Tool Overview V3_JeffELT Publishing Tool Overview V3_Jeff
ELT Publishing Tool Overview V3_Jeff
 
Working with informtiaca teradata parallel transporter
Working with informtiaca teradata parallel transporterWorking with informtiaca teradata parallel transporter
Working with informtiaca teradata parallel transporter
 
Optimize access
Optimize accessOptimize access
Optimize access
 
Ssis ssas sps_mdx_hong_bingli
Ssis ssas sps_mdx_hong_bingliSsis ssas sps_mdx_hong_bingli
Ssis ssas sps_mdx_hong_bingli
 
Ssis sql ssas_sps_mdx_hong_bingli
Ssis sql ssas_sps_mdx_hong_bingliSsis sql ssas_sps_mdx_hong_bingli
Ssis sql ssas_sps_mdx_hong_bingli
 
Ssis sql ssas_sps_mdx_hong_bingli
Ssis sql ssas_sps_mdx_hong_bingliSsis sql ssas_sps_mdx_hong_bingli
Ssis sql ssas_sps_mdx_hong_bingli
 
Oracle DB Performance Tuning Tips
Oracle DB Performance Tuning TipsOracle DB Performance Tuning Tips
Oracle DB Performance Tuning Tips
 
Twp Upgrading 10g To 11g What To Expect From Optimizer
Twp Upgrading 10g To 11g What To Expect From OptimizerTwp Upgrading 10g To 11g What To Expect From Optimizer
Twp Upgrading 10g To 11g What To Expect From Optimizer
 
Oracle DBA interview_questions
Oracle DBA interview_questionsOracle DBA interview_questions
Oracle DBA interview_questions
 
Sq lite
Sq liteSq lite
Sq lite
 
Designing Database Solutions for Microsoft SQL Server 2012 2012 Microsoft 70-...
Designing Database Solutions for Microsoft SQL Server 2012 2012 Microsoft 70-...Designing Database Solutions for Microsoft SQL Server 2012 2012 Microsoft 70-...
Designing Database Solutions for Microsoft SQL Server 2012 2012 Microsoft 70-...
 
Steps for upgrading the database to 10g release 2
Steps for upgrading the database to 10g release 2Steps for upgrading the database to 10g release 2
Steps for upgrading the database to 10g release 2
 
Tracing Sql Server 2005
Tracing Sql Server 2005Tracing Sql Server 2005
Tracing Sql Server 2005
 
Introduction to SQL Report tool
Introduction to SQL Report toolIntroduction to SQL Report tool
Introduction to SQL Report tool
 
2310 b 09
2310 b 092310 b 09
2310 b 09
 
Disconnected Architecture and Crystal report in VB.NET
Disconnected Architecture and Crystal report in VB.NETDisconnected Architecture and Crystal report in VB.NET
Disconnected Architecture and Crystal report in VB.NET
 

Destacado

Urinario
UrinarioUrinario
UrinarioMariana
 
Business Intelligence Portfolio SSAS
Business Intelligence Portfolio SSASBusiness Intelligence Portfolio SSAS
Business Intelligence Portfolio SSASamoffat
 
Montagem Do Freio Gnre 412 Fp Parte 4
Montagem Do Freio Gnre 412 Fp Parte 4Montagem Do Freio Gnre 412 Fp Parte 4
Montagem Do Freio Gnre 412 Fp Parte 4Schipppa
 
Developing a Tabletop Show from Scratch
Developing a Tabletop Show from ScratchDeveloping a Tabletop Show from Scratch
Developing a Tabletop Show from ScratchJeff_Gamber
 
Montagem Do Freio Gnre 412 Fp Parte 4
Montagem Do Freio Gnre 412 Fp Parte 4Montagem Do Freio Gnre 412 Fp Parte 4
Montagem Do Freio Gnre 412 Fp Parte 4Schipppa
 
Vodaco Agency İş'te Facebook
Vodaco Agency İş'te FacebookVodaco Agency İş'te Facebook
Vodaco Agency İş'te FacebookVodaco Agency
 

Destacado (7)

Urinario
UrinarioUrinario
Urinario
 
Business Intelligence Portfolio SSAS
Business Intelligence Portfolio SSASBusiness Intelligence Portfolio SSAS
Business Intelligence Portfolio SSAS
 
Montagem Do Freio Gnre 412 Fp Parte 4
Montagem Do Freio Gnre 412 Fp Parte 4Montagem Do Freio Gnre 412 Fp Parte 4
Montagem Do Freio Gnre 412 Fp Parte 4
 
Developing a Tabletop Show from Scratch
Developing a Tabletop Show from ScratchDeveloping a Tabletop Show from Scratch
Developing a Tabletop Show from Scratch
 
Montagem Do Freio Gnre 412 Fp Parte 4
Montagem Do Freio Gnre 412 Fp Parte 4Montagem Do Freio Gnre 412 Fp Parte 4
Montagem Do Freio Gnre 412 Fp Parte 4
 
Jeffrey Gamber
Jeffrey GamberJeffrey Gamber
Jeffrey Gamber
 
Vodaco Agency İş'te Facebook
Vodaco Agency İş'te FacebookVodaco Agency İş'te Facebook
Vodaco Agency İş'te Facebook
 

Similar a Build and optimize SQL Server database with SSIS packages

David Weston SSIS Portfolio
David Weston SSIS PortfolioDavid Weston SSIS Portfolio
David Weston SSIS Portfoliodlweston
 
A-Project Report- SSIS
A-Project Report- SSISA-Project Report- SSIS
A-Project Report- SSISYubaraj Khanal
 
Bilir's Business Intelligence Portfolio SSIS Project
Bilir's Business Intelligence Portfolio SSIS ProjectBilir's Business Intelligence Portfolio SSIS Project
Bilir's Business Intelligence Portfolio SSIS ProjectFigen Bilir
 
Agnes's SSIS Project Documentation
Agnes's SSIS Project DocumentationAgnes's SSIS Project Documentation
Agnes's SSIS Project Documentationagnestetter
 
Ssis sql ssrs_sp_hb_li
Ssis sql ssrs_sp_hb_liSsis sql ssrs_sp_hb_li
Ssis sql ssrs_sp_hb_liHong-Bing Li
 
B Woodward Portfolio
B Woodward PortfolioB Woodward Portfolio
B Woodward Portfoliobwoodward
 
MS BI SSIS Project Portfolio
MS BI SSIS Project PortfolioMS BI SSIS Project Portfolio
MS BI SSIS Project Portfoliopencarver
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfoliogaryt1953
 
Ssis ssas sps_mdx_hong_bingli
Ssis ssas sps_mdx_hong_bingliSsis ssas sps_mdx_hong_bingli
Ssis ssas sps_mdx_hong_bingliHong-Bing Li
 
Introduction of ssis
Introduction of ssisIntroduction of ssis
Introduction of ssisdeepakk073
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfoliokarlumaguing
 
The Enterprise Excel Hell
The Enterprise Excel HellThe Enterprise Excel Hell
The Enterprise Excel HellBackand Cohen
 
BIS06 Physical Database Models
BIS06 Physical Database ModelsBIS06 Physical Database Models
BIS06 Physical Database ModelsPrithwis Mukerjee
 
BIS06 Physical Database Models
BIS06 Physical Database ModelsBIS06 Physical Database Models
BIS06 Physical Database ModelsPrithwis Mukerjee
 
Mo 09 G3 Intez Ali Portfolio
Mo 09 G3 Intez Ali PortfolioMo 09 G3 Intez Ali Portfolio
Mo 09 G3 Intez Ali Portfoliointezali
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolioguest5a8ee60b
 
Building the DW - ETL
Building the DW - ETLBuilding the DW - ETL
Building the DW - ETLganblues
 

Similar a Build and optimize SQL Server database with SSIS packages (20)

David Weston SSIS Portfolio
David Weston SSIS PortfolioDavid Weston SSIS Portfolio
David Weston SSIS Portfolio
 
A-Project Report- SSIS
A-Project Report- SSISA-Project Report- SSIS
A-Project Report- SSIS
 
Bilir's Business Intelligence Portfolio SSIS Project
Bilir's Business Intelligence Portfolio SSIS ProjectBilir's Business Intelligence Portfolio SSIS Project
Bilir's Business Intelligence Portfolio SSIS Project
 
Agnes's SSIS Project Documentation
Agnes's SSIS Project DocumentationAgnes's SSIS Project Documentation
Agnes's SSIS Project Documentation
 
Ssis sql ssrs_sp_hb_li
Ssis sql ssrs_sp_hb_liSsis sql ssrs_sp_hb_li
Ssis sql ssrs_sp_hb_li
 
B Woodward Portfolio
B Woodward PortfolioB Woodward Portfolio
B Woodward Portfolio
 
Ssis event handler
Ssis event handlerSsis event handler
Ssis event handler
 
MS BI SSIS Project Portfolio
MS BI SSIS Project PortfolioMS BI SSIS Project Portfolio
MS BI SSIS Project Portfolio
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
 
Ssis ssas sps_mdx_hong_bingli
Ssis ssas sps_mdx_hong_bingliSsis ssas sps_mdx_hong_bingli
Ssis ssas sps_mdx_hong_bingli
 
Introduction of ssis
Introduction of ssisIntroduction of ssis
Introduction of ssis
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
 
The Enterprise Excel Hell
The Enterprise Excel HellThe Enterprise Excel Hell
The Enterprise Excel Hell
 
BIS06 Physical Database Models
BIS06 Physical Database ModelsBIS06 Physical Database Models
BIS06 Physical Database Models
 
BIS06 Physical Database Models
BIS06 Physical Database ModelsBIS06 Physical Database Models
BIS06 Physical Database Models
 
Ssis sql hb_li
Ssis sql hb_liSsis sql hb_li
Ssis sql hb_li
 
Abstract.DOCX
Abstract.DOCXAbstract.DOCX
Abstract.DOCX
 
Mo 09 G3 Intez Ali Portfolio
Mo 09 G3 Intez Ali PortfolioMo 09 G3 Intez Ali Portfolio
Mo 09 G3 Intez Ali Portfolio
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
 
Building the DW - ETL
Building the DW - ETLBuilding the DW - ETL
Building the DW - ETL
 

Último

Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 

Último (20)

Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 

Build and optimize SQL Server database with SSIS packages

  • 1. Business Intelligence Portfolio Aaron Moffat aarongmoffat@yahoo.com 704.614.0471
  • 2. SQL Server 2005 Integration Services Project Project Summary Build and Design a SQL Server 2005 database for Allworks Construction Company . Excel Spreadsheets and CSV files provided data for employee and customer information . Project Overview   Create DTS packages to read each source file (Extraction), made conversions or (Transformation), and load them into the designated tables within AllWorks SQL Database (Loading). Emails were generated for the results of each package. Nightly schedules were create to midnight processing for all updates and new records. Create separate package to handle indexing and file truncation. Schedule the packages to run nightly at midnight to update the database with any new or changed data. Create a separate package to handle nightly database backups.
  • 3. Division Master Table  This package loads the division data from an Excel Spreadsheet, ClientGeographies.xls. Data cleansing takes place to verify that the data is in a useable format. Divisions can be added or updated to the division table. Database integrity is upheld through referencing the division identification number with the data provided from the source data file. A log is created to quantify the number of updated and inserted records which are sent to a specific destination. The records are sent to a mail recipient who will tell them if the package was a success along with the file name, user who performed action, and record results. In the event of a failure of the package during execution an error would be sent to specific address alerting them of the failure.
  • 4. Client Grouping Master Table This package loads the division data from an Excel Spreadsheet, ClientGeographies.xls. Data cleansing takes place to verify that the data is in a useable format. Divisions can be added or updated to the division table. Sorting of like data was used to help in avoiding repetitive or duplicates from data source. Database integrity is upheld through referencing the Grouping primary key and the grouping identification number with the data provided from the source data file. A log is created to quantify the number of updated and inserted records which are sent to a specific destination. The records are sent to a mail recipient who will tell them if the package was a success along with the file name, user who performed action, and record results. In the event of a failure of the package during execution an error would be sent to specific address alerting them of the failure.
  • 5. Project(“Job”)Time Sheets (Labor) Table This package loads the employee data from a comma separated value file which contained several files with different data. A counting mechanism was used to create an accumulation function on all the files that were processed. Data cleansing takes place to verify that the data is in a useable format. Errors are avoided by referencing the employeePK, job masterPK, worked hours with the client number on the source data file. If the record is null it will error that record to prevent corruption within database table. The error log will report the error to the error log table in the database which records the description and time of error. A log is created to quantify the number of updates, inserts and error records which are sent to a specific destination. The records are sent to a mail recipient who will tell them if the package was a success along with the file name, user who performed action, and record results. In the event of a failure of the package during execution an error would be sent to specific address alerting them of the failure.
  • 7. Client GroupingXref Table This package loads the Special Grouping data from an Excel Spreadsheet, ClientGeographies.xls. Data cleansing takes place to verify that the data is in a useable format. Grouping is updated to the GroupingsXClients table. Database integrity is upheld through referencing the client’s account number with the data provided from the source data file. A second integrity search is performed through referencing the client’s grouping with the data provided from the source data file. A log is created to quantify the number of updated records which are sent to a specific destination. The records are sent to a mail recipient who will tell them if the package was a success along with the file name, user who performed action, and record results. In the event of a failure of the package during execution an error would be sent to specific address alerting them of the failure.
  • 8. Employee Rate Table   This package loads the employee data from an Excel Spreadsheet, Employees.XLS. Data cleansing takes place to verify that the data is in a useable format. Errors are avoided by referencing the employee’s and rate with the data provided from the source data file. If the record is null it will error that record to prevent corruption within database table. A log is created to quantify the number of updates, inserts and error records which are sent to a specific destination. The records are sent to a mail recipient who will tell them if the package was a success along with the file name, user who performed action, and record results. In the event of a failure of the package during execution an error would be sent to specific address alerting them of the failure.
  • 9. Project(“Job”) Master Table This package loads the employee data from an Excel Project master, ProjectMaster.XLS. Data cleansing takes place to verify that the data is in a useable format. Errors are avoided by referencing the client number with the client number on the source data file. If the record is null it will error that record to prevent corruption within database table. The error log will report the error to the error log table in the database which records the description and time of error. A log is created to quantify the number of updates, inserts and error records which are sent to a specific destination. The records are sent to a mail recipient who will tell them if the package was a success along with the file name, user who performed action, and record results. In the event of a failure of the package during execution an error would be sent to specific address alerting them of the failure.
  • 10. Master Package This is a simple control flow task that creates order for each package to be executed. The purpose of this packaged is to align the packages so data dependencies would not be missing when other packages are ran. An example of this is the county table, which is a simple insert that checks data if it exists and if not it is inserted. However if not run at specific time package would fail.
  • 11. Maintenance Package After ETL process completion a backup of the database and also to perform some maintenance tasks such as indexing and truncating the database. This SQL Server Agent job was added to execute a Database Maintenance Package daily at midnight. Completion of this job is sent via email to Developer and database administrator.