SlideShare una empresa de Scribd logo
1 de 13
BASIC CONCEPTS OF
PARALLELIZATION
(CD)
by,
K.B.Snega,M.sc(CS).,
NADAR SARASWATHI COLLEGE
OF ARTS AND SCIENCE,THENI
Parallel programming
model
 A programming model is a collection of
program abstraction providing a programmer
a simplified and transparent view of computer
H/W and S/W.
 A parallel programming is an abstraction of
parallel computer architecture with which it is
convenient to express algorithms and their
composition in programs.
Five model are designed that exploits
parallelism :
• Shared-variable model.
 Message-passing model.
 Data parallel model.
 Object oriented model.
 Functional and logic model.
SHARED VARIABLE
MODEL
 Variables may be shared
or restricted.
 These model can
automatically generate the
appropriate
communication statements
based on shared variable
for SPMD(Simple Program
Multiple data).
MESSAGE PASSING MODEL
 Synchronous Message Passing –
It is must synchronize the sender process and the
receiver process in time and space.
 Asynchronous Message Passing –
It does not require message sending and
receiving be synchronized in time and space.
Non blocking can be achieved.
 Distributing the computations-
Subprogram level is handled rather than at the
instructional or fine grain process level in a tightly
coupled multiprocessor.
DATA PARALLEL MODEL
 It is easier to write and to debug because
parallelism is explicitly handled by hardware
synchronization and flow control.
 It requires the use of pre-distributed data
sets.
 Synchronization is done at compile time
rather than run time.
 The following are some issued handled
1. Data Parallelism
2. Array Language Extensions
3. Compiler support
OBJECT ORIENTED MODEL
 Object are created and manipulated dynamically.
 Processing is performed using object.
 Concurrent programming model are built up from
low level object such as processes, queue and
semaphore.
 C- oop achieve parallelism using three methods,
1.pipeline concurrency
2.Divide and conquer concurrency
3.Co-operating problem solving
FUNCTIONAL AND LOGICAL
MODEL
 Two language-oriented programming for
parallel processing are purposed.
 Functional programming model such as
LISP, SISAL, Strand 88.
 Logic programming model as prolog.
 Based on predicate logic, logic
programming is suitable for solving large
database queries.
PARALLEL CONTROL LANGUAGE
 Special language construct and data array
expression for exploiting parallelism in
program.
 First is FORTRAN 90 array notation.
 Parallel flow control is achieve using do across
and do all type of keyword which is use in the
FORTRAN 90.
 Same we also use FORK and JOIN method.
OPTIMIZING COMPILER
 The role of compiler to remove the burden
of program optimization and code
generation.
 A parallelizing compiler consist of the
three major phases.
 Flow analysis.
 Optimization.
 Code generation.
“Compilation phases in parallel code generation”
ISSUES IN PARALLELIZATION
 Amount of parallelizable CPU bound work.
 Task Granularity.
 Load Balancing.
 Memory allocation and Garbage collection.
 Locality issues.
Basic concepts of parallelization

Más contenido relacionado

La actualidad más candente

Matlab Mech Eee Lectures 1
Matlab Mech Eee Lectures 1Matlab Mech Eee Lectures 1
Matlab Mech Eee Lectures 1
Ayyarao T S L V
 
Solution manual for modern processor design by john paul shen and mikko h. li...
Solution manual for modern processor design by john paul shen and mikko h. li...Solution manual for modern processor design by john paul shen and mikko h. li...
Solution manual for modern processor design by john paul shen and mikko h. li...
neeraj7svp
 
Engr.Hamza Arshad CV
Engr.Hamza Arshad CVEngr.Hamza Arshad CV
Engr.Hamza Arshad CV
hamza arshad
 
FPL -Part 2 ( Sem - I 2013)
FPL -Part 2 ( Sem - I 2013)FPL -Part 2 ( Sem - I 2013)
FPL -Part 2 ( Sem - I 2013)
Yogesh Deshpande
 

La actualidad más candente (15)

An Efficient and Parallel Abstract Interpreter in Scala — Preparatory Work — ...
An Efficient and Parallel Abstract Interpreter in Scala — Preparatory Work — ...An Efficient and Parallel Abstract Interpreter in Scala — Preparatory Work — ...
An Efficient and Parallel Abstract Interpreter in Scala — Preparatory Work — ...
 
MATLAB Major Projects
MATLAB Major ProjectsMATLAB Major Projects
MATLAB Major Projects
 
Simulink
SimulinkSimulink
Simulink
 
Matlab Master Thesis Writing Service
Matlab Master Thesis Writing ServiceMatlab Master Thesis Writing Service
Matlab Master Thesis Writing Service
 
Matlab Mech Eee Lectures 1
Matlab Mech Eee Lectures 1Matlab Mech Eee Lectures 1
Matlab Mech Eee Lectures 1
 
Shrilesh kathe 2017
Shrilesh kathe 2017Shrilesh kathe 2017
Shrilesh kathe 2017
 
Matlab Projects USA
Matlab Projects USAMatlab Projects USA
Matlab Projects USA
 
Solution manual for modern processor design by john paul shen and mikko h. li...
Solution manual for modern processor design by john paul shen and mikko h. li...Solution manual for modern processor design by john paul shen and mikko h. li...
Solution manual for modern processor design by john paul shen and mikko h. li...
 
Matlab Projects for Electrical Students
Matlab Projects for Electrical StudentsMatlab Projects for Electrical Students
Matlab Projects for Electrical Students
 
Resume_Dec_16
Resume_Dec_16Resume_Dec_16
Resume_Dec_16
 
Engr.Hamza Arshad CV
Engr.Hamza Arshad CVEngr.Hamza Arshad CV
Engr.Hamza Arshad CV
 
Programmatic Muddle Management
Programmatic Muddle ManagementProgrammatic Muddle Management
Programmatic Muddle Management
 
O Matrix Overview
O Matrix OverviewO Matrix Overview
O Matrix Overview
 
URF Poster
URF PosterURF Poster
URF Poster
 
FPL -Part 2 ( Sem - I 2013)
FPL -Part 2 ( Sem - I 2013)FPL -Part 2 ( Sem - I 2013)
FPL -Part 2 ( Sem - I 2013)
 

Similar a Basic concepts of parallelization

Parallel Programing Model
Parallel Programing ModelParallel Programing Model
Parallel Programing Model
Adlin Jeena
 
Chapter 5( programming) answer
Chapter 5( programming) answerChapter 5( programming) answer
Chapter 5( programming) answer
smkengkilili2011
 
Project_Report (BARC-Jerin)_final
Project_Report (BARC-Jerin)_finalProject_Report (BARC-Jerin)_final
Project_Report (BARC-Jerin)_final
Jerin John
 
Programming content
Programming contentProgramming content
Programming content
Bazlin Ahmad
 

Similar a Basic concepts of parallelization (20)

Parallel programming model, language and compiler in ACA.
Parallel programming model, language and compiler in ACA.Parallel programming model, language and compiler in ACA.
Parallel programming model, language and compiler in ACA.
 
Advanced computer architecture unit 5
Advanced computer architecture  unit 5Advanced computer architecture  unit 5
Advanced computer architecture unit 5
 
Parallel Programing Model
Parallel Programing ModelParallel Programing Model
Parallel Programing Model
 
Parallel programming model
Parallel programming modelParallel programming model
Parallel programming model
 
Aq4301224227
Aq4301224227Aq4301224227
Aq4301224227
 
Prgramming paradigms
Prgramming paradigmsPrgramming paradigms
Prgramming paradigms
 
Doppl Development Introduction
Doppl Development IntroductionDoppl Development Introduction
Doppl Development Introduction
 
Parallelization of Coupled Cluster Code with OpenMP
Parallelization of Coupled Cluster Code with OpenMPParallelization of Coupled Cluster Code with OpenMP
Parallelization of Coupled Cluster Code with OpenMP
 
Compiler gate question key
Compiler gate question keyCompiler gate question key
Compiler gate question key
 
Unit5
Unit5Unit5
Unit5
 
Performance Analysis of Parallel Algorithms on Multi-core System using OpenMP
Performance Analysis of Parallel Algorithms on Multi-core System using OpenMP Performance Analysis of Parallel Algorithms on Multi-core System using OpenMP
Performance Analysis of Parallel Algorithms on Multi-core System using OpenMP
 
Programming
ProgrammingProgramming
Programming
 
PCCF UNIT 2 CLASS.pptx
PCCF UNIT 2 CLASS.pptxPCCF UNIT 2 CLASS.pptx
PCCF UNIT 2 CLASS.pptx
 
parallel programming models
 parallel programming models parallel programming models
parallel programming models
 
Parallelization using open mp
Parallelization using open mpParallelization using open mp
Parallelization using open mp
 
Chapter 5( programming) answer
Chapter 5( programming) answerChapter 5( programming) answer
Chapter 5( programming) answer
 
Project_Report (BARC-Jerin)_final
Project_Report (BARC-Jerin)_finalProject_Report (BARC-Jerin)_final
Project_Report (BARC-Jerin)_final
 
Building A Linux Cluster Using Raspberry PI #1!
Building A Linux Cluster Using Raspberry PI #1!Building A Linux Cluster Using Raspberry PI #1!
Building A Linux Cluster Using Raspberry PI #1!
 
Programming content
Programming contentProgramming content
Programming content
 
Beekman5 std ppt_13
Beekman5 std ppt_13Beekman5 std ppt_13
Beekman5 std ppt_13
 

Más de snegacmr (14)

Process improvement
Process improvementProcess improvement
Process improvement
 
Rest based xml web services
Rest based xml web servicesRest based xml web services
Rest based xml web services
 
Business intelligence
Business intelligenceBusiness intelligence
Business intelligence
 
Deepi rdbms
Deepi rdbmsDeepi rdbms
Deepi rdbms
 
Computer network
Computer networkComputer network
Computer network
 
Os
OsOs
Os
 
Dm powerpoint
Dm powerpointDm powerpoint
Dm powerpoint
 
Sql
SqlSql
Sql
 
Data mining
Data miningData mining
Data mining
 
Cn
CnCn
Cn
 
Query optimization
Query optimizationQuery optimization
Query optimization
 
Network security
Network securityNetwork security
Network security
 
Discretization and concept hierarchy(os)
Discretization and concept hierarchy(os)Discretization and concept hierarchy(os)
Discretization and concept hierarchy(os)
 
System components (os)
System components (os)System components (os)
System components (os)
 

Último

AKTU Computer Networks notes --- Unit 3.pdf
AKTU Computer Networks notes ---  Unit 3.pdfAKTU Computer Networks notes ---  Unit 3.pdf
AKTU Computer Networks notes --- Unit 3.pdf
ankushspencer015
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
ssuser89054b
 
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak HamilCara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Kandungan 087776558899
 

Último (20)

ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdfONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
 
Unit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdfUnit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdf
 
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
 
AKTU Computer Networks notes --- Unit 3.pdf
AKTU Computer Networks notes ---  Unit 3.pdfAKTU Computer Networks notes ---  Unit 3.pdf
AKTU Computer Networks notes --- Unit 3.pdf
 
Water Industry Process Automation & Control Monthly - April 2024
Water Industry Process Automation & Control Monthly - April 2024Water Industry Process Automation & Control Monthly - April 2024
Water Industry Process Automation & Control Monthly - April 2024
 
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
 
Block diagram reduction techniques in control systems.ppt
Block diagram reduction techniques in control systems.pptBlock diagram reduction techniques in control systems.ppt
Block diagram reduction techniques in control systems.ppt
 
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
 
Design For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the startDesign For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the start
 
Intze Overhead Water Tank Design by Working Stress - IS Method.pdf
Intze Overhead Water Tank  Design by Working Stress - IS Method.pdfIntze Overhead Water Tank  Design by Working Stress - IS Method.pdf
Intze Overhead Water Tank Design by Working Stress - IS Method.pdf
 
Bhosari ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
Bhosari ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...Bhosari ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...
Bhosari ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
 
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
 
Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
 
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak HamilCara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
Cara Menggugurkan Sperma Yang Masuk Rahim Biyar Tidak Hamil
 
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfdata_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdf
 
Intro To Electric Vehicles PDF Notes.pdf
Intro To Electric Vehicles PDF Notes.pdfIntro To Electric Vehicles PDF Notes.pdf
Intro To Electric Vehicles PDF Notes.pdf
 
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
 
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordCCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
 

Basic concepts of parallelization

  • 1. BASIC CONCEPTS OF PARALLELIZATION (CD) by, K.B.Snega,M.sc(CS)., NADAR SARASWATHI COLLEGE OF ARTS AND SCIENCE,THENI
  • 2. Parallel programming model  A programming model is a collection of program abstraction providing a programmer a simplified and transparent view of computer H/W and S/W.  A parallel programming is an abstraction of parallel computer architecture with which it is convenient to express algorithms and their composition in programs.
  • 3. Five model are designed that exploits parallelism : • Shared-variable model.  Message-passing model.  Data parallel model.  Object oriented model.  Functional and logic model.
  • 4. SHARED VARIABLE MODEL  Variables may be shared or restricted.  These model can automatically generate the appropriate communication statements based on shared variable for SPMD(Simple Program Multiple data).
  • 5. MESSAGE PASSING MODEL  Synchronous Message Passing – It is must synchronize the sender process and the receiver process in time and space.  Asynchronous Message Passing – It does not require message sending and receiving be synchronized in time and space. Non blocking can be achieved.  Distributing the computations- Subprogram level is handled rather than at the instructional or fine grain process level in a tightly coupled multiprocessor.
  • 6. DATA PARALLEL MODEL  It is easier to write and to debug because parallelism is explicitly handled by hardware synchronization and flow control.  It requires the use of pre-distributed data sets.  Synchronization is done at compile time rather than run time.  The following are some issued handled 1. Data Parallelism 2. Array Language Extensions 3. Compiler support
  • 7. OBJECT ORIENTED MODEL  Object are created and manipulated dynamically.  Processing is performed using object.  Concurrent programming model are built up from low level object such as processes, queue and semaphore.  C- oop achieve parallelism using three methods, 1.pipeline concurrency 2.Divide and conquer concurrency 3.Co-operating problem solving
  • 8. FUNCTIONAL AND LOGICAL MODEL  Two language-oriented programming for parallel processing are purposed.  Functional programming model such as LISP, SISAL, Strand 88.  Logic programming model as prolog.  Based on predicate logic, logic programming is suitable for solving large database queries.
  • 9. PARALLEL CONTROL LANGUAGE  Special language construct and data array expression for exploiting parallelism in program.  First is FORTRAN 90 array notation.  Parallel flow control is achieve using do across and do all type of keyword which is use in the FORTRAN 90.  Same we also use FORK and JOIN method.
  • 10. OPTIMIZING COMPILER  The role of compiler to remove the burden of program optimization and code generation.  A parallelizing compiler consist of the three major phases.  Flow analysis.  Optimization.  Code generation.
  • 11. “Compilation phases in parallel code generation”
  • 12. ISSUES IN PARALLELIZATION  Amount of parallelizable CPU bound work.  Task Granularity.  Load Balancing.  Memory allocation and Garbage collection.  Locality issues.