SlideShare una empresa de Scribd logo
1 de 33
Dec 8th, 2012
 Introduction
 What is the problem?
 Pixeye goal
 Pixeye methodology
 Pixeye feature set
 Pixeye offers an integrated suite for
◦ Image processing
◦ Algorithm development, mass execution and configuration
◦ Image quality assessment
◦ Camera module and external component integration
 Developed with algorithms developers and IQ engineers to
allow rapid development, evaluation and configuration of
image pipeline blocks.
 Pixeye usage model has a proven success in accelerating
development and integration processes, increasing
collaboration between developers and IQ engineers.
 Usually algorithm engineers develop blocks in Matlab and
sometimes convert it to compiled language (e.g., C, C++ etc.)
to decrease the run-time, and enable integration.
 Many times, the algorithms require some configuration to
control its behavior. Usually, the algorithms’ configuration
turns to be complex, require scalability and visibility for
additional post-development tasks such as IQ, integration
and configuration management.
 Algorithm developers usually build a GUI to allow the IQ
engineers to verify the block, comment on it and later to
configure it.
 Writing a GUI in Matlab is easy, but it’s a maintenance
nightmare when it comes to adding features.
 Algorithm, SW and IQC Team Flow
◦ Image capture using external camera module.
◦ Image extraction from an external stream.
◦ Building an algorithms chain (Blocks pipe).
◦ Algorithms blocks configuration.
◦ Execution.
◦ Intermediate results/Outputs analysis and evaluation.
◦ Outputs comparison.
Algorithm
IQC
SW
Can it be
Combined
Into One
Tool…?
Combining several
tools to see the
behavior of a
complete image
pipeline can also
be challenging
 In addition, as part of the algorithm development and the IQ
work, images created in the process are frequently compared
to reference images which requires saving the images after
each run and using other external tools (e.g. FastStone.).
One stop shop tool for
development, evaluation, configuration and
demonstration
 Increase productivity of algorithm and IQ engineers – decrease the
invested time on ad-hoc tools/GUIs/configuration tools.
 Standardize development of blocks and tools.
 Standardize a typed output of intermediate results and maps of any
execution block to assist developers and IQ engineers.
 Encapsulating all image quality activity inside a single tool, without
the need to use other tools for routine work (e.g., image
comparison).
 To allow using the same tool for demonstration purposes with the
options to hide or expose to the customers certain parameters of
the configuration.
Our Goal
 Pixeye can load, configure and execute any block which
accepts Bayer/RGB/Gray image and outputs a Bayer/RGB/Gray
images.
 Pixeye has a well defined API for custom blocks insertion,
based on XML and a managed .NET wrapper.
 Each block declares its configuration through an XML.
 The XML uses simple schema to declare its components, and
based on it, Pixeye renders a specific GUI for this block.
 Pixeye dynamically detects the available blocks on
initialization and allows the user to declare image pipelines
chains using it’s arsenal of blocks.
 Pixeye provide session context and workspace per user under
a project entity, allowing custom preferences, and
configuration management.
 Algorithms processing environment
◦ Manages algorithms in user projects.
◦ Dynamically constructs image pipeline processing blocks
into chains
◦ Runs multiple algorithms chains simultaneously.
◦ The framework is agnostic to algorithms implementation
and internal configuration.
◦  Can learn configuration and present it ‘on the fly’.
◦ Supports different pixel orders, image size, masks, header
lines etc.
◦ Controls images and blocks execution.
◦ Auto saves user environment.
 Processing blocks configuration
◦ Loads metadata of native processing blocks
◦ Presents various controls of different configuration types.
◦ Have rich UI to calibrate processing blocks.
◦ Load/Save blocks configuration.
◦ Supports intermediate outputs per algorithm
◦ Provides a way to configure the parameters of each
processing block under any chain.
 Algorithms execution
◦ Multithreaded execution.
◦ Partial image processing according to cropped area
selection on different source images.
◦ Batch execution.
 Images workspace
◦ Image quality analysis tools.
◦ Displays intermediate results.
◦ Loads reference images for benchmarking.
◦ Allows comparison between images.
◦ Lock multiple images to share same ROI and zoom settings.
◦ Analyze image in full screen mode.
◦ Full crop/pan/zoom capabilities
RAW
BAYER
BPC
Noise
Reduction
LSC
GrGb
Statistics
Gains & Offsets
New BlockDemosaicing
CCM
Gamma
Lateral Color
Scaling
RGB2YUV
SharpeningNew Algorithm
block can be
integrated
easily anywhere
inside the
image pipeline
KJS
LFD
Nominal
 Pixeye comes with a plugin which allow integration
with sensor.
 The current code supports SCOOBY2
interface, where all the sensor configuration is
flexible and loaded from XML.
 Other custom interfaces can be added on demand.
Scooby2 Platform for
Image Sensor Analysis
 Currently the tool is supplied with the
following ISP blocks:
◦ White balance
◦ CCM
◦ Gamma correction
◦ Black level substraction
◦ Simple Demosaic
◦ Advanced Demosaic
•SW installation package
•Support C++/C Algorithms
•Managed .NET API
•XML Reference
•C++/C Structures auto generation
•Bayer/RGB/Gray full support
•Documentations (e.g. User
manual, integration etc.))
Basic
•Algorithms native language
(Matlab/Lua/Java/R/etc..)
•Algorithm input/output types.
•Maps/Intermediate results
•Custom IQ analysis tools
•Images formats
•Platform related requirements
•External components/Camera modules
Definition
•Native algorithm wrapping (Managed layer)
•Supporting custom types.
•Integrating new maps formats.
•Adding custom tools
•Writing plug-ins for external tools
Integration
Pixeye Presentation

Más contenido relacionado

Destacado

For ip
For ipFor ip
For ipinfpol
 
Checkbox presentation cs5
Checkbox presentation cs5Checkbox presentation cs5
Checkbox presentation cs5smadyby
 
презентация принт 2.0.
презентация принт 2.0.презентация принт 2.0.
презентация принт 2.0.dimovic
 
#SCMW2014 - Brand Culture - Nicolas Bordas
#SCMW2014 - Brand Culture - Nicolas Bordas#SCMW2014 - Brand Culture - Nicolas Bordas
#SCMW2014 - Brand Culture - Nicolas Bordasscoopit_fr
 
Mobile Marketing Techniques to Jumpstart your Business
Mobile Marketing Techniques to Jumpstart your BusinessMobile Marketing Techniques to Jumpstart your Business
Mobile Marketing Techniques to Jumpstart your BusinessMichelle Hummel
 
How to Successfully Build a Social Media Presence
How to Successfully Build a Social Media PresenceHow to Successfully Build a Social Media Presence
How to Successfully Build a Social Media PresenceMichelle Hummel
 
#SCMW2014 - Knowledge Sharing - Marc Rougier
#SCMW2014 - Knowledge Sharing - Marc Rougier#SCMW2014 - Knowledge Sharing - Marc Rougier
#SCMW2014 - Knowledge Sharing - Marc Rougierscoopit_fr
 

Destacado (8)

For ip
For ipFor ip
For ip
 
Checkbox presentation cs5
Checkbox presentation cs5Checkbox presentation cs5
Checkbox presentation cs5
 
презентация принт 2.0.
презентация принт 2.0.презентация принт 2.0.
презентация принт 2.0.
 
#SCMW2014 - Brand Culture - Nicolas Bordas
#SCMW2014 - Brand Culture - Nicolas Bordas#SCMW2014 - Brand Culture - Nicolas Bordas
#SCMW2014 - Brand Culture - Nicolas Bordas
 
Mobile Marketing Techniques to Jumpstart your Business
Mobile Marketing Techniques to Jumpstart your BusinessMobile Marketing Techniques to Jumpstart your Business
Mobile Marketing Techniques to Jumpstart your Business
 
How to Successfully Build a Social Media Presence
How to Successfully Build a Social Media PresenceHow to Successfully Build a Social Media Presence
How to Successfully Build a Social Media Presence
 
Mate3
Mate3Mate3
Mate3
 
#SCMW2014 - Knowledge Sharing - Marc Rougier
#SCMW2014 - Knowledge Sharing - Marc Rougier#SCMW2014 - Knowledge Sharing - Marc Rougier
#SCMW2014 - Knowledge Sharing - Marc Rougier
 

Similar a Pixeye Presentation

Debug, Analyze and Optimize Games with Intel Tools
Debug, Analyze and Optimize Games with Intel Tools Debug, Analyze and Optimize Games with Intel Tools
Debug, Analyze and Optimize Games with Intel Tools Matteo Valoriani
 
Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...
Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...
Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...Codemotion
 
Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...
Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...
Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...Codemotion
 
Applications use in Java GUIThe Java GUI consists of a separate, .pdf
Applications use in Java GUIThe Java GUI consists of a separate, .pdfApplications use in Java GUIThe Java GUI consists of a separate, .pdf
Applications use in Java GUIThe Java GUI consists of a separate, .pdfakshay1213
 
Developing, testing and distributing elasticsearch beats in a complex, heter...
Developing, testing and distributing elasticsearch beats in  a complex, heter...Developing, testing and distributing elasticsearch beats in  a complex, heter...
Developing, testing and distributing elasticsearch beats in a complex, heter...Jesper Agerled Wermuth
 
Y1 gd engine_terminology
Y1 gd engine_terminologyY1 gd engine_terminology
Y1 gd engine_terminologyZak Warren
 
Photo Editing And Sharing Web Application With AI- Assisted Features
Photo Editing And Sharing Web Application With AI- Assisted FeaturesPhoto Editing And Sharing Web Application With AI- Assisted Features
Photo Editing And Sharing Web Application With AI- Assisted FeaturesIRJET Journal
 
PratheshBV_Resume
PratheshBV_ResumePratheshBV_Resume
PratheshBV_Resumepradeesh bv
 
Engine Terminology
Engine Terminology Engine Terminology
Engine Terminology copelandadam
 
Catia product enhancement_overview_v5r20
Catia product enhancement_overview_v5r20Catia product enhancement_overview_v5r20
Catia product enhancement_overview_v5r20Jimmy Chang
 
Automated Build using teamcity
Automated Build using teamcityAutomated Build using teamcity
Automated Build using teamcityMd Jawed
 
Online movie ticket booking
Online movie ticket bookingOnline movie ticket booking
Online movie ticket bookingmrinnovater007
 
Rapid Prototyping with TurboGears2
Rapid Prototyping with TurboGears2Rapid Prototyping with TurboGears2
Rapid Prototyping with TurboGears2Alessandro Molina
 
Expert Image Notes
Expert Image NotesExpert Image Notes
Expert Image NotesMary Clemons
 
Overview of Visual Studio Team System 2010
Overview of Visual Studio Team System 2010Overview of Visual Studio Team System 2010
Overview of Visual Studio Team System 2010joycsc
 

Similar a Pixeye Presentation (20)

Debug, Analyze and Optimize Games with Intel Tools
Debug, Analyze and Optimize Games with Intel Tools Debug, Analyze and Optimize Games with Intel Tools
Debug, Analyze and Optimize Games with Intel Tools
 
Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...
Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...
Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...
 
Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...
Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...
Debug, Analyze and Optimize Games with Intel Tools - Matteo Valoriani - Codem...
 
Applications use in Java GUIThe Java GUI consists of a separate, .pdf
Applications use in Java GUIThe Java GUI consists of a separate, .pdfApplications use in Java GUIThe Java GUI consists of a separate, .pdf
Applications use in Java GUIThe Java GUI consists of a separate, .pdf
 
Developing, testing and distributing elasticsearch beats in a complex, heter...
Developing, testing and distributing elasticsearch beats in  a complex, heter...Developing, testing and distributing elasticsearch beats in  a complex, heter...
Developing, testing and distributing elasticsearch beats in a complex, heter...
 
Y1 gd engine_terminology
Y1 gd engine_terminologyY1 gd engine_terminology
Y1 gd engine_terminology
 
Photo Editing And Sharing Web Application With AI- Assisted Features
Photo Editing And Sharing Web Application With AI- Assisted FeaturesPhoto Editing And Sharing Web Application With AI- Assisted Features
Photo Editing And Sharing Web Application With AI- Assisted Features
 
Game Studio
Game StudioGame Studio
Game Studio
 
SSDT unleashed
SSDT unleashedSSDT unleashed
SSDT unleashed
 
Ijetr011814
Ijetr011814Ijetr011814
Ijetr011814
 
PratheshBV_Resume
PratheshBV_ResumePratheshBV_Resume
PratheshBV_Resume
 
Engine Terminology
Engine Terminology Engine Terminology
Engine Terminology
 
Catia product enhancement_overview_v5r20
Catia product enhancement_overview_v5r20Catia product enhancement_overview_v5r20
Catia product enhancement_overview_v5r20
 
ProSyst OSGi SDK
ProSyst OSGi SDKProSyst OSGi SDK
ProSyst OSGi SDK
 
Automated Build using teamcity
Automated Build using teamcityAutomated Build using teamcity
Automated Build using teamcity
 
Online movie ticket booking
Online movie ticket bookingOnline movie ticket booking
Online movie ticket booking
 
Rapid Prototyping with TurboGears2
Rapid Prototyping with TurboGears2Rapid Prototyping with TurboGears2
Rapid Prototyping with TurboGears2
 
Resume_Basith
Resume_BasithResume_Basith
Resume_Basith
 
Expert Image Notes
Expert Image NotesExpert Image Notes
Expert Image Notes
 
Overview of Visual Studio Team System 2010
Overview of Visual Studio Team System 2010Overview of Visual Studio Team System 2010
Overview of Visual Studio Team System 2010
 

Último

Transport in Open Pits______SM_MI10415MI
Transport in Open Pits______SM_MI10415MITransport in Open Pits______SM_MI10415MI
Transport in Open Pits______SM_MI10415MIRomil Mishra
 
Bitdefender-CSG-Report-creat7534-interactive
Bitdefender-CSG-Report-creat7534-interactiveBitdefender-CSG-Report-creat7534-interactive
Bitdefender-CSG-Report-creat7534-interactivestartupro
 
Bridge to the Future: Migrating to KRaft
Bridge to the Future: Migrating to KRaftBridge to the Future: Migrating to KRaft
Bridge to the Future: Migrating to KRaftHostedbyConfluent
 
QMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdfQMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdfROWELL MARQUINA
 
Fish Plays Pokemon | Kafka Summit London
Fish Plays Pokemon | Kafka Summit LondonFish Plays Pokemon | Kafka Summit London
Fish Plays Pokemon | Kafka Summit LondonHostedbyConfluent
 
Digital Tools & AI in Career Development
Digital Tools & AI in Career DevelopmentDigital Tools & AI in Career Development
Digital Tools & AI in Career DevelopmentMahmoud Rabie
 
Build Copilots on Streaming Data with Generative AI, Kafka Streams and Flink SQL
Build Copilots on Streaming Data with Generative AI, Kafka Streams and Flink SQLBuild Copilots on Streaming Data with Generative AI, Kafka Streams and Flink SQL
Build Copilots on Streaming Data with Generative AI, Kafka Streams and Flink SQLHostedbyConfluent
 
THE STATE OF STARTUP ECOSYSTEM - INDIA x JAPAN 2023
THE STATE OF STARTUP ECOSYSTEM - INDIA x JAPAN 2023THE STATE OF STARTUP ECOSYSTEM - INDIA x JAPAN 2023
THE STATE OF STARTUP ECOSYSTEM - INDIA x JAPAN 2023Joshua Flannery
 
Web Development Solutions 2024 A Beginner's Comprehensive Handbook.pdf
Web Development Solutions 2024 A Beginner's Comprehensive Handbook.pdfWeb Development Solutions 2024 A Beginner's Comprehensive Handbook.pdf
Web Development Solutions 2024 A Beginner's Comprehensive Handbook.pdfSeasia Infotech
 
#SCIT 2024 LatAm Delegation Overview + SPONSORSHIP.pdf
#SCIT 2024 LatAm Delegation Overview + SPONSORSHIP.pdf#SCIT 2024 LatAm Delegation Overview + SPONSORSHIP.pdf
#SCIT 2024 LatAm Delegation Overview + SPONSORSHIP.pdfREFASHIOND
 
Green paths: Learning from publishers’ sustainability journeys - Tech Forum 2024
Green paths: Learning from publishers’ sustainability journeys - Tech Forum 2024Green paths: Learning from publishers’ sustainability journeys - Tech Forum 2024
Green paths: Learning from publishers’ sustainability journeys - Tech Forum 2024BookNet Canada
 
Leveraging Tiered Storage in Strimzi-Operated Kafka for Cost-Effective Stream...
Leveraging Tiered Storage in Strimzi-Operated Kafka for Cost-Effective Stream...Leveraging Tiered Storage in Strimzi-Operated Kafka for Cost-Effective Stream...
Leveraging Tiered Storage in Strimzi-Operated Kafka for Cost-Effective Stream...HostedbyConfluent
 
Transcript: Book industry state of the nation 2024 - Tech Forum 2024
Transcript: Book industry state of the nation 2024 - Tech Forum 2024Transcript: Book industry state of the nation 2024 - Tech Forum 2024
Transcript: Book industry state of the nation 2024 - Tech Forum 2024BookNet Canada
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemSafe Software
 
Mastering Kafka Consumer Distribution: A Guide to Efficient Scaling and Resou...
Mastering Kafka Consumer Distribution: A Guide to Efficient Scaling and Resou...Mastering Kafka Consumer Distribution: A Guide to Efficient Scaling and Resou...
Mastering Kafka Consumer Distribution: A Guide to Efficient Scaling and Resou...HostedbyConfluent
 
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Mark Simos
 
Real-time Customer Impact Calculation on a Telecom Scale Knowledge Graph
Real-time Customer Impact Calculation on a Telecom Scale Knowledge GraphReal-time Customer Impact Calculation on a Telecom Scale Knowledge Graph
Real-time Customer Impact Calculation on a Telecom Scale Knowledge GraphHostedbyConfluent
 
Brick-by-Brick: Exploring the Elements of Apache Kafka®
Brick-by-Brick: Exploring the Elements of Apache Kafka®Brick-by-Brick: Exploring the Elements of Apache Kafka®
Brick-by-Brick: Exploring the Elements of Apache Kafka®HostedbyConfluent
 
Data Contracts In Practice With Debezium and Apache Flink
Data Contracts In Practice With Debezium and Apache FlinkData Contracts In Practice With Debezium and Apache Flink
Data Contracts In Practice With Debezium and Apache FlinkHostedbyConfluent
 
How Do You Query a Stream? | Kafka Summit London
How Do You Query a Stream? | Kafka Summit LondonHow Do You Query a Stream? | Kafka Summit London
How Do You Query a Stream? | Kafka Summit LondonHostedbyConfluent
 

Último (20)

Transport in Open Pits______SM_MI10415MI
Transport in Open Pits______SM_MI10415MITransport in Open Pits______SM_MI10415MI
Transport in Open Pits______SM_MI10415MI
 
Bitdefender-CSG-Report-creat7534-interactive
Bitdefender-CSG-Report-creat7534-interactiveBitdefender-CSG-Report-creat7534-interactive
Bitdefender-CSG-Report-creat7534-interactive
 
Bridge to the Future: Migrating to KRaft
Bridge to the Future: Migrating to KRaftBridge to the Future: Migrating to KRaft
Bridge to the Future: Migrating to KRaft
 
QMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdfQMMS Lesson 2 - Using MS Excel Formula.pdf
QMMS Lesson 2 - Using MS Excel Formula.pdf
 
Fish Plays Pokemon | Kafka Summit London
Fish Plays Pokemon | Kafka Summit LondonFish Plays Pokemon | Kafka Summit London
Fish Plays Pokemon | Kafka Summit London
 
Digital Tools & AI in Career Development
Digital Tools & AI in Career DevelopmentDigital Tools & AI in Career Development
Digital Tools & AI in Career Development
 
Build Copilots on Streaming Data with Generative AI, Kafka Streams and Flink SQL
Build Copilots on Streaming Data with Generative AI, Kafka Streams and Flink SQLBuild Copilots on Streaming Data with Generative AI, Kafka Streams and Flink SQL
Build Copilots on Streaming Data with Generative AI, Kafka Streams and Flink SQL
 
THE STATE OF STARTUP ECOSYSTEM - INDIA x JAPAN 2023
THE STATE OF STARTUP ECOSYSTEM - INDIA x JAPAN 2023THE STATE OF STARTUP ECOSYSTEM - INDIA x JAPAN 2023
THE STATE OF STARTUP ECOSYSTEM - INDIA x JAPAN 2023
 
Web Development Solutions 2024 A Beginner's Comprehensive Handbook.pdf
Web Development Solutions 2024 A Beginner's Comprehensive Handbook.pdfWeb Development Solutions 2024 A Beginner's Comprehensive Handbook.pdf
Web Development Solutions 2024 A Beginner's Comprehensive Handbook.pdf
 
#SCIT 2024 LatAm Delegation Overview + SPONSORSHIP.pdf
#SCIT 2024 LatAm Delegation Overview + SPONSORSHIP.pdf#SCIT 2024 LatAm Delegation Overview + SPONSORSHIP.pdf
#SCIT 2024 LatAm Delegation Overview + SPONSORSHIP.pdf
 
Green paths: Learning from publishers’ sustainability journeys - Tech Forum 2024
Green paths: Learning from publishers’ sustainability journeys - Tech Forum 2024Green paths: Learning from publishers’ sustainability journeys - Tech Forum 2024
Green paths: Learning from publishers’ sustainability journeys - Tech Forum 2024
 
Leveraging Tiered Storage in Strimzi-Operated Kafka for Cost-Effective Stream...
Leveraging Tiered Storage in Strimzi-Operated Kafka for Cost-Effective Stream...Leveraging Tiered Storage in Strimzi-Operated Kafka for Cost-Effective Stream...
Leveraging Tiered Storage in Strimzi-Operated Kafka for Cost-Effective Stream...
 
Transcript: Book industry state of the nation 2024 - Tech Forum 2024
Transcript: Book industry state of the nation 2024 - Tech Forum 2024Transcript: Book industry state of the nation 2024 - Tech Forum 2024
Transcript: Book industry state of the nation 2024 - Tech Forum 2024
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Mastering Kafka Consumer Distribution: A Guide to Efficient Scaling and Resou...
Mastering Kafka Consumer Distribution: A Guide to Efficient Scaling and Resou...Mastering Kafka Consumer Distribution: A Guide to Efficient Scaling and Resou...
Mastering Kafka Consumer Distribution: A Guide to Efficient Scaling and Resou...
 
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
 
Real-time Customer Impact Calculation on a Telecom Scale Knowledge Graph
Real-time Customer Impact Calculation on a Telecom Scale Knowledge GraphReal-time Customer Impact Calculation on a Telecom Scale Knowledge Graph
Real-time Customer Impact Calculation on a Telecom Scale Knowledge Graph
 
Brick-by-Brick: Exploring the Elements of Apache Kafka®
Brick-by-Brick: Exploring the Elements of Apache Kafka®Brick-by-Brick: Exploring the Elements of Apache Kafka®
Brick-by-Brick: Exploring the Elements of Apache Kafka®
 
Data Contracts In Practice With Debezium and Apache Flink
Data Contracts In Practice With Debezium and Apache FlinkData Contracts In Practice With Debezium and Apache Flink
Data Contracts In Practice With Debezium and Apache Flink
 
How Do You Query a Stream? | Kafka Summit London
How Do You Query a Stream? | Kafka Summit LondonHow Do You Query a Stream? | Kafka Summit London
How Do You Query a Stream? | Kafka Summit London
 

Pixeye Presentation

  • 2.  Introduction  What is the problem?  Pixeye goal  Pixeye methodology  Pixeye feature set
  • 3.  Pixeye offers an integrated suite for ◦ Image processing ◦ Algorithm development, mass execution and configuration ◦ Image quality assessment ◦ Camera module and external component integration  Developed with algorithms developers and IQ engineers to allow rapid development, evaluation and configuration of image pipeline blocks.  Pixeye usage model has a proven success in accelerating development and integration processes, increasing collaboration between developers and IQ engineers.
  • 4.
  • 5.  Usually algorithm engineers develop blocks in Matlab and sometimes convert it to compiled language (e.g., C, C++ etc.) to decrease the run-time, and enable integration.  Many times, the algorithms require some configuration to control its behavior. Usually, the algorithms’ configuration turns to be complex, require scalability and visibility for additional post-development tasks such as IQ, integration and configuration management.  Algorithm developers usually build a GUI to allow the IQ engineers to verify the block, comment on it and later to configure it.  Writing a GUI in Matlab is easy, but it’s a maintenance nightmare when it comes to adding features.
  • 6.  Algorithm, SW and IQC Team Flow ◦ Image capture using external camera module. ◦ Image extraction from an external stream. ◦ Building an algorithms chain (Blocks pipe). ◦ Algorithms blocks configuration. ◦ Execution. ◦ Intermediate results/Outputs analysis and evaluation. ◦ Outputs comparison. Algorithm IQC SW
  • 7. Can it be Combined Into One Tool…? Combining several tools to see the behavior of a complete image pipeline can also be challenging
  • 8.  In addition, as part of the algorithm development and the IQ work, images created in the process are frequently compared to reference images which requires saving the images after each run and using other external tools (e.g. FastStone.).
  • 9.
  • 10. One stop shop tool for development, evaluation, configuration and demonstration  Increase productivity of algorithm and IQ engineers – decrease the invested time on ad-hoc tools/GUIs/configuration tools.  Standardize development of blocks and tools.  Standardize a typed output of intermediate results and maps of any execution block to assist developers and IQ engineers.  Encapsulating all image quality activity inside a single tool, without the need to use other tools for routine work (e.g., image comparison).  To allow using the same tool for demonstration purposes with the options to hide or expose to the customers certain parameters of the configuration. Our Goal
  • 11.  Pixeye can load, configure and execute any block which accepts Bayer/RGB/Gray image and outputs a Bayer/RGB/Gray images.  Pixeye has a well defined API for custom blocks insertion, based on XML and a managed .NET wrapper.  Each block declares its configuration through an XML.  The XML uses simple schema to declare its components, and based on it, Pixeye renders a specific GUI for this block.  Pixeye dynamically detects the available blocks on initialization and allows the user to declare image pipelines chains using it’s arsenal of blocks.  Pixeye provide session context and workspace per user under a project entity, allowing custom preferences, and configuration management.
  • 12.
  • 13.  Algorithms processing environment ◦ Manages algorithms in user projects. ◦ Dynamically constructs image pipeline processing blocks into chains ◦ Runs multiple algorithms chains simultaneously. ◦ The framework is agnostic to algorithms implementation and internal configuration. ◦  Can learn configuration and present it ‘on the fly’. ◦ Supports different pixel orders, image size, masks, header lines etc. ◦ Controls images and blocks execution. ◦ Auto saves user environment.
  • 14.  Processing blocks configuration ◦ Loads metadata of native processing blocks ◦ Presents various controls of different configuration types. ◦ Have rich UI to calibrate processing blocks. ◦ Load/Save blocks configuration. ◦ Supports intermediate outputs per algorithm ◦ Provides a way to configure the parameters of each processing block under any chain.  Algorithms execution ◦ Multithreaded execution. ◦ Partial image processing according to cropped area selection on different source images. ◦ Batch execution.
  • 15.  Images workspace ◦ Image quality analysis tools. ◦ Displays intermediate results. ◦ Loads reference images for benchmarking. ◦ Allows comparison between images. ◦ Lock multiple images to share same ROI and zoom settings. ◦ Analyze image in full screen mode. ◦ Full crop/pan/zoom capabilities
  • 16.
  • 17. RAW BAYER BPC Noise Reduction LSC GrGb Statistics Gains & Offsets New BlockDemosaicing CCM Gamma Lateral Color Scaling RGB2YUV SharpeningNew Algorithm block can be integrated easily anywhere inside the image pipeline
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 26.
  • 27.
  • 28.  Pixeye comes with a plugin which allow integration with sensor.  The current code supports SCOOBY2 interface, where all the sensor configuration is flexible and loaded from XML.  Other custom interfaces can be added on demand. Scooby2 Platform for Image Sensor Analysis
  • 29.
  • 30.  Currently the tool is supplied with the following ISP blocks: ◦ White balance ◦ CCM ◦ Gamma correction ◦ Black level substraction ◦ Simple Demosaic ◦ Advanced Demosaic
  • 31.
  • 32. •SW installation package •Support C++/C Algorithms •Managed .NET API •XML Reference •C++/C Structures auto generation •Bayer/RGB/Gray full support •Documentations (e.g. User manual, integration etc.)) Basic •Algorithms native language (Matlab/Lua/Java/R/etc..) •Algorithm input/output types. •Maps/Intermediate results •Custom IQ analysis tools •Images formats •Platform related requirements •External components/Camera modules Definition •Native algorithm wrapping (Managed layer) •Supporting custom types. •Integrating new maps formats. •Adding custom tools •Writing plug-ins for external tools Integration

Notas del editor

  1. White balance – gray world assumptionCCMGamma correctionBlack level substractionSimple Demosaic – Microsoft based.Advanced Demosaic – proprietary.