SlideShare una empresa de Scribd logo
1 de 46
Descargar para leer sin conexión
National Aeronautics and Space
Administration
Jet Propulsion Laboratory
California Institute of Technology




                    Market-Based Systems:
                    Bidding your way to the
                         Launch Pad

                                         Dr. Randii R. Wessen
                                              Jet Propulsion Laboratory
                                           California Institute of Technology
                                              Dr. Dave Porter
                                     Interdisciplinary Center for Economic Science
                                                George Mason University


                                                                                     1
Agenda


• Introduction
• Cassini Science Instrument Development
• Space Shuttle Manifests
• LightSAR Mission Planning
• Market-Based Systems Applied to NASA
  Resource Allocation Problems
• Conclusions



                                           2
Introduction

Problem - How to allocate scarce resources
among many users?
♦   Users do not have an incentive to reveal accurate information.
Current Approach:
♦ Benevolent Dictator - Impartial individual making decisions for
  user community.
♦ Committee - “Consensus” reached by user representatives.

New Approach:
♦   Market-based systems - Decentralized incentive-based
    decision-making at the user level.



                                                                     3
Introduction (cont.)

Market-based systems use “rights” and
“trades” to resolve conflicts.
 ♦ Users:
   – Own clearly defined resources.
   – Decide the importance of their resources.
   – Enhance their own position by exchanging resources
     among themselves.




                                                          4
Introduction (cont.)

Market-based systems require that an
“economy” be created.
To create an economy, the following must be
defined:
♦ Resources to be allocated.
♦ Resource ownership rights.
♦ Rules for making and keeping track of trades.




                                                  5
Introduction (cont.)

Market-based systems have two major
phases:
♦ Initial Allocation (Primary Market) - Users use “currency” to
  establish property rights over resources.
♦ Aftermarket (Secondary Market) - Users can voluntarily
  trade their resources with others to enhance their value.




                                                                  6
Introduction (cont.)

Examples of Market-based systems used in
private industry:
    ♦ Best Buy           ♦ RECLAIM Program in
    ♦ Corning              Southern California
    ♦ Federal            ♦ Sandia National
      Communications       Laboratories
      Commission         ♦ Sears Logistic Services
    ♦ General Electric   ♦ University of Chicago
    ♦ Google               Business School
    ♦ Hewlett-Packard    ♦ University of Michigan
    ♦ Koch Industries    ♦ University of San Diego
    ♦ Microsoft


                                                     7
The Cassini Instrument
     Development



                         8
Cassini Instrument Development

Typical instrument development for planetary
missions require:
 ♦ Project’s to submit a Request for Proposals.
 ♦ Project’s acceptance of Principal Investigators’ proposals.

Data from previous missions show that
instrument mass and cost growths are:
 ♦ Almost always positive.
 ♦ Can be very large.




                                                                 9
Cassini Instrument Dev. (cont.)

     Percent Growth for Past Space Missions




                                              10
Cassini Instrument Dev. (cont.)

In 1992 a Market-based Aftermarket, known
as the Cassini Resource Exchange (CRE),
was developed.
♦   Based on experiments conducted at Caltech with student
    subjects and science personnel.
Instrument mass, power, data rate, and
funding were allowed to be traded.
♦   The CRE opened in 1993 and closed in 1995.
     – 29 successful trades were made, all but two involved
       money and mass.



                                                              11
Cassini Instrument Dev. (cont.)

Example of a money-market trade:
 $200k this FY in return for $212k next FY = 6%.

16 contracts, worth $4M, were traded at an
average rate of 8.5%.
                              Fig 2. Money Market Activity
           14
                                                                                Cassini Trade
           12                                                                   1 Year T-Bill

           10

            8
  % Rate




            6

            4

            2

            0

                0   20   40     60      80       100       120      140   160     180           200

                                     Week Number Starting in FY93
                                                                                                      12
Cassini Instrument Dev. (cont.)

Mass-market trades:
♦ Mass started at $105k/kg and fell to $5k/kg.
♦ 11 contracts for a total of 12 kg were traded.


                       Figure 5: Mass Market Activity


            120

            100

             80
    $k/Kg




             60

             40

             20

              0

                  0   50               100                150   200

                           Week Number Starting in FY93

                                                                      13
Cassini Instrument Dev. (cont.)

Cost for the entire science payload grew by
<1%.
                                    Figure 6: Cassini's Instrument Cost Growth


                      60



                      50



                      40
            ost, $M




                                                                                                    LOA Cost
                      30
      otal C




                                                                                                    Final Cost
     T




                      20



                      10



                       0
                                                                    R


                                                                            S
                        PS




                                                                                                S
                                             S




                                                         G




                                                                                        IS
                               A


                                      S




                                                                                  S
                                                                I
                                                   S




                                                              IM


                                                                   A


                                                                           W
                                            M




                                                                                              IM
                                    IR




                                                        A




                                                                                RS
                                                 IS
                              D




                                                                                       V
                       A




                                                                  D
                                                             M
                                          IN




                                                       M
                             C


                                   C




                                                                         RP




                                                                                      U


                                                                                             V
                      C




                                                                RA




                                                        Investigations




                                                                                                                 14
Cassini Instrument Dev. (cont.)

Mass for the entire science payload decreased by
7%.                              Figure 7: Cassini's Instrument Mass Growth


                   70


                   60


                   50


                   40
        ass, kg.




                                                                                                 LOA Mass
                                                                                                 Final Mass
                   30
       M




                   20


                   10


                    0
                                                                 R


                                                                         S
                     PS




                                                                                             S
                                          S




                                                      G




                                                                                     IS
                            A


                                   S




                                                                               S
                                                             I
                                                S




                                                           IM


                                                                A


                                                                        W
                                         M




                                                                                           IM
                                 IR




                                                     A




                                                                             RS
                                              IS
                           D




                                                                                    V
                    A




                                                               D
                                                          M
                                       IN




                                                    M
                          C


                                C




                                                                      RP




                                                                                   U


                                                                                          V
                   C




                                                             RA




                                                     Investigations




                                                                                                              15
Cassini Instrument Dev. (cont.)

In 1998 a Market-based system was developed
for Cassini science planning.
♦ Web-based application.
    – Password protected.
♦ Used to allocate observation time, CDS words and data volume.
♦ Compatible with JPL’s Mission Sequence Software System
  (e.g., APGEN)




                                                                  16
Cassini Instrument Dev. (cont.)

 Cassini science planning bid sheet.




                                       17
Cassini Instrument Dev. (cont.)

• Cassini Science
  Planning Tool.
  ♦   Timeline is always
      conflict-free.
  ♦   Provides user
      feedback to get
      observation
      requests accepted.
  ♦   This system was
      never tested.




                                     18
Space Shuttle
    Manifests of
Secondary Payloads



                     19
Space Shuttle Manifests

Typical approach for manifesting Space
Shuttles Secondary Payloads require:
♦ NASA User Codes to submit requests for payload lockers.
♦ Manifestors at NASA Headquarters allocate lockers in such
  a way to:
   – Utilize Space Shuttle resources to capacity.
   – Be “fair” to the User Codes.




                                                              20
Space Shuttle Manifests (cont.)


 Multiple meetings required to:
 ♦ Present current manifest.
 ♦ Explain why some payloads were included while others
   were not.
 ♦ Obtain payload trade-off information.

 Manifestors required to re-manifest
 secondary payloads after each meeting.




                                                          21
Space Shuttle Manifests (cont.)


In the summer of 1996 a Market-based Initial
Allocation experiment was developed for
NASA’s Office of Space Utilization.
♦ Market-based approach was compared to a simple ranking
  approach.
♦ Secondary payload lockers, energy, and crew hour
  requirements were allowed to be requested.




                                                           22
Space Shuttle Manifests (cont.)

  Office of Space Utilization personnel performed
  the simple ranking manifest.
   ♦    Results were compared to market-based results.
  Real payload data was used.
   ♦    A “science return” value and payload rank were included to
        measure the caliber of the manifest.
 USER        P/L      LOCKERS   WATT-HRS   CREW-HRS   SCIENCE RETURN   RANK
Code U    MGBX-01        6        237        56           100           1
Code U    CGBA-04        4        136       5.166          70           2
Code U     CPCG-07       1        128       5.833          55           2
Code U     CPCG-08       1        128         2            45           3
Code U PCG-TES-02        3        115         0            40           3

                                                                              23
Space Shuttle Manifests (cont.)

 Comparison of resource utilization between a
simple ranking vs a market-based approach.
                                                                       Ranking
                                                                       Manual
                                     Resource Utilization              MBS
                                                                       Points


                     100
% of Capacity Used




                      95

                      90

                      85

                      80

                      75
                           Lockers          Watt-Hrs        Crew-Hrs
                                                                                 24
Space Shuttle Manifests (cont.)

      Comparison of science value for a simple ranking
     vs a market-based approach.
                                           Additional Science Return Relative to Baseline
                            40                                                       Year 1
                                                                                     Year 2
                            30                                                       Total
          % Excess Return




                            20
                            10
                             0
                            -10
                            -20
                            -30
                                  Code U    Code S     Code X     Code F       DoD
Point carry-over                    0         37         30          3               1
Year 1 to Year 2
                                                                                              25
Space Shuttle Manifests (cont.)

Market-based systems have already handled
the following type of problem:
♦   Manifest space shuttles middeck lockers efficiently
♦   6 Users
♦   47 variables/payload
♦   1,500,000 payload requests
♦   Solutions found in an average of 2.5 minutes




                                                          26
Space Shuttle Manifests (cont.)


Implementation of a market-based system is
“on-hold” until:
♦   The full impact of the International Space Station’s
    requirements on middeck lockers can be determined.
♦   “Nominal” Space Shuttle missions resume.




                                                           27
LightSAR
Mission Planning



                   28
LightSAR Mission Planning

LightSAR was a NASA initiative to develop a
low-cost Earth-imaging RADAR satellite.
Typical approach for mission planning:
♦ Submit data take requests.
♦ Create integrated timeline.
♦ Multiple meetings to resolve conflicts.
♦ Re-Integrate timeline.




                                              29
LightSAR Mission Planning (cont.)

In the winter of 1997 a Market-based Initial
Allocation experiment was developed for
LightSAR mission planning.
 ♦   Users were assigned a specific data acquisition type (e.g.
     Hi-Res Strip, Spotlight, Interferometry, Dual Polarimetry,
     etc.).




                                                                  30
LightSAR Mission Planning (cont.)

A data request, rank and “science return”
value were included with each request to
measure the caliber of the manifest.
                 Dual Polarimetry Requests
    Location        Orbit    Data Take       Rank   Value
                  Number     Number

    Vietnam          1           1            1      60
  Kuala Lumpar       1           3            2      45
    Indonesia        1           4            2      35
    Cambodia         2           3            3      10




                                                            31
LightSAR Mission Planning (cont.)

In a market-based approach, Users bid for a
“higher priority” request.
 ♦ The higher the priority, the greater the probability of
   getting into the timeline.
 ♦ A Vickrey Auction was used to provide “incentives” for the
   Users to be forthright about their bids.
    – In a Vickrey Auction “winners”pay the runner-up price.




                                                                32
LightSAR Mission Planning (cont.)

    Comparison of the science value between a
    simple ranking, a simple market, and a market
    using a Vickrey Auction.
                                                                       Science Values

                                       108                                                       Simple Market
                                                                                                 Simple Market
                                                                                                 Priority Marke
                                                                                                 Market w/ Vickrey
                                       107
                                       106
                  % of Draft Outcome




                                       105
                                       104
                                       103
                                       102
                                       101
Science value using
a simple ranking                       100
approach
                                       99
                                             Subject 1   Subject 2   Subject 3   Subject 4   Cumulative

                                                                                                                     33
LightSAR Mission Planning (cont.)




                                    34
LightSAR Mission Planning (cont.)




                                    35
LightSAR Mission Planning (cont.)




                                    36
LightSAR Mission Planning (cont.)




                                    37
LightSAR Mission Planning (cont.)

Experiments revealed only minor operational
problems.
 ♦ Lack of experience seemed to be the largest.

LightSAR was canceled.
A new RADAR mission called INSAR has begun
concept studies.
♦   The work on LightSAR can be used for INSAR and will be
    pursued.



                                                             38
Market-Based Systems
Applied to NASA Resource
   Allocation Problems



                           39
NASA Market-Based Systems

      Task             Start         End                   Status
Cassini Instrument                              Successfully controlled mass and
                      1993 Sept    1995 April
Development                                     cost growth.
Space Shuttle
                      1996 Dec     1997 Sept    Never made it past experiments.
Manifests
LightSAR Mission
                      1997 Dec     1998 Sept    Mission canceled.
Planning
Cassini Science                                 Never performed experiments
                      1998 April   1999 Mar
Planning                                        with users.
Mars’01 Science
                      1999 April   1999 Dec     Mission canceled.
Planning
International Space                             Never performed experiments
                      2000 Sept    On Hold
Station Manifests                               with users.
Alternate Workforce                             Never performed experiments
                      2000 Jun     2002 Jan
Allocations                                     with users.

Deep Space Network                              Never performed experiments
                      2005 Jan     2005 April
Antenna Allocation                              with users.



                                                                                   40
Conclusions




              41
Conclusions

Cassini, Space Shuttle, and LightSAR
benefited (or could benefit) from the use of a
market-based process.
Resource allocation problems can be solved
with the use of market-based systems.
♦   Data shows that market-based systems can produce results:
     – As good (or better) than the current processes.
     – Are reached quicker and with a smaller workforce.




                                                                42
Conclusions

The strengths of market-based systems are
that they:
♦ Move the decision making process back to the individuals
  that have the information, namely the users.
♦ Are electronically based on the Web and thus can be
  globally distributed.
♦ Remove the need for multiple meetings and appeals.




                                                             43
Conclusions

One perceived short coming of market-based
systems is their initial allocation.
♦ However, all processes have initial allocation problems.
♦ Better to solve one large problem early then multiple smaller
  problems late in a given process.
Most individuals outside of experimental
economics do not appreciate the power of
market-based systems.



                                                                  44
Conclusions

In order to successfully implement a market-
based system it is recommended that it be
used in parallel with the current approach to
“gently” help users understand its application.
There will be resistance to change to a new
system, even a more efficient one.
♦ Winners are not sure that they’ll do as well as compared to
  the current process.
♦ Losers are not sure that they’ll do better as compared to the
  current process.
♦ Integrators lose their jobs.
♦ Managers will express a loss of control.

                                                                  45
Conclusions

Top 5 “bad” reasons for not using a market-
based system:
5. “Market-based systems can solve resource allocation problems,
   but my problem is different.”
4. “We don’t have a resource allocation problem, we just just have
   a scheduling problem.”
3. “There’s no way to come up with an initial allocation of
   resources.”
2. “Too many people will lose their jobs.”
1. “We don’t need a market-based system to solve our problems.
   We’ll just solve it in a collegial manner.”


                                                                     46

Más contenido relacionado

Destacado

Paradis william
Paradis williamParadis william
Paradis williamNASAPMC
 
Rudolphi mike
Rudolphi mikeRudolphi mike
Rudolphi mikeNASAPMC
 
O'keefe william
O'keefe williamO'keefe william
O'keefe williamNASAPMC
 
Baniszewski john
Baniszewski johnBaniszewski john
Baniszewski johnNASAPMC
 
Rackley mike
Rackley mikeRackley mike
Rackley mikeNASAPMC
 
Vellinga joe
Vellinga joeVellinga joe
Vellinga joeNASAPMC
 
Trahan stuart
Trahan stuartTrahan stuart
Trahan stuartNASAPMC
 
Smalley sandra
Smalley sandraSmalley sandra
Smalley sandraNASAPMC
 
Law.richard
Law.richardLaw.richard
Law.richardNASAPMC
 
Wood frank
Wood frankWood frank
Wood frankNASAPMC
 
Seftas krage
Seftas krageSeftas krage
Seftas krageNASAPMC
 
Sampietro marco
Sampietro marcoSampietro marco
Sampietro marcoNASAPMC
 
Mc namara.karen
Mc namara.karenMc namara.karen
Mc namara.karenNASAPMC
 
Roberts karlene
Roberts karleneRoberts karlene
Roberts karleneNASAPMC
 
Snow lee
Snow leeSnow lee
Snow leeNASAPMC
 
Yew manson
Yew mansonYew manson
Yew mansonNASAPMC
 
Wood frank
Wood frankWood frank
Wood frankNASAPMC
 
Humphreys.gary
Humphreys.garyHumphreys.gary
Humphreys.garyNASAPMC
 
Muller ralf
Muller ralfMuller ralf
Muller ralfNASAPMC
 
Bejmuk bo
Bejmuk boBejmuk bo
Bejmuk boNASAPMC
 

Destacado (20)

Paradis william
Paradis williamParadis william
Paradis william
 
Rudolphi mike
Rudolphi mikeRudolphi mike
Rudolphi mike
 
O'keefe william
O'keefe williamO'keefe william
O'keefe william
 
Baniszewski john
Baniszewski johnBaniszewski john
Baniszewski john
 
Rackley mike
Rackley mikeRackley mike
Rackley mike
 
Vellinga joe
Vellinga joeVellinga joe
Vellinga joe
 
Trahan stuart
Trahan stuartTrahan stuart
Trahan stuart
 
Smalley sandra
Smalley sandraSmalley sandra
Smalley sandra
 
Law.richard
Law.richardLaw.richard
Law.richard
 
Wood frank
Wood frankWood frank
Wood frank
 
Seftas krage
Seftas krageSeftas krage
Seftas krage
 
Sampietro marco
Sampietro marcoSampietro marco
Sampietro marco
 
Mc namara.karen
Mc namara.karenMc namara.karen
Mc namara.karen
 
Roberts karlene
Roberts karleneRoberts karlene
Roberts karlene
 
Snow lee
Snow leeSnow lee
Snow lee
 
Yew manson
Yew mansonYew manson
Yew manson
 
Wood frank
Wood frankWood frank
Wood frank
 
Humphreys.gary
Humphreys.garyHumphreys.gary
Humphreys.gary
 
Muller ralf
Muller ralfMuller ralf
Muller ralf
 
Bejmuk bo
Bejmuk boBejmuk bo
Bejmuk bo
 

Más de NASAPMC

Mulenburg jerry
Mulenburg jerryMulenburg jerry
Mulenburg jerryNASAPMC
 
Mitskevich amanda
Mitskevich amandaMitskevich amanda
Mitskevich amandaNASAPMC
 
Martt anne
Martt anneMartt anne
Martt anneNASAPMC
 
Manzer fred
Manzer fredManzer fred
Manzer fredNASAPMC
 
Manthos jeff
Manthos jeffManthos jeff
Manthos jeffNASAPMC
 
Lengyel dave
Lengyel daveLengyel dave
Lengyel daveNASAPMC
 
Krahula john
Krahula johnKrahula john
Krahula johnNASAPMC
 
Kroeger lin
Kroeger linKroeger lin
Kroeger linNASAPMC
 
Krage jousha
Krage joushaKrage jousha
Krage joushaNASAPMC
 
Kotnour tim
Kotnour timKotnour tim
Kotnour timNASAPMC
 
King richardson
King richardsonKing richardson
King richardsonNASAPMC
 

Más de NASAPMC (11)

Mulenburg jerry
Mulenburg jerryMulenburg jerry
Mulenburg jerry
 
Mitskevich amanda
Mitskevich amandaMitskevich amanda
Mitskevich amanda
 
Martt anne
Martt anneMartt anne
Martt anne
 
Manzer fred
Manzer fredManzer fred
Manzer fred
 
Manthos jeff
Manthos jeffManthos jeff
Manthos jeff
 
Lengyel dave
Lengyel daveLengyel dave
Lengyel dave
 
Krahula john
Krahula johnKrahula john
Krahula john
 
Kroeger lin
Kroeger linKroeger lin
Kroeger lin
 
Krage jousha
Krage joushaKrage jousha
Krage jousha
 
Kotnour tim
Kotnour timKotnour tim
Kotnour tim
 
King richardson
King richardsonKing richardson
King richardson
 

Último

"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 

Último (20)

"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 

Wessen randi (cd)

  • 1. National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Market-Based Systems: Bidding your way to the Launch Pad Dr. Randii R. Wessen Jet Propulsion Laboratory California Institute of Technology Dr. Dave Porter Interdisciplinary Center for Economic Science George Mason University 1
  • 2. Agenda • Introduction • Cassini Science Instrument Development • Space Shuttle Manifests • LightSAR Mission Planning • Market-Based Systems Applied to NASA Resource Allocation Problems • Conclusions 2
  • 3. Introduction Problem - How to allocate scarce resources among many users? ♦ Users do not have an incentive to reveal accurate information. Current Approach: ♦ Benevolent Dictator - Impartial individual making decisions for user community. ♦ Committee - “Consensus” reached by user representatives. New Approach: ♦ Market-based systems - Decentralized incentive-based decision-making at the user level. 3
  • 4. Introduction (cont.) Market-based systems use “rights” and “trades” to resolve conflicts. ♦ Users: – Own clearly defined resources. – Decide the importance of their resources. – Enhance their own position by exchanging resources among themselves. 4
  • 5. Introduction (cont.) Market-based systems require that an “economy” be created. To create an economy, the following must be defined: ♦ Resources to be allocated. ♦ Resource ownership rights. ♦ Rules for making and keeping track of trades. 5
  • 6. Introduction (cont.) Market-based systems have two major phases: ♦ Initial Allocation (Primary Market) - Users use “currency” to establish property rights over resources. ♦ Aftermarket (Secondary Market) - Users can voluntarily trade their resources with others to enhance their value. 6
  • 7. Introduction (cont.) Examples of Market-based systems used in private industry: ♦ Best Buy ♦ RECLAIM Program in ♦ Corning Southern California ♦ Federal ♦ Sandia National Communications Laboratories Commission ♦ Sears Logistic Services ♦ General Electric ♦ University of Chicago ♦ Google Business School ♦ Hewlett-Packard ♦ University of Michigan ♦ Koch Industries ♦ University of San Diego ♦ Microsoft 7
  • 8. The Cassini Instrument Development 8
  • 9. Cassini Instrument Development Typical instrument development for planetary missions require: ♦ Project’s to submit a Request for Proposals. ♦ Project’s acceptance of Principal Investigators’ proposals. Data from previous missions show that instrument mass and cost growths are: ♦ Almost always positive. ♦ Can be very large. 9
  • 10. Cassini Instrument Dev. (cont.) Percent Growth for Past Space Missions 10
  • 11. Cassini Instrument Dev. (cont.) In 1992 a Market-based Aftermarket, known as the Cassini Resource Exchange (CRE), was developed. ♦ Based on experiments conducted at Caltech with student subjects and science personnel. Instrument mass, power, data rate, and funding were allowed to be traded. ♦ The CRE opened in 1993 and closed in 1995. – 29 successful trades were made, all but two involved money and mass. 11
  • 12. Cassini Instrument Dev. (cont.) Example of a money-market trade: $200k this FY in return for $212k next FY = 6%. 16 contracts, worth $4M, were traded at an average rate of 8.5%. Fig 2. Money Market Activity 14 Cassini Trade 12 1 Year T-Bill 10 8 % Rate 6 4 2 0 0 20 40 60 80 100 120 140 160 180 200 Week Number Starting in FY93 12
  • 13. Cassini Instrument Dev. (cont.) Mass-market trades: ♦ Mass started at $105k/kg and fell to $5k/kg. ♦ 11 contracts for a total of 12 kg were traded. Figure 5: Mass Market Activity 120 100 80 $k/Kg 60 40 20 0 0 50 100 150 200 Week Number Starting in FY93 13
  • 14. Cassini Instrument Dev. (cont.) Cost for the entire science payload grew by <1%. Figure 6: Cassini's Instrument Cost Growth 60 50 40 ost, $M LOA Cost 30 otal C Final Cost T 20 10 0 R S PS S S G IS A S S I S IM A W M IM IR A RS IS D V A D M IN M C C RP U V C RA Investigations 14
  • 15. Cassini Instrument Dev. (cont.) Mass for the entire science payload decreased by 7%. Figure 7: Cassini's Instrument Mass Growth 70 60 50 40 ass, kg. LOA Mass Final Mass 30 M 20 10 0 R S PS S S G IS A S S I S IM A W M IM IR A RS IS D V A D M IN M C C RP U V C RA Investigations 15
  • 16. Cassini Instrument Dev. (cont.) In 1998 a Market-based system was developed for Cassini science planning. ♦ Web-based application. – Password protected. ♦ Used to allocate observation time, CDS words and data volume. ♦ Compatible with JPL’s Mission Sequence Software System (e.g., APGEN) 16
  • 17. Cassini Instrument Dev. (cont.) Cassini science planning bid sheet. 17
  • 18. Cassini Instrument Dev. (cont.) • Cassini Science Planning Tool. ♦ Timeline is always conflict-free. ♦ Provides user feedback to get observation requests accepted. ♦ This system was never tested. 18
  • 19. Space Shuttle Manifests of Secondary Payloads 19
  • 20. Space Shuttle Manifests Typical approach for manifesting Space Shuttles Secondary Payloads require: ♦ NASA User Codes to submit requests for payload lockers. ♦ Manifestors at NASA Headquarters allocate lockers in such a way to: – Utilize Space Shuttle resources to capacity. – Be “fair” to the User Codes. 20
  • 21. Space Shuttle Manifests (cont.) Multiple meetings required to: ♦ Present current manifest. ♦ Explain why some payloads were included while others were not. ♦ Obtain payload trade-off information. Manifestors required to re-manifest secondary payloads after each meeting. 21
  • 22. Space Shuttle Manifests (cont.) In the summer of 1996 a Market-based Initial Allocation experiment was developed for NASA’s Office of Space Utilization. ♦ Market-based approach was compared to a simple ranking approach. ♦ Secondary payload lockers, energy, and crew hour requirements were allowed to be requested. 22
  • 23. Space Shuttle Manifests (cont.) Office of Space Utilization personnel performed the simple ranking manifest. ♦ Results were compared to market-based results. Real payload data was used. ♦ A “science return” value and payload rank were included to measure the caliber of the manifest. USER P/L LOCKERS WATT-HRS CREW-HRS SCIENCE RETURN RANK Code U MGBX-01 6 237 56 100 1 Code U CGBA-04 4 136 5.166 70 2 Code U CPCG-07 1 128 5.833 55 2 Code U CPCG-08 1 128 2 45 3 Code U PCG-TES-02 3 115 0 40 3 23
  • 24. Space Shuttle Manifests (cont.) Comparison of resource utilization between a simple ranking vs a market-based approach. Ranking Manual Resource Utilization MBS Points 100 % of Capacity Used 95 90 85 80 75 Lockers Watt-Hrs Crew-Hrs 24
  • 25. Space Shuttle Manifests (cont.) Comparison of science value for a simple ranking vs a market-based approach. Additional Science Return Relative to Baseline 40 Year 1 Year 2 30 Total % Excess Return 20 10 0 -10 -20 -30 Code U Code S Code X Code F DoD Point carry-over 0 37 30 3 1 Year 1 to Year 2 25
  • 26. Space Shuttle Manifests (cont.) Market-based systems have already handled the following type of problem: ♦ Manifest space shuttles middeck lockers efficiently ♦ 6 Users ♦ 47 variables/payload ♦ 1,500,000 payload requests ♦ Solutions found in an average of 2.5 minutes 26
  • 27. Space Shuttle Manifests (cont.) Implementation of a market-based system is “on-hold” until: ♦ The full impact of the International Space Station’s requirements on middeck lockers can be determined. ♦ “Nominal” Space Shuttle missions resume. 27
  • 29. LightSAR Mission Planning LightSAR was a NASA initiative to develop a low-cost Earth-imaging RADAR satellite. Typical approach for mission planning: ♦ Submit data take requests. ♦ Create integrated timeline. ♦ Multiple meetings to resolve conflicts. ♦ Re-Integrate timeline. 29
  • 30. LightSAR Mission Planning (cont.) In the winter of 1997 a Market-based Initial Allocation experiment was developed for LightSAR mission planning. ♦ Users were assigned a specific data acquisition type (e.g. Hi-Res Strip, Spotlight, Interferometry, Dual Polarimetry, etc.). 30
  • 31. LightSAR Mission Planning (cont.) A data request, rank and “science return” value were included with each request to measure the caliber of the manifest. Dual Polarimetry Requests Location Orbit Data Take Rank Value Number Number Vietnam 1 1 1 60 Kuala Lumpar 1 3 2 45 Indonesia 1 4 2 35 Cambodia 2 3 3 10 31
  • 32. LightSAR Mission Planning (cont.) In a market-based approach, Users bid for a “higher priority” request. ♦ The higher the priority, the greater the probability of getting into the timeline. ♦ A Vickrey Auction was used to provide “incentives” for the Users to be forthright about their bids. – In a Vickrey Auction “winners”pay the runner-up price. 32
  • 33. LightSAR Mission Planning (cont.) Comparison of the science value between a simple ranking, a simple market, and a market using a Vickrey Auction. Science Values 108 Simple Market Simple Market Priority Marke Market w/ Vickrey 107 106 % of Draft Outcome 105 104 103 102 101 Science value using a simple ranking 100 approach 99 Subject 1 Subject 2 Subject 3 Subject 4 Cumulative 33
  • 38. LightSAR Mission Planning (cont.) Experiments revealed only minor operational problems. ♦ Lack of experience seemed to be the largest. LightSAR was canceled. A new RADAR mission called INSAR has begun concept studies. ♦ The work on LightSAR can be used for INSAR and will be pursued. 38
  • 39. Market-Based Systems Applied to NASA Resource Allocation Problems 39
  • 40. NASA Market-Based Systems Task Start End Status Cassini Instrument Successfully controlled mass and 1993 Sept 1995 April Development cost growth. Space Shuttle 1996 Dec 1997 Sept Never made it past experiments. Manifests LightSAR Mission 1997 Dec 1998 Sept Mission canceled. Planning Cassini Science Never performed experiments 1998 April 1999 Mar Planning with users. Mars’01 Science 1999 April 1999 Dec Mission canceled. Planning International Space Never performed experiments 2000 Sept On Hold Station Manifests with users. Alternate Workforce Never performed experiments 2000 Jun 2002 Jan Allocations with users. Deep Space Network Never performed experiments 2005 Jan 2005 April Antenna Allocation with users. 40
  • 42. Conclusions Cassini, Space Shuttle, and LightSAR benefited (or could benefit) from the use of a market-based process. Resource allocation problems can be solved with the use of market-based systems. ♦ Data shows that market-based systems can produce results: – As good (or better) than the current processes. – Are reached quicker and with a smaller workforce. 42
  • 43. Conclusions The strengths of market-based systems are that they: ♦ Move the decision making process back to the individuals that have the information, namely the users. ♦ Are electronically based on the Web and thus can be globally distributed. ♦ Remove the need for multiple meetings and appeals. 43
  • 44. Conclusions One perceived short coming of market-based systems is their initial allocation. ♦ However, all processes have initial allocation problems. ♦ Better to solve one large problem early then multiple smaller problems late in a given process. Most individuals outside of experimental economics do not appreciate the power of market-based systems. 44
  • 45. Conclusions In order to successfully implement a market- based system it is recommended that it be used in parallel with the current approach to “gently” help users understand its application. There will be resistance to change to a new system, even a more efficient one. ♦ Winners are not sure that they’ll do as well as compared to the current process. ♦ Losers are not sure that they’ll do better as compared to the current process. ♦ Integrators lose their jobs. ♦ Managers will express a loss of control. 45
  • 46. Conclusions Top 5 “bad” reasons for not using a market- based system: 5. “Market-based systems can solve resource allocation problems, but my problem is different.” 4. “We don’t have a resource allocation problem, we just just have a scheduling problem.” 3. “There’s no way to come up with an initial allocation of resources.” 2. “Too many people will lose their jobs.” 1. “We don’t need a market-based system to solve our problems. We’ll just solve it in a collegial manner.” 46