SlideShare una empresa de Scribd logo
1 de 149
Descargar para leer sin conexión
NASA
Systems
Engineering
Handbook




SP-610S
June 1995
NASA Systems Engineering Handbook                                                                             Page            ii


Foreword                                                        from a systems perspective, starting at mission needs and
                                                                conceptual studies through operations and disposal.
          In an attempt to demonstrate the potential
                                                                           While it would be impossible to thank all of the
dangers of relying on purely ''cookbook" logical
                                                                people directly involved, it is essential to note the efforts of
thinking, the mathematician/philosopher Carl Hempel             Dr. Robert Shishko of the Jet Propulsion Laboratory. Bob
posed a paradox. If we want to prove the hypothesis             was largely responsible for ensuring the completion of this
“AII ravens are black," we can look for many ravens             effort. His technical expertise and nonstop determination
and determine if they all meet our criteria. Hempel             were critical factors to ensure the success of this project.
suggested changing the hy –pothesis to its logical
contrapositive (a rewording with identical meaning)                      Mihaly Csikzenthmihali defined an optimal
would be easier. The new hypothesis becomes: "All               experience as one where there is "a sense of exhilaration, a
                                                                deep sense of enjoyment that is long cherished and
nonblack things are nonravens." This transformation,
                                                                becomes a landmark in memory of what life should be like." I
supported by the laws of logical thinking, makes it             am not quite sure if the experience which produced this hand
much easier to test, but unfortunately is ridiculous.           –book can be described exactly this way, yet the sentiment
Hempel's raven paradox points out the importance of             seems reasonably close.
common sense and proper background exploration,
even to subjects as intricate as systems engineering.                                             —Dr. Edward J. Hoffman
                                                                                      Program Manager, NASA Headquarters
In 1989, when the initial work on the NASA Systems                                                            Spring 199
Engineering Handbook was started, there were many
who were concerned about the dangers of a
document that purported to teach a generic NASA
approach to systems engineering. Like Hempel's
raven, there were concerns over the potential of
producing a "cookbook" which of fered the illusion of
logic while ignoring experience and common sense.
From the tremendous response to the initial
(September 1992) draft of the handbook (in terms of
both requests for copies and praise for the product), it
seems early concerns were largely unfounded and
that there is a strong need for this handbook.

          The document you are holding represents what
was deemed best in the original draft and updates
information necessary in light of recommendations and
changes within NASA. This handbook represents some of
the best thinking from across NASA. Many experts
influenced its outcome, and consideration was given to each
idea and criticism. It truly represents a NASA-wide product
and one which furnishes a good overview of NASA systems
engineering.

           The handbook is intended to be an educational
guide written from a NASA perspective. Individuals who take
systems engineering courses are the primary audience for
this work. Working professionals who require a guidebook to
NASA systems engineering represent a secondary
audience.

           It was discovered during the review of the draft
document that interest in this work goes far beyond NASA.
Requests for translating this work have come from
international sources, and we have been told that the draft
hand book is being used in university courses on the subject.
All of this may help explain why copies of the original draft
handbook have been in short supply.

          The main purposes of the NASA Systems
Engineering Handbook are to provide: 1) useful information
to system engineers and project managers, 2) a generic
description of NASA systems engineering which can be
supported by
center-specific documents, 3) a common language and
perspective of the systems engineering process, and 4) a
reference work which is consistent with NMI 7120.4/NHB
7120.5. The handbook approaches systems engineering
NASA Systems Engineering Handbook                                                                   Page        iii



Foreword to the September 1992 Draft                                  As such, this present document is to be
                                                             considered a next-to-final draft. Your comments,
         When NASA began to sponsor agency –                 corrections and suggestions are welcomed, valued
wide classes in systems engineering, it was to a             and appreciated. Please send your remarks directly to
doubting audience. Top management was quick to               Robert Shishko, NASA Systems
express concern. As a former Deputy Administrator            Engineering Working Group. NASA/Jet Propulsion
stated "How can you teach an agency-wide systems             Laboratory, California Institute of Technology,
engineering class when we cannot even agree on               4800 Oak Grove Drive, Pasadena, CA
how to define it?" Good question, and one I must             91109-8099.
admit caused us considerable concern at that time.                                                —Francis T. Hoban
The same doubt continued up until the publication of                     Program Manager, NASA Headquarters
this handbook.

          The initial systems engineering education
conference was held in January 1989 at the Johnson
Space Center. A number of representatives from
other Centers at tended this meeting and it was
decided then that we needed to form a working group
to support the development of appropriate and
tailored systems engineering courses. At this meeting
the representatives from Marshal1 Space Flight
Center (MSFC) expressed a strong desire to docu
ment their own historic systems engineering process
before any more of the key players left the Center.
Other Centers also expressed a desire, if not as
urgent as MSFC, to document their processes.

           It was thought that the best way to reflect the
totality of the NASA systems engineering process and
to aid in developing the needed training was to
prepare a top level (Level 0) document that would
contain a broad definition of systems engineering, a
broad process outline, and typi cal tools and
procedures. In general, we wanted a top level
overview of NASA systems engineering. To this
document would be appended each Center's unique
systems engineering manual. The group was well
aware of the diversity each Center may have, but
agreed that this approach would be quite acceptable.

          The next step and the most difficult in this
arduous process was to find someone to head this
yet-to-be-formed working group. Fortunately for
NASA, Donna [Pivirotto] Shirley of the Jet Propulsion
Laboratory stepped up to the challenge. Today,
through her efforts, those of the working group, and
the skilled and dedicated authors, we have a unique
and possibly a historic document.

           During the development of the manual we
decided to put in much more than may be appropriate
for a Level 0 document with the idea that we could
always refine the document later. It was more
important to capture the knowledge when we could in
order to better position our selves for later
dissemination. If there is any criticism, it may be the
level of detail contained in the manual, but this detail
is necessary for young engineers. The present
document does appear to serve as a good
instructional guide, although it does go well beyond its
original intent.
NASA Systems Engineering Handbook                                                                   Page         5


Preface                                                     JSC-49040. The SEPIT project life cycle is
                                                            intentionally consistent with that in NMI 7120.4/NHB
          This handbook was written to bring the            7120.5 (Management of Major System Programs and
fundamental concepts and techniques of systems              Projects), but provides more detail on its systems
engineering to NASA personnel in a way that                 engineering aspects.
recognizes the nature of NASA systems and the
NASA environment. The authors readily acknowledge                     This handbook consists of five core
that this goal will not be easily realized. One reason is   chapters: (1) systems engineering's intellectual
that not everyone agrees on what systems                    process, (2) the NASA project life cycle, (3)
engineering is, nor on how to do it. There are              management issues in systems engineering, (4)
legitimate differences of opinion on basic definitions,     systems analysis and modeling issues, and (5)
content, and techniques. Systems engineering itself is      engineering specialty integration. These core
a broad subject, with many different aspects. This          chapters are supplemented by appendices, which can
initial handbook does not (and cannot) cover all of         be expanded to accommodate any number of
them.                                                       templates and examples to illustrate topics in the core
                                                            chapters. The handbook makes extensive use of
          The content and style of this handbook show       sidebars to define, refine, illustrate, and extend
a teaching orientation. This handbook was meant to          concepts in the core chapters without diverting the
accompany formal NASA training courses on systems           reader from the main argument. There are no
engineering, not to be a stand-alone, comprehensive         footnotes; sidebars are used instead. The structure of
view of NASA systems engineering. Systems                   the handbook also allows for additional sections and
engineering, in the authors' opinions, cannot be            chapters to be added at a later date.
learned simply by starting at a well-defined beginning      Finally, the handbook should be considered only a
and proceeding seamlessly from one topic to another.        starting point. Both NASA as a systems engineering
Rather, it is a field that draws from many engineering      organization, and systems engineering as a discipline,
disciplines and other intellectual domains. The             are undergoing rapid evolution. Over the next five
boundaries are not always clear, and there are many         years, many changes will no doubt occur, and some
interesting intellectual offshoots. Consequently, this      are already in progress. NASA, for instance, is
handbook was designed to be a top-level overview of         moving toward implementation of the standards in the
systems engineering as a discipline; brevity of             International Standards Organization (ISO) 9000
exposition and the provision of pointers to other books     family, which will affect many aspects of systems
and documents for details were considered important         engineering. In systems engineering as a discipline,
guidelines.                                                 efforts are underway to merge existing systems
                                                            engineering standards into a common American
          The material for this handbook was drawn          National Standard on the Engineering of Systems,
from many different sources, including field center         and then ultimately into an international standard.
systems engineering handbooks, NASA management              These factors should be kept in mind when using this
instructions (NMls) and NASA handbooks (NHBs),              handbook
field center briefings on systems engineering
processes, non-NASA systems engineering textbooks
and guides, and three independent systems
engineering courses taught to NASA audiences. The
handbook uses this material to provide only top-level
information and suggestions for good systems
engineering practices; it is not intended in any way to
be a directive.

           By design, the handbook covers some topics
that are also taught in Project Management/Program
Control (PM/PC) courses, reflecting the unavoidable
connectedness
of these three domains. The material on the NASA
project life cycle is drawn from the work of the NASA-
wide Systems Engineering Working Group (SEWG),
which met periodically in 1991 and 1992, and its
successor, the Systems Engineering Process
Improvement Task (SEPIT) team, which met in 1993
And 1994. This handbook's project life cycle is
identical to that promulgated in the SEPIT report,
NASA Systems
Engineering Process for Programs and Projects,
NASA Systems Engineering Handbook                                                              Page         6


Acknowledgements                                         Mr. Don Woodruff, NASA/Marshall Space Flight
This work was conducted under the overall direction      Center
of Mr. Frank Hoban, and then Dr. Ed Hoffman, NASA
Headquarters/Code FT, under the NASA Pro-                Other Sources:
gram/Project Management Initiative (PPMI). Dr.           Mr. Dave Austin, NASA Headquarters/Code DSS
Shahid Habib, NASA Headquarters/Code QW,                 Mr. Phillip R. Barela, NASA/Jet Propulsion Laboratory
provided additional financial support to the NASA-       Mr. J.W. Bott, NASA/Jet Propulsion Laboratory
wide Systems Engineering Working Group and               Dr. Steven L. Cornford, NASA/Jet Propulsion
Systems Engineering Process Improvement Task             Laboratory
team. Many individuals, both in and out of NASA,         Ms. Sandra Dawson, NASA/Jet Propulsion Laboratory
contributed material, reviewed various drafts, or        Dr. James W. Doane, NASA/Jet Propulsion
otherwise provided valuable input to this handbook.      Laboratory
Unfortunately, the lists below cannot include everyone   Mr. William Edminston, NASA/Jet Propulsion
who shared their ideas and experience.                   Laboratory
                                                         Mr. Charles C. Gonzales, NASA/Jet Propulsion
Principal Contributors:                                  Laboratory
Dr. Robert Shishko, NASA/Jet Propulsion Laboratory       Dr. Jairus Hihn, NASA/Jet Propulsion Laboratory
Mr. Robert G. Chamberlain, P.E., NASA/Jet                Dr. Ed Jorgenson, NASA/Jet Propulsion Laboratory
Propulsion Laboratory                                    Mr. Richard V. Morris, NASA/Jet Propulsion
                                                         Laboratory
Other Contributors:                                      Mr. Tom Weber, Rockwell International/Space
Mr. Robert Aster, NASA/Jet Propulsion Laboratory         Systems
Ms. Beth Bain, Lockheed Missiles and Space
Company                                                  Reviewers:
Mr. Guy Beutelschies, NASA/Jet Propulsion                Mr. Robert C. Baumann, NASA/Goddard Space Flight
Laboratory                                               Center
Dr. Vincent Bilardo, NASA/Ames Research Center           Mr. Chris Carl, NASA/Jet Propulsion Laboratory
Ms. Renee I. Cox, NASA/Marshall Space Flight             Dr. David S.C. Chu, Assistant Secretary of
Center                                                   Defense/Pro-gram
Dr. Kevin Forsberg, Center for Systems Management        Analysis and Evaluation
Dr. Walter E. Hammond, Sverdrup Techology, Inc.          Mr. M.J. Cork, NASA/Jet Propulsion Laboratory
Mr. Patrick McDuffee, NASA/Marshall Space Flight         Mr. James R. French, JRF Engineering Services
Center                                                   Mr. John L. Gasery, Jr., NASA/Stennis Space Center
Mr. Harold Mooz, Center for Systems Management           Mr. Frederick D. Gregory, NASA Headquarters/Code
Ms. Mary Beth Murrill, NASA/Jet Propulsion               Q
Laboratory                                               Mr. Don Hedgepeth, NASA/Langley Research Center
Dr. Les Pieniazek Lockheed Engineering and               Mr. Jim Hines, Rockwell International/Space Systems
ScienceS                                                 Mr. Keith L. Hudkins, NASA Headquarters/Code MZ
Co. Mr. Lou Polaski, Center for Systems Management       Dr. Jerry Lake, Defense Systems Management
Mr. Neil Rainwater, NASA/Marshall Space Flight           College
Center                                                   Mr. T.J. Lee, NASA/Marshall Space Flight Center
Mr. Tom Rowell, NASA/Marshall Space Flight Center        Mr. Jim Lloyd, NASA Headquarters/Code QS
Ms. Donna Shirley, NASA/Jet Propulsion Laboratory        Mr. Woody Lovelace, NASA/Langley Research
Mr. Mark Sluka, Lockheed Engineering and Sciences        Center
Co. Mr. Ron Wade, Center for Systems Management          Dr. Brian Mar, Department of Civil Engineering,
SEPIT team members (not already mentioned):              University
Mr. Randy Fleming, Lockheed Missiles and Space           of Washington
Co.                                                      Dr. Ralph F. Miles, Jr., Center for Safety and System
Dr. Frank Fogle, NASA/Marshall Space Flight Center       Management, University of Southern California
Mr. Tony Fragomeni, NASA/Goddard Space Flight            Dr. Richard A. Montgomery, Montgomery and
Center Dr. Shahid Habib, NASA Headquarters/Code          Associates
QW                                                       Mr. Bernard G. Morais, Synergistic Applications, Inc.
Mr. Henning Krome, NASA/Marshall Space Flight            Mr. Ron Moyer, NASA Headquarters/Code QW
Center                                                   Mr. Rudy Naranjo, NASA Headquarters/Code MZ
Mr. Ray Lugo, NASA/Kennedy Space Center                  Mr. Raymond L. Nieder, NASA/Johnson Space
Mr. William C. Morgan, NASA/Johnson Space Center         Center
Dr. Mike Ryschkewitsch, NASA/Goddard Space Flight        Mr. James E. Pearson, United Technologies
Center                                                   Research
Mr. Gerry Sadler, NASA/Lewis Research Center             Center
Mr. Dick Smart, Sverdrup Technology, Inc.                Mr. Leo Perez, NASA Headquarters/Code QP
Dr. James Wade, NASA/Johnson Space Center                Mr. David Pine, NASA Headquarters/Code B
Mr. Milam Walters, NASA/Langley Research Center
NASA Systems Engineering Handbook                  Page   7


Mr. Glen D. Ritter, NASA/Marshall Space Flight
Center
Dr. Arnold Ruskin, NASA/Jet Propulsion
Laboratory and University of California at
Los Angeles
Mr. John G. Shirlaw, Massachusetts Institute of
Technology
Mr. Richard E. Snyder, NASAlLangley Research
Center
Mr. Don Sova, NASA Headquarters/Code AE
Mr. Marvin A. Stibich, USAF/Aeronautical Systems
Center
Mr. Lanny Taliaferro, NASAtMarshall Space Flight
Center
Editorial and graphics support:
Mr. Stephen Brewster, NASA/Jet Propulsion
Laboratory
Mr. Randy Cassingham, NASA/Jet Propulsion
Laboratory
Mr. John Matlock, NASA/Jet Propulsion Laboratory
—Dr. Robert Shishko
Task Manager, NASA/Jet Propulsion Laboratory
NASA Systems Engineering Handbook                                                                     Page         1


1 Introduction                                                           The subject matter of systems engineering is
1.1 Purpose                                                    very broad. The coverage in this handbook is limited
                                                               to general concepts and generic descriptions of
         This handbook is intended to provide                  processes, tools, and techniques. It provides
information on systems engineering that will be useful         information on good systems engineering practices,
to NASA sys-tem engineers, especially new ones. Its            and pitfalls to avoid.
primary objective is to provide a generic description of       There are many textbooks that can be consulted for
systems engineering as it should be applied                    in-depth tutorials.
throughout NASA. Field centers' handbooks are
encouraged to provide center-specific details of                        This    handbook      describes    systems
implementation.                                                engineering as it should be applied to the
                                                               development of major NASA systems. Systems
         For NASA system engineers to choose to                engineering deals both with the system being
keep a copy of this handbook at their elbows, it must          developed (the product system) and the system that
provide answers that cannot be easily found                    does the developing (the producing system).
elsewhere. Conse-quently, it provides NASA-relevant            Consequently, the handbook's scope properly
perspectives and NASA-particular data. NASA                    includes systems engineering functions regardless of
management instructions (NMIs) are referenced when             whether they are performed by an in-house systems
applicable.                                                    engineering organization, a program/project office, or
                                                               a system contractor.
         This handbook's secondary objective is to
serve as a useful companion to all of the various                        While many of the producing system's
courses in systems engineering that are being offered          design features may be implied by the nature of the
under NASA's auspices.                                         tools and techniques of systems engineering, it does
                                                               not follow that institutional procedures for their
                                                               application must be uniform from one NASA field
1.2 Scope and Depth                                            center to another.


                                         Selected Systems Engineering Reading

  See the Bibliography for full reference data and further reading suggestions.

  Fundamentals of Systems Engineering
  Systems Engineering and Analysis (2nd ed.), B.S. Blanchard and W.J. Fabrycky
  Systems Engineering, Andrew P. Sage
  An Introduction to Systems Engineering, J.E. Armstrong and Andrew P. Sage

  Management Issues in Systems Engineering
  Systems Engineering, EIA/IS-632
  IEEE Trial-Use Standard for application and Management of the Systems Engineering Process, IEEE Std 1220-
  1994
  Systems Engineering Management Guide, Defense Systems Management College
  System Engineering Management, B.S. Blanchard
  Systems Engineering Methods, Harold Chestnut
  Systems Concepts, Ralph Miles, Jr. (editor)
  Successful Systems Engineering for Engineers and Managers, Norman B. Reilly

  Systems Analysis and Modeling
  Systems Engineering Tools, Harold Chestnut
  Systems Analysis for Engineers and Managers, R. de Neufville and J.H. Stafford
  Cost Considerations in Systems Analysis, Gene H. Fisher

  Space Systems Design and Operations
  Space Vehicle Design, Michael D. Griffin and James R. French
  Space Mission Analysis and Design (2nd ed.), Wiley J. Larson and James R. Wertz (editors)
  D i    fG        h        S        ft B ij N A       l
NASA Systems Engineering Handbook                                                                  Page          2


2 Fundamentals of Systems Engineering                               The NASA management instruction for the
                                                          acquisition of “major" systems (NMI 7120.4) defines a
2.1 Systems, Supersystems, and                            program as “a related series of undertakings that
                                                          continue over a period of time (normally years), which
Subsystems                                                are designed to pursue, or are in support of, a
                                                          focused scientific or technical goal, and which are
A system is a set of interrelated components which        characterized by: design, development, and
interact with one another in an organized fashion         operations of systems." Programs are managed by
toward a common purpose. The components of a              NASA Headquarters, and may encompass several
system may be quite diverse, consisting of persons,       projects.
organizations, procedures, software, equipment, end                 In the NASA context, a project encompasses
'or facilities. The purpose of a system may be as         the design, development, and operation of one or
humble as distributing electrical power within a          more sys-tems, and is generally managed by a NASA
spacecraft or as grand as exploring the surface of        field center.
Mars.                                                               Headquarters'      management        concerns
                                                          include not only the engineering of the systems, but
        Every system exists in the context of a           all of the other activities required to achieve the
broader supersystem, i.e., a collection of related        desired end. These other activities include explaining
systems. It is in that context that the system must be    the value of programs and projects to Congress and
                                                          enlisting international cooperation. The term mission
          A Hierarchical System Terminology               is often used for a program project's purpose; its
                                                          connotations of fervor make it particu-larly suitable for
 The following hierarchical sequence of terms for         such political activities, where the emo-tional content
 suc-cessively finer resolution was adopted by the        of the term is a desirable factor. In everyday
 NASA –wide Systems Engineering Working                   conversation, the terms "project," "mission," and
 Group (SEWG) and its successor, the Systems              "system" are often used interchangeably; while
 Engineering Process Im-provement Task (SEPIT)            imprecise, this rarely causes difficulty.
 team:

           System                                             The Technical Sophistication Required to do
               Segment                                        Systems Engineering Depends on the Project
                  Element
                     Subsystem                             • The system's goals may be simple and easy to
                        Assembly                           identify and measure—or they may be technically
                             Subassembly                   complicated, requiring a great deal of insight
                                Part                       about the environment or technology within or with
                                                           which the system must operate.
  Particular projects may need a different sequence
  of layers— an instrument may not need as many            • The system may have a single goal—or multiple
  layers, while a broad initiative may need to             goals. There are techniques available for
  distinguish more layers. Projects should establish       determining the relative values of multiple goals
judged. Thus, managers in the supersystem set              — but sometimes goals are truly incommensurate
system policies, establish system objectives,              and unquantifiable.
determine system constraints, and define what costs
are relevant. They often have oversight authority over     • The system may have users representing
system design and operations decisions.                    factions with conflicting objectives. When there
                                                           are      conflicting     objectives,   negotiated
          Most NASA systems are sufficiently complex       compromises will be required.
that their components are subsystems, which must
function in a coordinated way for the system to            • Alternative system design concepts may be
accomplish its goals. From the point of view of            abundant—or they may require creative genius to
systems engineering, each subsystem is a system in         develop.
its own right—that is, policies, requirements,
objectives, and which costs are relevant are
                                                           • A "back-of-the-envelope" computation may be
established at the next level up in the hierarchy.
                                                           satisfactory for prediction of how well the
Spacecraft systems often have such subsystems as
                                                           alternative design concepts would do in
propulsion, attitude control telecommunications, and
                                                           achievement of the goals—or credibility may
power. In a large project, the subsystems are likely to
                                                           depend upon construction and testing of hardware
be called "systems". The word system is also used
                                                           or software models.
within NASA generically, as defined in the first
paragraph above. In this handbook, system" is
generally used in its generic form.
NASA Systems Engineering Handbook                                                                    Page            3


2.2 Definition of Systems Engineering                        system must provide the most effectiveness for the
                                                             resources expended or, equivalently, it must be the
Systems engineering is a robust approach to the              least expensive for the effectiveness it provides. This
design, creation, and operation of systems. In simple        condition is a weak one because there are usually
terms, the approach consists of identification and           many designs that meet the condition. Think of each
quantification of system goals, creation of alternative      possible design as a point in the tradeoff space
system design concepts, performance of design                                         Cost
trades, selection and implementation of the best
                                                               The cost of a system is the foregone value of the
          Systems Engineering per ElA/IS-632
                                                               re-sources needed to design, build, and operate it.
                                                               Be-cause resources come in many forms— work
 Systems engineering is "an interdisciplinary approach
 encompassing the entire technical effort to evolve and
                                                               per-formed by NASA personnel and contractors,
 verify an integrated and life-cycle balanced set of sys-      materials, energy, and the use of facilities and
 tem people, product, and process solutions that satisfy       equipment such as wind tunnels, factories, offices,
 customer needs. Systems engineering encompasses (a)           and computers—it is of en convenient to express
 the technical efforts related to the development,             these values in common terms by using monetary
 manufacturing, verification, deployment, operations,          units (such as dollars).
 support) disposal of, and user training for, system prod-
 ucts and processes; (b) the definition and management                            Effectiveness
 of the system configuration; (c) the translation of the
 system definition into work breakdown structures; and
                                                               The effectiveness of a system is a quantitative
 (d) development of information for management deci-
 sion making."                                                 measure of the degree to which the system's
                                                               purpose is achieved. Effectiveness measures are
                                                               usually     very     dependent      upon    system
design, verification that the design is properly built
                                                               performance. For example, launch vehicle
and integrated, and post-implementation assessment
                                                               effectiveness depends on the probability of
of how well the system meets (or met) the goals. The
                                                               successfully injecting a payload onto a usable
approach is usually applied repeatedly and
                                                               trajectory. The associated system performance
recursively, with several increases in the resolution of
                                                               attributes include the mass that can be put into a
the system baselines (which contain requirements,
                                                               specified nominal orbit, the trade between injected
design details, verification procedures and standards,
                                                               mass and launch velocity, and launch availability.
cost and performance estimates, and so on).
                                                                               Cost-Effectiveness
          Systems engineering is performed in concert
with system management. A major part of the system             The cost-effectiveness of a system combines both
engineer's role is to provide information that the             the cost and the effectiveness of the system in the
system manager can use to make the right decisions.            context of its objectives. While it may be
This includes identification of alternative design             necessary to measure either or both of those in
concepts and characterization of those concepts in
ways that will help the system managers first discover       between effectiveness and cost. A graph plotting the
their preferences, then be able to apply them astutely.      maximum achievable effectiveness of designs
An important aspect of this role is the creation of          available with current technology as a function of cost
system models that facilitate assessment of the              would in general yield a curved line such as the one
alternatives in various dimensions such as cost,             shown in Figure 1. (In the figure, all the dimensions of
performance, and risk.                                       effectiveness are represented by the ordinate and all
                                                             the dimensions of cost by the abscissa.) In other
         Application of this         approach includes       words, the curved line represents the envelope of the
performance of some delegated        management duties,      currently available technology in terms of cost -
such as maintaining control          of the developing       effectiveness.
configuration and overseeing         the integration of                Points above the line cannot be achieved
subsystems.                                                  with currently available technology e that is, they do
                                                             not represent feasible designs. (Some of those points
2.3 Objective of Systems Engineering                         may be feasible in the future when further
                                                             technological advances have been made.) Points
                                                             inside the envelope are feasible, but are dominated
        The objective of systems engineering is to
                                                             by designs whose combined cost and effectiveness
see to it that the system is designed, built, and
                                                             lie on the envelope. Designs represented by points on
operated so that it accomplishes its purpose in the
                                                             the envelope are called cost-effective (or efficient or
most cost-effective way possible, considering
                                                             non-dominated) solutions.
performance, cost, schedule, and risk.
                                                                       Design trade studies, an important part of
                                                             the systems engineering process, often attempt to
A cost-effective system must provide a particular kind
                                                             find designs that provide a better combination of the
of balance between effectiveness and cost: the
NASA Systems Engineering Handbook                                                                     Page          4


various dimensions of cost and effectiveness. When          likely point, as is shown for design concept A in the
the starting point for a design trade study is inside the   figure. Distributions resulting from designs which have
envelope, there are alternatives that reduce costs          little uncertainty are dense and highly compact, as is
without decreasing any aspect of effectiveness. or          shown for concept B. Distributions associated with
increase some aspect of effectiveness with                  risky designs may have significant probabilities of
                                                            producing highly undesirable outcomes, as is
                                                            suggested by the presence of an additional low
                                                            effectiveness/high cost cloud for concept C. (Of
                                                            course, the envelope of such clouds cannot be a
                                                            sharp line such as is shown in the figures, but must
                                                            itself be rather fuzzy. The line can now be thought of
                                                            as representing the envelope at some fixed
                                                            confidence level -- that is, a probability of x of
                                                            achieving that effectiveness.)

                                                                      Both effectiveness and cost may require
                                                            several descriptors. Even the Echo balloons obtained
                                                            scientific data on the electromagnetic environment
                                                            and atmospheric drag, in addition to their primary
                                                            mission as communications satellites. Furthermore,
                                                            Echo was the first satellite visible to the naked eye, an
                                                            unquantified -- but not unrecognized —aspect of its
Figure 1 -- The Enveloping Surface of Non-dominated
                                                            effectiveness. Costs, the expenditure of limited
Designs.
                                                            resources, may be measured in the several
                                                            dimensions of funding, personnel, use of facilities,
out decreasing others and without increasing costs.
                                                            and so on. Schedule may appear as an attribute of
Then, the system manager's or system engineer's
                                                            effectiveness or cost, or as a constraint. Sputnik, for
decision is easy. Other than in the sizing of
                                                            example, drew much of its effectiveness from the fact
subsystems, such "win-win" design trades are
                                                            that it was a "first"; a mission to Mars that misses its
uncommon, but by no means rare. When the
                                                            launch window has to wait about two years for
alternatives in a design trade study, however, require
                                                            another opportunity—a clear schedule constraint.
trading cost for effectiveness, or even one dimension
                                                            Risk results from uncertainties in realized
of effectiveness for another at the same cost, the
                                                            effectiveness, costs, timeliness, and budgets.
decisions become harder.
                                                                      Sometimes, the systems that provide the
                                                            highest ratio of effectiveness to cost are the most
                                                            desirable. However, this ratio is likely to be
                                                            meaningless or—worse—misleading. To be useful
                                                            and meaningful, that ratio must be uniquely
                                                            determined and independent of the system cost.
                                                            Further, there must be but a single measure of
                                                            effectiveness and a single measure of cost. If the
                                                            numerical values of those metrics are obscured by
                                                            probability distributions, the ratios become uncertain
                                                            as well; then any usefulness the simple, single ratio of
                                                            two numbers might have had disappears.
                                                                      In some contexts, it is appropriate to seek
                                                            the most effectiveness possible within a fixed budget;
                                                            in other contexts, it is more appropriate to seek the
                                                            least cost possible with specified effectiveness. In
                                                            these cases, there is the question of what level of
Figure 2--Estimates of Outcomes to be Obtained from
                                                            effectiveness to specify or of what level of costs to fix.
Several Design Concepts Including Uncertainty.
                                                            In practice, these may be mandated in the form of
                                                            performance or cost requirements; it then becomes
           The process of finding the most cost-
                                                            appropriate to ask whether a slight relaxation of
effective design is further complicated by uncertainty,
                                                            requirements could produce a significantly cheaper
which is shown in Figure 2 as a modification of Figure
                                                            sys-tem or whether a few more resources could
1. Exactly what outcomes will be realized by a
                                                            produce a significantly more effective system.
particular system design cannot be known in advance
                                                                      Usually, the system manager must choose
with certainty, so the projected cost and effectiveness
                                                            among designs that differ in terms of numerous
of a design are better described by a probability
                                                            attributes. A variety of methods have been developed
distribution than by a point. This distribution can be
                                                            that can be used to help managers uncover their
thought of as a cloud which is thickest at the most
                                                            preferences between attributes and to quantify their
likely value and thinner farther away from the most
NASA Systems Engineering Handbook                                                                    Page          5


            The System Engineer's Dilemma                  analytic methods. These specialty engineering areas
                                                           typically include reliability, maintainability, logistics,
  At each cost-effective solution:                         test, production, transportation, human factors, quality
  • To reduce cost at constant risk, performance           assurance, and safety engineering. Specialty
  must be reduced.                                         engineers contribute throughout the systems
  • To reduce risk at constant cost, performance           engineering process; part of the system engineer's job
  must be reduced.                                         is to see that these functions are coherently
  • To reduce cost at constant performance, higher         integrated into the project at the right times and that
  risks must be accepted.                                  they address the relevant issues. One of the
                                                           objectives for Chapter 6 is to develop an
  • To reduce risk at constant performance, higher
                                                           understanding of how these specialty engineers
  costs must be accepted.
                                                           contribute to the objective of systems engineering.
                                                                      In both systems analysis and systems
  In this context, time in the schedule is often a
                                                           engineering, the amounts and kinds of resources to
  critical resource, so that schedule behaves like a
                                                           be made available for the creation of the system are
  kind
                                                           assumed to be among the decisions to be made.
    f    t
subjective assessments of relative value. When this        Systems engineering concentrates on the creation of
can be done, trades between attributes can be              hardware and software architectures and on the
assessed quantitatively. Often, however, the               development and management of the interfaces
attributes seem to be truly incommensurate;                between subsystems, while relying on systems
managers must make their decisions in spite of this        analysis to construct the mathematical models and
multiplicity.                                              analyze the data to evaluate alternative designs and
                                                           to perform the actual design trade studies. Systems
2.4 Disciplines Related to Systems                         analysis often requires the use of tools from
Engineering                                                operations research, economics, or other decision
                                                           sciences, and systems analysis curricula generally
          The definition of systems engineering given      include extensive study of such topics as probability,
in Section 2.2 could apply to the design task facing a     statistics, decision theory, queueing theory, game
bridge designer, a radio engineer, or even a               theory, linear and non-linear programming, and so on.
committee chair. The systems engineering process           In practice, many system engineers' academic
can be a part of all of these. It cannot be the whole of   background is richer in the engineering disciplines
the job—the bridge designer must know the                  than in the decision sciences. As a consequence, the
properties of concrete and steel, the radio engineer       system engineer is often a consumer of systems
must apply Maxwell's equations, and a committee            analysis products, rather than a producer of them.
chair must understand the personalities of the             One of the major objectives for Chapter 5 is to
members of the committee. In fact, the optimization of     develop an understanding and appreciation of the
systems requires collaboration with experts in a           state of that art.
variety of disciplines, some of which are compared to                 Operations    research     and      operations
systems engineering in the remainder of this section.      engineering confine their attention to systems whose
          The role of systems engineering differs from     components are assumed to be more or less
that of system management in that engineering is an        immutable. That is, it is assumed that the resources
analytical, advisory and planning function, while          with which the system operates cannot be changed,
management is the decision-making function. Very           but that the way in which they are used is amenable
often, the distinction is irrelevant, as the same          to optimization. Operations research techniques often
individuals may perform both roles. When no factors        provide powerful tools for the optimization of system
enter the decision-making process other than those         designs.
that are covered by the analyses, system                              Within NASA, terms such as mission
management may delegate some of the management             analysis and engineering are often used to describe
responsibility to the systems engineering function.        all study and design efforts that relate to
          Systems engineering differs from what might      determination of what the project's mission should be
be called design engineering in that systems               and how it should be carried out. Sometimes the
engineering deals with the relationships of the thing      scope is limited to the study of future projects.
being designed to its supersystem (environment) and        Sometimes the charters of organizations with such
subsystems, rather than with the internal details of       names include monitoring the capabilities of systems,
how it is to accomplish its objectives. The systems        ensuring that important considerations have not been
viewpoint is broad, rather than deep: it encompasses       overlooked, and overseeing trades between major
the system functionally from end to end and                systems—        thereby    encompassing       operations
temporally from conception to disposal.                    research, systems analysis, and systems engineering
          System engineers must also rely on               activities.
contributions from the specialty engineering                          Total quality management (TQM) is the
disciplines, in addition to the traditional design         application of systems engineering to the work
disciplines, for functional expertise and specialized      environment. That is, part of the total quality
NASA Systems Engineering Handbook                                                                    Page         6


management paradigm is the realization that an
operating organization is a particular kind of system
and should be engineered as one. A variety of
specialized tools have been developed for this
application area; many of them can be recognized as
established systems engineering tools, but with
different names. The injunction to focus on the
satisfaction of customer needs, for example, is even
expressed in similar terms. The use of statistical
process control is akin to the use of technical
performance and earned value measurements.
Another method, qualify function deployment (QFD),
is a technique of requirements analysis often used in
systems engineering.
           The systems approach is common to all of
these related fields. Essential to the systems
approach is the recognition that a system exists, that
it is embedded in a supersystem on which it has an
impact, that it may contain subsystems, and that the
system's objectives must be understood preferably
explicitly identified.

2.5 The Doctrine of Successive Refinement

           The realization of a system over its life cycle
                                                             integration of lower-level elements is a part of the
results from a succession of decisions among
                                                             systems engineering process. In fact, there is always
alternative courses of action. If the alternatives are
                                                             a danger that the top-down process cannot keep up
precisely enough defined and thoroughly enough
                                                             with the bottom-up process.
understood to be well differentiated in the cost-
                                                                       There is often an early need to resolve the
effectiveness space, then the system manager can
                                                             issues (such as the system architecture) enough so
make choices among them with confidence.
                                                             that the system can be modeled with sufficient realism
           The systems engineering process can be
                                                             to do reliable trade studies.
thought of as the pursuit of definition and
                                                                       When resources are expended toward the
understanding of design alternatives to support those
                                                             implementation of one of several design options, the
decisions, coupled with the overseeing of their
                                                             resources required to complete the implementation of
implementation. To obtain assessments that are crisp
                                                             that design decrease (of course), while there is
enough to facilitate good decisions, it is often
                                                             usually little or no change in the resources that would
necessary to delve more deeply into the space of
                                                             be required by unselected alternatives. Selected
possible designs than has yet been done, as is
                                                             alternatives thereby become even more attractive
illustrated in Figure 3.
                                                             than those that were not selected.
           It should be realized, however, that this
                                                                       Consequently, it is reasonable to expect the
spiral represents neither the project life cycle, which
                                                             system to be defined with increasingly better
encompasses the system from inception through
                                                             resolution as time passes. This tendency is formalized
disposal, nor the product development process by
                                                             at some point (in Phase B) by defining a baseline
which the system design is developed and
                                                             system definition. Usually, the goals, objectives, and
implemented, which occurs in Phases C and D (see
                                                             constraints are baselined as the requirements portion
Chapter 3) of the project life cycle. Rather, as the
                                                             of the baseline. The entire baseline is then subjected
intellectual process of systems engineering, it is
                                                             to configuration control in an attempt to ensure that
inevitably reflected in both of them.
                                                             successive changes are indeed improvements.
                                                                       As the system is realized, its particulars
                                                             become clearer—but also harder to change. As stated
Figure 3—The Doctrine of Successive Refinement
                                                             above, the purpose of systems engineering is to make
                                                             sure that the development process happens in a way
                                                             that leads to the most cost-effective final system. The
         Figure 3 is really a double helix—each
                                                             basic idea is that before those decisions that are hard
create concepts step at the level of design
                                                             to undo are made, the alternatives should be carefully
engineering initiates a ca-pabilities definition spiral
                                                             assessed.
moving in the opposite direction. The concepts can
                                                                       The systems engineering process is applied
never be created from whole cloth. Rather, they result
                                                             again and again as the system is developed. As the
from the synthesis of potential capabilities offered by
                                                             system is realized, the issues addressed evolve and
the continually changing state of technology. This
                                                             the particulars of the activity change.
process of design concept development by the
NASA Systems Engineering Handbook                                                                     Page          7


    As an Example of the Process of Successive               but its first cause. It could be argued that recognition
  Refinement, Consider the Choice of Altitude for a          of the need or opportunity for a new system is an
           Space Station such as Alpha                       entrepreneurial activity, rather than an engineering
                                                             one.
• The first issue is selection of the general                           The end result of this step is the discovery
location. Alternatives include Earth orbit, one of           and delineation of the system's goals, which generally
the Earth-Moon Lagrange points, or a solar orbit.            express the desires and requirements of the eventual
At the current state of technology, cost and risk            users of the system. In the NASA context, the
considerations made selection of Earth orbit an              system's goals should also represent the long term
easy choice for Alpha. • Having chosen Earth                 interests of the taxpaying public.
orbit, it is necessary to select an orbit region.
Alternatives include low Earth orbit (LEO), high             Identify and Quantify Goals. Before it is possible to
Earth orbit and geosynchronous orbit; orbital                compare the cost-effectiveness of alternative system
inclination and eccentricity must also be chosen.            design concepts, the mission to be performed by the
One of many criteria considered in choosing LEO              system must be delineated. The goals that are
for Alpha was the design complexity associated               developed should cover all relevant aspects of
with passage through the Van Allen radiation                 effectiveness, cost, schedule, and risk, and should be
belts.                                                       traceable to the goals of the supersystem. To make it
• System design choices proceed to the selection             easier to choose among alternatives, the goals should
of an altitude maintenance strategy—rules that               be stated in quantifiable, verifiable terms, insofar as
implicitly determine when, where, and why to re-             that is possible and meaningful to do.
boost, such as "maintain altitude such that there                      It is also desirable to assess the constraints
are always at least TBD days to reentry," "collision         that may apply. Some constraints are imposed by the
avoidance maneuvers shall always increase the                state of technology at the time of creating or
altitude," "reboost only after resupply flights that         modifying system design concepts. Others may
have brought fuel," "rotate the crew every TBD               appear to be inviolate, but can be changed by higher
days."                                                       levels of management. The assumptions and other
• A next step is to write altitude specifications.           relevant information that underlie constraints should
These choices might consist of replacing the                 always be recorded so that it is possible to estimate
TBDs (values to be determined) in the altitude               the benefits that could be obtained from their
strategy with explicit numbers.                              relaxation.
• Monthly operations plans are eventually part of                      At each turn of the spiral, higher-level goals
the complete system design. These would include              are analyzed. The analysis should identify the
scheduled reboost burns based on predictions of              subordinate enabling goals in a way that makes them
the accumulated effect of drag and the details of            traceable to the next higher level. As the systems
on-board microgravity experiments.                           engineering       process     continues,   these     are
                                                             documented as functional requirements (what must
• Actual firing decisions are based on determinations of     be done to achieve the next-higher-level goals) and
the orbit which results from the momentum actually
added by previous firings, the atmospheric density
                                                             as      performance        requirements     (quantitative
variations actually encountered, and so on.                  descriptions of how well the functional requirements
                                                             must be done). A clear operations concept often helps
           Note that decisions at every step require that    to focus the require-ments analysis so that both
the capabilities offered by available technology be          functional and performance requirements are
considered—often at levels of design that are more           ultimately related to the original need or opportunity.
detailed than seems necessary at first                       In later turns of the spiral, further elaborations may
                                                             become documented as detailed functional and
         Most of the major system decisions (goals,          performance specifications.
architecture, acceptable life-cycle cost, etc.) are made
during the early phases of the project, so the turns of      Create Alternative Design Concepts. Once it is
the spiral (that is, the successive refinements) do not      under-stood what the system is to accomplish, it is
correspond precisely to the phases of the system life        possible to devise a variety of ways that those goals
cycle. Much of the system architecture can be ''seen"        can be met. Sometimes, that comes about as a
even at the outset, so the turns of the spiral do not        consequence of considering alternative functional
correspond exactly to development of the                     allocations and integrating available subsystem
architectural     hierarchy,   either.   Rather,     they    design options. Ideally, as wide a range of plausible
correspond to the successively greater resolution by         alternatives as is consistent with the design
which the system is defined.                                 organization's charter should be defined, keeping in
         Each of the steps in the systems engineering        mind the current stage in the process of successive
process is discussed below.                                  refinement. When the bottom-up process is operating,
                                                             a problem for the system engineer is that the
Recognize Need/Opportunity. This step is shown in            designers tend to become fond of the designs they
Figure 3 only once, as it is not really part of the spiral   create, so they lose their objectivity; the system
NASA Systems Engineering Handbook                                                                      Page           8


engineer often must stay an "outsider" so that there is      associated with the continually improving resolution
more objectivity.                                            reduces the spread between upper and lower bounds
          On the first turn of the spiral in Figure 3, the   as the process proceeds.
sub-ject is often general approaches or strategies,
sometimes architectural concepts. On the next, it is         Select Concept. Selection among the alternative
likely to be functional design, then detailed design,        design concepts is a task for the system manager,
and so on.                                                   who must take into account the subjective factors that
          The reason for avoiding a premature focus          the system engineer was unable to quantify, in
on a single design is to permit discovery of the truly       addition to the estimates of how well the alternatives
best design. Part of the system engineer's job is to         meet the quantified goals (and any effectiveness,
ensure that the design concepts to be compared take          cost, schedule, risk, or other constraints).
into account all interface requirements. "Did you                       When it is possible, it is usually well worth
include the cabling?" is a characteristic question.          the trouble to develop a mathematical expression,
When possible, each design concept should be                 called an objective function, that expresses the values
described in terms of controllable design parameters         of combinations of possible outcomes as a single
so that each represents as wide a class of designs as        measure of cost-effectiveness, as is illustrated in
is reasonable. In doing so, the system engineer              Figure 4, even if both cost and effectiveness must be
should keep in mind that the potentials for change           described by more than one measure. When
may include organizational structure, schedules,             achievement of the goals can be quantitatively
procedures, and any of the other things that make up         expressed by such an objective function, designs can
a system. When possible, constraints should also be          be compared in terms of their value. Risks associated
described by parameters.                                     with design concepts can cause these evaluations to
          Owen Morris, former Manager of the Apollo          be somewhat nebulous (because they are uncertain
Spacecraft Program and Manager of Space Shuttle              and are best described by probability distributions). In
Systems and Engineering, has pointed out that it is          this illustration, the risks are relatively high for design
often useful to define design reference missions             concept A. There is little risk in either effectiveness or
which stress all of the system's capabilities to a           cost for concept B. while the risk of an expensive
significant extent and which al1 designs will have to        failure is high for concept C, as is shown by
be able to accomplish. The purpose of such missions
is to keep the design space open. Consequently, it
can be very dangerous to write them into the system
specifications, as they can have just the opposite
effect.

Do Trade Studies. Trade studies begin with an
assess-ment of how well each of the design
alternatives meets the system goals (effectiveness,
cost, schedule, and risk, both quantified and
otherwise). The ability to perform these studies is
enhanced by the development of system models that
relate the design parameters to those assessments—
but it does not depend upon them.
Controlled modification and development of design
concepts, together with such system models, often
permits the use of formal optimization techniques to
find regions of the design space that warrant further
investigation— those that are closer to the optimum          Figure 4—A Quantitative Objective Function, De"
surface indicated in Figure 1.                               pendent on Life-Cycle Cost and All Aspects of
          Whether system models are used or not, the         Effec-tiveness.
design     concepts      are    developed,       modified,
reassessed, and compared against competing                   the cloud of probability near the x axis with a high cost
alternatives in a closed-loop process that seeks the         and essentially no effectiveness. Schedule factors
best choices for further development. System and             may affect the effectiveness values, the cost values,
subsystem sizes are often determined during the              and the risk distributions.
trade studies. The end result is the determination of                  The mission success criteria for systems
bounds on the relative cost-effectivenesses of the           differ significantly. In some cases, effectiveness goals
design alternatives, measured in terms of the                may be much more important than all others. Other
quantified system goals. (Only bounds, rather than           projects may demand low costs, have an immutable
final values, are possible because determination of          schedule, or require minimization of some kinds of
the final details of the design is intentionally deferred.   risks. Rarely (if ever) is it possible to produce a
The bounds, in turn, may be derived from the                 combined quantitative measure that relates all of the
probability density functions.) Increasing detail            important factors, even if it is expressed as a vector
NASA Systems Engineering Handbook                                                                   Page          9


with several components. Even when that can be             often desirable. The accounting system should follow
done, it is essential that the underlying factors and      (not lead) the system architecture. In terms of
relationships be thoroughly revealed to and                breadth, partitioning should be done essentially all at
understood by the system manager. The system               once. As with system design choices, alternative parti
manager must weigh the importance of the                   -tioning plans should be considered and compared
unquantifiable factors along with the quantitative data    before implementation.
provided by the system engineer.                           If a requirements-driven design paradigm is used for
         Technical reviews of the data and analyses        tile development of the system architecture, it must be
are an important part of the decision support              applied with care, for the use of "shells" creates a
packages prepared for the system manager. The              tendency for the requirements to be treated as
decisions that are made are generally entered into the     inviolable con straints rather than as agents of the
configuration management system as changes to (or          objectives. A goal, ob -jective or desire should never
elaborations of) the system baseline. The supporting       be made a requirement until its costs. are understood
trade studies are archived for future use. An essential    and the buyer is willing to pay for it. The capability to
feature of the systems engineering process is that         compute the effects of lower -level decisions on the
trade studies are performed before decisions are           quantified goals should be maintained throughout the
made. They can then be baselined with much more            partitioning process. That is, there should be a goals
confidence.                                                flowdown embedded in the requirements allocation
         At this point in the systems engineering          process.
process, there is a logical branch point. For those                  The process continues with creation of a
issues for which the process of successive refinement      variety of alternative design concepts at the next level
has proceeded far                                          of resolution, construction of models that permit
                                                           prediction of how well those alternatives will satisfy
             Simple Interfaces are Preferred
                                                           the quantified goals, and so on. It is imperative that
  According to Morris, NASA's former Acting
                                                           plans for subsequent integration be laid throughout
  Administrator George Low, in a 1971 paper titled
                                                           the partitioning. Integration plans include verification
  "What Made Apollo a Success," noted that only
                                                           and validation activities as a matter of course.
  100 wires were needed to link the Apollo
  spacecraft to the Saturn launch vehicle. He
                                                           Implement the Selected Design Decisions. When
  emphasized the point that a single person could
                                                           the process of successive refinement has proceeded
  fully understand the interface and cope with all the
                                                           far enough, the next step is to reverse the partitioning
enough, the next step is to implement the decisions at     process. When applied to the system architecture,
that level of resolution (that is, unwind the recursive    this "unwinding" of the process is called system
process). For those issues that are still insufficiently   integration. Conceptual system integration takes
resolved, the next step is to refine the development       place in all phases of the project life cycle. That is,
further.                                                   when a design approach has been selected, the
                                                           approach is verified by "unwinding the process" to test
Increase the Resolution of the Design. One of the          whether the concept at each physical level meets the
first issues to be addressed is how the system should      expectations and requirements. Physical integration is
be subdivided into subsystems. (Once that has been         accomplished during Phase D. At the finer levels of
done, the focus changes and the subsystems become          resolution, pieces must be tested, assembled and/or
systems -- from the point of view of a system              integrated, and tested again. The system engineer's
engineer. The partitioning process stops when the          role includes the performance of the delegated
subsystems are simple enough to be managed                 management du ties, such as configuration control
holistically.) As noted by Morris, "the divi- be           and overseeing the integration, verification, and
managed holistically.) As noted by Morris, "the            validation process.
division of program activities to minimize the number                  The purpose of verification of subsystem
and complexity of interfaces has a strong influence on     integration is to ensure that the subsystems conform
the overall program cost and the ability of the program    to what was designed and interface with each other
to meet schedules."                                        as expected in all re spects that are important:
           Charles Leising and Arnold Ruskin have          mechanical connections, effects on center of mass
(separately) pointed out that partitioning is more art     and products of inertia, electromagnetic interference,
than science, but that there are guidelines available:     connector impedance and voltage, power con
To make interfaces clean and simple, similar               sumption, data flow, and so on. Validation consists of
functions, designs and tech nologies should be             ensuring that the interfaced subsystems achieve their
grouped. Each portion of work should be verifiable.        intended results. While validation is even more
Pieces should map conveniently onto the                    important than verification, it is usually much more
organizational structure. Some of the functions that       difficult to accomplish.
are needed throughout the design (such as electrical
power) or throughout the organization (such as             Perform the Mission. Eventually, the system is
purchasing) can be centralized. Standardization—of         called upon to meet the need or seize the opportunity
such things as parts lists or reporting formats—is         for which it was designed and built.
NASA Systems Engineering Handbook                         Page   10


           The system engineer continues to perform a
variety of supporting functions, depending on the
nature and duration of the mission. On a large project
such as Space Station Alpha, some of these
continuing functions include the validation of system
effectiveness at the operational site, overseeing the
maintenance       of  configuration    and    logistics
documentation, overseeing sustaining engineering
activities, compiling development and operations
"lessons reamed" documents, and, with the help of
the specialty engineering disciplines, identifying
product improvement opportunities. On smaller
systems, such as a Spacelab payload, only the last
two may be needed.
NASA Systems Engineering Handbook                                                                      Page        11


3    The Project Life Cycle for Major                        in government. In general, the engineering
NASA Systems                                                 development life cycle is dependent on the technical
                                                             nature of what's being developed, and the project life
                                                             cycle may need to be tailored accordingly. Barry W.
          One of the fundamental concepts used
                                                             Boehm described how several contemporary software
within NASA for the management of major systems is
                                                             development processes work; in some of these
the pro-gram/ project life cycle, which consists of a
                                                             processes, the development and construction
categorization of everything that should be done to
                                                             activities proceed in parallel, so that attempting to
accomplish a project into distinct phases, separated
                                                             separate the associated phases on a time line is
by control gates. Phase boundaries are defined so
                                                             undesirable. Boehm describes a spiral, which reflects
that they provide more-or-less natural points for
                                                             the doctrine of successive refinement depicted in
go/no-go decisions. Decisions to proceed may be
                                                             Figure 3, but Boehm's spiral describes the software
qualified by liens that must be removed within a
                                                             product development process in particular. His
reasonable time. A project that fails to pass a control
                                                             discussion applies as well to the development of
gate and has enough resources may be allowed to
                                                             hardware products as it does to software. Other
“go back to the drawing board"—or it may be
                                                             exam-ples of alternative processes are the rapid
terminated.
                                                             prototyping and rapid development approaches.
          All systems start with the recognition of a
                                                             Selection of a product development process paradigm
need or the discovery of an opportunity and proceed
                                                             must be a case-dependent decision, based on the
through various stages of development to a final
                                                             system engineer's judgment and experience.
disposition. While the most dramatic impacts of the
                                                                       Sometimes, it is appropriate to perform some
analysis and optimization activities associated with
                                                             long-lead-time activities ahead of the time they would
systems engineering are obtained in the early stages,
                                                             nominally be done. Long-lead-time activities might
decisions that affect millions of dollars of value or cost
                                                             consist of technology developments, prototype
continue to be amenable to the systems approach
                                                             construction and testing, or even fabrication of difficult
even as the end of the system lifetime approaches.
                                                             components. Doing things out of their usual sequence
          Decomposing the project life cycle into
                                                             increases risk in that those activities could wind up
phases or-ganizes the entire process into more
                                                             having been either unnecessary or improperly
manageable pieces. The project life cycle should
                                                             specified. On the other hand, overall risk can
provide managers with incremental visibility into the
                                                             sometimes be reduced by removal of such activities
progress being made at points in time that fit with the
                                                             from the critical path.
management and budgetary environments. NASA
                                                                       Figure 5 (foldout, next page) details the
documents governing the acquisition of major
                                                             resulting     management      and     major     systems
systems (NMI 7120.4 and NHB 7120.5) define the
                                                             engineering products and control gates that
phases of the project life cycle as:
                                                             characterize the phases in NMI 7120.4 and NHB
                                                             7120.5. Sections 3.1 to 3.6 contain narrative
•   Pre-Phase A—Advanced Studies ("find a suitable
                                                             descriptions of the purposes, major activities,
    project")
                                                             products, and control gates of the NASA project life
•   Phase A—Preliminary Analysis ("make sure the
                                                             cycle phases. Section 3.7 provides a more
    project is worthwhile")
                                                             concentrated discussion of the role of systems
•   Phase B—Definition ("define the project and              engineering in the process. Section 3.8 describes the
    establish a preliminary design")                         NASA budget cycle within which program/project
•   Phase C—Design ("complete the system design")            managers and system engineers must operate.
    Phase D — Development ("build, integrate, and
    verify the system, and prepare for operations")          3.1 Pre-Phase A—Advanced Studies
•   Phase E—Operations ("operate the system and
    dispose of it properly").                                The purpose of this activity, which is usually per-
                                                             formed more or less continually by "Advanced
         Phase A efforts are conducted by NASA field         Projects" groups, is to uncover, invent, create,
cen-ters; such efforts may rely, however, on pre-            concoct and/or devise a broad spectrum of ideas and
Phase A in-house and contracted advanced studies.            alternatives for missions from which new projects
The majority of Phase B efforts are normally                 (programs) can be selected. Typically, this activity
accomplished by industry under NASA contract, but            consists of loosely structured ex-aminations of new
NASA field centers typically conduct parallel in-house       ideas, usually without central control and mostly
studies in order to validate the contracted effort and       oriented toward small studies. Its major product is a
remain an informed buyer. NASA usually chooses to            stream of suggested projects, based on the
contract with industry for Phases C and D, and often         identification of needs and the discovery of
does so for Phase E. Phase C is nominally combined           opportunities that are potentially consistent with
with Phase D, but when large production quantities           NASA's       mission.  capabilities, priorities, and
are planned, these are treated separately.                   resources.
         Alternatives to the project phases described
above can easily be found in industry and elsewhere
NASA Systems Engineering Handbook                                                                    Page        12


           Pre-Phase A—Advanced Studies
                                                           system before seeking significant funding. According
                                                           to NHB 7120.5, the major products of this phase are a
 Purpose: To produce a broad spectrum of ideas             formal Mission Needs Statement (MNS) and one or
 and alternatives for missions from which new pro-         more credible, feasible designs and operations
 grams/ projects can be selected.                          concepts. John Hodge describes this phase as "a
 Major Activities and their Products: Identify             structured version of the previous phase."
 missions consistent with charter Identify and                          Phase A—Preliminary Analysis
 involve users
 Perform preliminary evaluations of possible                 Purpose: To determine the feasibility and
 missions Prepare program/project proposals,                 desirability of a suggested new major system and
 which include:                                              its compatibility with NASA's strategic plans.
 • Mission justification and objectives                      Major Activities and their Products:
 • Possible operations concepts                              Prepare Mission Needs Statement
 • Possible system architectures                             Develop top-level requirements
 • Cost, schedule, and risk estimates.                       Develop corresponding evaluation criteria/metrics
 Develop master plans for existing program areas             Identify alternative operations and logistics
 Information Baselined:                                      concepts
 (nothing)                                                   Identify project constraints and system boundaries
 Control Gates:                                              Consider alternative design concepts, including:
 Mission Concept Review                                      feasibility and risk studies, cost and schedule
 Informal proposal reviews                                   estimates,       and      advanced        technology
                                                             requirements
           In the NASA environment, demands for new          Demonstrate that credible, feasible design(s) exist
systems derive from several sources. A major one is          Acquire systems engineering tools and models
the opportunity to solve terrestrial problems that may       Initiate environmental impact studies
be ad-dressed by putting instruments and other               Prepare Project Definition Plan for Phase B
devices into space. Two examples are weather                 Information Baselined:
prediction and communications by satellite. General          (nothing)
improvements in technology for use in space will             Control Gates:
continue to open new possibilities. Such opportunities       Mission Definition Review
are rapidly perceived as needs once the magnitude of         Preliminary Non-Advocate Review
their value is understood.                                   Preliminary Program/Project Approval Review
           Technological progress makes possible
missions that were previously impossible. Manned
trips to the moon and the taking of high resolution                   In Phase A, a larger team, often associated
pictures of planets and other objects in the universe      with an ad hoc program or project office, readdresses
illustrate past responses to this kind of opportunity.     the mission concept to ensure that the project
New opportunities will continue to become available        justification and practicality are sufficient to warrant a
as our technological capabilities grow.                    place in NASA's budget. The team's effort focuses on
           Scientific progress also generates needs for    analyzing mission requirements and establishing a
NASA systems. As our understanding of the universe         mission architecture. Activities become formal, and
around us continues to grow, we are able to ask new        the emphasis shifts toward establishing optimality
and more precise questions. The ability to answer          rather than feasibility. The effort addresses more
these questions often depends upon the changing            depth and considers many alternatives. Goals and
state of technology.                                       objectives are solidified, and the project develops
           Advanced studies may extend for several         more definition in the system requirements, top-level
years, and may be a sequence of papers that are only       system architecture, and operations concept.
loosely connected. These studies typically focus on        Conceptual designs are developed and exhibit more
establishing mission goals and formulating top-level       engineering detail than in advanced studies.
system requirements and operations concepts.               Technical risks are identified in more detail and
Conceptual designs are often offered to demonstrate        technology development needs become focused.
feasibility and support programmatic estimates. The                   The Mission Needs Statement is not shown
emphasis is on establishing feasibility and desirability   in the sidebar as being baselined, as it is not under
rather than optimality. Analyses and designs are           configuration control by the project. It may be under
accordingly limited in both depth and number of            configuration control at the program level, as may the
options.                                                   program requirements documents and the Preliminary
                                                           Program Plan.
3.2 Phase A—Preliminary Analysis

The purpose of this phase is to further examine the
feasibility and desirability of a suggested new major
NASA Systems Engineering Handbook                                                                   Page         14


                                                           seek out more cost-effective designs. (Trade studies
                                                           should precede—rather than follow—system design
Figure 6 – Overruns are Very Likely if Phases A            decisions. Chamberlain, Fox, and Duquette describe
and B are Underfunded.
                                                                            Phase B -- Definition

                                                            Purpose: To define the project in enough detail to
                                                            establish an initial baseline capable of meeting
                                                            mission needs.
                                                            Major Activities and their Products:
                                                            Prepare a Systems Engineering Management
                                                            Plan
                                                            Prepare a Risk Management Plan
                                                            Initiate configuration management
                                                            Prepare engineering specialty program plans
                                                            Develop system-level cost-effectiveness model
                                                            Restate mission needs as functional requirements
                                                            Identify science payloads
                                                            Establish the initial system requirements and
                                                            verification requirements matrix
                                                            Perform and archive trade studies
                                                            Select a baseline design solution and a concept of
                                                            operations
3.3 Phase B -- Definition                                   Define      internal    and     external     interface
                                                            requirements
          The purpose of this phase is to establish an      (Repeat the process of successive refinement to
initial project baseline, which (according to NHB           get "design-to" specifications and drawings,
7120.5) includes "a formal flowdown of the project-         verifications plans, and interface documents to
level performance requirements to a complete set of         lower levels as appropriate)
system and subsystem design specifications for both         Define the work breakdown structure
flight and ground elements" and "corresponding              Define verification approach end policies
preliminary designs." The technical requirements            Identify integrated logistics support requirements
should be sufficiently detailed to establish firm           Establish technical resource estimates and firm
schedule and cost estimates for the project.                life-cy-cle cost estimates
                                                            Develop statement(s) of work
              A Credible, Feasible Design                   Initiate advanced technology developments
                                                            Revise and publish a Project Plan
 A feasible system design is one that can be                Reaffirm the Mission Needs Statement
 implemented as designed and can then                       Prepare a Program Commitment Agreement
 accomplish the system's goals within the                   Information Baselined:
 constraints imposed by the fiscal and operating            System        requirements       and      verification
 environment. To be credible, a design must not             requirements matrix
 depend on the occurrence of unforeseen                     System architecture and work breakdown
 breakthroughs in the state of the art. While a             structure
 credible design may assume likely improvements             Concept of operations
 in the state of the art, it is nonetheless riskier than    “Design-to” specifications at all levels
           Actually, "the" Phase B baseline consists of     Project plans, including schedule, resources,
a collection of evolving baselines covering technical       acquisition strategies and risk management
and business aspects of the project: system (and           a decentralized process for ensuring that such trades
subsystem) requirements and specifications, designs,       lead efficiently to an optimum system design.) Major
verification and operations plans, and so on in the        products to this point include an accepted "functional"
technical portion of the baseline, and schedules, cost     baseline and preliminary "design-to" baseline for the
projections, and management plans in the business          system and its major end items. The effort also
portion. Establishment of baselines implies the            produces various engineering and management plans
implementation        of   configuration  management       to prepare for managing the project's downstream
procedures. (See Section 4.7.)                             processes, such as verification and operations, and
           Early in Phase B, the effort focuses on         for implementing engineering specialty programs.
allocating functions to particular items of hardware,                Along the way to these products, projects
software, personnel, etc. System functional and            are subjected to a Non-Advocate Review, or NAR.
performance requirements along with architectures          This activity seeks to assess the state of project
and designs become firm as system trades and               definition in terms of its clarity of objectives and the
subsystem trades iterate back and forth in the effort to   thoroughness of technical and management plans,
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook
NASA Engineering Handbook

Más contenido relacionado

Destacado

Hispanics, high school dropouts and the ged
Hispanics, high school dropouts and the gedHispanics, high school dropouts and the ged
Hispanics, high school dropouts and the gedmhernandez29
 
Vmobile presentation bom ( monday to saturday 4 pm to 6pm or 6pm to 8pm )
Vmobile presentation bom ( monday to saturday 4 pm to 6pm or 6pm to 8pm )Vmobile presentation bom ( monday to saturday 4 pm to 6pm or 6pm to 8pm )
Vmobile presentation bom ( monday to saturday 4 pm to 6pm or 6pm to 8pm )alayonruth
 
ΜΑΧΕΣ ΣΤΗ ΝΕΑ ΕΚΔΟΣΗ
ΜΑΧΕΣ ΣΤΗ ΝΕΑ ΕΚΔΟΣΗΜΑΧΕΣ ΣΤΗ ΝΕΑ ΕΚΔΟΣΗ
ΜΑΧΕΣ ΣΤΗ ΝΕΑ ΕΚΔΟΣΗtremaximus75
 
Pozitive effects of globalization
Pozitive effects of globalizationPozitive effects of globalization
Pozitive effects of globalizationerdemkarademir
 
Bmi v9
Bmi v9Bmi v9
Bmi v9Dugee
 
Software As-A-Service Company Presentation
Software As-A-Service Company PresentationSoftware As-A-Service Company Presentation
Software As-A-Service Company PresentationFerdinand Kjærulff
 
Bikram final summar tranning
Bikram final summar tranningBikram final summar tranning
Bikram final summar tranningbikram99tiwary
 
概要设计说明
概要设计说明概要设计说明
概要设计说明Jacken
 
Media Evaluation
Media EvaluationMedia Evaluation
Media EvaluationKendalMiles
 

Destacado (13)

PPT KERAJINAN BAHAN KERAS
PPT KERAJINAN BAHAN KERAS PPT KERAJINAN BAHAN KERAS
PPT KERAJINAN BAHAN KERAS
 
Hispanics, high school dropouts and the ged
Hispanics, high school dropouts and the gedHispanics, high school dropouts and the ged
Hispanics, high school dropouts and the ged
 
Vmobile presentation bom ( monday to saturday 4 pm to 6pm or 6pm to 8pm )
Vmobile presentation bom ( monday to saturday 4 pm to 6pm or 6pm to 8pm )Vmobile presentation bom ( monday to saturday 4 pm to 6pm or 6pm to 8pm )
Vmobile presentation bom ( monday to saturday 4 pm to 6pm or 6pm to 8pm )
 
ΜΑΧΕΣ ΣΤΗ ΝΕΑ ΕΚΔΟΣΗ
ΜΑΧΕΣ ΣΤΗ ΝΕΑ ΕΚΔΟΣΗΜΑΧΕΣ ΣΤΗ ΝΕΑ ΕΚΔΟΣΗ
ΜΑΧΕΣ ΣΤΗ ΝΕΑ ΕΚΔΟΣΗ
 
Pozitive effects of globalization
Pozitive effects of globalizationPozitive effects of globalization
Pozitive effects of globalization
 
Bmi v9
Bmi v9Bmi v9
Bmi v9
 
Software As-A-Service Company Presentation
Software As-A-Service Company PresentationSoftware As-A-Service Company Presentation
Software As-A-Service Company Presentation
 
Three Disruptions In One
Three Disruptions In OneThree Disruptions In One
Three Disruptions In One
 
Brown act
Brown actBrown act
Brown act
 
Bikram final summar tranning
Bikram final summar tranningBikram final summar tranning
Bikram final summar tranning
 
Trip planner
Trip plannerTrip planner
Trip planner
 
概要设计说明
概要设计说明概要设计说明
概要设计说明
 
Media Evaluation
Media EvaluationMedia Evaluation
Media Evaluation
 

Similar a NASA Engineering Handbook

fundamentals-of-neural-networks-laurene-fausett
fundamentals-of-neural-networks-laurene-fausettfundamentals-of-neural-networks-laurene-fausett
fundamentals-of-neural-networks-laurene-fausettZarnigar Altaf
 
Artificial Intelligence A Modern Approach
Artificial Intelligence  A Modern ApproachArtificial Intelligence  A Modern Approach
Artificial Intelligence A Modern ApproachSophia Diaz
 
Summary of Professional Background and Research Objectives
Summary of Professional Background and Research ObjectivesSummary of Professional Background and Research Objectives
Summary of Professional Background and Research ObjectivesSuresh Phansalkar
 
Summary of Professional Background and Research Objectives
Summary of Professional Background and Research ObjectivesSummary of Professional Background and Research Objectives
Summary of Professional Background and Research ObjectivesSuresh Phansalkar
 
Dennis m. ritchie
Dennis m. ritchieDennis m. ritchie
Dennis m. ritchie夏 永锋
 
Capella Days 2021 | Introduction to CAPELLA/ARCADIA and NASA Systems Engineer...
Capella Days 2021 | Introduction to CAPELLA/ARCADIA and NASA Systems Engineer...Capella Days 2021 | Introduction to CAPELLA/ARCADIA and NASA Systems Engineer...
Capella Days 2021 | Introduction to CAPELLA/ARCADIA and NASA Systems Engineer...Obeo
 
Data structures and algorithms alfred v. aho, john e. hopcroft and jeffrey ...
Data structures and algorithms   alfred v. aho, john e. hopcroft and jeffrey ...Data structures and algorithms   alfred v. aho, john e. hopcroft and jeffrey ...
Data structures and algorithms alfred v. aho, john e. hopcroft and jeffrey ...Chethan Nt
 
Hal bell
Hal bellHal bell
Hal bellNASAPMC
 
Hal bell
Hal bellHal bell
Hal bellNASAPMC
 
Stuart russell and peter norvig artificial intelligence - a modern approach...
Stuart russell and peter norvig   artificial intelligence - a modern approach...Stuart russell and peter norvig   artificial intelligence - a modern approach...
Stuart russell and peter norvig artificial intelligence - a modern approach...Lê Anh Đạt
 
Scientific workflow-overview-2012-01-rev-2
Scientific workflow-overview-2012-01-rev-2Scientific workflow-overview-2012-01-rev-2
Scientific workflow-overview-2012-01-rev-2Terence Critchlow
 
Chaos engineering open science for software engineering - kube con north am...
Chaos engineering   open science for software engineering - kube con north am...Chaos engineering   open science for software engineering - kube con north am...
Chaos engineering open science for software engineering - kube con north am...Sylvain Hellegouarch
 
The Symbiotic Nature of Provenance and Workflow
The Symbiotic Nature of Provenance and WorkflowThe Symbiotic Nature of Provenance and Workflow
The Symbiotic Nature of Provenance and WorkflowEric Stephan
 
[ ] uottawa_copeck.doc
[ ] uottawa_copeck.doc[ ] uottawa_copeck.doc
[ ] uottawa_copeck.docbutest
 
An Essay Concerning Human Understanding Of Genetic Programming
An Essay Concerning Human Understanding Of Genetic ProgrammingAn Essay Concerning Human Understanding Of Genetic Programming
An Essay Concerning Human Understanding Of Genetic ProgrammingJennifer Roman
 

Similar a NASA Engineering Handbook (20)

Hpkb year 1 results
Hpkb   year 1 resultsHpkb   year 1 results
Hpkb year 1 results
 
9810005 (1)
9810005 (1)9810005 (1)
9810005 (1)
 
CS846_report_akshat_kumar
CS846_report_akshat_kumarCS846_report_akshat_kumar
CS846_report_akshat_kumar
 
fundamentals-of-neural-networks-laurene-fausett
fundamentals-of-neural-networks-laurene-fausettfundamentals-of-neural-networks-laurene-fausett
fundamentals-of-neural-networks-laurene-fausett
 
Artificial Intelligence A Modern Approach
Artificial Intelligence  A Modern ApproachArtificial Intelligence  A Modern Approach
Artificial Intelligence A Modern Approach
 
Summary of Professional Background and Research Objectives
Summary of Professional Background and Research ObjectivesSummary of Professional Background and Research Objectives
Summary of Professional Background and Research Objectives
 
Summary of Professional Background and Research Objectives
Summary of Professional Background and Research ObjectivesSummary of Professional Background and Research Objectives
Summary of Professional Background and Research Objectives
 
Dennis m. ritchie
Dennis m. ritchieDennis m. ritchie
Dennis m. ritchie
 
Capella Days 2021 | Introduction to CAPELLA/ARCADIA and NASA Systems Engineer...
Capella Days 2021 | Introduction to CAPELLA/ARCADIA and NASA Systems Engineer...Capella Days 2021 | Introduction to CAPELLA/ARCADIA and NASA Systems Engineer...
Capella Days 2021 | Introduction to CAPELLA/ARCADIA and NASA Systems Engineer...
 
Data structures and algorithms alfred v. aho, john e. hopcroft and jeffrey ...
Data structures and algorithms   alfred v. aho, john e. hopcroft and jeffrey ...Data structures and algorithms   alfred v. aho, john e. hopcroft and jeffrey ...
Data structures and algorithms alfred v. aho, john e. hopcroft and jeffrey ...
 
03
0303
03
 
Hal bell
Hal bellHal bell
Hal bell
 
Hal bell
Hal bellHal bell
Hal bell
 
richardson_laura_MS
richardson_laura_MSrichardson_laura_MS
richardson_laura_MS
 
Stuart russell and peter norvig artificial intelligence - a modern approach...
Stuart russell and peter norvig   artificial intelligence - a modern approach...Stuart russell and peter norvig   artificial intelligence - a modern approach...
Stuart russell and peter norvig artificial intelligence - a modern approach...
 
Scientific workflow-overview-2012-01-rev-2
Scientific workflow-overview-2012-01-rev-2Scientific workflow-overview-2012-01-rev-2
Scientific workflow-overview-2012-01-rev-2
 
Chaos engineering open science for software engineering - kube con north am...
Chaos engineering   open science for software engineering - kube con north am...Chaos engineering   open science for software engineering - kube con north am...
Chaos engineering open science for software engineering - kube con north am...
 
The Symbiotic Nature of Provenance and Workflow
The Symbiotic Nature of Provenance and WorkflowThe Symbiotic Nature of Provenance and Workflow
The Symbiotic Nature of Provenance and Workflow
 
[ ] uottawa_copeck.doc
[ ] uottawa_copeck.doc[ ] uottawa_copeck.doc
[ ] uottawa_copeck.doc
 
An Essay Concerning Human Understanding Of Genetic Programming
An Essay Concerning Human Understanding Of Genetic ProgrammingAn Essay Concerning Human Understanding Of Genetic Programming
An Essay Concerning Human Understanding Of Genetic Programming
 

Más de Champs Elysee Roldan

1886 -1887-El 12 de octubre de 1886 Alexandre Ciurcu recibió la patente franc...
1886 -1887-El 12 de octubre de 1886 Alexandre Ciurcu recibió la patente franc...1886 -1887-El 12 de octubre de 1886 Alexandre Ciurcu recibió la patente franc...
1886 -1887-El 12 de octubre de 1886 Alexandre Ciurcu recibió la patente franc...Champs Elysee Roldan
 
1885 - 25 de Agosto - El Capitán Griffiths obtiene la Patente Británica No 10...
1885 - 25 de Agosto - El Capitán Griffiths obtiene la Patente Británica No 10...1885 - 25 de Agosto - El Capitán Griffiths obtiene la Patente Británica No 10...
1885 - 25 de Agosto - El Capitán Griffiths obtiene la Patente Británica No 10...Champs Elysee Roldan
 
Patentes de Aeroplanos en Inglaterra por Robert M.Neilson
Patentes de Aeroplanos en Inglaterra por Robert  M.NeilsonPatentes de Aeroplanos en Inglaterra por Robert  M.Neilson
Patentes de Aeroplanos en Inglaterra por Robert M.NeilsonChamps Elysee Roldan
 
1883- Konstantin Eduardovich Tsiolkovsky Prepara un manuscrito titulado Free ...
1883- Konstantin Eduardovich Tsiolkovsky Prepara un manuscrito titulado Free ...1883- Konstantin Eduardovich Tsiolkovsky Prepara un manuscrito titulado Free ...
1883- Konstantin Eduardovich Tsiolkovsky Prepara un manuscrito titulado Free ...Champs Elysee Roldan
 
1882- 5 de Octubre: Nace el Padre de la Cohetería Moderna Robert Hutchings G...
1882- 5 de Octubre: Nace el Padre de la Cohetería Moderna  Robert Hutchings G...1882- 5 de Octubre: Nace el Padre de la Cohetería Moderna  Robert Hutchings G...
1882- 5 de Octubre: Nace el Padre de la Cohetería Moderna Robert Hutchings G...Champs Elysee Roldan
 
1882 - Cohete Salvavidas Norte Americano Cunningham
1882 - Cohete Salvavidas  Norte Americano Cunningham1882 - Cohete Salvavidas  Norte Americano Cunningham
1882 - Cohete Salvavidas Norte Americano CunninghamChamps Elysee Roldan
 
1882 – 1895 - Sergei Sergeevich Nezhdanovsky avanzó por primera vez en la id...
1882 – 1895 - Sergei Sergeevich Nezhdanovsky avanzó por primera vez en  la id...1882 – 1895 - Sergei Sergeevich Nezhdanovsky avanzó por primera vez en  la id...
1882 – 1895 - Sergei Sergeevich Nezhdanovsky avanzó por primera vez en la id...Champs Elysee Roldan
 
1879 – Trabajo de Propulsión en Máquinas Voladoras por Enrico Forlanini
1879 – Trabajo de Propulsión en Máquinas Voladoras por Enrico Forlanini1879 – Trabajo de Propulsión en Máquinas Voladoras por Enrico Forlanini
1879 – Trabajo de Propulsión en Máquinas Voladoras por Enrico ForlaniniChamps Elysee Roldan
 
1877- Trabajos en Propulsión de Maquínas Voladoras de: - Pennington -Abate- R...
1877- Trabajos en Propulsión de Maquínas Voladoras de: - Pennington -Abate- R...1877- Trabajos en Propulsión de Maquínas Voladoras de: - Pennington -Abate- R...
1877- Trabajos en Propulsión de Maquínas Voladoras de: - Pennington -Abate- R...Champs Elysee Roldan
 
1876 - 27 de Enero - Patente Británica de John Buchanan -nº 327- también tit...
1876 - 27 de Enero - Patente Británica de John Buchanan -nº 327-  también tit...1876 - 27 de Enero - Patente Británica de John Buchanan -nº 327-  también tit...
1876 - 27 de Enero - Patente Británica de John Buchanan -nº 327- también tit...Champs Elysee Roldan
 
1871 - 9 de Septiembre: Primeros Intentos No Demostrados de Propulsión de Coh...
1871 - 9 de Septiembre: Primeros Intentos No Demostrados de Propulsión de Coh...1871 - 9 de Septiembre: Primeros Intentos No Demostrados de Propulsión de Coh...
1871 - 9 de Septiembre: Primeros Intentos No Demostrados de Propulsión de Coh...Champs Elysee Roldan
 
Winter_Cosyn_Reaction-Propelled_Manned_Aircraft_Concepts_(1670-1900)_II.pdf
Winter_Cosyn_Reaction-Propelled_Manned_Aircraft_Concepts_(1670-1900)_II.pdfWinter_Cosyn_Reaction-Propelled_Manned_Aircraft_Concepts_(1670-1900)_II.pdf
Winter_Cosyn_Reaction-Propelled_Manned_Aircraft_Concepts_(1670-1900)_II.pdfChamps Elysee Roldan
 
1881 – Nicolai Ivanovich Kibalchich diseña una dipositivo volador propulsado ...
1881 – Nicolai Ivanovich Kibalchich diseña una dipositivo volador propulsado ...1881 – Nicolai Ivanovich Kibalchich diseña una dipositivo volador propulsado ...
1881 – Nicolai Ivanovich Kibalchich diseña una dipositivo volador propulsado ...Champs Elysee Roldan
 
1880 – Julio: Sergei Sergeevich Nezhdanovsky avanzó por primera vez en la id...
1880 – Julio: Sergei Sergeevich Nezhdanovsky avanzó por primera vez en  la id...1880 – Julio: Sergei Sergeevich Nezhdanovsky avanzó por primera vez en  la id...
1880 – Julio: Sergei Sergeevich Nezhdanovsky avanzó por primera vez en la id...Champs Elysee Roldan
 
1881 - El Médico Frances Louis Figuier describió el Mal de Altura
1881 - El Médico Frances Louis Figuier describió el Mal de Altura1881 - El Médico Frances Louis Figuier describió el Mal de Altura
1881 - El Médico Frances Louis Figuier describió el Mal de AlturaChamps Elysee Roldan
 
1872 - El Español Federico Gómez Arias presenta un trabajo sobre la propulsió...
1872 - El Español Federico Gómez Arias presenta un trabajo sobre la propulsió...1872 - El Español Federico Gómez Arias presenta un trabajo sobre la propulsió...
1872 - El Español Federico Gómez Arias presenta un trabajo sobre la propulsió...Champs Elysee Roldan
 
Gaganyaan Test Vehicle TV-D1 Brochure.pdf
Gaganyaan Test Vehicle TV-D1 Brochure.pdfGaganyaan Test Vehicle TV-D1 Brochure.pdf
Gaganyaan Test Vehicle TV-D1 Brochure.pdfChamps Elysee Roldan
 
1872 - Diseño de Torpedo con Cohetes
1872 - Diseño de Torpedo con Cohetes1872 - Diseño de Torpedo con Cohetes
1872 - Diseño de Torpedo con CohetesChamps Elysee Roldan
 
1872 - La Pirotecnia Militar de Sevilla instaló nueva maquinaria para la fabr...
1872 - La Pirotecnia Militar de Sevilla instaló nueva maquinaria para la fabr...1872 - La Pirotecnia Militar de Sevilla instaló nueva maquinaria para la fabr...
1872 - La Pirotecnia Militar de Sevilla instaló nueva maquinaria para la fabr...Champs Elysee Roldan
 
1869 - Se Empieza la Serialización de la Historia de Ciencia Ficción en el Pe...
1869 - Se Empieza la Serialización de la Historia de Ciencia Ficción en el Pe...1869 - Se Empieza la Serialización de la Historia de Ciencia Ficción en el Pe...
1869 - Se Empieza la Serialización de la Historia de Ciencia Ficción en el Pe...Champs Elysee Roldan
 

Más de Champs Elysee Roldan (20)

1886 -1887-El 12 de octubre de 1886 Alexandre Ciurcu recibió la patente franc...
1886 -1887-El 12 de octubre de 1886 Alexandre Ciurcu recibió la patente franc...1886 -1887-El 12 de octubre de 1886 Alexandre Ciurcu recibió la patente franc...
1886 -1887-El 12 de octubre de 1886 Alexandre Ciurcu recibió la patente franc...
 
1885 - 25 de Agosto - El Capitán Griffiths obtiene la Patente Británica No 10...
1885 - 25 de Agosto - El Capitán Griffiths obtiene la Patente Británica No 10...1885 - 25 de Agosto - El Capitán Griffiths obtiene la Patente Británica No 10...
1885 - 25 de Agosto - El Capitán Griffiths obtiene la Patente Británica No 10...
 
Patentes de Aeroplanos en Inglaterra por Robert M.Neilson
Patentes de Aeroplanos en Inglaterra por Robert  M.NeilsonPatentes de Aeroplanos en Inglaterra por Robert  M.Neilson
Patentes de Aeroplanos en Inglaterra por Robert M.Neilson
 
1883- Konstantin Eduardovich Tsiolkovsky Prepara un manuscrito titulado Free ...
1883- Konstantin Eduardovich Tsiolkovsky Prepara un manuscrito titulado Free ...1883- Konstantin Eduardovich Tsiolkovsky Prepara un manuscrito titulado Free ...
1883- Konstantin Eduardovich Tsiolkovsky Prepara un manuscrito titulado Free ...
 
1882- 5 de Octubre: Nace el Padre de la Cohetería Moderna Robert Hutchings G...
1882- 5 de Octubre: Nace el Padre de la Cohetería Moderna  Robert Hutchings G...1882- 5 de Octubre: Nace el Padre de la Cohetería Moderna  Robert Hutchings G...
1882- 5 de Octubre: Nace el Padre de la Cohetería Moderna Robert Hutchings G...
 
1882 - Cohete Salvavidas Norte Americano Cunningham
1882 - Cohete Salvavidas  Norte Americano Cunningham1882 - Cohete Salvavidas  Norte Americano Cunningham
1882 - Cohete Salvavidas Norte Americano Cunningham
 
1882 – 1895 - Sergei Sergeevich Nezhdanovsky avanzó por primera vez en la id...
1882 – 1895 - Sergei Sergeevich Nezhdanovsky avanzó por primera vez en  la id...1882 – 1895 - Sergei Sergeevich Nezhdanovsky avanzó por primera vez en  la id...
1882 – 1895 - Sergei Sergeevich Nezhdanovsky avanzó por primera vez en la id...
 
1879 – Trabajo de Propulsión en Máquinas Voladoras por Enrico Forlanini
1879 – Trabajo de Propulsión en Máquinas Voladoras por Enrico Forlanini1879 – Trabajo de Propulsión en Máquinas Voladoras por Enrico Forlanini
1879 – Trabajo de Propulsión en Máquinas Voladoras por Enrico Forlanini
 
1877- Trabajos en Propulsión de Maquínas Voladoras de: - Pennington -Abate- R...
1877- Trabajos en Propulsión de Maquínas Voladoras de: - Pennington -Abate- R...1877- Trabajos en Propulsión de Maquínas Voladoras de: - Pennington -Abate- R...
1877- Trabajos en Propulsión de Maquínas Voladoras de: - Pennington -Abate- R...
 
1876 - 27 de Enero - Patente Británica de John Buchanan -nº 327- también tit...
1876 - 27 de Enero - Patente Británica de John Buchanan -nº 327-  también tit...1876 - 27 de Enero - Patente Británica de John Buchanan -nº 327-  también tit...
1876 - 27 de Enero - Patente Británica de John Buchanan -nº 327- también tit...
 
1871 - 9 de Septiembre: Primeros Intentos No Demostrados de Propulsión de Coh...
1871 - 9 de Septiembre: Primeros Intentos No Demostrados de Propulsión de Coh...1871 - 9 de Septiembre: Primeros Intentos No Demostrados de Propulsión de Coh...
1871 - 9 de Septiembre: Primeros Intentos No Demostrados de Propulsión de Coh...
 
Winter_Cosyn_Reaction-Propelled_Manned_Aircraft_Concepts_(1670-1900)_II.pdf
Winter_Cosyn_Reaction-Propelled_Manned_Aircraft_Concepts_(1670-1900)_II.pdfWinter_Cosyn_Reaction-Propelled_Manned_Aircraft_Concepts_(1670-1900)_II.pdf
Winter_Cosyn_Reaction-Propelled_Manned_Aircraft_Concepts_(1670-1900)_II.pdf
 
1881 – Nicolai Ivanovich Kibalchich diseña una dipositivo volador propulsado ...
1881 – Nicolai Ivanovich Kibalchich diseña una dipositivo volador propulsado ...1881 – Nicolai Ivanovich Kibalchich diseña una dipositivo volador propulsado ...
1881 – Nicolai Ivanovich Kibalchich diseña una dipositivo volador propulsado ...
 
1880 – Julio: Sergei Sergeevich Nezhdanovsky avanzó por primera vez en la id...
1880 – Julio: Sergei Sergeevich Nezhdanovsky avanzó por primera vez en  la id...1880 – Julio: Sergei Sergeevich Nezhdanovsky avanzó por primera vez en  la id...
1880 – Julio: Sergei Sergeevich Nezhdanovsky avanzó por primera vez en la id...
 
1881 - El Médico Frances Louis Figuier describió el Mal de Altura
1881 - El Médico Frances Louis Figuier describió el Mal de Altura1881 - El Médico Frances Louis Figuier describió el Mal de Altura
1881 - El Médico Frances Louis Figuier describió el Mal de Altura
 
1872 - El Español Federico Gómez Arias presenta un trabajo sobre la propulsió...
1872 - El Español Federico Gómez Arias presenta un trabajo sobre la propulsió...1872 - El Español Federico Gómez Arias presenta un trabajo sobre la propulsió...
1872 - El Español Federico Gómez Arias presenta un trabajo sobre la propulsió...
 
Gaganyaan Test Vehicle TV-D1 Brochure.pdf
Gaganyaan Test Vehicle TV-D1 Brochure.pdfGaganyaan Test Vehicle TV-D1 Brochure.pdf
Gaganyaan Test Vehicle TV-D1 Brochure.pdf
 
1872 - Diseño de Torpedo con Cohetes
1872 - Diseño de Torpedo con Cohetes1872 - Diseño de Torpedo con Cohetes
1872 - Diseño de Torpedo con Cohetes
 
1872 - La Pirotecnia Militar de Sevilla instaló nueva maquinaria para la fabr...
1872 - La Pirotecnia Militar de Sevilla instaló nueva maquinaria para la fabr...1872 - La Pirotecnia Militar de Sevilla instaló nueva maquinaria para la fabr...
1872 - La Pirotecnia Militar de Sevilla instaló nueva maquinaria para la fabr...
 
1869 - Se Empieza la Serialización de la Historia de Ciencia Ficción en el Pe...
1869 - Se Empieza la Serialización de la Historia de Ciencia Ficción en el Pe...1869 - Se Empieza la Serialización de la Historia de Ciencia Ficción en el Pe...
1869 - Se Empieza la Serialización de la Historia de Ciencia Ficción en el Pe...
 

Último

The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 

Último (20)

The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 

NASA Engineering Handbook

  • 2. NASA Systems Engineering Handbook Page ii Foreword from a systems perspective, starting at mission needs and conceptual studies through operations and disposal. In an attempt to demonstrate the potential While it would be impossible to thank all of the dangers of relying on purely ''cookbook" logical people directly involved, it is essential to note the efforts of thinking, the mathematician/philosopher Carl Hempel Dr. Robert Shishko of the Jet Propulsion Laboratory. Bob posed a paradox. If we want to prove the hypothesis was largely responsible for ensuring the completion of this “AII ravens are black," we can look for many ravens effort. His technical expertise and nonstop determination and determine if they all meet our criteria. Hempel were critical factors to ensure the success of this project. suggested changing the hy –pothesis to its logical contrapositive (a rewording with identical meaning) Mihaly Csikzenthmihali defined an optimal would be easier. The new hypothesis becomes: "All experience as one where there is "a sense of exhilaration, a deep sense of enjoyment that is long cherished and nonblack things are nonravens." This transformation, becomes a landmark in memory of what life should be like." I supported by the laws of logical thinking, makes it am not quite sure if the experience which produced this hand much easier to test, but unfortunately is ridiculous. –book can be described exactly this way, yet the sentiment Hempel's raven paradox points out the importance of seems reasonably close. common sense and proper background exploration, even to subjects as intricate as systems engineering. —Dr. Edward J. Hoffman Program Manager, NASA Headquarters In 1989, when the initial work on the NASA Systems Spring 199 Engineering Handbook was started, there were many who were concerned about the dangers of a document that purported to teach a generic NASA approach to systems engineering. Like Hempel's raven, there were concerns over the potential of producing a "cookbook" which of fered the illusion of logic while ignoring experience and common sense. From the tremendous response to the initial (September 1992) draft of the handbook (in terms of both requests for copies and praise for the product), it seems early concerns were largely unfounded and that there is a strong need for this handbook. The document you are holding represents what was deemed best in the original draft and updates information necessary in light of recommendations and changes within NASA. This handbook represents some of the best thinking from across NASA. Many experts influenced its outcome, and consideration was given to each idea and criticism. It truly represents a NASA-wide product and one which furnishes a good overview of NASA systems engineering. The handbook is intended to be an educational guide written from a NASA perspective. Individuals who take systems engineering courses are the primary audience for this work. Working professionals who require a guidebook to NASA systems engineering represent a secondary audience. It was discovered during the review of the draft document that interest in this work goes far beyond NASA. Requests for translating this work have come from international sources, and we have been told that the draft hand book is being used in university courses on the subject. All of this may help explain why copies of the original draft handbook have been in short supply. The main purposes of the NASA Systems Engineering Handbook are to provide: 1) useful information to system engineers and project managers, 2) a generic description of NASA systems engineering which can be supported by center-specific documents, 3) a common language and perspective of the systems engineering process, and 4) a reference work which is consistent with NMI 7120.4/NHB 7120.5. The handbook approaches systems engineering
  • 3. NASA Systems Engineering Handbook Page iii Foreword to the September 1992 Draft As such, this present document is to be considered a next-to-final draft. Your comments, When NASA began to sponsor agency – corrections and suggestions are welcomed, valued wide classes in systems engineering, it was to a and appreciated. Please send your remarks directly to doubting audience. Top management was quick to Robert Shishko, NASA Systems express concern. As a former Deputy Administrator Engineering Working Group. NASA/Jet Propulsion stated "How can you teach an agency-wide systems Laboratory, California Institute of Technology, engineering class when we cannot even agree on 4800 Oak Grove Drive, Pasadena, CA how to define it?" Good question, and one I must 91109-8099. admit caused us considerable concern at that time. —Francis T. Hoban The same doubt continued up until the publication of Program Manager, NASA Headquarters this handbook. The initial systems engineering education conference was held in January 1989 at the Johnson Space Center. A number of representatives from other Centers at tended this meeting and it was decided then that we needed to form a working group to support the development of appropriate and tailored systems engineering courses. At this meeting the representatives from Marshal1 Space Flight Center (MSFC) expressed a strong desire to docu ment their own historic systems engineering process before any more of the key players left the Center. Other Centers also expressed a desire, if not as urgent as MSFC, to document their processes. It was thought that the best way to reflect the totality of the NASA systems engineering process and to aid in developing the needed training was to prepare a top level (Level 0) document that would contain a broad definition of systems engineering, a broad process outline, and typi cal tools and procedures. In general, we wanted a top level overview of NASA systems engineering. To this document would be appended each Center's unique systems engineering manual. The group was well aware of the diversity each Center may have, but agreed that this approach would be quite acceptable. The next step and the most difficult in this arduous process was to find someone to head this yet-to-be-formed working group. Fortunately for NASA, Donna [Pivirotto] Shirley of the Jet Propulsion Laboratory stepped up to the challenge. Today, through her efforts, those of the working group, and the skilled and dedicated authors, we have a unique and possibly a historic document. During the development of the manual we decided to put in much more than may be appropriate for a Level 0 document with the idea that we could always refine the document later. It was more important to capture the knowledge when we could in order to better position our selves for later dissemination. If there is any criticism, it may be the level of detail contained in the manual, but this detail is necessary for young engineers. The present document does appear to serve as a good instructional guide, although it does go well beyond its original intent.
  • 4.
  • 5. NASA Systems Engineering Handbook Page 5 Preface JSC-49040. The SEPIT project life cycle is intentionally consistent with that in NMI 7120.4/NHB This handbook was written to bring the 7120.5 (Management of Major System Programs and fundamental concepts and techniques of systems Projects), but provides more detail on its systems engineering to NASA personnel in a way that engineering aspects. recognizes the nature of NASA systems and the NASA environment. The authors readily acknowledge This handbook consists of five core that this goal will not be easily realized. One reason is chapters: (1) systems engineering's intellectual that not everyone agrees on what systems process, (2) the NASA project life cycle, (3) engineering is, nor on how to do it. There are management issues in systems engineering, (4) legitimate differences of opinion on basic definitions, systems analysis and modeling issues, and (5) content, and techniques. Systems engineering itself is engineering specialty integration. These core a broad subject, with many different aspects. This chapters are supplemented by appendices, which can initial handbook does not (and cannot) cover all of be expanded to accommodate any number of them. templates and examples to illustrate topics in the core chapters. The handbook makes extensive use of The content and style of this handbook show sidebars to define, refine, illustrate, and extend a teaching orientation. This handbook was meant to concepts in the core chapters without diverting the accompany formal NASA training courses on systems reader from the main argument. There are no engineering, not to be a stand-alone, comprehensive footnotes; sidebars are used instead. The structure of view of NASA systems engineering. Systems the handbook also allows for additional sections and engineering, in the authors' opinions, cannot be chapters to be added at a later date. learned simply by starting at a well-defined beginning Finally, the handbook should be considered only a and proceeding seamlessly from one topic to another. starting point. Both NASA as a systems engineering Rather, it is a field that draws from many engineering organization, and systems engineering as a discipline, disciplines and other intellectual domains. The are undergoing rapid evolution. Over the next five boundaries are not always clear, and there are many years, many changes will no doubt occur, and some interesting intellectual offshoots. Consequently, this are already in progress. NASA, for instance, is handbook was designed to be a top-level overview of moving toward implementation of the standards in the systems engineering as a discipline; brevity of International Standards Organization (ISO) 9000 exposition and the provision of pointers to other books family, which will affect many aspects of systems and documents for details were considered important engineering. In systems engineering as a discipline, guidelines. efforts are underway to merge existing systems engineering standards into a common American The material for this handbook was drawn National Standard on the Engineering of Systems, from many different sources, including field center and then ultimately into an international standard. systems engineering handbooks, NASA management These factors should be kept in mind when using this instructions (NMls) and NASA handbooks (NHBs), handbook field center briefings on systems engineering processes, non-NASA systems engineering textbooks and guides, and three independent systems engineering courses taught to NASA audiences. The handbook uses this material to provide only top-level information and suggestions for good systems engineering practices; it is not intended in any way to be a directive. By design, the handbook covers some topics that are also taught in Project Management/Program Control (PM/PC) courses, reflecting the unavoidable connectedness of these three domains. The material on the NASA project life cycle is drawn from the work of the NASA- wide Systems Engineering Working Group (SEWG), which met periodically in 1991 and 1992, and its successor, the Systems Engineering Process Improvement Task (SEPIT) team, which met in 1993 And 1994. This handbook's project life cycle is identical to that promulgated in the SEPIT report, NASA Systems Engineering Process for Programs and Projects,
  • 6. NASA Systems Engineering Handbook Page 6 Acknowledgements Mr. Don Woodruff, NASA/Marshall Space Flight This work was conducted under the overall direction Center of Mr. Frank Hoban, and then Dr. Ed Hoffman, NASA Headquarters/Code FT, under the NASA Pro- Other Sources: gram/Project Management Initiative (PPMI). Dr. Mr. Dave Austin, NASA Headquarters/Code DSS Shahid Habib, NASA Headquarters/Code QW, Mr. Phillip R. Barela, NASA/Jet Propulsion Laboratory provided additional financial support to the NASA- Mr. J.W. Bott, NASA/Jet Propulsion Laboratory wide Systems Engineering Working Group and Dr. Steven L. Cornford, NASA/Jet Propulsion Systems Engineering Process Improvement Task Laboratory team. Many individuals, both in and out of NASA, Ms. Sandra Dawson, NASA/Jet Propulsion Laboratory contributed material, reviewed various drafts, or Dr. James W. Doane, NASA/Jet Propulsion otherwise provided valuable input to this handbook. Laboratory Unfortunately, the lists below cannot include everyone Mr. William Edminston, NASA/Jet Propulsion who shared their ideas and experience. Laboratory Mr. Charles C. Gonzales, NASA/Jet Propulsion Principal Contributors: Laboratory Dr. Robert Shishko, NASA/Jet Propulsion Laboratory Dr. Jairus Hihn, NASA/Jet Propulsion Laboratory Mr. Robert G. Chamberlain, P.E., NASA/Jet Dr. Ed Jorgenson, NASA/Jet Propulsion Laboratory Propulsion Laboratory Mr. Richard V. Morris, NASA/Jet Propulsion Laboratory Other Contributors: Mr. Tom Weber, Rockwell International/Space Mr. Robert Aster, NASA/Jet Propulsion Laboratory Systems Ms. Beth Bain, Lockheed Missiles and Space Company Reviewers: Mr. Guy Beutelschies, NASA/Jet Propulsion Mr. Robert C. Baumann, NASA/Goddard Space Flight Laboratory Center Dr. Vincent Bilardo, NASA/Ames Research Center Mr. Chris Carl, NASA/Jet Propulsion Laboratory Ms. Renee I. Cox, NASA/Marshall Space Flight Dr. David S.C. Chu, Assistant Secretary of Center Defense/Pro-gram Dr. Kevin Forsberg, Center for Systems Management Analysis and Evaluation Dr. Walter E. Hammond, Sverdrup Techology, Inc. Mr. M.J. Cork, NASA/Jet Propulsion Laboratory Mr. Patrick McDuffee, NASA/Marshall Space Flight Mr. James R. French, JRF Engineering Services Center Mr. John L. Gasery, Jr., NASA/Stennis Space Center Mr. Harold Mooz, Center for Systems Management Mr. Frederick D. Gregory, NASA Headquarters/Code Ms. Mary Beth Murrill, NASA/Jet Propulsion Q Laboratory Mr. Don Hedgepeth, NASA/Langley Research Center Dr. Les Pieniazek Lockheed Engineering and Mr. Jim Hines, Rockwell International/Space Systems ScienceS Mr. Keith L. Hudkins, NASA Headquarters/Code MZ Co. Mr. Lou Polaski, Center for Systems Management Dr. Jerry Lake, Defense Systems Management Mr. Neil Rainwater, NASA/Marshall Space Flight College Center Mr. T.J. Lee, NASA/Marshall Space Flight Center Mr. Tom Rowell, NASA/Marshall Space Flight Center Mr. Jim Lloyd, NASA Headquarters/Code QS Ms. Donna Shirley, NASA/Jet Propulsion Laboratory Mr. Woody Lovelace, NASA/Langley Research Mr. Mark Sluka, Lockheed Engineering and Sciences Center Co. Mr. Ron Wade, Center for Systems Management Dr. Brian Mar, Department of Civil Engineering, SEPIT team members (not already mentioned): University Mr. Randy Fleming, Lockheed Missiles and Space of Washington Co. Dr. Ralph F. Miles, Jr., Center for Safety and System Dr. Frank Fogle, NASA/Marshall Space Flight Center Management, University of Southern California Mr. Tony Fragomeni, NASA/Goddard Space Flight Dr. Richard A. Montgomery, Montgomery and Center Dr. Shahid Habib, NASA Headquarters/Code Associates QW Mr. Bernard G. Morais, Synergistic Applications, Inc. Mr. Henning Krome, NASA/Marshall Space Flight Mr. Ron Moyer, NASA Headquarters/Code QW Center Mr. Rudy Naranjo, NASA Headquarters/Code MZ Mr. Ray Lugo, NASA/Kennedy Space Center Mr. Raymond L. Nieder, NASA/Johnson Space Mr. William C. Morgan, NASA/Johnson Space Center Center Dr. Mike Ryschkewitsch, NASA/Goddard Space Flight Mr. James E. Pearson, United Technologies Center Research Mr. Gerry Sadler, NASA/Lewis Research Center Center Mr. Dick Smart, Sverdrup Technology, Inc. Mr. Leo Perez, NASA Headquarters/Code QP Dr. James Wade, NASA/Johnson Space Center Mr. David Pine, NASA Headquarters/Code B Mr. Milam Walters, NASA/Langley Research Center
  • 7. NASA Systems Engineering Handbook Page 7 Mr. Glen D. Ritter, NASA/Marshall Space Flight Center Dr. Arnold Ruskin, NASA/Jet Propulsion Laboratory and University of California at Los Angeles Mr. John G. Shirlaw, Massachusetts Institute of Technology Mr. Richard E. Snyder, NASAlLangley Research Center Mr. Don Sova, NASA Headquarters/Code AE Mr. Marvin A. Stibich, USAF/Aeronautical Systems Center Mr. Lanny Taliaferro, NASAtMarshall Space Flight Center Editorial and graphics support: Mr. Stephen Brewster, NASA/Jet Propulsion Laboratory Mr. Randy Cassingham, NASA/Jet Propulsion Laboratory Mr. John Matlock, NASA/Jet Propulsion Laboratory —Dr. Robert Shishko Task Manager, NASA/Jet Propulsion Laboratory
  • 8. NASA Systems Engineering Handbook Page 1 1 Introduction The subject matter of systems engineering is 1.1 Purpose very broad. The coverage in this handbook is limited to general concepts and generic descriptions of This handbook is intended to provide processes, tools, and techniques. It provides information on systems engineering that will be useful information on good systems engineering practices, to NASA sys-tem engineers, especially new ones. Its and pitfalls to avoid. primary objective is to provide a generic description of There are many textbooks that can be consulted for systems engineering as it should be applied in-depth tutorials. throughout NASA. Field centers' handbooks are encouraged to provide center-specific details of This handbook describes systems implementation. engineering as it should be applied to the development of major NASA systems. Systems For NASA system engineers to choose to engineering deals both with the system being keep a copy of this handbook at their elbows, it must developed (the product system) and the system that provide answers that cannot be easily found does the developing (the producing system). elsewhere. Conse-quently, it provides NASA-relevant Consequently, the handbook's scope properly perspectives and NASA-particular data. NASA includes systems engineering functions regardless of management instructions (NMIs) are referenced when whether they are performed by an in-house systems applicable. engineering organization, a program/project office, or a system contractor. This handbook's secondary objective is to serve as a useful companion to all of the various While many of the producing system's courses in systems engineering that are being offered design features may be implied by the nature of the under NASA's auspices. tools and techniques of systems engineering, it does not follow that institutional procedures for their application must be uniform from one NASA field 1.2 Scope and Depth center to another. Selected Systems Engineering Reading See the Bibliography for full reference data and further reading suggestions. Fundamentals of Systems Engineering Systems Engineering and Analysis (2nd ed.), B.S. Blanchard and W.J. Fabrycky Systems Engineering, Andrew P. Sage An Introduction to Systems Engineering, J.E. Armstrong and Andrew P. Sage Management Issues in Systems Engineering Systems Engineering, EIA/IS-632 IEEE Trial-Use Standard for application and Management of the Systems Engineering Process, IEEE Std 1220- 1994 Systems Engineering Management Guide, Defense Systems Management College System Engineering Management, B.S. Blanchard Systems Engineering Methods, Harold Chestnut Systems Concepts, Ralph Miles, Jr. (editor) Successful Systems Engineering for Engineers and Managers, Norman B. Reilly Systems Analysis and Modeling Systems Engineering Tools, Harold Chestnut Systems Analysis for Engineers and Managers, R. de Neufville and J.H. Stafford Cost Considerations in Systems Analysis, Gene H. Fisher Space Systems Design and Operations Space Vehicle Design, Michael D. Griffin and James R. French Space Mission Analysis and Design (2nd ed.), Wiley J. Larson and James R. Wertz (editors) D i fG h S ft B ij N A l
  • 9. NASA Systems Engineering Handbook Page 2 2 Fundamentals of Systems Engineering The NASA management instruction for the acquisition of “major" systems (NMI 7120.4) defines a 2.1 Systems, Supersystems, and program as “a related series of undertakings that continue over a period of time (normally years), which Subsystems are designed to pursue, or are in support of, a focused scientific or technical goal, and which are A system is a set of interrelated components which characterized by: design, development, and interact with one another in an organized fashion operations of systems." Programs are managed by toward a common purpose. The components of a NASA Headquarters, and may encompass several system may be quite diverse, consisting of persons, projects. organizations, procedures, software, equipment, end In the NASA context, a project encompasses 'or facilities. The purpose of a system may be as the design, development, and operation of one or humble as distributing electrical power within a more sys-tems, and is generally managed by a NASA spacecraft or as grand as exploring the surface of field center. Mars. Headquarters' management concerns include not only the engineering of the systems, but Every system exists in the context of a all of the other activities required to achieve the broader supersystem, i.e., a collection of related desired end. These other activities include explaining systems. It is in that context that the system must be the value of programs and projects to Congress and enlisting international cooperation. The term mission A Hierarchical System Terminology is often used for a program project's purpose; its connotations of fervor make it particu-larly suitable for The following hierarchical sequence of terms for such political activities, where the emo-tional content suc-cessively finer resolution was adopted by the of the term is a desirable factor. In everyday NASA –wide Systems Engineering Working conversation, the terms "project," "mission," and Group (SEWG) and its successor, the Systems "system" are often used interchangeably; while Engineering Process Im-provement Task (SEPIT) imprecise, this rarely causes difficulty. team: System The Technical Sophistication Required to do Segment Systems Engineering Depends on the Project Element Subsystem • The system's goals may be simple and easy to Assembly identify and measure—or they may be technically Subassembly complicated, requiring a great deal of insight Part about the environment or technology within or with which the system must operate. Particular projects may need a different sequence of layers— an instrument may not need as many • The system may have a single goal—or multiple layers, while a broad initiative may need to goals. There are techniques available for distinguish more layers. Projects should establish determining the relative values of multiple goals judged. Thus, managers in the supersystem set — but sometimes goals are truly incommensurate system policies, establish system objectives, and unquantifiable. determine system constraints, and define what costs are relevant. They often have oversight authority over • The system may have users representing system design and operations decisions. factions with conflicting objectives. When there are conflicting objectives, negotiated Most NASA systems are sufficiently complex compromises will be required. that their components are subsystems, which must function in a coordinated way for the system to • Alternative system design concepts may be accomplish its goals. From the point of view of abundant—or they may require creative genius to systems engineering, each subsystem is a system in develop. its own right—that is, policies, requirements, objectives, and which costs are relevant are • A "back-of-the-envelope" computation may be established at the next level up in the hierarchy. satisfactory for prediction of how well the Spacecraft systems often have such subsystems as alternative design concepts would do in propulsion, attitude control telecommunications, and achievement of the goals—or credibility may power. In a large project, the subsystems are likely to depend upon construction and testing of hardware be called "systems". The word system is also used or software models. within NASA generically, as defined in the first paragraph above. In this handbook, system" is generally used in its generic form.
  • 10. NASA Systems Engineering Handbook Page 3 2.2 Definition of Systems Engineering system must provide the most effectiveness for the resources expended or, equivalently, it must be the Systems engineering is a robust approach to the least expensive for the effectiveness it provides. This design, creation, and operation of systems. In simple condition is a weak one because there are usually terms, the approach consists of identification and many designs that meet the condition. Think of each quantification of system goals, creation of alternative possible design as a point in the tradeoff space system design concepts, performance of design Cost trades, selection and implementation of the best The cost of a system is the foregone value of the Systems Engineering per ElA/IS-632 re-sources needed to design, build, and operate it. Be-cause resources come in many forms— work Systems engineering is "an interdisciplinary approach encompassing the entire technical effort to evolve and per-formed by NASA personnel and contractors, verify an integrated and life-cycle balanced set of sys- materials, energy, and the use of facilities and tem people, product, and process solutions that satisfy equipment such as wind tunnels, factories, offices, customer needs. Systems engineering encompasses (a) and computers—it is of en convenient to express the technical efforts related to the development, these values in common terms by using monetary manufacturing, verification, deployment, operations, units (such as dollars). support) disposal of, and user training for, system prod- ucts and processes; (b) the definition and management Effectiveness of the system configuration; (c) the translation of the system definition into work breakdown structures; and The effectiveness of a system is a quantitative (d) development of information for management deci- sion making." measure of the degree to which the system's purpose is achieved. Effectiveness measures are usually very dependent upon system design, verification that the design is properly built performance. For example, launch vehicle and integrated, and post-implementation assessment effectiveness depends on the probability of of how well the system meets (or met) the goals. The successfully injecting a payload onto a usable approach is usually applied repeatedly and trajectory. The associated system performance recursively, with several increases in the resolution of attributes include the mass that can be put into a the system baselines (which contain requirements, specified nominal orbit, the trade between injected design details, verification procedures and standards, mass and launch velocity, and launch availability. cost and performance estimates, and so on). Cost-Effectiveness Systems engineering is performed in concert with system management. A major part of the system The cost-effectiveness of a system combines both engineer's role is to provide information that the the cost and the effectiveness of the system in the system manager can use to make the right decisions. context of its objectives. While it may be This includes identification of alternative design necessary to measure either or both of those in concepts and characterization of those concepts in ways that will help the system managers first discover between effectiveness and cost. A graph plotting the their preferences, then be able to apply them astutely. maximum achievable effectiveness of designs An important aspect of this role is the creation of available with current technology as a function of cost system models that facilitate assessment of the would in general yield a curved line such as the one alternatives in various dimensions such as cost, shown in Figure 1. (In the figure, all the dimensions of performance, and risk. effectiveness are represented by the ordinate and all the dimensions of cost by the abscissa.) In other Application of this approach includes words, the curved line represents the envelope of the performance of some delegated management duties, currently available technology in terms of cost - such as maintaining control of the developing effectiveness. configuration and overseeing the integration of Points above the line cannot be achieved subsystems. with currently available technology e that is, they do not represent feasible designs. (Some of those points 2.3 Objective of Systems Engineering may be feasible in the future when further technological advances have been made.) Points inside the envelope are feasible, but are dominated The objective of systems engineering is to by designs whose combined cost and effectiveness see to it that the system is designed, built, and lie on the envelope. Designs represented by points on operated so that it accomplishes its purpose in the the envelope are called cost-effective (or efficient or most cost-effective way possible, considering non-dominated) solutions. performance, cost, schedule, and risk. Design trade studies, an important part of the systems engineering process, often attempt to A cost-effective system must provide a particular kind find designs that provide a better combination of the of balance between effectiveness and cost: the
  • 11. NASA Systems Engineering Handbook Page 4 various dimensions of cost and effectiveness. When likely point, as is shown for design concept A in the the starting point for a design trade study is inside the figure. Distributions resulting from designs which have envelope, there are alternatives that reduce costs little uncertainty are dense and highly compact, as is without decreasing any aspect of effectiveness. or shown for concept B. Distributions associated with increase some aspect of effectiveness with risky designs may have significant probabilities of producing highly undesirable outcomes, as is suggested by the presence of an additional low effectiveness/high cost cloud for concept C. (Of course, the envelope of such clouds cannot be a sharp line such as is shown in the figures, but must itself be rather fuzzy. The line can now be thought of as representing the envelope at some fixed confidence level -- that is, a probability of x of achieving that effectiveness.) Both effectiveness and cost may require several descriptors. Even the Echo balloons obtained scientific data on the electromagnetic environment and atmospheric drag, in addition to their primary mission as communications satellites. Furthermore, Echo was the first satellite visible to the naked eye, an unquantified -- but not unrecognized —aspect of its Figure 1 -- The Enveloping Surface of Non-dominated effectiveness. Costs, the expenditure of limited Designs. resources, may be measured in the several dimensions of funding, personnel, use of facilities, out decreasing others and without increasing costs. and so on. Schedule may appear as an attribute of Then, the system manager's or system engineer's effectiveness or cost, or as a constraint. Sputnik, for decision is easy. Other than in the sizing of example, drew much of its effectiveness from the fact subsystems, such "win-win" design trades are that it was a "first"; a mission to Mars that misses its uncommon, but by no means rare. When the launch window has to wait about two years for alternatives in a design trade study, however, require another opportunity—a clear schedule constraint. trading cost for effectiveness, or even one dimension Risk results from uncertainties in realized of effectiveness for another at the same cost, the effectiveness, costs, timeliness, and budgets. decisions become harder. Sometimes, the systems that provide the highest ratio of effectiveness to cost are the most desirable. However, this ratio is likely to be meaningless or—worse—misleading. To be useful and meaningful, that ratio must be uniquely determined and independent of the system cost. Further, there must be but a single measure of effectiveness and a single measure of cost. If the numerical values of those metrics are obscured by probability distributions, the ratios become uncertain as well; then any usefulness the simple, single ratio of two numbers might have had disappears. In some contexts, it is appropriate to seek the most effectiveness possible within a fixed budget; in other contexts, it is more appropriate to seek the least cost possible with specified effectiveness. In these cases, there is the question of what level of Figure 2--Estimates of Outcomes to be Obtained from effectiveness to specify or of what level of costs to fix. Several Design Concepts Including Uncertainty. In practice, these may be mandated in the form of performance or cost requirements; it then becomes The process of finding the most cost- appropriate to ask whether a slight relaxation of effective design is further complicated by uncertainty, requirements could produce a significantly cheaper which is shown in Figure 2 as a modification of Figure sys-tem or whether a few more resources could 1. Exactly what outcomes will be realized by a produce a significantly more effective system. particular system design cannot be known in advance Usually, the system manager must choose with certainty, so the projected cost and effectiveness among designs that differ in terms of numerous of a design are better described by a probability attributes. A variety of methods have been developed distribution than by a point. This distribution can be that can be used to help managers uncover their thought of as a cloud which is thickest at the most preferences between attributes and to quantify their likely value and thinner farther away from the most
  • 12. NASA Systems Engineering Handbook Page 5 The System Engineer's Dilemma analytic methods. These specialty engineering areas typically include reliability, maintainability, logistics, At each cost-effective solution: test, production, transportation, human factors, quality • To reduce cost at constant risk, performance assurance, and safety engineering. Specialty must be reduced. engineers contribute throughout the systems • To reduce risk at constant cost, performance engineering process; part of the system engineer's job must be reduced. is to see that these functions are coherently • To reduce cost at constant performance, higher integrated into the project at the right times and that risks must be accepted. they address the relevant issues. One of the objectives for Chapter 6 is to develop an • To reduce risk at constant performance, higher understanding of how these specialty engineers costs must be accepted. contribute to the objective of systems engineering. In both systems analysis and systems In this context, time in the schedule is often a engineering, the amounts and kinds of resources to critical resource, so that schedule behaves like a be made available for the creation of the system are kind assumed to be among the decisions to be made. f t subjective assessments of relative value. When this Systems engineering concentrates on the creation of can be done, trades between attributes can be hardware and software architectures and on the assessed quantitatively. Often, however, the development and management of the interfaces attributes seem to be truly incommensurate; between subsystems, while relying on systems managers must make their decisions in spite of this analysis to construct the mathematical models and multiplicity. analyze the data to evaluate alternative designs and to perform the actual design trade studies. Systems 2.4 Disciplines Related to Systems analysis often requires the use of tools from Engineering operations research, economics, or other decision sciences, and systems analysis curricula generally The definition of systems engineering given include extensive study of such topics as probability, in Section 2.2 could apply to the design task facing a statistics, decision theory, queueing theory, game bridge designer, a radio engineer, or even a theory, linear and non-linear programming, and so on. committee chair. The systems engineering process In practice, many system engineers' academic can be a part of all of these. It cannot be the whole of background is richer in the engineering disciplines the job—the bridge designer must know the than in the decision sciences. As a consequence, the properties of concrete and steel, the radio engineer system engineer is often a consumer of systems must apply Maxwell's equations, and a committee analysis products, rather than a producer of them. chair must understand the personalities of the One of the major objectives for Chapter 5 is to members of the committee. In fact, the optimization of develop an understanding and appreciation of the systems requires collaboration with experts in a state of that art. variety of disciplines, some of which are compared to Operations research and operations systems engineering in the remainder of this section. engineering confine their attention to systems whose The role of systems engineering differs from components are assumed to be more or less that of system management in that engineering is an immutable. That is, it is assumed that the resources analytical, advisory and planning function, while with which the system operates cannot be changed, management is the decision-making function. Very but that the way in which they are used is amenable often, the distinction is irrelevant, as the same to optimization. Operations research techniques often individuals may perform both roles. When no factors provide powerful tools for the optimization of system enter the decision-making process other than those designs. that are covered by the analyses, system Within NASA, terms such as mission management may delegate some of the management analysis and engineering are often used to describe responsibility to the systems engineering function. all study and design efforts that relate to Systems engineering differs from what might determination of what the project's mission should be be called design engineering in that systems and how it should be carried out. Sometimes the engineering deals with the relationships of the thing scope is limited to the study of future projects. being designed to its supersystem (environment) and Sometimes the charters of organizations with such subsystems, rather than with the internal details of names include monitoring the capabilities of systems, how it is to accomplish its objectives. The systems ensuring that important considerations have not been viewpoint is broad, rather than deep: it encompasses overlooked, and overseeing trades between major the system functionally from end to end and systems— thereby encompassing operations temporally from conception to disposal. research, systems analysis, and systems engineering System engineers must also rely on activities. contributions from the specialty engineering Total quality management (TQM) is the disciplines, in addition to the traditional design application of systems engineering to the work disciplines, for functional expertise and specialized environment. That is, part of the total quality
  • 13. NASA Systems Engineering Handbook Page 6 management paradigm is the realization that an operating organization is a particular kind of system and should be engineered as one. A variety of specialized tools have been developed for this application area; many of them can be recognized as established systems engineering tools, but with different names. The injunction to focus on the satisfaction of customer needs, for example, is even expressed in similar terms. The use of statistical process control is akin to the use of technical performance and earned value measurements. Another method, qualify function deployment (QFD), is a technique of requirements analysis often used in systems engineering. The systems approach is common to all of these related fields. Essential to the systems approach is the recognition that a system exists, that it is embedded in a supersystem on which it has an impact, that it may contain subsystems, and that the system's objectives must be understood preferably explicitly identified. 2.5 The Doctrine of Successive Refinement The realization of a system over its life cycle integration of lower-level elements is a part of the results from a succession of decisions among systems engineering process. In fact, there is always alternative courses of action. If the alternatives are a danger that the top-down process cannot keep up precisely enough defined and thoroughly enough with the bottom-up process. understood to be well differentiated in the cost- There is often an early need to resolve the effectiveness space, then the system manager can issues (such as the system architecture) enough so make choices among them with confidence. that the system can be modeled with sufficient realism The systems engineering process can be to do reliable trade studies. thought of as the pursuit of definition and When resources are expended toward the understanding of design alternatives to support those implementation of one of several design options, the decisions, coupled with the overseeing of their resources required to complete the implementation of implementation. To obtain assessments that are crisp that design decrease (of course), while there is enough to facilitate good decisions, it is often usually little or no change in the resources that would necessary to delve more deeply into the space of be required by unselected alternatives. Selected possible designs than has yet been done, as is alternatives thereby become even more attractive illustrated in Figure 3. than those that were not selected. It should be realized, however, that this Consequently, it is reasonable to expect the spiral represents neither the project life cycle, which system to be defined with increasingly better encompasses the system from inception through resolution as time passes. This tendency is formalized disposal, nor the product development process by at some point (in Phase B) by defining a baseline which the system design is developed and system definition. Usually, the goals, objectives, and implemented, which occurs in Phases C and D (see constraints are baselined as the requirements portion Chapter 3) of the project life cycle. Rather, as the of the baseline. The entire baseline is then subjected intellectual process of systems engineering, it is to configuration control in an attempt to ensure that inevitably reflected in both of them. successive changes are indeed improvements. As the system is realized, its particulars become clearer—but also harder to change. As stated Figure 3—The Doctrine of Successive Refinement above, the purpose of systems engineering is to make sure that the development process happens in a way that leads to the most cost-effective final system. The Figure 3 is really a double helix—each basic idea is that before those decisions that are hard create concepts step at the level of design to undo are made, the alternatives should be carefully engineering initiates a ca-pabilities definition spiral assessed. moving in the opposite direction. The concepts can The systems engineering process is applied never be created from whole cloth. Rather, they result again and again as the system is developed. As the from the synthesis of potential capabilities offered by system is realized, the issues addressed evolve and the continually changing state of technology. This the particulars of the activity change. process of design concept development by the
  • 14. NASA Systems Engineering Handbook Page 7 As an Example of the Process of Successive but its first cause. It could be argued that recognition Refinement, Consider the Choice of Altitude for a of the need or opportunity for a new system is an Space Station such as Alpha entrepreneurial activity, rather than an engineering one. • The first issue is selection of the general The end result of this step is the discovery location. Alternatives include Earth orbit, one of and delineation of the system's goals, which generally the Earth-Moon Lagrange points, or a solar orbit. express the desires and requirements of the eventual At the current state of technology, cost and risk users of the system. In the NASA context, the considerations made selection of Earth orbit an system's goals should also represent the long term easy choice for Alpha. • Having chosen Earth interests of the taxpaying public. orbit, it is necessary to select an orbit region. Alternatives include low Earth orbit (LEO), high Identify and Quantify Goals. Before it is possible to Earth orbit and geosynchronous orbit; orbital compare the cost-effectiveness of alternative system inclination and eccentricity must also be chosen. design concepts, the mission to be performed by the One of many criteria considered in choosing LEO system must be delineated. The goals that are for Alpha was the design complexity associated developed should cover all relevant aspects of with passage through the Van Allen radiation effectiveness, cost, schedule, and risk, and should be belts. traceable to the goals of the supersystem. To make it • System design choices proceed to the selection easier to choose among alternatives, the goals should of an altitude maintenance strategy—rules that be stated in quantifiable, verifiable terms, insofar as implicitly determine when, where, and why to re- that is possible and meaningful to do. boost, such as "maintain altitude such that there It is also desirable to assess the constraints are always at least TBD days to reentry," "collision that may apply. Some constraints are imposed by the avoidance maneuvers shall always increase the state of technology at the time of creating or altitude," "reboost only after resupply flights that modifying system design concepts. Others may have brought fuel," "rotate the crew every TBD appear to be inviolate, but can be changed by higher days." levels of management. The assumptions and other • A next step is to write altitude specifications. relevant information that underlie constraints should These choices might consist of replacing the always be recorded so that it is possible to estimate TBDs (values to be determined) in the altitude the benefits that could be obtained from their strategy with explicit numbers. relaxation. • Monthly operations plans are eventually part of At each turn of the spiral, higher-level goals the complete system design. These would include are analyzed. The analysis should identify the scheduled reboost burns based on predictions of subordinate enabling goals in a way that makes them the accumulated effect of drag and the details of traceable to the next higher level. As the systems on-board microgravity experiments. engineering process continues, these are documented as functional requirements (what must • Actual firing decisions are based on determinations of be done to achieve the next-higher-level goals) and the orbit which results from the momentum actually added by previous firings, the atmospheric density as performance requirements (quantitative variations actually encountered, and so on. descriptions of how well the functional requirements must be done). A clear operations concept often helps Note that decisions at every step require that to focus the require-ments analysis so that both the capabilities offered by available technology be functional and performance requirements are considered—often at levels of design that are more ultimately related to the original need or opportunity. detailed than seems necessary at first In later turns of the spiral, further elaborations may become documented as detailed functional and Most of the major system decisions (goals, performance specifications. architecture, acceptable life-cycle cost, etc.) are made during the early phases of the project, so the turns of Create Alternative Design Concepts. Once it is the spiral (that is, the successive refinements) do not under-stood what the system is to accomplish, it is correspond precisely to the phases of the system life possible to devise a variety of ways that those goals cycle. Much of the system architecture can be ''seen" can be met. Sometimes, that comes about as a even at the outset, so the turns of the spiral do not consequence of considering alternative functional correspond exactly to development of the allocations and integrating available subsystem architectural hierarchy, either. Rather, they design options. Ideally, as wide a range of plausible correspond to the successively greater resolution by alternatives as is consistent with the design which the system is defined. organization's charter should be defined, keeping in Each of the steps in the systems engineering mind the current stage in the process of successive process is discussed below. refinement. When the bottom-up process is operating, a problem for the system engineer is that the Recognize Need/Opportunity. This step is shown in designers tend to become fond of the designs they Figure 3 only once, as it is not really part of the spiral create, so they lose their objectivity; the system
  • 15. NASA Systems Engineering Handbook Page 8 engineer often must stay an "outsider" so that there is associated with the continually improving resolution more objectivity. reduces the spread between upper and lower bounds On the first turn of the spiral in Figure 3, the as the process proceeds. sub-ject is often general approaches or strategies, sometimes architectural concepts. On the next, it is Select Concept. Selection among the alternative likely to be functional design, then detailed design, design concepts is a task for the system manager, and so on. who must take into account the subjective factors that The reason for avoiding a premature focus the system engineer was unable to quantify, in on a single design is to permit discovery of the truly addition to the estimates of how well the alternatives best design. Part of the system engineer's job is to meet the quantified goals (and any effectiveness, ensure that the design concepts to be compared take cost, schedule, risk, or other constraints). into account all interface requirements. "Did you When it is possible, it is usually well worth include the cabling?" is a characteristic question. the trouble to develop a mathematical expression, When possible, each design concept should be called an objective function, that expresses the values described in terms of controllable design parameters of combinations of possible outcomes as a single so that each represents as wide a class of designs as measure of cost-effectiveness, as is illustrated in is reasonable. In doing so, the system engineer Figure 4, even if both cost and effectiveness must be should keep in mind that the potentials for change described by more than one measure. When may include organizational structure, schedules, achievement of the goals can be quantitatively procedures, and any of the other things that make up expressed by such an objective function, designs can a system. When possible, constraints should also be be compared in terms of their value. Risks associated described by parameters. with design concepts can cause these evaluations to Owen Morris, former Manager of the Apollo be somewhat nebulous (because they are uncertain Spacecraft Program and Manager of Space Shuttle and are best described by probability distributions). In Systems and Engineering, has pointed out that it is this illustration, the risks are relatively high for design often useful to define design reference missions concept A. There is little risk in either effectiveness or which stress all of the system's capabilities to a cost for concept B. while the risk of an expensive significant extent and which al1 designs will have to failure is high for concept C, as is shown by be able to accomplish. The purpose of such missions is to keep the design space open. Consequently, it can be very dangerous to write them into the system specifications, as they can have just the opposite effect. Do Trade Studies. Trade studies begin with an assess-ment of how well each of the design alternatives meets the system goals (effectiveness, cost, schedule, and risk, both quantified and otherwise). The ability to perform these studies is enhanced by the development of system models that relate the design parameters to those assessments— but it does not depend upon them. Controlled modification and development of design concepts, together with such system models, often permits the use of formal optimization techniques to find regions of the design space that warrant further investigation— those that are closer to the optimum Figure 4—A Quantitative Objective Function, De" surface indicated in Figure 1. pendent on Life-Cycle Cost and All Aspects of Whether system models are used or not, the Effec-tiveness. design concepts are developed, modified, reassessed, and compared against competing the cloud of probability near the x axis with a high cost alternatives in a closed-loop process that seeks the and essentially no effectiveness. Schedule factors best choices for further development. System and may affect the effectiveness values, the cost values, subsystem sizes are often determined during the and the risk distributions. trade studies. The end result is the determination of The mission success criteria for systems bounds on the relative cost-effectivenesses of the differ significantly. In some cases, effectiveness goals design alternatives, measured in terms of the may be much more important than all others. Other quantified system goals. (Only bounds, rather than projects may demand low costs, have an immutable final values, are possible because determination of schedule, or require minimization of some kinds of the final details of the design is intentionally deferred. risks. Rarely (if ever) is it possible to produce a The bounds, in turn, may be derived from the combined quantitative measure that relates all of the probability density functions.) Increasing detail important factors, even if it is expressed as a vector
  • 16. NASA Systems Engineering Handbook Page 9 with several components. Even when that can be often desirable. The accounting system should follow done, it is essential that the underlying factors and (not lead) the system architecture. In terms of relationships be thoroughly revealed to and breadth, partitioning should be done essentially all at understood by the system manager. The system once. As with system design choices, alternative parti manager must weigh the importance of the -tioning plans should be considered and compared unquantifiable factors along with the quantitative data before implementation. provided by the system engineer. If a requirements-driven design paradigm is used for Technical reviews of the data and analyses tile development of the system architecture, it must be are an important part of the decision support applied with care, for the use of "shells" creates a packages prepared for the system manager. The tendency for the requirements to be treated as decisions that are made are generally entered into the inviolable con straints rather than as agents of the configuration management system as changes to (or objectives. A goal, ob -jective or desire should never elaborations of) the system baseline. The supporting be made a requirement until its costs. are understood trade studies are archived for future use. An essential and the buyer is willing to pay for it. The capability to feature of the systems engineering process is that compute the effects of lower -level decisions on the trade studies are performed before decisions are quantified goals should be maintained throughout the made. They can then be baselined with much more partitioning process. That is, there should be a goals confidence. flowdown embedded in the requirements allocation At this point in the systems engineering process. process, there is a logical branch point. For those The process continues with creation of a issues for which the process of successive refinement variety of alternative design concepts at the next level has proceeded far of resolution, construction of models that permit prediction of how well those alternatives will satisfy Simple Interfaces are Preferred the quantified goals, and so on. It is imperative that According to Morris, NASA's former Acting plans for subsequent integration be laid throughout Administrator George Low, in a 1971 paper titled the partitioning. Integration plans include verification "What Made Apollo a Success," noted that only and validation activities as a matter of course. 100 wires were needed to link the Apollo spacecraft to the Saturn launch vehicle. He Implement the Selected Design Decisions. When emphasized the point that a single person could the process of successive refinement has proceeded fully understand the interface and cope with all the far enough, the next step is to reverse the partitioning enough, the next step is to implement the decisions at process. When applied to the system architecture, that level of resolution (that is, unwind the recursive this "unwinding" of the process is called system process). For those issues that are still insufficiently integration. Conceptual system integration takes resolved, the next step is to refine the development place in all phases of the project life cycle. That is, further. when a design approach has been selected, the approach is verified by "unwinding the process" to test Increase the Resolution of the Design. One of the whether the concept at each physical level meets the first issues to be addressed is how the system should expectations and requirements. Physical integration is be subdivided into subsystems. (Once that has been accomplished during Phase D. At the finer levels of done, the focus changes and the subsystems become resolution, pieces must be tested, assembled and/or systems -- from the point of view of a system integrated, and tested again. The system engineer's engineer. The partitioning process stops when the role includes the performance of the delegated subsystems are simple enough to be managed management du ties, such as configuration control holistically.) As noted by Morris, "the divi- be and overseeing the integration, verification, and managed holistically.) As noted by Morris, "the validation process. division of program activities to minimize the number The purpose of verification of subsystem and complexity of interfaces has a strong influence on integration is to ensure that the subsystems conform the overall program cost and the ability of the program to what was designed and interface with each other to meet schedules." as expected in all re spects that are important: Charles Leising and Arnold Ruskin have mechanical connections, effects on center of mass (separately) pointed out that partitioning is more art and products of inertia, electromagnetic interference, than science, but that there are guidelines available: connector impedance and voltage, power con To make interfaces clean and simple, similar sumption, data flow, and so on. Validation consists of functions, designs and tech nologies should be ensuring that the interfaced subsystems achieve their grouped. Each portion of work should be verifiable. intended results. While validation is even more Pieces should map conveniently onto the important than verification, it is usually much more organizational structure. Some of the functions that difficult to accomplish. are needed throughout the design (such as electrical power) or throughout the organization (such as Perform the Mission. Eventually, the system is purchasing) can be centralized. Standardization—of called upon to meet the need or seize the opportunity such things as parts lists or reporting formats—is for which it was designed and built.
  • 17. NASA Systems Engineering Handbook Page 10 The system engineer continues to perform a variety of supporting functions, depending on the nature and duration of the mission. On a large project such as Space Station Alpha, some of these continuing functions include the validation of system effectiveness at the operational site, overseeing the maintenance of configuration and logistics documentation, overseeing sustaining engineering activities, compiling development and operations "lessons reamed" documents, and, with the help of the specialty engineering disciplines, identifying product improvement opportunities. On smaller systems, such as a Spacelab payload, only the last two may be needed.
  • 18. NASA Systems Engineering Handbook Page 11 3 The Project Life Cycle for Major in government. In general, the engineering NASA Systems development life cycle is dependent on the technical nature of what's being developed, and the project life cycle may need to be tailored accordingly. Barry W. One of the fundamental concepts used Boehm described how several contemporary software within NASA for the management of major systems is development processes work; in some of these the pro-gram/ project life cycle, which consists of a processes, the development and construction categorization of everything that should be done to activities proceed in parallel, so that attempting to accomplish a project into distinct phases, separated separate the associated phases on a time line is by control gates. Phase boundaries are defined so undesirable. Boehm describes a spiral, which reflects that they provide more-or-less natural points for the doctrine of successive refinement depicted in go/no-go decisions. Decisions to proceed may be Figure 3, but Boehm's spiral describes the software qualified by liens that must be removed within a product development process in particular. His reasonable time. A project that fails to pass a control discussion applies as well to the development of gate and has enough resources may be allowed to hardware products as it does to software. Other “go back to the drawing board"—or it may be exam-ples of alternative processes are the rapid terminated. prototyping and rapid development approaches. All systems start with the recognition of a Selection of a product development process paradigm need or the discovery of an opportunity and proceed must be a case-dependent decision, based on the through various stages of development to a final system engineer's judgment and experience. disposition. While the most dramatic impacts of the Sometimes, it is appropriate to perform some analysis and optimization activities associated with long-lead-time activities ahead of the time they would systems engineering are obtained in the early stages, nominally be done. Long-lead-time activities might decisions that affect millions of dollars of value or cost consist of technology developments, prototype continue to be amenable to the systems approach construction and testing, or even fabrication of difficult even as the end of the system lifetime approaches. components. Doing things out of their usual sequence Decomposing the project life cycle into increases risk in that those activities could wind up phases or-ganizes the entire process into more having been either unnecessary or improperly manageable pieces. The project life cycle should specified. On the other hand, overall risk can provide managers with incremental visibility into the sometimes be reduced by removal of such activities progress being made at points in time that fit with the from the critical path. management and budgetary environments. NASA Figure 5 (foldout, next page) details the documents governing the acquisition of major resulting management and major systems systems (NMI 7120.4 and NHB 7120.5) define the engineering products and control gates that phases of the project life cycle as: characterize the phases in NMI 7120.4 and NHB 7120.5. Sections 3.1 to 3.6 contain narrative • Pre-Phase A—Advanced Studies ("find a suitable descriptions of the purposes, major activities, project") products, and control gates of the NASA project life • Phase A—Preliminary Analysis ("make sure the cycle phases. Section 3.7 provides a more project is worthwhile") concentrated discussion of the role of systems • Phase B—Definition ("define the project and engineering in the process. Section 3.8 describes the establish a preliminary design") NASA budget cycle within which program/project • Phase C—Design ("complete the system design") managers and system engineers must operate. Phase D — Development ("build, integrate, and verify the system, and prepare for operations") 3.1 Pre-Phase A—Advanced Studies • Phase E—Operations ("operate the system and dispose of it properly"). The purpose of this activity, which is usually per- formed more or less continually by "Advanced Phase A efforts are conducted by NASA field Projects" groups, is to uncover, invent, create, cen-ters; such efforts may rely, however, on pre- concoct and/or devise a broad spectrum of ideas and Phase A in-house and contracted advanced studies. alternatives for missions from which new projects The majority of Phase B efforts are normally (programs) can be selected. Typically, this activity accomplished by industry under NASA contract, but consists of loosely structured ex-aminations of new NASA field centers typically conduct parallel in-house ideas, usually without central control and mostly studies in order to validate the contracted effort and oriented toward small studies. Its major product is a remain an informed buyer. NASA usually chooses to stream of suggested projects, based on the contract with industry for Phases C and D, and often identification of needs and the discovery of does so for Phase E. Phase C is nominally combined opportunities that are potentially consistent with with Phase D, but when large production quantities NASA's mission. capabilities, priorities, and are planned, these are treated separately. resources. Alternatives to the project phases described above can easily be found in industry and elsewhere
  • 19. NASA Systems Engineering Handbook Page 12 Pre-Phase A—Advanced Studies system before seeking significant funding. According to NHB 7120.5, the major products of this phase are a Purpose: To produce a broad spectrum of ideas formal Mission Needs Statement (MNS) and one or and alternatives for missions from which new pro- more credible, feasible designs and operations grams/ projects can be selected. concepts. John Hodge describes this phase as "a Major Activities and their Products: Identify structured version of the previous phase." missions consistent with charter Identify and Phase A—Preliminary Analysis involve users Perform preliminary evaluations of possible Purpose: To determine the feasibility and missions Prepare program/project proposals, desirability of a suggested new major system and which include: its compatibility with NASA's strategic plans. • Mission justification and objectives Major Activities and their Products: • Possible operations concepts Prepare Mission Needs Statement • Possible system architectures Develop top-level requirements • Cost, schedule, and risk estimates. Develop corresponding evaluation criteria/metrics Develop master plans for existing program areas Identify alternative operations and logistics Information Baselined: concepts (nothing) Identify project constraints and system boundaries Control Gates: Consider alternative design concepts, including: Mission Concept Review feasibility and risk studies, cost and schedule Informal proposal reviews estimates, and advanced technology requirements In the NASA environment, demands for new Demonstrate that credible, feasible design(s) exist systems derive from several sources. A major one is Acquire systems engineering tools and models the opportunity to solve terrestrial problems that may Initiate environmental impact studies be ad-dressed by putting instruments and other Prepare Project Definition Plan for Phase B devices into space. Two examples are weather Information Baselined: prediction and communications by satellite. General (nothing) improvements in technology for use in space will Control Gates: continue to open new possibilities. Such opportunities Mission Definition Review are rapidly perceived as needs once the magnitude of Preliminary Non-Advocate Review their value is understood. Preliminary Program/Project Approval Review Technological progress makes possible missions that were previously impossible. Manned trips to the moon and the taking of high resolution In Phase A, a larger team, often associated pictures of planets and other objects in the universe with an ad hoc program or project office, readdresses illustrate past responses to this kind of opportunity. the mission concept to ensure that the project New opportunities will continue to become available justification and practicality are sufficient to warrant a as our technological capabilities grow. place in NASA's budget. The team's effort focuses on Scientific progress also generates needs for analyzing mission requirements and establishing a NASA systems. As our understanding of the universe mission architecture. Activities become formal, and around us continues to grow, we are able to ask new the emphasis shifts toward establishing optimality and more precise questions. The ability to answer rather than feasibility. The effort addresses more these questions often depends upon the changing depth and considers many alternatives. Goals and state of technology. objectives are solidified, and the project develops Advanced studies may extend for several more definition in the system requirements, top-level years, and may be a sequence of papers that are only system architecture, and operations concept. loosely connected. These studies typically focus on Conceptual designs are developed and exhibit more establishing mission goals and formulating top-level engineering detail than in advanced studies. system requirements and operations concepts. Technical risks are identified in more detail and Conceptual designs are often offered to demonstrate technology development needs become focused. feasibility and support programmatic estimates. The The Mission Needs Statement is not shown emphasis is on establishing feasibility and desirability in the sidebar as being baselined, as it is not under rather than optimality. Analyses and designs are configuration control by the project. It may be under accordingly limited in both depth and number of configuration control at the program level, as may the options. program requirements documents and the Preliminary Program Plan. 3.2 Phase A—Preliminary Analysis The purpose of this phase is to further examine the feasibility and desirability of a suggested new major
  • 20.
  • 21. NASA Systems Engineering Handbook Page 14 seek out more cost-effective designs. (Trade studies should precede—rather than follow—system design Figure 6 – Overruns are Very Likely if Phases A decisions. Chamberlain, Fox, and Duquette describe and B are Underfunded. Phase B -- Definition Purpose: To define the project in enough detail to establish an initial baseline capable of meeting mission needs. Major Activities and their Products: Prepare a Systems Engineering Management Plan Prepare a Risk Management Plan Initiate configuration management Prepare engineering specialty program plans Develop system-level cost-effectiveness model Restate mission needs as functional requirements Identify science payloads Establish the initial system requirements and verification requirements matrix Perform and archive trade studies Select a baseline design solution and a concept of operations 3.3 Phase B -- Definition Define internal and external interface requirements The purpose of this phase is to establish an (Repeat the process of successive refinement to initial project baseline, which (according to NHB get "design-to" specifications and drawings, 7120.5) includes "a formal flowdown of the project- verifications plans, and interface documents to level performance requirements to a complete set of lower levels as appropriate) system and subsystem design specifications for both Define the work breakdown structure flight and ground elements" and "corresponding Define verification approach end policies preliminary designs." The technical requirements Identify integrated logistics support requirements should be sufficiently detailed to establish firm Establish technical resource estimates and firm schedule and cost estimates for the project. life-cy-cle cost estimates Develop statement(s) of work A Credible, Feasible Design Initiate advanced technology developments Revise and publish a Project Plan A feasible system design is one that can be Reaffirm the Mission Needs Statement implemented as designed and can then Prepare a Program Commitment Agreement accomplish the system's goals within the Information Baselined: constraints imposed by the fiscal and operating System requirements and verification environment. To be credible, a design must not requirements matrix depend on the occurrence of unforeseen System architecture and work breakdown breakthroughs in the state of the art. While a structure credible design may assume likely improvements Concept of operations in the state of the art, it is nonetheless riskier than “Design-to” specifications at all levels Actually, "the" Phase B baseline consists of Project plans, including schedule, resources, a collection of evolving baselines covering technical acquisition strategies and risk management and business aspects of the project: system (and a decentralized process for ensuring that such trades subsystem) requirements and specifications, designs, lead efficiently to an optimum system design.) Major verification and operations plans, and so on in the products to this point include an accepted "functional" technical portion of the baseline, and schedules, cost baseline and preliminary "design-to" baseline for the projections, and management plans in the business system and its major end items. The effort also portion. Establishment of baselines implies the produces various engineering and management plans implementation of configuration management to prepare for managing the project's downstream procedures. (See Section 4.7.) processes, such as verification and operations, and Early in Phase B, the effort focuses on for implementing engineering specialty programs. allocating functions to particular items of hardware, Along the way to these products, projects software, personnel, etc. System functional and are subjected to a Non-Advocate Review, or NAR. performance requirements along with architectures This activity seeks to assess the state of project and designs become firm as system trades and definition in terms of its clarity of objectives and the subsystem trades iterate back and forth in the effort to thoroughness of technical and management plans,