This slidedeck goes through the technology involved automatiing tests throught the design cycle (MIL, SIL, HIL and test cells). It also touches on topics like lights-out-testing and links to requirements databases.

1. Automating Real-Time Testing
for
Embedded Software
Development
Javier Gutierrez
Business Development Manager
ni.com

2. Agenda
• What is embedded software development?
• What is Real-Time testing?
• Manual Real-Time testing
• Automated Real-Time testing
• Scripting Real-Time tests
ni.com 2

3. Embedded Software Development
Embedded software development is the process
used to create the software for a computer
system (embedded system) designed to perform
one or a few dedicated functions. For example,
an engine control unit (ECU)
ni.com 3

4. Control System
Controller Plant
setpoint error
+
-
ni.com 4

5. Embedded Software Development Process
Tests
Field Test
Requirements
• Calibration
Gathering
Model Controller Plant Physical Testing
Simulation
Controller Plant
+- • Test Cells
+
-
Rapid Hardware in the
Prototyping
Loop Testing
(HIL)
Code Generation
and ECU Flashing
ni.com 5

6. Real-Time Testing (RTT)
Test that provides deterministic stimulus for
reliability and accurate simulation of an
environment
• RTT Types:
• Model in the loop (MIL)
• Rapid Control Prototyping (RCP)
• Hardware in the Loop (HIL)
• Functional Testing / Test Cells
ni.com 6

7. Test Continuity
Simulated
Real
Stimulus, Data Logging, User Interface, Analysis
ni.com 7

8. Embedded Software Development Process
MIL Testing
Field Test
Requirements
• Calibration
Gathering
Model Controller Plant Physical Testing
Simulation
Controller Plant
+- • Test Cells
+
-
Rapid Hardware in the
Prototyping
Loop Testing
(HIL)
Code Generation
and ECU Flashing
ni.com 8

9. Model In the Loop (MIL)
Manual Testing
Requirements
ni.com 9

10. Requirements
Requirement
s
The test system will be used to validate an engine controller model with
different environmental parameter values.
Environmental Conditions
Stimulus and Analysis
• REQ_FTP1000_SpeedProfile
• REQ_CoastalSummer_Conditions
Modify the engine model parameters
Exercise the engine, controller and
to reflect coastal summer conditions:
application model closed loop with
Ambient Temperature = 90 deg
the FTP1000 speed profile.
Ambient Pressure = 14.5 psi
• REQ_NumExceptions_215
• REQ_MountainWinter_Conditions
Analyze the load torque response
vs engine speed. Then compare
Modify the engine model parameters
to reflect mountain winter test results to Mask A. Number of
conditions:
exceptions (points outside the
Ambient Temperature = 20 deg
mask) should be less than 215.
Ambient Pressure = 10.5 psi.
ni.com 10

11. Model In the Loop (MIL)
Manual Testing
Requirements
Models
ni.com 11

12. Engine Model
Requirement Models
s
ni.com 12

13. Model In the Loop (MIL)
Manual Testing
Requirements
Models
Stimulus Profile
ni.com 13

14. Engine FTP1000
Speed Profile
Engine Speed (RPM)
Requirement
s
Models
Stimulus
Profile
Time (s)
ni.com 14

15. Model In the Loop (MIL)
Manual Testing
Requirements
Models
Stimulus Profile
Analysis
ni.com 15

16. Speed/Torque
Mask A Analysis
Requirements
Models
Stimulus Profile
Analysis
ni.com 16

17. Model In the Loop (MIL)
Manual Testing
Requirements
Models
Stimulus Profile
Analysis
ni.com 17

18. Application Software
NI Requirements Gateway
• Requirements traceability
• Impact analysis
• Coverage reporting
NI DIAdem
• Data management
• Data visualization
• Data Analysis and reporting
ni.com 18

19. Application Software
NI TestStand
• Test automation
• Production test optimization
• Batch test data collection and reporting
NI VeriStand
• Real-Time control, stimulus, and data logging
• Simulation automation and visualization
• Control algorithm prototyping
ni.com 19

20. Manual Testing Demo
ni.com 20

21. Model In the Loop (MIL)
Automated Testing
Requirements
Models
Stimulus Profile
Analysis
Stimulus Profile
Analysis
Stimulus Profile
Analysis
ni.com 21

22. Model In the Loop (MIL)
Automated Testing
Automation
Requirement
Models
Stimulus Profiles
Analysis
s
ni.com 22

23. Model In the Loop (MIL)
Automated Testing
Automation
Requirement Models
Stimulus Profiles
Analysis
s
Workspace
Export Channels
Models
Import Channels
Stimulus Profile
Run Script
ni.com 23

24. Model In the Loop (MIL)
Automated Testing
Automation Sequence
Open VeriStand (VS)
Open VeriStand Config File
Requirements
Set Model Parameters
Run Stimulus Profile
Open DIAdem
Export Log
Run Analysis Script
Close DIAdem
ni.com 24

25. Automated Demo
ni.com 25

26. Model In the Loop (MIL)
Scripting Real-Time Tests
• Abstract the complexity of the test sequence creation
• Define the test procedure
• Provide a single tool that abstract other tools
• Talk the same language as the user
ni.com 26

27. Model In the Loop (MIL)
Scripting Real-Time Tests
Automated Test Sequence
Scripting Test
• Use the NIGEL engine, controller
and application model DLLs as
the models to validate
• Use the
CalibFile_CoastalSummer.csv as
model parameters file
• Use the engine 1000.et1 as the
stimulus profile
• Use the
NIGEL_MaskA_Analysis.VBS as
the analysis script and reporting
ni.com 27

28. Model In the Loop (MIL)
Scripting Real-Time Tests
Scripting
Automation
Requiremen Stimulus
Models
Analysis
ts
Profiles
ni.com 28

29. MIL Scripting Demo
ni.com 29

30. Embedded Software Development Process
MIL Testing
Requirements
HIL Testing Field Test
• Calibration
Gathering
Model Controller Plant Physical Testing
Simulation
Controller Plant
+- • Test Cells
+
-
Rapid Hardware in the
Prototyping
Loop Testing
(HIL)
Code Generation
and ECU Flashing
ni.com 30

31. HIL Scripting Demo
ni.com 31

32. Questions?
javier.gutierrez@ni.com
ni.com 32