SlideShare una empresa de Scribd logo
1 de 26
A Modeller’s Dilemma:
Overfitting or Underperforming?
Tracey Pershouse & Yun Bu (AECOM)
About this presentation
 Requirements for transport modelling
 Three case studies
o Trip generation
o Trip distribution
o Trip distribution and mode choice
 Summary
Page 2
Requirements for Transport
Modelling
Requirements for Transport Modelling
 Replicating base year situations: In practice, it is used as
key measurement of model quality and is often the focus
of model development
 Forecasting future year implications: In practice, it
receives less attention although forecasting is the ultimate
use of models
Case Study – Trip Generation
Case Study – Trip Generation
 Alternative B: Introduce retail job density as an additional
explanatory factor for the number of attractions of
shopping trips
Presentation Title Page 6August 17, 2016
Modelling trip attraction to major shopping centres:
HBS trip attraction = a * number of retail jobs +
b * Ln(retail job density, in jobs / hectare)
 Alternative A: Flags a number of shopping centers as
‘special generators’ and apply adjustment factors derived
from observed data
HBS trip attraction = [a * number of retail jobs] * adjustment factors
Validation Performance
Presentation Title Page 7August 17, 2016
The Alternative B produces considerably worse validation results
for the largest centres (A and B) but better outcomes for relatively
smaller shopping centres (C to H).
Forecasting Performance
Page 8
Alternative A: growth in jobs and growth in trip attractions are similar at
all the shopping centres
Alternative B, faster growth rate for trip attractions at the shopping
centres with relatively lower density, and slower growth rate at D where
the density reaches a very high level
Case Study – Trip Distribution
Case Study – Trip Distribution
August 17, 2016
Calibrate gravity model for HBW trip distribution:
 Alternative A:
- Use observed trip productions and attractions as inputs for
model calibration, even though it is modelled trip ends are
that input to the gravity model for model application
- Only include the OD movements with observed trips > 0,
excluding the ODs with zero trips, even though some of
the zeros may reflect travellers’ choice of not travelling
Case Study – Trip Distribution
Presentation Title Page 11August 17, 2016
Calibrating gravity model for HBW trip distribution:
 Alternative B:
- Use modelled trip productions and attractions as inputs for
calibrating the gravity model parameters
- Include all the o-d pairs including those with zero trips.
This requires aggregating the movements to sector (SA2)
level to remove the zeros that are due to the small sample
size in HTS
Base Year Performance – for model calibration
Page 12August 17, 2016
Observed number of trip productions and attractions are
used to produce the trip distribution curves
Base Year Performance – for model validation
Presentation Title Page 13August 17, 2016
Modelled number of trip productions and attractions are
used to produce the trip distribution curves
Forecasting Performance
Presentation Title Page 14August 17, 2016
Modelled elasticity of changes in trip length in response to
cost increase
Case Study – Trip Distribution and
Mode Choice
Case Study – Trip Distribution and Mode Choice
Presentation Title Page 16August 17, 2016
 Alternative A: mode choice occurs after the trip
distribution (or destination choice)
 This ordering is computationally convenient: OD trip
tables from distribution provide inputs to the mode
choice
 Arguably, this order also fits in a modelers’ experience
of real life in so far as on many occasions travelers’
decide on their destinations first and then choose
between transport modes
Develop destination and mode choice model for HBW trips:
Case Study – Trip Distribution and Mode Choice
Presentation Title Page 17August 17, 2016
Develop destination and mode choice model for HBW trips:
 Alternative B: mode choice occurs before the trip
distribution (or destination choice).
 Less computationally straightforward: the generalized
cost input for mode choice must be aggregated at trip
production level, instead of at trip (origin-destination)
level.
 Due to the aggregation of cost inputs, the resultant
base year validation outcomes tend to be less desirable
than the destination choice first approach.
Validation Performance - Overall mode shares
Presentation Title Page 18August 17, 2016
Similar performance between the two alternatives
Validation Performance – Mode share for SA2 to SA2
movements
Presentation Title Page 19August 17, 2016
Alternative A:
Validation Performance – Mode share for SA2 to SA2
movements
Presentation Title Page 20August 17, 2016
Alternative B – similar performance to Alternative A
Forecasting performance
August 17, 2016 Page 21
Car GC = 30
mins
PT GC = 70
min
Car GC = 30
mins
PT GC = 70
min
D1
D2
Base case assumptions:
1000 trips from origin to
destination D1, D2, via
Car or PT
Destination and Mode
choice results in base case
(for both alternative):
D1, Car = 478 trips
D1, PT = 22 trips
D2, Car = 478 trips
D2, PT = 22 trips
Forecasting performance
August 17, 2016 Page 22
Car GC = 40
mins
PT GC = 70
min
Car GC = 30
mins
PT GC = 70
min
D1
D2
Scenario testing:
Car travel cost to D1
increases from 30 to 40
minutes
Destination and Mode choice
results , Alternative A
(double constrained)
D1, Car = 432 trips
(decrease from 478 in Base)
D1, PT = 68 trips (increase
from 22 trips in Base)
D2, Car = 478 trips
(unchanged from Base)
D2, PT = 22 trips
(unchanged from Base)
Forecasting performance
August 17, 2016 Page 23
Car GC = 40
mins
PT GC = 70
min
Car GC = 30
mins
PT GC = 70
min
D1
D2
Scenario testing:
Car travel cost to D1
increases from 30 to 40
minutes
Destination and Mode choice
results , Alternative B
D1, Car = 394 trips (more
significant decrease)
D1, PT = 106 trips (more
significant increase)
D2, Car = 480 trips (nearly
unchanged)
D2, PT = 20 trips (nearly
unchanged)
Summary
Implications
 Overfitting: Use synthetic measures for fitting base year
outcomes to observed data, which may affect forecasting
performance adversely.
 Underperforming: Accommodate underperformance
(compared with overfitting option) in base year validation,
in exchange of improved forecasting performance
Another option:
Common practice?
Thank You

Más contenido relacionado

La actualidad más candente

La actualidad más candente (8)

PPT8 - Planning and Managing Long Haul Freight Transportation
PPT8 - Planning and Managing Long Haul Freight TransportationPPT8 - Planning and Managing Long Haul Freight Transportation
PPT8 - Planning and Managing Long Haul Freight Transportation
 
PPT9 - Planning and Managing Long Haul Freight Transportation
PPT9 - Planning and Managing Long Haul Freight TransportationPPT9 - Planning and Managing Long Haul Freight Transportation
PPT9 - Planning and Managing Long Haul Freight Transportation
 
PPT10 - Planning and Managing Long Haul Freight Transportation
PPT10 - Planning and Managing Long Haul Freight TransportationPPT10 - Planning and Managing Long Haul Freight Transportation
PPT10 - Planning and Managing Long Haul Freight Transportation
 
MODIFIED VOGEL APPROXIMATION METHOD FOR BALANCED TRANSPORTATION MODELS TOWARD...
MODIFIED VOGEL APPROXIMATION METHOD FOR BALANCED TRANSPORTATION MODELS TOWARD...MODIFIED VOGEL APPROXIMATION METHOD FOR BALANCED TRANSPORTATION MODELS TOWARD...
MODIFIED VOGEL APPROXIMATION METHOD FOR BALANCED TRANSPORTATION MODELS TOWARD...
 
Transportation Planning & Travel Demand Forecasting (Transportation Engineering)
Transportation Planning & Travel Demand Forecasting (Transportation Engineering)Transportation Planning & Travel Demand Forecasting (Transportation Engineering)
Transportation Planning & Travel Demand Forecasting (Transportation Engineering)
 
Facility location
Facility locationFacility location
Facility location
 
3-Trip Generation-Distribution ( Transportation and Traffic Engineering Dr. S...
3-Trip Generation-Distribution ( Transportation and Traffic Engineering Dr. S...3-Trip Generation-Distribution ( Transportation and Traffic Engineering Dr. S...
3-Trip Generation-Distribution ( Transportation and Traffic Engineering Dr. S...
 
Multi depot Time-dependent Vehicle Routing Problem with Heterogeneous Fleet
Multi depot Time-dependent Vehicle Routing Problem with Heterogeneous FleetMulti depot Time-dependent Vehicle Routing Problem with Heterogeneous Fleet
Multi depot Time-dependent Vehicle Routing Problem with Heterogeneous Fleet
 

Similar a A modeller’s dilemma: overfitting or underperforming

Facility location and techniques
Facility location and techniquesFacility location and techniques
Facility location and techniques
Piyush Sharma
 
Promotion for a Logistic Project
Promotion for a Logistic ProjectPromotion for a Logistic Project
Promotion for a Logistic Project
Huang Zachary
 
Talk_SciEnvRes_Gombodshaw_Boß_0466122.pptx
Talk_SciEnvRes_Gombodshaw_Boß_0466122.pptxTalk_SciEnvRes_Gombodshaw_Boß_0466122.pptx
Talk_SciEnvRes_Gombodshaw_Boß_0466122.pptx
Gombo2
 
Modeling Truck Movements: A Comparison between the Quick Response Freight Man...
Modeling Truck Movements: A Comparison between the Quick Response Freight Man...Modeling Truck Movements: A Comparison between the Quick Response Freight Man...
Modeling Truck Movements: A Comparison between the Quick Response Freight Man...
inventionjournals
 
An Enhanced Agglomerative Clustering Algorithm for Solving Vehicle Routing Pr...
An Enhanced Agglomerative Clustering Algorithm for Solving Vehicle Routing Pr...An Enhanced Agglomerative Clustering Algorithm for Solving Vehicle Routing Pr...
An Enhanced Agglomerative Clustering Algorithm for Solving Vehicle Routing Pr...
ijtsrd
 
"Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ...
"Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ..."Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ...
"Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ...
Ravinder Dahiya
 
APTA Annual 2016 GIRO first mile last mile
APTA Annual 2016 GIRO first mile last mileAPTA Annual 2016 GIRO first mile last mile
APTA Annual 2016 GIRO first mile last mile
Arjan van Andel
 
2013-03-15_BalanceMHub&Parking_final
2013-03-15_BalanceMHub&Parking_final2013-03-15_BalanceMHub&Parking_final
2013-03-15_BalanceMHub&Parking_final
Joshua Engel-Yan
 

Similar a A modeller’s dilemma: overfitting or underperforming (20)

Facility location and techniques
Facility location and techniquesFacility location and techniques
Facility location and techniques
 
Uber APM Take-Home Test
Uber APM Take-Home TestUber APM Take-Home Test
Uber APM Take-Home Test
 
My Portfolio
My PortfolioMy Portfolio
My Portfolio
 
Promotion for a Logistic Project
Promotion for a Logistic ProjectPromotion for a Logistic Project
Promotion for a Logistic Project
 
Talk_SciEnvRes_Gombodshaw_Boß_0466122.pptx
Talk_SciEnvRes_Gombodshaw_Boß_0466122.pptxTalk_SciEnvRes_Gombodshaw_Boß_0466122.pptx
Talk_SciEnvRes_Gombodshaw_Boß_0466122.pptx
 
An Intro to estimating travel demand
An Intro to estimating travel demandAn Intro to estimating travel demand
An Intro to estimating travel demand
 
Transportation chain shipping cost calculation for multi leg with different v...
Transportation chain shipping cost calculation for multi leg with different v...Transportation chain shipping cost calculation for multi leg with different v...
Transportation chain shipping cost calculation for multi leg with different v...
 
Modeling Truck Movements: A Comparison between the Quick Response Freight Man...
Modeling Truck Movements: A Comparison between the Quick Response Freight Man...Modeling Truck Movements: A Comparison between the Quick Response Freight Man...
Modeling Truck Movements: A Comparison between the Quick Response Freight Man...
 
An Enhanced Agglomerative Clustering Algorithm for Solving Vehicle Routing Pr...
An Enhanced Agglomerative Clustering Algorithm for Solving Vehicle Routing Pr...An Enhanced Agglomerative Clustering Algorithm for Solving Vehicle Routing Pr...
An Enhanced Agglomerative Clustering Algorithm for Solving Vehicle Routing Pr...
 
Route Performance : YUL - CDG
Route Performance : YUL - CDGRoute Performance : YUL - CDG
Route Performance : YUL - CDG
 
TDM and Transportation Infrastructure: An Essential Part of Any Master Plan
TDM and Transportation Infrastructure: An Essential Part of Any Master PlanTDM and Transportation Infrastructure: An Essential Part of Any Master Plan
TDM and Transportation Infrastructure: An Essential Part of Any Master Plan
 
Bay Area regional transit fare coordination
Bay Area regional transit fare coordinationBay Area regional transit fare coordination
Bay Area regional transit fare coordination
 
Model-Based Optimization for Effective and Reliable Decision-Making
Model-Based Optimization for Effective and Reliable Decision-MakingModel-Based Optimization for Effective and Reliable Decision-Making
Model-Based Optimization for Effective and Reliable Decision-Making
 
Viamente Route Planner
Viamente Route PlannerViamente Route Planner
Viamente Route Planner
 
Route optimization algorithm..
Route optimization algorithm..Route optimization algorithm..
Route optimization algorithm..
 
"Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ...
"Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ..."Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ...
"Efficient and Effective Logistics by way of On Time Delivery (OTD)- A study ...
 
CONTAINER TRAFFIC PROJECTIONS USING AHP MODEL IN SELECTING REGIONAL TRANSHIPM...
CONTAINER TRAFFIC PROJECTIONS USING AHP MODEL IN SELECTING REGIONAL TRANSHIPM...CONTAINER TRAFFIC PROJECTIONS USING AHP MODEL IN SELECTING REGIONAL TRANSHIPM...
CONTAINER TRAFFIC PROJECTIONS USING AHP MODEL IN SELECTING REGIONAL TRANSHIPM...
 
APTA Annual 2016 GIRO first mile last mile
APTA Annual 2016 GIRO first mile last mileAPTA Annual 2016 GIRO first mile last mile
APTA Annual 2016 GIRO first mile last mile
 
Ichiro Satoh
Ichiro SatohIchiro Satoh
Ichiro Satoh
 
2013-03-15_BalanceMHub&Parking_final
2013-03-15_BalanceMHub&Parking_final2013-03-15_BalanceMHub&Parking_final
2013-03-15_BalanceMHub&Parking_final
 

Más de JumpingJaq

Más de JumpingJaq (20)

Richard Tang - Mitcham Princes Road Crossing
Richard Tang - Mitcham Princes Road CrossingRichard Tang - Mitcham Princes Road Crossing
Richard Tang - Mitcham Princes Road Crossing
 
Darren Blasdale - Seaford roundabout
Darren Blasdale - Seaford roundaboutDarren Blasdale - Seaford roundabout
Darren Blasdale - Seaford roundabout
 
Zak Valiff - Causeway Road and Semaphore Road Shared Use Paths
Zak Valiff - Causeway Road and Semaphore Road Shared Use PathsZak Valiff - Causeway Road and Semaphore Road Shared Use Paths
Zak Valiff - Causeway Road and Semaphore Road Shared Use Paths
 
Lydia Kairl - King William pedestrian crossings
Lydia Kairl - King William pedestrian crossingsLydia Kairl - King William pedestrian crossings
Lydia Kairl - King William pedestrian crossings
 
Shaun Smith - Resident street parties
Shaun Smith - Resident street partiesShaun Smith - Resident street parties
Shaun Smith - Resident street parties
 
Shaun Smith - Narrow road parking
Shaun Smith - Narrow road parkingShaun Smith - Narrow road parking
Shaun Smith - Narrow road parking
 
Edward Chan - Local Area Traffic Management Novar Gardens and Camden Park
Edward Chan - Local Area Traffic Management Novar Gardens and Camden ParkEdward Chan - Local Area Traffic Management Novar Gardens and Camden Park
Edward Chan - Local Area Traffic Management Novar Gardens and Camden Park
 
Li Meng - Shared mobility
Li Meng - Shared mobilityLi Meng - Shared mobility
Li Meng - Shared mobility
 
Gabby O'Neil - Safe System Approach
Gabby O'Neil - Safe System ApproachGabby O'Neil - Safe System Approach
Gabby O'Neil - Safe System Approach
 
Paul Froggatt - KWR presentation
Paul Froggatt - KWR presentationPaul Froggatt - KWR presentation
Paul Froggatt - KWR presentation
 
Ingrid Hunt - Traffic control device approval
Ingrid Hunt - Traffic control device approval  Ingrid Hunt - Traffic control device approval
Ingrid Hunt - Traffic control device approval
 
David Hayes - Robust decision making
David Hayes - Robust decision makingDavid Hayes - Robust decision making
David Hayes - Robust decision making
 
Paul Steely White Plenary
Paul Steely White PlenaryPaul Steely White Plenary
Paul Steely White Plenary
 
Aecom - Streets for people workshop
Aecom - Streets for people workshop Aecom - Streets for people workshop
Aecom - Streets for people workshop
 
AITPM Conference Presentation - Bob Davis
AITPM Conference Presentation - Bob DavisAITPM Conference Presentation - Bob Davis
AITPM Conference Presentation - Bob Davis
 
AITPM Conference Presentation - Casper Baum
AITPM Conference Presentation - Casper BaumAITPM Conference Presentation - Casper Baum
AITPM Conference Presentation - Casper Baum
 
AITPM Conference Presentation - Laurie Piggott
AITPM Conference Presentation - Laurie PiggottAITPM Conference Presentation - Laurie Piggott
AITPM Conference Presentation - Laurie Piggott
 
AITPM Conference Presentation - David Sanders
AITPM Conference Presentation - David SandersAITPM Conference Presentation - David Sanders
AITPM Conference Presentation - David Sanders
 
AITPM Conference Presentation - Willem Deddam
AITPM Conference Presentation - Willem DeddamAITPM Conference Presentation - Willem Deddam
AITPM Conference Presentation - Willem Deddam
 
AITPM Conference Presentation - Nicole Lockwood
AITPM Conference Presentation - Nicole LockwoodAITPM Conference Presentation - Nicole Lockwood
AITPM Conference Presentation - Nicole Lockwood
 

Último

Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
SanaAli374401
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 

Último (20)

Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 

A modeller’s dilemma: overfitting or underperforming

  • 1. A Modeller’s Dilemma: Overfitting or Underperforming? Tracey Pershouse & Yun Bu (AECOM)
  • 2. About this presentation  Requirements for transport modelling  Three case studies o Trip generation o Trip distribution o Trip distribution and mode choice  Summary Page 2
  • 4. Requirements for Transport Modelling  Replicating base year situations: In practice, it is used as key measurement of model quality and is often the focus of model development  Forecasting future year implications: In practice, it receives less attention although forecasting is the ultimate use of models
  • 5. Case Study – Trip Generation
  • 6. Case Study – Trip Generation  Alternative B: Introduce retail job density as an additional explanatory factor for the number of attractions of shopping trips Presentation Title Page 6August 17, 2016 Modelling trip attraction to major shopping centres: HBS trip attraction = a * number of retail jobs + b * Ln(retail job density, in jobs / hectare)  Alternative A: Flags a number of shopping centers as ‘special generators’ and apply adjustment factors derived from observed data HBS trip attraction = [a * number of retail jobs] * adjustment factors
  • 7. Validation Performance Presentation Title Page 7August 17, 2016 The Alternative B produces considerably worse validation results for the largest centres (A and B) but better outcomes for relatively smaller shopping centres (C to H).
  • 8. Forecasting Performance Page 8 Alternative A: growth in jobs and growth in trip attractions are similar at all the shopping centres Alternative B, faster growth rate for trip attractions at the shopping centres with relatively lower density, and slower growth rate at D where the density reaches a very high level
  • 9. Case Study – Trip Distribution
  • 10. Case Study – Trip Distribution August 17, 2016 Calibrate gravity model for HBW trip distribution:  Alternative A: - Use observed trip productions and attractions as inputs for model calibration, even though it is modelled trip ends are that input to the gravity model for model application - Only include the OD movements with observed trips > 0, excluding the ODs with zero trips, even though some of the zeros may reflect travellers’ choice of not travelling
  • 11. Case Study – Trip Distribution Presentation Title Page 11August 17, 2016 Calibrating gravity model for HBW trip distribution:  Alternative B: - Use modelled trip productions and attractions as inputs for calibrating the gravity model parameters - Include all the o-d pairs including those with zero trips. This requires aggregating the movements to sector (SA2) level to remove the zeros that are due to the small sample size in HTS
  • 12. Base Year Performance – for model calibration Page 12August 17, 2016 Observed number of trip productions and attractions are used to produce the trip distribution curves
  • 13. Base Year Performance – for model validation Presentation Title Page 13August 17, 2016 Modelled number of trip productions and attractions are used to produce the trip distribution curves
  • 14. Forecasting Performance Presentation Title Page 14August 17, 2016 Modelled elasticity of changes in trip length in response to cost increase
  • 15. Case Study – Trip Distribution and Mode Choice
  • 16. Case Study – Trip Distribution and Mode Choice Presentation Title Page 16August 17, 2016  Alternative A: mode choice occurs after the trip distribution (or destination choice)  This ordering is computationally convenient: OD trip tables from distribution provide inputs to the mode choice  Arguably, this order also fits in a modelers’ experience of real life in so far as on many occasions travelers’ decide on their destinations first and then choose between transport modes Develop destination and mode choice model for HBW trips:
  • 17. Case Study – Trip Distribution and Mode Choice Presentation Title Page 17August 17, 2016 Develop destination and mode choice model for HBW trips:  Alternative B: mode choice occurs before the trip distribution (or destination choice).  Less computationally straightforward: the generalized cost input for mode choice must be aggregated at trip production level, instead of at trip (origin-destination) level.  Due to the aggregation of cost inputs, the resultant base year validation outcomes tend to be less desirable than the destination choice first approach.
  • 18. Validation Performance - Overall mode shares Presentation Title Page 18August 17, 2016 Similar performance between the two alternatives
  • 19. Validation Performance – Mode share for SA2 to SA2 movements Presentation Title Page 19August 17, 2016 Alternative A:
  • 20. Validation Performance – Mode share for SA2 to SA2 movements Presentation Title Page 20August 17, 2016 Alternative B – similar performance to Alternative A
  • 21. Forecasting performance August 17, 2016 Page 21 Car GC = 30 mins PT GC = 70 min Car GC = 30 mins PT GC = 70 min D1 D2 Base case assumptions: 1000 trips from origin to destination D1, D2, via Car or PT Destination and Mode choice results in base case (for both alternative): D1, Car = 478 trips D1, PT = 22 trips D2, Car = 478 trips D2, PT = 22 trips
  • 22. Forecasting performance August 17, 2016 Page 22 Car GC = 40 mins PT GC = 70 min Car GC = 30 mins PT GC = 70 min D1 D2 Scenario testing: Car travel cost to D1 increases from 30 to 40 minutes Destination and Mode choice results , Alternative A (double constrained) D1, Car = 432 trips (decrease from 478 in Base) D1, PT = 68 trips (increase from 22 trips in Base) D2, Car = 478 trips (unchanged from Base) D2, PT = 22 trips (unchanged from Base)
  • 23. Forecasting performance August 17, 2016 Page 23 Car GC = 40 mins PT GC = 70 min Car GC = 30 mins PT GC = 70 min D1 D2 Scenario testing: Car travel cost to D1 increases from 30 to 40 minutes Destination and Mode choice results , Alternative B D1, Car = 394 trips (more significant decrease) D1, PT = 106 trips (more significant increase) D2, Car = 480 trips (nearly unchanged) D2, PT = 20 trips (nearly unchanged)
  • 25. Implications  Overfitting: Use synthetic measures for fitting base year outcomes to observed data, which may affect forecasting performance adversely.  Underperforming: Accommodate underperformance (compared with overfitting option) in base year validation, in exchange of improved forecasting performance Another option: Common practice?