TCD PFS Evaluation of Symbol Signs Bryan Katz Gene Hawkins Jason Kennedy Outline Introduction Background Focus Groups and Expert Panel Comprehension and Legibility Distance Testing Recommendations and Conclusions Group Discussion Background Project chosen by TCD PFS in 2005 Replacement of current signs and creation of new signs for new services and technologies Most signs tested not in MUTCD Three tasks within research study Sign development Lit review Focus Groups Expert Panel Comprehension testing Legibility distance testing Background 10 different sign categories Type 3 Object Marker Wireless Internet Ferry Motorcycle Warning Rental Car Information School Bus Stop Truck Parking Photo Enforcement Truck Electrification
1 2 3 4 5 6 A B Object Marker Ferry Focus Groups C Rental Car D School Bus Stop Four focus groups conducted in Jan/Feb 2006 E F Photo Enforcement Wireless Internet Two in Falls Church, VA (Washington DC area) Highly populated with expansive highway system G H Motorcycle Warning Information Two in College Station, TX Less populated/college town with primarily rural highway system I Truck Parking J Truck Electrification Focus Groups Falls Church, VA Focus Group 1 Mid-day 6 Participants, 2 male and 4 female 1 motorcyclist (female) Focus Group 2 8 Participants, 5 male and 3 female 1 motorcyclist (male) Focus Groups College Station, TX Focus Group 3 Evening 9 Participants, 5 male and 4 female No motorcyclists Focus Group 4 9 Participants, 3 male and 6 female No motorcyclists
Focus Groups Focused Interviews with Truck Drivers Carmel Church, VA at a Flying J Truck Stop 10 Truck Drivers (9 Males, 1 Female) Truck Parking Symbol Truck Electrification Symbol Focus Groups Moderator initiated general discussion Elements of a good sign Sample of participants comments on beneficial sign element: Visibility Clear and unambiguous Color Consistent design Shape Size and style (font) of letters Procedure In-context photo + discussion, Example alternatives + more discussion Message clarity Consistency Noticeable/conspicuous Placement Considers driver expectancy In-Context Photo Wi-Fi, Truck Parking, Information Object Markers Alternatives
Expert Panel Ferry Panelists included engineers, human factors psychologists TCD PFS members FHWA Panel down-selected signs to help narrow down sign set for study Recommendations incorporated into creation of signs Object Marker Rental Car
School Bus Stop Ahead Automated Enforcement Wireless Internet Motorcycle Warning
Motorist Information Truck Parking Truck Stop Electrification Comprehension Research conducted at various locations Springfield Mall Fairfax County, VA McLean Community Center Fairfax County, VA New Kent County Rest Area New Kent, VA 174 Research Participants 21 commercial vehicle drivers (valid CDL) 18 and older Valid driver s license Survey featured 5 6 signs 10 15 minutes
Legibility Distance Laboratory study conducted in the FHWA SignSim 36 Symbol Signs 48 participants Ages 21 84 Half 75+ Legibility Distance Matching task Binder versus screen Participants responded same or different 100% correct for valid data Simulated distance Distances transformed from voltage output Average distance: 165 feet for all participants Relative distances between signs can be used to choices of preferred alternative Actual distance needs to be calibrated in the field Ferry Alternative 1 Alternative 2 Alternative 3 Type 3 Object Marker Alternative 1 Alternative 2 Alternative 3 Alternative 4 Alternative 5 Alternative 6 Mean Legibility Distance 121 116 123 Clearly Understood 60% 68% 72% Maybe Understood 4% 12% 4% Not Understood 36% 20% 24% High Water 0% 0% 8% Ferry 79% 79% 79% Car Trailers 17% 8% 8% Cruise Ship 0% 4% 4% Cargo Ship 4% 8% 0% Acceptable Users Cars 100% 96% 92% Trucks 24% 28% 84% Motorcycles 56% 44% 48% Passengers 48% 48% 40% Bicycles 40% 40% 24% Mean Legibility Distance 235 204 212 201 183 230 Clearly Understood 0% 4% 0% 0% 0% 4% Maybe Understood 24% 20% 8% 4% 16% 0% Not Understood 76% 76% 92% 96% 84% 96% Roadway Ends Ahead 16% 21% 17% 0% 29% 13% Hazardous Object 8% 25% 0% 0% 29% 8% Left Hand Curve 72% 46% 71% 96% 33% 79% Construction Ahead 4% 4% 0% 4% 4% 0% Pothole in Road 0% 4% 13% 0% 4% 0% Required Action Drive to Right of Sign 0% 4% 4% 0% 4% 8% Drive to Left of Sign 29% 24% 72% 79% 8% 68% Sign Gives No Direction 71% 72% 24% 21% 88% 24% Average Rating 1.58 2.96 4.00 4.65 2.23 3.03 Average Rating 4.85 5.17 5.23
Rental Car Alternative 1 Alternative 2 Alternative 3 School Bus Stop Alternative 1 Alternative 2 Alternative 3 Alternative 4 Alternative 5 Mean Legibility Distance 201 186 157 Clearly Understood 20% 16% 20% Maybe Understood 0% 0% 0% Not Understood 80% 84% 80% Parking Lot Ahead 29% 35% 23% Reminder to Lock Car 29% 30% 18% Valet Parking 8% 13% 14% Rental Car 21% 17% 45% Locksmith 13% 4% 0% Mean Legibility Distance 212 142 205 202 168 Clearly Understood 84% 80% 76% 56% 76% Maybe Understood 12% 12% 12% 24% 16% Not Understood 4% 8% 12% 20% 8% School Crosswalk 0% 0% 5% 15% 5% School Bus Stop 90% 95% 95% 85% 95% Children at Play 5% 0% 0% 0% 0% School Zone Ahead 5% 5% 0% 0% 0% Average Rating 6.28 5.56 5.44 3.97 5.27 Average Rating 3.14 3.10 4.33 Photo Enforcement Alternative 1 Alternative 2 Alternative 3 Wireless Internet Alternative 1 Alternative 2 Alternative 3 Alternative 4 Mean Legibility Distance 188 234 165 Clearly Understood 72% 80% 92% Maybe Understood 20% 8% 0% Not Understood 8% 12% 8% Red Light Enforcement Cameras 83% 96% 92% Sun Glare 0% 0% 0% Traffic Signal Ahead 0% 0% 0% Scenic View Ahead 0% 0% 0% Speed Limit Enforced by Radar 4% 0% 0% Speeding Enforcement Cameras 13% 4% 8% Mean Legibility Distance 145 152 143 188 Clearly Understood 76% 52% 80% 16% Maybe Understood 8% 32% 4% 0% Not Understood 16% 16% 16% 84% Reduce Radio Noise 0% 4% 0% 5% Fallout Shelter 0% 0% 0% 0% Radio Tower 4% 4% 0% 38% Wireless Internet 96% 88% 96% 43% Satellite Radio 0% 4% 4% 14% Average Rating 4.75 5.20 4.81 2.60 Average Rating 6.15 5.49 4.09
Motorcycle Warning Alternative 1 Alternative 2 Alternative 3 Alternative 4 Motorist Information Alternative 1 Alternative 2 Alternative 3 Mean Legibility Distance 199 204 187 184 Clearly Understood 36% 40% 48% 36% Maybe Understood 8% 10% 36% 24% Not Understood 32% 20% 16% 40% Wear Helmet for Safety 0% 0% 4% 8% Motorcycle Warning 84% 83% 87% 75% Motorcycles Permitted 4% 9% 4% 8% Watch for Motorcyclists 12% 9% 4% 8% Motorcycle Parking Ahead 0% 0% 0% 0% Average Rating 4.99 4.78 5.19 5.42 Mean Legibility Distance 218 232 157 Clearly Understood 52% 60% 96% Maybe Understood 4% 8% 0% Not Understood 44% 32% 4% Use Caution 4% 0% 0% Wireless Internet Available 20% 0% 0% Medical Assistance 0% 8% 5% Traveler Information 76% 92% 95% Services Expected Maps Available 60% 84% 79% Brochures Available 80% 80% 75% Manned Booth During Business Hours 44% 64% 46% Manned Booth 24 Hours 28% 36% 25% Average Rating 4.85 5.17 5.23 Truck Parking Alternative 1 Alternative 2 Alternative 3 Truck Electrification Alternative 1 Alternative 2 Mean Legibility Distance 150 175 220 Clearly Understood 84% 88% 68% Maybe Understood 8% 4% 24% Not Understood 8% 8% 8% Passing Trucks is Permitted 0% 4% 8% Heavy Truck Loads Permitted 0% 0% 4% Truck Parking 100% 96% 88% Weigh Station Ahead 0% 0% 0% Loading Zone 0% 0% 0% Vehicles Permitted Cars 4% 0% 13% Small Trucks 56% 64% 52% Tractor Trailers 76% 84% 96% Recreational Vehicles 32% 20% 24% Buses 40% 28% 32% Average Rating 5.21 5.61 3.27 Mean Legibility Distance 201 184 Clearly Understood 20% 32% Maybe Understood 36% 28% Not Understood 44% 40% Truck Parking for Electric Powered Trucks 17% 25% Truck Electrification Available 39% 29% Beware of Wires 0% 0% Truck Stop Ahead 4% 0% Truck Parking and Electric Vehicle Charging 39% 46% Average Rating 5.32 4.90
Ferry If only cars are permitted, alternative on left should be used If trucks are permitted, the alternative on the right should be used Object Marker None of the alternatives adequately show a hazard; however, the existing marker performed better than the others If direction element is required, then the alternative (right) was more clear to motorists Rental Car Rental car symbol with $ was most easily understood, but the meaning of the sign is still not clear to motorists Text may be a better option for this sign School Bus Stop Ahead If a symbol is desired, the School Bus Stop Ahead sign with the rear view of a school bus was clearly understood and had the best legibility distance of symbols
Automated Enforcement Camera symbol shown below as a separate plaque was easier to comprehend and had the best legibility distance Wireless Internet The wireless internet symbols shown below were easy to comprehend and had similar legibility distances Motorcycle Warning Old-fashioned style motorcycle symbol as a separate placard was similar to other alternatives for comprehension but had the best legibility distance Motorist Information? Mark had the best legibility distance but INFO had the best comprehension ratings i was not easily understood
Truck Parking Truck parking symbol alternative shown below was the easiest to comprehend and performed better in the legibility distance tests than an alternative with the P inside the symbol Truck Stop Electrification Neither symbol was understood (perhaps since concept is new) If symbol is chosen, alternative below performed the best in legibility testing Group Discussion Questions and Comments?