Sequence VIE Test is ready for Precision Matrix testing for GF-6A pending the approval of the Matrix Design.

Transcription

1 AOAP eballot - Motion that the Seq. VIE Test is ready for Precision Matrix Testing The AOAP met on August 13, 2015 to review the GF-6 Engine Test Development programs. After the review of the Sequence VIE Test Update there was a discussion to ballot the Sequence VIE Test as Ready for Precision Matrix testing. A motion was made that the Sequence VIE Test is ready for Precision Matrix testing for GF-6A pending the approval of the Matrix Design. The AOAP agreed by voice vote to send the Motion to eballot once the Seq. VIE Data was provided by the Surveillance Panel. AOAP members are asked to cast their vote on AOAP motion Sequence VIE Test is ready for Precision Matrix testing for GF-6A pending the approval of the Matrix Design. using the API eballot Website at eballot: Sequence VIE Test is ready for Precision Matrix testing for GF-6A pending the approval of the Matrix Design. Motion Motion by: Seconded by: Sequence VIE Test is ready for Precision Matrix testing for GF-6A pending the approval of the Matrix Design. Gail Evans, Lubrizol Robert Stockwell, Oronite The Seq. VIE Data Presentation supporting the motion is provided on the eballot Website. This eballot will close on Monday, September 7, Note that all Negative Votes must include comments as described in API 1509 Annex C paragraph C.2.2. (a. Specific paragraph, section, or part negative ballot pertains to. b. Specific substantive reason(s) for negative vote. c. Proposed wording or action to resolve negative vote.) Additionally all Abstains must be explained. Should you have any questions, please contact API.

2 eballot Documentation Sequence VIE Test

3 ASTM Sequence VIE New Test Introduction Nathan Moles Sequence VI Surveillance Panel Chairman August 19, 2015

4 Seq. VIE Test Ready for Matrix Vote On August 10th surveillance panel voted the current Seq. VIE test ready to proceed with the precision matrix along with continued efforts to investigate alternate test procedure to evaluate XW-16 oils. 9 yes, 4 waive, 1 negative

5 Seq. VIE Test Ready for Matrix 1. Updated analysis from industry statisticians (slides 423) 2. Sufficient parts are available for matrix and subsequent testing (slide 24) 3. Field Correlation (slide 25) 4. Expectations for completed precision matrix (slide 26) 5. Answers to ASTM New Test Template document (slides 27-41)

6 VIE Prove-Out Data Analysis Statisticians Group 8/14/15

7 Statisticians Group Art Andrews, Exxon Mobil Doyle Boese, Infineum Eric Liu, SwRI Todd Dvorak, Afton Rich Grundza, TMC Kevin O Malley, Lubrizol Jo Martinez, Oronite

8 Conclusions The current VIE data indicates statistical discrimination among the oils tested for FEI1 and FEI2. Based on the analysis presented the estimated standard deviation for both FEI1 and FEI2 is VID LTMS standard deviation is 0.12 and 0.14 for FEI1 and FEI2, respectively. Other estimates have also been calculated based on various subsets of the oils tested. The standard deviation estimates are based on models including oil, lab, engine within lab and engine hour effects. Engine Hours should be included in the precision matrix design. In some of the analyses, lab and engine within lab effects are statistically significant.

9 VIE Data Oil Sample Size Engine Hours w30T1* Total # of VIE Tests with Engine # of VIE Tests with Engine Oil Hours 800 Hours > w30T1 1 0 Total *Validity Code RN, not run per procedure

10 Data Concerns Data used in the analysis is not designed but observational and therefore have a lot of correlation among the variables Engines did not run the same mix of oils Many engines have limited tests High percentage of the tests were run in early engine hours In most cases there s a lack of randomization of oil order in new engines Most of the data in higher hours are with 542 FM carry-over effects could not be accounted for in this data

11 VIE FEI1_OR Combined Oils 542, 542-1, and 1010, Model: s = 0.20 Engine Hours [linear] Oils [542, 1010, 541-1, 5w30T1] Labs [A, B, C, D, F, G] Engine(Lab) Oil LS Mean 542blends blends w30T1* Conclusions (5% level of significance): 1. Oil: 542 > 1010 > 541-1, 5w30T1 2. Lab: No significant lab differences Lab LS Mean D 1.83 A 1.75 F 1.73 G 1.70 B 1.62 C 1.47 Oil/Lab Comparisons with intervals that do not include 0 are significantly different * Validity Code RN not run per procedure

12 VIE FEI2_OR Combined Oils 542, 542-1, and 1010, Model: s = 0.20 Engine Hours [linear] Oils [542, 1010, 541-1, 5w30T1] Labs [A, B, C, D, F, G] Engine(Lab) Oil LS Mean blends w30T1* Conclusions (5% level of significance): 1. Oil: 1010 > 542, 541-1, 5w30T1 2. Lab: D > A Lab LS Mean D 1.58 A 1.35 F 1.63 G 1.40 B 1.40 C 1.98 Oil/Lab Comparisons with intervals that do not include 0 are significantly different * Validity Code RN not run per procedure

13 VIE FEI by Engine Hour * Note: 5w30T1 Validity Code RN not run per procedure

14 VID Precision Matrix and VIE Comparison FEI1 FEI2 VID Precision Matrix VIE Prove-Out VID Precision Matrix VIE Prove-Out Oil LS Mean Oil LSMean Oil LS Mean Oil LSMean X (542) blends 2.41 X (542) blends blends blends 1.86 A (540) 1.32 A (540) w30T1* w30T1* 1.09 D (541) D (541) s 0.14 s 0.20 s 0.16 s 0.20 VID Precision Matrix Oil Discrimination FEI1: X(542), A(540) > D(541) FEI2: A(540) > D(541), X(542) VIE Prove-Out Oil Discrimination FEI1: 542blends > 1010 > 541-1, 5w30T1 FEI2: 1010 > 541-1, 542blends, 5w30T1 *Validity Code RN not run per procedure

15 VID Precision Matrix

16 VID Precision Matrix

17 VID Precision Matrix

18 VID Data and VIE Comparison FEI1 VIE Prove-Out Oil Discrimination FEI1: 542blends > 1010 > 541-1, 5w30T1 FEI2: 1010 > 541-1, 542blends, 5w30T1 VID Data Oil Discrimination FEI1: 542blends > 1010, 540 > 541blends FEI2: 1010 > 540 > 542blends > 541blends FEI2 VID Data VIE Prove-Out VID Data VIE Prove-Out LS Oil Mean Oil LSMean Oil LS Mean Oil LSMean 542blends blends blends blends blends blends w30T1* w30T1* blends blends s 0.12 s 0.20 s 0.13 s 0.20 * VID Data as of 2/19/15 * 5w30T1 Validity Code RN not run per procedure # of VIE Tests with Engine Hours 800 # of VIE Tests with Engine Hours > 800 Oil w30T1 1 0 Total 78 14

19 VID FEI1 Combined Oils 542, 542-1, and Oils 541, Model: s = 0.12 Oils [542, 1010, 541, 540] Labs [A, B, C, D, F, G] Engine(Lab) Oil LS Mean 542blends blends 0.91 Conclusions (5% level of significance): 1. Oil: 542 > 1010, 540 > Lab: C, A > B Lab LS Mean C 1.34 A 1.29 G 1.27 D 1.25 F 1.25 B 1.22 Oil/Lab Comparisons with intervals that do not include 0 are significantly different * VID data as of 2/19/15

20 VID FEI2 Combined Oils 542, 542-1, and Oils 541, Model: s = 0.13 Oils [542, 1010, 541, 540] Labs [A, B, C, D, F, G] Engine(Lab) Oil LS Mean blends blends 0.67 Conclusions (5% level of significance): 1. Oil: 1010 > 540 > 542 > Lab: C > B, D, F; G, A > B; G > D Lab LS Mean C 1.00 G 0.94 A 0.91 F 0.85 D 0.85 B 0.81 Oil/Lab Comparisons with intervals that do not include 0 are significantly different * VID data as of 2/19/15

21 VID FEI (Unadjusted) by Engine Hour * VID data as of 2/19/15

22 VID FEI (Adjusted) by Engine Hour * VID data as of 2/19/15

23 VID Data and VIE Comparison (542 and 541 only) FEI1 FEI2 VID Data VIE Prove-Out VID Data VIE Prove-Out Oil LS Mean Oil LSMean Oil LS Mean Oil LSMean 542blends blends blends blends blends blends s 0.13 s 0.17 s 0.12 s 0.14 VIE Prove-Out Oil Discrimination FEI1: 542blends > FEI2: not significant VID Data Oil Discrimination FEI1: 542blends > 541blends FEI2: 542blends > 541blends * VID data as of 2/19/15 # of VIE Tests with Engine Hours 800 # of VIE Tests with Engine Hours > 800 Oil Total 51 8

24 VID Data and VIE Comparison (542 and 1010 only) FEI1 FEI2 VID Data VIE Prove-Out VID Data VIE Prove-Out Oil LS Mean Oil LSMean Oil LS Mean Oil LSMean 542blends blends blends blends blends blends 1.86 s 0.12 s 0.21 s 0.15 s 0.21 VIE Prove-Out Oil Discrimination FEI1: 542blends > 1010 FEI2: 1010 > 542blends VID Data Oil Discrimination FEI1: 542blends > 1010 FEI2: 1010 > 542blends # of VIE Tests with Engine Hours 800 # of VIE Tests with Engine Hours > 800 Oil Total * VID data as of 2/19/15

25 Standard Deviation Estimates RMSE, estimate of s FEI1 FEI2 VID VIE VID VIE All Oils, VID Prove-Out Matrix All Oils, VID Precision Matrix All Oils, Current VID Data & 541 blends only & 1010 blends only * VID data as of 2/19/15

26 Parts are Available for Matrix CPD handles the engines and related critical engine hardware, they are a Single Source Supplier Currently there is approximately 59 of the original 150 engines available. CPD is acquiring 260 additional engines which is estimated to last 5-6 years based on current consumption rates Three reference oils will be chosen: 542-2: 0W-20 Seq. VID reference oil : 5W-20 Seq. VID reference oil TBD: 5W-30 has been suggested by surveillance panel. Final selection pending with ILSAC approval.

27 Field Correlation The Sequence VID Consortium developed the Sequence VID engine test based on vehicle operating conditions for the FTP-75 and Highway Fuel Economy Tests that responded to both viscometric and friction modifier effects in oils in both North American and Japanese manufacturers engines. Duplicating the Sequence VID test procedure, calculation methods and utilizing the same reference oils, the Sequence VIE produced the same ranking of fuel economy improvements and similar precision that was observed in during the VID prove out testing. Equivalent limits are expected to be established following the completion of the precision matrix

28 Completion of Precision Matrix As a result of completing the precision matrix, several procedural updates are expected including: Estimate of the test precision Updated engine hour correction factor Updated reference oil severity adjustments Number of passing reference oil tests required to calibrate new engine Number of candidate oil runs allowed within a reference period

29 NEW TEST TEMPLATE DATA Follow sections answers questions contained in the ASTM New Test Template document

30 1.0 Reference Oils Do the majority of reference oils represent current technology? A Are the majority of reference oils of passing or borderline pass/fail performance? Pending precision matrix data B* Is reference oil supply and distribution handled through ASTM/TMC? A Is a quality control plan defined and in place? A Is a turnover plan defined/in place to ensure uninterrupted supply of reference oil and an orderly transition to reblends? A Is a process for introducing replacement reference oils defined and in place? A Are oils blended in a homogeneous quantity to last 5 years? A How many reference oil are there and what are the identifying oil codes? TBD, 542-2, RATING SCALE: A Completed; B In Progress; D No Action; E - TBD

31 2.0 Test Parts 2.1 Are all critical parts identified? A Statement from Draft: Discussion-Because of the need for availability, rigorous inspection, and control of many of the parts used in this test method, companies having the capabilities to provide the needed services have been selected as the official suppliers for the Sequence VIE test method. These companies work closely with the Test Procedure Developer and with the ASTM groups associated with the test method to help ensure that the critical engine parts used in this test method are available to the testing industry and function satisfactorily List the parts consider as critical. Next Slide RATING SCALE: A Completed; B In Progress; D No Action; E - TBD

32 2.1.1 Critical Parts List Part Name Mass Air Meter Throttle Body Dual Throttle Body Fuel Injector Spark Plug Crankshaft Sensor Camshaft Sensor Knock Sensor Pre-Cat Sensor Coolant Sensor Exhaust Shield (L.H.) Exhaust Shield (R.H.) Fuel Rail Engine Air Cleaner Assembly Air Cleaner Element Engine Wiring Harness Engine Control Module Exhaust Manifold (R.H.) Exhaust Manifold (L.H.) Exhaust Adapter, (R.H.) Exhaust Adapter, (L.H.) Engine Flywheel Engine Mount Front Engine Mount Rear Engine Mount Isolators Gear, Camshaft, Exhaust, Non-Phased Gear, Camshaft, Intake, Non-Phased Orifice, Coolant, Internal Part No. OHT6D OHT6D OHT6D OHT6D OHT6D GM# OHT6D OHT6D OHT6D OHT6D GM GM GM See description in standard text GM OHT6D OHT6D (Revision 3) GM GM OHT6D OHT6D OHT6D-020-X (Lab specific) OHT3H OHT3H Labs discretion OHT6E-0xx-1 OHT6E-0xx-1 OHT6D RATING SCALE: A Completed; B In Progress; D No Action; E - TBD

33 2.0 Test Parts Continued 2.2 Is a system defined/in place to maintain uniform hardware? CPD handles the engines and related critical engine hardware, they are a Single Source Supplier. Previous slide shows details on engine and parts. A* 2.3 Is there a system for engineering support and test parts supply? A How many tests can be run with the supply of parts currently in stock? As-of 8/18/2015 the current supply is approx. 59 engines, the CPD is purchasing 260 additional engine 2.4 Are critical parts distributed through a Central Parts Distributor (CPD)? A 2.5 Are critical parts serialized, and their use documented in test report? A RATING SCALE: A Completed; B In Progress; D No Action; E - TBD

34 2.0 Test Parts Continued 2.6 Are all parts used on a first in/first out basis? D Engines are preassembled and available from OHT, the initial batch was produced on the assembly line as one batch so the Seq. VI SP has determined the first in/first out requirement is not required. 2.7 Are all rejected critical parts accounted for and returned to the CPD? A 2.8 Does the CPD make status reports to the test surveillance body at least semi-annually? A 2.9 Is there a quality control and turnover plan in place for critical test parts, including identification and measurement of key part attributes, a system for parts quality, accountability and a turnover plan in place for simultaneous industry-wide use of new parts or supply sources? A* OHT is the sole source supplier for the test engines and any critical hardware specified. Next Slide 2.10 Is the CPD active in industry surveillance panel/group, and in industry sponsored test matrices? A RATING SCALE: A Completed; B In Progress; D No Action; E - TBD

35 2.9 Critical Parts A complete list may be found in the VIE Draft Procedure on the TMC web site. X1.3 Test Engine: Sequence VIE engines, part 2012 GM (HFV6) OHT6E X1.4 Dynamometer: A Midwest Model 758 (50-hp) dry gap dynamometer may be ordered from: X1.5 Dynamometer Load Cell: X1.7 Cooling System Pump (P-1): The specified cooling system pump may be obtained from: Gould Pumps, Inc. X1.8 Coolant Heat Exchanger (HX-1): ITT (Model ) ITT Standard Bell & Gossett (BP 75H-20 or BP ) Bell & Gossett ITT X1.9 Coolant Orifice Plate (Differential Pressure): Flowell X1.10 Coolant Control Valves (TCV-104, FCV-103 and TCV-101): Badger Meter, Inc. X1.12 Water Pump Plate: X1.13 Oil Scavenge Pump (P-3): X1.16 External Oil System Solenoid Valves (FCV-150A, FCV-150C, FCV-150D, FCV-150E and FCV-150F): Burkert Contromatic Corp. X1.17 External Oil System Control Valves (TCV-144 and TCV-145): X1.18 Oil Heat Exchanger (HX-6): ITT (Model ): Bell & Gossett (Model BP or BP ): Bell & Gossett ITT 8200 N. Austin Avenue Morton Grove, IL X1.19 Electric Oil Heater Housing (EH-5): X1.20 Oil Filter Housing Assembly OHT6A and Filters (Screen) (FIL-2) Racor 60 micron screen OHT6A-013-3: X1.21 Modified Oil Filter Adapter Plate OHT6D-003-1: X1.23 Modified Oil Pan and Modified Oil Pick-Up Tube OHT6D-001-1: The oil pan and oil level blocking plate may be purchased from: X1.24 Fuel Flow Measurement Mass Flow Meter: MicroMotion, Inc. X1.26 ECU (Engine Control Unit) Revision 3, OHT6D-012-4: X1.27 Engine Wiring Harness Without Interface OHT6D-011-2: X1.28 Modified Coolant Inlet: X1.31 Damper drivelines

36 3.0 Test Fuel 3.1 Is the fuel specified and the supplier(s) identified? A Who is the fuel supplier? A COA for each batch of Lube Cert EEE (HF0003) is generated when the fuel is certified for use. After the fuel is certified, and the COA is generated, the batch is tested weekly for RVP and API Gravity. The data is entered into our control charts. We have an action level for each parameter, and the fuel is adjusted if the RVP or the API Gravity falls below the action level. Tracey King of Haltermann (single source supplier) 3.2 Is a process in place to monitor fuel stability over time? A* Haltermann has a Quality Control system to monitor the test fuel 3.3 Are approval guidelines in place for fuel certification? Test fuel is specified in the Draft test procedure Next Slide A* RATING SCALE: A Completed; B In Progress; D No Action; E - TBD

37 3.3 Fuel Specification TABLE 1 Sequence VIE Fuel Specification Test Method Octane, research min Pb (organic), mg/l max Sensitivity, min Distillation range IBP, C 10 % point, C 50 % point, C 90 % point, C E.P., C (max) Sulfur, mass fraction %, max Phosphorous, mg/l, max RVP, kpa Hydrocarbon composition Olefins, % max Aromatics, % Saturates Existent gum, mg/100 ml, max Oxidation stability, min Carbon weight fraction Hydrogen/Carbon ratio, mol basis Net heating value, J/kg Net heating value, J/kg API gravity D2699 D max 7.5 D86 D86 D86 D86 D86 D5453 D3231 D to to to to min to 15 max to 63.4 D1319 D1319 D1319 D381 D525 E191 E min to 32.5 max Report min Report Report D240 D3338 D4052 Report Report 58.7 min to 61.2 max RATING SCALE: A Completed; B In Progress; D No Action; E - TBD

38 3.0 Test Fuel Continued 3.4 If the test fuel is treated as a critical part of the test procedure: Is an approval plan and severity monitoring plan for each fuel batch in place? See Comments A* 3.5 Is a quality control plan defined and in place to assure long term quality of the fuel? See Comments A* 3.6 Is a turnover plan defined, in place and demonstrated to ensure uninterrupted supply of fuel? See Comments A* Comments: The Seq.VIE Test Fuel is not considered critical by batch, the QC process was provided in previous slide RATING SCALE: A Completed; B In Progress; D No Action; E - TBD

39 4.0 Test Procedure 4.1 Is a technical report published documenting, per ASTM Flow Plan: Test precision for reference oils? Field correlation? Test development history? A A A 4.2 Are test preparation and operation clearly documented in a ASTM standard format? A* A Draft Procedure in ASTM Format is available on the TMC Web Site ftp://ftp.astmtmc.cmu.edu/docs/gas/sequencevi/procedure_and_ils/vie/draft%20vie% pdf 4.3 Are test stand configuration requirements documented and standardized? A* A Draft Procedure in ASTM Format is available on the TMC Web Site ftp://ftp.astmtmc.cmu.edu/docs/gas/sequencevi/procedure_and_ils/vie/draft%20vie% pdf RATING SCALE: A Completed; B In Progress; D No Action; E - TBD

40 4.0 Test Procedure Cont. 4.4 Are milestones for precision improvements established? A* These are included in the Scope and Objectives for the Surveillance Panel ASTM Sequence VI Surveillance Panel Scope and Objectives Scope: The Sequence VI Surveillance Panel is responsible for the surveillance and continued improvement of the ASTM Sequence VI test documented in the current ASTM Standard for the Seq. VID as each is updated by the Information Letter System. Improvements in test operation, test monitoring and test validation will be accomplished through continual communication with the Test Sponsor, ASTM Test Monitoring Center, Central Parts Distributor, ASTM B.O1, and the ASTM Passenger Car Engine Oil Classification Panel. Actions to improve the process will be recommended when deemed appropriate based on input from the aforementioned. The panel will review development and correlation of updated test procedures with previous test procedures. This process will provide the best possible test procedure for evaluating automotive lubricant performance with respect to the lubricant's ability to provide fuel economy benefits. Objectives Target Date Review development of Seq. VIE test for GF-6 In Process Work with ASTM Facilitator to complete ASTM Standard for VIE Pending PM completion Review Proposed Precision Matrix (PM) for VIE Pending Doc. From AOAP Statistical Group to review VIE LTMS and Engine Hr. Adjustment Pending PM completion 4.5 Are routine engine builder workshops planned/conducted? D How often and by whom? Not applicable D RATING SCALE: A Completed; B In Progress; D No Action; E - TBD

41 5.0 Rating and Reporting of Results 5.1 Are the reported ratings from single raters (i.e. not averages from various raters)? D 5.2 Is a suitable severity adjustment system in place? B* Pending Precision Matrix Data 5.3 Is each pass/fail parameter unique and have a significant purpose for judging engine oil performance? A List the pass/fail parameters. FEI2 and FEISUM 5.4 Do all rate and report parameters judge operational validity, help in test interpretation or judge engine oil performance? A 5.5 Are routine rater workshops conducted/planned? No ratings are required D How often and by whom? Not applicable D RATING SCALE: A Completed; B In Progress; D No Action; E - TBD

42 6.0 Calibration, Monitoring and Surveillance 6.1 Is a process in place for independent monitoring of severity and precision with an action plan for maintaining calibration of all laboratories? C* The Surveillance Panel will develop an LTMS once the Precision Matrix is completed 6.2 Are stand, lab, and industry reference oil control charts of all pass/fail criteria parameters used to judge calibration status? C* The Surveillance Panel will develop an LTMS once the Precision Matrix is completed 6.3 Does the specified calibration test interval allow no more than 15 nonreference oil tests between successful calibration tests? C* The Surveillance Panel will develop an LTMS once the Precision Matrix is completed 6.4 Is an ASTM Surveillance Panel in place? A Who is chairman? Nathan Moles RATING SCALE: A Completed; B In Progress; D No Action; E - TBD

43 7.0 Test prove out data 7.1 Has a test development Task Force/TMC visit been made to each of the labs that will participate in the industry precision matrix? C* TMC has completed all lab/stand inspections 7.2 Have prove out tests been run with the finalized test procedure and test parts? A* Data is available on TMC Web Site, a summary is shown in previous slides How many labs and stands? 6 labs and 8 stands RATING SCALE: A Completed; B In Progress; D No Action; E - TBD