Program Measurement and Verification / Implementation
Previous Projects

Design for Excellence 
Impact Evaluation
For Southern California Edison, ADM developed detailed estimates of the impacts of the Design for Excellence Program, SCE's commercial new construction DSM program. The analysis quantified the following post-implementation impacts: first-year savings, load shape changes, and net adoption rates. ADM defined a strategy for selecting program participants for the impact evaluation sample. ADM then conducted phone interviews with a sample of decision-makers to determine their criteria for participation in the program. Title 24 documents were also collected for projects within this sample. High-resolution on-site surveys of 100 participants provided the data for DOE-2 runs correlated to billing data and local weather data. Additional parametric runs compared the energy-use of the buildings under various Title 24 conditions and the as-built conditions. The data from the decision makers' survey was combined with the results of the DOE-2 parametric analysis to inform the overall net-to-gross analysis for the program.
Title-24 Plus Measurement and Evaluation Impact Study ADM performed a study to develop quantitative estimates of the impacts of San Diego Gas and Electric's Commercial New Construction Program, whose technical requirements exceeded California's Title 24 building energy-use criteria. The purpose of the study was to assess the actual (realized) impact of several post-implementation program parameters; first year annual energy savings, load shape impacts, net-to-gross and persistence impacts, incremental customer equipment and installation costs, and total customers' costs. Samples of program participants and nonparticipants were chosen and a survey designed to compare the energy-use of these groups. Realized savings are being evaluated for the two groups using data on building equipment and characteristics, economic and attitudinal characteristics of the businesses involved, and billing and/or end-use metered data. On-site data-collection was used to collect "as built" information not available from existing sources. Monitoring equipment was installed on a subsample of the buildings visited. Metered electricity end-use data were collected that reflected equipment "as-operated" conditions.
Commercial Audit Impact Evaluation ADM was a subcontractor for the evaluation of Consumers Power's Commercial Audit and Bonus Program.  The primary goal of the evaluation is to estimate the gas and electricity energy and demand savings of the program.  ADM conducted on-site engineering audits for a sample of 30 commercial sites, and was responsible for reviewing the engineering assumptions for 170 commercial sites; analyzing and reporting on the kWh and kW energy savings for the program participants.
Residential Audit Program Impact Evaluation ADM was a subcontractor for the evaluation of Consumer's Power Residential Audit Program.  CPCo's residential program offers energy- efficiency information, rebates for customer-installed energy-efficient measures, and direct installation of low-cost energy-efficiency measures. The primary objective of the evaluation was to determine the energy impacts of this program.  ADM developed a sample for on-site verification audits, conducting on-site audits, and reported on the effectiveness of the program.
Residential New Construction Impact Evaluation ADM was a subcontractor for the evaluation of Consumers Power's Energy Wise Home Builder Program.  ADM was responsible for designing the sample for participating and nonparticipating homes, conducting detailed on-site audits of 30 homes, performing engineering simulations of energy use based on the on-site-collected data, and reporting on the kWh and kW impacts of the program measures.
Evaluation of Energy Smart Design Program ADM conducted an evaluation of the gross and net savings impacts of Portland General Electric Company’s Energy Smart Design Program, a new-construction DSM program for the commercial sector.  Estimates of the gross savings in energy use for buildings participating in the ESD Program were derived through comprehensive engineering analysis of the energy use for a sample comprised of both participant and nonparticipant buildings.  Complete data on the building and equipment characteristics and the operational practices of the sample buildings were collected through on-site visits.  For each building in the sample, the data collected on-site were used in a series of parametric simulation runs with the DOE-2 building energy analysis model to develop estimates of annual whole-building and end-use energy use under different sets of building conditions. The gross savings attributable to measures installed under the ESD program were then determined through comparisons of a building’s whole-building and end-use energy use with and without the rebated measures installed.  Net-to-gross ratios for determining the net energy savings of the program were derived both through survey-based estimation methods and through econometric methods.
Evaluation of New Building Design Program ADM prepared an impact evaluation of the gross savings achieved by B.C. Hydro’s New Building Design (NBD) Program.  Estimates of the gross savings in energy use in the new commercial buildings participating in the NBD Program were derived through comprehensive engineering analysis for a sample comprised of both participant and nonparticipant buildings.  Complete data on the building and equipment characteristics and the operational practices of the sample buildings were collected through on-site visits.  For each building in the sample, the data collected on-site were used in a series of parametric simulation runs with the DOE-2 building energy analysis model to develop estimates of annual whole-building and end-use energy use under different sets of building conditions.  The gross savings attributable to measures installed under the NBD program were then determined through comparisons of a building’s whole-building and end-use energy use, with and without the rebated measures installed.
Evaluation of the Large Commercial/Industrial Retrofit Program ADM conducted comprehensive process and impact evaluations of Green Mountain Power Company's Large Commercial and Industrial Retrofit (LCIR) Program.  Data for the evaluations were obtained via: a telephone survey of all participants, on-site data-collection at the facilities of the 10 participants that were responsible for 85% of the program’s impacts, selected end-use metering (using compact data-loggers) at 6 facilities, staff interviews, and a detailed review of all records, correspondence, and other documentation.  The impact evaluation was based on an independent assessment ¾ using engineering analysis ¾ of both electricity savings and fuel-use increases produced by each measure installed because of the program at each of the 10 facilities, plus an analysis of free-ridership and other parameters relevant to a gross-to-net adjustment.
Evaluation of the High-Efficiency Motors and Adjustable Speed Drives Rebate Programs ADM performed process and impact evaluations of two of Cincinnati Gas and Electric Company’s commercial and industrial DSM programs. Through these programs, customers receive rebates for installing high-efficiency motors or ASDs.  We are collecting data via a telephone survey of a sample of participants, staff interviews, and records/documents review.  An engineering analysis was used to estimate the energy and demand savings achieved by the programs.
Process and Impact Evaluations of the Smart Light Program ADM is currently performing process and impact evaluations of Brooklyn Union Gas Company’s 1994 Gas Cooling Rebate DSM program, and has completed a process evaluation of BU’s newly introduced Gas-Engine Drive Pilot Program.  (In 1995, process and impact evaluations of both programs will be performed.)  Both programs are focused on commercializing new technologies (gas-fired absorption-cycle chillers smaller than 10-tons and all equipment larger than 100-tons are not eligible for BU’s rebates).  An interesting feature of the evaluations of these programs is that Consolidated Edison, the electric utility that serves the same customers, also offers a rebates for converting from electric-motor-driven equipment to gas-powered equipment.  The impact evaluations (which are based on both a billing analysis and an SAE analysis of both gas and electricity billing records) will take into account both electricity savings and gas-usage increases.
Impact Evaluation of New York State Energy Star Program ADM conducted process and impact evaluations of the Smart Light Program that Conowingo Power Company (CoPCo), a subsidiary of PECO Energy, offers in its Maryland service territory.  Under the program, residential customers can order (via either mail or telephone) up to 5 compact fluorescent lamps (CFLs) for only $5.00 each, plus a $3.00 shipping charge.  As of the start of the evaluation in June, 1994, more than 2000 customers had participated in the program, and more than 9,000 CFLs had been distributed.  The objectives of the evaluation were to develop: (1) estimates of the program's demand-reduction and annualized energy-savings impacts, and (2) assessments of (a) the adequacy of the program's design and implementation procedures, and (b) customer satisfaction with both the program and the CFLs.  ADM's activities included developing survey questionnaires, conducting survey interviews with 300 participants and 125 nonparticipants, interviewing program staff,  reviewing program records and other documents, calculating annualized demand-reduction and energy-saving impacts, and preparing an Evaluation Report.
Prime Power Pilot Program Evaluation This project had two parts.  The first was to conduct an impact evaluation of the NYSE-STAR Home component of Long Island Lighting Company's Residential New Construction Program.  This work involved conducting a telephone survey of about 300 residential customers and home builders (both participants and nonparticipants), and collecting detailed data on-site for 18 houses (6 NYSE STAR homes, 6 participants in the other components of the New Construction Program, and 6 nonparticipant homes).  Annual fuel-use in the homes were computed using the DOE-2 computerized building energy analysis program, calibrated to actual billing records. The average annual fuel-uses for the three groups were then compared.  The other part of the project was to perform an evaluation of weatherization measures in existing single-family homes that are heated by natural gas.  This evaluation consisted of obtaining detailed data on-site at 5 homes, performing blower-door tests to measure air infiltration, performing the weatherizations, repeating the blower-door tests, and then using the DOE-2 program to estimate annual gas savings for each home.
PG&E Nonresidential Energy Management Services Evaluation For Pacific Gas and Electric, ADM conducted a study of the air conditioner repair program being operated by PG&E in the Fresno area.   Telephone interviews were conducted with 350 PG&E customers in the Fresno area to determine their attitudes toward the program and toward PG&E.  The study was conducted in two waves.  In the pre-wave, telephone interviews were conducted with 200 PG&E customers, divided equally between participants and nonparticipants in the air conditioner study.  In the post-wave, telephone interviews were conducted with 150 participants, using a modified version of the questionnaire used for the pre-wave interviews.

Back



Copyright © ADM Associates, Inc. 2002