Table of Contents

Papers

What Can You Achieve for Your Country? Experience Feedback from the 2011 NEEAPs
Stefan Thomas, Wuppertal Institute for Climate, Environment and Energy

    Evaluating Energy Savings Arising from NEEAP Implementation: Lessons Learned in Croatia
    Vesna Bukarica, University of Zagreb
    Nenad Debrecin, University of Zagreb Faculty of Electrical Engineering and Computing
    Zeljka Hrs Borkovic, Energy Institute Hrvoje Pozar
    Damir Pesut, Energy Institute Hrvoje Pozar

    Sensitivity Analysis for Calculating the ESD Energy Savings Target with Top Down Method: The French Experience of NEEAP2
    Didier Bosseboeuf, ADEME
    Bruno Lapillonne, Enerdata sa
    Jean-Sébastien Broc, Ecole des Mines de Nantes

    Are the Energy Savings Sufficient? Impact of Energy Efficiency Policies Included in the 2011 NEEAPs
    Barbara Schlomann, Fraunhofer Institute for Systems and Innovation Research
    Wolfgang Eichhammer, Fraunhofer ISI
    Stefano Faberi, ISIS

Plotting the Right Course; Using Evaluation to Set Targets and Develop Policy
Charles Michaelis, Databuild Research and Solutions

    Evaluating the ESD and CHP Directive: A Methodology Addressing Multiple Complexities and Addressing Various Information Sources
    Piet Boonekamp, ECN
    Monique Voogt, SQ Consult

    How to Shape a Binding Energy Savings Target for Europe that Allows for Effective Evaluation
    Robert Harmsen, Utrecht University
    Bart Wesselink, WWF
    Wolfgang Eichhammer, Fraunhofer ISI

    Current Status and Implications of Energy Efficiency Programs in Korea
    Hyeong-Jung Kim, Korea Energy Management Corporation
    Sang-Soo Ahn, Korea Energy Management Corporation
    Woo-Nam Lee, Konkuk University
    Jong-Bae Park, Konkuk University
    Jae-Hyung Roh, Konkuk University

Exploring the Impacts and Effectiveness of MEPS and Labelling Schemes
Anita Eide, Director of European Programs, CLASP

    Estimation Tool for National Effects of MEPS and Energy Labeling
    Troels Fjordbak Larsen, IT Energy ApS
    Karolina Petersson, Swedish Energy Agency
    Rikke Noeraa, Danish Energy Agency

    China’s Practices on Evaluating the Energy Savings of Mandatory Energy Efficiency Standards
    Li Pengcheng, China National Institute of Standardization
    Liu Meng, CNIS
    Chen Haihong, CNIS
    Li Yan, CNIS

    Evaluation of Local Enforcement of Energy Efficiency Standards and Labeling Program in China
    Nina Zheng, Lawrence Berkeley National Laboratory
    Nan Zhou, Lawrence Berkeley National Laboratory
    Cecilia Fino-Chen, Lawrence Berkeley National Laboratory
    David Fridley, Lawrence Berkeley National Laboratory

Evaluation Method Challenges in the Real World
Michelle McGuire, Databuild Research and Solutions

    Second Time Around: Improving a Second Evaluation while Maintaining Comparability with the First
    Sara Pasquier, International Energy Agency
    Nigel Jollands, European Bank for Reconstruction and Development

    Sample Size Selection in Energy Efficiency Research and Evaluation – The Use and Abuse of the Coefficient of Variation
    Andie Baker, Tacoma Power

    What Makes a Good EUL? Analysis of Existing Estimates and Implications for New Protocols for Estimated Useful Lifetimes (EULs)
    Lisa Skumatz, Skumatz Economic Research Associates Inc.

Evaluation of Behaviour Change Programmes
Edward Vine, Lawrence Berkeley National Laboratory and California Institute for Energy and Environment

    Widgets vs. Actions: Measuring the Role of Behavior Change in DSM Programs
    David J. Freeman, Skumatz Economic Research Associates Inc.
    Lisa Skumatz, Skumatz Economic Research Associates Inc.

    Analysis of the Effectiveness of the Campaign for District Heating Energy Savings Considering Seasonal Influence
    Hyeong-Jung Kim, Korea Energy Management Corporation
    Sang-Soo Ahn, Korea Energy Management Corporation
    Sung-Hee Lee, Konkuk University
    Woo-Nam Lee, Konkuk University
    Jong-Bae Park, Konkuk University

    Behavior Change and Driving Forces to Save Electricity in the Electricity Crisis in Japan
    Ken-ichiro Nishio, Central Research Institute of Electric Power Industry
    Kenta Ofuji, University of Aizu

Energy Provider Programmes
Marcella Pavan, Regulatory Autority for Electricity and Gas (AEEG)

    Detailed Comparison of Brazilian and French Obligation Schemes to Promote Energy Efficiency
    Jean-Sébastien Broc, Ecoles des Mines de Nantes - Dept. S.E.E.
    Conrado Augustus de Melo, University of Campinas
    Gilberto Jannuzzi, UNICAMP

    Evaluating Policies for Energy Provider-Delivered Energy Efficiency
    Grayson Heffner, International Energy Agency
    Eoin Lees, Regulatory Assistance Project - Brussels, Belgium
    David Crossley, Regulatory Assistance Project - Sydney, Austrailia
    Janine Migden-Ostrander, Regulatory Assistance Project - Montpelier, VT, USA

Policies for Building
Dominique Osso, EDF

    Effectiveness of Financial Incentives to Energy Efficiency-Case: Croatia
    Vesna Bukarica, University of Zagreb
    Slavko Krajcar, University of Zagreb Faculty of Electrical Engineering and Computing

    Assessment of Building Energy Policies in the IEA and the BRICS Countries
    Yamina Saheb, International Energy Agency
    Alastair Blyth, OECD
    Aurelien Saussay, International Energy Agency
    Vida Rozite, International Energy Agency
    MaryRose Cleere, International Energy Agency

    Combining Theoretical Analysis with Empirical Evidence from an International Comparison: Policy Packages to Make Energy Savings in Buildings Happen
    Stefan Thomas, Wuppertal Institute for Climate, Environment and Energy
    Vera Hofele, Wuppertal Institute for Climate, Environment and Energy
    Lena Tholen, Wuppertal Institute for Climate, Environment and Energy

Top-Down Potential in Energy Efficiency Policy Analysis
Anna Maria Salama, ENEA

    A Decompostion Approach to Evaluating the Progress of the New Green Economy
    Brian Cloughley, International Institute for Industrial Environmental Economics at Lund University
    Luis Mundaca, International Institute for Industrial Environmental Economics at Lund

    The View from the Top: Application of Macro-Economic Models to Measure Energy-Efficiency Program Savings in California
    Hossein Haeri, The Cadmus Group
    Jim Stewart, The Cadmus Group
    Ayat Osmon, The Energy Division, California Public Utilities Commission

    An Analysis of Eco-Efficiency in Energy Use and CO2 Emissions in the Swedish Service Industries
    Clara Ines Pardo Martinez, Royal Institute of Technology (KTH)
    Semida Silveira, Royal Institute of Technology

Improving and Harmonizing EM&V Methods
Even Bjørnstad, Enova SF

    The Development of a National Energy Efficiency Data-framework and Its Use in Evaluating Energy Efficiency Policies
    Mary Gregory, Department of Energy and Climate Change, UK
    Julian Prime, Department of Energy and Climate Change

    Ontario's EM&V Protocols and Requirements:  An Author's Perspective
    Kevin Monte de Ramos, KMDR Research

    Comparable Energy Savings: How to Ensure that Singers Form a Harmonious Chorus?
    Harry Vreuls, NL Agency

Managing Peak Demand
Daniel Violette, Navigant Consulting, Inc.

    Evidence of Consistency Over Time of the Demand Response of Large Commercial and Industrial Customers in Aggregator-Based Programs
    Steven Braithwait, Christensen Associates Energy Consulting

    Consolidated Edison of New York Room Air Conditioning Pilot
    Mei Shibata, ThinkEco
    Vicki Kuo, Consolidated Edision Company of New York
    Curt Puckett, KEMA, Inc.

    Comfort and Load Control: It's Getting Hot in Here -- But Is the Utility to Blame?
    Frank Stern, Navigant Consulting, Inc.
    Nicholas DeDominicis, PECO
    Greg Ekrem, Navigant
    Bethany Glinsmann, Navigant

Multiple-Benefits of Energy Efficiency: What More Is There to Gain?
Mirjam Harmelink, Harmelink Consulting

    Spreading the Net: Evaluating the Multiple Benefits Delivered by Energy Efficiency Policy
    Charlotte Forbes, International Energy Agency
    Nina Campbell, IEA, Paris, France
    Lisa Ryan, IEA, Paris, France

    Evaluating Energy Efficiency Benefits for Energy Providers and Customers
    Grayson Heffner, International Energy Agency
    Nina Campbell, International Energy Agency

    Driving Back to the Future: Understanding the Impact of Transport Programmes over Time
    Kate Jenkins, Energy Saving Trust
    David Kenington, Databuild Research and Solutions

European- and US-Wide Evaluations: Challenges and Lessons Learnt
Jean-Sébastien Broc, Ecoles des Mines de Nantes - Dept. S.E.E.

    National Evaluation of US Department of Energy State Energy Program
    Kathleen Gaffney, DNV KEMA

    How are the Neighbours Doing? Making Energy Efficiency Efforts Comparable through NEEAP Screening
    Vera Hoefele, Wuppertal Institute for Climate, Environment and Energy
    Ralf Schule, Wuppertal Institute for Climate, Environment and Energy
    Stefan Thomas, Wuppertal Institute for Climate, Environment and Energy
    Daniel Becker, Ecofys Germany GmbH

Residential Incentives: Tax Credits, Direct Installation, and Market Transformation
Rob Bordner, Energy Market Innovations, Inc.

    Long Term Market Transformation from a Short Term Subsidy: Energy Savings from Residential Air-to-Air Heat Pumps in Norway
    Even Bjornstad, Enova SF
    Per Ivar Helgesen, Enova SF

    The 55% Tax Reductions for Building Retrofitting in Italy: The Results of the ENEA's Five-Years Activities
    Giampaolo Valentini, ENEA
    Patrizia Pistochini, ENEA

    Moderate Income Comprehensive Energy Efficiency Program Evaluation
    Robert Mowris, Verified, Inc.
    Ean Jones, Verified, Inc.

Modeling for Understanding Achievement of Savings
Piet Boonekamp, Energy Center of the Netherlands

    Interactions Between Energy Efficiency Policies and Emission Trading Schemes: Modelling the Effects on Carbon Prices and Industrial Competitiveness
    Johannes Thema, Wuppertal Institute for Climate, Environment and Energy
    Felix Suerkemper, Wuppertal Institute for Climate, Environment and Energy
    Adrian Amelung, Institute of Energy Economics, Cologne University
    Katharina Grave, Institute of Energy Economics, Cologne University

    The Impact of Building Energy Codes on the Energy Efficiency of Residential Space Heating in European Countries--A Stochastic Frontier Approach
    Aurelien Saussay, International Energy Agency
    Yamina Saheb, International Energy Agency
    Philippe Quirion, Centre National de la Recherche Scientifique

Smart Meters, Smart Consumers & Smart Evaluations
Harry Vreuls, NL Agency

    Can Smart Meters Make Smarter Customers?  Evaluating the Impact of Smart Meters on Customer Energy Efficiency Behaviors
    Sharyn Barata, Itron
    Linda Warne, Itron
    Michael Messenger, Itron
    Corrine Da Silva, LEVEL

    Effects of Feedback on Residential Electricity Demand - Results from a Field Trial in Austria
    Joachim Schleich, Fraunhofer Institute for Systems and Innovation Research
    Marian Klobasa, Fraunhofer ISI
    Sebastian Golz, Fraunhofer Institute for Solar Energy Systems (ISE)

    Impact, Process, and Technology Assessment for Smart Meter-Enabled Demand Response
    Stuart Schare, Navigant

    OG&E Smart Study TOGETHER: Technology-Enabled Dynamic Pricing Impact Evaluation
    Craig Williamson, EnerNOC Utility Solutions
    Katie Chiccarelli, OG&E

Moving from Ex-Ante to Ex-Post: Alternative Methods to Assess Expectations Versus Reality
Kevin Cooney, Navigant Consulting

    On-site Measurement and Verification Versus Project File Desk Review
    Michael Frischmann, Michaels Energy
    Ryan Kroll, Michaels Energy

    An Energy Efficiency Program Analysis to Understand the Gaps Between Ex Ante and Ex Post Evaluations
    Maxime Raynaud, EDF R&D and CEP MINES ParisTech
    D. Osso, EDF - R&D
    J. Adnot, CEP MINES ParisTech
    B. Bourges, GEPEA
    B. Duplessis, CEP MINES Paris Tech

    Splendid Isolation: How People Affect Anticipated Energy Measure Performance
    John Fawcett, Databuild Research and Solutions

Building Codes--Review and Impact Assessment
Aleksandra Novikova, Climate Policy Initiative at DIW Berlin

    Codes to Cleaner Buildings: Effectiveness of U.S. Building Energy Codes
    Jeff Deason, Climate Policy Initiative
    Andrew Hobbs, Climate Policy Initiative

    European Survey on the Energy Performance of Buildings and Related Policies -- Results and Lessons Learned
    Marina Economidou, Buildings Performance Institute Europe
    Joana Maio, Buildings Performance Institute Europe

The Role of Energy Management Standards in Achieving Targets in the Industrial Sector
Pierre Landry, Southern California Edison

    Promoting Energy Management Systems through Energy Efficiency Programmes, Incentives, and Support, Lessons Learnt from Evaluations in Denmark, Ireland and Sweden
    Amelie Goldberg, Institute for Industrial Productivity
    Julia Reinaud, Institute for Industrial Productivity

    Policy Pyramids: An Evaluation Framework for Industrial GHG Mitigation Policies
    Julia Reinaud, Institute for Industrial Productivity
    Amelie Goldberg, Institute for Industrial Productivity

    Evaluating Industrial Energy Management Systems – Considerations for an Evaluation Plan
    Christian Stenqvist, Lund University

Market Transformation: Appliances and Lighting
Li Pengcheng, China National Institute of Standardization

    Home Appliance Programs Hit the Wall
    Jane Peters, Research Into Action, Inc.
    Marti Frank, Research Into Action, Inc.
    Caroline Chen, Southern California Edison

    Evaluation of a Lighting Market Transformation Program in Austrailia - Outcomes and Attributions
    George Wilkenfeld, George Wilkenfeld & Associates
    Using Experimental Designs to Evaluate New Program Initiatives
    John Reed, Innovologie LLC

Energy Savings from Behavioural Initiatives in Commercial Businesses and Buildings
Iris Sulyma, BC Hydro PowerSmart

    Evaluating Personalised Energy Feedback Information for Behaviour Change in Commercial Buildings
    Michael Coleman, De Montfort University
    Katherine Irvine, De Montfort University
    Mark Lemon, De Montfort University
    Li Shao, De Montfort University

    An Evaluative Investigation into Employee Attitudes to Energy Management in the Food Retail Environment
    Sian Christina, Loughborough University
    Andrew Dainty, Loughborough University
    Kevin Daniels, University of East Anglia
    Patrick Waterson, Loughborough University
    Richard Lee, Tesco plc

    A Support Tool for Ranking Energy-Saving Activities in Office Buildings
    Tsuyoshi Ueno, Central Research Institute of Electric Power Industry
    Yukio Nakano, Central Research Institute of Electric Power Industry
    Masahito Takahashi, Central Research Institute of Electric Power Industry

Standards for the Calculation of Energy Savings
Barbara Schlomann, Fraunhofer Institute for Systems and Innovation Research ISI

    Using prEN 16212 for Improving the Comparability of Results of Bottom-Up Energy Savings
    Klemens Leutgöb, e7 Energie Markt Analyse GmbH

    Assessing Bottom-Up and Top-Down Approaches for Assessing DSM Programs and Efforts
    Daniel Violette, Navigant Consulting, Inc.
    Bill Provencher, Navigant Consulting, Madison, WI
    Iris Sulyma, BC Hydro

    A New Tool for Evaluators: The European Standard on Energy Savings Calculations
    Harry Vreuls, NL Agency

Building Codes and Standards
Lynn Hoefgen, NMR Group Inc.

    Building Energy Standards Can Fail to Deliver Expected Savings – The Importance of Code Compliance
    Yvonne Boerakker, KEMA   
    John Stoops, KEMA

    Planning and Evaluation Tool for Energy Efficiency Policy in Housing Sector in Latvia
    Andra Blumberga, Riga Technical university, Institute of Environmental Protection and Energy Systems
    Gatis Zogla, Riga Technical University
    Ilze Laicane, Riga Technical University

    Coding Conservation: Does a Residential Energy Code Significantly Reduce Energy and Natural Gas Consumption?
    Ken Tiedemann, BC Hydro

Evaluating Program Pilots in the Real World
Ben Bronfman, The Cadmus Group

    Pilot Programs to Mainstreaming: How Evaluation Can Help
    Linda Dethman, The Cadmus Group
    Shahana Samiullah, Southern California Edison
    Anne West, The Cadmus Group

    "When Policies Attack!": Adapting Pilot Evaluations to Changing Landscapes
    Claire Murray, Energy Saving Trust
    John Fawcett, Databuild Research and Solutions Ltd.

    Uses of Evaluation Findings--Taking a First-Year Industrial Program to the Next Level
    Doreen Caruth, Integrative Growth, Inc.
    Jean Bardeaux, Xcel Energy

Changing Behaviour: From Theory to Results
Linda Schuck, University of California - CIEE

    Exploring Behavioral Change Theory
    Kevin Monte de Ramos, KMDR Research

    Enhancing Environmental Citizenship and Reducing Energy Consumption through Creative Engagement with Building Users
    Monica Pianosi, IESD - De Montfort University
    Richard Bull, De Montfort University
    Marlin Rieser, De Montfort University

    What Do We Know About Comparative Energy Usage Feedback Reports for Residential Customers?
    Valerie Richardson, DNV KEMA
    Mitchell Rosenberg, DNV KEMA
    G. Kennedy Agnew, DNV KEMA

R&D Evaluation
Jane Peters, Research Into Action, Inc.

    Monitoring Energy Innovation During its Growth to Maturity: Better Appreciation of Innovation in Evaluations
    Dirk Both, NL Agency

    An Impact Evaluation Framework for Public-Private Collaborations on Research, Manufacturing, Supply Chain and Early Markets
    Gretchen Jordan, 360 Innovation LLC
    Jeffery Dowd, U.S. Department of Energy
    Jonathon Mote, Southern Illinois University - Carbondale

    Incumbents in Transition:  How the Natural Gas Regime Accelerates Radical Innovation in the Gas Supply
    Joost Koch, NL Agency
    Geert Thijssen, Ministry of Economic Affairs, Agriculture and Innovation, NL Agency

Embracing Future Evaluation Demands--Is Evaluation Ready to Face Future Challenges?
Claire Murray, Energy Saving Trust

    Are Free-Riders Actually a Good Thing? Revisiting What Free-Riders Are Actually Telling Us
    Patrice Ignelzi, Global Energy Partners/EnerNOC
    Bridget Kester, EnerNOC Utility Solutions
    Barb Ryan, EnerNOC Utility Solutions

    Evaluating Market Transformation in the Residential Energy Market--What to Measure? A Case Study
    Michelle McGuire, Databuild Research and Solutions

    Training the Next Generation of Energy Efficiency Evaluators: A Report from the Field
    Edward Vine, Lawrence Berkeley National Laboratory and California Institute for Energy and Environment
    William Saxonis, New York Department of Public Service
    Jane Peters, Research Into Action
    Bobbi Tannenbaum
    Bob Wirtshafter, Wirtshafter Associates

Posters

Evaluation of Energy Efficiency Incentivation Programmes in Three EU Regions
Marcello Antinucci, AESS Modena

Is Your Footprint Stepping on my Policy Toes?
Daniel Bauer, Florida Atlantic University, School of Public Administration

More Coherent Monitoring for Management Decisions Using Intermediate Level Indicators
Dirk Both, NL Agency

Applied Framework for Evaluation of Benefits and Costs of Smart Grid Investments: A Regional Case Study
Kevin Cooney, Navigant Consulting

The Approach to Social Impacts of Energy Efficiency Projects
Uduakobong Ekpenyong, Univerisity of Pretoria

Will We Ever Get the LED Out? Results from a LED Market Characterization Study
Kathleen Gaffney, DNV KEMA

Uncertainty Analysis in Energy Savings Calculations
Joost Gerdes, ECN

Exemplary Role of the Public Sector in Energy Efficiency Policies - Best Enforcement Practices and Improvement Options
Olivier Greslou, Mines ParisTech - Centre for Energy and Processes

Subsidies for Energy Audits as an Efficient Policy Instrument: Lessons Learnt from the Evaluation of an Audit Programme for SMEs in Germany
Edelgard Gruber, IREES

The Evolution of Process Evaluation Protocols in the United States
Katherine Johnson, Johnson Consulting Group

A Break Down of the Various Procedures and Involved Organizations for the Permitting, Financing and Installation of Renewable Energy Projects in Cyprus
Charis Kordatos, Cyprus Energy Agency

Diagnostic Benchmarks: Revolutionary Benefits of Eliminating Sampling Error
Les Lambert, Lambert Engineering

Societal Objectives as Drivers of Ex-Ante Evaluation of Energy Efficiency Measures
José Luís de Sousa, Instituto Politécnico de Setúbal

Social Network Analysis as a Tool for Process Evaluation and Market Analyses
Todd Malinick, Energy Market Innovations, Inc

What Difference Have We Made? Well that Depends, Who Wants to Know? Considering the Impact of the UK's Resource Efficiency Delivery Body from Different 'Vantage Points'
Michelle McGuire, Databuild Research and Solutions Ltd

Methodology for Evaluation of Energy Efficiency Policy for Industries in EU Countries with Less Energy Intensive Industrial Sector|
Liga Ozolina, Riga Technical University

Assessing the Potential Impact of the CO2 Performance Ladder on CO2 Emission Reduction
Martijn Rietbergen, Utrecht University of Applied Science

Measurement and Verification Process for Heat Pump Water Heaters Retrofitting
Xianming Ye, University of Pretoria