Table of Contents

Papers

ARRA
Moderator: Carla Frisch, US Department of Energy

Better Buildings, Better Market Effects? Estimating the Market Effects of the Better Buildings Neighborhood Program

Greg Clendenning, NMR Group, Inc.
David Barclay, NMR Group, Inc.
Lynn Hoefgen, NMR Group, Inc.
Jane Peters, Research Into Action
Marjorie McRae, Research Into Action
Edward Vine, Lawrence Berkeley National Laboratory

Better Buildings Neighborhood Program: An Economic Impact Analysis of a Whole-Building Retrofit Program

Matthew Koson, Evergreen Economics
Stephen Grover, Evergreen Economics
Alec Josephson, Pinnacle Economics
Edward Vine, Lawrence Berkeley National Laboratory

Apples to Audits: Challenges Affecting the Reliability of Performance Metrics for ARRA-Funded Energy Programs

Jaime Rossman, Washington State Department of Commerce, Research & Evaluation Services Unit
Alicia LeDuc, Washington State Department of Commerce, Research & Evaluation Services Unit
Graham Parrington, Washington State Department of Commerce, Research & Evaluation Services Unit

Quantifying the Outcomes of Clean Energy Policy Support Programs: The Experience of the State Energy Program National Evaluation

Timothy Pettit, DNV KEMA Energy & Sustainability
Martin Schweitzer, Oak Ridge National Laboratory
Kristina Kelly, DNV KEMA Energy & Sustainability

Demand Response
Moderator: Taghi Alereza, ADM Associates

Comparison of Event-based Demand Response Programs With and Without Enabling Technology

Elizabeth Hartmann, FSC Group
Michael Perry, FSC Group

Impact Evaluation of a Peak Time Rebate Program with Universal Enrollment

Steven Braithwait, Christensen Associates Energy Consulting
Marlies Hilbrink, Christensen Associates Energy Consulting

2012 Impact Evaluation of Southern California Edison’s 10 For 10 Rebate Program

Stephen George, Freeman, Sullivan & Co.
Josh Schellenberg, Freeman, Sullivan & Co.
Samuel Holmberg, Freeman, Sullivan & Co.
Edward Lovelace, Southern California Edison

Demand Response Evaluation, Cost-Effectiveness and System Planning

Nik Schruder, Ontario Power Authority
Josh Bode, Freeman, Sullivan & Co.

Realizing the Full Value of Commercial/Industrial Programs
Moderator: Jennifer Meissner, NYSERDA

Moving Beyond the Menu to Capture Savings from Soup to Nuts

Shawn Duff Intorcio, DNV KEMA Energy & Sustainability
Wendy Todd, National Grid

Impact and Process Evaluations of Northern Illinois Retro-Commissioning Programs

Randy Gunn, Navigant Consulting, Inc.
Roger Hill, Navigant Consulting
George Malek, Commonwealth Edison
Richard Tonielli, Commonwealth Edison

Using In-Depth Interviews to Estimate Non-Energy Impacts Resulting from Commercial and Industrial Energy Efficiency Measures

Noel Stevens, DNV KEMA Energy & Sustainability
Lindsay Foley, National Grid
Susan Weber, DNV KEMA Energy & Sustainability
Pam Rathbun, Tetra Tech
Miriam Goldberg, DNV KEMA Energy & Sustainability

Auditing Audits: Big Savings Found in Long-Term Assessment

Jonathan Maxwell, ERS
Satyen Moray, ERS
Rebecca Reed Gagnon, NYSERDA

Evaluating Refrigerator/Freezer Recycling Programs--Four Cool Perspectives
Moderator: Bill Saxonis, New York  State Department of Public Service

UMP, There It Is: A Collaborative Process Results in Standardized Appliance Recycling Evaluation Guidelines

Doug Bruchs, Cadmus
Josh Keeling, Cadmus

Savings from Appliance Recycling Programs: Think Outside the Grid

Mohit Singh-Chhabra, Ptarmigan Research
Angie Lee, Navigant Consulting

How the New and Used Refrigerator Markets are Intertwined

John Reed, Innovologie
Moria Morrissey, Innovologie

ARPs are RAD: How to Incorporate Environmental Benefits from Appliance Recycling Programs into Cost-Effectiveness Calculations

Josh Keeling, Cadmus
Arnab Pal, Cadmus
Caroline Chen, StatWizards LLC

Quick Takes: What Enquiring Minds Need to Know
Moderator: Jane Peters, Research Into Action/Ken Keating

But I Thought a Statewide TRM Would Solve Everything

Ryan Del Balso, Navigant Consulting, Inc.
Kevin Grabner, Navigant Consulting, Inc.

What's Driving the CART in Behavior-Based Demand Response?

Hale Forster, Research Into Action, Inc.
Dulane Moran, Research Into Action, Inc.
Brenda Gettig, San Diego Gas and Electric

An Evaluation of Trends in Energy Consumption in Residential Housing

Bill McNary, U.S. Energy Information Administration
Chip Berry, U.S. Energy Information Administration
Danni Mayclin, U.S. Energy Information Administration

Rewarding Efficiency: Lessons from California's Shareholder Incentive

Julia Zuckerman, Climate Policy Initiative
Jeff Deason, Climate Policy Initiative
Sangeetha Chandrashekeran, University of Melbourne

All Together Now: Making the Most of Energy Efficiency Data through Consistent Reporting

Cecily McChalicher, Northeast Energy Efficiency Partnership
Brian Cotterill, Vermont Department of Public Service
Megan Billingsley, Lawrence Berkeley National Laboratory

Incorporating Non-Energy Benefits into Cost-Effectiveness Screening: The Vermont Story

Ingrid Malmgren, Vermont Energy Investment Corporation

Energy Efficiency and Retail Electricity Shopping: Competing Goals or Complementary Goals?

Sunil Maheshwari, PPL Electric Utilities
Sanchita Sengupta, Cadmus
Jim Stewart, Cadmus

Renewables
Moderator: Phil Degens, Energy Trust of Oregon

Rounding up Renewables: Evaluating NYSERDA's Biomass, Wind, Solar Photovoltaic, Solar Hot Water, and Solar Space Heating Programs 2008-2011

Shawn Shaw, Cadmus
Danielle Kolp, Cadmus
Mary Knipe, Cadmus
Rebecca Reed Gagnon, NYSERDA
Jennifer Meissner, NYSERDA

Keep on the Sunny Side: Lessons Learned While Evaluating PV Program Impacts

Vergil Weatherford, Navigant Consulting, Inc.
Erik Merkt, Navigant
Pace Goodman, Navigant

Evaluating a National, Renewable Market Transformation Program over a Decade of Massive Change

Frank Stern, Navigant Consulting, Inc.
Charlie Bloch, Navigant
Edward Vine, Lawrence Berkeley National Laboratory

New Frontiers in Non-Residential Lighting: Program and Evaluation Challenges
Moderator: Shahana Samiullah, Southern California Edison

LEDs are Moving on Up: C&I Upstream LED Lighting Program

Aaron Kwiatkowski, DNV KEMA Energy & Sustainability
Chad Telarico, DNV KEMA Energy & Sustainability
William Blake, National Grid

Bright Opportunities: A New Way of Getting LEDs Into the Commercial and Industrial Market

Chris Dyson, DNV KEMA Energy & Sustainability
William Blake, National Grid

Watt's Next for Nonresidential Lighting Retrofits

Dulane Moran, Research Into Action, Inc.
Bobbi Tannenbaum, Research Into Action
Caroline Chen, StatWizard
Nathaniel Albers, Research Into Action

Small Entities Tackle BIG Challenges
Moderator: Lark Lee, TetraTech

Demystifying EM&V: Best Practices and Lessons Learned from the First Year Evaluations of the 2011-2014 Portfolio

Phil Bosco, Ontario Power Authority

Evaluation Challenges for Generation and Transmission Companies and Electric Cooperatives

Luisa Freeman, DNV KEMA Energy & Sustainability
Susan Weber, DNV KEMA Energy & Sustainability

Designing for Effective Evaluation: Tools and Strategies to Support Energy Efficiency Programs Targeting Small, Low-Capacity Jurisdictions

Alicia LeDuc, Research Services, Washington State Department of Commerce
Jaime Rossman, Research Services, Washington State Department of Commerce
Graham Parrington, Research Services, Washington State Department of Commerce

Measuring Behavioral Impacts: The Struggle for Control
Moderator: Patricia Gonzales NYSERDA

I Can't Use a Randomized Controlled Trial -- NOW WHAT? Comparison of Methods for Assessing Impacts from Opt-In Behavioral Programs

Bethany Glinsmann, Navigant Consulting, Inc.
Bill Provencher, Navigant Consulting & University of Wisconsin-Madison

Some Insights on Matching Methods in Estimating Energy Savings for an Opt-In, Behavioral-Based Energy Efficiency Program

Bill Provencher, Navigant Consulting , Inc. & University of Wisconsin-Madison
Bethany Vittetoe-Glinsmann, Navigant Consulting
Anne Dougherty, Opinion Dynamics Corporation
Katherine Randazzo, Opinion Dynamics Corporation
Phil Moffitt, Cape Light Compact
Ralph Prahl, Prahl and Associates

Control Group Wars:  There’s More Than One Way to Win the Battle

Dave Hanna, Itron, Inc.
Kelly Marrin, EnerNOC, Inc.

Evaluation Practices--Exploring the Roads Not Taken
Moderator: Mike Messenger, Itron

Trials and Tribulations of Joint Electric and Gas Programs - Guidelines in Integrating Joint DSM

Robert Neumann, Navigant Consulting, Inc.

Kicking the Can: How First-Year Impact Evaluation Transfers Cost and Uncertainty

Marc Collins, Itron
Joe Loper, Itron

Evaluation Evolution: Leveraging Data Collection Standards for EM&V and Other Analysis

Jarred Metoyer, DNV KEMA Energy & Sustainability
Thomas Ledyard, DNV KEMA Energy & Sustainability
Elizabeth Titus, Northeast Energy Efficiency Partnerships

R&D Innovation
Moderator: Rosalie Ruegg, TIA Consulting, Inc.

An Innovative Product’s Path to Market: The Influence of Laboratory and Field Evaluations on Adoption and Implementation

John Proctor, Proctor Engineering Group
Adrian Hairrell, Proctor Engineering Group

Incubating Innovation

Linda Olsson, Cadmus
Eileen Nebhut, Southeast Energy Efficiency Alliance
Carol Mulholland, Cadmus

R&D Methods and Approaches:  Impact Evaluation of an R&D Demonstration Program

Kathryn Parlin, West Hill Energy and Computing
Lori Lewis, Analytical Evaluation Consultants, LLC
Tara Rainstrom, NYSERDA

Emissions and Climate Policy
Moderator: Elizabeth Titus, NEEP

Using EPA's eGRID to Estimate GHG Emissions Reductions from Energy Efficiency

Art Diem, US EPA
Christina Quiroz, Radium Consulting Group, Inc.
Manish Salhotra, Radium Consulting Group, Inc.

Quantifying Emissions Benefits for Wisconsin's Focus on Energy Programs

David Sumi, Cadmus
Kate Swayne, Cadmus
Carol Stemrich, Public Service Commission of Wisconsin

An Analysis of Eco-Efficiency in Energy Use and CO2 Emissions in the Swedish Service Industries

Clara Ines Pardo Martinez, University of El Rosario

BOOM BOOM On Go The Lights: Cutting Edge Methods for Evaluating Lighting
Moderator: Anne Dougherty, Opinion Dynamics

Just When You Thought It Was Safe to Turn the Lights Out: Trials, Tribulations, and Results of a Pre/Post-Retrofit Occupancy Sensor Evaluation

Arlis Reynolds, Cadmus
Susan Haselhorst, ERS

Going Long: Assessing the Value of 12 Month Monitoring of Lighting Systems

Chad Telarico, DNV KEMA Energy & Sustainability
Thomas Ledyard, DNV KEMA Energy & Sustainability
William Blake, National Grid
Melissa Piper, National Grid

Uniform Methods for Upstream Lighting Program Evaluation

Scott Dimetrosky, Apex Analytics
Katie Parkinson, Apex Analytics

Building Energy Savings: from the Group Up
Moderator: Rich Hackner, GDS Associates

Innovative Market Framework to Enable Deep Renovation of Existing Buildings in IEA Countries

Yamina Saheb, International Energy Agency
Aurelien Saussay, French Economic Observatory
Vida Rozite, International Energy Agency
Charlotte Johnson, University College, London
Alastair Blyth, University of Westminster, London

The Road to Drive Savings

Jay Robbins, DMI
Arlis Reynolds, Cadmus
Chad Telarico, DNV KEMA Energy & Sustainability
Whitney Brougher, National Grid
Elizabeth Titus, Northeast Energy Efficiency Partnerships

HVAC and Lighting Interaction, a Waste Heat Factor by Any Other Name

David Korn, Cadmus
Shannon Donahue, Cadmus
Caleb Wisch, Cadmus

Compared to What? An Alternative Strategy for Estimating Commercial and Industrial New Construction Baselines

Jennifer Chiodo, Cx Associates, LLC
Jennifer Meissner, NYSERDA
Judeen Byrne, NYSERDA
Lori Lewis, Medgal and Associates
Jonathan Maxwell, ERS
Kathryn Parlin, WHEC

Industrial Efficiency: Baselines, Bids and Strategic Management
Moderator: Jeff Ihnen, Michaels Energy

Keeping Pace with Innovative Industrial Program: Assessing Complex Program Deliveries and Strategic Energy Management Programs

Adam Gardels, Research Into Action, Inc.
Marjorie McRae, Research Into Action, Inc.
Lauren Miller Gage, Bonneville Power Administration

Capturing Savings Down the Production Line: Measuring the Impacts of Energy Management Programs

Heidi Ochsner, Cadmus
Jim Stewart, Cadmus
Lauren Gage, Bonneville Power Administration

Pre-Retrofit Evaluation of Industrial Projects

Jonathan Maxwell, ERS
Betsy Ricker, ERS
Carley Murray, NYSERDA

Staring into the Light--Visions of Improved Residential Lighting Programs and Evaluation Methods
Moderator: Lauren Gage, Bonneville Power Administration

Study It ‘til You’re Sick of It: CFL Research as an Example for Other Efficiency Markets

Lynn Hoefgen, NMR Group, Inc.
Lisa Wilson-Wright, NMR Group, Inc.
Chris Russell, NMR Group, Inc.
Matthew Nelson, Northeast Utilities
Wendy Todd, National Grid
Ralph Prahl, Prahl and Associates
Glenn Reed, Energy Futures Group
Scott Dimetrosky, Apex Analytics

Designing and Evaluating Residential Lighting Programs in a Rapidly Changing Market

Jeff Erickson, Navigant Consulting, Inc.

The Revenue Neutral Sales Model: A New Approach to Estimating Lighting Program Free Ridership

Tami Buhr, Opinion Dynamics Corporation
Stan Mertz, Applied Proactive Technologies

Estimating Spillover in Upstream Lighting Programs: Hard Data for an Elusive Number

Eric Rambo, Cadmus
Louise Song, Cadmus
Josh Keeling, Cadmus
Andrew Carollo, Cadmus
Jason Christianson, Cadmus

Quick Takes: Producing, Measuring and Claiming Savings from Residential Feedback, Home Energy Audit and Behavior Change Programs
Moderator: Monica Nevius, NMR Group/Robert Wirtshafter, Wirtshafter Associates

Residential Home Energy Surveys:  What’s the Impact…Survey Says!

Amy Buege, Itron, Inc.
Molly Du, Itron, Inc.
Jean Shelton, Itron, Inc.
Peter Franzese, CPUC

Impacts of Feedback Programs: Generating Comparable Impacts across Varying Program Design Models

Anne Dougherty, Opinion Dynamics Corporation
Katherine Randazzo, Opinion Dynamics
Alan Elliott, Opinion Dynamics

Opower, Where Art Thou? Savings Estimates From a Pilot Program

Stephen Grover, Evergreen Economics
John Cornwell, Evergreen Economics
Jenny Yaillen, Evergreen Economics
Chris Ann Dickerson, CAD Consulting
Jim Flanagan, James Flanagan Associates
Merissa Sakuda, Hawaii Public Utilities Commission

Sure It Works, But How Long Does it Last? Persistence of Savings after Short-Term Participation in Behavioral Programs

Chris Russell, NMR Group, Inc.
Lisa Wilson-Wright, NMR Group, Inc.
Kim Oswald, Viridian LLC

Weatherization Lost and Found: Attempting to Overcome Lost Opportunities from Pre-Weatherization Barriers to Achieve Deeper Savings

Doug Bruchs, Cadmus
Kim Rankin, Cadmus
Gail Azulay, Cape Light Compact
Kimberly Crossman, National Grid
Anna Carvill, Cadmus

What Motivates Action on Energy Efficiency?

Erika Kociolek, Energy Trust of Oregon
Sarah Castor, Energy Trust of Oregon

Draw Back the Curtains: What a Residential Economizer Pilot Study Revealed about Home Cooling Behaviors

Anna Kim, Research Into Action, Inc.
Marjorie McRae, Research Into Action
Todd Greenwell, Idaho Power
Brad Acker, University of Idaho
Mark Rehley, NEEA

Top Down, Bottom Up
Moderator: Maureen McNamara, US EPA ENERGY STAR Program

Bottom-up Evaluation of Municipal Energy and Climate Policy -- More Than an Alternative to Top-Down Approaches?

Jan Kaselofsky, Wuppertal Institute for Climate, Environment and Energy
Steven März, Wuppertal Institute for Climate, Environment and Energy
Ralf Schüle, Wuppertal Institute for Climate, Environment and Energy

The View from the Top: Application of Macro-Economic Models to Measure Energy-Efficiency Program Savings in California

Hossein Haeri, Cadmus
Jim Stewart, Cadmus

Evaluating Low-Income Programs:  Not Just for Energy Efficiency Anymore
Moderator: Lynn Westerlind, National Grid

Comparison of Pooled and Household Level Usage Impact Analysis

Jacqueline Berger, APPRISE
Ferit Ucar, APPRISE

Pathways to Success in Low-Income Energy Assistance Payment Programs: The Differential Effects of Customer Characteristics and Program Design on Payment Rates

Megan Campbell, Opinion Dynamics

New Opportunities in Low-Income Energy Conservation Programs

Scott Reeves, Cadmus
Jamie Drakos, Cadmus
M. Sami Khawaja, Cadmus

Critical Peak Pricing: Quantitative, Qualitative and Persistence Analysis
Moderator: Steve Braithwait, Christensen Associates Energy Consulting, LLC

The Arc of Price Responsiveness – Consistency of Results across Time-Varying Pricing Studies

Ahmad Faruqui, The Brattle Group
Sanem Sergicvi, The Brattle Group
Eric Schultz, The Brattle Group

Default Critical Peak Pricing for Non-residential Customers: Do Demand Reductions Persist?  Are the Reductions Reliable?

Candice Churchwell, Freeman, Sullivan & Co.
Josh Bode, Freeman, Sullivan & Co.

Strategies for Improving Customer Response to CPP Price Signals

Barb Ryan, EnerNOC Consulting Services
Mark Martinez, SCE
Kathryn Smith, SDG&E
Greg Mandelman, PG&E

Net Savings Evaluation--Getting It Right: It's More Than a Couple of Questions on a Participant or Market Survey
Moderator: Nick Hall, TecMarket Works

Gross Is Gross and Net Is Net: Simple, Right?

Richard Ridge, Ridge & Associates
Michael Baker, SBW Consulting
Nick Hall, TecMarket Works
Ralph Prahl, Prahl & Associates
William Saxonis, New York State Department of Public Service

The Estimation of Spillover: EM&V’s Orphan Gets a Home

Ralph Prahl, Prahl & Associates
Richard Ridge, Ridge & Associates
Nick Hall, TecMarket Works
William Saxonis, New York State Department of Public Service

A Case Study of How a Market Transforming Program Claims Spillover and Market Effects

Robert Wirtshafter, Wirtshafter Associates
Jennifer Fagan, Itron
Bobbi Tannenbaum, Research Into Action

Harmonization of Evaluation Practices: The Hidden Pathway to Greater Energy Efficiency
Moderator: Michael Li, US Department of Energy

Looking in the Mirror: Applying Metaevaluation to Energy Efficiency Program Evaluations

Brandy Brown, Western Michigan University

Improving the Design, Implementation and Evaluation of Residential Energy Efficiency Programs: Insights from the Social Sciences
Moderator: Edward Vine, Lawrence Berkeley National Laboratory & California Institute for Energy and Environment

akAB Theory: Moving from Theory to Application

Mersiha McClaren, Research Into Action, Inc.
Alexandra Dunn, Research Into Action, Inc.
Jane Peters, Research Into Action, Inc.

Behavioral Economic Models of Household Electricity Decision Making: An Application to Energy Efficiency Program Evaluation

Peter Martin, Centre for Informatics and applied Optimization, University of Ballarat
David Lynch, Centre for Regional Innovation and Competitiveness, University of Ballarat

Utility Distribution Systems: Evaluating Energy Efficiency & Load Management Opportunities
Moderator: Kevin Cooney, Navigant

Driving Away From Off-Peak Vehicle Charging: The Need for an Evaluation of the Effects of Public Vehicle Charging Infrastructure on PEV Owner Charging Behavior

Stephen Parry, Energy Market Innovations

Conservation Voltage Reduction: What are the Savings?

Frank Stern, Navigant Consulting, Inc.
Nicholas DeDominicis, PECO Energy Company

Incorporating Energy Efficiency into the Transmission & Distribution Planning Process – Potential Financial and Reliability Implications

Michael Goldman, Northeast Utilities
Monica Kachru, Northeast Utilities

Smart Data: A Myriad of Uses
Moderator: Sharyn Barata, Itron

New Approach to Analyzing Hourly Energy Usage Data to Obtain Fast, Accurate Savings Estimates

William Miller, Lawrence Berkeley National Laboratory
Robert Van Buskirk, Lawrence Berkeley National Laboratory

Using Smart Meter Data to Identify Non-Performing Load Control Devices

Wendy Brummer, Pacific Gas and Electric Company
Colin Kerrigan, Pacific Gas and Electric Company
Christine Hartmann, Freeman, Sullivan & Co.
Josh Bode, Freeman, Sullivan & Co.

A Randomized Experiment in Direct Load Control Using Smart Meter Data

Jessei Kanagarajan, Ontario Power Authority
Dries Berghman, Freeman, Sullivan & Co.

Social Marketing Is Everywhere—What Effect Is It Having?
Moderator: Patrice Ignelzi, EnerNOC Utility Solutions

Evaluation of the "Lose Your Excuse" Public Service Advertising Campaign for Tweens to Save Energy

Yaw Agyeman, Lawrence Berkeley National Laboratory
Jane Bertrand, Tulane University
Patty Goldman, Ad Council
Paul Metz, C&R Research
Erin Barber, C&R Research
Kym Wegenka, C&R Research

Controlling for Program Participation Self-Selection Bias

Shawn Bodmann, DNV KEMA Energy & Sustainability
Tammy Kuiken, DNV KEMA Energy & Sustainability
William Golemboski, DNV KEMA Energy & Sustainability
Mitchell Rosenberg, DNV KEMA Energy & Sustainability
Miriam Goldberg, DNV KEMA Energy & Sustainability
Robin Sempf, Alliant Energy

Social Marketing in an Unusual Environment – The Military. One Case Study in Ready, Fire, Aim

Lisa Skumatz, Skumatz Economic Research Associates, Inc.
D. Juri Freeman, Skumatz Economic Research Associates, Inc.

Financing: Panacea or Flacebo?
Moderator: Annika Todd, Lawrence Berkeley National Laboratory

Process and Market Evaluation of a Program that Integrates Green Legislation Components into a Residential Energy-Efficiency Program

Rohit Vaidya, NMR Group, Inc.
Carley Murray, NYSERDA
Perry Grossman, NMR Group

Coast-to-Coast: An Update on On-Bill Financing Program Strategies

Katherine Johnson, Johnson Consulting Group
Phil Degens, Energy Trust of Oregon
Lucia Nixon, Efficiency Maine Trust
Antje Flanders, Opinion Dynamics Corporation
Philippe Dunsky, Dunsky Energy Consulting

Riding the Financing Wave: Integrating Financing with Traditional DSM Programming

Karin Corfee, Navigant Consulting, Inc.
Jane Pater Salmon, Navigant Consulting
Brad Rogers, Navigant Consulting
Floyd Keneipp, Navigant Consulting

Evaluation Zen: How Residential Retrofit Challenges Are Met with Smart Meters, Engineering Analysis and Billing Analysis
Moderator: Matthew Nelson, Northeast Utilities

Challenges of Estimating Hourly Baselines for Residential Customers

Collin Elliot, Itron, Inc.
Jean Shelton, Itron
Dave Hanna, Itron

Getting our Ducts in a Row: A Billing Analysis of Duct Sealing and Heat Pumps in the Northwest

Jenny Yaillen, Evergreen Economics
Carrie Cobb, Bonneville Power Administration

Dynamic Duo:  How Combining Billing Analysis and Engineering Simulation Methods Improves Evaluation Quality and Understanding

Kimberly Crossman, National Grid
Laura Tabor, Navigant
Matei Perussi, Cadmus
David Basak, Navigant

Process Evaluation: Real Time Strategies That Work
Moderator: Iris Sulyma

Maximizing Usefulness of Process Evaluations

Steve Hastie, Navigant Consulting, Inc.
Steven Mysholowsky, Con Edison Company of New York, Inc.

Putting Your Best Foot Forward:  A Model for Using Best Practices in Process Evaluations

Hope Lobkowicz, Cadmus
Cameron Ramey, Cadmus

200 Programs, One Evaluation Budget, One New Approach: A Recounting of the Great “Program Assessments”

Jennifer Fagan, Itron, Inc.
Christina Torok, Evergreen Economics
Michael Rovito, ERS

Business-Based Behavior: Recent Lessons Learned
Moderator: Susan Mazur-Stommen, ACEEE

Integrating Process and Impact Findings to Understand and Measure Behavioral Savings at Work

Linda Dethman, Cadmus
Jim Stewart, Cadmus
Kathryn Thomsen, Cadmus

Measuring End-Use Technological and Behavioral Waste to Prioritze and Improve Program Design

Adam Burke, Opinion Dynamics Corporation
Roger Baker, Commonwealth Edison

Lessons Learned from Field Observations of Commercial Sector HVAC Technician Behavior and Laboratory Testing

Robert Mowris, Robert Mowris & Associates, Inc.
Robert Eshom, Robert Mowris & Associates, Inc.
Ean Jones, Robert Mowris & Associates, Inc.

Quick Takes: Evolving Methods
Moderator: Marjorie McRae, Research Into Action/Jim Mapp, Dark Energy Associates

Setting Net Energy Impact Baselines: Building Reliable Evaluation Approaches

Nick Hall, TecMarket Works
David Ladd, TecMarket Works
M. Sami Khawaja, Cadmus Group

What Do They Know?  Strengths and Limits in Survey Data Collection about Residential Structures and Equipment

Karen Koski, Energy Center of Wisconsin
Ingo Bensch, Energy Center of Wisconsin
Patrick Michalkiewicz, Peoples Gas & North Shore Gas

Annualization of Results of Residential Lighting Meter Data

Brian Shepherd, Cadmus
Eric Rambo, Cadmus
Madison Busker, Cadmus

Revisiting Double Ratio Estimation for Managing Risk in High Rigor Evaluation

Justin Spencer, Navigant Consulting, Inc.
Dan Greenberg, Navigant Consulting
Terese Decker, Navigant Consulting

Evaluating Impact of Retrofit Programs on Commercial Buildings: Results from the Energize Phoenix Project

Karthik Thalappully, Global Institute of Sustainability, Arizona State University
Agami Reddy, Arizona State University
Oscar Nishizaki, Arizona State University
Marcus Myers, Arizona State University
Michael Dalrymple, Arizona State University
Patrick Phelan, Arizona State University

Assessing Energy Savings from Building Commissioning

Steven Keates, ADM Associates, Inc.
Taghi Alereza, ADM Associates, Inc.

Beyond Elephants and Donkeys: Methodology Lessons from Election Polling for Energy Research

Carla Jackson, Abt SRBI, Inc.

Working Effectively with Program Cycles (Or: How not to do Evaluation Planning in a Vacuum)
Moderator: Ralph Prahl, Prahl & Associates

Evaluation Planning Across Multiple Cycles: Delivering Value through Continous Improvement and Innovation

Michael Rufo, Itron, Inc.
Carmen Best, California Public Utilities Commission

To Do or Not to Do: Is It Time for Another Impact Evaluation?

Susan Haselhorst, ERS
Erik Mellen, Northeast Utilities
Chad Telarico, DNV KEMA Energy & Sustainability

Panel Studies – The Perfect Marriage of Formative and Summative Evaluations

Ellen Steiner, Energy Market Innovations
Donna Whitsett, Energy Market Innovations
Hannah Carmalt Justus, Energy Market Innovations
Kara Crohn, Energy Market Innovations
Todd Malinick, Energy Market Innovations

Residential Plug Loads
Moderator: Sarah Castor, Energy Trust of Oregon

The New Frontier in Energy Efficiency: Estimating the Impact of a Consumer Electronics Program

Kenneth Tiedemann, BC Hydro

Measuring Success in Mid-stream Programs: Design and Evaluation Recommendations from a Television Program

Marti Frank, Research Into Action, Inc.
Ty Stober, Northwest Energy Efficiency Alliance
Jane Peters, Research Into Action, Inc.
Joe Van Clock, Research Into Action, Inc.
Alex Dunn, Research Into Action, Inc.
Nicole DeHoratius, University of Chicago

Designing for Evaluation in Residential Plug Loads

AJ Howard, Energy Market Innovations, Inc.
Brian Smith, Pacific Gas and Electric Company
Richard Ridge, Ridge and Associates

Customer's Rationale for LED Bulbs
Moderator: Greg Lovett, Ameren Missouri

Break on Through to the Other Side: How to Help LEDs Emerge in the California Residential Lighting Market

Tyler Mahone, DNV KEMA Energy & Sustainability
Kathleen Gaffney, DNV KEMA Energy & Sustainability

Taking LEDs to Market: Designing a Comprehensive Market Trial that Examines Incentive Levels and Consumer Preference

Katherine Randazzo, Opinion Dynamics Corporation
Anne Dougherty, Opinion Dynamics
George Boomer, StatWizards LLC
Richard Greenburg, Southern California Edison
Brett Close, Southern California Edison

Why the Light Bulb is No Longer a Textbook Example for Price Elasticity: Results from Choice Experiments and Demand Modeling Research

Andrew Stryker, DNV KEMA Energy & Sustainability
Kathleen Gaffney, DNV KEMA Energy & Sustainability

Codes and Standards
Moderator: Isaac Elnecave, Midwest Energy Efficiency Alliance

To Comply or Not to Comply—What Is the Question?

Allen Lee, Cadmus
Dan Groshans, Cadmus

Extra Credit: How Utilities Can Receive Credit for Savings from Building Energy Codes

Dan Groshans, Cadmus
Allen Lee, Cadmus

Evaluating Code Compliance Enhancement - A Love Story

Joshua Rasin, Heschong Mahone Group, A TRC Company
Cathy Chappell, Heschong Mahone Group, A TRC Company
Andre Gouin, Xcel Energy

The Impact of Refrigerator Standards on United States Households

James Mapp, Dark Energy
John Reed, Innovologie

It's a Beautiful Day in the Neighborhood? A Look At Community-Based Energy Efficiency  Programs
Moderator: Martin Kushler, ACEEE

How Is the Neighborhood? Preliminary Results from the Better Buildings Neighborhood Program

Jane Peters, Research Into Action, Inc.
Marjorie McRae, Research Into Action, Inc.
Ryan Bliss, Research Into Action, Inc.
Edward Vine, Lawrence Berkeley National Laborator

Herding Cats: The Approach and Challenges of the Preliminary Impact Evaluation of the National Better Buildings Neighborhood Program

Lynn Roy, Nexant, Inc.
Kevin Afflerbaugh, Nexant, Inc.
Edward Vine, Lawrence Berkeley National Laboratory

Community-Based Energy Programs in Washington: Rediscovering and Relearning the Lessons of Thirty Years of Residential Energy Efficiency Program Delivery

Vince Schueler, Washington State University Energy Program

Howdy Partner! Lessons Learned from an Assessment of Local Government Partnerships

John Boroski, Evergreen Economics
Tami Rasmussen, Evergreen Economics
Rafael Friedmann, Pacific Gas & Electric Company

Behavior-Based Programs: Quantifying Impacts
Moderator: Rafael Friedmann, PG&E

Are Savings from Behavior Programs Ready for TRM Prime Time?

Katie Parkinson, Apex Analytics
Scott Dimetrosky, Apex Analytics
Jeffrey Orrey, GeoVisual Analytics

Causality, Sustainability and Scalability – What We Still Do and Do Not Know About Impacts of Comparative Feedback Programs

Mitchell Rosenberg, DNV KEMA Energy & Sustainability
G. Kennedy Agnew, DNV KEMA Energy & Sustainability
Kathleen Gaffney, DNV KEMA Energy & Sustainability

Neighbor Comparison Programs Save Energy, but What Drives Savings?

Mike Sullivan, Freeman, Sullivan & Company
Brian Smith, Pacific Gas and Electric Company
Candice Churchwell, Freeman, Sullivan & Co.

Panels

Panel: Public Policy's Role in Energy Efficiency Investments vs. Benefit/Cost Requirements
Moderator: Carol White, National Grid

Panel:  Evaluations, The Harm They Do
Moderator: Bobbi Tannenbaum, BTan Consulting

Panel:  The Regulatory/Policy Maker/Evaluator Relationship: Let the Sun Shine In!
Moderator: William Saxonis, New York State Department of Public Service

Panel: Paving the Way for a Rich Mix of Consumer Behavior Programs
Moderator: Patrice Ignelzi, EnerNOC Utility Solutions

Panel: "Real-Time" Evaluation: Benefits, Drawbacks and Practical Applications
Moderator: Jennifer Meissner, NYSERDA

Panel: “So, What are All These EM&V Guidelines, Protocols, Uniform Methods, Standards, and Model Practices Being Established in the U.S. and Why?”
Moderator: Carla Frisch, US Department of Energy

Posters

Very Efficacious: Transforming the Market with the DesignLights Consortium Qualified Products List

Brian Booher, D&R International, Ltd.
Chris Cloutier, D&R International
David Ryan, D&R International

Field Evaluation of Heat Pump Water Heaters in the Northeast

Whitney Brougher, National Grid
Gail Azulay, Cape Light Compact
Srikanth Puttagunta, Steven Winter Associates, Inc.

Is it Still Cost Effective to Promote Light Bulbs? Should We?

Seth Craigo-Snell, Applied Proactive Technologies

Determining Emissions from Electric Vehicle Adoption in Colorado

Jennifer Detlor, University of Colorado/University of Wisconsin-Madison
Jennie Jorgenson, University of Colorado at Boulder
Jana Milford, University of Colorado at Boulder

Forecasting the Energy Impacts of State Energy-Efficiency Policies

Nikolaas Dietsch, US EPA
Robyn DeYoung, U.S. EPA

At Variance: The Cluster Sampling Paradigm

Geoffrey Embree, Northeast Utilities

Changes of Energy Saving Behavior Since the Earthquake in Japan

Goshi Fujimoto, Tokyo Gas Co., Ltd.
Yumiko Iwafune, The University of Tokyo

Retrofitting Multifamily Buildings: A Sustainabile Model for Energy Savings

Marjorie Isaacson, CNT Energy
Peter Ludwig, CNT Energy

Assessing New Construction Programs in Light of Advancing Standards: Where are the Opportunities for Deeper Savings?

James Leahy, DNV KEMA Energy & Sustainability
Wendy Todd, National Grid

The Extra Mile: Searching for Indirect Market Effects?

Lori Lewis, Analytical Evaluation Consultants
Kathryn Parlin, West Hill Energy and Computing, Inc.

Characterizing the Multifamily Market -- Lessons Learned and Best Practices

Jeannette LeZaks, Energy Center of Wisconsin
Tom Syring, Franklin Energy Services, Inc.

Will a Green Jobs Objective Help or Hinder the Achievement of Energy Savings Goals?

Lance Loncke, District Department of the Environment
Teri Lutz, Tetra Tech

Commercial New Construction Code Compliance: Strategies for Accurate Assessment and Improved Compliance Rates

Brian McCowan, Energy & Resource Solutions
Gary Epstein, ERS
Ryan Barry, DNV KEMA Energy & Sustainabiilty
James Leahy, DNV KEMA Energy & Sustainabiilty
Wendy Todd, National Grid

Impact of Advanced Power Strips (APS) in Office Buildings

Brian McCowan, ERS
Elizabeth Titus, Regional E, M&V Forum
Chris Neme, Energy Futures Group

Making the Switch from Watts to Lumens: A Comparison of Consumer Knowledge Across States & Over Time

Monica Nevius, NMR Group, Inc.
Lisa Wilson-Wright, NMR Group, Inc.
Mike Strom, NMR Group, Inc.
Victoria Engel-Fowles, NYSERDA
Carley Murray, NYSERDA
Matthew Nelson, NSTAR

Assessing Interactions Between Statewide and Utility Energy Efficiency Program Offerings

Jeremy Offenstein, ADM Associates, Inc.
Anna Espitallier, ADM Associates, Inc.

Realizing Evaluations Produce Estimates NOT "Certainty"

John Proctor, Proctor Engineering Group, Ltd.

TMY3 is Not Normal, Nor is it Typical – The New Normal is a Trend!

John Proctor, Proctor Engineering Group, Ltd.

Farewell T12s, Parting is Such Sweet Sorrow

Bob Ramirez, Itron, Inc.
Jean Shelton, Itron, Inc.

Why Won't You Answer My Questions?

Pam Rathbun, Tetra Tech
Mandy Pom, Tetra Tech

The Next Generation of Consumer Electronics Programs

Nicole Rosenberg, NMR Group, Inc.
Monica Nevius, NMR Group, Inc.
Ralph Prahl, Energy Efficiency Advisory Council of Massachusetts
Glenn Reed, Energy Efficiency Advisory Council of Massachusetts
Matthew Nelson, NSTAR
Wendy Todd, National Grid

Get Out the Watt! Drawing Parallels with a GOTV Campaign and Influencing Behavior for Results in Energy Efficiency

Gomathi Sadhasivan, DNV KEMA Energy & Sustainability

Maximizing Return on Research Investment: The Role of Repeatable Sample Frame Development Processes

Ellen Steiner, Energy Market Innovations, Inc.
Todd Malinick, Energy Market Innovations
Donna Whitsett, Energy Market Innovations
Shahana Samiullah, Southern California Edison
Brett Close, Southern California Edison
Derek Jones, Pacific Gas & Electric

Market Transformation in Commercial Food Service: Integrating DSM into Procurement Processes

Adam Thomas, ADM Associates, Inc.

New and Improved! Findings and Implications from a Baseline Energy Appliance, Equipment and Building Characteristics Study

Martha Thompson, Evergreen Economics
Tami Rasmussen, Evergreen Economics
Chris Ann Dickerson, CAD Consulting
Jim Flanagan, Jim Flanagan Associates
Merissa Sakuda, Hawaii Public Utilities Commission

Assessing and Optimizing M&V Metering Samples and Durations

Isaac Wainstein, Energy & Resource Solutions

Demand Response and Appropriation of Smart Grid by Residential Consumers

Grégoire Wallenborn, Université Libre de Bruxelles

Potential and Pitfalls with Quality Installation Verification

Cheryl Winch, Cadmus
Anna Carvill, Cadmus

Measurement and Verification Methodology for Coal Fired Power Plant Energy Efficiency Improvement

Xianming Ye, University of Pretoria
Xiaohua Xia, University of Pretoria
Jiangfeng Zhang, University of Pretoria