[ias-opportunities] CSET 09 Call for Participation (co-located with the USENIX Security Symposium)

[Angelos Stavrou <astavrou@gmu.edu>]

Please accept our apologies if you receive multiple copies of the same  
announcement.
----------------------------------------------------------------------------------------------------------------------

CALL FOR PARTICIPATION

We invite you to attend the Workshop on Cyber Security
Experimentation and Test (CSET '09) on August 10, 2009 in Montreal,
Canada. The CSET'09 workshop is co-located with the USENIX Security
Symposium.

Workshop URL: http://www.usenix.org/event/cset09/

CSET '09 is bringing together researchers and testbed developers to
share their experiences and define a forward-looking agenda for the
development of scientific, realistic evaluation approaches for security
threats and defenses; it provides an important community forum for the
exploration of transformational advances in the field of cyber security
experimentation and test.

This year we have an exciting program, which includes 9 papers on
security experimentation, a keynote address by Dr Michael Van Putte
from DARPA and a panel on science of security experimentation.

******************************
WORKSHOP PROGRAM
******************************
9:00 a.m.–9:15 a.m.
---------------------------
Opening Remarks
Program Co-Chairs: Jelena Mirkovic, USC Information Sciences Institute  
(ISI); Angelos Stavrou, George Mason University
General Chair: Terry V. Benzel, USC Information Sciences Institute (ISI)

9:15 a.m.–9:45 a.m.
---------------------------
Keynote Address
The Future of Cyber Security Experimentation and Test
Michael VanPutte, DARPA

10:00 a.m.–11:00 a.m.
---------------------------
Session on Security Education
A Highly Immersive Approach to Teaching Reverse Engineering
Golden G. Richard III, University of New Orleans

Collective Views of the NSA/CSS Cyber Defense Exercise on Curricula  
and Learning Objectives
William J. Adams and Efstratios L. Gavas, United States Merchant  
Marine Academy; Tim Lacey, Air Force Institute of Technology; Sylvain  
P. Leblanc, Royal Military College of Canada

11:00 a.m.–noon
---------------------------
Session on Security Experimentation
Evaluating Security Products with Clinical Trials
Anil Somayaji and Yiru Li, Carleton Computer Security Lab; Hajime  
Inoue, ATC-NY; José M. Fernandez, École Polytechnique Montréal;  
Richard Ford, Florida Institute of Technology

The Heisenberg Measuring Uncertainty in Lightweight Virtualization  
Testbeds
Quan Jia, Zhaohui Wang, and Angelos Stavrou, George Mason University

1:00 p.m.–2:30 p.m.
---------------------------
Session on Testbeds
The Virtual Power System Testbed and Inter-Testbed Integration
David C. Bergman, Dong Jin, David M. Nicol, and Tim Yardley,  
University of Illinois at Urbana-Champaign

Dartmouth Internet Security Testbed (DIST): Building a Campus-wide  
Wireless Testbed
Sergey Bratus, David Kotz, Keren Tan, William Taylor, Anna Shubina,  
and Bennet Vance, Dartmouth College; Michael Locasto, George Mason  
University

An Emulation of GENI Access Control
Soner Sevinc and Larry Peterson, Princeton University; Trevor Jim and  
Mary Fernández, AT&T Labs Research

2:45 p.m.–3:45 p.m.
---------------------------
Session on Experimentation Tools
Payoff-Based IDS Evaluation
Michael Collins, RedJack, LLC

Toward Instrumenting Network Warfare Competitions to Generate Labeled  
Datasets
Benjamin Sangster, T.J. O'Connor, Thomas Cook, Robert Fanelli, Erik  
Dean, William J. Adams, Chris Morrell, Gregory Conti, United States  
Military Academy

4:00 p.m.–5:30 p.m.
---------------------------
Panel on Science of Security Experimentation

Panelists: John McHugh, Dalhousie University; Jennifer Bayuk, Jennifer  
L Bayuk LLC; Minaxi Gupta, Indiana University; Roy Maxion, Carnegie  
Mellon University

There is currently no established best practice for evaluation of  
practical research security solutions. Not only do we lack benchmarks  
and metrics for security testing, we also don't agree on testing  
approaches, test setup, or even evaluation goals. Published work  
abounds with ad hoc, unrealistic, and unrepeatable test strategies. It  
is impossible to compare related solutions because they usually have  
been tested in very different settings, and their implementation was  
not made public. It is further impossible to build on the work of  
others without re-implementing their solution and evaluation approach  
from scratch. This dilutes the strength of a research community and  
slows down the progress.

This panel will discuss challenges to scientifically rigorous security  
experimentation, including:

   * the choice of an appropriate evaluation approach from theory,  
simulation, emulation, trace-based analysis, and deployment
   * how/where to gather appropriate and realistic data to reproduce  
relevant security threats
   * how to faithfully reproduce data in an experimental setting
   * how to promote reuse and sharing, and discourage reinvention in  
the community
   * requirements for and obstacles to creation of widely accepted  
benchmarks for popular security areas

**************************************
We hope to see you in Montreal!

CSET'09 Organizers
Terry Benzel (tbenzel at isi.edu)
Angelos Stavrou (astavrou at gmu.edu)
Jelena Mirkovic (sunshine at isi.edu)