Minutes of the storage EVO meeting 15 Dec 2010

Attending:
	Glasgow: David, Sam
	Lancaster: Matt
	IC: Duncan
	Bristol: Winnie
	Sheffield: Elena
	Oxford: Pete, Ewan
	RAL T1: Brian, James, Jens (chair+mins)	

Apologies:
	Edinburgh: Wahid
	QMUL: Chris
	

0. Review of actions

   Below see.

1. Status of and plans for toolkits

   So we have the following toolkits:

   1. DPM toolkit - most mature, packaged as RPM
   2. DPM monitoring - packaged for SL4 but not SL5.  Sam has talked
      to Brian Bockelman.

   Some tools are available as single scripts, is that sufficient?
   Ewan suggests that an RPM package is best, then updates happen as
   part of the rest of the system.  Probably only need .rpm, not
   .deb.

   3. File integrity checking.
   4. Catalogue synchronisation checking.
   5. Scripts for thrashing disk servers.  James will talk to Martin.
   6. "Toolkit" for StoRM - filesystem utilities which are sort of
      the same as the ones for the filesystem StoRM already manages.

   Sam points out that maybe we don't want to hand the VOs the
   toolkits, because using them inappropriately could lead to
   inappropriate use of resources.  In which case there are fewer
   requirements on packaging, if we run the service anyway.

2. Mileage in milestones

   We discussed metrics last week.  Let's have a quick stab at which
   milestones and/or deliverables will be useful over the next six
   months or (in some cases) longer:

   Pensively proposed possible proposals:

   * GLUE 2.0 upgrade plan
   * GLUE 2.0 deployed
   * GLUE 1.3 decommissioned
   * Cloud storage interactions (scratch storage? interoperation)?
   * Publishing accuracy reevaluated again one more time
   * Storage affecting job efficiency (timeouts, unavailability)

     OK, in this case efficiency = success rate.

   * Storage-and-data-management clients - access patterns revisited
   * Insert some security related goal here
   * TLA collaborations proposal/report: EMI, EGI, IGE, NGS, NGI, OGF.
   * WAN tuning study
   * Some monitoring related study or milestone.  Identifying
     bottlenecks?  Or fsprobe at T2s.
   * VO arm twisting - feedback report?
   * Workshop at next GridPP
   * Chris proposed something on Argus (whether he intended it for this
     section is not clear :-)  Sam says Argus is optional, so if we have
     a milestone for Argus deployment, it should take this into account.

   Any blue sky stuff we can fit in?  Data transfer?

3. Round table, if there is enough time (storage and data management
   related, please.)

   No time, perhaps next week.

4. AOB

   Jens may be travelling next Wed.(?) so just in case thanked
   everybody for their contributions in 2010 and may the Force be with
   the disk servers over the Christmas break.

BEHOLD THE ACTIONS:

401	02/06/2010	Clean up the wiki	ALL	Low	Open

Ongoing.

416	10/11/2010	Report on to Sam on Areca problems	ALL	Med	Open

Progress: James is talking to a chappie from Areca; other people are
preparing input.

419	08/12/2010	Circulate ATLAS mail on preallocation to list	Wahid	Med	Open

Done: https://www.jiscmail.ac.uk/cgi-bin/webadmin?A2=ind1012&L=GRIDPP-STORAGE&F=&S=&P=4863

420	08/12/2010	Circulate Lustre performance numbers to list	Jeremy	Med	Open

Done: https://www.jiscmail.ac.uk/cgi-bin/webadmin?A2=ind1012&L=GRIDPP-STORAGE&F=&S=&P=6172

421	08/12/2010	Circulate metric discussion to list	Jens	Med	Open

Done: https://www.jiscmail.ac.uk/cgi-bin/webadmin?A2=ind1012&L=GRIDPP-STORAGE&F=&S=&P=13547

422	08/12/2010	Check membership of European Lustre consortium	Jeremy	Med	Open

No news, but it can't be hard to do.

NEW ACTIONS

423	15/12/2010	Talk to Martin about disk stress testing tool	James	Med	Open

424	15/12/2010	Report on blue sky data transfer stuff proposed by JANET	Jens	Low	Open

09:59:48] Winnie Lacesso joined
[10:00:57] Jens Jensen will be joining shortly
[10:02:07] Ewan Mac Mahon joined
[10:02:24] Winnie Lacesso someone say something please to check audio?
[10:02:42] Winnie Lacesso Good, tx
[10:02:45] David Crooks joined
[10:02:52] Elena Korolkova joined
[10:03:17] James Thorne joined
[10:03:23] Ewan Mac Mahon A little. Maybe.
[10:04:57] Ewan Mac Mahon *whistles*
[10:08:00] Duncan Rand joined
[10:08:06] Brian Davies atlas tools
[10:08:08] Brian Davies https://twiki.cern.ch/twiki/bin/view/Atlas/DDMOperationsScripts
[10:08:51] Brian Davies and this http://iopscience.iop.org/1742-6596/219/4/042053
[10:09:17] Ewan Mac Mahon  
[10:14:07] Pete Gronbech joined
[10:20:13] Elena Korolkova left
[10:21:10] Elena Korolkova joined
[10:36:50] James Thorne left
[10:36:56] Winnie Lacesso left
[10:36:59] Elena Korolkova left