Minutes of the storage EVO meeting 19 Jan 2011 Present: Edinburgh: Wahid Glasgow: Sam, David Lancaster: Matt QMUL: Chris Liverpool: John, Stephen Bristol: Winnie Sheffield: Elena RHUL: Govind Oxford: Pete RAL T1: Brian, Jens (chair+mins) Apologies: RAL T1: James Discussion started just before the meeting regarding the storage workshop to be scheduled in connection with the GridPP meeting in April. To set an agenda, perhaps we should have a poll like the last time. It was suggested to prioritise time on tuning and performance, and monitoring. It was suggested that we spend time on practical stuff as well, and do not have parallel sessions. Chris points out there will be a Dell-sponsored (=lunch) Lustre workshop at QMUL, currently scheduled for 1-2 March. The focus is not GridPP of course. Jens talked on Monday to the Sanger data management guys again, and mentioned the GridPP storage, and they are interested. It may make sense to invite them to the Lustre workshop as well. They are not interested in SRM directly, but everything below that is of interest. 0. Review of action items Below see. 1. Review of ATLAS transfers The purpose is to decommission ATLASMCDISK. These are site-internal transfers, between disk servers (or at least between space tokens). They are scheduled by FTS (at RAL) and thus use GridFTP. Glasgow increased their FTS slots to 66, and with this managed to achieve sustained transfers at 10 Gb/s, peaking at 12 Gb/s. Ten other sites will see transfers, but by default only with their normal FTS settings. 2. review of ATLAS space token change requests Sites will need to increase the ATLASDATADISK to accommodate the data coming in from ATLASMCDISK; and then decommission MCDISK. Generally, Alistair Dewhurst from the T1 and Brian are plugged into the ATLAS decision procedure at some level, and change requests are posted to tb-support and dteam. 3. Baseline versions review (cf Brian's thread on the list) StoRM has problems with information publishing on Lustre, so upgrading is not recommended on Lustre systems. However, on GPFS is fine, so Bristol (if you still have it) can upgrade to 1.5.6. For DPM, there is a 1.8 release currently running on the Glasgow test instance. The upgrade from 1.7 to 1.8 requires a schema change in the database, an extra table added (which YAIM will add.) Versions 1.7.4 and above are said to have much improved database management - in particular, clearing old requests - so upgrading is recommended. You should also be able to go from any 1.7.X to 1.8, as there is just the database change to do. Glasgow have tested with 1.8 head node and 1.7 pools (on SL5) and it worked; the other way around (1.7 head and 1.8 pools) have not been tested but may work. Matt will try. 1.8 has the most recent publishing magic; fixing all but one of the edge cases that could cause publishing to go awry. Ran out of time here, so these may be postponed till next week - see AOB. 4. Information systems reporting next steps Ie. the next steps in information systems reporting, not the information system reporting the next steps. 5. Cloud storage plans - what does it make sense to test? $-2.1 Interoperation? $-2.2 Running SRM in IaaS? $-2.3 Transfer rates? $-2.4 Does it need cloud computing for a meaningful test? ... $-3. Plans for getting Dell to show&tell re Lustre? $-2. Whatever happened to the CERN@School discussion(s)? $-1. Last week's GDB - demos of work proposed at Jamboree BTW I like the name "SpeedySRM" $. AOB Jens will be at SURFnet next week (Dutch NREN), so Sam or Wahid or Brian or some superposition thereof will be running the storage meeting next week, possibly using any or all of the remaining agenda items above, and discussing also the agenda for the storage workshop. ACTIONS 401 02/06/2010 Clean up the wiki ALL Low Open Ongoing. 416 10/11/2010 Report on to Sam on Areca problems ALL Med Open Two reports received; two others have promised input - Ewan and Matt - so close this action and open individual ones on them. 422 08/12/2010 Check membership of European Lustre consortium Jeremy Med Open Oops, this should have been closed. 425 05/01/2011 Check Chris' test SE (se04) info published Jens/ALL Med Open Still needed. New (and old) action list 401 02/06/2010 Clean up the wiki ALL Low Open 425 05/01/2011 Check Chris' test SE (se04) info published Jens/ALL Med Open 426 19/01/2011 Send Areca stuff to Sam Matt High Open 427 19/01/2011 Send Areca stuff to Sam Ewan High Open 428 19/01/2011 Create a survey for agenda for storage at GridPP26 Jens,Wahid High Open 429 19/01/2011 Contact Sanger about storage (Lustre workshop and GridPP) Jens Med Open 430 19/01/2011 Test the rest of Chris's StoRM (cf 425) ALL Med Open [09:55:07] Sam Skipsey Hi Wahid. [09:55:16] Sam Skipsey Just encaffeinating. [09:56:16] Wahid Bhimji hello [10:00:01] Queen Mary, U London London, U.K. joined [10:00:40] John Bland joined [10:00:55] Queen Mary, U London London, U.K. left [10:01:01] Queen Mary, U London London, U.K. joined [10:01:52] Stephen Jones joined [10:02:43] Winnie Lacesso joined [10:03:25] Brian Davies joined [10:03:27] David Crooks joined [10:04:10] Elena Korolkova joined [10:07:02] Queen Mary, U London London, U.K. left [10:08:32] Wahid Bhimji Chris - there is a nagios plugin for the Dell OpenManage stuff. I almost have it working [10:10:11] Queen Mary, U London London, U.K. joined [10:11:42] Queen Mary, U London London, U.K. left [10:12:51] Queen Mary, U London London, U.K. joined [10:13:22] Queen Mary, U London London, U.K. left [10:14:01] Queen Mary, U London London, U.K. joined [10:15:22] Govind Songara joined [10:15:50] Pete Gronbech joined [10:17:02] Queen Mary, U London London, U.K. left [10:19:11] Queen Mary, U London London, U.K. joined [10:20:12] Queen Mary, U London London, U.K. left [10:21:21] Queen Mary, U London London, U.K. joined [10:22:22] Queen Mary, U London London, U.K. left [10:24:31] Queen Mary, U London London, U.K. joined [10:25:32] Queen Mary, U London London, U.K. left [10:26:11] Queen Mary, U London London, U.K. joined [10:27:42] Queen Mary, U London London, U.K. left [10:28:21] Queen Mary, U London London, U.K. joined [10:29:22] Queen Mary, U London London, U.K. left [10:30:31] Queen Mary, U London London, U.K. joined [10:32:11] Elena Korolkova left [10:32:19] David Crooks left [10:32:31] David Crooks joined [10:33:32] Queen Mary, U London London, U.K. left