Attending, in approximate joinological order: JEns (chair+mins), Matt, Sam, John H, Marcus, Steve, Daniel, Winnie, David, Tom, Luke, Brian, Govind 0. OPerational blog posts Marcus had a problem with dpm-listspaces still showing the VO that was supposed to have been decommissioned. The directory path was still there but the owner had been changed. It would be useful to describe this in the wiki. Sam reported curious DPM load spike at Glasgow, probably caused by queued xroot requests. There is a feature in edg-mkgridmap which causes it to regenerate and replace the gridmap file carefully, but services then need to reload the file (if they don't read it each time), but were not closing the old file, thus leading the system to leak file handles (and the old file would not be actually deleted since there would be a handle open to it - one of the nice features of Unix filesystems) 1. Remaining todos for December: we have only ~1wk to implement anything else that needs implementing this year... Apparently there is nothing else to do, operationally speaking. David is collecting information about SL5 for/with EGI; if you have any please send to him - (both for head and pool nodes). May also need new drivers and stuff; a bit of a pain to recompile for older/newer kernels. 2. Report from yesterweek's cloud whatsit workshop at Crick. GridPP was well represented at yesterweek's cloud workshop (slides should appear shortly... tomorrow?) General theme was hybrid cloud; part of the Real Work(tm) session was on moving data between infrastructures, namely GridPP, DiRAC, EUDAT, PRACE, EGI, and a public cloud, Azure. Using GridFTP. Work in progress. Specifically, setting up a Globus GridFTP node in the cloud didn't work as it didn't like NAT; Mike Jones had a suggestion for working around that which we will test. The certificates worked fine; they can be issued to an IP address (not with the standard interface, though ^_^) as long as they have the string representation of the IP address in the CN as well (as per the old, pre-RFC2818 Globus). Did not check IPv6, though. Brian points out for multiprotocol, we should try gfal-copy. Another question from Brian, while we are (likely) reusing sessions, are we using restart markers? Probably not... Others are using scp and rsync; Marcus reminds us there are specific replacements for scp such as bbcp which have better performance [there was also a bbftp if memory serves] Interestingly on the Azure front, the chap from Microsoft mentioned Data Factory which is basically a multiprotocol data transfer tool - didn't support GridFTP but maybe we could contribute that? Also needs bit more exploration. Of course the purpose of the tool is for you to migrate your data into Azure, so it also supports S3 endpoints. Also in the Real Work(tm) section, Jupyter notebooks were popular but do you need to know python ...? And how do you get your data made available to a Jupyter notebook, particularly if it is running in the cloud... and store the output. 3. Comparative datamanagementology?! (related to 3) This has now turned into a blog post (thanks Winnie for the suggestion re the title!) 4. AOB Jens and others will be at CIUK next week. We still aim to have a meeting on the 21st, obvs the last one of the year. The SOC at the GDB next week is unrelated to the SL5. The "Security Operations Centre" is analysing security data (logs), aiming to work with a small set of components to develop threats intel, in support of intrusion detection systems. Daniel Traynor: (07/12/2016 10:00:31) hi Paige Winslowe Lacesso: (10:10 AM) MAKE SURE any blog post includes datamanagementology term so you can prove you invented it!!! Jens Jensen: (10:12 AM) :-) Govind: (10:14 AM) I am waiting for centos7 to release Tom Whyntie: (10:19 AM) ha - true! (Well, apart from the LINAC hall if you go up to Restaurant 2) (And the tram now goes all the way to CERN) Jens Jensen: (10:20 AM) www.cloud.ac.uk Daniel Traynor: (10:22 AM) did you check ipv6 Lukasz Kreczko: (10:27 AM) https://azure.microsoft.com/en-gb/services/data-factory/ or wget e.g. wget https://s3.amazonaws.com/connect.globusonline.org/linux/stable/globusconnectpersonal-latest.tgz Marcus Ebert: (10:34 AM) scp could always directly substituted with bbcp, which uses same authentication but with much better performance than scp Daniel Traynor: (10:37 AM) is there a gridftp RFC/ ISO /IEEE/ IETF standared? it might help adoption see you in manchester too Tom Whyntie: (10:43 AM) Thanks, bye!