Attending: Brian, Dan, Winnie, RobC, Ste, Sam, Jens (chair+mins), Raja, Matt, JohnH T2K checksums - require ADLER32 which is pretty lightweight, a compromise between catching errors and ease of computation - however, even ADLER32 needs to have a thread going through the file sequentially (or checksum on the fly as it comes in or goes out) For DPM, generating checksums for files that don't have it will require DOME. We believe that FTS should turn on checksums automatically more or less; it will ask the source for the checksum, presumably, and the destination once the file is transferred, and compare. The source could have a shallow or soft (cached in metadata) checksum or a deep one (calculated afresh on the data). Would we need to revisit the documentation for data transfers? Possibly. Brian attended the GlobusWorld event which was hosted at RAL last week (see blog post) One related question is whether Globus remains interoperable with GridPP. Certificate-based GridFTP is OK, but if Globus switches to MyProxy-generated credentials, and WLCG to SciTokens (which are JWT), and Globus will use OAuth2 to authorise the certificate generation or the transfer itself, then the two might diverge. Both are looking at HTTP as an alternative transfer protocol but would not be interoperable with bearer tokens in Globus and JWT in GridPP. Would need some testing/documenting. Data lakes- Sam circulated a document with fairly liberal permissions, so due to the open nature of this summary, we have redacted the link, as is customary. Daniel yes DP Brian for later discussion, blogpots: https://gridpp-storage.blogspot.com/2019/01/learning-about-globus-connectonline-and.html https://gridpp-storage.blogspot.com/2019/01/this-is-dave-first-of-atlas-datasets-at.html checnksum algorithin is VO choice and vice versa, WLCG vos dcided against md5 since its swloer than adler , but adler was good enough take away from my blog posts, on ATLAS , you can see that in the second half of the plot, maximum datasets sizes grew by order of magnitude. FTS (can) ask for a soft checksum before copying the data We did that before, it acted as expected. ie transfer failed metadata one sec BD Samuel [link to doc] SC Brian sam should I still hget you access to ern datalahe, or ashould i add teng ? working on why Jens is blocked ewhen I thought he should have.. plus RAL node seem to be offline atm so got to sort that as well. BD Today at 10:34 AM