Verification fails during downloading

[KatrienQ]

Hello,
While downloading a dataset, I get this error:

Error in .local(object, ...) :
Verification of file ... failed.

I tried different datasets, but I keep running into this error.

Best,
Katrien

[jspidlen]

Hi Katrien, Last week, we have seen a recent surge in FlowRepository data downloads. Our typical download volume is around 3-5 TB of data per month. Last week, we saw downloads of over 40 TB just within a few days; over 90% of those downloads were unauthenticated downloads from web crawlers and other automated systems hitting the single FCS file downloads, which was beyond what the FlowRepository system can handle (so FlowRepository was down with all listeners busy most of the time). Consequently, I had to turn off the single FCS file downloads to address this and to ensure FlowRepository remains up for normal users. The API (and consequently FlowRepositoryR) will not allow you to download data at this time; however you can still download data using your web browser. My apologies for any inconvenience; this is hopefully a temporary fix while ISAC rethings a long term strategy for improved maintenance and operation of FlowRepository. Best, Josef

…

On Tue, Apr 6, 2021 at 1:33 AM KatrienQ ***@***.***> wrote: Hello, While downloading a dataset, I get this error: Error in .local(object, ...) : Verification of file ... failed. I tried different datasets, but I keep running into this error. Best, Katrien — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#1>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AADJJWV3SHKDTVOEBE56UJ3THLBLXANCNFSM42OILAPA> .

[PedroMilanezAlmeida]

Hi Josef,

Any chances the API will be back on?

Thank you very much,
Pedro

EDIT: @jspidlen

[jspidlen]

Hi Pedro, sorry, no I don't think it will, at least not in the current form. I tried to save ii, proposed some solutions to ISAC, discussed those with ISAC for about 2 years, but at the end ISAC picked a different solution to move forward. So it looks like it will be a new solution developed by a different party, and it's still unclear how exactly it will look like. Best, Josef

…

On Thu, Dec 16, 2021 at 2:02 PM PedroMilanezAlmeida < ***@***.***> wrote: Hi Josef, Any chances the API will be back on? Thank you very much, Pedro — Reply to this email directly, view it on GitHub <#1 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AADJJWV6PATLFR55QSXAFVTURJOWXANCNFSM42OILAPA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>. You are receiving this because you commented.Message ID: ***@***.***>

[PedroMilanezAlmeida]

Thanks for your quick reply, Joseph. Hopefully we will have something soon. Best.

[phauchamps]

Hi Josef,
Any news on this topic ? Got trapped myself trying to download single fcs files using FlowRepositoryR :-S
Thanks,
Philippe

[jspidlen]

Hi Philippe, Sorry, no update since December. Back in August, ISAC decided to go with a third-party to implement a new version of FlowRepository, but there were delays in signing the actual agreement. It's my understanding that ISAC is aiming to have the contract signed this Spring so that it can be officially announced at CYTO in June, and presumably some development work on this would actually start this Spring or Summer. I don't have visibility into the roadmap or scope of this project, and I have no idea if some APIs or even an R library to access the contents programmatically is planned. Jonathan Irish is leading the efforts from ISAC'c end; I'd recommend checking with him, and perhaps also suggesting that an R library to access data from the new FlowRepository would be valuable. Best, Josef

…

On Mon, Feb 21, 2022 at 6:27 AM Philippe Hauchamps ***@***.***> wrote: Hi Josef, Any news on this topic ? Got trapped myself trying to download single fcs files using FlowRepositoryR :-S Thanks, Philippe — Reply to this email directly, view it on GitHub <#1 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AADJJWXGQWASFVOJYBZIR3DU4JDTHANCNFSM42OILAPA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[phauchamps]

Thank you Josef, I will try to liaise with Jonathan.
However if the plan is still to provide a API to access contents programmatically, why not then adapting FlowRepositoryR to connect to the new API ? After all, the methods and user interface is there and fully functional, only the back-end would need to be developed according to the new API. What do you think ?

[jspidlen]

Hi Philippe, I agree, adapting FlowRepositoryR could be less work than starting from scratch, but it really depends on whether there will be an API at all, and if so, what sort of functionality is offered through the new API. Best, Josef

…

On Tue, Feb 22, 2022, 1:48 AM Philippe Hauchamps ***@***.***> wrote: Thank you Josef, I will try to liaise with Jonathan. However if the plan is still to provide a API to access contents programmatically, why not then adapting FlowRepositoryR to connect to the new API ? After all, the methods and user interface is there and fully functional, only the back-end would need to be developed according to the new API. What do you think ? — Reply to this email directly, view it on GitHub <#1 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AADJJWV32YVHZDLQWFVA4ILU4NLWJANCNFSM42OILAPA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>. You are receiving this because you were mentioned.Message ID: ***@***.***>