At 8:30AM (CST) on 1/20/23, Students started experiencing intermittent failure of file uploads and file viewing. This impacted report assignments that required file uploads such as images or PDFs.
Time Frame:
Starting at: 8:30AM (CST) on 1/20/23 Ending at: 3:20PM (CST) on 1/20/23 Duration: 6 hours 50 minutes
Root Cause:
Labflow’s vendor that processes file uploads and file viewing, FileStack, was experiencing intermittent issues. Labflow is expecting a follow-up root cause analysis report to understand their future remediation strategies.
Remediation:
Labflow has re-enabled the file uploads and file viewing functionality as of 3:20PM (CST).
Student Impact:
The intermittent failure of file uploads and file viewing created a frustrating experience for students where they may encounter an error preventing them from uploading a file one time, but are then successful on other attempts, or situations where 1 or 2 of their files do not appear to be uploaded but others appear successful.
Posted Jan 20, 2023 - 15:52 CST
Update
We are continuing to monitor the external service's progress. No additional information is available at this time.
Posted Jan 20, 2023 - 14:41 CST
Identified
The root cause of the issue has been identified. The external service used for file uploads and viewing, Filestack, is now testing solutions.
Posted Jan 20, 2023 - 13:25 CST
Update
We are continuing to investigate this issue.
Posted Jan 20, 2023 - 12:00 CST
Investigating
Labflow Outage Incident (Partial)
Status: In-Progress
At 8:30AM (CST) on 1/20/23, Students started experiencing intermittent failure of file uploads and file viewing.
(TBD) Labflow’s external service that processes file uploads and file viewing, FileStack, is experiencing intermittent issues.
Remedies:
Labflow is working with the vendor to remediate this issue as quickly as possible.
Labflow needs to temporarily disable the ability to upload files within reports.
Student Impact:
The intermittent failure of file uploads and file viewing is creating a frustrating experience for students where they may encounter an error preventing them from uploading a file one time, but are then successful on other attempts, or situations where 1 or 2 of their files do not appear to be uploaded but others appear successful.
Posted Jan 20, 2023 - 11:42 CST
This incident affected: Filestack Service (File Conversions, Filestack API).