We are currently experiencing issues with single-sign on. The user will be presented with an error message when attempting to sign in to services such as Workday, Canvas, Helpdesk, Blackboard, and any other application that is utilizing single-sign on. Our team is working on restoring services as soon as possible.
We apologize for the inconvenience this may cause.
OIT
Google is currently investigating a phishing email that is appearing as Google Docs. Please do not click on the link for any unknown shared google doc requests. If you have clicked the link, please make sure to change your Owl Apps and FAU password as soon as possible.
For further assistance resetting your password or any questions please contact the OIT help desk at 561-297-3999.
OIT
**** UPDATE 8:46AM *****
The issue with single-sign on has been resolved and all services have been restored at this time. You may need to close all open browser windows and open a new session before attempting to login.
We thank you for your patience during this time.
OIT
*************************************************************************************************************
We are currently experiencing issues with single-sign on. The user will be presented with an error message when attempting to sign in to services such as Workday, Canvas, Helpdesk, Blackboard, and any other application that is utilizing single-sign on. Our team is working on restoring services as soon as possible.
We apologize for the inconvenience this may cause.
OIT
Issue has been resolved.
———————————————————
Some users may experience an error trying to log into blackboard. We are currently investigating and working to resolve as soon as possible.
We apologize for the inconvenience.
OIT
Amazon has verified that uploads to their service should be working again; users should be seeing improved performance with their uploads to Canvas. Our DevOps team is continuing to monitor the situation, but we are not currently aware of any lingering issues that affect Canvas functionality at this time.
In our previous update, we mentioned there would still be areas of impaired functionality between Canvas and Amazon. The biggest area of impact right now is that uploads are not yet working. This includes student uploads to assignments, instructor grade uploads, and similar functions, but also the ability for Canvas’ background processes to upload files such as admin reports (which is required as part of the process to generate a report at the account level). You may continue to see issues with this, and other areas in Canvas, as Amazon works to fully restore all services.
Canvas performance and service recovery continues to progress quickly. Although many users should now be able to access Canvas, there may still be areas of impaired functionality as we work through remaining issues.
We are beginning to see positive indications of recovery and have successfully tested workflows that were previously failing. We are still awaiting full resolution, and we will provide updates as the situation continues to improve.
AWS is still working through their recovery process. Unfortunately, the number of Amazon services that have been impacted has grown in the time it took to find the root cause, and it will be a significant effort on their side to recover all of the services. They are understandably starting with the most critical ones. Since Canvas depends on so many of their services, a full recovery may still take some time.
On our side, our DevOps team has moved on to other ideas about how to get from a “service disruption” state to a “degraded performance” state in Canvas. We are also discussing the plans for addressing similar circumstances in the future, though our options are limited due to the perniciousness of this incident; but we are considering all options at this time.
Amazon is continuing to work through their recovery process. On our side, our DevOps team has implemented a temporary change to ensure tools and apps not hosted on AWS (Amazon Web Services) are still accessible to those that are able to access Canvas, which is an improvement to the complete service disruption we have had since 10:37 AM MST. However, the majority of Canvas users are still unable to access their Canvas site, due to the outage with AWS.
We will continue our efforts to ensure a good experience with Canvas for users once they are able to access the site again, and will provide an update on the overall issue within the next 30 minutes.
As Amazon works to restore availability in their systems, our DevOps team continues their efforts to expedite the process to restore access to Canvas. We will provide a new update on their progress in 30 minutes or less.
Amazon Web Services has informed us that they have identified the underlying root cause of the issue and they are beginning the remediation process. Our internal DevOps team continues to explore options to facilitate faster recovery.
Amazon is still working to restore server access for sites that have been affected by their outage today, including many Canvas sites. They will keep us updated on their progress.
Amazon has narrowed the scope of their investigation and has identified a specific region impacted by the networking issue. They are actively working on a solution. Our own DevOps team is investigating options that may allow us to work around the problem. We will provide another update in 15 minutes.
Amazon Web Services is currently experiencing what appears to be a large-scale networking issue that has impacted Instructure along with many other companies. We are working with Amazon to diagnose the problem and waiting for updates on their mitigation timeline. We will keep you posted as soon as we have more information.
Updates will follow as they become available.
Network maintenance has been completed.
Thank you
On Sunday, January 22, 2017, between 6:00 am and 7:00 am, OIT will implement an emergency update to the core network. Due to the nature of the maintenance, users may experience intermittent network outages lasting approximately 10 – 20 minutes during this time period. This outage will affect connectivity to the Internet as well as connectivity within FAU.
Thank you
If you received an email that appears to come from President John Kelly with subject line “Important announcement from President John Kelly” do not open and please delete this email immediately. This is a phishing email.
If you already opened the attached document contact the OIT Help Desk at 561.297.3999 for further assistance.
The network maintenance scheduled for January 7 has been completed.
Thank you
On Saturday, January 07, 2017, between 1:00 am and 6:00 am, OIT will implement an emergency update to the core network. Due to the nature of the maintenance, users may experience intermittent network outages lasting approximately 20 – 30 minutes during this time period. This outage will affect connectivity to the Internet as well as connectivity within FAU.
Thank you