[Resolved] Webex Meetings: Users unable to connect to Meeting services

Posted on April 16, 2020 at 6:44 pm by acampb28

Locations: US data centers

Apr 16, 6:18 PM EDT
Monitoring – A network event caused specific service traffic to be interrupted across the US Webex data centers. While we continue our root cause analysis to identify the source of the traffic interruption, additional mitigations have been implemented to ensure we avoid a recurrence. Services have been fully restored and engineering will continue to monitor the global Webex environment.

Apr 16, 05:44 PM EDT

Identified – Engineering continues to work to restore services and we are now seeing Meetings services recover. Engineering is working to complete the remediation activities. Affected users should retry their operation to connect. Mobile clients, Webex Teams, Webex Messenger, Webex Devices, SIP connections, PSTN audio-call in and other video devices are also available join methods. Engineering will provide updates as the restoration activities complete and we move into a monitoring status.

Apr 16, 04:42 PM EDT

Identified – Meeting services hosted within the US data centers are experiencing delays and failures joining or utilizing the Meetings services. Engineering is taking corrective actions to work to restore services. Users that are affected can retry or wait for the join as some joins are succeeding, but are delayed. Users can also join ongoing meetings using audio call-in. Users may also now be able to connect using Webex Teams or video devices (SIP). We are working quickly to restore services and will provide updates as quickly as we can.

Apr 16, 04:19 PM EDT

Investigating – Engineering is working on addressing an issue affecting meeting joins for users connecting to the SJC and DFW US data centers. Affected users will see error messages or failures when joining using the desktop or Webex Teams client. Engineering is working to restore services. We apologize for this impact and will provide updates as soon as they are available.

Posted in Canvas / LMS, Video Conferencing

[Resolved]Webex Meetings: Users experience intermittent disconnects and reconnects to Webex Meetings

Posted on April 16, 2020 at 12:11 pm by acampb28

Locations: San Jose data center services

Resolved – Service restoration activities have been completed and engineering is continuing to monitor. Services are operating as expected.  For the previously mentioned edge cases where users experienced a ‘split’ meeting, please disconnect the meeting and restart it to resolve the issue.  Thank you for your continued patience and we will continue to provide updates as we complete our monitoring activities.

Investigating – Cisco Engineering is working to address an issue that is causing intermittent computer audio and video issues when connecting to Meetings services hosted in the San Jose data center. Affected users may have experienced in-meeting latency including mute/unmute and sharing delays as well as roster update latency. Other users may experience computer audio and video streams be disconnected and reconnected automatically to another instance. In some edge cases, users may have experienced a ‘split’ meeting, where some users cannot see or hear all participants. If this condition does occur, please disconnect the meeting and restart it to resolve the issue. Service remediation activities are in progress. Updates will be provided as they become available.

Posted in Canvas / LMS, Video Conferencing

[RESOLVED] Canvas LMS Currently Unavailable

Posted on April 15, 2020 at 5:25 pm by esatkowi

Resolved: Canvas is now accessible.

Legacy issue:  Canvas 503 Bad Gateway Error
Some users are experiencing a 503 Bad Gateway error when trying to access Canvas. Canvas has identified the issue and is working to resolve it.
  Thank you for your patience and cooperation
Posted in Canvas / LMS, Educational Technologies, Instructional Technologies, Lecture Capture

[RESOLVED]WebEx Meetings not appearing in Canvas

Posted on April 15, 2020 at 12:20 pm by turner
Update – Cisco has identified and resolved the issue for most affected sites. Most sites should now see their courses in their properly configured state. Please standby if any courses on your site are still in setup mode or are experiencing any related issues.
——————————————————————————————————

The Cisco Webex tool in Canvas is currently experiencing a synchronization issue. We have reached out to Cisco for a resolution and will post updates as we receive them. If you do not see your meetings/recordings in Canvas, they are still available and accessible via https://fau.webex.com. Please view the guides linked below for instructions on how to schedule, join, and host meetings, and how to share and view recordings through fau.webex.com.

 

​
Posted in Canvas / LMS, Educational Technologies

[RESOLVED] TouchNet Systems Maintenance, Friday, April 24th from 3:00AM to 7:00AM

Posted on April 15, 2020 at 1:15 am by silverst

The TouchNet payment processing system will be undergoing maintenance -Starting from 3:00am to 7:00am (EST) Friday, 4/24/2020. This affects student payment services (Bill+Payment), as well as all Marketplace Stores, uPay sites and TouchNet ready partner payment services. We expect all systems to be back online no later than 7:00 am (EST) that morning. When the system is back up and ready to go, we will notify you. You may wish to place warnings on your website, or take your store offline. If this scheduled downtime creates a conflict for your operations, please feel free to contact us at FIS@fau.edu for further discussion. Expected End-user impact: During this time all student payment services (Bill+Payment), as well as all Marketplace Stores, uPay sites and TouchNet ready partner payment services will be unavailable during this maintenance cycle.

Posted in Banner and Admin Systems, Workday

OIT Systems Maintenance, Thurs. April 16 from 3:00AM to 7:00AM

Posted on April 14, 2020 at 10:54 am by ann

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 04/16/2020 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:

*************************************************************************************

Server Maintenance
Description of change: OIT will apply routine patches to redundant LDAP user/configuration information servers at disaster recovery location (NWRDC)​
Downtime window start: 3:00 AM
Downtime window end: 6:00 AM
Affected services: No service downtime expected but for full disclosure, the NWRDC oud servers are part of the cluster of: Production OUD (Oracle Unified Directory) servers, services that rely on them such as OIM (Identity Management), and servers/clients that rely on them for login authentication.​​
Expected End-user impact: During this time, no end-user impact is expected as any reboots necessary will be done in a rolling manner.

********************************************************

Server Upgrade
Description of change: OIT will be upgrading the software on its spam filtering appliances.​
Downtime window start: 3:00 AM
Downtime window end: 5:00 AM
Affected services: Inbound FAU Email, smtp.fau.edu​
Expected End-user impact: During this time, inbound email may be delayed. Mail relayed through smtp.fau.edu may fail during the change window.

********************************************************

Server Maintenance
Description of change: OIT will add a test appliance to FAU’s web traffic director cluster to pull a copy of the configuration data
Downtime window start: 5:00 AM
Downtime window end: 6:00 AM
Affected services: No service interruption expected but for full disclosure: a plethora of web domains and vanity domains are resolved via the Global Traffic Manager. Major ones are: www.fau.edu, sso.fau.edu, forms.fau.edu
Expected End-user impact: During this time, no end-user impact is expected.

********************************************************
Exit Form II
Description of change: OIT will apply a frevvo form for matriculated students who wish to withdraw/terminate from the university.
Downtime window start: 6:00 AM
Downtime window end: 8:00 AM
Affected services: ​Banner
Expected End-user impact: ​When students attempt to drop their last course in Banner they will now have an error message that redirects them to Exit Form II instead of Exit I.

********************************************************

Account cleanup
Description of change: OIT will be removing old user accounts
Downtime window start: 6:00 AM
Downtime window end: 6:15 AM
Affected services: AD login
Expected End-user impact: During this time, no end-user impact is expected

********************************************************

Server Maintenance
Description of change: We will be making a configuration change to Onbase webservers that will require a restart​
Downtime window start  4/16/2020 3:00 AM
Downtime window end  4/16/2020 4:00 AM
OIT Units involved in the change (Internal Only)  Systems and AS DEV
Affected services: Onbase web users will be logged off if connected during the restart (15 second window)
Expected End-user impact: During this time, no end-user impact is expected.

Posted in Banner and Admin Systems, Email, Systems

Webex Engineering has scheduled a maintenance window to support ongoing service maintenance for Webex Meeting Services – US East Coast

Posted on April 9, 2020 at 8:00 am by acampb28

Webex Engineering has scheduled a maintenance window to support ongoing service maintenance for Webex Meeting Services.

— Scheduled Maintenance Window — Start: Friday, April 10, 2020, 10:00 PM PDT (GMT-7) Complete: Friday, April 10, 2020, 11:59 PM PDT (GMT-7)

— User Experience — During the maintenance window, hosts and participants may experience the following service impacts:

Recording WILL be available during the maintenance period, but processing and availability of those new Network Based Recordings will be delayed for up to 24 hours after the maintenance is completed.

Recordings that were made prior to this maintenance will NOT be available during this maintenance.

Posted in Canvas / LMS, Video Conferencing

OIT Systems Maintenance, Thurs. April 9, from 3:00AM to 7:00AM

Posted on April 7, 2020 at 11:39 am by ann

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 04/09/2020 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:

*************************************************************************************

Integration of new sexual harassment training tool
Description of change: OIT will integrate a new sexual harassment tool with Banner using a ​Snaplogic pipeline to integrate banner with the new tool from Everfi, a third party service.
Downtime window start: 12:00 AM
Downtime window end: 12:00 AM
Affected services: ​No services are affected.
Expected End-user impact: During this time no end-user impact is expected.

********************************************************

Server Upgrade
Description of change: OIT will be upgrading the software on one of its mail servers.​
Downtime window start: 3:00 AM
Downtime window end: 6:00 AM
Affected services: On-premises exchange – mail.fau.edu​
Expected End-user impact: During this time, no-end user impact is expected since all user mailboxes are hosted in Office 365. This change only impact on-premises exchange, which will be unavailable.

********************************************************

Posted in Banner and Admin Systems, Email, Systems

Starfish relationships and Managed relationships files down (no access to calandar, students, flags, etc.)

Posted on April 6, 2020 at 10:09 am by coleenjordan

Resolved

Posted in Banner and Admin Systems, Uncategorized

[Resolved] Webex Meetings: Users are intermittently unable to connect to computer audio (VoIP)

Posted on April 4, 2020 at 12:18 pm by acampb28
11:55am – All tasks have been completed and computer audio and video services are fully operational.

11:33am – WebEx Engineering continues to work on updating the VoIP services. Many of the services have been restored, but additional work is underway to complete the task. Previously affected users should close out of their meeting and rejoin to enable audio and video. Remaining affected users may see connection issues or may be able to connect to audio, but the client computer video option may be unavailable.

10:59am – Engineering is working to address an issue affecting the computer audio (VoIP) component of Webex Meetings. Users connecting to sites hosted in the US region may not be able to join meetings using the Webex computer client for audio or video. Users can connect using telephony call-in or call-back, Webex Teams, or video endpoints (SIP connections) as an alternative.

Posted in Canvas / LMS, Video Conferencing