The Office of Information Technology is investigating networking issues affecting numerous services. More information will be reported as it becomes available.
OIT Systems Maintenance, Thurs. July 9 from 3:00AM to 7:00AM
Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 07/09/2020 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:
*************************************************************************************
Backup server upgrade
Description of change: OIT will upgrade on-prem crashplan backup server.
Downtime window start: 7/9/2020 5:00 AM
Downtime window end: 7/9/2020 6:00 AM
Affected services: Crashplan
Expected End-user impact: During this time, Crashplan backups will not work. Backups will resume once the upgrade is completed.
*************************************************************************************
Server Maintenance
Description of change: OIT will be enabling a feature to continually clean up old hostnames from DNS.
Downtime window start: 7/9/2020 5:00 AM
Downtime window end: 7/9/2020 5:00 AM
Affected services: Internal AD DNS (ad.fau.edu and irm.ad.fau.edu)
Expected End-user impact: Computers joined to the IRM or FAU domain may lose their DNS record if they have been unable to update it. This should self resolve in 24 hours or less or can be resolved manually.
*************************************************************************************
BHRIC VMware Horizon Upgrade to 7.12
Description of change: OIT will upgrade the BHRIC VMware Horizon to 7.12
Downtime window start: 7/9/2020 12:05 AM
Downtime window end: 7/9/2020 5:05 AM
Affected services: https://vhealth.fau.edu, https://vhealthon.fau.edu, horizon admin, vmware composer
Expected End-user impact: During this time, end users of the BHRIC VMware infrastructure will not be able to login to VMware services.
*************************************************************************************
BHRIC MySQL Server Storage Adjustment
Description of change: OIT will move the MySQL storage to an alternative storage partition to protect against back file growth and add certificates for mysql with tls.
Downtime window start: 7/9/2020 3:00 AM
Downtime window end: 7/9/2020 3:15 AM
Affected services: SaraAlert and Redcap
Expected End-user impact: During this time, SaraAlert and Redcap will be offline for 5 – 10 minutes while the data is moved.
*************************************************************************************
Web Services Load Balancer Maintenance
Description of change: OIT is performing an upgrade on load balancers that manage many of FAU’s major web services.
Downtime window start: 7/9/2020 3:00 AM
Downtime window end: 7/9/2020 7:00 AM
Affected services: All services served by virtual servers hosted by the BigIP load balancers. These include but may not be limited to: owlapp, sso, papercut, sas, myfau, banner, talisma, oud, www, filelocker, ds/ldap, dmz entry point for various coldfusion/grails/tomcat applications, tms, sctforms, etc.
Services that have cloud or NW presence will be failed over accordingly to lessen impact. E.g. www, oud, sso, myfau
Expected End-user impact: Users connecting to websites served by the BigIP load balancers may experience their sessions being disconnected intermittently as we proceed through the upgrade. Sites should not be down for extended periods of time as the units are being upgraded incrementally and there should be at least one unit providing services throughout the maintenance period.
*************************************************************************************
Global Web Services Load Balancer maintenance
Description of change: OIT is upgrading the Global Services Load Balancer with two newer ones. The Global Services Load Balancer (formerly Global Traffic Managers) are responsible for providing resiliency for major web sites/services that FAU provide. This change plan will account for the first step of adding the two new ones into the pool. A later change plan will be written to remove the two older ones.
Downtime window start: 7/9/2020 5:00 AM
Downtime window end: 7/9/2020 6:00 AM
Affected services: Web services/sites that are being managed by the BigIP DNS appliances (formerly GTM). These include many public FAU websites such as www.fau.edu, and departmental subdomains. May also include major services such as SSO, OUD, ADFS, wordpress.
Expected End-user impact: Durin this time, no end-user impact is expected. The new units have been configured to mirror what the old units serve up and their addition to the mix should be non-intrusive.
*************************************************************************************
OIT Systems Maintenance, Thurs. July 2 from 3:00AM to 7:00AM
Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 07/02/2020 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:
*************************************************************************************
Update account sync to Azure
Description of change: OIT will modify the attributes synced from on-prem directories to Azure
Downtime window start: 7/2/2020 6:00 AM
Downtime window end: 7/2/2020 6:15 AM
Affected services: Office 365 and Azure login
Expected End-user impact: During this time, no end-user impact is expected
*************************************************************************************
Posted in Systems
[RESOLVED] TouchNet Systems Maintenance, Friday, June 26th from 3:00AM to 7:00AM
The TouchNet payment processing system will be undergoing maintenance -Starting from 3:00am to 7:00am (EST) Friday, 6/26/2020. This affects student payment services (Bill+Payment), as well as all Marketplace Stores, uPay sites and TouchNet ready partner payment services. We expect all systems to be back online no later than 7:00 am (EST) that morning. When the system is back up and ready to go, we will notify you. You may wish to place warnings on your website, or take your store offline. If this scheduled downtime creates a conflict for your operations, please feel free to contact us at FIS@fau.edu for further discussion. Expected End-user impact: During this time all student payment services (Bill+Payment), as well as all Marketplace Stores, uPay sites and TouchNet ready partner payment services will be unavailable during this maintenance cycle.
Posted in Banner and Admin Systems, Workday
Computing Cluster nodes down
Several compute nodes have failed and we are investigating the cause and looking for a fix.
OIT Systems Maintenance – Thurs. June 18 from 3:00 AM to 7:00 AM
Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 06/18/2020 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:
*************************************************************************************
Single Sign-on Maintenance
Description of change: OIT will be moving production SSO Metadata server from the Boca Raton data center to Microsoft Azure.
Downtime window start: 6/18/2020 6:00 AM
Downtime window end: 6/18/2020 7:00 AM
Affected services: SSO Metadata site. Service providers will not be able to be added or modified during the switchover.
Expected End-user impact: During this time, there should be no end user impact.
*************************************************************************************
Server Maintenance
Description of change: OIT will be moving Mediasite servers to a different domain. Mediasite will be unavailable during this time.
Downtime window start: 6/18/2020 4:00 AM
Downtime window end: 6/18/2020 6:00 AM
Affected services: MediaSite
Expected End-user impact: During this time, MediaSite will be unavailable.
*************************************************************************************
Database Maintenance
Description of change: OIT will apply April 2020 Oracle patchset updates to all production databases
Downtime window start: 6/18/2020 3:00 AM
Downtime window end: 6/18/2020 7:00 AM
Affected Services:
Banner production
– Admin Pages (Forms)
– Application Navigator
– Banner Access Manager
– Banner self-service
– Touchnet – Payments/Deposits
– Workflow
– uAchieve – DARS
– FLVS
– Transcripts
Appworx
Harvest
ODS
FAUDW Warehouse
– DWPROD: OwlDone
– DWPROD: FinancialAid Attendance Survey
IEAP Warehouse
WebFOCUS/ReportCaster
OIM
– Account claiming
– Password resets
MSOP Instance
– ACH or VPAS
– Mandatory Course Entry Quiz
– accounts.fau.edu – Accounts Self Service
– Canvas Electronic Grading “Banner Grade Submissions” in Canvas
– Wireless network authentication for guests.
– 4P Configuration, Admissions Status, Znumber page, ssoauth.fau.edu/*, egrades.fau.edu/* (except egrades itself)
– Group Management – grouper.fau.edu
– Phonebill application pre latest system.
– Password expiration
– network registration, talon.fau.edu/netreg, talon.fau.edu/networkregistrationadmin, DHCP Logger
– Frevvo – University forms
– Undergraduate Admissions
– Graduate Admissions
– Residency Project
– OwlDone
Expected End-user impact: During this time, the listed services will be temporarily offline while the patches are applied. Some applications may need to be restarted after the maintenance is complete.
*************************************************************************************
Website Maintenance
Description of change: OIT will be moving several websites to a new web server.
Downtime window start: 6/18/2020 3:00 AM
Downtime window end: 6/18/2020 4:00 AM
Affected services:
– andi.fau.edu
– home.fau.edu
– student.fau.edu
Expected End-user impact: During this time, the websites listed will experience 5-10 minutes of downtime.
*************************************************************************************
REDCap Database Upgrade
Description of change: OIT will be updating the REDCap database server
Downtime window start: 6/18/2020 3:00 AM
Downtime window end: 6/18/2020 4:00 AM
Affected services: REDCap
Expected End-user impact: During this time, REDCap will be offline for 10 – 15 minutes while we sync the database between the old and new servers.
*************************************************************************************
REDCap Application Upgrade
Description of change: OIT will be updating the REDCap application
Downtime window start: 6/18/2020 4:00 AM
Downtime window end: 6/18/2020 5:00 AM
Affected services: Update REDCap application
Expected End-user impact: During this time, no end-user impact is expected.
*************************************************************************************
OnBase Maintenance
Description of change: OIT will be adding new document types and functionality to production OnBase. This update will take place over two days.
Downtime window start: 6/18/2020 3:00 AM – 7:00 AM
Downtime window end: 6/19/2020 3:00 AM – 7:00 AM
Affected services: OnBase desktop and web client
Expected End-user impact: During this time, OnBase will not be accessible. We will be doing this during off hours to minimize end-user impact.
*************************************************************************************
[RESOLVED] Workday Monthly Maintenance – June 12-13, 2020
Beginning at June 12, 2020, 11:00 PM Pacific time (June 13, 2020, 2:00 AM Eastern time), Workday Production tenants will be unavailable for a period of 8 hours until June 13, 2020, 7:00 AM Pacific time (June 13, 2020, 10:00 AM Eastern time).
In addition, the Implementation, Sandbox, and Sandbox preview tenants will be unavailable for 12 hours beginning on June 12, 2020, 6:00 PM Pacific time (June 12, 2020, 9:00 PM Eastern time), until June 13, 2020, 6:00 AM Pacific time (June 13, 2020, 9:00 AM Eastern time).
Posted in Workday
[RESOLVED] Help Desk Ticketing System Unavailable
** UPDATE**
The help desk ticketing system is back online.
***********************************************
The help desk ticketing system is currently unavailable. We are working with the vendor to resolve the issue as soon as possible.
OIT
Owl Done and possibly other FAU services unavailable
At this time we have identified that Owl Done is unavailable. We are currently investigating the cause and will update the status as we learn more. Other FAU services may also be affected.
We apologize for any inconvenience.
OIT
OIT Systems Maintenance, Thurs. June 11 from 1:00AM to 7:00AM
Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 06/11/2020 from 1:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:
*************************************************************************************
BANNER XE DB Upgrade 9.18.0 release and co-requisite releases
Description of change: OIT Production Support will upgrading Banner XE database and modules to a new version.
Downtime window start 6/11/2020 1:00 AM
Downtime window end 6/11/2020 7:00 AM
Affected services: Banner XE System, Self-Service
Expected End-user impact: During this time, the Banner system and Banner services, such as Self-Service will be unavailable the installation of the code.
*************************************************************************************
Posted in Banner and Admin Systems