[RESOLVED] OnBase production unavailable

** Update **

The OnBase production issue has been resolved, users are now able to log in.


We are currently investigating an issue preventing users from logging in to the OnBase production environment.  More information will be reported as it becomes available.

Posted in Systems

OnBase production unavailable

We are currently investigating an issue preventing users from logging in to the OnBase production environment.  More information will be reported as it becomes available.

Posted in Systems

OIT Systems Maintenance, Thurs. July 23 from 3:00AM to 7:00AM

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 07/23/2020 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:

*************************************************************************************
Server Maintenance
Description of change: OIT will be changing the domain a few servers are joined to.
Downtime window start: 7/23/2020 3:00 AM
Downtime window end: 7/23/2020 5:00 AM
Affected services: SMB/SFTP file sharing on Andisec, Speech server for the FAU main phone line
Expected End-user impact: During this time, file sharing on Andisec and the automated operator for the FAU main phone line will be unavailable.

*************************************************************************************
Server configuration change
Description of change: ​OIT will be changing a parameter on it’s storage system to make inter-system communication more secure
Downtime window start: 7/23/2020 6:00 AM
Downtime window end: 7/23/2020 6:05 AM
Affected services: ​All Services
Expected End-user impact: During this time, no end-user impact is expected

*************************************************************************************
Run SHATAEQ Deletion scripts in Production
Description of change: OIT will run the scripts necessary delete the workspace records requested by the Undergraduate Admissions department
Downtime window start: 7/23/2020 3:00 AM
Downtime window end: 7/23/2020 3:20 AM
Affected services: ​​Three Banner tables will have some workspace records deleted resulting in minimal delays in access time.
Expected End-user impact: During this time, no end-user impact is expected

*************************************************************************************

Posted in Banner and Admin Systems, Systems

OIT Systems Maintenance, Thurs. July 16 from 3:00AM to 7:00AM

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 07/16/2020 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:

*************************************************************************************

Server Maintenance
Description of change: OIT will be changing the domain a few servers are joined to.
Downtime window start: 7/16/2020 5:00 AM
Downtime window end: 7/16/2020 6:00 AM
Affected services: Crestron Fusion, Wowza Streaming Engine
Expected End-user impact: During this time, services hosted by the listed servers will be unavailable.

*************************************************************************************

Posted in Systems

Research Computing Equipment

Good afternoon, due to a cooling failure the Research Computing Clusters (koko-login.fau.edu) have been shutdown. They will return to service once we get the OK from Facilities.

Posted in Educational Technologies, Network and Telecom, Uncategorized

Networking Issues

The Office of Information Technology is investigating networking issues affecting numerous services. More information will be reported as it becomes available.

Posted in Banner and Admin Systems, Canvas / LMS, Educational Technologies, Email, Instructional Technologies, Lecture Capture, Network and Telecom, Systems, Uncategorized, Video Conferencing, Workday

OIT Systems Maintenance, Thurs. July 9 from 3:00AM to 7:00AM

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 07/09/2020 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:

*************************************************************************************
Backup server upgrade
Description of change: OIT will upgrade on-prem crashplan backup server.
Downtime window start: 7/9/2020 5:00 AM
Downtime window end: 7/9/2020 6:00 AM
Affected services: Crashplan​
Expected End-user impact: During this time, Crashplan backups will not work. Backups will resume once the upgrade is completed.

*************************************************************************************
Server Maintenance
Description of change: OIT will be enabling a feature to continually clean up old hostnames from DNS.
Downtime window start: 7/9/2020 5:00 AM
Downtime window end: 7/9/2020 5:00 AM
Affected services: Internal AD DNS (ad.fau.edu and irm.ad.fau.edu)
Expected End-user impact: Computers joined to the IRM or FAU domain may lose their DNS record if they have been unable to update it. This should self resolve in 24 hours or less or can be resolved manually.

*************************************************************************************
BHRIC VMware Horizon Upgrade to 7.12
Description of change: OIT will upgrade the BHRIC VMware Horizon to 7.12
Downtime window start: 7/9/2020 12:05 AM
Downtime window end: 7/9/2020 5:05 AM
Affected services: https://vhealth.fau.edu, https://vhealthon.fau.edu, horizon admin, vmware composer
Expected End-user impact: During this time, end users of the BHRIC VMware infrastructure will not be able to login to VMware services.

*************************************************************************************
BHRIC MySQL Server Storage Adjustment
Description of change: OIT will move the MySQL storage to an alternative storage partition to protect against back file growth and add certificates for mysql with tls.
Downtime window start: 7/9/2020 3:00 AM
Downtime window end: 7/9/2020 3:15 AM
Affected services: SaraAlert and Redcap​
Expected End-user impact: During this time, SaraAlert and Redcap will be offline for 5 – 10 minutes while the data is moved.

*************************************************************************************

Web Services Load Balancer Maintenance
Description of change: OIT is performing an upgrade on load balancers that manage many of FAU’s major web services.​
Downtime window start: 7/9/2020 3:00 AM
Downtime window end: 7/9/2020 7:00 AM
Affected services: All services served by virtual servers hosted by the BigIP load balancers. These include but may not be limited to: owlapp, sso, papercut, sas, myfau, banner, talisma, oud, www, filelocker, ds/ldap, dmz entry point for various coldfusion/grails/tomcat applications, tms, sctforms, etc.​
Services that have cloud or NW presence will be failed over accordingly to lessen impact. E.g. www, oud, sso, myfau
Expected End-user impact: Users connecting to websites served by the BigIP load balancers may experience their sessions being disconnected intermittently as we proceed through the upgrade. Sites should not be down for extended periods of time as the units are being upgraded incrementally and there should be at least one unit providing services throughout the maintenance period.​

*************************************************************************************

Global Web Services Load Balancer maintenance
Description of change: OIT is upgrading the Global Services Load Balancer with two newer ones. The Global Services Load Balancer (formerly Global Traffic Managers) are responsible for providing resiliency for major web sites/services that FAU provide. This change plan will account for the first step of adding the two new ones into the pool. A later change plan will be written to remove the two older ones.
Downtime window start: 7/9/2020 5:00 AM
Downtime window end: 7/9/2020 6:00 AM
Affected services: Web services/sites that are being managed by the BigIP DNS appliances (formerly GTM). These include many public FAU websites such as www.fau.edu, and departmental subdomains. May also include major services such as SSO, OUD, ADFS, wordpress.​
Expected End-user impact: Durin this time, no end-user impact is expected. The new units have been configured to mirror what the old units serve up and their addition to the mix should be non-intrusive.

*************************************************************************************

Posted in Email, Systems, Workday

OIT Systems Maintenance, Thurs. July 2 from 3:00AM to 7:00AM

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 07/02/2020 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:

*************************************************************************************
Update account sync to Azure
Description of change: OIT will modify the attributes synced from on-prem directories to Azure
Downtime window start: 7/2/2020 6:00 AM
Downtime window end: 7/2/2020 6:15 AM
Affected services: Office 365 and Azure login
Expected End-user impact: During this time, no end-user impact is expected

*************************************************************************************

Posted in Systems

[RESOLVED] TouchNet Systems Maintenance, Friday, June 26th from 3:00AM to 7:00AM

The TouchNet payment processing system will be undergoing maintenance -Starting from 3:00am to 7:00am (EST) Friday, 6/26/2020. This affects student payment services (Bill+Payment), as well as all Marketplace Stores, uPay sites and TouchNet ready partner payment services. We expect all systems to be back online no later than 7:00 am (EST) that morning. When the system is back up and ready to go, we will notify you. You may wish to place warnings on your website, or take your store offline. If this scheduled downtime creates a conflict for your operations, please feel free to contact us at FIS@fau.edu for further discussion. Expected End-user impact: During this time all student payment services (Bill+Payment), as well as all Marketplace Stores, uPay sites and TouchNet ready partner payment services will be unavailable during this maintenance cycle.

Posted in Banner and Admin Systems, Workday

Computing Cluster nodes down

Several compute nodes have failed and we are investigating the cause and looking for a fix.

Posted in Educational Technologies, Network and Telecom, Uncategorized