The Biomedical Health Research Informatics Core experienced an error that prevented virtual desktops being rebooted, started, or migrated. The error occurred between 7:00 – 7:50 am August 22 and appears to have been resolved. For more information please contact the Research Computing team.
[Resolved] BHRIC Virtual Desktop Infrastructure downtime
Owl Apps login issue: Google Services “Something went wrong”
Google status shows the following:
2:50 PM
Description:
We are investigating a potential issue with signing into Google services.
We will provide more information by Monday, 2019-08-19 12:45 US/Pacific.
How to diagnose:
Users may have issues signing into Google services. They may receive the error “Something went wrong. Sorry, something went wrong there. Try again.”
Workaround:
There’s no workaround available at this time, but we’ll let you know if we learn of one.
[RESOLVED] MYFAU Login having problems
The MYFAU login issue has now been resolved.
[RESOLVED] MYFAU Login having problems
The MYFAU login issue is now resolved.
—–
The MYFAU login is currently not working. We are looking into the issue and will supply an update when available.
OIT Systems Maintenance, Thurs. July 18 from 3:00AM to 7:00AM
Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 07/18/2019 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:
******************************************************************************************************************
Mail Server Configuration Change
Description of change: OIT will be making a change to how email recipients are validated.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 3:00 AM
Affected services: Inbound email, smtp.fau.edu
Affected systems: boc22fortimail01.fau.edu, nwfortimail01.fau.edu
Expected End-user impact: none
Chessboard Certificate Update
Description of change: Update the SSL certificate on chessboard the User Services management tool.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: Password reset tools for user services
Affected systems: chessboard.fau.edu
Expected End-user impact: none
GitLab Certificate Update and Config Changes
Description of change: OIT will be migrating the mail servers that handle smtp.fau.edu to new servers.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: gitlab
Affected systems: gitlab.hpc.fau.edu
Expected End-user impact: Gitlab will be turned off an back on again. Users who have used the scheduler may see their jobs run 45 minutes earlier than expected. We are also changing the default time zone from UTC to America/New_York, this affects times displayed in gitlab UI.
BHRIC certificate updates
Description of change: All SSL certificates used on the BHRIC including, Redcap, VMware, and others will be updated to a new Digicert or LetsEncrypt certificate.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: BHRIC, VMware Horizon, Redcap, VMware Virtual Center
Affected systems: redcap1.fau.edu (letsencrypt), redcap2.fau.edu (letsencrypt), redcapstore.fau.edu (letsencrypt), vhealth.fau.edu (digicert), vhealthon.fau.edu (digicert), boc22-h-hv1.health.ad.fau.edu (digicert), boc22-h-vc1.health.ad.fau.edu (digicert)
Expected End-user impact: Users will need to reconnect to their services when they return to their desks should they be connected to VDI over the evening.
BHRIC Servers upgrade from Windows 2012R2 to Windows 2019
Description of change: We have series of Windows servers on BOCA RATON and JUPITER cloud platforms running Windows 2012 R2. These servers will be upgraded to Windows 2019. Several servers are upgraded successfully. We would like to continue upgrading all servers in 3/4 servers per batch over next few months.
Downtime window start 7/11/2019 3:00 AM
Downtime window end 7/11/2019 6:00 AM
Affected services: Various services on following servers in health domain: boc22-s-adc1, Boc22-s-ps.med, research-mssqlX, boc22-s-sql
Affected systems: boc22-s-adc1, Boc22-s-ps.med, research-mssqlX, boc22-s-sql
Expected End-user impact: NONE is expected
Touchet Maintenance
Description of change: Migrate Touchnet Payment Transaction web service from Oracle Application Server to Tomcat in order to support Oracle database 12c.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: Touchnet
Affected systems: ctcache1, sctcache2, boc22banxe03, boc22banxe04
Expected End-user impact: Touchnet will be unavailable.
Banner Database Maintenance
Description of change: The production Banner database will be upgraded from Oracle 11gR2 to 12cR2.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: Banner production database and any applications that depend on it. Appworx, Harvest, Workflow, Banner Admin Pages, Banner self-service, Touchnet
Affected systems: bannerprd
Expected End-user impact: Affected services will be down during the time of the maintenance.
Secure file server data migration
Description of change: OIT will be moving the data internally on a secure file server
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: all shares on andisec
Affected systems: andisec
Expected End-user impact: all shares on andisec will be unavailable during the window
Mail Server Upgrade
Description of change: OIT will be replacing current mail gateways with new appliances.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 4:00 AM
Affected services: Inbound mail processing for FAU (Office 365 and Gmail)
Affected systems: New Units:boc22fortimail01.fau.edu, nwfortimail01.fau.edu Old Units: bertx.fau.edu, berty.fau.edu, boc22esa01.fau.edu, nwesa01.fau.edu
Expected End-user impact: Ideally none, however there may be some unintended impact if a configuration is missing/incorrect.
BHRIC Servers upgrade from Windows 2012R2 to Windows 2019
Description of change: We have series of Windows servers on BOCA RATON and JUPITER cloud platforms running Windows 2012 R2. These servers will be upgraded to Windows 2019. Several servers are upgraded successfully. We would like to continue upgrading all servers in 3/4 servers per batch over next few months.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: Various services on following servers in health domain: boc22-s-adc1, Boc22-s-ps.med, research-mssqlX, boc22-s-sql
Affected systems: boc22-s-adc1, Boc22-s-ps.med, research-mssqlX, boc22-s-sql
Expected End-user impact: NONE is expected
Account Self Service Updates
Description of change: Installing patches and updates to backend services. Adding support for Workday Report to Active Directory Group synchronization.
Downtime window start 7/18/2019 5:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: Accounts Self Service – https://accounts.fau.edu, user manager
Affected systems: um.fau.edu
Expected End-user impact: none, requires a rolling restart of services but should not cause any disruption in services.
Updates to HIPAA Onboarding
Description of change: We are making adjustments to correct an issue related to the on boarding process of HIPAA employees. These changes should not effect existing HIPAA users.
Downtime window start 7/18/2019 5:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: Database
Affected systems: OIM
Expected End-user impact: This change should correct issues related to passwords synchorzing to newly created HIPAA AD Accounts.
Server Maintenance
Description of change: We will be changing the current www.fau.edu webservers with new webservers that are able to do shibboleth.
Downtime window start 7/18/2019 6:00 AM
Downtime window end 7/18/2019 7:00 AM
Affected services: www.fau.edu website
Affected systems: www.fau.edu webservers
Expected End-user impact: No end user impact expted as these webservers are behind bigip.
AutoAdvisor Maintenance
Description of change: Bug fix to the AutoAdvisor integration that exports to StarFish to include a new population for the General Advisor role.
Downtime window start 7/18/2019 6:45 AM
Downtime window end 7/18/2019 7:00 AM
Affected services: None
Affected systems: AutoAdvisor
Expected End-user impact: None
OIT Systems Maintenance, Thurs. July 10 from 3:00AM to 7:00AM
Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 07/10/2019 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:
*****************************************************************************************
Server maintenance
Description of change: Certificates for various secure web sites managed by OIT are being renewed
Downtime window start 7/11/2019 3:00 AM
Downtime window end 7/19/2019 7:00 AM
Affected services: Almost all services that rely on our wildcard certificate.
Affected systems: bigip and any other system using the wildcard fau certificate
Expected End-user impact: varies. some to none depending on the sensitivity of the service on accepting a new certificate.
********************************************************************************************
Secure file server data migration
Description of change: OIT will be moving the data internally on a secure file server
Downtime window start 7/11/2019 3:00 AM
Downtime window end 7/11/2019 6:00 AM
Affected services: all shares on andisec
Affected systems: andisec
Expected End-user impact: all shares on andisec will be unavailable during the window
*****************************************************************************************
Mail Server Upgrade
Description of change: OIT will be migrating the mail servers that handle smtp.fau.edu to new servers.
Downtime window start 7/11/2019 3:00 AM
Downtime window end 7/11/2019 4:00 AM
Affected services: Mail relay for smtp.fau.edu
Affected systems: boc22esa02.fau.edu, nwesa02.fau.edu
Expected End-user impact: Ideally none, however depending on how dns is cached for each client and how the smtp server settings were configured you may see bouncebacks/failed to connect messages when dns is updated.
********************************************************************************************
Windows configuration and deployment system upgrade
Description of change: The system providing configuration, deployment and updates to Windows clients will be upgraded to the latest version
Downtime window start 7/11/2019 3:00 AM
Downtime window end 7/11/2019 7:00 AM
Affected services: OS deployments, app installs, windows updates from SCCM
Affected systems: boc22sccm
Expected End-user impact: All OS deployments, app installs, windows updates from sccm will be unavailable during the window
**********************************************************************************************
BHRIC Servers upgrade from Windows 2012R2 to Windows 2019
Description of change: We have series of Windows servers on BOCA RATON and JUPITER cloud platforms running Windows 2012 R2. These servers will be upgraded to Windows 2019. Several servers are upgraded successfully. We would like to continue upgrading all servers in 3/4 servers per batch over next few months.
Downtime window start 7/11/2019 3:00 AM
Downtime window end 7/11/2019 6:00 AM
Affected services: Various services on following servers in health domain: boc22-s-adc1, Boc22-s-ps.med, research-mssqlX, boc22-s-sql
Affected systems: boc22-s-adc1, Boc22-s-ps.med, research-mssqlX, boc22-s-sql
Expected End-user impact: NONE is expected
**********************************************************************************************
Banner Self-Service Maintenance
Description of change: Change to fix flaws associated with Banner Registration (Version 9.12) that causes inaccurate information to be displayed to the students. This fix includes updates to the Registration search feature to fix defects on what courses are rendered and fix inaccurate descriptions/sorting of other data points.
Downtime window start 7/11/2019 4:00 AM
Downtime window end 7/11/2019 6:00 AM
Affected services: Banner Self-Service
Affected systems: Banner XE
Expected End-user impact: There are no impact on user services expected
**************************************************************************************
Updates Accounts Self Service
Description of change: Upgrading and patching account self service website.
Downtime window start 7/11/2019 5:00 AM
Downtime window end 7/11/2019 6:00 AM
Affected services: accounts.fau.edu
Affected systems: boc22oimwebp1, boc22oimwebp2, nwrdcoimwebp1, nwrdcoimwebp2
Expected End-user impact: Users may see a delay in password resets during the time the systems are being patched and rolled out.
*************************************************************************************
Server Maintenance
Description of change: We will be changing two northwest www.fau.edu webservers with new ones that are able to do shibboleth.
Downtime window start 7/11/2019 6:00 AM
Downtime window end 7/11/2019 7:00 AM
Affected services: None as these are the northwest www.fau.edu webservers and are also behind BigIP
Affected systems: Northwest www.fau.edu webservers
Expected End-user impact: No end user impact expected
OIT Systems Maintenance, Thurs. June 6 from 3:00AM to 7:00AM
Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 06/06/2019 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:
*************************************************************************************
BHRIC Servers upgrade from Windows 2012R2 to Windows 2019
Description of change: OIT will be upgrading a series of Windows servers on BOCA RATON and JUPITER cloud platforms running Windows 2012 R2. These servers will be upgraded to Windows 2019. This is the 2nd batch of upgrades.
Downtime window start: 3:00 AM
Downtime window end: 6:00 AM
Affected services: Various services on following servers in health domain
Affected systems: Various health servers
Expected End-user impact: During this time, no end-user impact is expected
*************************************************************************************
Server Maintenance
Description of change: OIT will be changing the network address for a server.
Downtime window start: 5:00 AM
Downtime window end: 6:00 AM
Affected services: VIP file shares
Affected systems: VIP server
Expected End-user impact: During this time, end users will not be able to connect to the VIP file share.
*************************************************************************************
Oracle Server Maintenance
Description of change: OIT will be applying the Oracle Upgrade 12cR2 to IEAP production database
Downtime window start: 3:00 AM
Downtime window end: 6:00 AM
Affected services: IEAP production environment. Webfocus won’t be able to connect to the IEAP database.
Affected systems: odsprod
Expected End-user impact: Services that listed above will be unavailable at times during the maintenance window.
*************************************************************************************
Resolved: Frevvo offline
The University forms server (Frevvo) maintenance is running long and is currently offline. We will update this message once an hour with updates.
This issue has been resolved as of 8:05 am.
OIT Systems Maintenance, Thurs. May 23 from 3:00AM to 7:00AMm
Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 05/23/2019 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:
*************************************************************************************
Storage Maintenance
Description of change: OIT will be moving backend NetApp storage to two new switches
Downtime window start: 2:00 AM
Downtime window end: 7:00 AM
Affected services: ALL SERVICES WILL BE UNAVAILABLE except the following:
DNS
LDAP
DHCP
Single Sign On
Active Directory
Main FAU web page
Expected End-user impact: During this time, most services except the ones mentioned above will be unavailable for a few hours.
*************************************************************************************
Single Sign On Maintenance for Testing Center
Description of change: OIT is updating the single sign on (SSO) system to improve the user experience in the testing center.
Downtime window start: 3:00 AM
Downtime window end: 6:00 AM
Affected services: Single Sign On and all dependent services
Affected systems: Shibboleth
Expected End-user impact: During this time, no end-user impact is expected. After the change, single-sign on will not prompt for 2Factor when users access Canvas from the testing center.
*************************************************************************************
uAchieve Maintenance
Description of change: Updating student queries file in uAchieve production.
Downtime window start: 6:00 AM
Downtime window end: 6:30 AM
Affected services: uAchieve production
Affected systems: uAchieve server
Expected End-user impact: During this time, the uAchieve degree auditing/planning system will be unavailable.
*************************************************************************************
Banner Maintenance
Description of change: OIT will make changes to reduce the complexity of UDCID generation in Banner by removing Banner Enterprise Identity Services and replacing with database triggers.
Downtime window start: 5:00 AM
Downtime window end: 6:00 AM
Affected services: No downtime for any services
Affected systems: No downtime for any systems
Expected End-user impact: During this time, no end-user impact is expected.
*************************************************************************************
Storage Switch Replacement – Thurs. May 23 from 2:00AM – 6:00AM
OIT will be doing a much needed storage switch replacement during our regular maintenance window on Thursday, May 23 from 2:00AM to 6:00AM. The maintenance will be disruptive in nature and will affect most, if not all, servers (physical/virtual) and services that OIT manages.
Critical services such as DNS, DHCP, SSO, AD as well as cloud based services such as TeamDynamix, Workday and Canvas will be online. OIT will update this post when maintenance is complete or should any issues arise during this time.
We apologize for any inconvenience this may cause.
OIT