[Resolved] Banner Self-Service Emergency Maintenance – Thursday, July 18th between 11:30am-Noon

Banner Self-Service will be undergoing emergency maintenance today between 11:30-Noon that requires services to be restarted.  Services will return to normal by Noon time.

Posted in Banner and Admin Systems

OIT Systems Maintenance, Thurs. July 18 from 3:00AM to 7:00AM

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 07/18/2019 from 3:00 AM to 7:00 AM during OIT maintenance window.  In addition, the following systems will be specifically impacted:

******************************************************************************************************************

Mail Server Configuration Change
Description of change: OIT will be making a change to how email recipients are validated.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 3:00 AM
Affected services: Inbound email, smtp.fau.edu
Affected systems: boc22fortimail01.fau.edu, nwfortimail01.fau.edu
Expected End-user impact: none

Chessboard Certificate Update
Description of change: Update the SSL certificate on chessboard the User Services management tool. ​
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: Password reset tools for user services
Affected systems: chessboard.fau.edu
Expected End-user impact: none

GitLab Certificate Update and Config Changes
Description of change: OIT will be migrating the mail servers that handle smtp.fau.edu to new servers.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: gitlab​
Affected systems: gitlab.hpc.fau.edu
Expected End-user impact: Gitlab will be turned off an back on again. ​Users who have used the scheduler may see their jobs run 45 minutes earlier than expected. We are also changing the default time zone from UTC to America/New_York, this affects times displayed in gitlab UI.​

BHRIC certificate updates
Description of change: All SSL certificates used on the BHRIC including, Redcap, VMware, and others will be updated to a new Digicert or LetsEncrypt certificate.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: BHRIC, VMware Horizon​, Redcap, VMware Virtual Center
​Affected systems: redcap1.fau.edu (letsencrypt), redcap2.fau.edu (letsencrypt), redcapstore.fau.edu (letsencrypt), vhealth.fau.edu (digicert), vhealthon.fau.edu (digicert), boc22-h-hv1.health.ad.fau.edu (digicert), boc22-h-vc1.health.ad.fau.edu (digicert)
Expected End-user impact: Users will need to reconnect to their services when they return to their desks should they be connected to VDI over the evening.

BHRIC Servers upgrade from Windows 2012R2 to Windows 2019
Description of change: We have series of Windows servers on BOCA RATON and JUPITER cloud platforms running Windows 2012 R2. These servers will be upgraded to Windows 2019​. Several servers are upgraded successfully. We would like to continue upgrading all servers in 3/4 servers per batch over next few months. ​​
Downtime window start 7/11/2019 3:00 AM
Downtime window end 7/11/2019 6:00 AM
Affected services: Various services on following servers in health domain: boc22-s-adc1, Boc22-s-ps.med, research-mssqlX, boc22-s-sql
Affected systems: boc22-s-adc1, Boc22-s-ps.med, research-mssqlX, boc22-s-sql
Expected End-user impact: NONE is expected​​​

Touchet Maintenance
Description of change: Migrate Touchnet Payment Transaction web service from Oracle Application Server to Tomcat in order to support Oracle database 12c.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: Touchnet
Affected systems: ctcache1, sctcache2, boc22banxe03, boc22banxe04
Expected End-user impact: Touchnet will be unavailable.

Banner Database Maintenance
Description of change: The production Banner database will be upgraded from Oracle 11gR2 to 12cR2.​
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: Banner production database and any applications that depend on it. Appworx, Harvest, Workflow, Banner Admin Pages, Banner self-service, Touchnet
Affected systems: bannerprd
Expected End-user impact: Affected services will be down during the time of the maintenance.

Secure file server data migration
Description of change: OIT will be moving the data internally on a ​secure file server
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: all shares on andisec
Affected systems: andisec
Expected End-user impact: all shares on andisec will be unavailable during the window

Mail Server Upgrade
Description of change: OIT will be replacing current mail gateways with new appliances.
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 4:00 AM
Affected services: Inbound mail processing for FAU (Office 365 and Gmail)
Affected systems: New Units:boc22fortimail01.fau.edu, nwfortimail01.fau.edu Old Units: bertx.fau.edu, berty.fau.edu, boc22esa01.fau.edu, nwesa01.fau.edu
Expected End-user impact: Ideally none, however there may be some unintended impact if a configuration is missing/incorrect.

BHRIC Servers upgrade from Windows 2012R2 to Windows 2019
Description of change: We have series of Windows servers on BOCA RATON and JUPITER cloud platforms running Windows 2012 R2. These servers will be upgraded to Windows 2019​. Several servers are upgraded successfully. We would like to continue upgrading all servers in 3/4 servers per batch over next few months. ​​
Downtime window start 7/18/2019 3:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: Various services on following servers in health domain: boc22-s-adc1, Boc22-s-ps.med, research-mssqlX, boc22-s-sql
Affected systems: boc22-s-adc1, Boc22-s-ps.med, research-mssqlX, boc22-s-sql
Expected End-user impact: NONE is expected​​​

Account Self Service Updates
Description of change: Installing patches and updates to backend services. Adding support for Workday Report to Active Directory Group synchronization​.
Downtime window start 7/18/2019 5:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: Accounts Self Service – https://accounts.fau.edu, user manager
Affected systems: um.fau.edu
Expected End-user impact: none, requires a rolling restart of services but should not cause any disruption in services.

Updates to HIPAA Onboarding
Description of change: We are making adjustments to correct an issue related to the on boarding process of HIPAA employees. These changes should not effect existing HIPAA users.
Downtime window start 7/18/2019 5:00 AM
Downtime window end 7/18/2019 6:00 AM
Affected services: ​Database
Affected systems: OIM
Expected End-user impact: This change should correct issues related to passwords synchorzing to newly created HIPAA AD Accounts.

Server Maintenance
Description of change: We will be changing the current www.fau.edu webservers with new webservers that are able to do shibboleth.​
Downtime window start 7/18/2019 6:00 AM
Downtime window end 7/18/2019 7:00 AM
Affected services: www.fau.edu website
Affected systems: www.fau.edu webservers​
Expected End-user impact: No end user impact expted as these webservers are behind bigip.

AutoAdvisor Maintenance
Description of change: Bug fix to the AutoAdvisor integration that exports to StarFish to include a new population for the General Advisor role.​
Downtime window start 7/18/2019 6:45 AM
Downtime window end 7/18/2019 7:00 AM
Affected services: None
Affected systems: ​AutoAdvisor
Expected End-user impact: ​None​

Posted in Banner and Admin Systems, Educational Technologies, Email, Network and Telecom, Systems, Uncategorized

OIT Systems Maintenance, Thurs. July 10 from 3:00AM to 7:00AM

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 07/10/2019 from 3:00 AM to 7:00 AM during OIT maintenance window.  In addition, the following systems will be specifically impacted:

*****************************************************************************************

Server maintenance
Description of change: Certificates for various secure web sites managed by OIT are being renewed
Downtime window start 7/11/2019 3:00 AM
Downtime window end 7/19/2019 7:00 AM
Affected services: Almost all services that rely on our wildcard certificate.
Affected systems: bigip and any other system using the wildcard fau certificate​
Expected End-user impact: varies. some to none depending on the sensitivity of the service on accepting a new certificate.

********************************************************************************************
Secure file server data migration
Description of change: OIT will be moving the data internally on a ​secure file server
Downtime window start 7/11/2019 3:00 AM
Downtime window end 7/11/2019 6:00 AM
Affected services: all shares on andisec
Affected systems: andisec
Expected End-user impact: all shares on andisec will be unavailable during the window

*****************************************************************************************
Mail Server Upgrade
Description of change: OIT will be migrating the mail servers that handle smtp.fau.edu to new servers.
Downtime window start 7/11/2019 3:00 AM
Downtime window end 7/11/2019 4:00 AM
Affected services: Mail relay for smtp.fau.edu
Affected systems: boc22esa02.fau.edu, nwesa02.fau.edu
Expected End-user impact: Ideally none, however depending on how dns is cached for each client and how the smtp server settings were configured you may see bouncebacks/failed to connect messages when dns is updated.

********************************************************************************************
Windows configuration and deployment system upgrade
Description of change: The system providing configuration, deployment and updates to Windows clients will be upgraded to the latest version
Downtime window start 7/11/2019 3:00 AM
Downtime window end 7/11/2019 7:00 AM
Affected services: OS deployments, app installs, windows updates from SCCM​
​Affected systems: boc22sccm
Expected End-user impact: All OS deployments, app installs, windows updates from sccm will be unavailable during the window

**********************************************************************************************
BHRIC Servers upgrade from Windows 2012R2 to Windows 2019
Description of change: We have series of Windows servers on BOCA RATON and JUPITER cloud platforms running Windows 2012 R2. These servers will be upgraded to Windows 2019​. Several servers are upgraded successfully. We would like to continue upgrading all servers in 3/4 servers per batch over next few months. ​​
Downtime window start 7/11/2019 3:00 AM
Downtime window end 7/11/2019 6:00 AM
Affected services: Various services on following servers in health domain: boc22-s-adc1, Boc22-s-ps.med, research-mssqlX, boc22-s-sql
Affected systems: boc22-s-adc1, Boc22-s-ps.med, research-mssqlX, boc22-s-sql
Expected End-user impact: NONE is expected​​​

**********************************************************************************************
Banner Self-Service Maintenance
Description of change: Change to fix flaws associated with Banner Registration (Version 9.12) that causes inaccurate information to be displayed to the students. This fix includes updates to the Registration search feature to fix defects on what courses are rendered and fix inaccurate descriptions/sorting of other data points.
Downtime window start 7/11/2019 4:00 AM
Downtime window end 7/11/2019 6:00 AM
Affected services: Banner Self-Service
Affected systems: Banner XE
Expected End-user impact: There are no impact on user services expected

**************************************************************************************
Updates Accounts Self Service
Description of change: Upgrading and patching account self service website.
Downtime window start 7/11/2019 5:00 AM
Downtime window end 7/11/2019 6:00 AM
Affected services: accounts.fau.edu
Affected systems: boc22oimwebp1, boc22oimwebp2, nwrdcoimwebp1, nwrdcoimwebp2
Expected End-user impact: Users may see a delay in password resets during the time the systems are being patched and rolled out.

*************************************************************************************

Server Maintenance
Description of change: We will be changing two northwest www.fau.edu webservers with new ones that are able to do shibboleth.
Downtime window start 7/11/2019 6:00 AM
Downtime window end 7/11/2019 7:00 AM
Affected services: None as these are the northwest www.fau.edu webservers and are also behind BigIP
Affected systems: Northwest www.fau.edu webservers​
Expected End-user impact: No end user impact expected

Posted in Banner and Admin Systems, Educational Technologies, Network and Telecom, Systems, Uncategorized

Unable to load images in VIP document management system

We are currently experiencing issues with the content explorer component of the VIP document management system.  As such, users are unable to load images.  Scanning and input should still be functional.  Working with vendor for a solution.

Posted in Banner and Admin Systems, Systems, Uncategorized

Banner Self-Service Emergency Maintenance

Banner Self-Service will be undergoing emergency maintenance today at 12:30pm that requires services to be restarted.  Services will return to normal by 1pm.

Posted in Banner and Admin Systems

Reports of 2Factor/MFA enrollment issues

Users have reported that issues enrolling and activating MFA/2Factor on their user accounts. We have tracked the issue down and will be fixing it between 9 pm and 9:30 pm June 16, 2019. During this period both the student and employee enrollment applications will be offline.

Posted in Banner and Admin Systems, Canvas / LMS, Email, Instructional Technologies, Systems, Workday

OIT Systems Maintenance, Thurs. June 13 from 3:00AM to 7:00AM

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 06/13/2019 from 3:00 AM to 7:00 AM during OIT maintenance window.  In addition, the following systems will be specifically impacted:

*************************************************************************************
Email System Configuration Change
Description of change: Email spam protection settings are being modified to allow the a new project (SalesForce) to send valid emails on behalf of FAU.
Downtime window start: 5:00 AM
Downtime window end: 5:30 AM
Affected services: FAU Email Delivery​
Affected systems: Email and DNS servers
Expected End-user impact: During this time, no end-user impact is expected. ​

*************************************************************************************
Server Maintenance
Description of change: OIT will restart one of five LDAP user information servers to recover the ability to manage it properly.​
Downtime window start: 4:45 AM
Downtime window end: 5:00 AM
Affected services: A major service that may be impacted is Single Sign-on logins.  Other services may be OIM  (Oracle Identity Management) changes that need to be performed on OUD (Oracle Unified Directory) and any service requiring LDAP connections to OUD (Oracle Unified Directory).
Affected systems: boc22oudp02 proxy instance (asinst_2)​
Expected End-user impact: During this time, no long term impact is expected as this is only 1 of 5 OUD servers.  They are redundant and new connections would be routed to servers that are still alive. Momentary interruption of services may occur if something has been connected to that server and did not complete its operation during the shutdown.

*************************************************************************************
Server maintenance
Description of change: OIT will be introducing some security​ enhancements to the webservers.
Downtime window start: 4:00 AM
Downtime window end: 5:00 AM
Affected services: www.fau.edu
Affected systems: Web servers
Expected End-user impact: During this time, no end-user impact is expected. Changes should be transparent to end users.​

*************************************************************************************
Server Cluster Maintenance
Description of change: OIT will be applying updates to a server cluster.​
Downtime window start: 8:00 AM
Downtime window end: 5:00 PM
Affected services: Hyper-V, Multiple FAU services (please see list of virtual machines)​
Affected systems: HyperV clusters
Expected End-user impact: During this time, no end-user impact is expected. Virtual machines will be migrated live and no down time is expected for those work loads.​

************************************************************************************
Banner Maintenance
Description of change: OIT will be upgrading and patching the BANNER system with 5 different releases. There are six Harvest packages over five Team Dynamix Incident numbers to be installed during the maintenance window.
Downtime window start: 3:00 AM
Downtime window end: 7:00 AM
Affected services: No service impact expected
Affected systems: BANNER
Expected End-user impact: During this time, no end-user impact expected.

*************************************************************************************
Oracle Server Maintenance
Description of change: OIT will be applying the Oracle Upgrade 12cR2 to IEAP production database​
Downtime window start: 3:00 AM
Downtime window end: 6:00 AM
Affected services: IEAP production environment. Webfocus won’t be able to connect to the IEAP database. ​
Affected systems: odsprod
Expected End-user impact: During this time, services that listed above will be unavailable at times during the maintenance window.​​

************************************************************************************
BHRIC Servers upgrade from Windows 2012R2 to Windows 2019
Description of change: OIT has series of Windows servers on BOCA RATON and JUPITER cloud platforms running Windows 2012 R2. These servers will be upgraded to Windows 2019​. The first server was upgraded successfully. We would like to continue upgrading all servers in 3/4 servers per batch over next few months. ​
This will be the 3rd batch.
Downtime window start: 3:00 AM
Downtime window end: 6:00 AM
Affected services: Various services on following servers in health domain
Affected systems: Servers on the Health domain
Expected End-user impact: During this time, no end-user impact is expected

************************************************************************************

Posted in Banner and Admin Systems, Email, Systems

TouchNet Systems Maintenance, Wed. June 12th from 3:00AM to 7:00AM

The TouchNet payment processing system will be undergoing maintenance -Starting from 3:00am to 7:00am (EST) Wednesday, 06/12/2019

This affects student payment services (Bill+Payment), as well as all Marketplace Stores, uPay sites and TouchNet ready partner payment services.

We expect all systems to be back online no later than 7:00 am (EST) that morning. When the system is back up and ready to go, we will notify you.

You may wish to place warnings on your website, or take your store offline. If this scheduled downtime creates a conflict for your operations, please feel free to contact us at FIS@fau.edu for further discussion.

Expected End-user impact: During this time all student payment services (Bill+Payment), as well as all Marketplace Stores, uPay sites and TouchNet ready partner payment services will be unavailable during this maintenance cycle.

Posted in Banner and Admin Systems

[RESOLVED] Owldone Unavailable

Update: The issue with Owldone has been resolved and is now available again. We thank you for your patience during this time.

OIT

***************************************************************************************

We are currently experiencing some issues with Owldone and the application is currently unavailable. We are working to resolve the issue as soon as possible and we appreciate your patience during this time.

OIT

Posted in Banner and Admin Systems, Systems

OIT Systems Maintenance, Thurs. June 6 from 3:00AM to 7:00AM

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 06/06/2019 from 3:00 AM to 7:00 AM during OIT maintenance window.  In addition, the following systems will be specifically impacted:

*************************************************************************************
BHRIC Servers upgrade from Windows 2012R2 to Windows 2019
Description of change: OIT will be upgrading a series of Windows servers on BOCA RATON and JUPITER cloud platforms running Windows 2012 R2. These servers will be upgraded to Windows 2019​. This is the 2nd batch of upgrades.
Downtime window start: 3:00 AM
Downtime window end: 6:00 AM
Affected services: Various services on following servers in health domain
Affected systems:  Various health servers
Expected End-user impact: During this time, no end-user impact is expected

*************************************************************************************
Server Maintenance
Description of change: OIT will be changing the network address for a server.
Downtime window start: 5:00 AM
Downtime window end: 6:00 AM
Affected services: VIP file shares
Affected systems: VIP server
Expected End-user impact: During this time, end users will not be able to connect to the VIP file share.

*************************************************************************************
Oracle Server Maintenance
Description of change: OIT will be applying the Oracle Upgrade 12cR2 to IEAP production database​
Downtime window start: 3:00 AM
Downtime window end: 6:00 AM
Affected services: IEAP production environment. Webfocus won’t be able to connect to the IEAP database. ​
Affected systems: odsprod
Expected End-user impact: Services that listed above will be unavailable at times during the maintenance window.​​

*************************************************************************************

Posted in Banner and Admin Systems, Educational Technologies, Email, Systems