[RESOLVED] Intermittent single-sign on issues

Early this morning we experienced issues with single sign on. This affected several of our services such as Banner and FAU Self-Service.

The issue has been resolved and all services should be accessible at this time. If you continue having issues please contact the OIT Help Desk 561.297.3999.

We apologize for the inconvenience this may have caused.

OIT

Posted in Banner and Admin Systems, Educational Technologies, Email, Google App Status Feed, Instructional Technologies, Network and Telecom, Systems, Uncategorized, Workday

OIT Systems Maintenance, Thurs. April 12 from 3:00am to 7:00am

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 04/12/2018 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:

*************************************************************************************
Student Printing Service Upgrade.
Description of change: OIT will be upgrading Papercut production servers from 16.4 to 18.0.4. This is due in part to fix TLS 1.2 issues with MFD devices as well as add 3D printing capabilities.
Downtime window start: 3:00 AM
Downtime window end: 6:00 AM
Affected services: Papercut printing.​
Affected systems: Boc22pcapp01, Boc22pcapp02, Boc22pcprt01, Boc22pclyprt01, Jup17pcprt01, Dav90pcprt01​, Ftlbc04pcprt01, Boc22pcoffice01.
Expected End-user impact: During this time, Papercut printing will be unavailable

*************************************************************************************
Account Claiming Self Service Update
Description of change: OIT will be updating the Account claiming service to provide improved user experience.
Downtime window start: 5:00 AM
Downtime window end: 5:00 AM
OIT Units involved in the change FAU Apps
Affected services: Account Self Service
Affected systems: boc22oimwebp1, boc22oimwebp2
Expected End-user impact: None

*************************************************************************************
Systems maintenance
Description of change: OIT will be restarting several systems for maintenance​
Downtime window start: 3:00 AM
Downtime window end: 3:30 AM
Affected services: Graduate Admission Application (http://owlapp.fau.edu)​, external DNS, http://gear.fau.edu​, User Services account tool, eGrades, Jira and Confluence, College of Science web, College of Med web, uachieve, EZProxy​, Filelocker, IDM, HPC, Networking, configuration backup tool​
Affected systems: appadmin, as5, boc22canvascli, boc22frevvoctr, boc22mysql02, boc22ora02, boc22ora04, boc22payaradp, boc22payaranp01, boc22uachieve1, boc22vm102vrt101mrtg, chessboard, chessboard-el7-2, comvmweb01, cosweb1, dsr1, ezproxyweb, filelocker2, gitlab, hpc, idm2, madcat1p, marketing, napalm, ns, ns1, ugapp2, ugapp4, ugapp5​
Expected End-user impact: During this time, some of the listed services may be unavailable for a few minutes

*************************************************************************************
Server Maintenance
Description of change: OIT is applying a patch to enhance functionality of the VIP Content management system​​
Downtime window start: 5:30 AM
Downtime window end: 6:30 AM
Affected services: VIP Content Management System
Affected systems: vip.fau.edu (Boc22coex01)
Expected End-user impact: During this time the VIP system will be unavailable.

************************************************************************************
Load balancer maintenance
Description of change: OIT will be changing the monitor on bigip that checks to see if the production oud servers are up.​
Downtime window start: 6:30 AM
Downtime window end: 7:00 AM
Affected services: None
Affected systems: boc22oudp01 and boc22oudp02
Expected End-user impact: During this time, no end-user impact is expected​

*************************************************************************************
Server Upgrade and Maintenance
Description of change: OIT will be upgrading the components of several systems to resolve bugs and add support for newer hardware.​​​
Downtime window start: 3:00 AM
Downtime window end: 7:00 AM
Affected services: All services
Affected systems: adcon, adrms, andisec, ansible, appadmin, as2, as4, as5, banpocbep, banpocdb, banpocidm, banpocjs, banpoclp, banpocwkflw, banpocwl, banpocxe1, bba1, bba2, bba3, bba4, bbda1, bbda2, bbloracle, bblt3sp10, bbm1, boc22aajc, boc22aalmgr, boc22aasiemens1, boc22aaweb, boc22adfs, boc22adfsp, boc22aptven, boc22asmt, boc22azadc, boc22banxe01-30, boc22banxealt01-08, boc22canvascli, boc22cm102srv1, boc22cm102vrt101mrtg, boc22coex01, boc22coex02, boc22dellome, boc22dms02, boc22dns, boc22frevvoctr, boc22jamfccm, boc22jamfim, boc22jmeter, boc22jmeter2, boc22keytracer, boc22kofaxcap, boc22mbes, boc22mssql21, boc22mssql22, boc22mssql31, boc22mssql32, boc22mssql41, boc22mssql42, boc22mssqldev1, boc22mssqldev2, boc22mssqltald1, boc22mssqltald2, boc22mssqltalp1, boc22mssqltalp2, boc22mysql02, boc22nxtcloudd1, boc22oars, boc22oimccp1
boc22ora01, boc22ora02, boc22ora03, boc22ora04, boc22ora05, boc22ora06, boc22ora07, boc22ora09, boc22ora10, boc22payaradp, boc22payaranp01, boc22payaranp02, boc22pcapp01, boc22pcapp01dev, boc22pcapp02, boc22pcapp02dev, boc22pclyprt01, boc22pcoffice01, boc22pcprt01, boc22redis1p, boc22redis2p, boc22redis3p, boc22sacs, boc22sasdoa, boc22sasdt,
boc22saspoa, boc22satrane, boc22sccm, boc22snapc, boc22talweb2, boc22uachieve1, boc22vcenter1, boc22w7dev1, boc22w7dev2,
boc22w81dev1, boc22w81dev2, boc22w8dev2, boc22wapportal, boc22wapspf, boc22web5, boc22whatsup, bocca01, cardaccess, carenet, cas1t, chessboard, chessboard-el7-2, comvmadi01, comvmpsql1, comvmsql01, comvmweb01, comvmweb1, comvmwebdev1, controller, cosweb1, cuttlefish, dhcpboc17, dsr1-6, duo, eprint2, eprint-ol6, exchangeca03, ezproxyweb, faasadvisor, fauappsrv2, filelocker1, filelocker2, filelockerd01, filelockerd02, freeze, frevvo1, frevvo1t, frevvo2t, frevvot, gitlab, hpc, idm1nw, idm2, idm4p, idmgatewaynw, iss, issdev, jenkins2, kube1, kube2, kube3, kube4, ldapboc0, ldapboc0-el6, libweb-live, lintalon0, lintalon1, lists, ls-matlab, ls-medmodel, ,ls-osd, ls-snap, madcat1p, marketing, mcclient, mcoracle, migrate365, modena, napalm, ns, ns1, OracleEM, pinetree, pinky, piwik1, r25-webservice, remotecon, s164n14, s165n113, s165n15, sacs, sctaltcache1, sctaltcache2, sctaltcache3, sctaltcache4, sctaltcache5, sctaltcache6, sctcache1, sctcache2, sctcache3, sctcache4, sctcache5, sctcache6, sepiidae, shibboleth1p, shib-proxy1, shoutcast, spacewalk, starfish, talonx2, tuna2p, ugapp1, ugapp2, ugapp3, ugapp4, ugapp5, vcdb, vcrecorder, wildflymc1, wildflymc2, wordpress, wordpress2, XenAPP00, XenAPP01, XenAPP02, XenAPP-Office, XenAppVDA1, XenAppVDA2, XenDelCont1, XenDelCont2, XenDirector, XenLIC, XenSF1, XenSF2, XenStoreF1, XenStoreF2, XenZDC1, XenZDC2, yakko, bannerprd, banoradev, bbloraclealt, odsprod, odstest, boc22sas1, boc22sas2, boc22sas3, boc22sas4, boc22sast1, boc22sast2, boc22sast3, boc22sast4, boc22esxi01, boc22esxi02
Expected End-user impact: During this time, no end user impact is expected

************************************************************************************

Posted in Banner and Admin Systems, Educational Technologies, Email, Google App Status Feed, Instructional Technologies, Network and Telecom, Systems, Uncategorized, Workday

Email Upgrade Phishing Message – Do Not click the link

Please be advised that a Phishing email has been identified.

The subject line of this message is Email Upgrade.  Please DO NOT click the link in the message. The message is not sent from OIT or FAU. If you have already clicked the link, please change your password immediately.  If you need assistance, please contact the OIT Help Desk at 561.297.3999

OIT

Posted in Banner and Admin Systems, Educational Technologies, Email, Google App Status Feed, Instructional Technologies, Network and Telecom, Systems, Uncategorized, Workday

[RESOLVED] – Malwarebytes Update causing network connectivity issues

UPDATE:

Today at 1:55PM, Malwarebytes released v.12 update that has fixed the network connectivity problem. OIT has tested the update and can confirm that it resolves the issues.

We highly recommend rebooting your computer at your earliest convenience after the update is installed.

If you continue to experience issues, please contact the OIT Help Desk for assistance.
561.297.3999 or helpdesk.fau.edu

OIT

******************************************************************************************************

Earlier today Malwarebytes released a signature update that is causing computers to lose network connectivity. This is a widespread issue and are affecting anyone who has Malwarebytes installed.

The temporary workaround is to disable Malicious Web Protection under Settings. This will restore network connectivity. Once Malwarebytes releases a new update the Malicious Web Protection feature should be turned on again.

We will be monitoring the status of this issue and apologize for the inconvenience this may cause.

OIT

Posted in Banner and Admin Systems, Educational Technologies, Email, Google App Status Feed, Instructional Technologies, Network and Telecom, Systems, Uncategorized, Workday

OIT Systems Maintenance, Thurs. Nov 30 from 3:00AM to 7:00AM

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches, and other health checks on Thursday, 11/30/2017 from 3:00 AM to 7:00 AM during OIT maintenance window.  In addition, the following systems will be specifically impacted:
************************************************************************************

Canvas Maintenance
Description of change: OIT will be performing maintenance on Canvas. No disruption of service is anticipated.
Downtime window start: 5:00 AM
Downtime window end: 5:00 AM
Affected services: Canvas
Affected systems:  boc22devproc, Canvas – Hosted
Expected End-user impact: During this time, no downtime is expected. Once the update has been completed, users with a preferred name set in Workday or Banner will see the change in Canvas.

*************************************************************************************

Updates to FAU Account Self Services portal
Description of change: OIT will be applying patches to the backend systems to improve the account claiming process for users.
Downtime window start: 5:00 AM
Downtime window end: 5:30 AM
Affected services: OIM, OUD, MyFAU, Waveset, DSEE, Google Apps and Gmail
Affected systems: boc22oimp1, boc22oimp2
Expected End-user impact: During this time, no end-user impact is expected. Changes should not cause any loss of services or impact access to any sites.

*************************************************************************************

Email System Maintenance
Description of change: OIT will be preforming steps on the email system to enable additional encryption options​
Downtime window start: 6:00 AM
Downtime window end: 6:15 AM
Affected services: All Office 365 email users
Affected systems: Exchange 365​
Expected End-user impact: During this time, no end user impact is expected

*************************************************************************************

Server Maintenance
Description of change:  OIT will be moving several IPs from the old load balancer to the new load balancer hardware.​​
Downtime window start: 4:30 AM
Downtime window end: 6:00 AM
OIT Units involved in the change  Systems, fauapps
Affected services: Coldfusion apps,  OIM and anything that authenticates off OIM, alertportal.fau.edu, pinkypass, owlrec, hpc website,
Affected systems: boc22cfdev.fau.ed, boc22cfprod.fau.edu, boc22oudp.fau.edu, alertportal.fau.edu, ugapp.fau.edu, owlrec.fau.edu, pinkypass.fau.edu, hpc.fau.edu​
Expected End-user impact:  During this time, users will not be able to access the services listed above for about 10 minutes at a time while the IPs are being moved from the old load balancer to our new load balancer.

*************************************************************************************

Oracle Server Maintenance
Description of change:  OIT will be applying the latest Oracle quarterly patch updates to the production ​databases.
Downtime window start: 3:00 AM
Downtime window end: 7:00 AM
Affected services: Banner production, Report Caster production, Oracle Identity Manager production, Identity Manager (IDM) production, ODS production, MSOP instance
Affected systems: bannerprd, boc22ora01, boc22ora03, boc22ora​05, boc22ora07, odsprod
Expected End-user impact: During this time, services listed above will be unavailable​

*************************************************************************************

Server Chassis Maintenance
Description of change: OIT/Systems will be performing maintenance on a server chassis
Downtime window start: 3:00 AM
Downtime window end: 5:00 AM
Affected services: SSO, DHCP, DNS, LDAP, Network Monitoring​,
Affected systems: Boca 96 VRTX, BOC96HV01, BOC96HV02, BOC96ESXI01, BOC96ESXI02, boc96dns, dhcpboc1, dhcpboc18, dnsboc1, ldapboc1, ldapboc1-el6, overwatch, shibboleth2p​​,
Expected End-user impact: During this time, services listed above will be unavailable. Most services are redundant, however SSO may be intermittenly unavailable

*************************************************************************************

Digital Signage Improvements
Description of change: OIT will be upgrading Fourwinds digital signage from 5.1.1 to 5.4 for the Marketing department.
Downtime window start: 3:00 AM
Downtime window end: 7:00 AM
Affected services: Four Winds digital signage for the Marketing on-prem players.
Affected systems:  3 Marketing on-prem content players.
Expected End-user impact:  During this time, the Marketing department will not be able to manipulate content during the upgrade, however, existing content will continue to be displayed. Once the upgrade is complete, OIT will need to update the 3 content players as well as any computer using Content manager for these 3 players.

*************************************************************************************

Posted in Banner and Admin Systems, Educational Technologies, Email, Google App Status Feed, Systems, Uncategorized

[RESOLVED] Login issues

**ISSUE RESOLVED**

The login issue has been resolved and you should be able to login to all systems at this time.

Thank you for your patience while we addressed the problem.

OIT

**************************************************************************

We are currently experiencing login issues. This impacts, but is not limited to, Banner, Workday, MyFAU, Networkregistration, eGrades, and EZProxy.

Our team are working to resolve this issue as soon as possible.

We apologize for the inconvenience this may cause.

OIT

Posted in Banner and Admin Systems, Educational Technologies, Email, Google App Status Feed, Instructional Technologies, Network and Telecom, Systems, Uncategorized, Workday

Authentication System Maintenance

The single sign-on authentication system will be partially unavailable from 3:00 am  to 4:00 am Thursday August 18th, 2017. While the maintenance is in progress users may intermittently experience difficulty logging into services such as Canvas, Self Service, Office 365, Owlapps, and Workday.

 

Posted in Banner and Admin Systems, Educational Technologies, Email, Google App Status Feed, Instructional Technologies, Lecture Capture, Network and Telecom, Systems, Video Conferencing

[RESOLVED] Slowness with some services

** UPDATE **

All services are operating normally at this time.

*************************************

We are currently experiencing slowness with some services, such as Workday, email, Banner INB, Self-service, and possibly some others. We are currently investigating the issue and will post an update once we know more.

We apologize for the inconvenience.

OIT

Posted in Banner and Admin Systems, Educational Technologies, Email, Google App Status Feed, Instructional Technologies, Network and Telecom, Systems, Uncategorized, Workday

[RESOLVED]Password change/reset delays

Status: 6/21/17 6:45PM

The password change/reset delays have been resolved and are back to functioning as normal.

We appreciate your patience and support.

OIT

————————————————————

Status: 6/21/17 5:30PM

Please be advised that the issue with password change delays has been resolved, however, the system is currently processing the password changes and should normalize in no more than a couple of hours. If you change your password during this time please be aware that it may take some time to propagate to all systems.

We appreciate your patience.

OIT

 

_________________________________________________________________________________

Password changes/reset is currently experiencing extended delays. We recommend holding off changing your password until further notice.

We are working with due diligence to resolve this issue.

We appreciate your patience during this time.

OIT

Posted in Banner and Admin Systems, Educational Technologies, Email, Google App Status Feed, Instructional Technologies, Network and Telecom, Systems, Uncategorized, Workday

OIT Systems Maintenance, Thurs. June 1 from 3:00AM to 7:00AM

Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 06/01/2017 from 3:00 AM to 7:00 AM during OIT maintenance window.  In addition, the following systems will be specifically impacted:

***************************************************

Google Applications Single Sign On (SSO) Update
When: 5:00AM – 6:00AM
Affected services: Google Applications​
Affected systems: Google Applications, OwlApps
Description of maintenance: OIT will convert Google Applications authentication from CAS to Saml 2.0​
User impact: Authentication to Google Applications may be interrupted during the conversion. ​Users should try to log in again after maintenance is completed.

***************************************************

Upgrade multiple systems – unavailable during upgrade
When: 3:00AM – 4:00AM
Affected services: Undergrad Application, SACS, Remote Management, College of Science web, Networking What’s up, Networking napalm, Shoutcast, Labs XenApp, vCenter, Middleware monitoring system, Middleware monitoring/management system, User Services account management tool​
Affected systems: boc22cm102srv1, boc22vcenter1, boc22whatsup, chessboard, cosweb1
cuttlefish, dsr6, eprint2, jenkins2, lintalon1, mcclient, napalm, piwik1, remotecon, s165n113, sacs, sepiidae, shoutcast, tuna2p, ugapp3, ugapp4, XenAPP00, XenAPP01, XenAPP02​
Description of maintenance: OIT will be upgrading the VM version of several systems as well as expanding the processor capabilities for some VMs​​​
User impact: The listed services may be unavailable for approximately 5 minutes during the window

***************************************************

Recreate dnsjup2 virtual machine 
When: 4:00AM – 5:00AM
Affected services: DNS
Affected systems: dnsjup2 [131.91.213.91​]
Description of maintenance: OIT is deleting and recreating the dnsjup2 VM using the same virtual hard disk. This is being done because this VM shares the same VM id as dnsboc1 and is causing various issues with SCVMM managing the clusters they reside on as well as the VMs themselves.
User impact: Any systems that rely on dnsjup2 for name resolution will fail during the change window.

***************************************************

Replace NS with new Linux VM 
When: 4:30AM – 5:00AM
Affected services: External facing DNS​
Affected systems: ns​
Description of maintenance: OIT is replacing an old Solaris branded computer server that is functioning as ns (one of three external facing domain name servers)​ with a new VM that is running the Linux operating system.
User impact: No expected end-user impact

***************************************************

Appworx Production Upgrade
When: 5:00AM – 6:00AM
Affected services: Appworx​
Affected systems: enzo, bannerprd
Description of maintenance: OIT is upgrading Appworx production to latest release
User impact: Appworx and Appworx jobs will be unavailable during this time

***************************************************

Blackboard Restarts
When: 5:00AM – 6:00AM
Affected services: Blackboard​
Affected systems: Blackboard​
Description of maintenance: OIT is restarting blackboard application servers to fix an analysis issue that some professors may be having​.
To start with the ramp down of blackboard we will only be bringing up 4 user facing app servers.
User impact: ​Blackboard will be intermittently unavailable between 5 and 6 AM

***************************************************

Posted in Banner and Admin Systems, Educational Technologies, Google App Status Feed, Systems