Our service provider has informed us that restoration of services will begin around midnight tonight lasting until morning. We do not have a specific ETA for resolution. Until the expected restoration of our primary internet link in the early morning hours, we will continue to have degraded performance to all services from off-campus and from FAU to the internet.
[UPDATE] FAU Experiencing Degraded Internet Performance
FAU Experiencing Degraded Internet Performance
FAU is currently experiencing an outage of its primary connection to the internet. While all traffic has switched over to a backup connection and all services are available, users will experience decreased speeds to the internet until the issue is resolved. Our service provider is aware of the issue and working to resolve this issue as quickly as possible.
OIT Systems Maintenance, Thurs. Oct. 29, 2015
Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 10/29/2015 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:
***************************************************
When: 3:00AM – 5:00AM
Affected services: Waveset, Active Directory, Departmental software that relies upon Active Directory Organizational Units
Affected systems: idm1, idm2, idm4p, bocdcfau01, bocdcfau2
Description of maintenance: All accounts in the courtesy organizational will be moved to the People organizational unit in Active Directory
User impact: We do not anticipate any issues as this has been tested in Waveset and Active Directory. They may experience issues changing their password, if this occurs we will revert the change.
***************************************************
When: 4:00AM – 7:00AM
Affected services: If we can’t migrate services and apps the following databases will be impacted:
AppController, Bannerview, Clearwire, CollegeExpo_prod, ecollege, facstaffalert, FIMsync, Frevvo, FSAAtlas, GRAS, Inauguration, Internalservices, JIRA, Medicine, OperationsManager, Orinoco, Parature, Private Eye, SOFTLIC, Techfee, ThirdparrtyAlert, Transients, vCenter Databases, VPAS, vWorkspace, Xitracs
Affected systems: mssql1, mssql2
Description of maintenance: The MSSQL0 cluster is having a management network issue. Usually restarting the non active node fixes this issue, but it has persisted. To fix the issue we will need to reboot the active node. I will attempt to manually move the services and applications running on MSSQL2 to the non-active node, but since it is a network connection issue between the two nodes, this may not work.
User impact: Users of the following databases may experience a connection disruption for 10-15 minutes: AppController, Bannerview, Clearwire, CollegeExpo_prod, ecollege, facstaffalert, FIMsync, Frevvo, FSAAtlas, GRAS, Inauguration, Internalservices, JIRA, Medicine, OperationsManager, Orinoco, Parature, Private Eye, SOFTLIC, Techfee, ThirdparrtyAlert, Transients, vCenter Databases, VPAS, vWorkspace, Xitracs
***************************************************
When: 5:00AM – 6:00AM
Affected services: OIM Self Service Portal
Affected systems: OIM Application Servers
Description of maintenance: Apply updates to Self Service Portal https://accounts.fau.edu/
User impact: The following services maybe offline during restart: Password resets, Account claiming
***************************************************
When: 5:30AM – 6:00AM
Affected services: Blackboard
Affected systems: Blackboard
Description of maintenance: Installation of new Pearson Integration Building Block
User impact: Rolling restarts may be required. Users should not see an impact.
***************************************************
Resolved: Single Sign-On Issues
Single Sign-on failed to work as expected this evening October 20th, 2015. We have corrected the problem and will monitor the servers for the next few hours. We have confirmed that Blackboard, Workday, EZProxy, OwlApps (Google Applications) and other related services are now accessible.
ANDISEC Accessibility
Users may experience difficulty accessing ANDISEC services. We are investigating and will update this post regularly.
Single Sign-on errors
Users may have experienced difficulty logging into Blackboard, Workday, Office 365 and other single sign-on services. We are investigating and will update this post regularly.
OIT Systems Maintenance, Thurs. Oct 8 from 3:00AM to 7:00AM
Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 10/08/2015 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:
***************************************************
OIM Blackboard Connector Maintenance
When: 5:00 – 6:00AM
Affected services: Oracle Identity Manager (OIM)
Affected systems: Blackboard, Oracle Identity Manager (OIM)
Description of maintenance: Changes will be made to the OIM database to correct issues that prevented name and username changes to some Blackboard accounts.
User impact: No end-user impact is expected.
***************************************************
OIM Match Resolution Manager Update (FuzzyMatching)
When: 5:00 – 5:15AM
Affected services: Oracle Identity Manager (OIM), including Accounts Self-Service and Claiming Interface and WorkdayRest listener
Affected systems: boc22oimp1, boc22oimp2
Description of maintenance: Updating the Fuzzy Match Interface with many enhancements.
User impact: Any users attempting to claim their account during this period will not be able to access the accounts.fau.edu site.
Any Workday hires reaching the INT083A (Workday Hire JSON Post to OIM) will not reach the system.
***************************************************
lists.fau.edu is working intermittently
We are currently experiencing some issues with lists.fau.edu and its backend mail delivery and processing. We are currently looking into the matter and will update this notice as new information is available. Sorry for the inconvenience.
OIT Systems Maintenance, Thurs. 9/24 from 3:00AM to 7:00AM
Office of Information Technology will be performing routine systems maintenance which includes but is not limited to rebooting Windows servers as deemed necessary, installing critical patches and other health checks on Thursday, 09/24/2014 from 3:00 AM to 7:00 AM during OIT maintenance window. In addition, the following systems will be specifically impacted:
Upgrade ODS to the new version ODS 8.5.1
When: 3:00AM – 7:00AM
Affected services: ODS production environment. Webfocus won’t be able to connect to the ODS database.
Affected systems: odsprod
Description of maintenance: OIT is upgrading the ODS version from 8.4.1 to 8.5.1
User impact: Affected services will be unavailable during the maintenance window.
***************************************************
Upgrade SAS drive firmware on NetApp filer
When: 5:00 AM – 7:00AM
Affected services: None
Affected systems: bocana01
Description of maintenance: OIT will be upgrading the SAS drive firmware on the NetApp filer bocana01.
User impact: None
***************************************************
Undeliverable Email Messages
Please note that email messages sent from FAU are currently being limited or blocked by other providers due to an increased number of compromised accounts. This results in some email messages coming back as “undeliverable” or “delayed delivery.”
Unfortunately, at this time, the only thing we can do is to wait for the other providers to remove the block and/or limit.
We apologize for the inconvenience this may cause.
OIT