Incidents and maintenance reported on status page for Florida Institute of Technology https://floridatechthehub.betteruptime.com/ https://d1lppblt9t2x15.cloudfront.net/logos/c1ac33b3c43526323c1253abf1cc01da.png https://floridatechthehub.betteruptime.com/ en https://floridatechthehub.betteruptime.com/incident/740768 Fri, 10 Oct 2025 13:49:00 -0000 https://floridatechthehub.betteruptime.com/incident/740768#45f43fe49f8ee7438b43075c3c48967171c877f78edf4aac0ecc25d48e940f10 Incident We are pleased to report that the university-wide network instability has been resolved, and all systems have returned to normal operation. Performance for The Hub and all its integrated services—including PAWS connectivity, student/instructor data streams, and Degree Works—has been fully restored. We sincerely apologize for the extended disruption this incident caused. If you continue to encounter any issues, please try clearing your browser's cache and reloading the page before contacting IT Support. Thank you for your patience. https://floridatechthehub.betteruptime.com/incident/740768 Fri, 10 Oct 2025 13:13:00 -0000 https://floridatechthehub.betteruptime.com/incident/740768#94d837a8b78fda3f2973b8038e64b2bbc9809ff1188e3ba1f29542027998d604 Incident We are continuing to address the system-wide performance issues caused by ongoing university network instability. There is no new ETA for a resolution at this time. Performance for The Hub remains degraded. We have confirmed that this is affecting several core functions and integrations, including: - PAWS connectivity - Student and instructor data streams - Degree Works integration Users will continue to experience slow performance, errors, and potentially stale or unavailable data from these services. Our teams continue to work with campus network services to resolve the underlying problem. We sincerely apologize for this extended disruption and appreciate your continued patience. We will post another update as soon as more information becomes available. https://floridatechthehub.betteruptime.com/incident/740768 Thu, 09 Oct 2025 13:00:00 -0000 https://floridatechthehub.betteruptime.com/incident/740768#ab7cd9e0c6458632605de206f5669fb8d1ecf1b77748916934799fbc90ca25d7 Incident We are continuing to monitor the university network instability affecting The Hub. While some services may be accessible, users will likely continue to experience degraded performance. Our team remains engaged with campus network services who are working to resolve the root cause. Thank you for your patience. https://floridatechthehub.betteruptime.com/maintenance/497456 Fri, 17 Jan 2025 13:55:32 -0000 https://floridatechthehub.betteruptime.com/incident/497456#5f924005594214d2d133971adff7c202358483310548bbaf51927fb3012c932d Maintenance Dear Valued Users, Please be advised that we will perform scheduled system maintenance and updates on our tutoring, supplemental instruction, and writing assistance services. During this time, you may experience: - Slowness or intermittent service disruptions - Temporary unavailability of some features or resources Maintenance Window: - Start: Friday, January 17th, 2025 at 09:00 AM EST - End: Tuesday, January 21st, 2025 3:00 PM EST We understand that this may cause inconvenience, and we apologize for any disruption this may cause. We are working to minimize downtime and ensure that all services are restored as quickly as possible. We appreciate your understanding and patience. If you have any questions or concerns, please do not hesitate to contact us at hub@fit.edu. Sincerely, Ce "Samuel" Su, Ph.D. | Applications Programmer 2 Florida Tech | Information Technology (321) 674-6806 csu2015@fit.edu https://floridatechthehub.betteruptime.com/maintenance/476603 Thu, 12 Dec 2024 13:58:10 -0000 https://floridatechthehub.betteruptime.com/incident/476603#f3021cbc29d6e36861f7a5e39ed52ed923eea9f6fa4ea44eac2a552d79adaa71 Maintenance Dear Florida Tech Hub Users, Please be advised that Florida Tech Hub will undergo scheduled maintenance on Monday, December 16th, at 4:00 PM. This maintenance is necessary to deploy version 4.13 and update supporting services. During this time, all Florida Tech Hub services will be unavailable. We expect the maintenance to last approximately one (1) hour. We understand that this downtime may cause inconvenience, and we apologize for any disruption it may cause. We will work to restore services as quickly as possible. Thank you for your understanding and cooperation. Sincerely, The Florida Tech Hub Team https://floridatechthehub.betteruptime.com/maintenance/467560 Mon, 25 Nov 2024 14:00:02 -0000 https://floridatechthehub.betteruptime.com/incident/467560#8ace073de3e496af5281c7f6aed949cf19cfb11b0bd57fa67ec215f4cc01d3e1 Maintenance We are updating our server and system, which may affect the service. We apologize for the inconvenience in advance. https://floridatechthehub.betteruptime.com/incident/382863 Tue, 11 Jun 2024 19:37:00 -0000 https://floridatechthehub.betteruptime.com/incident/382863#7384649a346b3aecbd8f9d1442733fc5bfbeda3c27d0a8c586b828c232485762 Incident The authentication issue causing Service Accounts (SAs) to not be validated has been resolved. The Central Authentication Service (CAS) server is now responding correctly to authentication requests. https://floridatechthehub.betteruptime.com/incident/382863 Tue, 11 Jun 2024 18:25:00 -0000 https://floridatechthehub.betteruptime.com/incident/382863#628502b271ced6ff838bd286df9940f07e54b75e9bef5a2c7e664b264c328865 Incident Details: We are currently experiencing an authentication issue where Service Accounts (SAs) are not being validated. This is due to the Central Authentication Service (CAS) server not responding to authentication requests. Impact: Users may be unable to log in or access certain services requiring authentication. Automated processes relying on service accounts might be disrupted. Current Status: Our technical team is actively investigating the issue. We are working to restore normal service as quickly as possible. Next Steps: Monitoring the CAS server for responsiveness. Investigating the root cause of the server's lack of response. Implementing necessary fixes and updates. Estimated Resolution Time: We will provide an update within the next hour or as soon as we have more information. https://floridatechthehub.betteruptime.com/maintenance/369249 Tue, 14 May 2024 14:45:00 -0000 https://floridatechthehub.betteruptime.com/incident/369249#3dd1f05fff884714aad3c059f000a78142a7e68d2d4d43841fcef3c4872075f1 Maintenance Please be informed that our system will undergo a scheduled update on May 14, 2024, from 10:45 AM to 11:00 AM EST. During this time, the system will be temporarily unavailable. We apologize for any inconvenience this may cause and appreciate your understanding. https://floridatechthehub.betteruptime.com/incident/326326 Tue, 13 Feb 2024 20:20:00 -0000 https://floridatechthehub.betteruptime.com/incident/326326#77bc09f0e0878027c6f735b73d991bc99ee81e3d262d3ff8dc9a6914a8eaaa9b Incident Dear Users, We are pleased to inform you that the recent issues with our system's communication with the University's Central Authentication Service (CAS) have been successfully resolved. You should now be able to log in and access all services without any difficulty. We want to thank you for your patience and understanding while we worked to fix this problem. Your cooperation during this time was greatly appreciated. Should you encounter any further issues or have any questions, please do not hesitate to contact our support team. Thank you for your continued support. Best regards, Ce "Samuel" Su, M.S. | The Hub System Admin and Dev Florida Tech | Student Success and Support Center 321-674-6806 hub@fit.edu https://floridatechthehub.betteruptime.com/incident/326326 Tue, 13 Feb 2024 17:58:00 -0000 https://floridatechthehub.betteruptime.com/incident/326326#ed9a075109f7d3c997a60f493d8b667f7962c75faa58a1e44bd18a8519b945ab Incident Dear Users, We are currently experiencing technical difficulties with our system's communication with the University's Central Authentication Service (CAS). This issue may result in problems during the login process for some users. Our technical team is actively working to resolve this issue as quickly as possible. We understand the inconvenience this may cause and appreciate your patience and understanding during this time. Please stay tuned for further updates. Should you encounter any login issues or have any concerns, do not hesitate to reach out to our support team. Thank you for your cooperation. Best regards, Ce "Samuel" Su, M.S. | The Hub System Admin and Dev Florida Tech | Student Success and Support Center 321-674-6806 hub@fit.edu https://floridatechthehub.betteruptime.com/maintenance/283828 Tue, 07 Nov 2023 20:11:26 -0000 https://floridatechthehub.betteruptime.com/incident/283828#7bfb13ee430c2d4af60fd5dd28bcfbd2d97e5b17ab149f195339dad68637da63 Maintenance Hi Panthers, We want to inform you that our system will be undergoing scheduled maintenance to ensure optimal performance and to implement important updates. During this maintenance window, the system will be temporarily unavailable. Maintenance Details: Date: November 9, 2023 Time: 17:00 - 18:00 EST Duration: 1 hour Maintenance Purpose: We will be performing critical updates and enhancements to our system, focusing on academic accommodations and resident care data and functions. These updates are essential to maintain the system's efficiency, security, and reliability. During the maintenance period, you may experience temporary unavailability or a slowdown in system performance. We apologize for any inconvenience this may cause and recommend planning your work accordingly. Action Required: To minimize any disruption, we kindly ask all users to save their work and log out of the system before the maintenance window begins. Please refrain from accessing the system during this time. We will send another notification once the maintenance is complete and the system is back online. Thank you for your understanding and cooperation as we improve our system. If you have any urgent concerns or questions regarding this maintenance, please do not hesitate to contact our support team at hub@fit.edu or 321-674-6806. We appreciate your continued support, and we strive to provide you with the best possible service. Sincerely, Ce "Samuel" Su System Admin and Developer https://floridatechthehub.betteruptime.com/incident/278992 Sat, 28 Oct 2023 17:35:00 -0000 https://floridatechthehub.betteruptime.com/incident/278992#059da244a8a12dc23489581a17ae05f3b3973867a12e6c4ca51080d41ebd289a Incident Dear Florida Tech Hub Users, We want to inform you that, on 28th October 2023, at 03:27 AM EDT, a campus-wide server outage occurred, affecting multiple services provided by Florida Tech Hub. We understand the inconvenience this may have caused, and we want to assure you that our team has been working diligently to resolve this issue. The outage impacted various services, and we are pleased to inform you that as of 1:25 PM EDT, all systems have been successfully restored and are now fully operational. The root cause of the server outage has been identified and addressed. We take this matter seriously and are committed to ensuring the stability and reliability of our services. If you encounter any lingering issues or concerns, please do not hesitate to contact our support team at hub@fit.edu. Our support staff is ready to assist you with any questions or problems related to this incident. We sincerely apologize for any disruption this may have caused, and thank you for your patience and understanding while we worked to restore our services. We greatly value your continued trust in Florida Tech Hub. Thank you for your understanding, and we look forward to serving you with the reliability and quality you expect from us. Sincerely, Ce "Samuel" Su System Admin and Developer Florida Tech Hub https://floridatechthehub.betteruptime.com/maintenance/256792 Fri, 08 Sep 2023 16:03:14 -0000 https://floridatechthehub.betteruptime.com/incident/256792#03db756ea4df80ec8a22588b5509d44ee7e53e7c6dabdcde45b43dba47c4bf99 Maintenance The Hub is scheduled for maintenance and will be unavailable from 5:00 PM to 6:00 PM on September 8, 2023, Eastern Daylight Time (EDT). https://floridatechthehub.betteruptime.com/maintenance/247612 Fri, 18 Aug 2023 18:00:00 -0000 https://floridatechthehub.betteruptime.com/incident/247612#2a21f27f0861765320a620766733484f2eaffffcf92a9f470e2a46669dc25447 Maintenance We will update The Hub dependencies and patch some security issues on 08/18/2023 at 02:00 PM EST. The service will be interrupted briefly. We appreciate your understanding. https://floridatechthehub.betteruptime.com/maintenance/190701 Wed, 29 Mar 2023 19:53:10 -0000 https://floridatechthehub.betteruptime.com/incident/190701#f30ba0b87513dc549a2b23a971276a771ae05266a42f753762d1a6cf5370d17a Maintenance Information Technology will be performing emergency maintenance to several system servers on Sunday, April 2. Downtime will begin at 8 a.m. and will conclude by 4 p.m. Please take the necessary precautions for the interruption in service during this timeframe. Many services include Banner and PAWS, incoming email (including Sympa distribution lists), TRACKS Password Reset system, Event Management System (EMS), SDrive Shares, GitHub, and Computer Engineering and Sciences systems will likely experience intermittent or total outages during the timeframe. https://floridatechthehub.betteruptime.com/incident/190191 Tue, 28 Mar 2023 16:21:00 -0000 https://floridatechthehub.betteruptime.com/incident/190191#f68de9371dce4c4452d7530993579bdd429540051a50871295e144cc107a4f27 Incident We've confirmed that the on-campus DHCP server outage has been resolved. Our telemetry indicates that the service has largely recovered. We're continuing to investigate the root cause and whether additional action is required. https://floridatechthehub.betteruptime.com/incident/190191 Tue, 28 Mar 2023 12:00:00 -0000 https://floridatechthehub.betteruptime.com/incident/190191#ccb644e8b40fa9fd80f38106d1bb725d3cdecf2025b8fa33cdc64b492dc05937 Incident Due to an ongoing DHCP maintenance on-campus network, The Hub service is unstable. https://floridatechthehub.betteruptime.com/maintenance/188796 Fri, 24 Mar 2023 17:00:00 -0000 https://floridatechthehub.betteruptime.com/incident/188796#796134254ceceec829db269c6e8b9b1601b797151cea6489724e77f3b69a8736 Maintenance There will be an undergoing scheduled infrastructure maintenance on 03/24/2023, between 01:00 PM and 01:10 PM EDT for making online tutoring appointments. During this maintenance, you can expect a few short service interruptions. https://floridatechthehub.betteruptime.com/incident/187118 Mon, 20 Mar 2023 18:49:00 -0000 https://floridatechthehub.betteruptime.com/incident/187118#069d81c5c87a541157c7fb1f4749a471e4700bba778be24edfd75dbb3fadccca Incident The Hub 4 response time is under 1s. The slow loading problem has been solved. https://floridatechthehub.betteruptime.com/incident/187118 Mon, 20 Mar 2023 10:20:00 -0000 https://floridatechthehub.betteruptime.com/incident/187118#96b0231768cfe3c795c8cf86ffdb2669094d42d59a93ae45d7b4ddc380ef9d24 Incident From 20 Mar 06:16 am, The Hub loads time exceeds 2 mins per request. The incident is currently under investigation. https://floridatechthehub.betteruptime.com/incident/168199 Tue, 12 Apr 2022 16:53:00 -0000 https://floridatechthehub.betteruptime.com/incident/168199#7ec1a93b9494230808da4b208129700fc8ec0d4cb6a335b15895eb1ebae63733 Incident The following is the incident report for the outage on April 11, 2022. I understand this service issue has impacted our operation and students' services, and I apologize to everyone affected. Issue Summary From 10:26 AM to 6:30 PM EST, requests to most of The Hub pages resulted in 503 error response messages. At its peak, the issue affected 100% of traffic to The Hub. The root cause of this outage was database ran out of resources to process incoming queries. Timeline (EST) 10:26 AM: Outage begins 10:30 AM: Issue noticed, and started searching for the cause. 11:00 AM: Rollback to the lasted known version of The Hub 12:10 PM: The problem persists. Continue searching for the cause. 12:20 PM: Restart the server 12:30 PM: The problem persists. Continue searching for the reason. 3:00 PM: Identity System running out of resources 3:10 PM: Identity MariaDB service is the cause of system overloading 3:20 PM: Check all running queries running on the system 4:30 PM: Kill all MariaDB service processes and only allow certain users to access The Hub 5:30 PM: Remove the questionable view table; materialize its table content, and index the new table 6:00 PM: Push the latest version to the server 6:30 PM: 100% of traffic back online Root Cause The Hub system restores all students' data within one table named `classes`, and a view table summarizes all students from 2005. Multiple APIs and pages rely on the `Students` view table to render and search students' names and records. The process uses many resources to process each query, from page rendering to API access. When a certain amount of traffic accesses a page or API witch uses the view table, the system will use many server resources. With only 2GB RAM for the server, the system ran out of resources and denied any internet requests. Resolution and recovery At 10:30 AM EST, the system developer noticed an access problem with The Hub system and investigated and quickly escalated the issue. At 11:00 AM, I attempted to roll back to a previous version since the system had a patch updated earlier in the morning. This rollback failed since the problem didn't cause by the update. At 3:00 PM, we noticed that no MariaDB service was used, almost total system usage, and processes would not finish. We killed all the SQL query processes, and The Hub system was back online for 5 minutes. At 3:20 PM, I checked which query or function was causing the problem and restricted only developers and access to the service. Around 5:00 PM, I identified all questionable questions and removed all related code. Then, the system resources recovered, and the system was back online. At 6:00 PM, I pulled the dubious view table, materialized its content, and indexed a new table. After pushing the lasted version back to the server, 100% of traffic returned online at 6:30 PM. Corrective and Preventative Measures The following are actions I am taking to address the underlying causes of the issue and to help prevent recurrence and improve response times: Materialize all students' data in the database to reduce database system usage. (Completed.) Add more SQL query size. (Completed.) Add a secondary server to switch when a server fails. Develop a better students information database structure to handle queries with fewer resources Update the system framework to the newest version to manage the overloading problem better https://floridatechthehub.betteruptime.com/incident/168199 Mon, 11 Apr 2022 22:30:00 -0000 https://floridatechthehub.betteruptime.com/incident/168199#e2f6201401e4164a84dc3bcdb475b851049a64631fca42758b034f82af17c813 Incident All service is back to normal. We will provide an incident report tomorrow (04/12/2022). https://floridatechthehub.betteruptime.com/incident/168199 Mon, 11 Apr 2022 14:26:00 -0000 https://floridatechthehub.betteruptime.com/incident/168199#ce61b3c1555eb3095209071b93b85a32abf78901cbfd9ef990dd9e3ed0c7b79c Incident We are experiencing downtime for the primary server, and our team is working on a solution to restore the service.