We are currently experiencing a partial outage in our New York location. Our System Administrators are actively working with our onsite technicians to restore service as quickly as possible.
Affecting Other - Network
We are currently experiencing a partial outage in our Chicago location. Our network engineers are actively working with our upstream providers to restore connectivity as quickly as possible.
Affecting System - SLC-0541
We are performing an emergency maintenance to replace a fan in one of our hypervisors in our Salt Lake City data center. This should be done soon and servers will be back online soon. Thank you for your understanding.
Affecting Other - Local Seattle Network
There is a network issue in the Seattle area affecting the ability to connect to our data center. We are currently working on it and will update you as soon as possible.
We are performing emergency maintenance on one of our hypervisors in our Salt Lake City data center. This is affecting some customers as well as our shared server fms-301-slc.oditech.com. Our Infrastructure team is currently working on bringing these servers back online. We will update this post as soon as we have more information.
If you have any questions or concerns, please contact support@oditech.com
Affecting Server - ODI SSD Cloud
We are experiencing an issue with one of our hypervisors in the Salt Lake City data center. Not all of our clients in the SLC data center will be experiencing this outage as it only pertains to one hypervisor. The servers will be automatically started once the issue has been resolved.
Thank you for your patience.
ODI Support Staff
Affecting Other - Data Center
We are currently experiencing network issues in our Chicago SSD Cloud. Our network engineers are currently investigating the issue, but there is no ETA at this time.
Affecting Server - fms-301-slc
We had a hardware failure on fms-301-slc.oditech.com and are working on repairing the server. The server will automatically be restarted when it is completed.
We are sorry for any inconvenience.
ODITech Support
Affecting Other - Data Center
There is a network issue in our NYC data center that is affecting connectivity for customers. We are currently working on getting the network back up and running and will update this post as soon as we have more information.
Thank you for your patience.
Update:
The issue has been resolved.
ODI Support Team
Affecting Server - fms11
We are currently experiencing issues with this server. Engineers are hard at work getting the server back up.
Sorry for any inconvenience.
ODITech Support
Affecting Server - fms13-010-pdx
The server fms13-010-pdx.oditech.com is being restarted for emergency maintenance. This should take about 10 minutes.
Thank you for your patience.
ODI Support Staff
Affecting System - SAN
We are having an issue with one of our SAN's (storage array) in our Washington DC datacenter. Engineers are currently working on the issue. All servers connected to this SAN will be restarted.
Thanks for your patience.
ODI Support
Affecting System - SLC Datacenter Hypervisor
We have an issue with one of our hypervisors in our Salt Lake City data center and are working to resolve the issue. This hypervisor issue is only affecting a few clients. We are sorry for any inconvenience and will have the issue resolved shortly.
Thank you for your patience.
ODITech Support Staff
Affecting Server - ODI SSD Cloud
We had an issue this afternoon that required us to restart one of our clouds in our NYC data center. Service should be restored soon.
Sorry for any inconvience,
ODITech Support Staff
Affecting System - NYC SSD Cloud
We are experiencing an issue with one of our hypervisors in our NYC data center. This is affecting some dedicated servers as well as one shared server (fms-301-nyc.oditech.com) We are working hard to resolve the issue and will have the service back online soon.
Thanks for your patience.
UPDATE:
Issue has been resolved and service is back to normal
ODI Support Staff
Affecting Server - fms12-010-dca
Because data integrity is very important to us we often check our servers for data issues. We detected that the server fms12-010-dca.oditech.com needed a disk check and it was started at 11:30 EST. This should be completed shortly and we thank you for your patience.
Affecting System - NYC Cloud
We are currently experiencing some network issues in our NYC data center. This is causing slowdowns and dropped connections to servers located at this data center. We are doing everything to bring the service back to normal operations. We appreciate your patience.
ODI Support Team
Affecting Other - Networking
We are currently having some network issues in our Salt Lake City data center. Our engineers are currently wirking on this and we will have it operational ASAP.
Thank you for your patience.
ODI Support Team
Affecting Other - New York City Network Issue
Good Afternoon,
We have been alerted of an issues with all servers in our NYC datacenter location. Our network administrators are working to correct the issue you now. We will update this message as soon as network connectivity has been restored to all servers.
We apologize for the inconvenience and appreciate the patience as we work through this outage.
ODI Support Staff
UPDATE:
All servers are now operating normally. Please login to your databases and verify that everything is running correctly. If you are still experiencing issues please open a support ticket by emailing support@oditech.com.
Thanks
Affecting System - NYC Data Center
One of our hypervisors in our NYC data center had a hadware failure. We are working hard to resolve the issue. Should not be very long.
We apologize for any inconvenience.
ODITech Support Team
Affecting Other - SLC Cloud
One of the SANs in our SLC cloud has gone down. Our infrastructure engineers are aware of the issue and have been working to get it back online. We will provide an update once we have more information.
Affecting Server - fms13-010-pdx
Emergency maintenance is being done on fms13-010-pdx.oditech.com for approx. 1 hour. This is to improve performance and server capacity. We apologize for any inconvenience.
ODITech Support
support@oditech.com
Affecting Server - fms12-010-dca
We had to perform emergency maintenance on the server fms12-010-dca.oditech.com this evening. This should not take very long and we apologize for any inconvience.
ODITech Support Team support@oditech.com
Affecting Other - Router
This morning we had a core router failure upstream from ODITech. This caused outages to our Portland, OR data center. Because our website is also in this data center, our site was down as well. The router has been replaced and everything is back up.
Affecting Server - fms13-010-pdx
We were having an issue with the FileMaker Admin service on this server. We decided to restart the server to restore the service. We also added RAM to this server when we did the restart to ensure server performance. The server is now up and running and the issue should be resolved.
Affecting Server - fms12-010-dca
[update] - This individual server had an issue with the security update that was posted to our Xen Cloud. This has been fixed and the server is operating normally. If you are still having issues please contact ODI Support at support@oditech.com or by calling 877-735-9299
Server maintenance has started on our Washington DC zone, this shouldnt take a long time and should be done within the hour.
The update is a critical security update on XEN and we needed to update our hypervisors ASAP.
We are sorry for any inconvenience.
ODI Support Team
Affecting Other - ODI Cloud
Today, a 3rd party vulnerability was reported to us (URL: http://xenbits.xen.org/xsa/ Reference: XSA-108) within the Xen hypervisor that requires an immediate patch, we have acquired the patch for this issue and have begun patching our system.
The patch is now being deployed on all hypervisors. We anticipate downtime will be approximately 20 minutes per server.
Security is of the up most importance to us at ODI and this vulnerability is so severe that we made the decision to update our system ASAP
We are sorry for any inconvience that this may have caused.
ODI Support Team
Affecting Server - fms11
Update 5:58PM
The new fms11 server has been rebuilt! The databases will now be moved from clancy.oditech.com to the new server. After the databases have been moved we will then restore the admin console access. We will then start moving the backups back to the server. You will then be able to get to your ftp space.
Update 1:44PM
It appears that the server was infected by a file uploaded by a customer. We have quarantined the server to clean it. The clean databases have been moved to another database server that you can access now. The server name is:
clancy.oditech.com
If you have any questions please call our support staff.
Thanks
fms11.oditech.com was restarted at 11AM this morning due to emergency maintenance. The server is back online, however, Instant Web Publishing and Custom Web Publishing are still down for this server. There were corrupt files pertaining to these services and the server is being redeployed. Service should be back shortly.
Thank you for your patience.
ODI Support Staff
Affecting Other - Portland, OR Data Center
Today we had a very large distributed denial of service attack on our Portland, Oregon data center. This is the largest attack that we have seen to date and slowed our network to a crawl. The attack came from over 300 locations which makes it very difficult to mitigate. The situation has been dealt with and network operations have returned to normal. We always strive for 100% uptime and are doing everything we can to avoid attacks such as this. We did learn a lot in this most recent attack and will use this knowledge to continue to protect our networks from attack.
We value our customers and appreciate your patience during this time. If you have any questions please direct them to support.oditech.com
Thanks
Affecting Other - PDX Data Center
This morming we had a DDOS attack on our network located in Portland, Oregon. We have resolved the situation and will continue to monitor our network. Sorry for any inconvience.
ODI Network Staff
Affecting Server - cp10
This morning the server cp10.oditech.com was under a dictionary attack which caused email slowdowns and restarting of services on the server. The situation is ongoing and we are doing everything we can to minimize the effect to our clients.
Affecting Server - fms12-010-pdx
Due to growth we had to upgrade the server fms12.oditech.com tonight. We added more ram and also took this time to separate our drives on the system. We hope that this will keep our server performing at top speed. Thank you for you patience.
Affecting System - DNS
This morning Network Solution sent out some wrong DNS information for our domain oditech.com which has since been corrected. Some DNS server picked up this information and it is causing some loss of connectivity to ODI's servers. This will correct itself automatically as the DNS updates. You can access all of our servers via IP address if you need immediate connectivity. To find you IP address please contact support at 877-735-9299 or email support@oditech.com