tag:status.onshape.com,2005:/historyOnshape Status - Incident History2024-03-19T04:49:09-04:00Onshapetag:status.onshape.com,2005:Incident/202727682024-03-15T16:43:30-04:002024-03-15T16:43:30-04:00Rendering services are unavailable - waiting for a resource<p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>16:43</var> EDT</small><br><strong>Resolved</strong> - All rendering services are now functioning correctly. We apologize for the disruption.</p><p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>16:37</var> EDT</small><br><strong>Investigating</strong> - Rendering services are unavailable in all regions. We are working on remediating this now.</p>tag:status.onshape.com,2005:Incident/201745722024-03-06T06:26:18-05:002024-03-06T06:26:18-05:00Slow response in all regions<p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>06:26</var> EST</small><br><strong>Resolved</strong> - A database configuration issue caused increased load and decreased performance. This configuration change has been rolled back. Our apologies for the disruption.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>05:04</var> EST</small><br><strong>Investigating</strong> - Our automated systems are reporting slow performance and a high rate of errors in all regions. We are investigating.</p>tag:status.onshape.com,2005:Incident/194173562023-12-12T11:33:03-05:002023-12-12T11:33:03-05:00Unable to open 2D drawings in the North America region<p><small>Dec <var data-var='date'>12</var>, <var data-var='time'>11:33</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'>12</var>, <var data-var='time'>11:10</var> EST</small><br><strong>Identified</strong> - We have identified a problem with opening drawings in the North America region. We are implementing a mitigation now.</p>tag:status.onshape.com,2005:Incident/192381312023-11-28T19:13:01-05:002023-11-28T19:13:01-05:00Documents list page is very slow to load.<p><small>Nov <var data-var='date'>28</var>, <var data-var='time'>19:13</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>28</var>, <var data-var='time'>18:50</var> EST</small><br><strong>Investigating</strong> - We are seeing the documents list page load very slowly. We are investingating.</p>tag:status.onshape.com,2005:Incident/190619282023-11-11T21:40:19-05:002023-11-11T21:40:19-05:00Slow drawings performance<p><small>Nov <var data-var='date'>11</var>, <var data-var='time'>21:40</var> EST</small><br><strong>Resolved</strong> - The cause for some users experiencing slow drawings performance has been resolved.</p><p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>14:53</var> EST</small><br><strong>Investigating</strong> - We are investigating reports of slow drawings performance for some users.</p>tag:status.onshape.com,2005:Incident/190469592023-11-07T16:53:01-05:002023-11-07T16:53:01-05:00Some users are reporting problems opening drawings<p><small>Nov <var data-var='date'> 7</var>, <var data-var='time'>16:53</var> EST</small><br><strong>Resolved</strong> - The incident has been resolved. A code change that was deployed with the 1.172 release last night caused some random drawings and release management failures. We have remediated the issue and have deployed it to production. We have been monitoring for a few hours and have confirmed that the problem is no longer occurring.</p><p><small>Nov <var data-var='date'> 7</var>, <var data-var='time'>10:14</var> EST</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.onshape.com,2005:Incident/189700632023-10-30T13:37:49-04:002023-10-30T13:37:49-04:00Increased rates of Onshape disconnects in North America region<p><small>Oct <var data-var='date'>30</var>, <var data-var='time'>13:37</var> EDT</small><br><strong>Resolved</strong> - The issue has been resolved. A code push caused instability in one of our internal services that did not show up during our testing. The push was reverted and the service has recovered. We apologize for the disruption.</p><p><small>Oct <var data-var='date'>30</var>, <var data-var='time'>13:23</var> EDT</small><br><strong>Update</strong> - This issue is impacting all regions. We have implemented a fix and are waiting for the change to propagate through the service.</p><p><small>Oct <var data-var='date'>30</var>, <var data-var='time'>13:18</var> EDT</small><br><strong>Investigating</strong> - We are seeing increased rates of Onshape disconnects in North America region. We are investigating.</p>tag:status.onshape.com,2005:Incident/189340612023-10-26T09:34:10-04:002023-10-26T09:34:10-04:00Onshape community forum is down for maintenance<p><small>Oct <var data-var='date'>26</var>, <var data-var='time'>09:34</var> EDT</small><br><strong>Resolved</strong> - The forums incident has been resolved.</p><p><small>Oct <var data-var='date'>26</var>, <var data-var='time'>08:54</var> EDT</small><br><strong>Update</strong> - The Onshape community forum is now down. We are still working with our forum partner to get a resolution.</p><p><small>Oct <var data-var='date'>26</var>, <var data-var='time'>08:22</var> EDT</small><br><strong>Identified</strong> - We are working with our forum partner to get a time to resolution.</p>tag:status.onshape.com,2005:Incident/186004612023-09-26T10:52:59-04:002023-09-26T10:52:59-04:00Search results are delayed or not showing recent changes<p><small>Sep <var data-var='date'>26</var>, <var data-var='time'>10:52</var> EDT</small><br><strong>Resolved</strong> - Reindexing of our search data completed at about 02:00 UTC today. Search functionality has returned to normal. We apologize for the extended period of reduced functionality.</p><p><small>Sep <var data-var='date'>25</var>, <var data-var='time'>12:33</var> EDT</small><br><strong>Update</strong> - We continue to see delays in the ability to search for newly created parts. We are currently processing a backlog of search indexing requests.</p><p><small>Sep <var data-var='date'>25</var>, <var data-var='time'>08:19</var> EDT</small><br><strong>Investigating</strong> - We are receiving reports of search results being delayed or incomplete. We are investigating this issue now.</p>tag:status.onshape.com,2005:Incident/185785332023-09-22T14:08:55-04:002023-09-22T14:08:55-04:00Onshape is not responding<p><small>Sep <var data-var='date'>22</var>, <var data-var='time'>14:08</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved. We will be implementing changes to prevent this situation from happening in the future.</p><p><small>Sep <var data-var='date'>22</var>, <var data-var='time'>13:15</var> EDT</small><br><strong>Monitoring</strong> - We have identified the issue and implemented a fix. We are monitoring and working on establishing a root cause.</p><p><small>Sep <var data-var='date'>22</var>, <var data-var='time'>13:04</var> EDT</small><br><strong>Investigating</strong> - We are investigating problems accessing Onshape.</p>tag:status.onshape.com,2005:Incident/185392392023-09-18T17:45:35-04:002023-09-18T17:45:35-04:00Delays importing and exporting documents in the North America region<p><small>Sep <var data-var='date'>18</var>, <var data-var='time'>17:45</var> EDT</small><br><strong>Resolved</strong> - We are currently redirecting export and export requests to servers in Western Europe. This issue is resolved. We will resume North America imports and exports once the cloud provider issues resolve.</p><p><small>Sep <var data-var='date'>18</var>, <var data-var='time'>17:13</var> EDT</small><br><strong>Identified</strong> - The cloud provider networking issues from earlier are persisting and causing us to be unable to import / export documents in the North America region. We are working to mitigate this issue now.</p>tag:status.onshape.com,2005:Incident/185376432023-09-18T16:59:14-04:002023-09-18T16:59:14-04:00Degraded performance in North America<p><small>Sep <var data-var='date'>18</var>, <var data-var='time'>16:59</var> EDT</small><br><strong>Resolved</strong> - The networking incident has been resolved.</p><p><small>Sep <var data-var='date'>18</var>, <var data-var='time'>14:38</var> EDT</small><br><strong>Identified</strong> - Our cloud provider is experiencing networking issues in their Oregon data center. This is currently presenting as performance issue with Onshape. This performance issue may extend to other regions outside the US. You may also experience some operation failures if this issue persists / expands.<br /><br />We will post updates here as we learn more information.</p>tag:status.onshape.com,2005:Incident/182117242023-08-21T12:46:28-04:002023-08-21T12:46:29-04:00Delayed import / export processing<p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>12:46</var> EDT</small><br><strong>Resolved</strong> - The issue has been resolved and we are working with the operations team to prevent this from happening again.</p><p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>12:08</var> EDT</small><br><strong>Identified</strong> - We have identified an issue that is causing imports and exports to be delayed. We are working on resolving the issue now.</p>tag:status.onshape.com,2005:Incident/180512622023-08-04T09:38:55-04:002023-08-04T09:38:55-04:00Errors getting enterprise analytic data and slow performance<p><small>Aug <var data-var='date'> 4</var>, <var data-var='time'>09:38</var> EDT</small><br><strong>Resolved</strong> - We have resolved the remaining issues. We are working with engineering to determine a root cause for the problem. We apologize for the disruption.</p><p><small>Aug <var data-var='date'> 4</var>, <var data-var='time'>09:05</var> EDT</small><br><strong>Monitoring</strong> - At 11:04 UTC today operational monitors began reporting that Enterprise Analytics access was failing. Starting about 30 minutes later, general performance in the US region was decreased. This also caused exports of drawings to fail.<br /><br />An internal auto scaling service failed. The operations team has recovered the auto scaling service and the overall performance has recovered. We are still seeing some failures with drawings exports and we are working through those issues now.</p>tag:status.onshape.com,2005:Incident/173446602023-05-23T21:03:39-04:002023-05-23T21:03:39-04:00Onshape is unable to send email<p><small>May <var data-var='date'>23</var>, <var data-var='time'>21:03</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>May <var data-var='date'>23</var>, <var data-var='time'>16:32</var> EDT</small><br><strong>Monitoring</strong> - Email delivery has been resumed. Any emails that were generated by the Onshape product from about 19:50 - 20:05 UTC were not delivered.</p><p><small>May <var data-var='date'>23</var>, <var data-var='time'>16:03</var> EDT</small><br><strong>Identified</strong> - Onshape is currently unable to send email through our email provider. Account signups cannot be completed until this has been resolved.</p>tag:status.onshape.com,2005:Incident/171923982023-05-09T09:01:56-04:002023-05-09T09:01:56-04:00Document open failures in the Western Europe region<p><small>May <var data-var='date'> 9</var>, <var data-var='time'>09:01</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>May <var data-var='date'> 9</var>, <var data-var='time'>08:57</var> EDT</small><br><strong>Monitoring</strong> - We have resolved the issue causing the document open failures and we are monitoring the service for any additional issues. We apologize for the disruption.</p><p><small>May <var data-var='date'> 9</var>, <var data-var='time'>08:42</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating an increased document open failure rate in the EU. We will update here as the investigation progresses.</p>tag:status.onshape.com,2005:Incident/160557622023-02-07T21:07:24-05:002023-02-07T21:27:12-05:00Onshape is not responding<p><small>Feb <var data-var='date'> 7</var>, <var data-var='time'>21:07</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved. We experienced multiple database failures in one of our primary database clusters that took Onshape offline for about 8 minutes starting at 17:06 UTC today. No data was lost. The operations and site reliability teams have identified the issue and are engineering changes to prevent this from happening again. We apologize for the disruption.</p><p><small>Feb <var data-var='date'> 7</var>, <var data-var='time'>12:14</var> EST</small><br><strong>Monitoring</strong> - The service has recovered. We are monitoring and working to prevent the issue from happening again.</p><p><small>Feb <var data-var='date'> 7</var>, <var data-var='time'>12:13</var> EST</small><br><strong>Investigating</strong> - Automated systems are reporting that Onshape is not responding. We are investigating this now.</p>tag:status.onshape.com,2005:Incident/151847292022-12-15T06:52:22-05:002022-12-15T06:52:22-05:00Delayed Enterprise Analytics<p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>06:52</var> EST</small><br><strong>Resolved</strong> - The recovery of the Enterprise Analytics data has completed. All data has been restored.</p><p><small>Dec <var data-var='date'>14</var>, <var data-var='time'>16:07</var> EST</small><br><strong>Update</strong> - Our engineering and operations teams continue to work to restore full access to our Enterprise Analytics service. We expect this to complete within the next 8 hours.</p><p><small>Dec <var data-var='date'>14</var>, <var data-var='time'>11:13</var> EST</small><br><strong>Identified</strong> - We have identified an issue where Enterprise Plan analytics is not showing data for the past month. The Enterprise Analytics team is currently working to restore access to this data. We will provide an additional update within the next 4 hours.</p>tag:status.onshape.com,2005:Incident/137006072022-11-25T22:36:00-05:002022-11-25T22:36:00-05:00503 Service Temporarily Unavailable in all regions<p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>22:36</var> EST</small><br><strong>Resolved</strong> - We have reverted to the pervious networking configuration and are monitoring. All services are currently reporting as healthy. We are working with engineering to understand the cause of this outage.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>22:04</var> EST</small><br><strong>Identified</strong> - This issue has been identified and the causal networking change has been reverted. Currently only the Tokyo region is experiencing errors.</p><p><small>Nov <var data-var='date'>25</var>, <var data-var='time'>21:35</var> EST</small><br><strong>Investigating</strong> - All regions are currently reporting a "503 Service Temporarily Unavailable". We are working to identify and resolve this issue as soon as possible.</p>tag:status.onshape.com,2005:Incident/126734302022-10-31T08:30:00-04:002022-10-31T12:07:16-04:00Potential for some lost modeling changes<p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>08:30</var> EDT</small><br><strong>Resolved</strong> - Starting at 12:41 UTC one of the database clusters containing design data in the US was unable to accept writes for about 3 minutes. This was due to a configuration error that was automatically resolved by automation. Modeling changes for a very small set of users during this period were not persisted to the database and were lost. We sincerely apologize for this failure on our part and will work harder to regain your trust.</p>tag:status.onshape.com,2005:Incident/122533042022-10-18T11:36:55-04:002022-10-18T11:36:55-04:00Delayed search results in all regions<p><small>Oct <var data-var='date'>18</var>, <var data-var='time'>11:36</var> EDT</small><br><strong>Resolved</strong> - The incident has been resolved. We are working with engineering to prevent this from recurring.</p><p><small>Oct <var data-var='date'>18</var>, <var data-var='time'>11:20</var> EDT</small><br><strong>Investigating</strong> - We are investigation an issue where search results are being delayed.</p>tag:status.onshape.com,2005:Incident/112089062022-09-21T20:08:05-04:002022-09-21T20:08:05-04:00Delayed search indexing<p><small>Sep <var data-var='date'>21</var>, <var data-var='time'>20:08</var> EDT</small><br><strong>Resolved</strong> - The incident has been resolved. Search indexing times are returning to normal and should be close to real-time with the next 30 minutes.</p><p><small>Sep <var data-var='date'>21</var>, <var data-var='time'>12:23</var> EDT</small><br><strong>Identified</strong> - Our automated systems are reporting that search indexing is delayed. This will result in some delays before new documents can be searched.</p>tag:status.onshape.com,2005:Incident/111929602022-09-20T09:59:38-04:002022-09-20T09:59:38-04:00High error count in all regions<p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>09:59</var> EDT</small><br><strong>Resolved</strong> - We have identified the issue and have fully recovered the service. A failure of an automated database replacement job caused an unexpected problem in the service. We are working to add additional protections to prevent this from recurring.</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>09:41</var> EDT</small><br><strong>Update</strong> - The Onshape service is experiencing a widepsread outage. We are working to restore the service now.</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>09:24</var> EDT</small><br><strong>Investigating</strong> - Our automated systems are reporting high levels of errors in all regions. We are investigating.</p>tag:status.onshape.com,2005:Incident/110493832022-09-04T08:54:19-04:002022-09-04T08:54:19-04:00www.onshape.com is returning "404 Page Not Found"<p><small>Sep <var data-var='date'> 4</var>, <var data-var='time'>08:54</var> EDT</small><br><strong>Resolved</strong> - The issue impacting Onshape home page at https://www.onshape.com has been resolve.</p><p><small>Sep <var data-var='date'> 3</var>, <var data-var='time'>21:02</var> EDT</small><br><strong>Investigating</strong> - The Onshape home page at onshape.com / www.onshape.com is returning a 404 "Page Not Found". We are working with our home page vendor to resolve this issue.<br /><br />The Onshape CAD service is not impacted. https://cad.onshape.com is still fully functional.</p>tag:status.onshape.com,2005:Incident/107856822022-08-08T14:30:00-04:002022-08-08T17:10:17-04:00Connection timeouts seen to the North America region<p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>14:30</var> EDT</small><br><strong>Resolved</strong> - A single load balancer was degraded and not properly answer requests which resulted in timeouts. This incident has since been resolved. <br /><br />We are working with engineering to prevent this from happening again.</p>