Incidents | ChangeSprout, Inc. Incidents reported on status page for ChangeSprout, Inc. https://status.controlshiftlabs.com/ https://d1lppblt9t2x15.cloudfront.net/logos/e6bed78d86617ab7596cfdca151f3b5d.png Incidents | ChangeSprout, Inc. https://status.controlshiftlabs.com/ en Slow Page Loads https://status.controlshiftlabs.com/incident/545309 Tue, 15 Apr 2025 00:49:00 -0000 https://status.controlshiftlabs.com/incident/545309#b22a44ee22342df6ea292d3f20dc3b5c6db83c0a968e397471e32324aefd1d15 We're recovering but continuing to monitor traffic. We'll be performing a full post-mortem to ensure that similar traffic spikes don't cause outages in the future. Slow Page Loads https://status.controlshiftlabs.com/incident/545309 Tue, 15 Apr 2025 00:31:00 -0000 https://status.controlshiftlabs.com/incident/545309#30ae5e3016c5b86551dce5c1c3c2e4becf3137a897d76c6b5b6e533478856910 We're working to mitigate the platform outage. More updates to follow. ControlShift Platform (US datacenter) recovered https://status.controlshiftlabs.com/ Tue, 15 Apr 2025 00:29:22 +0000 https://status.controlshiftlabs.com/#e34d5492da1c42fde7e3296014f56faa5fcf2d280a661b2875111fa382dea11b ControlShift Platform (US datacenter) recovered ControlShift Platform (US datacenter) went down https://status.controlshiftlabs.com/ Tue, 15 Apr 2025 00:27:17 +0000 https://status.controlshiftlabs.com/#e34d5492da1c42fde7e3296014f56faa5fcf2d280a661b2875111fa382dea11b ControlShift Platform (US datacenter) went down ControlShift Platform (US datacenter) recovered https://status.controlshiftlabs.com/ Tue, 15 Apr 2025 00:22:17 +0000 https://status.controlshiftlabs.com/#250c712901cfd6b5457377ec9cacd8fa8535a0645c4f0b6803495820198ba2fc ControlShift Platform (US datacenter) recovered Slow Page Loads https://status.controlshiftlabs.com/incident/545309 Tue, 15 Apr 2025 00:21:00 -0000 https://status.controlshiftlabs.com/incident/545309#28553c413cd327f8a117aea3546903aeb87802678af4fd8a540fea81a57c6430 We're investigating reports of slow page loads. Updates to follow. ControlShift Platform (US datacenter) went down https://status.controlshiftlabs.com/ Tue, 15 Apr 2025 00:17:16 +0000 https://status.controlshiftlabs.com/#250c712901cfd6b5457377ec9cacd8fa8535a0645c4f0b6803495820198ba2fc ControlShift Platform (US datacenter) went down ControlShift Platform (US datacenter) recovered https://status.controlshiftlabs.com/ Tue, 15 Apr 2025 00:02:17 +0000 https://status.controlshiftlabs.com/#0ee6ed9d247489d0f9279733947ac3951bfc65432b9743f79d3d4d763ab0a86e ControlShift Platform (US datacenter) recovered ControlShift Platform (US datacenter) went down https://status.controlshiftlabs.com/ Tue, 15 Apr 2025 00:01:16 +0000 https://status.controlshiftlabs.com/#0ee6ed9d247489d0f9279733947ac3951bfc65432b9743f79d3d4d763ab0a86e ControlShift Platform (US datacenter) went down Timeouts https://status.controlshiftlabs.com/incident/529214 Sun, 16 Mar 2025 19:43:00 -0000 https://status.controlshiftlabs.com/incident/529214#8a622ad103293d99d4d72b81edf756fdf3f196dc6a0597011e7a15aed50eecc6 We have implemented immediate measures to mitigate the attack, and sites should be responding normally now. All data is safe, and we will investigate additional ways to prevent this sort of issue in the future. ControlShift Platform (US datacenter) recovered https://status.controlshiftlabs.com/ Sun, 16 Mar 2025 19:30:03 +0000 https://status.controlshiftlabs.com/#cddc880707ac315698bb410d4ea084ab2a1e7c916ecac0f5503458bd8b133ad7 ControlShift Platform (US datacenter) recovered Timeouts https://status.controlshiftlabs.com/incident/529214 Sun, 16 Mar 2025 19:26:00 -0000 https://status.controlshiftlabs.com/incident/529214#f9cc0baaa94a39516a9ced69782b7fc7c0a7bd6db600e7b967847c14cf13f7a2 Visitors to some pages are experiencing timeouts as a consequence of a DDoS attack on one of our customers. We are working to mitigate the issue now. ControlShift Platform (US datacenter) went down https://status.controlshiftlabs.com/ Sun, 16 Mar 2025 19:17:02 +0000 https://status.controlshiftlabs.com/#cddc880707ac315698bb410d4ea084ab2a1e7c916ecac0f5503458bd8b133ad7 ControlShift Platform (US datacenter) went down Certificate issues https://status.controlshiftlabs.com/incident/505074 Fri, 31 Jan 2025 15:03:00 -0000 https://status.controlshiftlabs.com/incident/505074#e3c1b85cb73a9d4a3c2d336b1865715c0664e3969cccc9ad93ac361e15802f25 We've restored the previous certificate, and sites are back online. We're working to ensure the problem does not recur. ControlShift Platform (US datacenter) recovered https://status.controlshiftlabs.com/ Fri, 31 Jan 2025 15:01:21 +0000 https://status.controlshiftlabs.com/#97c14e4f7f91eab32ff46a31646b9a64140534f191210e4f95b637b9c1388d82 ControlShift Platform (US datacenter) recovered Certificate issues https://status.controlshiftlabs.com/incident/505074 Fri, 31 Jan 2025 14:48:00 -0000 https://status.controlshiftlabs.com/incident/505074#8b21e2ce9679ff655104b3d47b6bb05bb9b969026260df365a40250627cdb662 Some customer sites are currently unreachable due to a problem with the HTTPS certificate. We are actively working to resolve the problem. ControlShift Platform (US datacenter) went down https://status.controlshiftlabs.com/ Fri, 31 Jan 2025 14:46:27 +0000 https://status.controlshiftlabs.com/#97c14e4f7f91eab32ff46a31646b9a64140534f191210e4f95b637b9c1388d82 ControlShift Platform (US datacenter) went down New Year's Day Scheduled Maintenance https://status.controlshiftlabs.com/incident/479237 Wed, 01 Jan 2025 18:30:00 +0000 https://status.controlshiftlabs.com/incident/479237#f8adc7422c71b0e199ea936cc447131122c30e6751cecd647bd4ac522a1f4edf Maintenance completed New Year's Day Scheduled Maintenance https://status.controlshiftlabs.com/incident/479237 Wed, 01 Jan 2025 18:30:00 +0000 https://status.controlshiftlabs.com/incident/479237#f8adc7422c71b0e199ea936cc447131122c30e6751cecd647bd4ac522a1f4edf Maintenance completed ControlShift Platform (US datacenter) recovered https://status.controlshiftlabs.com/ Wed, 01 Jan 2025 16:15:13 +0000 https://status.controlshiftlabs.com/#914fc88251e1f457ffde8babc9b4569708601d546732f5da07e9fa86116c6d5d ControlShift Platform (US datacenter) recovered New Year's Day Scheduled Maintenance https://status.controlshiftlabs.com/incident/479237 Wed, 01 Jan 2025 15:25:10 -0000 https://status.controlshiftlabs.com/incident/479237#f4c92cb471a302992356cb9eb9dfa86a4bc2dd18c662c497ae700e65bd603b4a We'll be upgrading our infrastructure to ensure reliability and performance for the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance window. Updates will be posted on this status page as maintenance progresses. New Year's Day Scheduled Maintenance https://status.controlshiftlabs.com/incident/479237 Wed, 01 Jan 2025 15:25:10 -0000 https://status.controlshiftlabs.com/incident/479237#f4c92cb471a302992356cb9eb9dfa86a4bc2dd18c662c497ae700e65bd603b4a We'll be upgrading our infrastructure to ensure reliability and performance for the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance window. Updates will be posted on this status page as maintenance progresses. Platform offline https://status.controlshiftlabs.com/incident/489436 Wed, 01 Jan 2025 15:24:00 -0000 https://status.controlshiftlabs.com/incident/489436#f63863af0a5f7c3dacaf8916d54cec0d202f897a1a29ff5d539d0dcc6c4cda78 Maintenance is completed in our US data center. Platform offline https://status.controlshiftlabs.com/incident/489436 Wed, 01 Jan 2025 15:24:00 -0000 https://status.controlshiftlabs.com/incident/489436#f63863af0a5f7c3dacaf8916d54cec0d202f897a1a29ff5d539d0dcc6c4cda78 Maintenance is completed in our US data center. Platform offline https://status.controlshiftlabs.com/incident/489436 Wed, 01 Jan 2025 15:24:00 -0000 https://status.controlshiftlabs.com/incident/489436#f63863af0a5f7c3dacaf8916d54cec0d202f897a1a29ff5d539d0dcc6c4cda78 Maintenance is completed in our US data center. Platform offline https://status.controlshiftlabs.com/incident/489436 Wed, 01 Jan 2025 15:24:00 -0000 https://status.controlshiftlabs.com/incident/489436#f63863af0a5f7c3dacaf8916d54cec0d202f897a1a29ff5d539d0dcc6c4cda78 Maintenance is completed in our US data center. Platform offline https://status.controlshiftlabs.com/incident/489436 Wed, 01 Jan 2025 15:24:00 -0000 https://status.controlshiftlabs.com/incident/489436#f63863af0a5f7c3dacaf8916d54cec0d202f897a1a29ff5d539d0dcc6c4cda78 Maintenance is completed in our US data center. ControlShift Platform (EU datacenter) recovered https://status.controlshiftlabs.com/ Wed, 01 Jan 2025 15:18:04 +0000 https://status.controlshiftlabs.com/#bb3ab1719101a2f0ec6ca357e73966a07479ddc971a084d64fb868b97198be20 ControlShift Platform (EU datacenter) recovered ControlShift Platform (EU datacenter) went down https://status.controlshiftlabs.com/ Wed, 01 Jan 2025 15:01:03 +0000 https://status.controlshiftlabs.com/#bb3ab1719101a2f0ec6ca357e73966a07479ddc971a084d64fb868b97198be20 ControlShift Platform (EU datacenter) went down ControlShift Platform (US datacenter) went down https://status.controlshiftlabs.com/ Wed, 01 Jan 2025 14:58:45 +0000 https://status.controlshiftlabs.com/#914fc88251e1f457ffde8babc9b4569708601d546732f5da07e9fa86116c6d5d ControlShift Platform (US datacenter) went down New Year's Day Scheduled Maintenance https://status.controlshiftlabs.com/incident/479237 Wed, 01 Jan 2025 14:00:42 -0000 https://status.controlshiftlabs.com/incident/479237#f4c92cb471a302992356cb9eb9dfa86a4bc2dd18c662c497ae700e65bd603b4a We'll be upgrading our infrastructure to ensure reliability and performance for the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance window. Updates will be posted on this status page as maintenance progresses. New Year's Day Scheduled Maintenance https://status.controlshiftlabs.com/incident/479237 Wed, 01 Jan 2025 14:00:42 -0000 https://status.controlshiftlabs.com/incident/479237#f4c92cb471a302992356cb9eb9dfa86a4bc2dd18c662c497ae700e65bd603b4a We'll be upgrading our infrastructure to ensure reliability and performance for the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance window. Updates will be posted on this status page as maintenance progresses. Platform offline https://status.controlshiftlabs.com/incident/489436 Wed, 01 Jan 2025 14:00:00 -0000 https://status.controlshiftlabs.com/incident/489436#4baa6d4bdd99ffefeb383a31787d95a0cfc933923b74feb4cd67fa25fa7c27a0 We're performing our yearly maintenance window on our servers. We expect the platform to be unavailable for about 4.5 hours. Platform offline https://status.controlshiftlabs.com/incident/489436 Wed, 01 Jan 2025 14:00:00 -0000 https://status.controlshiftlabs.com/incident/489436#4baa6d4bdd99ffefeb383a31787d95a0cfc933923b74feb4cd67fa25fa7c27a0 We're performing our yearly maintenance window on our servers. We expect the platform to be unavailable for about 4.5 hours. Platform offline https://status.controlshiftlabs.com/incident/489436 Wed, 01 Jan 2025 14:00:00 -0000 https://status.controlshiftlabs.com/incident/489436#4baa6d4bdd99ffefeb383a31787d95a0cfc933923b74feb4cd67fa25fa7c27a0 We're performing our yearly maintenance window on our servers. We expect the platform to be unavailable for about 4.5 hours. Platform offline https://status.controlshiftlabs.com/incident/489436 Wed, 01 Jan 2025 14:00:00 -0000 https://status.controlshiftlabs.com/incident/489436#4baa6d4bdd99ffefeb383a31787d95a0cfc933923b74feb4cd67fa25fa7c27a0 We're performing our yearly maintenance window on our servers. We expect the platform to be unavailable for about 4.5 hours. Platform offline https://status.controlshiftlabs.com/incident/489436 Wed, 01 Jan 2025 14:00:00 -0000 https://status.controlshiftlabs.com/incident/489436#4baa6d4bdd99ffefeb383a31787d95a0cfc933923b74feb4cd67fa25fa7c27a0 We're performing our yearly maintenance window on our servers. We expect the platform to be unavailable for about 4.5 hours. Timeouts in the EU datacenter https://status.controlshiftlabs.com/incident/429759 Mon, 16 Sep 2024 05:19:00 -0000 https://status.controlshiftlabs.com/incident/429759#5f17cfd7b1d68dc00c18e735bc2e3d0cce6aee1b06fe68313ce823b9edf75bbb The issue tentatively appears to have resolved. We are continuing to monitor the situation. Timeouts in the EU datacenter https://status.controlshiftlabs.com/incident/429759 Mon, 16 Sep 2024 05:19:00 -0000 https://status.controlshiftlabs.com/incident/429759#5f17cfd7b1d68dc00c18e735bc2e3d0cce6aee1b06fe68313ce823b9edf75bbb The issue tentatively appears to have resolved. We are continuing to monitor the situation. Timeouts in the EU datacenter https://status.controlshiftlabs.com/incident/429759 Mon, 16 Sep 2024 05:16:00 -0000 https://status.controlshiftlabs.com/incident/429759#bf818e40ba569b48a175aeb7d27403e9b993150970b6a0331e3fa4e5a61cab72 EU sites are back to responding normally, but there now appears to be a problem with the integration proxy service in the US. We're continuing to investigate. Timeouts in the EU datacenter https://status.controlshiftlabs.com/incident/429759 Mon, 16 Sep 2024 05:16:00 -0000 https://status.controlshiftlabs.com/incident/429759#bf818e40ba569b48a175aeb7d27403e9b993150970b6a0331e3fa4e5a61cab72 EU sites are back to responding normally, but there now appears to be a problem with the integration proxy service in the US. We're continuing to investigate. Integration Proxy Service (US datacenter) recovered https://status.controlshiftlabs.com/ Mon, 16 Sep 2024 05:15:29 +0000 https://status.controlshiftlabs.com/#30bcdd9249199a019b79af3eb104748a7df5ae2a97c5296a826fe3fc11f8b916 Integration Proxy Service (US datacenter) recovered Integration Proxy Service (US datacenter) went down https://status.controlshiftlabs.com/ Mon, 16 Sep 2024 05:11:29 +0000 https://status.controlshiftlabs.com/#30bcdd9249199a019b79af3eb104748a7df5ae2a97c5296a826fe3fc11f8b916 Integration Proxy Service (US datacenter) went down ControlShift Platform (EU datacenter) recovered https://status.controlshiftlabs.com/ Mon, 16 Sep 2024 05:04:40 +0000 https://status.controlshiftlabs.com/#4f6994db755c8e69afe77eb3ce1146e2cb4f8fed2ebc031e32fc1c7d6aeb1316 ControlShift Platform (EU datacenter) recovered Timeouts in the EU datacenter https://status.controlshiftlabs.com/incident/429759 Mon, 16 Sep 2024 04:50:00 -0000 https://status.controlshiftlabs.com/incident/429759#a94826c87b9f3bfe032bbdbd1b5da3afa98443ffd840cdfec193a35488976445 We're investigating reports of timeouts when trying to reach sites hosted in the EU datacenter. ControlShift Platform (EU datacenter) went down https://status.controlshiftlabs.com/ Mon, 16 Sep 2024 04:49:09 +0000 https://status.controlshiftlabs.com/#4f6994db755c8e69afe77eb3ce1146e2cb4f8fed2ebc031e32fc1c7d6aeb1316 ControlShift Platform (EU datacenter) went down Integration Proxy Service (EU datacenter) recovered https://status.controlshiftlabs.com/ Mon, 16 Sep 2024 04:46:02 +0000 https://status.controlshiftlabs.com/#26bc385788abde8e61369ea3c33cf3bb8937fc4552c0923a0d5fb74134b195b8 Integration Proxy Service (EU datacenter) recovered Integration Proxy Service (EU datacenter) went down https://status.controlshiftlabs.com/ Mon, 16 Sep 2024 04:44:59 +0000 https://status.controlshiftlabs.com/#26bc385788abde8e61369ea3c33cf3bb8937fc4552c0923a0d5fb74134b195b8 Integration Proxy Service (EU datacenter) went down ControlShift Platform (US datacenter) recovered https://status.controlshiftlabs.com/ Fri, 30 Aug 2024 17:56:44 +0000 https://status.controlshiftlabs.com/#2327b35f7e92622b204d3d1804fe6f017da4658683f30b7d4944231640c572de ControlShift Platform (US datacenter) recovered ControlShift Platform (US datacenter) went down https://status.controlshiftlabs.com/ Fri, 30 Aug 2024 17:53:44 +0000 https://status.controlshiftlabs.com/#2327b35f7e92622b204d3d1804fe6f017da4658683f30b7d4944231640c572de ControlShift Platform (US datacenter) went down ControlShift Platform (US datacenter) recovered https://status.controlshiftlabs.com/ Thu, 29 Aug 2024 16:24:19 +0000 https://status.controlshiftlabs.com/#1e71a9de80b24e1cfcf3dc0f9d1b2f58654e06a3fa46402a3b24925dc114f6d1 ControlShift Platform (US datacenter) recovered ControlShift Platform (US datacenter) went down https://status.controlshiftlabs.com/ Thu, 29 Aug 2024 16:17:55 +0000 https://status.controlshiftlabs.com/#1e71a9de80b24e1cfcf3dc0f9d1b2f58654e06a3fa46402a3b24925dc114f6d1 ControlShift Platform (US datacenter) went down Search infrastructure upgrades https://status.controlshiftlabs.com/incident/413352 Tue, 20 Aug 2024 13:15:48 -0000 https://status.controlshiftlabs.com/incident/413352#6585c9ed3d8694dbfacb55afc1bb2bf52f294184b4f05e18a7a44b8a57f89ae4 On Friday, August 16, we'll be performing upgrades on our search infrastructure. Search results may be incomplete until reindexing finishes. The rest of the platform should continue to operate normally. Search infrastructure upgrades https://status.controlshiftlabs.com/incident/413352 Mon, 19 Aug 2024 14:00:00 +0000 https://status.controlshiftlabs.com/incident/413352#6a4b05140aecdbbfad8256347836a245d7fb70788576375c764c3d61d43628f6 Maintenance completed Search infrastructure upgrades https://status.controlshiftlabs.com/incident/413352 Mon, 19 Aug 2024 13:08:59 -0000 https://status.controlshiftlabs.com/incident/413352#6585c9ed3d8694dbfacb55afc1bb2bf52f294184b4f05e18a7a44b8a57f89ae4 On Friday, August 16, we'll be performing upgrades on our search infrastructure. Search results may be incomplete until reindexing finishes. The rest of the platform should continue to operate normally. ControlShift Platform (US datacenter) recovered https://status.controlshiftlabs.com/ Fri, 16 Aug 2024 18:14:30 +0000 https://status.controlshiftlabs.com/#09613b6aba5af5908f5ea1328bc0921054fab4d4bfafe997932b94278f73bfcd ControlShift Platform (US datacenter) recovered Search infrastructure upgrades https://status.controlshiftlabs.com/incident/413352 Fri, 16 Aug 2024 18:12:30 -0000 https://status.controlshiftlabs.com/incident/413352#6585c9ed3d8694dbfacb55afc1bb2bf52f294184b4f05e18a7a44b8a57f89ae4 On Friday, August 16, we'll be performing upgrades on our search infrastructure. Search results may be incomplete until reindexing finishes. The rest of the platform should continue to operate normally. Slow response times and 502 errors on some pages https://status.controlshiftlabs.com/incident/414938 Fri, 16 Aug 2024 18:10:00 -0000 https://status.controlshiftlabs.com/incident/414938#0bd868e364d52a5ab3866bfb1dac473907c0f45258e7751b1190dbebe8e6b2dc The problem with slow pages and timeouts has resolved. We're continuing to monitor the situation. ControlShift Platform (US datacenter) went down https://status.controlshiftlabs.com/ Fri, 16 Aug 2024 18:07:04 +0000 https://status.controlshiftlabs.com/#09613b6aba5af5908f5ea1328bc0921054fab4d4bfafe997932b94278f73bfcd ControlShift Platform (US datacenter) went down Search infrastructure upgrades https://status.controlshiftlabs.com/incident/413352 Fri, 16 Aug 2024 16:03:04 -0000 https://status.controlshiftlabs.com/incident/413352#6585c9ed3d8694dbfacb55afc1bb2bf52f294184b4f05e18a7a44b8a57f89ae4 On Friday, August 16, we'll be performing upgrades on our search infrastructure. Search results may be incomplete until reindexing finishes. The rest of the platform should continue to operate normally. Search infrastructure upgrades https://status.controlshiftlabs.com/incident/413352 Fri, 16 Aug 2024 15:00:00 -0000 https://status.controlshiftlabs.com/incident/413352#6585c9ed3d8694dbfacb55afc1bb2bf52f294184b4f05e18a7a44b8a57f89ae4 On Friday, August 16, we'll be performing upgrades on our search infrastructure. Search results may be incomplete until reindexing finishes. The rest of the platform should continue to operate normally. Background jobs are delayed https://status.controlshiftlabs.com/incident/309936 Mon, 08 Jan 2024 18:05:00 -0000 https://status.controlshiftlabs.com/incident/309936#6103547dfdbd766da9d8772e0e96d69d16a0cbfcbb84e7b72967f9e8ecd374cb The backlog has cleared, and background jobs should now be finishing in a timely fashion. We're continuing to work on performance improvements to prevent this from happening again. Background jobs are delayed https://status.controlshiftlabs.com/incident/309936 Mon, 08 Jan 2024 17:39:00 -0000 https://status.controlshiftlabs.com/incident/309936#a94ca77339134e79afe6bae149fb44f9bb7dec2ac2c78d004894bba9715cf9ae We're continuing to monitor the background jobs queue. A large portion of the backlog has cleared, and we expect the situation to fully resolve within the next hour or so. Background jobs are delayed https://status.controlshiftlabs.com/incident/309936 Mon, 08 Jan 2024 16:40:00 -0000 https://status.controlshiftlabs.com/incident/309936#50aed957fb7ffc1505a390d657d4f06589bc4f4229298d8ae8c3390f2494c681 We have scaled up resources to meet the demand, and we are also working on performance improvements to address the problem. Background jobs are still delayed by up to several hours, but we do expect the situation to improve within the next couple of hours. Background jobs are delayed https://status.controlshiftlabs.com/incident/309936 Mon, 08 Jan 2024 14:32:00 -0000 https://status.controlshiftlabs.com/incident/309936#315d9bf7444c72872389cd420faed481aa005471b8207f8270fc6f526fe9d043 Due to heavy load, background jobs are currently delayed by up to 3 hours. We're working on adjusting capacity to address the problem. The jobs will finish eventually, and no data has been lost. Thank you for your patience. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 17:59:06 +0000 https://status.controlshiftlabs.com/incident/294842#1d2f49c5d415e09e5aaea06bd3a615eea3e4050356a3d49edb4f6dd9973ba0c9 Maintenance completed New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 17:59:06 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 17:59:06 +0000 https://status.controlshiftlabs.com/incident/294842#1d2f49c5d415e09e5aaea06bd3a615eea3e4050356a3d49edb4f6dd9973ba0c9 Maintenance completed New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 17:59:06 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 17:59:06 +0000 https://status.controlshiftlabs.com/incident/294842#1d2f49c5d415e09e5aaea06bd3a615eea3e4050356a3d49edb4f6dd9973ba0c9 Maintenance completed New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 17:59:06 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 17:59:06 +0000 https://status.controlshiftlabs.com/incident/294842#1d2f49c5d415e09e5aaea06bd3a615eea3e4050356a3d49edb4f6dd9973ba0c9 Maintenance completed New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 17:59:06 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 16:28:03 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 16:28:03 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 16:28:03 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 16:28:03 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 15:25:53 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 15:25:53 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 15:25:53 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 15:25:53 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 14:00:00 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 14:00:00 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 14:00:00 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. New Year's Day Maintenance Window https://status.controlshiftlabs.com/incident/294842 Mon, 01 Jan 2024 14:00:00 -0000 https://status.controlshiftlabs.com/incident/294842#d5340b3722fab0d3e7d781d1fa073848c4e5dd9bb2013d0278826ad5e56adf49 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. The maintenance window will begin at 9am ET (14:00 UTC) and will last for 4.5 hours. We expect the platform to become sporadically unavailable during this maintenance. Updates will be posted on this status page as maintenance progresses. Admin-only full-platform search errors https://status.controlshiftlabs.com/incident/290289 Mon, 27 Nov 2023 13:05:00 -0000 https://status.controlshiftlabs.com/incident/290289#ce86ed6a10b0c62da8749f32bb6e329d6c44a4bd01c67e474b911e5d95776f06 We have finished reindexing member records, public and back end searches are fully functional again. Admin-only full-platform search errors https://status.controlshiftlabs.com/incident/290289 Tue, 21 Nov 2023 20:44:00 -0000 https://status.controlshiftlabs.com/incident/290289#013d7e80a96f8465ba5e3e891a8f0c02df9ead2b76f88e3030b04f75f51cad30 We're continuing to update our search infrastructure. Searches for blast emails, content, events, group members and organizers, and petitions have recovered and will work successfully again. We're still in the process of reindexing our members table, so searches for supporters may not work successfully until the records have been reindexed. Admin-only full-platform search errors https://status.controlshiftlabs.com/incident/290289 Tue, 21 Nov 2023 14:37:00 -0000 https://status.controlshiftlabs.com/incident/290289#74e5c7fbd4877909c4c6d2c49cd24f689805d9bcc0981e2e1b021b553bbf82e9 Omnisearch (the admin-only full-platform search) is currently not working due to an issue with our full-text search service. The engineering team is actively working to resolve these errors as soon as possible. EU datacenter scheduled maintenance https://status.controlshiftlabs.com/incident/272348 Tue, 17 Oct 2023 20:42:25 +0000 https://status.controlshiftlabs.com/incident/272348#2576c8c10fa0563ddb3f91b3e613911586e4eadd17f93efc7752f0a7eb6e822d Maintenance completed EU datacenter scheduled maintenance https://status.controlshiftlabs.com/incident/272348 Tue, 17 Oct 2023 20:42:25 -0000 https://status.controlshiftlabs.com/incident/272348#738456462f65a8f183c1569229b2d7684eb60aefae299361cb2f82f27b20c405 We will be performing maintenance in our EU datacenter on 17 October at 4pm ET (8pm UTC, 10pm CET). We expect the maintenance window to last for one hour, during which the platform will become unavailable. Updates will be posted on this status page. EU datacenter scheduled maintenance https://status.controlshiftlabs.com/incident/272348 Tue, 17 Oct 2023 20:00:00 -0000 https://status.controlshiftlabs.com/incident/272348#738456462f65a8f183c1569229b2d7684eb60aefae299361cb2f82f27b20c405 We will be performing maintenance in our EU datacenter on 17 October at 4pm ET (8pm UTC, 10pm CET). We expect the maintenance window to last for one hour, during which the platform will become unavailable. Updates will be posted on this status page. Errors with reCAPTCHA https://status.controlshiftlabs.com/incident/244636 Fri, 11 Aug 2023 17:28:00 -0000 https://status.controlshiftlabs.com/incident/244636#7db6b067540dfbda9f6dc5b49c8c7fd6e52dccd58143d273fbd1a991f11cb4f0 The problem is resolved and things should be working normally again. Errors with reCAPTCHA https://status.controlshiftlabs.com/incident/244636 Fri, 11 Aug 2023 17:28:00 -0000 https://status.controlshiftlabs.com/incident/244636#7db6b067540dfbda9f6dc5b49c8c7fd6e52dccd58143d273fbd1a991f11cb4f0 The problem is resolved and things should be working normally again. Errors with reCAPTCHA https://status.controlshiftlabs.com/incident/244636 Fri, 11 Aug 2023 15:59:00 -0000 https://status.controlshiftlabs.com/incident/244636#e0b13172d632a4e1a1b767e96df5f2d19c3f72a5d290003b183f19c1cdd6e144 We've investigated further and established that signatures are successfully being saved despite some error messages. We're continuing to work on the problem, but the platform should be fine to use. Errors with reCAPTCHA https://status.controlshiftlabs.com/incident/244636 Fri, 11 Aug 2023 15:59:00 -0000 https://status.controlshiftlabs.com/incident/244636#e0b13172d632a4e1a1b767e96df5f2d19c3f72a5d290003b183f19c1cdd6e144 We've investigated further and established that signatures are successfully being saved despite some error messages. We're continuing to work on the problem, but the platform should be fine to use. Errors with reCAPTCHA https://status.controlshiftlabs.com/incident/244636 Fri, 11 Aug 2023 15:43:00 -0000 https://status.controlshiftlabs.com/incident/244636#074edddfa95b512fa7305bf3dc7e29ba212ee901e598c22c602d90a3b5b6c13e We've received reports that when reCAPTCHA is enabled, some members are unable to sign petitions. We're working to identify and fix the source of the problem. Errors with reCAPTCHA https://status.controlshiftlabs.com/incident/244636 Fri, 11 Aug 2023 15:43:00 -0000 https://status.controlshiftlabs.com/incident/244636#074edddfa95b512fa7305bf3dc7e29ba212ee901e598c22c602d90a3b5b6c13e We've received reports that when reCAPTCHA is enabled, some members are unable to sign petitions. We're working to identify and fix the source of the problem. Scattered timeouts on customer sites https://status.controlshiftlabs.com/incident/233267 Sat, 15 Jul 2023 19:57:00 -0000 https://status.controlshiftlabs.com/incident/233267#8969b2fc57b4b06b8574e28499ec714c614b6689d015675a5751b54df7b42070 [Update] We've implemented additional protections to mitigate the DDoS attack. We're continuing to monitor the situation. Page load speeds remain stable for the majority of customers. Scattered timeouts on customer sites https://status.controlshiftlabs.com/incident/233267 Sat, 15 Jul 2023 19:21:00 -0000 https://status.controlshiftlabs.com/incident/233267#37685f174cff68a7b7dccc27577fefdbda41bf839bc198c7534012ad32deb6fb [Update] We're continuing to respond to an evolving DDoS attack. Page loads speeds have recovered for the majority of customers. We're continuing to monitor the situation. Scattered timeouts on customer sites https://status.controlshiftlabs.com/incident/233267 Sat, 15 Jul 2023 18:57:00 -0000 https://status.controlshiftlabs.com/incident/233267#cdd6c059e331c4b657215fc8fb7acf53b933dca1ed0417fe16bfb2c28512587e We're seeing scattered timeouts as we continue to mitigate a denial-of-service attack. We'll post updates soon. Slow page loads and time outs https://status.controlshiftlabs.com/incident/233264 Sat, 15 Jul 2023 18:40:00 -0000 https://status.controlshiftlabs.com/incident/233264#0eed1f0527b73731715547727b4c78c28173325224cb9440d76fa3966906f52c We found that the issue was caused by a denial-of-service attack on one of our customers' site. We've taken measures to block the offending traffic and the platform is now back online and fully restored. Slow page loads and time outs https://status.controlshiftlabs.com/incident/233264 Sat, 15 Jul 2023 18:22:00 -0000 https://status.controlshiftlabs.com/incident/233264#757f402fafe0b6012628af5fbef97c5af13244309b10e08dcc9c322b92f4016d We're currently investigating a problem on the platform causing slow page loads and time outs. US Platform is down https://status.controlshiftlabs.com/incident/233247 Sat, 15 Jul 2023 17:10:00 -0000 https://status.controlshiftlabs.com/incident/233247#81a419fa312453ce46f1133eee30d3ba48e60262f152903cd814b90562dd380c The platform has returned to normal, and pages should be loading in a normal amount of time. We apologize for the inconvenience. US Platform is down https://status.controlshiftlabs.com/incident/233247 Sat, 15 Jul 2023 17:05:00 -0000 https://status.controlshiftlabs.com/incident/233247#9544005a4eaf2ba808fca4e205a458d828571f41c2cc29c8753a9de9d903e9c9 We've identified the cause of the outage as a DDoS attack on one of our customers. We've taken steps to block the attack, and the platform appears to be recovering. US Platform is down https://status.controlshiftlabs.com/incident/233247 Sat, 15 Jul 2023 16:42:00 -0000 https://status.controlshiftlabs.com/incident/233247#63dab2a7e9fcc87b8a24bb47e7985cff952a1af7d36a2df1ac0ee2ad6affc1e4 We've received reports that requests to the US platform are timing out. We're investigating now. Problems with one-click signing https://status.controlshiftlabs.com/incident/217306 Wed, 07 Jun 2023 20:28:00 -0000 https://status.controlshiftlabs.com/incident/217306#89491f09ef819c6e71785e725247340f14c33504f4050077997647f920e771b9 We've identified a recent configuration change as the source of the problems with one-click signing. Rolling back that change has resolved the problem, and one-click signing should be working normally now. Problems with one-click signing https://status.controlshiftlabs.com/incident/217306 Wed, 07 Jun 2023 20:28:00 -0000 https://status.controlshiftlabs.com/incident/217306#89491f09ef819c6e71785e725247340f14c33504f4050077997647f920e771b9 We've identified a recent configuration change as the source of the problems with one-click signing. Rolling back that change has resolved the problem, and one-click signing should be working normally now. Problems with one-click signing https://status.controlshiftlabs.com/incident/217306 Wed, 07 Jun 2023 17:40:00 -0000 https://status.controlshiftlabs.com/incident/217306#0e066821b84c15de8c6539a77e1cbdf29a4d75e9cce9faad6e85e7887d03bd34 We've received reports of problems with one-click signing for Identity and ActionKit users. We're investigating the issue now. Problems with one-click signing https://status.controlshiftlabs.com/incident/217306 Wed, 07 Jun 2023 17:40:00 -0000 https://status.controlshiftlabs.com/incident/217306#0e066821b84c15de8c6539a77e1cbdf29a4d75e9cce9faad6e85e7887d03bd34 We've received reports of problems with one-click signing for Identity and ActionKit users. We're investigating the issue now. Scattered issues with the proxy integration service in the US datacenter https://status.controlshiftlabs.com/incident/216262 Mon, 05 Jun 2023 15:05:00 -0000 https://status.controlshiftlabs.com/incident/216262#dbb8f15a90dee65abf60db870fabe0eb172a893f1cf57dc6c14da60f27719149 We've made adjustments to our infrastructure and believe the issue is resolved now. Scattered issues with the proxy integration service in the US datacenter https://status.controlshiftlabs.com/incident/216262 Mon, 05 Jun 2023 12:54:00 -0000 https://status.controlshiftlabs.com/incident/216262#6110b33dee1494b1ddcfd393a4a5e6f46acd0697a2dc4fda8d120a0eb6feb31b Some members may be experiencing problems with one-click signing and other features due to an issue with the service. We're investigating the problem now. Brief outage for sites hosted in the US datacenter https://status.controlshiftlabs.com/incident/215344 Fri, 02 Jun 2023 22:46:00 -0000 https://status.controlshiftlabs.com/incident/215344#b5e4f613a30dee77ed25682a45bc2a10e2cd196536e5a199e9948e630159c368 From around 6:20 to 6:30 PM (US Eastern time), some members attempting to visit customer sites experienced timeouts. This was due to an infrastructure issue, which we have mitigated. We are taking steps to avoid this issue happening again and apologize for the inconvenience. Infrastructure upgrades in the EU datacenter https://status.controlshiftlabs.com/incident/194755 Wed, 12 Apr 2023 21:21:47 +0000 https://status.controlshiftlabs.com/incident/194755#8d6b615ec6d4f3f92173e5abc837edba65988b30dc28470154d583f3cdc69457 Maintenance completed Infrastructure upgrades in the EU datacenter https://status.controlshiftlabs.com/incident/194755 Wed, 12 Apr 2023 21:21:47 -0000 https://status.controlshiftlabs.com/incident/194755#5df14d2ecf4f3c7f20b0184b0b0e2c96c8122d5a005a29011a79b3b146e2a4e5 This Wednesday, April 12, we will be performing upgrades to our EU-hosted infrastructure between 9:00pm and 9:20pm UTC. During this time, we expect a period of about 5-10 minutes where visitors to the platform may experience errors. Infrastructure upgrades in the EU datacenter https://status.controlshiftlabs.com/incident/194755 Wed, 12 Apr 2023 21:19:11 -0000 https://status.controlshiftlabs.com/incident/194755#5df14d2ecf4f3c7f20b0184b0b0e2c96c8122d5a005a29011a79b3b146e2a4e5 This Wednesday, April 12, we will be performing upgrades to our EU-hosted infrastructure between 9:00pm and 9:20pm UTC. During this time, we expect a period of about 5-10 minutes where visitors to the platform may experience errors. Infrastructure upgrades in the EU datacenter https://status.controlshiftlabs.com/incident/194755 Wed, 12 Apr 2023 21:00:00 -0000 https://status.controlshiftlabs.com/incident/194755#5df14d2ecf4f3c7f20b0184b0b0e2c96c8122d5a005a29011a79b3b146e2a4e5 This Wednesday, April 12, we will be performing upgrades to our EU-hosted infrastructure between 9:00pm and 9:20pm UTC. During this time, we expect a period of about 5-10 minutes where visitors to the platform may experience errors. Error pages on US sites https://status.controlshiftlabs.com/incident/194739 Mon, 10 Apr 2023 14:51:00 -0000 https://status.controlshiftlabs.com/incident/194739#5c5fd57586ac6a98933b09951e2964322c731b843284bffd5969cbea6aaf5ca6 The errors were caused by an issue with an infrastructure upgrade. The upgrade has finished, and everything should be back to normal. Error pages on US sites https://status.controlshiftlabs.com/incident/194739 Mon, 10 Apr 2023 14:40:00 -0000 https://status.controlshiftlabs.com/incident/194739#eb564ae2273513d48c7c8e36be0ba3273deaff45fd002fa03728714dfa3cfc87 Some users are experiencing errors when attempting to view petition pages hosted in our US datacenter. We're aware of the problem and expect it to be resolved soon. Outage in the US datacenter https://status.controlshiftlabs.com/incident/191773 Sat, 01 Apr 2023 15:04:00 -0000 https://status.controlshiftlabs.com/incident/191773#ebe659d8be93367c496cb7f00b69054a2e6d044efb7f8845867f79527492757c The issue has been resolved, and page load times should be back to normal. The root cause was a denial-of-service attack on one of our customers, taking advantage of inadequate rate limiting on a particular endpoint. We've fixed the rate limiting to prevent this from happening again, and we apologize for the inconvenience. Outage in the US datacenter https://status.controlshiftlabs.com/incident/191773 Sat, 01 Apr 2023 14:49:00 -0000 https://status.controlshiftlabs.com/incident/191773#b66d277dc85ce2ac50b6db440eb1dac87b898449c135db25fcf6b99a4ed5d01d We have tentatively identified the problem and are implementing measures to mitigate it. Sites are coming back online. Outage in the US datacenter https://status.controlshiftlabs.com/incident/191773 Sat, 01 Apr 2023 14:22:00 -0000 https://status.controlshiftlabs.com/incident/191773#b7a5a33eaf1f0bb29b871f688921d4a52652357d638a3eff6d91afc9ded6cc04 We're investigating reports of timeouts when attempting to access sites hosted in our US datacenter. Slow Page Loads https://status.controlshiftlabs.com/incident/182148 Mon, 06 Mar 2023 22:39:00 -0000 https://status.controlshiftlabs.com/incident/182148#2f4a5cd920daa407b653020f1eb95826874f4024b8f07246ae4d843b0a8ba946 We've identified the likely root cause of the issue. A performance issue related to calculating certain statistics coincided with a large data migration, causing unusual load on the database. We've paused the data migration and are working on a plan to mitigate the performance issue so this does not happen again. Slow Page Loads https://status.controlshiftlabs.com/incident/182148 Mon, 06 Mar 2023 22:37:00 -0000 https://status.controlshiftlabs.com/incident/182148#06fb4b2f68746770d36732053cdd351aa9356630b46e9d8a36f9d1302de8a51b Page load times have returned to normal. We're continuing our investigation and monitoring. Slow Page Loads https://status.controlshiftlabs.com/incident/182148 Mon, 06 Mar 2023 22:27:00 -0000 https://status.controlshiftlabs.com/incident/182148#41d4c41a891980e3d153b42e36633cee48e59e304bd97daef8bec17563090aad We're seeing slow page loads on customer sites. We're investigating now and will update shortly. Slow responses and timeouts in the EU https://status.controlshiftlabs.com/incident/178351 Thu, 23 Feb 2023 16:25:00 -0000 https://status.controlshiftlabs.com/incident/178351#71e9de2ebc0cb20f878256486a767294120384039a7ae1e10a024107a25b75f0 We've traced the root cause of the issue to a brief network glitch in AWS. We don't expect it to happen again. Slow responses and timeouts in the EU https://status.controlshiftlabs.com/incident/178351 Thu, 23 Feb 2023 14:31:00 -0000 https://status.controlshiftlabs.com/incident/178351#db7bbe5b659b71331d37ec599ed4d649efe7f57c44d2ea8e7dbc07706f60350c The problem appears to have resolved, and page load times should be back to normal. We're continuing to investigate the root cause of this issue. Slow responses and timeouts in the EU https://status.controlshiftlabs.com/incident/178351 Thu, 23 Feb 2023 14:23:00 -0000 https://status.controlshiftlabs.com/incident/178351#2c24185efe3253edf24c7e7a8f46ca9ab529169f5c5174c2a81a05758aaf2a7e We're investigating reports of timeouts and slow page loads for sites hosted in the EU datacenter. IP-based geolocation offline https://status.controlshiftlabs.com/incident/175983 Thu, 16 Feb 2023 18:48:00 -0000 https://status.controlshiftlabs.com/incident/175983#3bb5d16a337a1466bc8e25cadd56fa44ad23cd31b0036adeb8125d04f4a0590c Updates on the IP-based geolocation service are completed, service is fully operational again. IP-based geolocation offline https://status.controlshiftlabs.com/incident/175983 Thu, 16 Feb 2023 18:48:00 -0000 https://status.controlshiftlabs.com/incident/175983#3bb5d16a337a1466bc8e25cadd56fa44ad23cd31b0036adeb8125d04f4a0590c Updates on the IP-based geolocation service are completed, service is fully operational again. IP-based geolocation offline https://status.controlshiftlabs.com/incident/175983 Thu, 16 Feb 2023 18:48:00 -0000 https://status.controlshiftlabs.com/incident/175983#3bb5d16a337a1466bc8e25cadd56fa44ad23cd31b0036adeb8125d04f4a0590c Updates on the IP-based geolocation service are completed, service is fully operational again. IP-based geolocation offline https://status.controlshiftlabs.com/incident/175983 Thu, 16 Feb 2023 17:50:00 -0000 https://status.controlshiftlabs.com/incident/175983#ee0e87b529d9b8f87f52ae0f3a6e88a9ea77c2e088fd4fc3ece66cf578b9b245 The country field on forms is temporarily not being autocompleted while we release an update on our Geo IP infrastructure. IP-based geolocation offline https://status.controlshiftlabs.com/incident/175983 Thu, 16 Feb 2023 17:50:00 -0000 https://status.controlshiftlabs.com/incident/175983#ee0e87b529d9b8f87f52ae0f3a6e88a9ea77c2e088fd4fc3ece66cf578b9b245 The country field on forms is temporarily not being autocompleted while we release an update on our Geo IP infrastructure. IP-based geolocation offline https://status.controlshiftlabs.com/incident/175983 Thu, 16 Feb 2023 17:50:00 -0000 https://status.controlshiftlabs.com/incident/175983#ee0e87b529d9b8f87f52ae0f3a6e88a9ea77c2e088fd4fc3ece66cf578b9b245 The country field on forms is temporarily not being autocompleted while we release an update on our Geo IP infrastructure. Sites hosted in the EU data center are down https://status.controlshiftlabs.com/incident/151653 Sun, 08 Jan 2023 14:42:00 -0000 https://status.controlshiftlabs.com/incident/151653#a334f988f852940bcb2eb6a23bcd66c99dfd3b66dac01f68d65485492da15bb9 We identified the issue as a certificate that had expired. We were able to replace the certificate, and everything should be fine now. The root cause of this issue was that the automatic process that was supposed to replace the certificate before it expired did not run. We will be investigating and rectifying that problem so it does not happen again. Sites hosted in the EU data center are down https://status.controlshiftlabs.com/incident/151653 Sun, 08 Jan 2023 14:17:00 -0000 https://status.controlshiftlabs.com/incident/151653#73b0949c4ec6a2798086b5eb4b87a712fa6815d250358a6b0fe3ac1aa8af4abc Visitors to ControlShift sites hosted in the EU are currently seeing errors related to an certificate issue. We're working to identify the problem. New Year's Scheduled Maintenance https://status.controlshiftlabs.com/incident/144475 Sun, 01 Jan 2023 18:31:40 -0000 https://status.controlshiftlabs.com/incident/144475#0c0958a74042c6da33b50db5bc2b9a68af6bda8ba398c21891199e05b638af47 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. Updates will be posted on this status page as maintenance progresses. New Year's Scheduled Maintenance https://status.controlshiftlabs.com/incident/144475 Sun, 01 Jan 2023 18:31:40 -0000 https://status.controlshiftlabs.com/incident/144475#0c0958a74042c6da33b50db5bc2b9a68af6bda8ba398c21891199e05b638af47 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. Updates will be posted on this status page as maintenance progresses. New Year's Scheduled Maintenance https://status.controlshiftlabs.com/incident/144475 Sun, 01 Jan 2023 18:30:00 +0000 https://status.controlshiftlabs.com/incident/144475#9234610dc1b42754c84287da1f2178e6ca007549e0521e4e09a0713c9cb80ee4 Maintenance completed New Year's Scheduled Maintenance https://status.controlshiftlabs.com/incident/144475 Sun, 01 Jan 2023 18:30:00 +0000 https://status.controlshiftlabs.com/incident/144475#9234610dc1b42754c84287da1f2178e6ca007549e0521e4e09a0713c9cb80ee4 Maintenance completed New Year's Scheduled Maintenance https://status.controlshiftlabs.com/incident/144475 Sun, 01 Jan 2023 17:30:16 -0000 https://status.controlshiftlabs.com/incident/144475#0c0958a74042c6da33b50db5bc2b9a68af6bda8ba398c21891199e05b638af47 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. Updates will be posted on this status page as maintenance progresses. New Year's Scheduled Maintenance https://status.controlshiftlabs.com/incident/144475 Sun, 01 Jan 2023 17:30:16 -0000 https://status.controlshiftlabs.com/incident/144475#0c0958a74042c6da33b50db5bc2b9a68af6bda8ba398c21891199e05b638af47 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. Updates will be posted on this status page as maintenance progresses. New Year's Scheduled Maintenance https://status.controlshiftlabs.com/incident/144475 Sun, 01 Jan 2023 14:03:53 -0000 https://status.controlshiftlabs.com/incident/144475#0c0958a74042c6da33b50db5bc2b9a68af6bda8ba398c21891199e05b638af47 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. Updates will be posted on this status page as maintenance progresses. New Year's Scheduled Maintenance https://status.controlshiftlabs.com/incident/144475 Sun, 01 Jan 2023 14:03:53 -0000 https://status.controlshiftlabs.com/incident/144475#0c0958a74042c6da33b50db5bc2b9a68af6bda8ba398c21891199e05b638af47 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. Updates will be posted on this status page as maintenance progresses. New Year's Scheduled Maintenance https://status.controlshiftlabs.com/incident/144475 Sun, 01 Jan 2023 14:00:00 -0000 https://status.controlshiftlabs.com/incident/144475#0c0958a74042c6da33b50db5bc2b9a68af6bda8ba398c21891199e05b638af47 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. Updates will be posted on this status page as maintenance progresses. New Year's Scheduled Maintenance https://status.controlshiftlabs.com/incident/144475 Sun, 01 Jan 2023 14:00:00 -0000 https://status.controlshiftlabs.com/incident/144475#0c0958a74042c6da33b50db5bc2b9a68af6bda8ba398c21891199e05b638af47 We'll be upgrading our infrastructure to ensure reliability and performance over the coming year. Updates will be posted on this status page as maintenance progresses.