HeyMint Status - Incident history https://uptime.heymint.xyz HeyMint Sat, 11 May 2024 16:33:51 +0000 Degraded database performance Type: Incident Duration: 3 hours and 3 minutes Affected Components: Contract Compiler, Mint Button, Launchpad Dashboard, Art Generator, HeyMint, Mint Page May 11, 16:33:51 GMT+0 - Investigating - We are currently investigating this incident. May 11, 19:37:00 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 3 hours and 3 minutes

Affected Components: , , , , ,

<p><small>May <var data-var='date'> 11</var>, <var data-var='time'>16:33:51</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>May <var data-var='date'> 11</var>, <var data-var='time'>19:37:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Sat, 11 May 2024 16:33:51 +0000 https://uptime.heymint.xyz/incident/clw2bssws135815b8lq6vte3qtn https://uptime.heymint.xyz/incident/clw2bssws135815b8lq6vte3qtn Twitter API is experiencing an issue Type: Incident Duration: 21 hours and 12 minutes Affected Components: HeyMint Dec 14, 00:22:00 GMT+0 - Investigating - We're currently experiencing some Twitter API errors that are preventing people from joining allowlists 😞 Our engineering team has been working non-stop to find a solution. We sincerely apologize for any inconvenience. Dec 14, 04:58:13 GMT+0 - Monitoring - We've implemented a fix and entries are going through. Systems are currently being monitored and slowly being brought up to scale, so things might take a little longer than usual. You might still see these two kinds of error messages: **Security header check failed**: It happens when we make a change. Please refresh the page and try again. **Sorry, you tried to enter too recently. Please try again in a few minutes**: We are currently rate limiting to lower the number of requests to Twitter. Please try again in a few minutes. Dec 14, 21:33:33 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 21 hours and 12 minutes

Affected Components:

<p><small>Dec <var data-var='date'> 14</var>, <var data-var='time'>00:22:00</var> GMT+0</small><br><strong>Investigating</strong> - We're currently experiencing some Twitter API errors that are preventing people from joining allowlists 😞 Our engineering team has been working non-stop to find a solution. We sincerely apologize for any inconvenience..</p> <p><small>Dec <var data-var='date'> 14</var>, <var data-var='time'>04:58:13</var> GMT+0</small><br><strong>Monitoring</strong> - We've implemented a fix and entries are going through. Systems are currently being monitored and slowly being brought up to scale, so things might take a little longer than usual. You might still see these two kinds of error messages: **Security header check failed**: It happens when we make a change. Please refresh the page and try again. **Sorry, you tried to enter too recently. Please try again in a few minutes**: We are currently rate limiting to lower the number of requests to Twitter. Please try again in a few minutes. .</p> <p><small>Dec <var data-var='date'> 14</var>, <var data-var='time'>21:33:33</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Thu, 14 Dec 2023 00:22:00 +0000 https://uptime.heymint.xyz/incident/clq4ggphs20797c3oizavkdq8g https://uptime.heymint.xyz/incident/clq4ggphs20797c3oizavkdq8g Upgrading HeyMint auth Type: Maintenance Duration: 2 hours and 29 minutes Affected Components: HeyMint Aug 23, 20:45:46 GMT+0 - Identified - At this time we're dealing with some unanticipated roadblocks, and are working on completing the maintenance & getting HeyMint back up and running as soon as possible! Aug 23, 22:28:30 GMT+0 - Completed - Explore page functionality is restored & Heymint is fully migrated to the new auth system! Aug 23, 20:00:01 GMT+0 - Identified - Maintenance is now in progress Aug 23, 20:00:00 GMT+0 - Identified - We are upgrading HeyMint to a new authentication system. During this process, HeyMint will temporarily be unavailable. Aug 23, 21:18:34 GMT+0 - Identified - The new auth system is live, and heymint.xyz is now accessible to the public again! We are seeing some issues with the explore pages, which we are currently investigating. Type: Maintenance

Duration: 2 hours and 29 minutes

Affected Components:

<p><small>Aug <var data-var='date'> 23</var>, <var data-var='time'>20:45:46</var> GMT+0</small><br><strong>Identified</strong> - At this time we're dealing with some unanticipated roadblocks, and are working on completing the maintenance & getting HeyMint back up and running as soon as possible!.</p> <p><small>Aug <var data-var='date'> 23</var>, <var data-var='time'>22:28:30</var> GMT+0</small><br><strong>Completed</strong> - Explore page functionality is restored & Heymint is fully migrated to the new auth system!.</p> <p><small>Aug <var data-var='date'> 23</var>, <var data-var='time'>20:00:01</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress.</p> <p><small>Aug <var data-var='date'> 23</var>, <var data-var='time'>20:00:00</var> GMT+0</small><br><strong>Identified</strong> - We are upgrading HeyMint to a new authentication system. During this process, HeyMint will temporarily be unavailable..</p> <p><small>Aug <var data-var='date'> 23</var>, <var data-var='time'>21:18:34</var> GMT+0</small><br><strong>Identified</strong> - The new auth system is live, and heymint.xyz is now accessible to the public again! We are seeing some issues with the explore pages, which we are currently investigating..</p> ]]> Wed, 23 Aug 2023 20:00:00 +0000 https://uptime.heymint.xyz/maintenance/cllmsdv0u44690b7ojr8vv4vu4 https://uptime.heymint.xyz/maintenance/cllmsdv0u44690b7ojr8vv4vu4 Twitter API is experiencing an issue Type: Incident Duration: 2 days, 13 hours and 48 minutes Affected Components: HeyMint Jun 27, 06:02:34 GMT+0 - Investigating - The Twitter API is currently returning a 403 (Forbidden) error for follows, tweet likes, and retweets, which appears to be affecting various services (https://github.com/twitterdev/Twitter-API-v2-sample-code/issues/58). This issue is causing certain Twitter features to be unavailable, including the ability to check follows, tweet likes, and retweets. Jun 28, 19:22:58 GMT+0 - Monitoring - Due to seemingly undocumented changes to the Twitter API, we have had to change how we verify the Twitter account follow requirement. We have implemented an alternative approach and will be monitoring to ensure there are no further issues. HeyMint should now be fully functional. Jun 29, 19:50:06 GMT+0 - Resolved - Our workaround is operating as expected and full functionality of HeyMint should be restored. Type: Incident

Duration: 2 days, 13 hours and 48 minutes

Affected Components:

<p><small>Jun <var data-var='date'> 27</var>, <var data-var='time'>06:02:34</var> GMT+0</small><br><strong>Investigating</strong> - The Twitter API is currently returning a 403 (Forbidden) error for follows, tweet likes, and retweets, which appears to be affecting various services (https://github.com/twitterdev/Twitter-API-v2-sample-code/issues/58). This issue is causing certain Twitter features to be unavailable, including the ability to check follows, tweet likes, and retweets..</p> <p><small>Jun <var data-var='date'> 28</var>, <var data-var='time'>19:22:58</var> GMT+0</small><br><strong>Monitoring</strong> - Due to seemingly undocumented changes to the Twitter API, we have had to change how we verify the Twitter account follow requirement. We have implemented an alternative approach and will be monitoring to ensure there are no further issues. HeyMint should now be fully functional..</p> <p><small>Jun <var data-var='date'> 29</var>, <var data-var='time'>19:50:06</var> GMT+0</small><br><strong>Resolved</strong> - Our workaround is operating as expected and full functionality of HeyMint should be restored..</p> ]]> Tue, 27 Jun 2023 06:02:34 +0000 https://uptime.heymint.xyz/incident/cljdvs7y466734azogyjd6k7wb https://uptime.heymint.xyz/incident/cljdvs7y466734azogyjd6k7wb Twitter integration not working for allowlists Type: Incident Duration: 18 hours and 51 minutes Affected Components: HeyMint Jun 14, 21:30:40 GMT+0 - Investigating - We are currently investigating this incident. Jun 15, 16:21:52 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 18 hours and 51 minutes

Affected Components:

<p><small>Jun <var data-var='date'> 14</var>, <var data-var='time'>21:30:40</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>Jun <var data-var='date'> 15</var>, <var data-var='time'>16:21:52</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Wed, 14 Jun 2023 21:30:40 +0000 https://uptime.heymint.xyz/incident/cliw87qbb39243amn1xlzwmvmz https://uptime.heymint.xyz/incident/cliw87qbb39243amn1xlzwmvmz Database Connectivity Issues Type: Incident Duration: 42 minutes Affected Components: Launchpad Dashboard, HeyMint, Mint Page Jun 3, 01:35:36 GMT+0 - Identified - We are investigating issues with our database load balancer which are resulting in some sign-in errors, and elevated error rates for other features which require database connectivity. Jun 3, 01:51:08 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Jun 3, 02:17:51 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 42 minutes

Affected Components: , ,

<p><small>Jun <var data-var='date'> 3</var>, <var data-var='time'>01:35:36</var> GMT+0</small><br><strong>Identified</strong> - We are investigating issues with our database load balancer which are resulting in some sign-in errors, and elevated error rates for other features which require database connectivity..</p> <p><small>Jun <var data-var='date'> 3</var>, <var data-var='time'>01:51:08</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> <p><small>Jun <var data-var='date'> 3</var>, <var data-var='time'>02:17:51</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Sat, 3 Jun 2023 01:35:36 +0000 https://uptime.heymint.xyz/incident/clifboh1o64081b4n8lsu9kjvf https://uptime.heymint.xyz/incident/clifboh1o64081b4n8lsu9kjvf Database connectivity issues Type: Incident Duration: 3 hours and 44 minutes Affected Components: HeyMint, Contract Compiler, Mint Button, Launchpad Dashboard, Art Generator, Mint Page May 13, 21:30:00 GMT+0 - Investigating - It appears that the server hosting our database load balancer has crashed. We are investigating further and will post an update when we know more. May 13, 23:27:49 GMT+0 - Investigating - Our database load-balancer is now up and running again, however our deployments are still having issues connecting to the database. We are still investigating why. May 13, 23:35:41 GMT+0 - Monitoring - All affected services have been restarted and appear to be working normally. We are monitoring to ensure no further interruptions to service. May 14, 01:13:41 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 3 hours and 44 minutes

Affected Components: , , , , ,

<p><small>May <var data-var='date'> 13</var>, <var data-var='time'>21:30:00</var> GMT+0</small><br><strong>Investigating</strong> - It appears that the server hosting our database load balancer has crashed. We are investigating further and will post an update when we know more..</p> <p><small>May <var data-var='date'> 13</var>, <var data-var='time'>23:27:49</var> GMT+0</small><br><strong>Investigating</strong> - Our database load-balancer is now up and running again, however our deployments are still having issues connecting to the database. We are still investigating why..</p> <p><small>May <var data-var='date'> 13</var>, <var data-var='time'>23:35:41</var> GMT+0</small><br><strong>Monitoring</strong> - All affected services have been restarted and appear to be working normally. We are monitoring to ensure no further interruptions to service..</p> <p><small>May <var data-var='date'> 14</var>, <var data-var='time'>01:13:41</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Sat, 13 May 2023 21:30:00 +0000 https://uptime.heymint.xyz/incident/clhmlvag51081767zmzsvx06zgx https://uptime.heymint.xyz/incident/clhmlvag51081767zmzsvx06zgx Mint page not working if wallet isn't connected Type: Incident Duration: 41 minutes Affected Components: Mint Page Mar 31, 19:59:45 GMT+0 - Identified - *Please connect your wallet using "Connect you wallet" in the top right.* This will resolve the issue for you. We've identified an issue where mint pages will continually load if a wallet isn't connected. We're working on a fix to the issue now. Mar 31, 20:40:48 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 41 minutes

Affected Components:

<p><small>Mar <var data-var='date'> 31</var>, <var data-var='time'>19:59:45</var> GMT+0</small><br><strong>Identified</strong> - *Please connect your wallet using "Connect you wallet" in the top right.* This will resolve the issue for you. We've identified an issue where mint pages will continually load if a wallet isn't connected. We're working on a fix to the issue now..</p> <p><small>Mar <var data-var='date'> 31</var>, <var data-var='time'>20:40:48</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Fri, 31 Mar 2023 19:59:45 +0000 https://uptime.heymint.xyz/incident/clfwyxw0n65532c7oc34njtsu5 https://uptime.heymint.xyz/incident/clfwyxw0n65532c7oc34njtsu5 Elevated error rate Type: Incident Duration: 6 hours and 40 minutes Affected Components: HeyMint Mar 7, 16:20:00 GMT+0 - Investigating - We are currently investigating an elevated error rate on HeyMint, especially when logging in. Mar 7, 16:51:53 GMT+0 - Identified - We have identified the issue and are working on a fix now. Mar 7, 18:39:57 GMT+0 - Identified - We've introduced a fix to the issue which has started to stabilize the service, but we are continuing to work on a more solid fix. Mar 7, 19:38:41 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Mar 7, 23:00:00 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 6 hours and 40 minutes

Affected Components:

<p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>16:20:00</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating an elevated error rate on HeyMint, especially when logging in..</p> <p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>16:51:53</var> GMT+0</small><br><strong>Identified</strong> - We have identified the issue and are working on a fix now..</p> <p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>18:39:57</var> GMT+0</small><br><strong>Identified</strong> - We've introduced a fix to the issue which has started to stabilize the service, but we are continuing to work on a more solid fix..</p> <p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>19:38:41</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> <p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>23:00:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Tue, 7 Mar 2023 16:20:00 +0000 https://uptime.heymint.xyz/incident/cleygitjk216447hjojqmyhpx05 https://uptime.heymint.xyz/incident/cleygitjk216447hjojqmyhpx05 Elevated error rate when entering raffles Type: Incident Duration: 35 minutes Affected Components: HeyMint Feb 28, 17:23:28 GMT+0 - Resolved - This incident has been resolved. Feb 28, 16:48:04 GMT+0 - Investigating - We are currently investigating an elevated error rate when trying to enter raffles on HeyMint. If you receive an error code 500 message, please try to enter again later! Feb 28, 17:06:38 GMT+0 - Monitoring - This appears to be an issue with the provider of our captchas, Cloudflare (see their report here: https://www.cloudflarestatus.com/incidents/2rfr4k8b7gcs ) They have implemented a fix and are monitoring the result. We are seeing error rates go down on HeyMint. Type: Incident

Duration: 35 minutes

Affected Components:

<p><small>Feb <var data-var='date'> 28</var>, <var data-var='time'>17:23:28</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Feb <var data-var='date'> 28</var>, <var data-var='time'>16:48:04</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating an elevated error rate when trying to enter raffles on HeyMint. If you receive an error code 500 message, please try to enter again later!.</p> <p><small>Feb <var data-var='date'> 28</var>, <var data-var='time'>17:06:38</var> GMT+0</small><br><strong>Monitoring</strong> - This appears to be an issue with the provider of our captchas, Cloudflare (see their report here: https://www.cloudflarestatus.com/incidents/2rfr4k8b7gcs ) They have implemented a fix and are monitoring the result. We are seeing error rates go down on HeyMint..</p> ]]> Tue, 28 Feb 2023 16:48:04 +0000 https://uptime.heymint.xyz/incident/cleohfzbs186005o1n6qp2e73la https://uptime.heymint.xyz/incident/cleohfzbs186005o1n6qp2e73la Infrastructure Upgrades Type: Maintenance Duration: 37 minutes Affected Components: HeyMint, Launchpad Dashboard Jan 12, 05:00:01 GMT+0 - Identified - Maintenance is now in progress Jan 12, 05:00:00 GMT+0 - Identified - We are planning for scheduled maintenance to upgrade our infrastructure during this time. The site may be unavailable or degraded for some (or all) of this maintenance window, but we'll complete the maintenance as quickly as possible! Thanks so much for your patience & understanding. Jan 12, 05:37:05 GMT+0 - Completed - Maintenance has been completed successfully. Thank you so much for your patience! Type: Maintenance

Duration: 37 minutes

Affected Components: ,

<p><small>Jan <var data-var='date'> 12</var>, <var data-var='time'>05:00:01</var> GMT+0</small><br><strong>Identified</strong> - Maintenance is now in progress.</p> <p><small>Jan <var data-var='date'> 12</var>, <var data-var='time'>05:00:00</var> GMT+0</small><br><strong>Identified</strong> - We are planning for scheduled maintenance to upgrade our infrastructure during this time. The site may be unavailable or degraded for some (or all) of this maintenance window, but we'll complete the maintenance as quickly as possible! Thanks so much for your patience & understanding..</p> <p><small>Jan <var data-var='date'> 12</var>, <var data-var='time'>05:37:05</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has been completed successfully. Thank you so much for your patience!.</p> ]]> Thu, 12 Jan 2023 05:00:00 +0000 https://uptime.heymint.xyz/maintenance/clcsgrlgd3812hwn18yaulwd0 https://uptime.heymint.xyz/maintenance/clcsgrlgd3812hwn18yaulwd0 Elevated error rate across HeyMint Type: Incident Duration: 1 hour and 59 minutes Affected Components: HeyMint Jan 11, 19:19:17 GMT+0 - Investigating - HeyMint is currently experiencing an unprecedented amount of traffic (and an elevated error rate) that may cause the site to be intermittently unreliable for some users. We're currently working hard to resolve the issue - so sorry for the inconvenience! Jan 11, 19:25:10 GMT+0 - Identified - We have identified the root cause of the issue, and are continuing to work on a fix for this incident. Jan 11, 20:17:39 GMT+0 - Monitoring - We implemented a fix and currently monitoring the result. Jan 11, 21:18:07 GMT+0 - Resolved - The issue is resolved at this time, if you run into any issues going forward, please reach out and let us know! Type: Incident

Duration: 1 hour and 59 minutes

Affected Components:

<p><small>Jan <var data-var='date'> 11</var>, <var data-var='time'>19:19:17</var> GMT+0</small><br><strong>Investigating</strong> - HeyMint is currently experiencing an unprecedented amount of traffic (and an elevated error rate) that may cause the site to be intermittently unreliable for some users. We're currently working hard to resolve the issue - so sorry for the inconvenience!.</p> <p><small>Jan <var data-var='date'> 11</var>, <var data-var='time'>19:25:10</var> GMT+0</small><br><strong>Identified</strong> - We have identified the root cause of the issue, and are continuing to work on a fix for this incident..</p> <p><small>Jan <var data-var='date'> 11</var>, <var data-var='time'>20:17:39</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and currently monitoring the result..</p> <p><small>Jan <var data-var='date'> 11</var>, <var data-var='time'>21:18:07</var> GMT+0</small><br><strong>Resolved</strong> - The issue is resolved at this time, if you run into any issues going forward, please reach out and let us know!.</p> ]]> Wed, 11 Jan 2023 19:19:17 +0000 https://uptime.heymint.xyz/incident/clcs1pjmh8721hkol9zjqnhgb https://uptime.heymint.xyz/incident/clcs1pjmh8721hkol9zjqnhgb HeyMint DDoS Attack Type: Incident Duration: 3 hours and 34 minutes Affected Components: HeyMint Dec 3, 21:10:00 GMT+0 - Identified - We have identified a DDoS attack against HeyMint and are currently working on a fix. Apologies for the inconvenience, we are working hard to get everything back up and running! Dec 3, 22:26:09 GMT+0 - Identified - We are continuing to work on a fix for this incident. Dec 4, 00:00:46 GMT+0 - Monitoring - We implemented a fix and currently monitoring the result. Dec 4, 00:44:29 GMT+0 - Resolved - Thanks for your patience everyone - HeyMint is back to being fully operational. Just to clarify, the DDoS attack didn't compromise security in any regard - it merely spammed our servers with a ton of bot traffic and momentarily made the site unusable. So sorry again all! Type: Incident

Duration: 3 hours and 34 minutes

Affected Components:

<p><small>Dec <var data-var='date'> 3</var>, <var data-var='time'>21:10:00</var> GMT+0</small><br><strong>Identified</strong> - We have identified a DDoS attack against HeyMint and are currently working on a fix. Apologies for the inconvenience, we are working hard to get everything back up and running!.</p> <p><small>Dec <var data-var='date'> 3</var>, <var data-var='time'>22:26:09</var> GMT+0</small><br><strong>Identified</strong> - We are continuing to work on a fix for this incident..</p> <p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>00:00:46</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and currently monitoring the result..</p> <p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>00:44:29</var> GMT+0</small><br><strong>Resolved</strong> - Thanks for your patience everyone - HeyMint is back to being fully operational. Just to clarify, the DDoS attack didn't compromise security in any regard - it merely spammed our servers with a ton of bot traffic and momentarily made the site unusable. So sorry again all!.</p> ]]> Sat, 3 Dec 2022 21:10:00 +0000 https://uptime.heymint.xyz/incident/clb8hneff249685vo935vl32dl https://uptime.heymint.xyz/incident/clb8hneff249685vo935vl32dl