Jun <var data-var='date'>22</var>, <var data-var='time'>13:35</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'>22</var>, <var data-var='time'>13:33</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jun <var data-var='date'>22</var>, <var data-var='time'>13:29</var> UTC Update - We are continuing to investigate this issue. Jun <var data-var='date'>22</var>, <var data-var='time'>13:29</var> UTC Investigating - We are currently investigating this issue.

A few areas of the platform appear to be non-functional.

Jan <var data-var='date'>15</var>, <var data-var='time'>16:10</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'> 9</var>, <var data-var='time'>10:44</var> UTC Monitoring - Due to ongoing maintenance, some platform functionality has been temporarily paused.

Admin/Manager reward wallet transfers and topup outage

Sep <var data-var='date'>30</var>, <var data-var='time'>14:48</var> UTC Resolved - This incident has been resolved. Sep <var data-var='date'>30</var>, <var data-var='time'>13:33</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Sep <var data-var='date'>30</var>, <var data-var='time'>13:15</var> UTC Identified - The issue has been identified and a fix is being implemented. Sep <var data-var='date'>30</var>, <var data-var='time'>11:25</var> UTC Investigating - We’re currently experiencing issues caused by recent infra updates. Our team is actively investigating, and these issues are affecting most of our production users.

System infrastructure outage

Sep <var data-var='date'>16</var>, <var data-var='time'>09:02</var> UTC Resolved - This incident has been resolved. Sep <var data-var='date'>15</var>, <var data-var='time'>18:53</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. If you are an Android App user and still affected by the payment issue, make sure you head to your "My Perkbox" section, Settings (top-right corner), Check for updates. We are sorry for any inconvenience caused. Sep <var data-var='date'>15</var>, <var data-var='time'>18:37</var> UTC Identified - The issue has been identified and a fix is being implemented. Sep <var data-var='date'>15</var>, <var data-var='time'>11:44</var> UTC Investigating - We are currently investigating an issue that faces Android users being unable to complete payments on the App.

Payment outage - Android devices

Jul <var data-var='date'> 3</var>, <var data-var='time'>18:25</var> UTC Resolved - This incident has been resolved. Jul <var data-var='date'> 2</var>, <var data-var='time'>16:48</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jul <var data-var='date'> 1</var>, <var data-var='time'>19:06</var> UTC Investigating - We are currently experiencing an outage affecting Flexi and Reward wallet transactions. Users may be unable to complete transactions using their Flexi or Reward points. This includes redeeming perks on the platform.

Flexi and reward wallet transaction outage

Aug <var data-var='date'> 1</var>, <var data-var='time'>14:45</var> UTC Resolved - This incident has been resolved. Aug <var data-var='date'> 1</var>, <var data-var='time'>13:13</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Aug <var data-var='date'> 1</var>, <var data-var='time'>11:44</var> UTC Identified - Issue identified with the payment processing.

Failing payments

Apr <var data-var='date'>22</var>, <var data-var='time'>15:30</var> UTC Resolved - This incident has been resolved. Apr <var data-var='date'>22</var>, <var data-var='time'>15:16</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Apr <var data-var='date'>22</var>, <var data-var='time'>14:21</var> UTC Investigating - We have discovered an issue causing payments to fail in the US region. We are currently investigating.

Payments failing in US region

Feb <var data-var='date'>13</var>, <var data-var='time'>16:36</var> UTC Resolved - This incident has been resolved. Feb <var data-var='date'>13</var>, <var data-var='time'>10:27</var> UTC Update - We are continuing to work on a fix for this issue. Feb <var data-var='date'>13</var>, <var data-var='time'>10:26</var> UTC Identified - We have identified an issue causing payments to fail in the US region. We are working on a fix.

Jul <var data-var='date'>29</var>, <var data-var='time'>14:28</var> UTC Resolved - This incident has been resolved. Jul <var data-var='date'>29</var>, <var data-var='time'>12:40</var> UTC Investigating - We are currently undergoing routine maintenance on our US cluster. There may be intermittent outages for customers in that region. These will be resolved by 29/07/2022 15:30 UTC.

Maintenance

Jun <var data-var='date'>15</var>, <var data-var='time'>16:17</var> UTC Resolved - This incident has been resolved. Jun <var data-var='date'>15</var>, <var data-var='time'>14:54</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Jun <var data-var='date'>15</var>, <var data-var='time'>11:08</var> UTC Update - We are continuing to investigate this issue. Jun <var data-var='date'>15</var>, <var data-var='time'>11:07</var> UTC Investigating - We have identified an issue with the application of discounts to some voucher redemptions. Our teams are investigating the issue.

Perks Discounts

Mar <var data-var='date'>16</var>, <var data-var='time'>15:48</var> UTC Resolved - This incident has been resolved. Mar <var data-var='date'>16</var>, <var data-var='time'>15:19</var> UTC Monitoring - The affected services have been restarted and Perks are now redeemable. We are monitoring the results. Mar <var data-var='date'>16</var>, <var data-var='time'>14:50</var> UTC Investigating - Some Perks are returning an error when starting the redemption process. We are currently investigating the issue.

Perks issues

Feb <var data-var='date'>24</var>, <var data-var='time'>18:11</var> UTC Resolved - This incident has been resolved. Feb <var data-var='date'>24</var>, <var data-var='time'>17:17</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Feb <var data-var='date'>24</var>, <var data-var='time'>16:56</var> UTC Investigating - Login is currently not functioning for users who log in via single sign-on. We are currently investigating the root cause of the issue

Perkbox login down

Jan <var data-var='date'>10</var>, <var data-var='time'>12:56</var> UTC Resolved - This incident has been resolved. Jan <var data-var='date'>10</var>, <var data-var='time'>12:32</var> UTC Monitoring - The issue has been identified and resolved. Platform is operational again, we are monitoring some minor failures which won't prevent the main usage of our products. Jan <var data-var='date'>10</var>, <var data-var='time'>12:15</var> UTC Investigating - We are currently investigating the issue

Intermittent platform outage

Oct <var data-var='date'>19</var>, <var data-var='time'>14:23</var> UTC Resolved - This incident has been resolved. Oct <var data-var='date'>19</var>, <var data-var='time'>12:37</var> UTC Monitoring - A fix has been deployed and we're now monitoring. Service is back ON Oct <var data-var='date'>19</var>, <var data-var='time'>11:49</var> UTC Identified - The issue has been identified. We're about to restore service and start monitoring. Oct <var data-var='date'>19</var>, <var data-var='time'>11:46</var> UTC Investigating - Issue is under investigation.

Perks redemptions

Oct <var data-var='date'> 8</var>, <var data-var='time'>12:39</var> UTC Resolved - This incident has been resolved. Oct <var data-var='date'> 8</var>, <var data-var='time'>06:21</var> UTC Investigating - We are currently experiencing issues with Login and Perks affecting the ability to login, browse and redeem offers. Updates to follow.

Login & Perks

Sep <var data-var='date'> 4</var>, <var data-var='time'>10:54</var> UTC Resolved - This incident has been resolved. Sep <var data-var='date'> 4</var>, <var data-var='time'>10:21</var> UTC Identified - The issue has been identified and a fix is being implemented. Sep <var data-var='date'> 4</var>, <var data-var='time'>09:54</var> UTC Investigating - We are currently experiencing issues with Perks affecting the ability to redeem. Updates to follow.

Aug <var data-var='date'>26</var>, <var data-var='time'>14:19</var> UTC Resolved - This incident has been resolved. Aug <var data-var='date'>26</var>, <var data-var='time'>14:12</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Aug <var data-var='date'>26</var>, <var data-var='time'>14:01</var> UTC Identified - The issue has been identified and a fix is being implemented.

Perks product down

Oct <var data-var='date'>19</var>, <var data-var='time'>19:48</var> UTC Resolved - Our engineers have resolved this issue. Hooray! Rewards are back! The issue was caused by timeouts in our Rewards service. We've put in place measures to ensure these timeouts do not reoccur. Oct <var data-var='date'>19</var>, <var data-var='time'>01:37</var> UTC Investigating - We are investigating an issue where our Australian users are unable to send Rewards on our platform. An update will be posted as soon as more information becomes available. UK and France users are unaffected.

Cannot send Rewards in Australia

Sep <var data-var='date'>24</var>, <var data-var='time'>10:01</var> UTC Resolved - Good news. Our apps are functioning again as normal after some fixes that were pushed out quickly by our devs in the last 24 hours. We are still working out the root cause as the issue did affect some users on both iOS and Android phones. If the Perkbox app is frozen for you, please close the app and then re-launch it on your phone. The auto update should resolve the issue. In the case of the auto update failing and it still freezing, then please re-install the app. Sep <var data-var='date'>22</var>, <var data-var='time'>17:24</var> UTC Monitoring - We are suspecting the iOS 14 update is causing issues to our app and for other 3rd party apps. If you have problems loading the app on your iPhone, our current advice is to uninstall then re-install the app to get it working. Again, sorry for the inconvenience caused. Sep <var data-var='date'>22</var>, <var data-var='time'>10:44</var> UTC Investigating - Since this morning, we've had reports that our mobile app is freezing on certain occasions (e.g. when resuming the app). Our team of engineers are currently investigating. An update will be provided shortly. In the the mean time, please enjoy your benefits by accessing Perkbox on your browser (desktop or mobile). Sorry for any inconvenience caused.

App freezing issue

Jul <var data-var='date'>23</var>, <var data-var='time'>01:05</var> UTC Resolved - All fixed! Thanks again for your patience. Jul <var data-var='date'>23</var>, <var data-var='time'>00:01</var> UTC Monitoring - We've rolled out a fix. We're just doing our final bit of testing to make sure it's working as it should be. Jul <var data-var='date'>22</var>, <var data-var='time'>23:39</var> UTC Identified - We've found an issue where our Perks are not being displayed on our Perks home page for our Australian users. You are still able to search and browse Perks via the categories. Our engineers are working hard to solve this issue. Thank you for your patience.

Perks not showing up in Australia (Perks home page only)

Jun <var data-var='date'>16</var>, <var data-var='time'>16:49</var> UTC Resolved - We've sorted out the deployment issues with an earlier release. Our Platform's admin features are working normally again. Thanks for your patience. Jun <var data-var='date'>16</var>, <var data-var='time'>16:08</var> UTC Identified - The issue has been identified. We're rolling out the fix very shortly. Jun <var data-var='date'>16</var>, <var data-var='time'>14:34</var> UTC Investigating - We are currently investigating a Platform issue that is causing errors on some of our admin features. We are are looking to fix this asap. Sorry for the inconvenience.

Some Platform admin features not functioning

May <var data-var='date'>30</var>, <var data-var='time'>14:19</var> UTC Resolved - Perks product is stable and back to normal operations. May <var data-var='date'>30</var>, <var data-var='time'>14:05</var> UTC Monitoring - The perks product is back up and running. We are monitoring it to make sure it is stable. May <var data-var='date'>30</var>, <var data-var='time'>11:42</var> UTC Identified - A third party service we use for search within the perks product is experiencing technical difficulties. https://status.algolia.com When their issues are resolved, our services will come back online. May <var data-var='date'>30</var>, <var data-var='time'>11:34</var> UTC Investigating - We are currently investigating a perks product outage.

Feb <var data-var='date'>21</var>, <var data-var='time'>10:34</var> UTC Resolved - This incident has been resolved. Feb <var data-var='date'>21</var>, <var data-var='time'>08:54</var> UTC Monitoring - A fix has been implemented and we are monitoring the results. Feb <var data-var='date'>21</var>, <var data-var='time'>04:32</var> UTC Identified - The issue has been identified and a fix is being implemented. Feb <var data-var='date'>21</var>, <var data-var='time'>03:05</var> UTC Investigating - We are currently experiencing some technical issues with our Reporting. As a result, data is failing to display under the ‘Perks’ and ‘Platform’ section. Your data is safe and our engineers are working hard to get this fixed as soon as possible. In the meantime, thank you for your patience. Please reach out to us if you have any questions.

Admin Reporting

Feb <var data-var='date'> 7</var>, <var data-var='time'>14:28</var> UTC Resolved - Our Insights product is fixed too. We have been monitoring our systems for the past few hours and everything is now back to normal. Thank you for your patience. This incident report is now closed. Feb <var data-var='date'> 7</var>, <var data-var='time'>08:43</var> UTC Update - Good news - our Perks and Recognition products are now back up and running and you should be able to use these two products as usual! :tada: Great work tech wizards. We are still experiencing issues with our Insights product, but are working hard on a fix. We’ll be back on here to let you know when it’s back with us. Thank you all again for your patience - we really appreciate it! Feb <var data-var='date'> 7</var>, <var data-var='time'>06:44</var> UTC Update - Our engineers have been tirelessly working through the night to bring you back the service you know and love. We’re very very nearly there… please sit tight for further updates! This is not the service we strive to provide for our customers and thank you all for you patience and support. Feb <var data-var='date'> 6</var>, <var data-var='time'>21:18</var> UTC Identified - We’re experiencing technical issues at the moment. We’re working hard to fix the problem - please try again later. Thank you for your patience Feb <var data-var='date'> 6</var>, <var data-var='time'>18:09</var> UTC Investigating - Due to an issue found during the maintenance, we are now rolling back our changes and will then reschedule the maintenance work to be carried out at another time.

Australia Platform maintenance - performing rollback

Feb <var data-var='date'> 6</var>, <var data-var='time'>19:00</var> UTC Completed - The scheduled maintenance has been completed. Feb <var data-var='date'> 6</var>, <var data-var='time'>15:00</var> UTC In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Feb <var data-var='date'> 4</var>, <var data-var='time'>18:55</var> UTC Scheduled - On Friday, 7 February, 2020 at 02:00 Australian Eastern Daylight Time (AEDT), we will be performing a platform and security upgrade for all our Australia services. The maintenance should take up to two hours maximum. During this time, only Australian customers will be impacted: Admin, Insights, Perks, Reward & Recognition applications being unavailable for the entire duration. This will affect Web, Mobile, and App users both on iOS and Android.

Is Perkbox down?

Perkbox status is UP

Lastest published events

A few areas of the platform appear to be non-functional.

Admin/Manager reward wallet transfers and topup outage

System infrastructure outage

Perkbox Services, Components and Regions

Recent Perkbox events

A few areas of the platform appear to be non-functional.

Admin/Manager reward wallet transfers and topup outage

System infrastructure outage

Payment outage - Android devices

Flexi and reward wallet transaction outage

Failing payments