Jan <var data-var='date'> 9</var>, <var data-var='time'>13:03</var> PST Resolved - Intercom has implemented a fix for the earlier outage affecting Inbox, Messenger, Fin, and related features in the US region. Live chat and in-app messaging should now be functioning normally. We are continuing to monitor the situation to ensure stability and will provide further updates if needed. Thank you for your patience while this issue was being resolved.Jan <var data-var='date'> 9</var>, <var data-var='time'>12:25</var> PST Monitoring - We are currently experiencing an issue with our live chat functionality due to an ongoing outage with Intercom, our third-party chat provider. Intercom has confirmed a service disruption affecting Inbox, Messenger, Fin, and related developer features in the US region. As a result, live chat and in-app messaging may be unavailable or not function as expected at this time. Please note that this issue is isolated to Intercom and does not impact the core functionality of our platform. Intercom is actively investigating and working to restore service. We will continue to monitor the situation and provide updates here as more information becomes available. Thank you for your patience.

Intercom Outage Impacting Live Chat

Oct <var data-var='date'>21</var>, <var data-var='time'>10:55</var> PDT Resolved - The issues impacting Funraise services due to the AWS outage have been fully resolved. All systems are now operating normally. Thank you for your patience while we monitored and restored stability.Oct <var data-var='date'>20</var>, <var data-var='time'>11:15</var> PDT Monitoring - We’ve completed an initial investigation of the major AWS outage mentioned in the retroactive post (https://status.funraise.org/incidents/h5bvwz1fy8kv) and confirmed that Funraise’s core services remain operational and unaffected. However, we are seeing impact at the boundaries where third-party platforms are experiencing issues—specifically with integrations. Some data syncs to external systems are failing, most notably Salesforce, which is currently reporting an ongoing outage. We are actively monitoring these dependencies and will provide updates as third-party services recover.

Investigating third-party outage (AWS US-EAST-1)

Oct <var data-var='date'>19</var>, <var data-var='time'>23:00</var> PDT Resolved - We’re aware of an ongoing AWS incident in the US-EAST-1 region that may impact some cloud services. We’re investigating potential effects on Funraise and will update this page as we learn more. What’s happening Amazon Web Services (AWS) is experiencing increased error rates and latency across multiple services in the US-EAST-1 region. AWS has reported connectivity issues and intermittent errors beginning around 12:11 AM PDT and continuing through the morning, with signs of gradual recovery. Impact to Funraise We have not yet confirmed a direct impact to core Funraise applications. Out of an abundance of caution, we are actively monitoring for customer-visible symptoms, including: Elevated error rates or slow page loads in the app or public donation pages Delays in background jobs (exports, webhooks, receipts, integrations) Delayed event processing or queue backlogs What we’re doing Reviewing service health and telemetry across our infrastructure that relies on AWS. Verifying redundancy and autoscaling behavior, and watching for queue backlogs. Background (from AWS public updates) 7:29 AM PDT: AWS confirms multiple services in US-EAST-1 had connectivity issues; early signs of recovery. 7:14 AM PDT: Significant API errors/connectivity issues confirmed across multiple services in US-EAST-1. Earlier updates indicate DNS issues affecting DynamoDB and downstream services, new EC2 instance launch errors in US-EAST-1, and backlog processing for services like Lambda/EventBridge/CloudTrail, with gradual recovery actions underway. We’ll keep this post updated as we learn more. If you’re experiencing urgent issues, please contact Funraise Support with timestamps and any error messages observed.

Dec <var data-var='date'>13</var>, <var data-var='time'>10:24</var> PST Resolved - We are happy to report that our Facebook integration has been fully restored following the recent Facebook outage. Our team has worked diligently to resolve all issues caused by the disruption, ensuring that everything is back to normal. If your Facebook integration was disconnected during the outage, you will need to re-enable it in your account settings. Once reconnected, please contact our support team to request a re-sync of any Facebook transaction reports. This will ensure your data is accurate and up to date. Thank you for your patience and understanding during this time. If you experience any further issues, please don’t hesitate to reach out to our support team.Dec <var data-var='date'>11</var>, <var data-var='time'>13:35</var> PST Update - We are continuing to investigate this issue and if it is related to the the global Meta / Facebook outage.Dec <var data-var='date'>11</var>, <var data-var='time'>09:44</var> PST Investigating - We're investigating an issue that is causing the Facebook integration to be disconnected.

Facebook Connectivity Issue

Sep <var data-var='date'>26</var>, <var data-var='time'>19:14</var> PDT Completed - The scheduled maintenance has been completed.Sep <var data-var='date'>26</var>, <var data-var='time'>18:42</var> PDT Verifying - Verification is currently underway for the maintenance items.Sep <var data-var='date'>26</var>, <var data-var='time'>17:56</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Sep <var data-var='date'>25</var>, <var data-var='time'>11:35</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

Database Maintenance

Aug <var data-var='date'>24</var>, <var data-var='time'>13:00</var> PDT Resolved - This incident has been resolved.Aug <var data-var='date'>24</var>, <var data-var='time'>11:33</var> PDT Update - We are continuing to monitor for any further issues.Aug <var data-var='date'>24</var>, <var data-var='time'>11:33</var> PDT Monitoring - It has been reported by users and verified by our internal team that the PayPal buttons are intermittently disappearing from donation forms. Users affected by this issue are temporarily unable to make transactions through PayPal while the buttons are not visible. Preliminary investigations indicate that the root cause of this issue resides on PayPal's end. PayPal is working on tracking the resolution on their incident page: https://www.paypal-status.com/incident/production

Paypal Buttons Disappearing

Jul <var data-var='date'>18</var>, <var data-var='time'>15:00</var> PDT Resolved - Since 2023-07-18 3:01 ET, there was an issue detected with an upstream payments processor causing intermittent donation failures for a subset of customers for a subset of donations. The upstream provider resolved the issue as of 20:00 ET.

Upstream Payment Provider Intermittent Errors

Dec <var data-var='date'>30</var>, <var data-var='time'>18:41</var> PST Resolved - This incident has been resolved.Dec <var data-var='date'>30</var>, <var data-var='time'>16:56</var> PST Update - We are continuing to monitor this issue with our upstream payments provider. We're seeing intermittent failures with other payment methods.Dec <var data-var='date'>30</var>, <var data-var='time'>13:34</var> PST Update - We are continuing to monitor this issue.Dec <var data-var='date'>30</var>, <var data-var='time'>13:34</var> PST Identified - We've identified an issue with an upstream payments provider (Legacy Delegate Mode PayPal) which is causing intermittent failures for a small number of customers and a subset of PayPal donations. We are currently monitoring the upstream provider for restoration of service.

Some PayPal Donations Are Failing For Legacy PayPal

Jul <var data-var='date'> 5</var>, <var data-var='time'>13:07</var> PDT Resolved - This incident has been resolved.Jul <var data-var='date'> 5</var>, <var data-var='time'>13:04</var> PDT Monitoring - A fix has been implemented and we are monitoring the results.Jul <var data-var='date'> 5</var>, <var data-var='time'>13:02</var> PDT Investigating - We've identified an underlying hardware fault at our data tier that is causing some requests to slow down. We're working to add capacity to restore performance.

Performance Degredation

Jun <var data-var='date'>21</var>, <var data-var='time'>12:18</var> PDT Resolved - This incident is resolved.Jun <var data-var='date'>21</var>, <var data-var='time'>07:03</var> PDT Monitoring - A fix has been implemented and we are monitoringJun <var data-var='date'>21</var>, <var data-var='time'>00:17</var> PDT Identified - We have identified an issue with our upstream hosting service.Jun <var data-var='date'>20</var>, <var data-var='time'>23:18</var> PDT Investigating - We are currently investigating a system wide outage due to an upstream service provider.

Platform Outage - Upstream Service Provider

May <var data-var='date'>22</var>, <var data-var='time'>20:54</var> PDT Completed - The scheduled maintenance has been completed.May <var data-var='date'>22</var>, <var data-var='time'>20:45</var> PDT Verifying - Verification is currently underway for the maintenance items.May <var data-var='date'>22</var>, <var data-var='time'>20:22</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.May <var data-var='date'>22</var>, <var data-var='time'>19:15</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

2022.5.0

Apr <var data-var='date'>18</var>, <var data-var='time'>17:35</var> PDT Completed - The scheduled maintenance has been completed.Apr <var data-var='date'>18</var>, <var data-var='time'>17:21</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Apr <var data-var='date'>18</var>, <var data-var='time'>16:55</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

2022.4.0 Release Window

Mar <var data-var='date'>27</var>, <var data-var='time'>08:31</var> PDT Completed - The scheduled maintenance has been completed.Mar <var data-var='date'>27</var>, <var data-var='time'>08:30</var> PDT Verifying - Verification is currently underway for the maintenance items.Mar <var data-var='date'>27</var>, <var data-var='time'>08:24</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Mar <var data-var='date'>27</var>, <var data-var='time'>08:01</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

2022.3.0

Mar <var data-var='date'> 2</var>, <var data-var='time'>11:11</var> PST Resolved - This incident has been resolved.Feb <var data-var='date'>28</var>, <var data-var='time'>20:00</var> PST Monitoring - A fix has been implemented and is being rolled out across Funraise accounts.Feb <var data-var='date'>28</var>, <var data-var='time'>12:08</var> PST Identified - We're currently investigating reports of some platform accounts not showing fully up-to-date donation data. Account data is still being stored and ingested and donations are processing correctly but just are not showing up correctly in lists at the moment. We're working on resolving this issue and expect no data loss.

Not All Recent Donations Are Visible In Platform

Dec <var data-var='date'>22</var>, <var data-var='time'>04:00</var> PST Resolved - A handful (~10) of donations using our new PayPal integration failed to process between 4:15am to 6:30am Pacific Standard Time due to a power loss at an Amazon data center. Amazon resolved the situation and donations are processing normally through that integration since 6:30am PST.

Datacenter Power Outage Causes Failed Donations

Dec <var data-var='date'>12</var>, <var data-var='time'>23:00</var> PST Resolved - Funraise for the does not use log4j for any of its native application code. Funraise identified one area of log4j use in a 3rd party component that we use for search engine functionality (ElasticSearch) that is hosted separately from the Funraise Platform core infrastructure. Funraise applied the appropriate initial patches and mitigation strategies on Dec 13 and continues to monitor the situation as new recommendations and patches are released and has found no evidence of exploit or attempted exploit in our application logs. Log4j was also identified in a 3rd party component powering our BI functionality. This functionality is also hosted separately from the Funraise core infrastructure and presents lowered risk of RCE. The vendor for that component patched and updated their infrastructure on Dec 16. Funraise continues to maintain a proactive security posture and undergoes annual analysis of our codebase and infrastructure by an independent security firm.

Log4j Statement

Oct <var data-var='date'>31</var>, <var data-var='time'>10:04</var> PDT Completed - The scheduled maintenance has been completed.Oct <var data-var='date'>31</var>, <var data-var='time'>10:02</var> PDT Verifying - Verification is currently underway for the maintenance items.Oct <var data-var='date'>31</var>, <var data-var='time'>09:52</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Oct <var data-var='date'>31</var>, <var data-var='time'>09:18</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

2021.9.0 Release Window

Sep <var data-var='date'>19</var>, <var data-var='time'>19:37</var> PDT Completed - The scheduled maintenance has been completed.Sep <var data-var='date'>19</var>, <var data-var='time'>19:28</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Sep <var data-var='date'>19</var>, <var data-var='time'>18:45</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

Sep <var data-var='date'> 2</var>, <var data-var='time'>20:04</var> PDT Completed - The scheduled maintenance has been completed.Sep <var data-var='date'> 2</var>, <var data-var='time'>18:44</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Sep <var data-var='date'> 1</var>, <var data-var='time'>15:50</var> PDT Update - We will be undergoing scheduled maintenance during this time.Sep <var data-var='date'> 2</var>, <var data-var='time'>18:00</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

2021.8.0 Release Window

Aug <var data-var='date'>31</var>, <var data-var='time'>17:30</var> PDT Resolved - The Funraise platform suffered a downtime from 1:31:11am UTC - 2:05:07am UTC due to insufficient compute to spawn new application instances. Funraise has increased server capacity to mitigate this issue going forward.

Platform Unavailability

Aug <var data-var='date'>28</var>, <var data-var='time'>10:45</var> PDT Completed - The scheduled maintenance has been completed.Aug <var data-var='date'>28</var>, <var data-var='time'>10:30</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Aug <var data-var='date'>28</var>, <var data-var='time'>10:30</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

Planned Downtime

Jul <var data-var='date'>27</var>, <var data-var='time'>15:30</var> PDT Resolved - This incident has been resolved.Jul <var data-var='date'>27</var>, <var data-var='time'>15:01</var> PDT Monitoring - A fix has been implemented and we are monitoring the results.Jul <var data-var='date'>27</var>, <var data-var='time'>13:39</var> PDT Update - We are continuing to investigate this issue.Jul <var data-var='date'>27</var>, <var data-var='time'>13:39</var> PDT Investigating - We're currently investigating reports of some platform accounts showing no data in certain sections. Account data is still being stored and ingested and donations are processing correctly but just are not showing up correctly in lists at the moment. We're working on resolving this issue and expect no data loss.

Lists Showing "No Data" In Certain Situations

Jul <var data-var='date'>26</var>, <var data-var='time'>11:00</var> PDT Resolved - Funraise platform suffered a downtime between 11:06am-11:17am PDT. The cause was underlying infrastructure not being able to boot a new set of application servers in a timely manner. Our systems team responded quickly and restarted our application server formation which provisioned a new set of servers which started successfully.

Platform Downtime

Jun <var data-var='date'>27</var>, <var data-var='time'>11:00</var> PDT Completed - The scheduled maintenance has been completed.Jun <var data-var='date'>27</var>, <var data-var='time'>10:00</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Jun <var data-var='date'>27</var>, <var data-var='time'>09:32</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

2021.6.0 Release Window

Jun <var data-var='date'>13</var>, <var data-var='time'>10:47</var> PDT Completed - The scheduled maintenance has been completed.Jun <var data-var='date'>13</var>, <var data-var='time'>09:54</var> PDT Verifying - Verification is currently underway for the maintenance items.Jun <var data-var='date'>13</var>, <var data-var='time'>09:40</var> PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.Jun <var data-var='date'>13</var>, <var data-var='time'>09:15</var> PDT Scheduled - We will be undergoing scheduled maintenance during this time.

Is Funraise down?

Funraise status is UP

Lastest published events

Intercom Outage Impacting Live Chat

Investigating third-party outage (AWS US-EAST-1)

Investigating third-party outage (AWS US-EAST-1)

Funraise Services, Components and Regions

Recent Funraise events

Intercom Outage Impacting Live Chat

Investigating third-party outage (AWS US-EAST-1)

Investigating third-party outage (AWS US-EAST-1)

Facebook Connectivity Issue

Database Maintenance

Paypal Buttons Disappearing

Get your FREE account now,
5 monitors included!

Is Funraise down?

Funraise status is UP

Lastest published events

Intercom Outage Impacting Live Chat

Investigating third-party outage (AWS US-EAST-1)

Investigating third-party outage (AWS US-EAST-1)

Funraise Services, Components and Regions

Recent Funraise events

Intercom Outage Impacting Live Chat

Investigating third-party outage (AWS US-EAST-1)

Investigating third-party outage (AWS US-EAST-1)

Facebook Connectivity Issue

Database Maintenance

Paypal Buttons Disappearing

Get your FREE account now,5 monitors included!

Get your FREE account now,
5 monitors included!