Mailgun Outage History

This incident has been resolved.

Logs are currently experiencing delays of 20 minutes in Mailgun's EU region. Outbound processing, inbound processing, and webhook delivery are operating normally.

Logs are currently experiencing delays of 15 minutes in Mailgun's EU region. Outbound processing, inbound processing, and webhook delivery are operating normally.

All systems are operating normally.

Events are processing normally without delay. We will continue to monitor the performance of the logging system.

Logs are currently delayed by 20 minutes due to elevated sending volumes. Outbound sending, inbound messages, and webhooks are not impacted.

Logs are currently delayed by 15 minutes due to elevated sending volumes.

Events are processing normally, we continue to monitor as we see elevated send volumes.

Events are processing normally, we continue to monitor as we see elevated send volumes.

Event processing has caught up and delays have resolved. We continue to monitor all operations.

We continue to see logging event delays of up to 5 minutes.

We continue to see logging event delays of up to 10 minutes.

We continue to see logging event delays of up to 20 minutes.

We continue to see logging event delays of up to 30 minutes.

We continue to see logging event delays of up to 35 minutes.

We continue to see logging event delays of up to 45 minutes.

We continue to see logging event delays of up to 50 minutes.

We continue to see logging event delays of up to 55 minutes.

We continue to see logging event delays of up to 60 minutes.

We continue to see logging event delays of up to 60 minutes.

We continue to see logging event delays of up to 60 minutes.

We continue to see logging event delays of up to 60 minutes.

We continue to see logging event delays of up to 60 minutes.

We continue to see logging event delays of up to 60 minutes.

We continue to see logging event delays of up to 55 minutes.

We continue to see logging event delays of up to 50 minutes.

We continue to see logging event delays of up to 40 minutes.

We continue to see logging event delays of up to 40 minutes.

We continue to see logging event delays of up to 40 minutes.

We continue to see logging event delays of up to 30 minutes.

We continue to see logging event delays of up to 25 minutes.

We're currently seeing delayed logging events in the EU region with up to a 15-minute delay.

Events are processing normally.

Events are processing normally, we continue to monitor as we see elevated send volumes.

Logs are currently experiencing delays of 15 minutes in Mailgun's US region. Outbound processing, inbound processing, and webhook delivery are operating normally.

This incident has been resolved.

We continue to monitor while the system processes delayed events.

A fix has been implemented and we are monitoring the results. The system continues to work through the delayed logging events backlog.

Engineers are continuing to implement a fix for this issue.

The issue has been identified and a fix is being implemented.

We are continuing to investigate this issue.

We are currently investigating this issue.

This incident has been resolved.

Operations are back to normal and queues are cleared. We'll continue to monitor.

Queues are being worked through, we continue to monitor resolution.

We have identified processing delays for some messages in our US region. A fix has been deployed and we are monitoring the recovery.

Between 12:55 UTC and 13:07 UTC, customers may have experienced email sending failures in the US region. A deployment of new code caused our sending pipeline to temporarily reject some email submissions with HTTP 500 or SMTP 451 errors (~ 2.5% of requests). Our team quickly identified the issue, rolled back the deployment, and restored normal service. Traffic was immediately shifted from the affected US region to the non impacted region to further mitigate customer impact while the rollback took place.

This incident has been resolved.

We are continuing to monitor for any further issues.

A fix has been implemented and we are monitoring the results.

The issue has been identified and a fix is being implemented.

We are currently investigating this issue.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

We are currently investigating this issue.

This incident has been resolved.

Queues are being worked through. Normal email delivery times will resume shortly. In addition to delayed email delivery, these other parts of our system saw increased processing time as well: inbound routes, forwards, webhook delivery, and unsubscribe processing.

A fix has been implemented and we are monitoring the results.

We are continuing to work on a fix for this issue.

We are continuing to work on a fix for this issue.

The issue has been identified and a fix is being implemented.

Email's sent from our Europe region may be experiencing increased delivery times. We are currently investigating.

This incident has been resolved.

Services are fully operational.

Email's from our us-east region may have experienced longer delivery time between 16:00 UTC and 16:20 UTC. The issue is resolved and we are monitoring.

This incident has been resolved.

We are continuing to monitor the system as delays resolve

A fix has been implemented and we are monitoring the results.

Customers using the events or logs APIs or viewing logs in the customer portal may see delays in some events appearing.

This incident has been resolved.

The current status of Let's Encrypt infrastucture is "[Identified] We have deployed mitigations for the failure of our internal DNS servers. Issuance of certificates is now succeeding, though we are still recovering from the resulting high traffic volumes." We are monitoring the situation and will update our status page accordingly.

Let's Encrypt, the certificate issuer used for creating certificates on customer tracking domains is experiencing an outage (https://letsencrypt.status.io/). Attempting to generate or regenerate a tracking certificate will not succeed until service is restored.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

We have identified an issue with one of our datastores and are attempting to implement a fix.

We are currently investigating reports of degraded performance.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

A fix has been implemented and we are monitoring the results.

Our team is investigating degraded performance in our logs and event APIs.

This incident has been resolved.

Our team has resolved the login issue.

Our team is investigating reports of Login issues for a subset of administrative accounts

This incident has been resolved.

A fix has been implemented and traffic is sending through these networks. We are monitoring the resolution.

We are continuing to work with our network provider to bring this range online.

Further mitigations are being worked on to resolve networking issues, messages will continue to be delayed until a full fix is implemented.

We are continuing to process the sending backlog at a reduced rate while things recover. Delays for the affected network should still be expected.

Connectivity has been restored, we are monitoring the traffic backlog as sending resumes.

We are continuing to work with our networking partner on the fix. Only customers sending with IPs in the 159.135.132.0/24 range are impacted.

Due to network connectivity issues with a third party, there is a chance that emails being sent through Mailgun's EU region are experiencing delivery delays. The issue has been identified and a fix is in progress.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

We are currently experiencing elevated timeouts when sending email via SMTP in US regions. Investigation is underway.

This incident has been resolved.

Data is continuing to be backfilled. We are monitoring the process.

We are monitoring the backfill process for log data.

A fix has been implemented and we are monitoring the results.

The issue has been identified and a fix is being implemented.

Some logs are delayed in our EU region. We are currently investigating the issue.

The data back fill process will complete shortly.

The work on restoring the missing data from 00:00 -> 1:40 UTC continues. We are continuing to monitor the back fill process.

The work on restoring the missing data from 00:00 -> 1:40 UTC is well underway. We continue to monitor the backfill process.

The work on restoring the missing data from 00:00 -> 1:40 UTC is still ongoing.

The Events API continues to operate as expected. Some customers may be missing events from 00:00 through 01:40 UTC. We are actively working on restoring that data.

The Events / Logs API & control panel are now working as expected. We continue to monitor closely.

The issue has been identified and a fix is being implemented.

We are experiencing issues with our Events & Logs API for our US regions. You may notice missing events at the moment (API & Control panel). Engineering is investigating.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

We are continuing to work on a fix for this issue.

The issue has been identified and a fix is being implemented.

This incident has been resolved.

Delay continues to decrease, we are monitoring the recovery at this time.

We are monitoring our system as the delay resolves.

The issue has been identified and a fix is being implemented.

We are currently investigating this issue.

This incident has been resolved.

We are continuing to monitor for any further issues.

The issue has been addressed. Monitoring continues.

The issue has been identified.

We are currently seeing an increase in failed email delivery in our EU region. Investigation is ongoing.

This incident has been resolved.

Delivery time for EU transactional emails is back to normal. We continue to monitor.

We are currently experiencing delays delivering transactional emails in our EU region. Investigation is ongoing.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

We are continuing to investigate the issue.

Inbound route processing in the EU region is currently experiencing delays. We are investigating the issue.

This incident has been resolved.

A fix has been implemented. We continue to monitor.

We continue to investigate a fix.

We are currently investigating intermittent issues logging into the Mailgun control panel. The source of the issue has been identified.

This incident has been resolved.

A fix has been implemented and we are monitoring the resolution.

We are currently investigating intermittent issues logging into the Mailgun control panel.

This incident has been resolved.

We have identified the cause of intermittent errors when logging into or navigating the Control Panel and are working on a fix.

We are currently investigating intermittent errors when logging into or navigating the Control Panel.

This incident has been resolved.

We continue to closely monitor traffic and are prepared to make additional proactive and reactive infrastructure changes as required.

We have completed a series of successful infrastructure changes and will monitor traffic closely over the weekend. Unless there is another major development, our next update will be on Monday.

Still executing against the mitigation strategy and monitoring platform performance.

We continue to execute against our mitigation strategy and closely monitor platform performance.

We continue to monitor platform performance.

We continue to deploy infrastructure updates, both proactive and reactive, while closely monitoring platform performance.

We are continuing to actively mitigate the attack at this time and are closely monitoring the performance of the system.

Our platform is still under an active DDoS attack. We are continuing to apply mitigation tactics and closely monitoring platform performance.

We are seeing the attack to be shifted to the EU region. We continue to monitor the situation.

We continue to investigate solutions and are actively monitoring the system.

DDoS protection remains in place. We are actively monitoring the system.

We are still seeing reports of some customers having issues. Moving the component status to "Degraded Performance".

DDoS protection is still in place. We are continuing to monitor the system.

Implemented DDoS protection and monitoring results.

The issue has been identified and a fix is being implemented.

We are continuing to investigate this issue.

We've been seeing intermittent connection issues to our API and SMTP endpoints located in the US.