tag:status.sendle.com,2005:/historySendle Status - Incident History2024-03-29T16:41:01+11:00Sendletag:status.sendle.com,2005:Incident/202372132024-03-14T10:16:25+11:002024-03-14T10:16:25+11:00Sendle Canada to USA cross-border ordering outage<p><small>Mar <var data-var='date'>14</var>, <var data-var='time'>10:16</var> AEDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>14</var>, <var data-var='time'>08:59</var> AEDT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Mar <var data-var='date'>14</var>, <var data-var='time'>08:28</var> AEDT</small><br><strong>Update</strong> - Canada to USA cross-border ordering is currently unavailable. We are working to restore service as soon as possible.</p><p><small>Mar <var data-var='date'>14</var>, <var data-var='time'>07:27</var> AEDT</small><br><strong>Investigating</strong> - We are investigating elevated error rates impacting Canada to USA cross-border orders.</p>tag:status.sendle.com,2005:Incident/201602532024-03-05T08:33:40+11:002024-03-05T08:33:40+11:00Tracking Delays - USA<p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>08:33</var> AEDT</small><br><strong>Resolved</strong> - Our upstream provider has resolved the issue and tracking events will be processed as expected.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>07:37</var> AEDT</small><br><strong>Identified</strong> - We are aware of tracking delays for USA domestic and export orders . This is related to an outage one of our upstream providers is experiencing.<br /><br />This may cause inaccuracies on our public tracking pages and tracking API while our system waits to retrieve up-to-date data.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>07:37</var> AEDT</small><br><strong>Investigating</strong> - We are aware of tracking delays for USA domestic and export orders . This is related to an outage one of our upstream providers is experiencing.<br /><br />This may cause inaccuracies on our public tracking pages and tracking API while our system waits to retrieve up-to-date data.</p>tag:status.sendle.com,2005:Incident/200913862024-02-28T10:29:49+11:002024-02-28T10:29:49+11:00Partial USA and Canada Quoting and Ordering Outage<p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>10:29</var> AEDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>08:44</var> AEDT</small><br><strong>Monitoring</strong> - Our upstream provider has indicated that a fix for the issue has been put in place and this incident appears to be resolved. Our engineering team will continue to monitor for stability.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>08:30</var> AEDT</small><br><strong>Identified</strong> - We're experiencing elevated errors with quotes and orders for certain USA and Canada routes. This is related to an issue one of our upstream providers is experiencing.<br /><br />Our engineers are investigating solutions to mitigate the impact on our side, and monitoring the upstream issue.</p>tag:status.sendle.com,2005:Incident/199247612024-02-07T11:26:28+11:002024-02-07T11:26:29+11:00Dashboard and API Offline<p><small>Feb <var data-var='date'> 7</var>, <var data-var='time'>11:26</var> AEDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'> 7</var>, <var data-var='time'>07:45</var> AEDT</small><br><strong>Monitoring</strong> - The Sendle dashboard and API are back online. We have identified the root cause of the outage and are exploring options to prevent this from occurring again.</p><p><small>Feb <var data-var='date'> 7</var>, <var data-var='time'>07:06</var> AEDT</small><br><strong>Investigating</strong> - We're experiencing an elevated level of errors and timeouts on our Dashboard and API.<br /><br />Our team is actively investigating.</p>tag:status.sendle.com,2005:Incident/196519002024-01-09T10:30:00+11:002024-01-09T12:05:55+11:00Partial Canada Quoting and Ordering Outage<p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>10:30</var> AEDT</small><br><strong>Resolved</strong> - We’re experiencing elevated errors with quotes and orders for certain routes in Canada. Our engineers have investigated and mitigated the issue and are monitoring the situation.</p>tag:status.sendle.com,2005:Incident/190634872023-11-08T10:00:00+11:002023-11-09T10:01:21+11:00Elevated error counts for USA quoting and booking<p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>10:00</var> AEDT</small><br><strong>Resolved</strong> - We have experienced elevated errors with quotes and orders for USA routes related to an issue one of our upstream providers was experiencing.</p>tag:status.sendle.com,2005:Incident/187564252023-10-12T04:05:15+11:002023-10-12T04:05:15+11:00Resolved: Elevated error counts for USA quoting and booking<p><small>Oct <var data-var='date'>12</var>, <var data-var='time'>04:05</var> AEDT</small><br><strong>Resolved</strong> - We have experienced elevated errors with quotes and orders for certain USA routes.<br /><br />We identified the cause of the errors and have now mitigated the issue to restore service.</p>tag:status.sendle.com,2005:Incident/187039622023-10-06T11:00:00+11:002023-10-06T12:15:11+11:00Partial USA quoting and ordering outage<p><small>Oct <var data-var='date'> 6</var>, <var data-var='time'>11:00</var> AEDT</small><br><strong>Resolved</strong> - We’ve identified elevated errors with quotes and orders for certain USA routes. This was related to an issue one of our upstream providers experienced.<br /><br />Our engineers have mitigated the impact on our side, the service has been restored. We will continue to monitor the upstream issue.</p>tag:status.sendle.com,2005:Incident/186041942023-09-26T06:57:50+10:002023-09-26T06:57:51+10:00Elevated error counts for USA quoting and booking<p><small>Sep <var data-var='date'>26</var>, <var data-var='time'>06:57</var> AEST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'>26</var>, <var data-var='time'>06:09</var> AEST</small><br><strong>Monitoring</strong> - The upstream provider involved has applied mitigations for this issue and expects the issue resolved. Our team will continue to monitor recovery.</p><p><small>Sep <var data-var='date'>26</var>, <var data-var='time'>05:43</var> AEST</small><br><strong>Identified</strong> - We're experiencing elevated errors with quotes and orders for certain USA routes related to an issue one of our upstream providers is experiencing.<br /><br />Our engineers have notified the provider and will continue to monitor performance and provide updates.</p>tag:status.sendle.com,2005:Incident/185955492023-09-25T14:53:50+10:002023-09-25T14:53:51+10:00Degraded USA performance for quoting and ordering<p><small>Sep <var data-var='date'>25</var>, <var data-var='time'>14:53</var> AEST</small><br><strong>Resolved</strong> - The mitigations we have in place for this issue are working and service has been restored.</p><p><small>Sep <var data-var='date'>25</var>, <var data-var='time'>08:10</var> AEST</small><br><strong>Monitoring</strong> - We’re experiencing elevated errors with quotes and orders for certain USA routes. This is related to an issue one of our upstream providers is experiencing.<br /><br />Our engineers have mitigated the impact on our side, and will continue to monitor the upstream issue.</p>tag:status.sendle.com,2005:Incident/185473012023-09-20T03:18:46+10:002023-09-20T03:18:46+10:00Degraded USA performance for quoting and ordering<p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>03:18</var> AEST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>02:37</var> AEST</small><br><strong>Monitoring</strong> - Our upstream provider has indicated that a fix for the issue has been put in place and this incident appears to be resolved. Our engineering team will continue to monitor for stability.</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>02:23</var> AEST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Sep <var data-var='date'>20</var>, <var data-var='time'>02:22</var> AEST</small><br><strong>Identified</strong> - We're experiencing elevated errors with quotes and orders for certain USA routes. This is related to an issue one of our upstream providers is experiencing.<br /><br />Our engineers are investigating solutions to mitigate the impact on our side, and monitoring the upstream issue.</p>tag:status.sendle.com,2005:Incident/183782662023-09-04T16:12:51+10:002023-09-04T16:12:51+10:00Degraded AU performance for quoting and ordering<p><small>Sep <var data-var='date'> 4</var>, <var data-var='time'>16:12</var> AEST</small><br><strong>Resolved</strong> - This incident is resolved.</p><p><small>Sep <var data-var='date'> 4</var>, <var data-var='time'>15:49</var> AEST</small><br><strong>Monitoring</strong> - The upstream provider involved has confirmed the issue, mitigations for this issue applied and services appear to be restoring to normal.</p><p><small>Sep <var data-var='date'> 4</var>, <var data-var='time'>14:19</var> AEST</small><br><strong>Identified</strong> - We're experiencing an elevated level of quoting and ordering failures for Australian routes. This is related to an outage one of our upstream providers is experiencing.<br /><br />Some routes may be returning errors. Our team is working on a resolution.</p>tag:status.sendle.com,2005:Incident/183300892023-09-01T12:08:31+10:002023-09-01T12:08:31+10:00Degraded AU performance for quoting and ordering<p><small>Sep <var data-var='date'> 1</var>, <var data-var='time'>12:08</var> AEST</small><br><strong>Resolved</strong> - This incident is resolved.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>18:00</var> AEST</small><br><strong>Monitoring</strong> - The upstream provider involved has been notified and mitigations for this issue applied.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>17:15</var> AEST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>14:31</var> AEST</small><br><strong>Identified</strong> - We're experiencing an elevated level of quoting and ordering failures for Australian routes.<br /><br />Some routes may still be returning errors, and our team is working on a resolution.</p>tag:status.sendle.com,2005:Incident/182055812023-08-21T13:17:08+10:002023-08-21T13:17:08+10:00Degraded AU quote / order performance<p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>13:17</var> AEST</small><br><strong>Resolved</strong> - This incident is resolved.</p><p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>11:58</var> AEST</small><br><strong>Monitoring</strong> - The upstream provider involved has been notified and mitigations for this issue applied.<br /><br />Our team will continue to monitor recovery</p><p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>11:33</var> AEST</small><br><strong>Identified</strong> - We're experiencing an elevated level of quoting failures for Australian routes.<br /><br />Some routes may still be returning errors, and our team is working on a resolution.</p>tag:status.sendle.com,2005:Incident/181104192023-08-11T12:24:35+10:002023-08-11T12:24:35+10:00AU Domestic Tracking Delays<p><small>Aug <var data-var='date'>11</var>, <var data-var='time'>12:24</var> AEST</small><br><strong>Resolved</strong> - Tracking information for the affected AU domestic orders is now up to date, and new tracking events are being received as expected. This incident is now resolved.</p><p><small>Aug <var data-var='date'>11</var>, <var data-var='time'>10:13</var> AEST</small><br><strong>Monitoring</strong> - The affected systems are back online, but we continue to see domestic tracking delays for some Australian orders. We are continuing to monitor and will update this incident when there is more to share.</p><p><small>Aug <var data-var='date'>11</var>, <var data-var='time'>09:10</var> AEST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Aug <var data-var='date'>11</var>, <var data-var='time'>09:09</var> AEST</small><br><strong>Identified</strong> - We are aware of tracking delays for some domestic orders in Australia. This is related to an outage one of our upstream providers is experiencing.<br /><br />This may cause inaccuracies on our public tracking pages and tracking API while this issue resolves.</p>tag:status.sendle.com,2005:Incident/176832532023-06-27T10:00:36+10:002023-06-27T10:00:36+10:00Delayed tracking events for international parcels from Australia<p><small>Jun <var data-var='date'>27</var>, <var data-var='time'>10:00</var> AEST</small><br><strong>Resolved</strong> - Tracking information for the affected orders is now up to date, and new tracking events are being received as expected. This incident is now resolved.</p><p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>15:19</var> AEST</small><br><strong>Monitoring</strong> - We have identified the issue and put a fix in place. No tracking information has been lost, and we will continue to monitor as the system retrieves up-to-date data.</p><p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>11:22</var> AEST</small><br><strong>Investigating</strong> - We are aware of tracking delays on some international orders from Australia. This may cause inaccuracies on our public tracking pages and tracking API. Our team is investigating.</p>tag:status.sendle.com,2005:Incident/173357102023-06-03T20:22:18+10:002023-06-03T20:22:18+10:00Sendle scheduled maintenance<p><small>Jun <var data-var='date'> 3</var>, <var data-var='time'>20:22</var> AEST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jun <var data-var='date'> 3</var>, <var data-var='time'>20:00</var> AEST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>May <var data-var='date'>23</var>, <var data-var='time'>11:44</var> AEST</small><br><strong>Scheduled</strong> - Sendle will be undergoing scheduled maintenance during this time to perform upgrades. The system will experience approximately 30 minutes of downtime within this window.<br /><br />During the downtime, the site will show an error and the API will return HTTP 503 error responses. Requests can be retried once the service is restored.</p>tag:status.sendle.com,2005:Incident/174376502023-06-02T11:31:44+10:002023-06-02T11:31:44+10:00Incorrect Delivered Event for International Parcels from Australia<p><small>Jun <var data-var='date'> 2</var>, <var data-var='time'>11:31</var> AEST</small><br><strong>Resolved</strong> - This incident is now resolved.</p><p><small>Jun <var data-var='date'> 1</var>, <var data-var='time'>13:38</var> AEST</small><br><strong>Monitoring</strong> - We have updated the affected orders to show the correct delivery status. We will monitor to ensure this works as expected.</p><p><small>Jun <var data-var='date'> 1</var>, <var data-var='time'>11:22</var> AEST</small><br><strong>Identified</strong> - We are aware of some AU International orders having an incorrect 'delivered' tracking event. Our system has been updated to process these events correctly, and the affected shipments will be updated to use the correct status.</p>tag:status.sendle.com,2005:Incident/174366992023-06-01T08:00:00+10:002023-06-01T09:13:33+10:00Delayed Tracking Events for Domestic Parcels from Australia<p><small>Jun <var data-var='date'> 1</var>, <var data-var='time'>08:00</var> AEST</small><br><strong>Resolved</strong> - We have identified and resolved the issue causing the tracking delays for domestic parcels from Australia. Events are now being processed at the expected rate.<br /><br />All backlogged events have been processed, and all Domestic labels in transit show the most recent status.<br />We are monitoring the process to ensure it continues as expected.</p>tag:status.sendle.com,2005:Incident/174050152023-05-26T16:00:00+10:002023-05-29T14:10:35+10:00Resolved: Sendle Canadian Cross-border Booking Failures<p><small>May <var data-var='date'>26</var>, <var data-var='time'>16:00</var> AEST</small><br><strong>Resolved</strong> - A number of Canadian cross-border orders (Canada to US) failed to book on both the Sendle Dashboard and API from 2am Friday until 4pm Sunday EDT. For these failed bookings, the Sendle dashboard showed a loading spinner and the API returned HTTP 500 error responses.<br /><br />We have identified the root cause and restored service. This incident has been resolved and any failed bookings can be retried.</p>tag:status.sendle.com,2005:Incident/172967662023-05-19T13:16:47+10:002023-05-19T13:16:47+10:00USA Tracking Delays<p><small>May <var data-var='date'>19</var>, <var data-var='time'>13:16</var> AEST</small><br><strong>Resolved</strong> - Our team has released an update to mitigate the upstream issue. We consider this incident resolved, and will continue monitor with our provider.</p><p><small>May <var data-var='date'>19</var>, <var data-var='time'>10:14</var> AEST</small><br><strong>Identified</strong> - We have identified an upstream provider issue resulting in tracking delays on some USA orders. This may cause inaccuracies on our public tracking pages and tracking API until the provider's system outage is resolved.</p>tag:status.sendle.com,2005:Incident/172212282023-05-12T10:51:46+10:002023-05-12T10:51:46+10:00Sandbox environment: degraded performance<p><small>May <var data-var='date'>12</var>, <var data-var='time'>10:51</var> AEST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>May <var data-var='date'>12</var>, <var data-var='time'>07:52</var> AEST</small><br><strong>Monitoring</strong> - A fix has been implemented and the errors have cleared. We are monitoring the results.</p><p><small>May <var data-var='date'>12</var>, <var data-var='time'>04:33</var> AEST</small><br><strong>Investigating</strong> - We are investigating degraded performance and an elevated count of errors occurring in the Sendle Sandbox environment.</p>tag:status.sendle.com,2005:Incident/172002682023-05-11T11:46:44+10:002023-05-11T11:46:44+10:00AU Domestic Tracking Delays<p><small>May <var data-var='date'>11</var>, <var data-var='time'>11:46</var> AEST</small><br><strong>Resolved</strong> - Tracking information for the affected AU domestic orders is now up to date, and new tracking events are being received as expected. This incident is now resolved.</p><p><small>May <var data-var='date'>10</var>, <var data-var='time'>20:23</var> AEST</small><br><strong>Update</strong> - Tracking information has been refreshed for the majority of orders affected by today's upstream outage. Our provider expects any remaining events to be updated over the next 4 hours.<br /><br />The underlying issue is resolved, but we will continue to monitor over the next 12 hours.</p><p><small>May <var data-var='date'>10</var>, <var data-var='time'>17:13</var> AEST</small><br><strong>Monitoring</strong> - The affected systems are back online, but we continue to see domestic tracking delays for some Australian orders. We are continuing to monitor and will update this incident when there is more to share.</p><p><small>May <var data-var='date'>10</var>, <var data-var='time'>13:21</var> AEST</small><br><strong>Update</strong> - We are continuing to monitor this issue with our upstream provider.</p><p><small>May <var data-var='date'>10</var>, <var data-var='time'>10:31</var> AEST</small><br><strong>Update</strong> - Our upstream provider's systems are continuing to experience this outage. We are continuing to monitor this issue.</p><p><small>May <var data-var='date'>10</var>, <var data-var='time'>08:52</var> AEST</small><br><strong>Identified</strong> - We are aware of tracking delays for some domestic orders in Australia. This is related to an outage one of our upstream providers is experiencing.<br /><br />This may cause inaccuracies on our public tracking pages and tracking API while this issue resolves.</p>tag:status.sendle.com,2005:Incident/171472792023-05-05T07:49:24+10:002023-05-05T07:49:24+10:00Partial USA and Canada Quoting and Ordering Outage<p><small>May <var data-var='date'> 5</var>, <var data-var='time'>07:49</var> AEST</small><br><strong>Resolved</strong> - This incident is resolved.</p><p><small>May <var data-var='date'> 5</var>, <var data-var='time'>07:00</var> AEST</small><br><strong>Monitoring</strong> - Our upstream provider has indicated that a fix for the issue has been put in place and this incident appears to be resolved. Our engineering team will continue to monitor for stability.</p><p><small>May <var data-var='date'> 5</var>, <var data-var='time'>06:36</var> AEST</small><br><strong>Identified</strong> - We're experiencing elevated errors with quotes and orders for certain USA and Canada routes. This is related to an issue one of our upstream providers is experiencing.<br /><br />Our engineers are investigating solutions to mitigate the impact on our side, and monitoring the upstream issue.</p>tag:status.sendle.com,2005:Incident/169877332023-04-28T12:24:11+10:002023-04-28T12:24:11+10:00Dashboard and API Offline<p><small>Apr <var data-var='date'>28</var>, <var data-var='time'>12:24</var> AEST</small><br><strong>Resolved</strong> - The fix has been stable over the past hour. This incident is now resolved.</p><p><small>Apr <var data-var='date'>28</var>, <var data-var='time'>11:23</var> AEST</small><br><strong>Monitoring</strong> - Our team has released an update to correct the issue. We will continue to monitor to ensure that the system is responding fully.</p><p><small>Apr <var data-var='date'>28</var>, <var data-var='time'>11:07</var> AEST</small><br><strong>Update</strong> - The Dashboard and API is currently offline while our team completes the required update.</p><p><small>Apr <var data-var='date'>28</var>, <var data-var='time'>10:36</var> AEST</small><br><strong>Identified</strong> - We're experiencing an elevated level of errors and timeouts on our Dashboard and API.<br /><br />Our team is already aware of the cause and are working to resolve it.</p>