We were experiencing network connectivity issues across all production instances of VoC Hub and survey answering systems.
Our upstream service provider has updated us that traffic levels had returned to normal and the incident is resolved.
Please see the latest update here: https://www.cloudflarestatus.com/incidents/tx4pgxs6zxdr
Affected period of time: 02.07.2019 15:52 CET -02.07.2019 16:15 CET
Total: 23 minutes
Why did it happen?
The issue was caused by network connectivity issues of an upstream service provider, Cloudflare.
What are we doing to avoid such issues?
We were in contact with Cloudflare along the entire duration of the incident.
Route leaks are common on the internet but their impact is usually minimal as the entire ecosystem works 24x7 to monitor and react to them as soon as possible.
We continuously monitor the availability of our services. However, in cases like this one, unfortunately, we have no ability to act on the network issues outside the scope of our reach and influence.