Overview
We experienced a service outage on Wednesday, December 7th, 2016 which affected VoC Feedback backend usage and survey answering system. During this incident VoC Feedback backend (allows to create new and edit existing surveys) was unavailable and customers experienced issues when answering the surveys such as not being able to open the survey page or not being able to answer a question on the survey page.
Existing questionnaire data was not lost. We're not seeing any evidence of data loss.
The period of disruption began at December 7th, 2016 ~10:54 CET and lasted until December 7th, 2016 ~11:55 CET.
Total measured downtime during the incident is 1 hour.
Cause
Our system has a service that checks a uniqueness of each created questionnaire. There was an architecture defect on this service that had a long term cumulative effect and finally caused a problem. As a result, it wasn't possible to access VoC Feedback and pass surveys at this time.
Post-Mortem
As it has already been mentioned at our previous announcements our system has monitoring of various modules in place and as usual our team was notified about the problem immediately. The issue was identified, localized and fixed. Existing questionnaire data was not lost. We're not seeing any evidence of data loss.
Such class of issues won't occur again, since it was one-time fix.
We apologize for any inconveniences you and your customers experienced.
Comments
0 comments
Article is closed for comments.