IOT down

Dear Customer,

Earlier this week, a critical vulnerability was identified on our NetScaler infrastructure, requiring an urgent security update. Following the implementation of this update, access to the IoT platform became unstable for some users.

As part of our standard post-update procedures, validation reports were executed to verify the integrity and security of the environment. During these validation activities, an unforeseen side effect of the NetScaler update impacted the stability of the IoT platform.

The internal timeline:

• 30/09 13:01:56 Access failed on primary and failover node because of the validation process and this causes all back-ends to go down
• 30/09 13:01:58 Failover node comes back online immediately, primary node is still down
• 30/09 13:01:59 Existing connections were forcefully closed, new connections arrive on failover node
• 30/09 13:25:48 Manuel intervention causes fully operational system to return

Some customers may have experienced the impact beyond the timeline above, as certain devices or applications, such as POS terminals, required a restart to re-establish their connection to the IoT platform.

The issue was identified and investigated promptly, and corrective measures were taken to restore stable access. We continue to monitor the environment closely to ensure ongoing reliability and to prevent similar occurrences in the future.

As a follow-up action, we are reviewing our validation procedures and failover process to minimize the risk of similar disruptions during future security maintenance activities.

We apologize for any inconvenience caused and appreciate your understanding as we prioritize the security and integrity of our systems.

Team Vintia

Dear Customers,

The issue have been solved and we will try to provide a post mortem as soon as possible.

Kind regards,
Team Vintia

Dear Customers,

We are reaching out to inform you that IOT is currently down. We are investigating the root cause and we’ll keep you posted as soon there is an update.

Kind regards,
Team Vintia