keystone - Notice history

This has been confirmed resolved as of 10/12

Latest Update from our carrier network: At this time our Partner’s network continues to function as expected with the majority of calls across the network functioning normally. There are some end users still experiencing issues with outbound dialing. This is due to the necessary implementation of a network change that slightly reduced usable packet size. Cloud Services and Support are working on reducing the packet size on these outbound dial invites. The most commonly affected devices are Grandstreams, however there are others. Last night our Partner rolled out a fix for Grandstream phones in the standard template. We are working on a way to deploy this across all such devices for you. However, if you have a few Grandstream endpoints that are unable to make outbound calls you can save the extension, let codegen run and then reboot the phone to restore service. We also encourage you to use CoreNexa Web, Desktop, or Mobile for outbound dialing while we remediate the affected devices as all services are available and are working without issue on these products. Thank You! Oct 8, 07:50 EDT

At this time Our Provider's network continues to function as expected, however some end users may still be experiencing residual effects from yesterday’s DDoS attack. Our Provider's Cloud Services and Network Services Teams have worked throughout the night and early morning to make changes to infrastructure and security to provide more resilience and new means of counteracting future DDoS attacks. We will continue to diligently monitor the network for signs of new Incidents. As always, contact your Account Manager at Keystone Solutions if a more through update is needed.

At this time Provider’s services continue to function as expected. Our Provider's Cloud Services and Network Services Teams have worked throughout the night to make changes to infrastructure and security to provide more resilience and new means of counteracting future DDoS attacks. We will continue to diligently monitor the network for signs of new Incidents, while work continues to secure our network for all of our Customers. There should be a increasing level of stability as time progresses. As always, contact your Account Manager at Keystone Solutions if a more through update is needed.

At approximately 1:40PM Wednesday 10/6, in order to mitigate the disruptions from a DDoS attack; Our Provider's Network Services Team applied a change to our network security devices at the recommendation of our vendor. We are beginning to see some traffic restore to normal. Our Cloud Services and Network Services Team continue working to block all sources of the attack and to restore all network and calling services. CoreNexa 7.0 Video, Meeting and Room services are still functioning as expected. Customers may still experience a variety of network related symptoms including portal down or slow, voice quality, dropped calls and unable to make or receive calls until services have completely restored.

From our Carrier: As of 12:30PM Wednesday 10/6, the Cloud Services Team is seeing the service disruption of our Calling Services begin to restore. Customers may still experience a variety of network related symptoms including voice quality, dropped calls and unable to make or receive calls until services have completely restored.

The incident has been resolved

Bandwidth has reported that their issue has been corrected. If you are a voice customer, and still experiencing any calls that aren't being completed, please reach out to us. https://keystone.solutions/contact-us/

Good Evening, Our Provider has advised they have completed repairs and they are monitoring their network at this time. We'll continue to monitor on our side as well as provide updates throughout the day tomorrow, if necessary. Thank you!

Keystone Solutions has been notified that the source of service failures related to an event reported to us by Bandwidth has been identified. They continue to work towards resolving the event and will continue to provide regular updates. Affected users are currently reporting intermittent service disruptions with Voice, including e911. As our Carrier continues work to resolve this event, our carrier has taken steps to mitigate some of the fallout you and your customers may be experiencing. The Cloud Services Team has adjusted our outbound call routing to route calls away from the affected Carrier. This should have reduced some of the outbound call failures our platform has been experiencing in relation to this event. We will continue to escalate with the Carrier and provide additional updates as we get them.