LakeNetworks: how did we do in these 2 months?

lakenetworks

Hello! As we are committed to keep a certain level of transparency with our customers, we would like to discuss with you about how our service has been in these 2 months.

As for HetrixTools, our 30days uptime now averages at 99.6065%. Our recent faults have been on March 22 and March 21 due to maintenance for a critical router problem -- which we will explain later.
We share the thought in the team that this is a great result for now, considering that we are managing everything internally.

Clearly, we shouldn’t only talk about the milestones, but also about the faults that have occurred:

• February 23 (1-5mins faults repeated 3 times): There was a BGP daemon that was generating some problems on imported routes, also generating packet loss as the daemon was sending too many updates to the upstream. Our NOC was instantly warned of the small faults and promptly corrected the issue.
• February 28 (123 minutes): planned maintenance, we changed our router and implemented a backup connectivity on a different path. We also added automatic IRR filters for our downstreams.
• March 12 (1 minute): Our fiber provider had a major fault in their POP and automatically switched to the backup connectivity.
• March 21 (74 minutes): We saw that we had increasing packet loss over the past two days that went as high as 2%. After diagnosing the problem, we planned an urgent critical maintenance to replace the NIC of our router which was causing these faults.

What do we want to do for the future?

• Automatic BGP session setup.
• Improve our total network capacity in order to grow as necessity grows.
• Improve traffic quality by adding new upstreams, thereby reducing latency to hard-to-reach destinations and improving reliability.
• More power redundancy and autonomy: we'd like to add some automatic engine-generators and upgrade our current battery units.
• VRRP between more separated core routers with the same uplink capacity, so we can do core upgrades and maintenance without creating any faults.
• Joining MINAP IX with a 10G port.

We know that we still have a lot of work to do and improve, but we like to share our results with you.

What would you like to see from us? Please let us know if you have any advice or something you want to see on LakeNetworks!