My box in SJC-Z005 is back up now. It was migrated from LAX to SJC, not something I expected, but I'm quite happy with it because now I have some redundancy given that my other box with VirMach is in LAX as well. Plus I'm quite happy with having Internap bandwidth?
@Advin said:
I have a question, @VirMach, do you even sleep? You work damn hard from what I've gathered so far in this thread, jesus.
I can't even begin to fathom the volume of tickets that you've probably gotten so far.
Nah virmach just pretends to be working, I am trying to find new ip to which my vps was migrated to still the services detail page does not open, i get timeout after waiting too long for it to open?
I have been unable to use that vps for more than a month still I see no resolution,
@Advin said:
I have a question, @VirMach, do you even sleep? You work damn hard from what I've gathered so far in this thread, jesus.
I can't even begin to fathom the volume of tickets that you've probably gotten so far.
Nah virmach just pretends to be working, I am trying to find new ip to which my vps was migrated to still the services detail page does not open, i get timeout after waiting too long for it to open?
Management (on left) -> VPS control panel -> Manage -> Network
@tetech said: The management button will still work to show the SolusVM shortcut even when it times out.
Huh?!
Then I guess when I last time checked there was other problems too - it did not load shit for me.
Tested now on FFME001 that is not working (timeout), but VPSes are working and it loads.
@Advin said:
I have a question, @VirMach, do you even sleep? You work damn hard from what I've gathered so far in this thread, jesus.
I can't even begin to fathom the volume of tickets that you've probably gotten so far.
Nah virmach just pretends to be working, I am trying to find new ip to which my vps was migrated to still the services detail page does not open, i get timeout after waiting too long for it to open?
Management (on left) -> VPS control panel -> Manage -> Network
The services details page doesn't even load when i click on this vps from list of vpses on service page ,
@Advin said:
I have a question, @VirMach, do you even sleep? You work damn hard from what I've gathered so far in this thread, jesus.
I can't even begin to fathom the volume of tickets that you've probably gotten so far.
Nah virmach just pretends to be working, I am trying to find new ip to which my vps was migrated to still the services detail page does not open, i get timeout after waiting too long for it to open?
Management (on left) -> VPS control panel -> Manage -> Network
The services details page doesn't even load when i click on this vps from list of vpses on service page ,
First of all thank you all for the kind words. I started writing this a while ago and didn't want to spend too much time finding the right words. I read it all and definitely had a productive day as a direct result of all the positive energy. There are those days where it's very easy to just want to go to sleep for a very long time and it was definitely headed toward one of those burn out and crash days but I was able to turn it around and get a lot done at a calmer pace.
So thanks again, you don't know how much it means and how far it goes.
@Advin said:
I have a question, @VirMach, do you even sleep? You work damn hard from what I've gathered so far in this thread, jesus.
It was definitely becoming concerning. Recently I unlocked some type of fight or flight response and didn't sleep for nearly a week but I was able to calm down to some degree more recently. It's still in maximum chunks of an hour or two. I had to force myself to sleep 3-4 times in a day a few days ago to try to get a full 8 hours and "reset" mentally.
You'd think it would just come naturally, it used to but something's definitely subconsciously fighting it. I'm sure once I feel the job has been completed I can finally rest.
I can't even begin to fathom the volume of tickets that you've probably gotten so far.
This is something we haven't addressed yet. I'm trying to think of every way we can bring it down to a meaningful level without just auto crediting and closing the tickets as it will of course upset a lot of people.
First, wanted to echo the sentiment of understanding, I know you've got to be WAY more stressed about the situation than I am. So, I'm happy to wait for a replacement server in another datacenter, and don't need access to the old data, I've got recent enough backups. I'd rather not end up with a refund / canceled server from all of this, should I just create a priority ticket and explain the same there or how are you wanting people to handle this? I'd like to make it the least work on you / your team, since I know you've got plenty of it already.
Sorry, meant to post this last night. It's pretty much exactly as I wrote it out last night:
Let me try to lay everything out a little neater here now that I've had some time to process it all.
What's going to happen whether or not we are contacted:
The existing "service" in WHMCS will be marked as ended in some way. Pro-rated refund will be processed, where possible. This doesn't necessarily mean you'll be forgotten, and you don't necessarily need to make a ticket to let us know you're interested in a replacement service.
You will be added to a "default" priority queue for a replacement service with an initial "free" duration. We may ask for further confirmation in some cases.
What's going to happen if we are contacted:
Higher priority queue for a replacement service, first come first serve.
You can communicate preferences, such as "ASAP" regardless of specifications, or let us know what location you want to wait for, and your minimum requirements (statistically speaking, the lower the requirements the more quickly we'll be able to accommodate you.)
What we'll also try to do:
Backup VPS matching your service's disk size, most likely for SSD services first.
You may request this in a ticket sooner if it's helpful.
Current available preferences:
Location: NYC Metro. No other location currently immediately available. Future Locations: San Jose, Los Angeles. Potential Other Locations: Dallas, Las Vegas, Denver, Phoenix, Jacksonville.
Processors: E3. Mostly v2. Some may be substituted for Dual E5 as we run out.
RAM: 16GB, 32GB.
Disk Configurations: 2TB HDD, 240GB SSD, 1TB SSD, 2TB SSD, 4TB HDD, 500GB SSD Note: 2TB means 1x2TB or 2x1TB, and so on.
IPv4: /29 IPv4 Default.
Currently available are all: 16GB RAM, 2TB HDD, NYC Metro, /29 IPv4 with CentOS6/7 installed. Some have IPMI, some do not. At least one or two have no OS but IPMI. One doesn't have a main IP but has IPMI, so there's definitely some issues that need to be ironed out on a few.
After clicking on my vps in this page nothing loads @tetech
wow thats alot of complaints for a $5 plan. since you hate virmach so much, cancel it and show them who's boss!!!
First of all value of 5 usd is really relative , and this thing is been down since one month now,
I don't know what your specific scenario has been to where it's down for a month, it's possible. This node has been regressing over the last few days but it definitely hasn't just been down for a solid month straight. I see that the more major problems started around July 26th with some stability August 1st, and going to its current nonresponsive state August 3rd. I was able to get it online but it's all over the place. It's technically up and running, pinging, and reporting back to all our monitoring but I can see that it's virtually unusable the last few days.
I apologize, I was supposed to go down to the datacenter with a replacement board for it several times. I tried to get the remote hands to work on it when I noticed I couldn't make it but that didn't work out.
I'm not going to share my pile of excuses for why it didn't happen, it just kept getting pushed into the next day. I'm genuinely looking into making the trip today.
My message above was essentially what I failed to post earlier. I have some additional information to share as well.
Here's some updates since then:
We've been working hard in loading in disaster recovery backups and completing any remaining virtual servers affected by yesterday's issues.
We finally set up Chicago Hivelocity. Since Chicago servers already got moved, a lot of people will be going there from former Buffalo location but it'll also be available on Ryzen button.
Tokyo got a few extra servers in that have been stuck in Miami for some time. One is having some weird problems related to the setup (nothing major hardware wise) but we were able to get another other online.
Miami has the servers and network equipment and everything there and should be set up very soon, possibly today.
Dedicated server specific update:
I organized all the servers we have available and sorted through the requests.
I wanted to provision these sooner but ran into problems trying to set up the new module, as well as performing any functions on the old. It looks like I have to essentially strip away the old module while trying to maintain some of the information and then re-insert it but what I'm saying doesn't even make sense. Short version, WHMCS is being super weird. I can't even load invoices associated with the old module without it throwing errors and I spent way too much time on this.
With that said, we're going to just skip over to dealing with that portion later and I'm going to begin assigning the new services without further delay. These are happening now. It won't look pretty at the beginning.
Website update:
The whole website missing thing has been spooking a lot of people out. I originally wanted to leave it this way for some time but it seems like it would actually significant reduce ticket load at this point in time if we fix the website.
@VirMach said: We finally set up Chicago Hivelocity. Since Chicago servers already got moved, a lot of people will be going there from former Buffalo location but it'll also be available on Ryzen button.
You likely have lots of other stuff on your mind right now, but will we get the Ryzen migration button enabled for services that have been auto-migrated to a (more or less) arbitrary location eventually?
Location: NYC Metro. No other location currently immediately available. Future Locations: San Jose, Los Angeles. Potential Other Locations: Dallas, Las Vegas, Denver, Phoenix, Jacksonville.
Processors: E3. Mostly v2. Some may be substituted for Dual E5 as we run out.
RAM: 16GB, 32GB.
Disk Configurations: 2TB HDD, 240GB SSD, 1TB SSD, 2TB SSD, 4TB HDD, 500GB SSD Note: 2TB means 1x2TB or 2x1TB, and so on.
IPv4: /29 IPv4 Default.
Currently available are all: 16GB RAM, 2TB HDD, NYC Metro, /29 IPv4 with CentOS6/7 installed. Some have IPMI, some do not. At least one or two have no OS but IPMI. One doesn't have a main IP but has IPMI, so there's definitely some issues that need to be ironed out on a few.
In this case, I probably can wait as I prefer West coast DC like San Jose or Los Angeles for my replacement Dedi. Hope all these issues are sorted out, resolved so we can return back as normal again.
@bula said:
In this case, I probably can wait as I prefer West coast DC like San Jose or Los Angeles for my replacement Dedi. Hope all these issues are sorted out, resolved so we can return back as normal again.
Same for me, I went ahead and submitted a ticket so that no one wastes time/energy setting up something in NYC for me so they can go to people who need something ASAP.
@vyas said:
Quality difference in response between here and LET to the situation . As expected, lot more PMS there
I don't think VirMach has posted over there since this CC issue happened so there's probably a bunch of people who don't use LES going "omg zero communication!!"
Comments
My box in SJC-Z005 is back up now. It was migrated from LAX to SJC, not something I expected, but I'm quite happy with it because now I have some redundancy given that my other box with VirMach is in LAX as well. Plus I'm quite happy with having Internap bandwidth?
Nah virmach just pretends to be working, I am trying to find new ip to which my vps was migrated to still the services detail page does not open, i get timeout after waiting too long for it to open?
I have been unable to use that vps for more than a month still I see no resolution,
Heck even boomer fixes his pannel in a week
Want free vps ? https://microlxc.net
Management (on left) -> VPS control panel -> Manage -> Network
That won't work if node is timing out :P
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
https://lowendspirit.com/uploads/editor/gi/ippw0lcmqowk.png
The management button will still work to show the SolusVM shortcut even when it times out.
Huh?!
Then I guess when I last time checked there was other problems too - it did not load shit for me.
Tested now on
FFME001that is not working (timeout), but VPSes are working and it loads.My bad.
Haven't bought a single service in VirMach Great Ryzen 2022 - 2023 Flash Sale.
https://lowendspirit.com/uploads/editor/gi/ippw0lcmqowk.png
The services details page doesn't even load when i click on this vps from list of vpses on service page ,
Want free vps ? https://microlxc.net
Can you post a screenshot (redacted)
https://imgur.com/a/KhXa94A
After clicking on my vps in this page nothing loads
@tetech
Want free vps ? https://microlxc.net
And after sometime I get this error
https://imgur.com/a/6aZfy0o
Want free vps ? https://microlxc.net
You mean nothing as in a Cloudflare 50x error, or blank page, or the billing panel with a "timeout 9001" error?
wow thats alot of complaints for a $5 plan. since you hate virmach so much, cancel it and show them who's boss!!!
I bench YABS 24/7/365 unless it's a leap year.
First of all value of 5 usd is really relative , and this thing is been down since one month now,
Want free vps ? https://microlxc.net
Click Management on the left side.
Exactly. You don't get "nothing", you get the billing panel showing the "Management" action!
That does not work let me try again
Want free vps ? https://microlxc.net
It worked thanks
Want free vps ? https://microlxc.net
Update vps is down ssh doesn't work tried vnc also not working stuck on starting vnc handshake,
Status in pannel is unknown,
Can anyone confirm is node RYZE. LAX -Z014. VMS is down?
Want free vps ? https://microlxc.net
What is vmc pl?
blog | exploring visually |
Vnc
Want free vps ? https://microlxc.net
Try network reconfiguration.
FWIW, as soon as my dedi came back online for a few minutes I made a quick backup of the > @soulchief said:
Can he get to reconfigure if the panel times out?
Yes, SolusVM should still work fine
First of all thank you all for the kind words. I started writing this a while ago and didn't want to spend too much time finding the right words. I read it all and definitely had a productive day as a direct result of all the positive energy. There are those days where it's very easy to just want to go to sleep for a very long time and it was definitely headed toward one of those burn out and crash days but I was able to turn it around and get a lot done at a calmer pace.
So thanks again, you don't know how much it means and how far it goes.
It was definitely becoming concerning. Recently I unlocked some type of fight or flight response and didn't sleep for nearly a week but I was able to calm down to some degree more recently. It's still in maximum chunks of an hour or two. I had to force myself to sleep 3-4 times in a day a few days ago to try to get a full 8 hours and "reset" mentally.
You'd think it would just come naturally, it used to but something's definitely subconsciously fighting it. I'm sure once I feel the job has been completed I can finally rest.
This is something we haven't addressed yet. I'm trying to think of every way we can bring it down to a meaningful level without just auto crediting and closing the tickets as it will of course upset a lot of people.
Sorry, meant to post this last night. It's pretty much exactly as I wrote it out last night:
Let me try to lay everything out a little neater here now that I've had some time to process it all.
What's going to happen whether or not we are contacted:
What's going to happen if we are contacted:
What we'll also try to do:
Current available preferences:
Location: NYC Metro. No other location currently immediately available.
Future Locations: San Jose, Los Angeles.
Potential Other Locations: Dallas, Las Vegas, Denver, Phoenix, Jacksonville.
Processors: E3. Mostly v2. Some may be substituted for Dual E5 as we run out.
RAM: 16GB, 32GB.
Disk Configurations: 2TB HDD, 240GB SSD, 1TB SSD, 2TB SSD, 4TB HDD, 500GB SSD
Note: 2TB means 1x2TB or 2x1TB, and so on.
IPv4: /29 IPv4 Default.
Currently available are all: 16GB RAM, 2TB HDD, NYC Metro, /29 IPv4 with CentOS6/7 installed. Some have IPMI, some do not. At least one or two have no OS but IPMI. One doesn't have a main IP but has IPMI, so there's definitely some issues that need to be ironed out on a few.
I don't know what your specific scenario has been to where it's down for a month, it's possible. This node has been regressing over the last few days but it definitely hasn't just been down for a solid month straight. I see that the more major problems started around July 26th with some stability August 1st, and going to its current nonresponsive state August 3rd. I was able to get it online but it's all over the place. It's technically up and running, pinging, and reporting back to all our monitoring but I can see that it's virtually unusable the last few days.
I apologize, I was supposed to go down to the datacenter with a replacement board for it several times. I tried to get the remote hands to work on it when I noticed I couldn't make it but that didn't work out.
I'm not going to share my pile of excuses for why it didn't happen, it just kept getting pushed into the next day. I'm genuinely looking into making the trip today.
My message above was essentially what I failed to post earlier. I have some additional information to share as well.
Here's some updates since then:
Dedicated server specific update:
Website update:
The whole website missing thing has been spooking a lot of people out. I originally wanted to leave it this way for some time but it seems like it would actually significant reduce ticket load at this point in time if we fix the website.
You likely have lots of other stuff on your mind right now, but will we get the Ryzen migration button enabled for services that have been auto-migrated to a (more or less) arbitrary location eventually?
dnscry.pt - Public DNSCrypt resolvers hosted by LowEnd providers • Need a free NAT LXC? -> https://microlxc.net/
In this case, I probably can wait as I prefer West coast DC like San Jose or Los Angeles for my replacement Dedi. Hope all these issues are sorted out, resolved so we can return back as normal again.
Same for me, I went ahead and submitted a ticket so that no one wastes time/energy setting up something in NYC for me so they can go to people who need something ASAP.
Quality difference in response between here and LET to the situation . As expected, lot more PMS there
blog | exploring visually |
I don't think VirMach has posted over there since this CC issue happened so there's probably a bunch of people who don't use LES going "omg zero communication!!"