I do not know what I deserve for all this. Durring standard update on servers which I was planning, I had a power surge and lost about 70% of all equipment I have got.
By Monday I am going to check everything and estimate the losses. At the moment it is very hard to tell me when I will be back online. I am sure that my database server lost 6 out of 8 disks, 1x PSU, 1xCPU and some RAM. The project server lost the motherboard, cpu, ram, psu. Regarding other losses, my main computer (psu, ram, mobo, cpu ... whole PC), 3x monitor, 2x ups, 2x odroid-xu4 and 2x psu in my storage (drives connected to electricity are spinning so maybe I can save them). It's not worth mentioning about such boulevards as lighting or 8x fans.
I am particularly surprised by the fact that no protections that an electrician made me last year didn't worked <- which are ordered before and after the ups. The electrician will check what has happened today or tomorrow.
I will only be estimating the losses, but last year's wall collapse and flooding had less impact than now.
If anyone knows the cause from where I have such a fate, I would really like to know.

Sorry to hear about your bad luck.

I would be immediately looking for a reliable data-center / co-location site and not just some "hole-in-the-wall" place to keep my computer equipment.

Sounds like whatever the electrician "did" (if anything) was worthless. If work was done properly, NONE of this should of ever happened.

If this happened here in the USA, I would not hesitate to take that so-called electrician (and his company if works for one) to court on a law suit to recover the cost of new equipment, additional money based on estimated time to rebuild the servers and have the court revoke his professional licence permanently.

Hopefully you had some kind of insurance to help protect the cost of replacement?

Damn thats tough! sorry to hear it goofy. Hope your loses are not as bad as expected and that the project will be back at some point

yes, but if that was electrician falt the insurance company give me nothing.
I will talk today with eletrician <- I have bills and what more important I have (i don't know what is a name in english) protocol of the installation's opinion from him.

Project will back, but i don't exacly when

if your insurance is good they will pay you und then get their money from your electrcian...

This project seems cursed with bad luck. Apparently, if it wasn't for bad luck, he would have no luck at all. Does anyone know of a similar project I can work with until this project is up and running again? Another project that will let me run CPU with a low load factor like this project.

Thanks, Brent

As of this writing, There are no other NCI *Non Compute Intensive" (low load) projects other than WuProp (you already run that project).
NCI's are an extremely rare project. Last one prior to Goofyx's project went silent December 2015 (FreeHal).

Sorry to hear about the most recent disaster!

It's unusual to have computers protected by a UPS to be damaged like that. Often, the UPS itself will have a guarantee that it will protect downstream equipment and the UPS manufacturer sometimes has a policy to replace damaged computer equipment.

Good luck with the repairs.

Mike

Situation update:
1. main and big problem is that storage is totally crush <- disk it's spin up, but then I unscrewed him disc disks the damage can be seen.... This is really fuck 6up situation and i don't need tell why... I can say that 15TB of my data is go FU*** I have only 4-5TB of backup on other disk (just critical data)
2. boinc server is totally dead <- i bought some parts to set it up and running
3. database server : 1x psu is dead (it's good that is a second one), 6x 16gb is dead (I exchanged it with spare one), 7 of 8 disk is dead (i send it for guarantee under warranty.... i know it's tricky <- at this moment database server start and running on 3 spare disk

Good news is that I am will back... need time to do it, but i will back.
Bad news... the only backup i have to restore for boinc projects is from 05.12.2018r, but there is a good things (i hope so) I have export data from projects (mainly from NCI) from 3-4h before disaster... i will try to import that date (credists etc) to production database

Goofyx PLEASE TURN OFF PROJECT NCI & CPU DATA EXPORTS ASAP!
THE RECENTLY IMPORTED STATS HERE AT BOINCSTATS (AND ELSEWHERE MOST LIKELY) ARE NOW COMPLETELY FUBARED!

Looks like today that I got all but 7,351,871 or so points back.

STATS, ETC ARE STILL VERY MUCH FUBARED!
Like I mentioned in my previous post Goofyx should of kept the stats export DISABLED until things were completely restored.

According to my account information page here at BoincStats I lost 327,255 points on NCI
---- and ----
the project as a whole lost 1,334,205,219 points.

All my active hosts indicate they have ZERO credits on the local (PC) side of things AND have been issued NEW HOST ID'S WITH ZERO CREDIT according to the NCI project web site.

Also received the following notification/message below earlier today:

GoofyxGrid@Home NCI: Notice from server
Invalid or missing account key. To fix, remove and add this project.

------

To avoid additional corruption of the projects various databases maybe we should not have our PC's communicate with the CPU & NCI projects UNTIL a post indicates things have been 100% fixed?

I have lost something like ~86 million points, after already losing ~25 million points after your last crash a month ago, so I am definitely not pleased with this situation at all. Goofy, you need to work with the stats sites to restore all points to everyone. Period. No more lost points! Get with the stats sites and get everyone's points restored to what they were before the crash, not what they were months ago. The stats sites have that data, so it should be fairly simple to restore points. Please make this happen ASAP!

Stats looks good.
Credits was restored to 4-5h before disaster.

Well done goofyx.
To get so close after such a catastrophe was way beyond my hopes.

Can confirm stats look GOOD!
--- BUT ---
I STILL SHOW ALL MY ACTIVE/CONNECTED PC'S RECEIVING NEW HOST ID'S

Stats may look good from an individual perspective but Teams are still broken/missing.

my account no longer exists on NCI !

my account no longer exists on NCI !

A few teams are also missing, and tasks are (sometimes?) non-NCI and reserve a whole thread.

Still, good job on restoration!

So, I sign up for a new NCI account and begin from zero credits !

>>my account no longer exists on NCI !
that really strage because like I wrote I had imported whole exported stats

>>Stats may look good from an individual perspective but Teams are still broken/missing.
I change team_import script and it create 2010 teams yesterday.
Admin/fouder of the team have to check it out.
In some cases teammember has to rejoin to team

>>I STILL SHOW ALL MY ACTIVE/CONNECTED PC'S RECEIVING NEW HOST ID'S
I know this is fu** up



I know that hardly anything run as I would like but I am still glad that we managed to recover accutall server state point state.

My account was very recent (one or two months) and may not have been in the backup!
Now, my new account will work better!