Pages: [1] 2 3 4
[BOINC@Poland]goofyx
 
BAM!ID: 85901
Joined: 2010-06-01
Posts: 26
Credits: 169,513,222
World-rank: 4,902

2019-01-17 06:49:12

I do not know what I deserve for all this. Durring standard update on servers which I was planning, I had a power surge and lost about 70% of all equipment I have got.
By Monday I am going to check everything and estimate the losses. At the moment it is very hard to tell me when I will be back online. I am sure that my database server lost 6 out of 8 disks, 1x PSU, 1xCPU and some RAM. The project server lost the motherboard, cpu, ram, psu. Regarding other losses, my main computer (psu, ram, mobo, cpu ... whole PC), 3x monitor, 2x ups, 2x odroid-xu4 and 2x psu in my storage (drives connected to electricity are spinning so maybe I can save them). It's not worth mentioning about such boulevards as lighting or 8x fans.
I am particularly surprised by the fact that no protections that an electrician made me last year didn't worked <- which are ordered before and after the ups. The electrician will check what has happened today or tomorrow.
I will only be estimating the losses, but last year's wall collapse and flooding had less impact than now.
If anyone knows the cause from where I have such a fate, I would really like to know.

Dr Who Fan
BAM!ID: 1075
Joined: 2006-05-31
Posts: 576
Credits: 69,457,521
World-rank: 9,288

2019-01-17 16:28:59

Sorry to hear about your bad luck.

I would be immediately looking for a reliable data-center / co-location site and not just some "hole-in-the-wall" place to keep my computer equipment.

Sounds like whatever the electrician "did" (if anything) was worthless. If work was done properly, NONE of this should of ever happened.

If this happened here in the USA, I would not hesitate to take that so-called electrician (and his company if works for one) to court on a law suit to recover the cost of new equipment, additional money based on estimated time to rebuild the servers and have the court revoke his professional licence permanently.
Coleslaw
BAM!ID: 60911
Joined: 2008-10-31
Posts: 162
Credits: 2,046,144,599
World-rank: 760

2019-01-18 00:49:07

Hopefully you had some kind of insurance to help protect the cost of replacement?
motqalden
BAM!ID: 228128
Joined: 2018-04-19
Posts: 1
Credits: 2,296,050,673
World-rank: 690

2019-01-18 02:16:21

Damn thats tough! sorry to hear it goofy. Hope your loses are not as bad as expected and that the project will be back at some point
[BOINC@Poland]goofyx
 
BAM!ID: 85901
Joined: 2010-06-01
Posts: 26
Credits: 169,513,222
World-rank: 4,902

2019-01-18 08:08:50

Coleslaw wrote:

Hopefully you had some kind of insurance to help protect the cost of replacement?

yes, but if that was electrician falt the insurance company give me nothing.
I will talk today with eletrician <- I have bills and what more important I have (i don't know what is a name in english) protocol of the installation's opinion from him.
[BOINC@Poland]goofyx
 
BAM!ID: 85901
Joined: 2010-06-01
Posts: 26
Credits: 169,513,222
World-rank: 4,902

2019-01-18 08:43:55

motqalden wrote:

Damn thats tough! sorry to hear it goofy. Hope your loses are not as bad as expected and that the project will be back at some point

Project will back, but i don't exacly when
Shadak
BAM!ID: 76064
Joined: 2009-10-10
Posts: 37
Credits: 68,532,635
World-rank: 9,392

2019-01-18 11:00:59

[BOINC@Polandgoofyx wrote:

Coleslaw wrote:

Hopefully you had some kind of insurance to help protect the cost of replacement?

yes, but if that was electrician falt the insurance company give me nothing.
I will talk today with eletrician <- I have bills and what more important I have (i don't know what is a name in english) protocol of the installation's opinion from him.


if your insurance is good they will pay you und then get their money from your electrcian...
Bharritt
 
BAM!ID: 83540
Joined: 2010-03-30
Posts: 20
Credits: 329,277,012
World-rank: 3,020

2019-01-19 20:52:07

This project seems cursed with bad luck. Apparently, if it wasn't for bad luck, he would have no luck at all. Does anyone know of a similar project I can work with until this project is up and running again? Another project that will let me run CPU with a low load factor like this project.

Thanks, Brent
Poway, CA
Dr Who Fan
BAM!ID: 1075
Joined: 2006-05-31
Posts: 576
Credits: 69,457,521
World-rank: 9,288

2019-01-20 04:25:19

Bharritt wrote:
Does anyone know of a similar project.. Another project that will let me run CPU with a low load factor like this project


As of this writing, There are no other NCI *Non Compute Intensive" (low load) projects other than WuProp (you already run that project).
NCI's are an extremely rare project. Last one prior to Goofyx's project went silent December 2015 (FreeHal).

Michael Goetz
BAM!ID: 44132
Joined: 2008-01-18
Posts: 6
Credits: 196,353,670
World-rank: 4,421

2019-01-21 03:10:26

Sorry to hear about the most recent disaster!

It's unusual to have computers protected by a UPS to be damaged like that. Often, the UPS itself will have a guarantee that it will protect downstream equipment and the UPS manufacturer sometimes has a policy to replace damaged computer equipment.

Good luck with the repairs.

Mike
Want to find one of the largest known primes? Try PrimeGrid. Or help cure disease at WCG.

[BOINC@Poland]goofyx
 
BAM!ID: 85901
Joined: 2010-06-01
Posts: 26
Credits: 169,513,222
World-rank: 4,902

2019-01-23 14:37:45

Situation update:
1. main and big problem is that storage is totally crush <- disk it's spin up, but then I unscrewed him disc disks the damage can be seen.... This is really fuck 6up situation and i don't need tell why... I can say that 15TB of my data is go FU*** I have only 4-5TB of backup on other disk (just critical data)
2. boinc server is totally dead <- i bought some parts to set it up and running
3. database server : 1x psu is dead (it's good that is a second one), 6x 16gb is dead (I exchanged it with spare one), 7 of 8 disk is dead (i send it for guarantee under warranty.... i know it's tricky <- at this moment database server start and running on 3 spare disk

Good news is that I am will back... need time to do it, but i will back.
Bad news... the only backup i have to restore for boinc projects is from 05.12.2018r, but there is a good things (i hope so) I have export data from projects (mainly from NCI) from 3-4h before disaster... i will try to import that date (credists etc) to production database
Dr Who Fan
BAM!ID: 1075
Joined: 2006-05-31
Posts: 576
Credits: 69,457,521
World-rank: 9,288

2019-01-23 22:36:49

[BOINC@Polandgoofyx wrote:

Situation update:
1. main and big problem is that storage is totally crush <- disk it's spin up, but then I unscrewed him disc disks the damage can be seen.... This is really fuck 6up situation and i don't need tell why... I can say that 15TB of my data is go FU*** I have only 4-5TB of backup on other disk (just critical data)
2. boinc server is totally dead <- i bought some parts to set it up and running
3. database server : 1x psu is dead (it's good that is a second one), 6x 16gb is dead (I exchanged it with spare one), 7 of 8 disk is dead (i send it for guarantee under warranty.... i know it's tricky <- at this moment database server start and running on 3 spare disk

Good news is that I am will back... need time to do it, but i will back.
Bad news... the only backup i have to restore for boinc projects is from 05.12.2018r, but there is a good things (i hope so) I have export data from projects (mainly from NCI) from 3-4h before disaster... i will try to import that date (credists etc) to production database


Goofyx PLEASE TURN OFF PROJECT NCI & CPU DATA EXPORTS ASAP!
THE RECENTLY IMPORTED STATS HERE AT BOINCSTATS (AND ELSEWHERE MOST LIKELY) ARE NOW COMPLETELY FUBARED!
Coleslaw
BAM!ID: 60911
Joined: 2008-10-31
Posts: 162
Credits: 2,046,144,599
World-rank: 760

2019-01-25 02:53:06

Looks like today that I got all but 7,351,871 or so points back.
Dr Who Fan
BAM!ID: 1075
Joined: 2006-05-31
Posts: 576
Credits: 69,457,521
World-rank: 9,288

2019-01-25 04:06:55

STATS, ETC ARE STILL VERY MUCH FUBARED!
Like I mentioned in my previous post Goofyx should of kept the stats export DISABLED until things were completely restored.

According to my account information page here at BoincStats I lost 327,255 points on NCI
---- and ----
the project as a whole lost 1,334,205,219 points.

All my active hosts indicate they have ZERO credits on the local (PC) side of things AND have been issued NEW HOST ID'S WITH ZERO CREDIT according to the NCI project web site.

Also received the following notification/message below earlier today:
GoofyxGrid@Home NCI: Notice from server
Invalid or missing account key. To fix, remove and add this project.

------

To avoid additional corruption of the projects various databases maybe we should not have our PC's communicate with the CPU & NCI projects UNTIL a post indicates things have been 100% fixed?
RFGuy_KCCO
BAM!ID: 93244
Joined: 2010-11-25
Posts: 4
Credits: 11,478,890,522
World-rank: 245

2019-01-25 15:11:58
last modified: 2019-01-25 15:14:00

I have lost something like ~86 million points, after already losing ~25 million points after your last crash a month ago, so I am definitely not pleased with this situation at all. Goofy, you need to work with the stats sites to restore all points to everyone. Period. No more lost points! Get with the stats sites and get everyone's points restored to what they were before the crash, not what they were months ago. The stats sites have that data, so it should be fairly simple to restore points. Please make this happen ASAP!
[BOINC@Poland]goofyx
 
BAM!ID: 85901
Joined: 2010-06-01
Posts: 26
Credits: 169,513,222
World-rank: 4,902

2019-01-25 23:43:29

Stats looks good.
Credits was restored to 4-5h before disaster.
JohnMD
BAM!ID: 60579
Joined: 2008-10-23
Posts: 41
Credits: 71,880,262
World-rank: 9,068

2019-01-26 01:19:19

[BOINC@Polandgoofyx wrote:

Stats looks good.
Credits was restored to 4-5h before disaster.

Well done goofyx.
To get so close after such a catastrophe was way beyond my hopes.
Dr Who Fan
BAM!ID: 1075
Joined: 2006-05-31
Posts: 576
Credits: 69,457,521
World-rank: 9,288

2019-01-26 04:08:17

Can confirm stats look GOOD!
--- BUT ---
I STILL SHOW ALL MY ACTIVE/CONNECTED PC'S RECEIVING NEW HOST ID'S
Coleslaw
BAM!ID: 60911
Joined: 2008-10-31
Posts: 162
Credits: 2,046,144,599
World-rank: 760

2019-01-27 02:50:20

Stats may look good from an individual perspective but Teams are still broken/missing.
[AF>Occitania]franky82
BAM!ID: 13325
Joined: 2006-11-27
Posts: 9
Credits: 2,403,419,223
World-rank: 666

2019-01-28 19:14:09
last modified: 2019-01-28 19:38:46

my account no longer exists on NCI !
aisong220
BAM!ID: 156019
Joined: 2013-11-21
Posts: 3
Credits: 6,962,757
World-rank: 52,647

2019-01-29 01:36:33

my account no longer exists on NCI !
fragamemnon
BAM!ID: 174897
Joined: 2014-11-19
Posts: 2
Credits: 1,308,758,247
World-rank: 1,057

2019-01-29 10:10:11

A few teams are also missing, and tasks are (sometimes?) non-NCI and reserve a whole thread.

Still, good job on restoration!
[AF>Occitania]franky82
BAM!ID: 13325
Joined: 2006-11-27
Posts: 9
Credits: 2,403,419,223
World-rank: 666

2019-01-29 16:55:59

So, I sign up for a new NCI account and begin from zero credits !
[BOINC@Poland]goofyx
 
BAM!ID: 85901
Joined: 2010-06-01
Posts: 26
Credits: 169,513,222
World-rank: 4,902

2019-01-30 06:57:50

>>my account no longer exists on NCI !
that really strage because like I wrote I had imported whole exported stats

>>Stats may look good from an individual perspective but Teams are still broken/missing.
I change team_import script and it create 2010 teams yesterday.
Admin/fouder of the team have to check it out.
In some cases teammember has to rejoin to team

>>I STILL SHOW ALL MY ACTIVE/CONNECTED PC'S RECEIVING NEW HOST ID'S
I know this is fu** up



I know that hardly anything run as I would like but I am still glad that we managed to recover accutall server state point state.
[AF>Occitania]franky82
BAM!ID: 13325
Joined: 2006-11-27
Posts: 9
Credits: 2,403,419,223
World-rank: 666

2019-01-30 10:10:26

My account was very recent (one or two months) and may not have been in the backup!
Now, my new account will work better!
Pages: [1] 2 3 4

Index :: The Projects :: GoofyxGrid@home - a disaster
Reason: