Site availability issue

When the site went down at my old work (tech company, so vitally important), IT came in the next morning after working at home all night looking like they’d just done 7 monsters and several lines of suspicious white powder. Ain’t a fun position to be in for sure.

4 Likes

Just an update: Site is still experiencing slow response times. I will keep working to get it back to normal. Sorry for the delay :slightly_frowning_face:

13 Likes

If I’m not fluent in Japanese by the end of the year this will be why. It will be your fault.

5 Likes

You guys are amazing!!

Thanks for all the hard work you’re putting into fixing this issue. I don’t know if everyone realizes that you’re literally working overnight to resolve this. I can’t say how thankful I am :pray:.

7 Likes

This. I’m in Australia which is only 1-2 hrs off Japan time at any given moment, when I saw the site go down at the time it did I inwardly withered knowing that the techs would need to fix it when they should be resting.

6 Likes

Ongoing update: We are making progress with periods of stability but still sorting ongoing issues.

13 Likes

Thanks for the update and the hard work!!

2 Likes

Final (:crossed_fingers:) Update: The site has been back to normal for about an hour now. Sorry for the huge inconvenience it caused everyone! :bowing_man:

11 Likes

Thanks. It is indeed back to normal from what I can tell.

1 Like

Thanks Jake, and everyone involved in bringing our beloved grammar site back to us!
:pray: :bowing_man:

I must say that now I’m very curious what the nature of the issue was! (After all, I made my little hypothesis/prediction in the Bugs thread, and it’s always good to check one’s guesses against reality. :nerd_face: )

Without giving anything proprietary away, would you guys be willing to let us know the general nature of the issue? E.g. Was it some code patch that affected performance which wasn’t caught during testing, as I guessed? Something entirely different?

2 Likes

While we did revert a few minor changes from yesterday (even though we couldn’t pinpoint any particular one as the cause), the change that stabilized it was improving our db indexing.

Looking at our average server response time over the past 7 days to the average after the improved indexing, it cut it by over 50% which helped free up bandwidth and prevent things from clogging back up.

That being said we will keep an eye on it! Despite being up from 2am this morning working to fix it, I doubt I will get much restful sleep until it proves itself stable :sob:

15 Likes

datgoodshit

Just drink about 3 to 10 of these bad boys and you’ll be fine.

For the unfamiliar, you know they are working when you start shaking, sweating, twitching or begin to feel numbness in all extremities. If you are lucky, maybe all of the above at once.

I find the off brand ones sometimes work the best. Sketchier and cheaper the better.

If anyone needs more tips on how to stay awake, let me know.

7 Likes

:joy:

4 Likes

I never took one of these, they look like nightmare fuel that leave you suffering while awake. Truly frightening!

4 Likes

Nightmare fuel but fuel none the less. If you think about it, they are a kind of anti-nightmare fuel - considering, well, you won’t be sleeping.

6 Likes

お疲れ様でした thanks for your hard work and endurance! It’s really appreciated by us.

3 Likes