Why does my website appears to be unresponsive and offline once in a week

banjicom 2020-03-20 12:22:32 UTC #1

Keywords: WordPress - Google Cloud Platform - Technical issue - Other
bnsupport ID: f00702e2-79de-faab-5034-254525c1b84d
Description:
For a couple of months, i have been having issues with my website appearing offline or responsive once in a week. I will only get to know when jetpack notify me in my email. Whevere this happens i will have to stop and restart my VM-instance with a previous snapshot . Please any suggestions is welcome.

banjicom 2020-03-21 22:11:16 UTC #2

Anybody please? Maybe a plugin is causing this error

jota 2020-03-23 07:51:18 UTC #3

Hi @banjicom,

These guides will be really useful for you to debug the issue

https://docs.bitnami.com/aws/apps/wordpress/troubleshooting/debug-errors-apache/
https://docs.bitnami.com/aws/how-to/troubleshoot-wordpress-issues/
https://docs.bitnami.com/aws/faq/troubleshooting/troubleshoot-server-performance/
https://docs.bitnami.com/aws/apps/wordpress/troubleshooting/deny-connections-bots/

Let us know your findings after following those guides.

Thanks

banjicom 2020-03-25 00:07:34 UTC #4

@jota
Thanks so much, but one more thing is that whenever my website goes offline and unresponsive i always get this error in my google cloud vm-dashboard

Instance "wordpress-1-vm" is overutilized. Consider switching to the machine type: custom (2 vCPUs, 6 GB memory)

I have always apply the recommendations by increasing performance but it still the same.

jota 2020-03-25 07:57:13 UTC #5

Hi @banjicom,

This seems to be a performance issue, did you take a look at the guides I shared?

banjicom 2020-03-25 11:27:52 UTC #6

@jota

i have been checking your guides out. When i troubleshoot the server performance and i check out the disk size this is what i see

banjicom4real@wordpress-1-vm:~$ df -ih
Filesystem Inodes IUsed IFree IUse% Mounted on
udev 618K 292 618K 1% /dev
tmpfs 621K 621 620K 1% /run
/dev/sdb1 960K 129K 832K 14% /
tmpfs 621K 1 621K 1% /dev/shm
tmpfs 621K 8 621K 1% /run/lock
tmpfs 621K 15 621K 1% /sys/fs/cgroup
banjicom4real@wordpress-1-vm:~$ df -h
Filesystem Size Used Avail Use% Mounted on
udev 2.5G 0 2.5G 0% /dev
tmpfs 497M 8.1M 489M 2% /run
/dev/sdb1 15G 11G 3.7G 75% /
tmpfs 2.5G 0 2.5G 0% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 2.5G 0 2.5G 0% /sys/fs/cgroup
banjicom4real@wordpress-1-vm:~$ cd /opt/bitnami

the dev/sdb1 seems to be taking so much storage could this be the issues. Any recommendation for me

jota 2020-03-26 08:00:39 UTC #7

Hi @banjicom,

The storage doesn't seem to be the problem. However, you can check which directories have the largest number of files with these commands

df -ih
df -h
cd /opt/bitnami
sudo find . -type f | cut -d "/" -f 2 | sort | uniq -c | sort -n
du -h -d 1

Did you find any error in the Apache's log?

banjicom 2020-03-26 09:07:21 UTC #8

@jota

Thanks for your reply, i have run the commands again and i noticed the /dev/sdb1 filesystem seems to be getting filled up quickly. It was at 75% yesterday and now it is now at 88% is this normal?

About the Apache log, i don't seems to understand how i can get access to it or view it. i have navigate to the /opt/bitnami/apache2/logs/error_log folder as mentioned in the troubleshooting guide using an ftp manager, i could see some error logs but they are all in .gz format which is unreadable by my ftp client.

jota 2020-03-26 10:40:41 UTC #9

Hi @banjicom,

Again, did you get the list of directories using more disk? The commands I shared above show that information.

If there is too much information, logrotate takes care of compressing the information and creating a new files. You should have a /opt/bitnami/apache2/logs/error_log file, can you take a look at it?

banjicom 2020-03-26 17:01:22 UTC #10

The /dev/sdb1 filesystem is now using 97% of storage space, it was at 77% yesterday after i restored my vm-instance with an old snapshot because my website went unresponsive and offline.

About the list of directories this is what i see when i enter the command

Filesystem Inodes IUsed IFree IUse% Mounted on
udev 618K 292 618K 1% /dev
tmpfs 621K 612 620K 1% /run
/dev/sdb1 960K 128K 833K 14% /
tmpfs 621K 1 621K 1% /dev/shm
tmpfs 621K 8 621K 1% /run/lock
tmpfs 621K 15 621K 1% /sys/fs/cgroup
banjicom4real@wordpress-1-vm:~$ df -h
Filesystem Size Used Avail Use% Mounted on
udev 2.5G 0 2.5G 0% /dev
tmpfs 497M 15M 483M 3% /run
/dev/sdb1 15G 14G 489M 97% /
tmpfs 2.5G 0 2.5G 0% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 2.5G 0 2.5G 0% /sys/fs/cgroup
banjicom4real@wordpress-1-vm:~$ cd /opt/bitnami
banjicom4real@wordpress-1-vm:/opt/bitnami$ sudo find . -type f | cut -d "/" -f 2 | sort | uniq -c | sort -n
1 bnsupport-regex.ini
1 changelog.txt
1 ctlscript.sh
1 img
1 manager-linux-x64.run
1 properties.ini
1 README.txt
1 use_wordpress
2 bncert
6 sqlite
6 stats
8 letsencrypt
10 config
16 var
24 scripts
47 bnsupport
108 varnish
112 licenses
452 mysql
1628 php
4705 common
9989 apache2
33196 apps

banjicom 2020-03-26 17:16:21 UTC #11

i have taken a look at the errors_log there are about 3900 lines of error this is what i found on the last line.

[Thu Mar 26 17:00:00.649267 2020] [pagespeed:warn] [pid 8580:tid 139654015579904] [mod_pagespeed 1.13.35.2-0 @8580] wp-content/themes/boombox/includes/authentication/assets/js/jquery.validate.min.js,qver=2.6.0.2.pagespeed.ce.kPbbCrYH_C.js resource_404_count: not found (404)

banjicom 2020-03-26 17:30:57 UTC #12

@jota

they are all pagespeed warnings on my Apache error logs, they all have the 404 error not found at the end

banjicom 2020-03-26 18:00:59 UTC #13

One more thing, i found this when i run your command

188M ./apache2
141M ./common
3.0M ./stats
du: cannot read directory './var/data': Permission denied
88K ./var
51M ./bncert
8.0K ./img
331M ./licenses
28M ./bnsupport
80M ./php
3.4M ./sqlite
120K ./scripts
1.1G ./apps
du: cannot read directory './mysql/data': Permission denied
315M ./mysql
3.6M ./varnish
du: cannot read directory './letsencrypt/accounts': Permission denied
32M ./letsencrypt
68K ./config
2.2G .

jota 2020-03-27 09:11:25 UTC #14

Hi @banjicom,

Your disk size is 15 GB and you have 14GB in use right now. However, one of the commands I shared with you say that you only have 2.2G of data in the /opt/bitnami folder so there must be something in the system that is taking that other amount of disk space.

Maybe, it can be MySQL. Can you run the du command with sudo?

cd /opt/bitnami
sudo du -h -d 1

If you continue receiving those PageSpeed errors, you can disable it by following this guide

https://docs.bitnami.com/google/apps/wordpress/administration/use-pagespeed/#disable-pagespeed

Thanks

banjicom 2020-03-27 11:18:37 UTC #15

@jota

Thanks so much, your replies have been very helpful to me. It is sad to know my website crashed and went offline yesterday after /dev/sdb1 reached 100% storage with no space left, i had to stop and restore my Vm-instance with an old snapshot in order to get my website back online.

After this, the /dev/sdb1 was back to 48% but this morning it is now at 62% after using the commands you shared with me to check it out. It think something is eating up the storage space in the Mysql folder.

After runing the commad this is what i see

banjicom4real@wordpress-1-vm:~$ cd /opt/bitnami
banjicom4real@wordpress-1-vm:/opt/bitnami$ sudo du -h -d 1
176M ./apache2
141M ./common
3.0M ./stats
96K ./var
51M ./bncert
8.0K ./img
331M ./licenses
28M ./bnsupport
80M ./php
3.4M ./sqlite
120K ./scripts
1.1G ./apps
4.7G ./mysql
3.6M ./varnish
32M ./letsencrypt
68K ./config
6.6G .
banjicom4real@wordpress-1-vm:/opt/bitnami$

I can see a folder with no name taking up 6.6GB of space..........

banjicom 2020-03-27 11:42:38 UTC #16

I have just disable pagespeed by following the guide in the link

jota 2020-03-30 08:39:33 UTC #17

Hi @banjicom,

That's the total disk size of the current folder (it contains the data of all the other folders)

MySQL is using almost 5GB of disk and I think it's because the binlog files. You can take a look at these other posts to expire the logs and disable them

Did it improve the the performance of the site?

banjicom 2020-03-30 12:24:34 UTC #18

Thanks i have followed the guide and the recommendation and delete the binlog files and disable it using the cnf configuration. So far the disk usage have been stable at 40% with no more creation of additional log files. I will keep my fingers crossed and check out the disk usage tomorrow.

So far i haven't noticed any significant performance after i disable pagespeed, but the error logs have sure stopped.

jota 2020-03-31 08:27:06 UTC #19

Hi @banjicom,

I'm glad everything seems stable now. Let us know if you require further help.

system 2020-04-14 08:27:20 UTC #20

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Bitnami provides free all-in-one installers, virtual machines and cloud images for popular open source applications. Get them now!