Kossa.ca 503 error and your bitnami support tool does not give me the id

Type: Bitnami Support Tool

Description:
Hi,

I am facing issues and urgently need to get site up and running. It was running all good last week and now there is this 503 error.

And here I am copy pasting the entire out put from bitnami support tool.

The Apache configuration has errors:

apache2: Syntax error on line 66 of /opt/bitnami/apache2/conf/httpd.conf: Cannot 
load modules/mod_mpm_event.so into server: libiconv.so.2: cannot open shared 
Press [Enter] to continue:
object file: No such file or directory

Please check the configuration.
A high number of incoming requests originate from one or more unique IP
addresses. This could indicate a bot attack. The following guide shows how to
check for and block suspicious IP addresses.

https://docs.bitnami.com/bch/apps/moodle/troubleshooting/deny-connections-bots-apache/
[Mysql]
The “/opt/bitnami/mysql/data” folder is using 51% of total disk space.

1 /opt/bitnami/mysql/data/#innodb_temp 1 /opt/bitnami/mysql/data/mysql 50550 
/opt/bitnami/mysql/data/bitnami_wordpress 695 
/opt/bitnami/mysql/data/kosaastaging 1 /opt/bitnami/mysql/data/sys 2 
/opt/bitnami/mysql/data/performance_schema 51396 /opt/bitnami/mysql/data

In most cases this is due to binary logging. Please check the following guide to
disable it.

Press [Enter] to continue:
https://docs.bitnami.com/general/apps/wordpress/troubleshooting/disable-bi
nary-logging-mysql/

===== End of bndiagnostic tool output =====

Press [Enter] to continue:
^C

I was able to increase the disk size, restarted the whole VM and re ran the bn support tool and here is what I get.

sudo /opt/bitnami/bnsupport-tool

Welcome to the Bitnami Support tool.

Please read the following information carefully.
Press [Enter] to continue:
This tool collects system information and files from a Bitnami stack into a
support bundle file to be uploaded and reviewed by the Bitnami Team, for the
sole purpose of providing you support for any issue you may find.
The uploaded information will be automatically removed from our systems after 1
month. In case you have any doubt regarding our privacy policy please check:
https://www.vmware.com/help/privacy.html
Press [Enter] to continue:
Do you accept? [y/n]: y
//
The bndiagnostic tool has finished searching for errors and has found some
issues that might be related to yours. The output will be shown on the next
page:

Press [Enter] to continue:
===== Begin of bndiagnostic tool output =====
Action ‘-t -f /opt/bitnami/apache2/conf/httpd.conf’ failed.
The Apache error log may have more information.

✓ Resources: No issues found
? Apache: Found possible issues
✓ Mysql: No issues found
✓ Connectivity: No issues found
✓ Php: No issues found

[Apache]
Found recent error or warning messages in the Apache error log.

[Apache]
Found recent error or warning messages in the Apache error log.

[Mon Aug 02 20:46:03.482656 2021] [proxy_fcgi:error] [pid 1864:tid 
139872916334336] (104)Connection reset by peer: [client **ip_address**:30124] 
AH01075: Error dispatching request to : 
 [Mon Aug 02 20:46:04.088494 2021] [proxy_fcgi:error] [pid 1864:tid 
139872916334336] [client **ip_address**:30124] AH01067: Failed to read FastCGI 
Press [Enter] to continue:
header
 [Mon Aug 02 20:46:04.088541 2021] [proxy_fcgi:error] [pid 1864:tid 
139872916334336] (104)Connection reset by peer: [client **ip_address**:30124] 
AH01075: Error dispatching request to : 

Please check the following guide to troubleshoot server issues:

https://docs.bitnami.com/general/apps/wordpress/troubleshooting/debug-erro
rs-apache/
The Apache configuration has errors:

apache2: Syntax error on line 66 of /opt/bitnami/apache2/conf/httpd.conf: Cannot 
load modules/mod_mpm_event.so into server: libiconv.so.2: cannot open shared 
object file: No such file or directory

Please check the configuration.
A high number of incoming requests originate from one or more unique IP
addresses. This could indicate a bot attack. The following guide shows how to
check for and block suspicious IP addresses.

Press [Enter] to continue:
https://docs.bitnami.com/bch/apps/moodle/troubleshooting/deny-connections-
bots-apache/

===== End of bndiagnostic tool output =====

Hello @dhruv,

The main error seems to be:

apache2: Syntax error on line 66 of /opt/bitnami/apache2/conf/httpd.conf: Cannot 
load modules/mod_mpm_event.so into server: libiconv.so.2: cannot open shared 
object file: No such file or directory

This is a weird error, the libiconv component should be installed in the machine. Did you remove any file by mistake? Can you share with us the output of running the next command?

sudo find /opt/bitnami -type f -iname "*libiconv*"

About bnsupport, note that you don’t need to share with us the whole output but the ID that appears at the end.

Regards

Hi David,

I performed this command and this is what I got

sudo find /opt/bitnami -type f -iname “libiconv
/opt/bitnami/licenses/src/libiconv-1.15.tar.gz
/opt/bitnami/licenses/libiconv.txt
/opt/bitnami/common/lib/libiconv.so.2.6.0
/opt/bitnami/php/include/php/ext/iconv/php_iconv_aliased_libiconv.h
/opt/bitnami/php/include/php/ext/iconv/php_have_libiconv.h

Also bnsupport tool does not give me an id, it keeps processing something forever and i have to close it manually everytime.

Hello @dhruv,

Try this command:

ln -s /opt/bitnami/common/lib/libiconv.so.2.6.0 /opt/bitnami/common/lib/libiconv.so.2

Regards

Hi David,

This is what I get.

ln -s /opt/bitnami/common/lib/libiconv.so.2.6.0 /opt/bitnami/common/lib/libiconv.so.2
ln: failed to create symbolic link ‘/opt/bitnami/common/lib/libiconv.so.2’: File exists

Hi @dhruv,

Really weird it was not in the previous list. Maybe you run it twice? Could please run the command below again?

sudo find /opt/bitnami -type f -iname "*libiconv*"

Have you tried to restart Apache after that?

Regards

Hi David,

I have restarted using this command

dhruv@kosaa:~$ sudo /opt/bitnami/ctlscript.sh restart
Syntax OK
/opt/bitnami/apache2/scripts/ctl.sh : httpd stopped
/opt/bitnami/php/scripts/ctl.sh : php-fpm stopped
/opt/bitnami/mysql/scripts/ctl.sh : mysql stopped
/opt/bitnami/mysql/scripts/ctl.sh : mysql  started at port 3306
/opt/bitnami/php/scripts/ctl.sh : php-fpm started
Syntax OK
/opt/bitnami/apache2/scripts/ctl.sh : httpd started at port 80


dhruv@kosaa:~$ sudo find /opt/bitnami -type f -iname "*libiconv*"
/opt/bitnami/licenses/src/libiconv-1.15.tar.gz
/opt/bitnami/licenses/libiconv.txt
/opt/bitnami/common/lib/libiconv.so.2.6.0
/opt/bitnami/php/include/php/ext/iconv/php_iconv_aliased_libiconv.h
/opt/bitnami/php/include/php/ext/iconv/php_have_libiconv.h

Hi @dhruv,

So Apache is properly started now. Are you facing another issue on your instance? In that case, can you try to execute the support tool now?

Regards

Hi David,

As mentioned earlier, I have tried running your support tool for which I have copy pasted the entire output and it does not give me the id. My server is down for days and I only one reply from you every day. At this rate i might have to look for another services and migrate which again will cost me resources.

And I am still facing the old issue,

check kosaa.ca and you will see 503 error.

Hi David,

I am waiting for your reply. I would appreciate if this issue can be resolved. Its been more than a week now that the whole site is down.

Hi @dhruv,

Have you taken a look at the Apache’s log to try to get more info about those 503 errors?

sudo tail -n30 /opt/bitnami/apache2/logs/error_log

https://docs.bitnami.com/aws/apps/wordpress/troubleshooting/debug-errors-apache/

I do not know which app you are using. If the app has a log file, you will also find useful information there.

Apart from checking the errors in the Apache’s log, can you check if the server has enough free RAM memory/disk to run your application?

free -m
df -H

Thanks

Hi Jota,

this is the what I am getting

[Mon Aug 09 13:25:31.157262 2021] [proxy_fcgi:error] [pid 6419:tid 140221823678208] (104)Connection reset by peer: 
[client 114.119.150.228:45996] AH01075: Error dispatching request to : 
[Mon Aug 09 13:25:57.098165 2021] [proxy_fcgi:error] [pid 6085:tid 140221915997952] [client 157.55.39.145:7808] AH0
1067: Failed to read FastCGI header
[Mon Aug 09 13:25:57.098327 2021] [proxy_fcgi:error] [pid 6085:tid 140221915997952] (104)Connection reset by peer: 
[client 157.55.39.145:7808] AH01075: Error dispatching request to : 
[Mon Aug 09 13:25:57.414615 2021] [proxy_fcgi:error] [pid 6085:tid 140221915997952] [client 157.55.39.145:7808] AH0
1067: Failed to read FastCGI header
[Mon Aug 09 13:25:57.414656 2021] [proxy_fcgi:error] [pid 6085:tid 140221915997952] (104)Connection reset by peer: 
[client 157.55.39.145:7808] AH01075: Error dispatching request to : 
[Mon Aug 09 13:28:04.409636 2021] [proxy_fcgi:error] [pid 6419:tid 140221781714688] [client 114.119.137.162:33320] 
AH01067: Failed to read FastCGI header
[Mon Aug 09 13:28:04.409684 2021] [proxy_fcgi:error] [pid 6419:tid 140221781714688] (104)Connection reset by peer: 
[client 114.119.137.162:33320] AH01075: Error dispatching request to : 
[Mon Aug 09 13:28:04.869972 2021] [proxy_fcgi:error] [pid 6419:tid 140221781714688] [client 114.119.137.162:33320] 
AH01067: Failed to read FastCGI header
[Mon Aug 09 13:28:04.870013 2021] [proxy_fcgi:error] [pid 6419:tid 140221781714688] (104)Connection reset by peer: 
[client 114.119.137.162:33320] AH01075: Error dispatching request to : 
[Mon Aug 09 13:30:53.388412 2021] [proxy_fcgi:error] [pid 6508:tid 140222142600960] [client 114.119.156.3:31240] AH
01067: Failed to read FastCGI header
[Mon Aug 09 13:30:53.388462 2021] [proxy_fcgi:error] [pid 6508:tid 140222142600960] (104)Connection reset by peer: 
[client 114.119.156.3:31240] AH01075: Error dispatching request to : 
[Mon Aug 09 13:30:53.826803 2021] [proxy_fcgi:error] [pid 6508:tid 140222142600960] [client 114.119.156.3:31240] AH
01067: Failed to read FastCGI header
[Mon Aug 09 13:30:53.826847 2021] [proxy_fcgi:error] [pid 6508:tid 140222142600960] (104)Connection reset by peer: 
[client 114.119.156.3:31240] AH01075: Error dispatching request to : 
[Mon Aug 09 13:34:22.582612 2021] [proxy_fcgi:error] [pid 6352:tid 140222041888512] [client 114.119.150.34:8414] AH
01067: Failed to read FastCGI header
[Mon Aug 09 13:34:22.582666 2021] [proxy_fcgi:error] [pid 6352:tid 140222041888512] (104)Connection reset by peer: 
[client 114.119.150.34:8414] AH01075: Error dispatching request to : 
[Mon Aug 09 13:34:23.070602 2021] [proxy_fcgi:error] [pid 6352:tid 140222041888512] [client 114.119.150.34:8414] AH
01067: Failed to read FastCGI header
[Mon Aug 09 13:34:23.070656 2021] [proxy_fcgi:error] [pid 6352:tid 140222041888512] (104)Connection reset by peer: 
[client 114.119.150.34:8414] AH01075: Error dispatching request to : 
[Mon Aug 09 13:42:18.142065 2021] [proxy_fcgi:error] [pid 6419:tid 140222109030144] [client 114.119.150.34:64798] A
H01067: Failed to read FastCGI header
[Mon Aug 09 13:42:18.142122 2021] [proxy_fcgi:error] [pid 6419:tid 140222109030144] (104)Connection reset by peer: 
[client 114.119.150.34:64798] AH01075: Error dispatching request to : 
[Mon Aug 09 13:42:18.490963 2021] [proxy_fcgi:error] [pid 6419:tid 140222109030144] [client 114.119.150.34:64798] A
H01067: Failed to read FastCGI header
[Mon Aug 09 13:42:18.491004 2021] [proxy_fcgi:error] [pid 6419:tid 140222109030144] (104)Connection reset by peer: 
[client 114.119.150.34:64798] AH01075: Error dispatching request to : 
[Mon Aug 09 13:59:41.462494 2021] [proxy_fcgi:error] [pid 6419:tid 140222150993664] [client 114.119.152.104:20196] 
AH01067: Failed to read FastCGI header
[Mon Aug 09 13:59:41.462542 2021] [proxy_fcgi:error] [pid 6419:tid 140222150993664] (104)Connection reset by peer: 
[client 114.119.152.104:20196] AH01075: Error dispatching request to : 
[Mon Aug 09 13:59:41.951576 2021] [proxy_fcgi:error] [pid 6419:tid 140222150993664] [client 114.119.152.104:20196] 
AH01067: Failed to read FastCGI header
[Mon Aug 09 13:59:41.951616 2021] [proxy_fcgi:error] [pid 6419:tid 140222150993664] (104)Connection reset by peer: 
[client 114.119.152.104:20196] AH01075: Error dispatching request to : 

and

free -m
              total        used        free      shared  buff/cache   available
Mem:           3703        1115        1218         212        1370        2095

df -H
Filesystem      Size  Used Avail Use% Mounted on
udev            2.0G     0  2.0G   0% /dev
tmpfs           389M   41M  348M  11% /run
/dev/sda1       159G   89G   64G  59% /
tmpfs           2.0G     0  2.0G   0% /dev/shm
tmpfs           5.3M     0  5.3M   0% /run/lock
tmpfs           2.0G     0  2.0G   0% /sys/fs/cgroup

I am simply running the site on wordpress. Everything with normal installation, nothing exceptional here. In fact I used your wordpress bitnami VM on google cloud to setup everything.

Thanks

Hi @dhruv,

It seems Apache can’t contact PHP. Let’s check its log file

sudo tail -n 20 /opt/bitnami/php/logs/php-fpm.log

Thanks

this is what I get

sudo tail -n 20 /opt/bitnami/php/logs/php-fpm.log
tail: cannot open ‘/opt/bitnami/php/logs/php-fpm.log’ for reading: No such file or directory

Hi @dhruv,

It seems PHP-FPM is not working in the machine, can you try to start it?

sudo /opt/bitnami/ctlscript.sh start
sudo /opt/bitnami/ctlscript.sh status

Regarding the Bitnami Support tool, does it continue failing when uploading the file to our buckets? Can you try to run the tool again and share the code here?

Thanks

Hi Jota,

Yes the support tool keeps processing something at the end, does not give me any ID.

and here is all the output.

dhruv@kosaa:~$ sudo /opt/bitnami/ctlscript.sh start
/opt/bitnami/mysql/scripts/ctl.sh : mysql  (pid 1399) already running
/opt/bitnami/php/scripts/ctl.sh : php-fpm (pid 1502) already running
Syntax OK
/opt/bitnami/apache2/scripts/ctl.sh : httpd started at port 80
dhruv@kosaa:~$ sudo /opt/bitnami/ctlscript.sh status
php-fpm already running
apache already running
mysql already running
dhruv@kosaa:~$ sudo /opt/bitnami/bnhelper-tool
----------------------------------------------------------------------------
Executing sudo /opt/bitnami/bnsupport-tool...
----------------------------------------------------------------------------
Welcome to the Bitnami Support tool.
----------------------------------------------------------------------------
Please read the following information carefully.
Press [Enter] to continue:
This tool collects system information and files from a Bitnami stack into a
support bundle file to be uploaded and reviewed by the Bitnami Team, for the
sole purpose of providing you support for any issue you may find.

The uploaded information will be automatically removed from our systems after 1
month. In case you have any doubt regarding our privacy policy please check:
https://www.vmware.com/help/privacy.html
Press [Enter] to continue:
Do you accept? [y/n]: y
|/
The bndiagnostic tool has finished searching for errors and has found some 
issues that might be related to yours. The output will be shown on the next 
page:
                                    
Press [Enter] to continue:
===== Begin of bndiagnostic tool output =====
Action '-t -f /opt/bitnami/apache2/conf/httpd.conf' failed.
The Apache error log may have more information.
 
    ✓ Resources: No issues found
    ? Apache: Found possible issues
    ✓ Mysql: No issues found
    ✓ Connectivity: No issues found
    ✓ Php: No issues found
 
 
[Apache]
Found recent error or warning messages in the Apache error log.
```
```
[Wed Aug 11 14:36:40.333639 2021] [proxy_fcgi:error] [pid 6352:tid 
140221798500096] (104)Connection reset by peer: [client **ip_address**:41214] 
AH01075: Error dispatching request to : 
 [Wed Aug 11 14:36:40.829700 2021] [proxy_fcgi:error] [pid 6352:tid 
140221798500096] [client **ip_address**:41214] AH01067: Failed to read FastCGI 
Press [Enter] to continue:
header
 [Wed Aug 11 14:36:40.829751 2021] [proxy_fcgi:error] [pid 6352:tid 
140221798500096] (104)Connection reset by peer: [client **ip_address**:41214] 
AH01075: Error dispatching request to : 
```
Please check the following guide to troubleshoot server issues:
 
https://docs.bitnami.com/general/apps/wordpress/troubleshooting/debug-erro
rs-apache/
The Apache configuration has errors:
```
apache2: Syntax error on line 66 of /opt/bitnami/apache2/conf/httpd.conf: Cannot 
load modules/mod_mpm_event.so into server: libiconv.so.2: cannot open shared 
object file: No such file or directory
```
Please check the configuration.
A high number of incoming requests originate from one or more unique IP 
addresses. This could indicate a bot attack. The following guide shows how to 
check for and block suspicious IP addresses.
 
Press [Enter] to continue:
https://docs.bitnami.com/bch/apps/moodle/troubleshooting/deny-connections-
bots-apache/
 
===== End of bndiagnostic tool output =====
                                    
Press [Enter] to continue:

Hi @dhruv,

This is weird. All services are running but Apache can’t contact PHP-FPM. Let’s try something to see if that works. We are going to disable PHP-FPM and will let Apache to handle the execution of the PHP code

https://docs.bitnami.com/aws/apps/wordpress/administration/disable-phpfpm/

Can you access the application now? Do you still receive errors in Apache?

sudo tail -n30 /opt/bitnami/apache2/logs/error_log

Thanks