MYSQL is not starting. Help me out

Keywords: WordPress - AWS - Technical issue - Other
Description:
it looks like my aws bitnami wordpress can not be run because database connection failed.

/opt/bitnami/mysql/scripts/ctl.sh : mysql could not be started

here is the mysql log.

bitnami@ip-172-31-44-132:/$ sudo tail -n 100 /opt/bitnami/mysql/data/mysqld.log
2021-04-04T12:56:12.756891Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld.bin: Shutdown complete (mysqld 8.0.22) MySQL Community Server - GPL.
2021-04-04T12:57:36.973849Z 0 [System] [MY-010116] [Server] /opt/bitnami/mysql/bin/mysqld.bin (mysqld 8.0.22) starting as process 2364
2021-04-04T12:57:36.982987Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-04-04T2021-04-04T12:57:37.587674Z 1 [ERROR] [MY-010334] [Server] Failed to initialize DD Storage Engine
2021-04-04T12:57:37.587968Z 0 [ERROR] [MY-010020] [Server] Data Dictionary initialization failed.
2021-04-04T12:57:37.588268Z 0 [ERROR] [MY-010119] [Server] Aborting
2021-04-04T12:57:37.588803Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld.bin: Shutdown complete (mysqld 8.0.22) MySQL Community Server - GPL.
2021-04-04T12:58:01.052699Z 0 [System] [MY-010116] [Server] /opt/bitnami/mysql/bin/mysqld.bin (mysqld 8.0.22) starting as process 2751
2021-04-04T12:58:01.062678Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-04-04T12:58:01.417832Z 1 [Warning] [MY-012637] [InnoDB] 1048576 bytes should have been written. Only 634880 bytes written. Retrying for the remaining bytes.
2021-04-04T12:58:01.418023Z 1 [Warning] [MY-012638] [InnoDB] Retry attempts for writing partial data failed.
2021-04-04T12:58:01.418150Z 1 [ERROR] [MY-012639] [InnoDB] Write to file ./ibtmp1 failed at offset 11534336, 1048576 bytes should have been written, only 634880 were written. Operating system error number 28. Check that your OS and file system support files of this size. Check also that the disk is not full or a disk quota exceeded.
2021-04-04T12:58:01.418283Z 1 [ERROR] [MY-012640] [InnoDB] Error number 28 means ‘No space left on device’
2021-04-04T12:58:01.418537Z 1 [ERROR] [MY-012267] [InnoDB] Could not set the file size of ‘./ibtmp1’. Probably out of disk space
2021-04-04T12:58:01.418666Z 1 [ERROR] [MY-012926] [InnoDB] Unable to create the shared innodb_temporary.
2021-04-04T12:58:01.418838Z 1 [ERROR] [MY-012930] [InnoDB] Plugin initialization aborted with error Generic error.
2021-04-04T12:58:01.671701Z 1 [ERROR] [MY-010334] [Server] Failed to initialize DD Storage Engine
2021-04-04T12:58:01.672001Z 0 [ERROR] [MY-010020] [Server] Data Dictionary initialization failed.
2021-04-04T12:58:01.672301Z 0 [ERROR] [MY-010119] [Server] Aborting
2021-04-04T12:58:01.672850Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld.bin: Shutdown complete (mysqld 8.0.22) MySQL Community Server - GPL.
2021-04-04T12:58:37.879483Z 0 [System] [MY-010116] [Server] /opt/bitnami/mysql/bin/mysqld.bin (mysqld 8.0.22) starting as process 3143
2021-04-04T12:58:37.889399Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-04-04T12:58:38.250276Z 1 [Warning] [MY-012637] [InnoDB] 1048576 bytes should have been written. Only 630784 bytes written. Retrying for the remaining bytes.
2021-04-04T12:58:38.250424Z 1 [Warning] [MY-012638] [InnoDB] Retry attempts for writing partial data failed.
2021-04-04T12:58:38.250551Z 1 [ERROR] [MY-012639] [InnoDB] Write to file ./ibtmp1 failed at offset 11534336, 1048576 bytes should have been written, only 630784 were written. Operating system error number 28. Check that your OS and file system support files of this size. Check also that the disk is not full or a disk quota exceeded.
2021-04-04T12:58:38.250681Z 1 [ERROR] [MY-012640] [InnoDB] Error number 28 means ‘No space left on device’
2021-04-04T12:58:38.250935Z 1 [ERROR] [MY-012267] [InnoDB] Could not set the file size of ‘./ibtmp1’. Probably out of disk space
2021-04-04T12:58:38.251092Z 1 [ERROR] [MY-012926] [InnoDB] Unable to create the shared innodb_temporary.
2021-04-04T12:58:38.251230Z 1 [ERROR] [MY-012930] [InnoDB] Plugin initialization aborted with error Generic error.
2021-04-04T12:58:38.503673Z 1 [ERROR] [MY-010334] [Server] Failed to initialize DD Storage Engine
2021-04-04T12:58:38.503963Z 0 [ERROR] [MY-010020] [Server] Data Dictionary initialization failed.
2021-04-04T12:58:38.504261Z 0 [ERROR] [MY-010119] [Server] Aborting
2021-04-04T12:58:38.504793Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld.bin: Shutdown complete (mysqld 8.0.22) MySQL Community Server - GPL.
2021-04-04T13:00:09.153541Z 0 [System] [MY-010116] [Server] /opt/bitnami/mysql/bin/mysqld.bin (mysqld 8.0.22) starting as process 3579
2021-04-04T13:00:09.163342Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-04-042021-04-04T13:00:09.779599Z 1 [ERROR] [MY-010334] [Server] Failed to initialize DD Storage Engine
2021-04-04T13:00:09.779897Z 0 [ERROR] [MY-010020] [Server] Data Dictionary initialization failed.
2021-04-04T13:00:09.780198Z 0 [ERROR] [MY-010119] [Server] Aborting
2021-04-04T13:00:09.780734Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld.bin: Shutdown complete (mysqld 8.0.22) MySQL Community Server - GPL.
2021-04-04T13:01:06.267862Z 0 [System] [MY-010116] [Server] /opt/bitnami/mysql/bin/mysqld.bin (mysqld 8.0.22) starting as process 992
2021-04-04T13:01:06.386021Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-04-04T13:01:07.076612Z 1 [Warning] [MY-012637] [InnoDB] 1048576 bytes should have been written. Only 364544 bytes written. Retrying for the remaining bytes.
2021-04-04T13:01:07.076759Z 1 [Warning] [MY-012638] [InnoDB] Retry attempts for writing partial data failed.
2021-04-04T13:01:07.076874Z 1 [ERROR] [MY-012639] [InnoDB] Write to file ./ibtmp1 failed at offset 11534336, 1048576 bytes should have been written, only 364544 were written. Operating system error number 28. Check that your OS and file system support files of this size. Check also that the disk is not full or a disk quota exceeded.
2021-04-04T13:01:07.076993Z 1 [ERROR] [MY-012640] [InnoDB] Error number 28 means ‘No space left on device’
2021-04-04T13:01:07.077250Z 1 [ERROR] [MY-012267] [InnoDB] Could not set the file size of ‘./ibtmp1’. Probably out of disk space
2021-04-04T13:01:07.077373Z 1 [ERROR] [MY-012926] [InnoDB] Unable to create the shared innodb_temporary.
2021-04-04T13:01:07.077503Z 1 [ERROR] [MY-012930] [InnoDB] Plugin initialization aborted with error Generic error.
2021-04-04T13:01:07.563626Z 1 [ERROR] [MY-010334] [Server] Failed to initialize DD Storage Engine
2021-04-04T13:01:07.563908Z 0 [ERROR] [MY-010020] [Server] Data Dictionary initialization failed.
2021-04-04T13:01:07.564203Z 0 [ERROR] [MY-010119] [Server] Aborting
2021-04-04T13:01:07.568521Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld.bin: Shutdown complete (mysqld 8.0.22) MySQL Community Server - GPL.
2021-04-04T13:02:11.638403Z 0 [System] [MY-010116] [Server] /opt/bitnami/mysql/bin/mysqld.bin (mysqld 8.0.22) starting as process 1422
2021-04-04T13:02:11.648793Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-04-04T13:02:11.997395Z 1 [Warning] [MY-012637] [InnoDB] 1048576 bytes should have been written. Only 360448 bytes written. Retrying for the remaining bytes.
2021-04-04T13:02:11.997561Z 1 [Warning] [MY-012638] [InnoDB] Retry attempts for writing partial data failed.
2021-04-04T13:02:11.997696Z 1 [ERROR] [MY-012639] [InnoDB] Write to file ./ibtmp1 failed at offset 11534336, 1048576 bytes should have been written, only 360448 were written. Operating system error number 28. Check that your OS and file system support files of this size. Check also that the disk is not full or a disk quota exceeded.
2021-04-04T13:02:11.997829Z 1 [ERROR] [MY-012640] [InnoDB] Error number 28 means ‘No space left on device’
2021-04-04T13:02:11.998084Z 1 [ERROR] [MY-012267] [InnoDB] Could not set the file size of ‘./ibtmp1’. Probably out of disk space
2021-04-04T13:02:11.998214Z 1 [ERROR] [MY-012926] [InnoDB] Unable to create the shared innodb_temporary.
2021-04-04T13:02:11.998353Z 1 [ERROR] [MY-012930] [InnoDB] Plugin initialization aborted with error Generic error.
2021-04-04T13:02:12.251554Z 1 [ERROR] [MY-010334] [Server] Failed to initialize DD Storage Engine
2021-04-04T13:02:12.251846Z 0 [ERROR] [MY-010020] [Server] Data Dictionary initialization failed.
2021-04-04T13:02:12.252144Z 0 [ERROR] [MY-010119] [Server] Aborting
2021-04-04T13:02:12.252675Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld.bin: Shutdown complete (mysqld 8.0.22) MySQL Community Server - GPL.
2021-04-04T13:03:27.917928Z 0 [System] [MY-010116] [Server] /opt/bitnami/mysql/bin/mysqld.bin (mysqld 8.0.22) starting as process 2187
2021-04-04T13:03:27.929474Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-04-04T2021-04-04T13:03:28.543777Z 1 [ERROR] [MY-010334] [Server] Failed to initialize DD Storage Engine
2021-04-04T13:03:28.544083Z 0 [ERROR] [MY-010020] [Server] Data Dictionary initialization failed.
2021-04-04T13:03:28.544446Z 0 [ERROR] [MY-010119] [Server] Aborting
2021-04-04T13:03:28.545102Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld.bin: Shutdown complete (mysqld 8.0.22) MySQL Community Server - GPL.
2021-04-04T13:05:20.597864Z 0 [System] [MY-010116] [Server] /opt/bitnami/mysql/bin/mysqld.bin (mysqld 8.0.22) starting as process 2697
2021-04-04T13:05:20.607882Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-04-04T13:05:20.965216Z 1 [Warning] [MY-012637] [InnoDB] 1048576 bytes should have been written. Only 897024 bytes written. Retrying for the remaining bytes.
2021-04-04T13:05:20.965362Z 1 [Warning] [MY-012638] [InnoDB] Retry attempts for writing partial data failed.
2021-04-04T13:05:20.965489Z 1 [ERROR] [MY-012639] [InnoDB] Write to file ./ibtmp1 failed at offset 9437184, 1048576 bytes should have been written, only 897024 were written. Operating system error number 28. Check that your OS and file system support files of this size. Check also that the disk is not full or a disk quota exceeded.
2021-04-04T13:05:20.965638Z 1 [ERROR] [MY-012640] [InnoDB] Error number 28 means ‘No space left on device’
2021-04-04T13:05:20.965899Z 1 [ERROR] [MY-012267] [InnoDB] Could not set the file size of ‘./ibtmp1’. Probably out of disk space
2021-04-04T13:05:20.966030Z 1 [ERROR] [MY-012926] [InnoDB] Unable to create the shared innodb_temporary.
2021-04-04T13:05:20.966188Z 1 [ERROR] [MY-012930] [InnoDB] Plugin initialization aborted with error Generic error.
2021-04-04T13:05:21.219496Z 1 [ERROR] [MY-010334] [Server] Failed to initialize DD Storage Engine
2021-04-04T13:05:21.219798Z 0 [ERROR] [MY-010020] [Server] Data Dictionary initialization failed.
2021-04-04T13:05:21.220106Z 0 [ERROR] [MY-010119] [Server] Aborting
2021-04-04T13:05:21.220634Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld.bin: Shutdown complete (mysqld 8.0.22) MySQL Community Server - GPL.
2021-04-04T13:09:27.637567Z 0 [System] [MY-010116] [Server] /opt/bitnami/mysql/bin/mysqld.bin (mysqld 8.0.22) starting as process 3443
2021-04-04T13:09:27.712885Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-04-04T13:09:28.480128Z 1 [Warning] [MY-012638] [InnoDB] Retry attempts for writing partial data failed.
2021-04-04T13:09:28.482291Z 1 [ERROR] [MY-012639] [InnoDB] Write to file ./ibtmp1 failed at offset 0, 1048576 bytes should have been written, only 0 were written. Operating system error number 28. Check that your OS and file system support files of this size. Check also that the disk is not full or a disk quota exceeded.
2021-04-04T13:09:28.482446Z 1 [ERROR] [MY-012640] [InnoDB] Error number 28 means ‘No space left on device’
2021-04-04T13:09:28.482700Z 1 [ERROR] [MY-012267] [InnoDB] Could not set the file size of ‘./ibtmp1’. Probably out of disk space
2021-04-04T13:09:28.482831Z 1 [ERROR] [MY-012926] [InnoDB] Unable to create the shared innodb_temporary.
2021-04-04T13:09:28.482975Z 1 [ERROR] [MY-012930] [InnoDB] Plugin initialization aborted with error Generic error.
2021-04-04T13:09:28.894335Z 1 [ERROR] [MY-010334] [Server] Failed to initialize DD Storage Engine
2021-04-04T13:09:28.894613Z 0 [ERROR] [MY-010020] [Server] Data Dictionary initialization failed.
2021-04-04T13:09:28.894916Z 0 [ERROR] [MY-010119] [Server] Aborting
2021-04-04T13:09:28.902298Z 0 [System] [MY-010910] [Server] /opt/bitnami/mysql/bin/mysqld.bin: Shutdown complete (mysqld 8.0.22) MySQL Community Server - GPL.
2021-04-04T13:11:27.436633Z 0 [System] [MY-010116] [Server] /opt/bitnami/mysql/bin/mysqld.bin (mysqld 8.0.22) starting as process 3914
2021-04-04T13:11:27.446171Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started.
2021-04-04T13:11:27.803425Z 1 [Warning] [MY-012638] [InnoDB] Retry attempts for writing partial data failed.
2021-04-04T13:11:27.803574Z 1 [ERROR] [MY-012639] [InnoDB] Write to file ./ibitnami@ip-172-31-44-132:/$

how can I fix this? ahhh help me out

You have ran out of space in EC2 and SQL cannot start. Clear some files or increase the storage capacity. Then restart all the services or the complete EC2 instance.

Hi @allenclein,

As @dmasdtec mentioned, you ran out of disk space. You will need to increase it to be able to start MySQL server again

2021-04-04T12:58:01.418150Z 1 [ERROR] [MY-012639] [InnoDB] Write to file ./ibtmp1 failed at offset 11534336, 1048576 bytes should have been written, only 634880 were written. Operating system error number 28. Check that your OS and file system support files of this size. Check also that the disk is not full or a disk quota exceeded.
2021-04-04T13:05:20.965638Z 1 [ERROR] [MY-012640] [InnoDB] Error number 28 means 'No space left on device'

Please find below our guide for resizing your EBS disk

https://docs.bitnami.com/aws/how-to/modify-ebs-volume/

After resize the volume and now works fine, thanks.

Hi @allenclein,

Thanks for the info. I’m glad you fixed your issue! We will close this thread as solved. Please do not hesitate to open a new one with any other questions you may have.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.