Cannot run gcloud commands from shell with new jenkins installation

audiomute 2020-05-10 08:12:57 UTC #1

Keywords: Jenkins - Google Cloud Platform - Technical issue - Permissions
bnsupport ID: 46d0a060-f18d-f59b-c7cc-b74bba92079d
Description:
Created a new Jenkins instance (ver 2.222.3) from GCP Marketplace

Created a new jenkins freestyle project and added an 'execute shell' build step with the command 'gcloud version'

When the build ran I get the following error :

Started by user user
Running as SYSTEM
Building in workspace /opt/bitnami/jenkins/jenkins_home/workspace/asdf
[asdf] $ /bin/sh -xe /tmp/jenkins1781898745875720813.sh
+ gcloud version
ERROR: gcloud failed to load: Active configuration name could not be read from: [/root/.config/gcloud/active_config]. Ensure you have sufficient read permissions on required active configuration in [/root/.config/gcloud/configurations].
  Unable to read file [/root/.config/gcloud/active_config]: [Errno 13] Permission denied: '/root/.config/gcloud/active_config'
    gcloud_main = _import_gcloud_main()
    import googlecloudsdk.gcloud_main
    from googlecloudsdk.api_lib.iamcredentials import util as iamcred_util
    from googlecloudsdk.api_lib.util import exceptions
    from googlecloudsdk.core import log
    _log_manager = _LogManager()
    self.Reset(sys.stdout, sys.stderr)
    std_console_formatter = _ConsoleFormatter(stderr)
    use_color = not properties.VALUES.core.disable_color.GetBool(validate=False)
    named_configs.ActivePropertiesFile.Load(),
    force_create=False).file_path])
    config_name = _EffectiveActiveConfigName()
    config_name = _ActiveConfigNameFromFile()
    .format(path, config.Paths().named_config_directory), exc)
  Unable to read file [/root/.config/gcloud/active_config]: [Errno 13] Permission denied: '/root/.config/gcloud/active_config'

This usually indicates corruption in your gcloud installation or problems with your Python interpreter.

Please verify that the following is the path to a working Python 2.7 or 3.5+ executable:
    /usr/bin/python2

If it is not, please set the CLOUDSDK_PYTHON environment variable to point to a working Python 2.7 or 3.5+ executable.

If you are still experiencing problems, please reinstall the Cloud SDK using the instructions here:
    https://cloud.google.com/sdk/
Build step 'Execute shell' marked build as failure
Finished: FAILURE

Thoughts..?

audiomute 2020-05-10 08:53:57 UTC #2

this used to work on 2.204.2 where the jobs ran as tomcat - now they run as jenkins..?

jota 2020-05-12 06:50:18 UTC #3

Hi @audiomute,

There is something weird in the command's output

This should have also happened in the previous version if the command was run with the tomcat user. That user doesn't have permissions to read that file either.

Can you try to run the command with different users in the command line and share the output with us?

gcloud version
sudo su bitnami -c "gcloud version"
sudo su jenkins -c "gcloud version"

Thanks

audiomute 2020-05-13 20:30:50 UTC #4

+ gcloud version
ERROR: gcloud failed to load: Active configuration name could not be read from: [/root/.config/gcloud/active_config]. Ensure you have sufficient read permissions on required active configuration in [/root/.config/gcloud/configurations].
  Unable to read file [/root/.config/gcloud/active_config]: [Errno 13] Permission denied: '/root/.config/gcloud/active_config'
    gcloud_main = _import_gcloud_main()
    import googlecloudsdk.gcloud_main
    from googlecloudsdk.api_lib.iamcredentials import util as iamcred_util
    from googlecloudsdk.api_lib.util import exceptions
    from googlecloudsdk.core import log
    _log_manager = _LogManager()
    self.Reset(sys.stdout, sys.stderr)
    std_console_formatter = _ConsoleFormatter(stderr)
    use_color = not properties.VALUES.core.disable_color.GetBool(validate=False)
    named_configs.ActivePropertiesFile.Load(),
    force_create=False).file_path])
    config_name = _EffectiveActiveConfigName()
    config_name = _ActiveConfigNameFromFile()
    .format(path, config.Paths().named_config_directory), exc)
  Unable to read file [/root/.config/gcloud/active_config]: [Errno 13] Permission denied: '/root/.config/gcloud/active_config'

This usually indicates corruption in your gcloud installation or problems with your Python interpreter.

Please verify that the following is the path to a working Python 2.7 or 3.5+ executable:
    /usr/bin/python2

If it is not, please set the CLOUDSDK_PYTHON environment variable to point to a working Python 2.7 or 3.5+ executable.

If you are still experiencing problems, please reinstall the Cloud SDK using the instructions here:
    https://cloud.google.com/sdk/
Build step 'Execute shell' marked build as failure
Finished: FAILURE

+ sudo su bitnami -c gcloud version
Google Cloud SDK 290.0.0
alpha 2020.04.21
beta 2020.04.21
bq 2.0.56
core 2020.04.21
gsutil 4.49
kubectl 2020.04.21

+ sudo su jenkins -c gcloud version
Google Cloud SDK 290.0.0
alpha 2020.04.21
beta 2020.04.21
bq 2.0.56
core 2020.04.21
gsutil 4.49
kubectl 2020.04.21
Finished: SUCCESS

Hi Jota, ran the three commands individually bitnami and jenkins worked, default didn't...

audiomute 2020-05-13 20:33:16 UTC #5

@jota see above...

thanks

abjimenez 2020-05-15 14:11:31 UTC #6

Hi @audiomute,

The problem is that spawned Jenkins process is running as jenkins user but the environment variable HOME is inherited from the parent process and is HOME=/root. This is causing glcoud to throw permissions problems. You can solve them by executing the command with sudo su jenkins -c "gcloud version" or changing the config path:

export CLOUDSDK_CONFIG=$JENKINS_HOME
gcloud version

We will evaluate if we can do some usability improvements in future versions of the Bitnami Jenkins Stack.

Best regards,
Andrés Bono.

system 2020-05-29 14:11:36 UTC #7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

abjimenez 2020-07-10 06:08:29 UTC #8

Hi @audiomute,

Just to let you know that the next release of the Jenkins Stack will include a fix for this issue.

Best regards,
Andrés Bono.

Bitnami provides free all-in-one installers, virtual machines and cloud images for popular open source applications. Get them now!