Apache Airflow Multi-Tier (Bitnami) enables to connect to On-Prem worker nodes and enable communication thru TLS?

Sritera 2020-01-31 16:19:03 UTC #1

Keywords: Apache Airflow - Microsoft Azure - How to - Secure Connections (SSL/HTTPS)
Description:
Does Apache Airflow Multi-Tier (Bitnami) enables to connect to On-Prem worker nodes and enable communication thru TLS ?
we have a requirement to communicate between cloud and on-prem via secure connection ports (TLS - 443/ HTTPS) only

tomasp 2020-02-03 10:11:35 UTC #2

Hi @Sritera,

I am afraid to tell you that SSL communication with Celery Workers is not supported currently.

Sritera 2020-02-03 15:02:09 UTC #3

Hi,
Thanks for the feedback, but just to confirm.
Current version of AirFlow Multi-Tier (Bitnami) do not support SSL/TLS communication within Azure environment or Bitnami instance of AirFlow form Azure do not support On-Prem environment worker images?

Any alternate method to enable in my scenario?

Thx

tomasp 2020-02-04 10:54:48 UTC #4

Hi @Sritera

The only communication within Azure that goes through SSL/TLS is the database connection with Postgresql Azure service.

No, adding On-Prem environment worker images is not supported. Although, in theory, it should be possible to connect any worker image manually. For that, you would need to start a new worker image and configure it with the Redis connection parameters from the Bitnami deployment. Once the worker is registered in the Redis broker, it should be listed in the Airflow UI.

system 2020-02-18 10:55:08 UTC #5

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Bitnami provides free all-in-one installers, virtual machines and cloud images for popular open source applications. Get them now!