Skip to main content
PUT
Update infrastructure configuration variables

Authorizations

Authorization
string
header
required

The access token received from the authorization server in the OAuth 2.0 flow.

Body

application/json

Partial-update request for Airflow infrastructure variables.

cluster_ssh_conn_id
string | null
cluster_edge_temp_path
string | null
cluster_edge_discovery_temp_path
string | null

Edge node scratch directory for the table discovery step. DAG 1 creates {path}/discovery_{run_id}_{src_db}_{dest_db}_{bucket_slug} under it. Give a literal path: the value is written into a Python script over SFTP, which expands neither shell variables nor a leading ~. Airflow variable cluster_edge_discovery_temp_path, environment fallback CLUSTER_EDGE_DISCOVERY_TEMP_PATH, default /tmp.

cluster_hive_scratch_dir
string | null

Hive scratch directory for edge node PySpark sessions. DAG 1 injects it as spark.hadoop.hive.exec.scratchdir and spark.hadoop.hive.exec.local.scratchdir into every session it starts, including the generated discover_tables.py. Give each tenant its own path: a shared /tmp/hive causes permission collisions between tenants on the same edge node. Give a literal path, with no $, no {, and no leading ~. Airflow variable cluster_hive_scratch_dir, environment fallback CLUSTER_HIVE_SCRATCH_DIR, default /tmp/hive.

cluster_distcp_log_root
string | null

Root directory for DistCp -log output. This is a root, not a full path: DAG 1 appends the migration user and run, giving {root}/{migration_user}/distcp_logs/{run_id}, and creates that directory on the cluster filesystem with hadoop fs -mkdir -p and chmod 700, not on the edge node. The {migration_user} segment comes from whatever service_account_user_id resolves to. Give a literal path. Airflow variable cluster_distcp_log_root, environment fallback CLUSTER_DISTCP_LOG_ROOT, default /tmp.

migration_spark_conn_id
string | null
migration_smtp_conn_id
string | null
s3_endpoint
string | null
s3_access_key
string | null
s3_secret_key
string | null
default_s3_bucket
string | null
tracking_database
string | null
tracking_location
string | null
report_output_location
string | null
email_recipients
string | null
distcp_mappers
integer | null
distcp_bandwidth
integer | null
service_account_user_id
string | null
mapr_ticketfile_location
string | null
tenant_profiles
TenantProfile · object[] | null

Response

Successful Response

Infrastructure configuration response. Write-only fields are always None.

cluster_ssh_conn_id
string | null
cluster_edge_temp_path
string | null
cluster_edge_discovery_temp_path
string | null

Edge node scratch directory for the table discovery step. DAG 1 creates {path}/discovery_{run_id}_{src_db}_{dest_db}_{bucket_slug} under it. Give a literal path: the value is written into a Python script over SFTP, which expands neither shell variables nor a leading ~. Airflow variable cluster_edge_discovery_temp_path, environment fallback CLUSTER_EDGE_DISCOVERY_TEMP_PATH, default /tmp.

cluster_hive_scratch_dir
string | null

Hive scratch directory for edge node PySpark sessions. DAG 1 injects it as spark.hadoop.hive.exec.scratchdir and spark.hadoop.hive.exec.local.scratchdir into every session it starts, including the generated discover_tables.py. Give each tenant its own path: a shared /tmp/hive causes permission collisions between tenants on the same edge node. Give a literal path, with no $, no {, and no leading ~. Airflow variable cluster_hive_scratch_dir, environment fallback CLUSTER_HIVE_SCRATCH_DIR, default /tmp/hive.

cluster_distcp_log_root
string | null

Root directory for DistCp -log output. This is a root, not a full path: DAG 1 appends the migration user and run, giving {root}/{migration_user}/distcp_logs/{run_id}, and creates that directory on the cluster filesystem with hadoop fs -mkdir -p and chmod 700, not on the edge node. The {migration_user} segment comes from whatever service_account_user_id resolves to. Give a literal path. Airflow variable cluster_distcp_log_root, environment fallback CLUSTER_DISTCP_LOG_ROOT, default /tmp.

migration_spark_conn_id
string | null
migration_smtp_conn_id
string | null
s3_endpoint
string | null
s3_access_key_set
boolean
default:false
s3_secret_key_set
boolean
default:false
default_s3_bucket
string | null
tracking_database
string | null
tracking_location
string | null
report_output_location
string | null
email_recipients
string | null
distcp_mappers
integer | null
distcp_bandwidth
integer | null
service_account_user_id
string | null
mapr_ticketfile_location
string | null
tenant_profiles
TenantProfile · object[] | null