The App Manager provides a management layer for organizing data pipeline assets into versioned app units. You would use this feature when you are building and maintaining data pipelines that require assets that need to evolve over time In this feature, an app comprises the following:Documentation Index
Fetch the complete documentation index at: https://docs.nx1cloud.com/llms.txt
Use this file to discover all available pages before exploring further.
- Components: Files belonging to an app. It’s used to define or support pipeline execution, and
comprises the following:
- DAGs: Apache Airflow DAG files
- Artifacts: Files such as
.csv,.jar,.py, or other file formats
- Roles: Who can manage an app
- Secrets: Sensitive values passed to a component
Key features
App Manager has the following key features:- Access control: Define roles for who can view and modify apps.
- Asset organization: Group DAGs and artifact files into a single app unit.
- Secure configuration: Store and inject secrets into pipeline components.
- Versioned apps: Track and manage changes to pipeline assets over time.
Default artifact and DAG locations
You can access the DAGs and artifacts in Jupyter Notebook. However, they’re stored in unique directories depending on the app version.-
For an active app version, you can find the
components in the following paths:
- Artifacts:
<bucket_name>/deps/<app_name>/current/ - DAGs:
<bucket_name>/deps/<app_name>/current/dags/
- Artifacts:
-
For all versions of an app, including the active version, you can find the
components in the following paths:
- Artifacts:
<bucket_name>/deps/<app_name>/<version_name>/ - DAGs:
<bucket_name>/deps/<app_name>/<version_name>/dags/
- Artifacts:
Use cases
These examples show how different industries can use NexusOne’s App Manager:- Financial services: Version and manage assets in a trading or reporting pipeline to ensure that changes to DAGs and artifacts evolve.
- Healthcare: Manage clinical pipeline assets as versioned apps that are explicitly promoted to production when you make updates to the assets.