Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.nx1cloud.com/llms.txt

Use this file to discover all available pages before exploring further.

The App Manager provides a management layer for organizing data pipeline assets into versioned app units. You would use this feature when you are building and maintaining data pipelines that require assets that need to evolve over time In this feature, an app comprises the following:
  • Components: Files belonging to an app. It’s used to define or support pipeline execution, and comprises the following:
    • DAGs: Apache Airflow DAG files
    • Artifacts: Files such as .csv, .jar, .py, or other file formats
  • Roles: Who can manage an app
  • Secrets: Sensitive values passed to a component
Together, these previously described items define how NexusOne packages and secures pipeline assets within an app.

Key features

App Manager has the following key features:
  • Access control: Define roles for who can view and modify apps.
  • Asset organization: Group DAGs and artifact files into a single app unit.
  • Secure configuration: Store and inject secrets into pipeline components.
  • Versioned apps: Track and manage changes to pipeline assets over time.

Default artifact and DAG locations

You can access the DAGs and artifacts in Jupyter Notebook. However, they’re stored in unique directories depending on the app version.
  • For an active app version, you can find the components in the following paths:
    • Artifacts: <bucket_name>/deps/<app_name>/current/
    • DAGs: <bucket_name>/deps/<app_name>/current/dags/
  • For all versions of an app, including the active version, you can find the components in the following paths:
    • Artifacts: <bucket_name>/deps/<app_name>/<version_name>/
    • DAGs: <bucket_name>/deps/<app_name>/<version_name>/dags/

Use cases

These examples show how different industries can use NexusOne’s App Manager:
  • Financial services: Version and manage assets in a trading or reporting pipeline to ensure that changes to DAGs and artifacts evolve.
  • Healthcare: Manage clinical pipeline assets as versioned apps that are explicitly promoted to production when you make updates to the assets.

Additional resources

To see all the open source software tools that make up the components of the NexusOne platform, refer to Platform components.