Prerequisite
Appropriate permission:nx1_ingest, nx1_monitor, nx1_s3_admin, airflow_user, superset_user,
spark_sql, and trino_admin
Add the public URL to the portal
- Log in to NexusOne.
- On the NexusOne homepage, navigate to Ingest > File.
- In the File Details section, click Public File URL.
- In the File URL field, enter the following URL to a CSV file:
There are no file options to customize the CSV file when you ingest a file using a public URL.
Add ingest details
Add the following information to the fields:- Name:
csv_url - Schema:
csv_url_schema - Table:
csv_url_table - Schedule:
None - Mode:
append - Tags: Don’t add any tags
None specifies that the DAG on Apache Airflow won’t run.
After adding these details, click Ingest. Wait for a few minutes until you see a success message appear.
Monitor and trigger job
- When you ingest the file, this creates an Airflow job, so a success message with a View Jobs button appears.
- Track the job status by clicking View Jobs or navigate to the NexusOne homepage and click Monitor.
- You should see your job name,
csv, in the list, and its current status. Use the three dots...menu to trigger the job. - If you clicked Trigger job, then click the job’s name to open its DAG details in Airflow’s portal.
Visualize your dataset
Use the following steps to visualize your dataset:- On the NexusOne homepage, click Discover to launch Superset.
- Hover your mouse over SQL and select SQL Lab.
- Enter the following command in the query box:
Visualize your dataset
Additional resources
- To get an overview of what file ingestion is, refer to Data ingestion overview.
- For general instructions about how to ingest a file in NexusOne, refer to How to ingest a file.
- For more information about roles or permissions, refer to Govern Overview.