Creating and managing jobs in a project

Creating jobs from the Assets page

Copy link to section

You can create a job to run an asset from the project's Assets page.

Required permissions

You must have an Editor or Admin role in the project.

To create jobs for a listed asset from the Assets page of a project:

1. Select the asset from the section for your asset type and choose New job from the menu icon with the lists of options () at the end of the table row.

2. Define the job details by entering a name and a description (optional).

3. If you can select Setting, specify the settings that you want for the job.

4. If you can select Configure, choose an environment runtime for the job. Depending on the asset type, you can optionally configure more settings, for example environment variables or script arguments.

   To avoid accumulating too many finished job runs and job run artifacts, set how long to retain finished job runs and job run artifacts like logs or notebook results. You can either select the number of days to retain the job runs or the last number of job runs to keep.

5. On the Schedule page, you can optionally add a one-time or repeating schedule.

   If you define a start day and time without selecting Repeat, the job will run exactly one time at the specified day and time. If you select Repeat, the job will run at the timestamp indicated in the Repeat section between the start and end dates of the schedule.

   You can't change the time zone; the schedule uses your web browser's time zone setting. If you exclude certain weekdays, the job might not run as you would expect. The reason might be due to a discrepancy between the time zone of the user who creates the schedule, and the time zone of the compute node where the job runs.
   
   An API key is generated when you create a scheduled job, and future runs will use this API key. If you didn't create a scheduled job but choose to modify one, an API key is generated for you when you modify the job and future runs will use this API key.

6. Optionally set to see notifications for the job. You can select the type of alerts to receive.

7. Review the job settings. Then, create the job and run it immediately, or create the job and run it later.

Managing jobs

Copy link to section

You can view all of the jobs that exist for your project from the project's Jobs page. With Admin or Editor role for the project, you can view and edit the job details. You can run jobs manually and you can delete jobs. With Viewer role for the project, you can only view the job details. You can't run or delete jobs with Viewer role.

To view the details of a specific job, click the job. From the job's details page, you can:

• View the runs for that job and the status of each run. If a run failed, you can select the run and view the log tail or download the entire log file to help you troubleshoot the run. A failed run might be related to a temporary connection or environment problem. Try running the job again. If the job still fails, you can send the log to Customer Support.
• Edit job settings by clicking Edit job, for example to change schedule settings or to pick another environment template.
• Run the job manually by clicking from the job's action bar. You can start a scheduled job based on the schedule and on demand.
• Delete the job by clicking from the job's action bar.

Learn more

Copy link to section

• Creating jobs in Data Refinery
• Creating jobs in the Notebook editor or Notebook viewer
• Creating jobs for Pipelines

Parent topic: Working in projects