Assessment jobs are primarily used to monitor and track the execution status of profiling and data quality rules. When either the Profile Datasets or Run Data Quality Scores toggle is activated, whether during the creation of a new connection or when a custom rule is run from the rules page, the system generates profiling statistics and data quality scores for the relevant data connections. The execution status of these processes can be tracked within assessment jobs.
Assessment jobs provide real-time visibility into the progress and outcomes of profiling and data quality rule evaluations, enabling you to quickly identify issues or anomalies in the data. Efficient management of these jobs helps maintain data integrity and ensures that users can make informed decisions based on up-to-date assessment results.
View assessment jobs
- Click Quality from the main navigation menu and navigate to Jobs.
- Select Assessments. The Assessments tab displays the
following details associated with the jobs.
- Job type: Displays the ongoing job as an assessment job. A scheduler icon indicates if the job is scheduled or not.
- Datasource: Displays the datasource associated with the job.
- Connection: Displays the name of the connection associated with the job.
- Started: Indicates when the job was started.
- Duration: Indicates the total duration taken for job completion.
- Status: Indicates the status of job
completion.
- Complete: Indicates that the assessment job was successfully completed.
- Failed: Indicates that the job processing failed due to an underlying cause.
- In Progress: Indicates that the job execution is in progress.
- Stopping: Signifies that the process to halt the job has commenced and it is currently in progress.
- Stopped: Denotes that the job execution has been halted.
- For default rules, the job name is fetched from the associated connection and datasource details.
Naming convention for jobs:
<Datasourcename_Connectionname_Assessment> - For custom rules, the job name is fetched from the associated rule name.
Naming convention for jobs:
<Rulename_assessment> - For those jobs that are triggered via developer portal, the job name is displayed in the below format.
Naming convention for jobs:
<Custom_Assessment_CorelationID>
View details of assessment jobs
- On the assessment jobs page, select the appropriate job.
- The assessment page displays the following details:
- Job Type: Type of job, which may be profiling jobs or rule execution jobs or the jobs associated with the respective observer rule.
- Started: Indicates the timestamp when the job processing was started.
- Duration: Indicates the total duration of the job run.
- Status: Indicates the status of job run.
- Complete: Indicates that the job processing was successful.
- Failed: Indicates that the job processing failed due to underlying reasons.
- In Progress: Indicates that the job execution is in progress.
- Stopping: Signifies that the process to halt the job has commenced and it is currently in progress.
- Stopped: Denotes that the job execution has been halted.
- Dataset path: Indicates the path of the dataset associated with the assessment job.
- Click the ellipsis next to the associated assessment job type.
- Select View information.
- This opens the assessment details which displays the details associated with the job.