skit_pipelines.pipelines.eval_asr_pipeline package

Module contents

eval_asr_pipeline(*, s3_path_data: str, org_id: str, notify: str = '', channel: str = '', true_label_column: str = 'transcript_y', pred_label_column: str = 'utterances', slack_thread: str = '')[source]

Evaluates ASR transcriptions using transcription tags.

Example payload to invoke this pipeline via slack integrations:

@charon run eval_asr_pipeline

{
    "s3_path_data": "s3://bucket-name/data/",
    "org_id": "org"
}
Parameters

  • s3_path_data (str) – S3 path to a tagged dataset (.csv).

  • org_id (str) – reference path to save the metrics.

  • channel (str, optional) – The slack channel to send the notification, defaults to “”

  • slack_thread (str, optional) – The slack thread to send the notification, defaults to “”