AI workflows

MK.IO supports AI workflows for On-Demand video processing.

We handle the work of segmenting video, extracting relevant data, sending the data to AIs, normalizing responses, and then doing something with your generated content. Examples of "something" include embedding generated content into TTML closed captions and secondary-to-denary audio tracks, generating in-band SCTE-35 signals containing generative metadata, transferring descriptive blobs into storage, stashing JSON into the MK.IO data lake.

Right now it seems like the whole world is exploring what is possible with AI — our aim is to make that exploration fast and easy for our customers (you), and to facilitate the rapid rollout of your most successful AI-augmented workflows to your customers.

Whether your workload is live or on-demand, you define and execute your AI workloads the same. So you can focus on building products instead of focusing on building data processing pipelines.

📘

MK.IO uses a third-party AI tool, specifically Azure AI Speech, from Azure AI Services.

Key concepts: Pipelines and Models

An AI Pipeline is a collection of operations that will be performed against your content. Your operations define which Model to execute, the destination outputs for your generated content, and any arguments required by the pipeline (for example, language, helper phrases).

Models provide a menu of the supported operations in MK.IO. They describe the supported input and output formats, and any arguments that may be provided (including where the argument can be modified).

Running an AI workflow

To execute an AI workflow, you just have to attach an AI pipeline to a VOD Transform and run a Job. See Configure transformations.

Supported languages

The table below summarizes the locales available in the AI model for transcription.

LanguageLocale (BCP-47)
Afrikaans (South Africa)af-ZA
Amharic (Ethiopia)am-ET
Arabic (United Arab Emirates)ar-AE
Arabic (Bahrain)ar-BH
Arabic (Algeria)ar-DZ
Arabic (Egypt)ar-EG
Arabic (Israel)ar-IL
Arabic (Iraq)ar-IQ
Arabic (Jordan)ar-JO
Arabic (Kuwait)ar-KW
Arabic (Lebanon)ar-LB
Arabic (Libya)ar-LY
Arabic (Morocco)ar-MA
Arabic (Oman)ar-OM
Arabic (Palestinian Authority)ar-PS
Arabic (Qatar)ar-QA
Arabic (Saudi Arabia)ar-SA
Arabic (Syria)ar-SY
Arabic (Tunisia)ar-TN
Arabic (Yemen)ar-YE
Azerbaijani (Latin, Azerbaijan)az-AZ
Bulgarian (Bulgaria)bg-BG
Bengali (India)bn-IN
Bosnian (Bosnia and Herzegovina)bs-BA
Catalanca-ES
Czech (Czechia)cs-CZ
Welsh (United Kingdom)cy-GB
Danish (Denmark)da-DK
German (Austria)de-AT
German (Switzerland)de-CH
German (Germany)de-DE
Greek (Greece)el-GR
English (Australia)en-AU
English (Canada)en-CA
English (United Kingdom)en-GB
English (Ghana)en-GH
English (Hong Kong SAR)en-HK
English (Ireland)en-IE
English (India)en-IN
English (Kenya)en-KE
English (Nigeria)en-NG
English (New Zealand)en-NZ
English (Philippines)en-PH
English (Singapore)en-SG
English (Tanzania)en-TZ
English (United States)en-US
English (South Africa)en-ZA
Spanish (Argentina)es-AR
Spanish (Bolivia)es-BO
Spanish (Chile)es-CL
Spanish (Colombia)es-CO
Spanish (Costa Rica)es-CR
Spanish (Cuba)es-CU
Spanish (Dominican Republic)es-DO
Spanish (Ecuador)es-EC
Spanish (Spain)es-ES
Spanish (Equatorial Guinea)es-GQ
Spanish (Guatemala)es-GT
Spanish (Honduras)es-HN
Spanish (Mexico)es-MX
Spanish (Nicaragua)es-NI
Spanish (Panama)es-PA
Spanish (Peru)es-PE
Spanish (Puerto Rico)es-PR
Spanish (Paraguay)es-PY
Spanish (El Salvador)es-SV
Spanish (United States)*es-US
Spanish (Uruguay)es-UY
Spanish (Venezuela)es-VE
Estonian (Estonia)et-EE
Basqueeu-ES
Persian (Iran)fa-IR
Finnish (Finland)fi-FI
Filipino (Philippines)fil-PH
French (Belgium)fr-BE
French (Canada)*fr-CA
French (Switzerland)fr-CH
French (France)fr-FR
Irish (Ireland)ga-IE
Galiciangl-ES
Gujarati (India)gu-IN
Hebrew (Israel)he-IL
Hindi (India)hi-IN
Croatian (Croatia)hr-HR
Hungarian (Hungary)hu-HU
Armenian (Armenia)hy-AM
Indonesian (Indonesia)id-ID
Icelandic (Iceland)is-IS
Italian (Switzerland)it-CH
Italian (Italy)it-IT
Japanese (Japan)ja-JP
Javanese (Latin, Indonesia)jv-ID
Georgian (Georgia)ka-GE
Kazakh (Kazakhstan)kk-KZ
Khmer (Cambodia)km-KH
Kannada (India)kn-IN
Korean (Korea)ko-KR
Lao (Laos)lo-LA
Lithuanian (Lithuania)lt-LT
Latvian (Latvia)lv-LV
Macedonian (North Macedonia)mk-MK
Malayalam (India)ml-IN
Mongolian (Mongolia)mn-MN
Marathi (India)mr-IN
Malay (Malaysia)ms-MY
Maltese (Malta)mt-MT
Burmese (Myanmar)my-MM
Norwegian Bokmål (Norway)nb-NO
Nepali (Nepal)ne-NP
Dutch (Belgium)nl-BE
Dutch (Netherlands)nl-NL
Punjabi (India)pa-IN
Polish (Poland)pl-PL
Pashto (Afghanistan)ps-AF
Portuguese (Brazil)pt-BR
Portuguese (Portugal)pt-PT
Romanian (Romania)ro-RO
Russian (Russia)ru-RU
Sinhala (Sri Lanka)si-LK
Slovak (Slovakia)sk-SK
Slovenian (Slovenia)sl-SI
Somali (Somalia)so-SO
Albanian (Albania)sq-AL
Serbian (Cyrillic, Serbia)sr-RS
Swedish (Sweden)sv-SE
Kiswahili (Kenya)sw-KE
Kiswahili (Tanzania)sw-TZ
Tamil (India)ta-IN
Telugu (India)te-IN
Thai (Thailand)th-TH
Turkish (Türkiye)tr-TR
Ukrainian (Ukraine)uk-UA
Urdu (India)ur-IN
Uzbek (Latin, Uzbekistan)uz-UZ
Vietnamese (Vietnam)vi-VN
Chinese (Wu, Simplified)wuu-CN
Chinese (Cantonese, Simplified)yue-CN
Chinese (Mandarin, Simplified)zh-CN
Chinese (Jilu Mandarin, Simplified)zh-CN-shandong
Chinese (Southwestern Mandarin, Simplified)zh-CN-sichuan
Chinese (Cantonese, Traditional)zh-HK
Chinese (Taiwanese Mandarin, Traditional)zh-TW
isiZulu (South Africa)zu-ZA

*The model is bilingual and also supports English.