🧱 Workflows & Jobs
Databricks Jobs, Tasks, Dependencies va monitoring
⚙️ Databricks Jobs
Job — bir yoki bir nechta task lardan iborat workflow. Trigger: Manual, Scheduled (cron), File arrival, Continuous. Task types: Notebook, Python script, Spark submit, SQL, DLT pipeline, dbt.
🔗 Task Dependencies
Task lar orasida dependency chain: Directed Acyclic Graph (DAG). Task muvaffaqiyatli tugagach keyingi task boshlanadi. On success, On failure, On completion trigger. Task values — tasklar orasida ma'lumot uzatish (`dbutils.jobs.taskValues`).
📊 Job Monitoring
Job Run history, logs, duration. Email notifications: success, failure, timeout. Webhook notifications: Slack, PagerDuty. Job Repair — muvaffaqiyatsiz task ni qayta ishga tushirish (boshidan emas). Retry policy.
💡 Asosiy nuqtalar
- Job = Task DAG, Trigger: cron/manual/file
- Job Cluster — har bir job uchun yangi cluster (tejamkor)
- Task Values: tasklar orasida parametr uzatish
- Job Repair: faqat muvaffaqiyatsiz task dan davom etish
- Email/Webhook: job status notification
🎯 Imtihon maslahatlari
- Trigger turi: Scheduled (cron) = vaqt bo'yicha, File Arrival = yangi fayl kelganda, Continuous = streaming job
- Task types: Notebook, Python Script, DLT Pipeline, dbt, SQL — exam da turli scenario uchun to'g'ri task type tanish
- Job Repair — muvaffaqiyatsiz task FAQAT restart: oldingi muvaffaqiyatli tasklar qayta ishlamaydi
- `dbutils.jobs.taskValues.get("taskName", "key")` — boshqa task dan qiymat olish
- Retry policy — task muvaffaqiyatsiz bo'lganda avtomatik qayta urinish (max attempts, delay)
⚠️ Ko'p adashadigan
- Job Cluster = All-Purpose Cluster deb o'ylash — Job Cluster har run uchun yangi, All-Purpose doim ishlaydi
- Job Repair boshidan qayta ishlatadi deb o'ylash — Repair faqat FAILED task dan davom etadi
- Task dependency yo'q bo'lganda parallel ishlashini bilmaslik — independent tasklar parallel bajariladi
🧠 Eslab qolish: "Jobs = DAG of Tasks": D (Dependencies), A (Actions/types), G (Graph order). "REPAIR = Resume from failure, not Restart from zero"
Workflows & Jobs bo'yicha o'zingizni sinab ko'ring
Bepul interaktiv quiz, mock imtihon va to'liq darslar — CertMaster platformasida.
Bepul boshlash →