3.5.6
Spark Master at spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077
| Worker Id | Address | State | Cores | Memory | Resources |
|---|---|---|---|---|---|
| worker-20251208215947-192.168.16.80-34325 | 192.168.16.80:34325 | ALIVE | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251209041523-192.168.60.67-45289 | 192.168.60.67:45289 | ALIVE | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251209144214-192.168.32.55-33761 | 192.168.32.55:33761 | ALIVE | 2 (0 Used) | 4.0 GiB (0.0 B Used) |
| Application ID | Name | Cores | Memory per Executor | Resources Per Executor | Submitted Time | User | State | Duration |
|---|
| Application ID | Name | Cores | Memory per Executor | Resources Per Executor | Submitted Time | User | State | Duration |
|---|---|---|---|---|---|---|---|---|
| app-20251209160921-0015 | DataLakeHouseTransfer | 16 | 3.0 GiB | 2025/12/09 16:09:21 | spark | FINISHED | 4.2 min | |
| app-20251209152936-0014 | ProjectSubmissionMediaDetailsIngestion | 14 | 3.0 GiB | 2025/12/09 15:29:36 | spark | FINISHED | 35 min | |
| app-20251209152600-0013 | DataLakeHouseTransfer | 8 | 3.0 GiB | 2025/12/09 15:26:00 | spark | FINISHED | 2.1 min | |
| app-20251209150311-0012 | DataLakeHouseTransfer | 8 | 3.0 GiB | 2025/12/09 15:03:11 | spark | FINISHED | 2.1 min | |
| app-20251209150304-0011 | DataLakeHouseTransfer | 8 | 3.0 GiB | 2025/12/09 15:03:04 | spark | FINISHED | 1.5 min | |
| app-20251209150217-0010 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/09 15:02:17 | spark | FINISHED | 1.7 min | |
| app-20251209150127-0009 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/09 15:01:27 | spark | FINISHED | 1.8 min | |
| app-20251209150115-0008 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/09 15:01:15 | spark | FINISHED | 1.5 min | |
| app-20251209112438-0007 | DataLakeHouseTransfer | 18 | 3.0 GiB | 2025/12/09 11:24:38 | spark | FINISHED | 26 min | |
| app-20251209111722-0006 | ProjectSubmissionMediaDetailsIngestion | 16 | 3.0 GiB | 2025/12/09 11:17:22 | spark | FINISHED | 30 min | |
| app-20251209111449-0005 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/09 11:14:49 | spark | FINISHED | 1.8 min | |
| app-20251209110447-0004 | DataLakeHouseTransfer | 8 | 3.0 GiB | 2025/12/09 11:04:47 | spark | FINISHED | 2.1 min | |
| app-20251209110345-0003 | DataLakeHouseTransfer | 8 | 3.0 GiB | 2025/12/09 11:03:45 | spark | FINISHED | 2.3 min | |
| app-20251209110343-0002 | DataLakeHouseTransfer | 8 | 3.0 GiB | 2025/12/09 11:03:43 | spark | FINISHED | 1.8 min | |
| app-20251209110249-0001 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/09 11:02:49 | spark | FINISHED | 2.0 min | |
| app-20251209110249-0000 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/09 11:02:49 | spark | FINISHED | 1.6 min |