3.5.6
Spark Master at spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077
| Worker Id | Address | State | Cores | Memory | Resources |
|---|---|---|---|---|---|
| worker-20251216170633-192.168.26.130-38531 | 192.168.26.130:38531 | ALIVE | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251217001246-192.168.74.61-40055 | 192.168.74.61:40055 | ALIVE | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251217020439-192.168.58.201-42211 | 192.168.58.201:42211 | ALIVE | 2 (0 Used) | 4.0 GiB (0.0 B Used) |
| Application ID | Name | Cores | Memory per Executor | Resources Per Executor | Submitted Time | User | State | Duration |
|---|
| Application ID | Name | Cores | Memory per Executor | Resources Per Executor | Submitted Time | User | State | Duration |
|---|---|---|---|---|---|---|---|---|
| app-20251217113600-0007 | DataLakeHouseTransfer | 30 | 3.0 GiB | 2025/12/17 11:36:00 | spark | FINISHED | 8.0 min | |
| app-20251217111835-0006 | ProjectSubmissionMediaDetailsIngestion | 26 | 3.0 GiB | 2025/12/17 11:18:35 | spark | FINISHED | 21 min | |
| app-20251217111534-0005 | DataLakeHouseTransfer | 10 | 3.0 GiB | 2025/12/17 11:15:34 | spark | FINISHED | 2.4 min | |
| app-20251217110315-0004 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/17 11:03:15 | spark | FINISHED | 3.7 min | |
| app-20251217110259-0003 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/17 11:02:59 | spark | FINISHED | 3.2 min | |
| app-20251217110258-0002 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/17 11:02:58 | spark | FINISHED | 2.5 min | |
| app-20251217110257-0001 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/17 11:02:57 | spark | FINISHED | 2.0 min | |
| app-20251217110257-0000 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/17 11:02:57 | spark | FINISHED | 1.7 min |