3.5.6
Spark Master at spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077
| Worker Id | Address | State | Cores | Memory | Resources |
|---|---|---|---|---|---|
| worker-20251210021059-192.168.41.207-43125 | 192.168.41.207:43125 | ALIVE | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251210040540-192.168.91.243-34157 | 192.168.91.243:34157 | ALIVE | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251210213324-192.168.176.99-33465 | 192.168.176.99:33465 | ALIVE | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251211081230-192.168.214.133-39193 | 192.168.214.133:39193 | DEAD | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251211081810-192.168.99.67-34939 | 192.168.99.67:34939 | DEAD | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251211081907-192.168.81.201-41553 | 192.168.81.201:41553 | DEAD | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251211082032-192.168.99.72-35315 | 192.168.99.72:35315 | DEAD | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251211082114-192.168.81.207-38489 | 192.168.81.207:38489 | DEAD | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251211082155-192.168.214.136-42041 | 192.168.214.136:42041 | DEAD | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251211082827-192.168.214.138-32795 | 192.168.214.138:32795 | DEAD | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251211084258-192.168.219.26-45673 | 192.168.219.26:45673 | DEAD | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251211084300-192.168.219.27-37511 | 192.168.219.27:37511 | DEAD | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251211084339-192.168.81.214-39623 | 192.168.81.214:39623 | DEAD | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251211084617-192.168.232.130-33621 | 192.168.232.130:33621 | DEAD | 2 (0 Used) | 4.0 GiB (0.0 B Used) | |
| worker-20251211084755-192.168.23.194-38375 | 192.168.23.194:38375 | DEAD | 2 (0 Used) | 4.0 GiB (0.0 B Used) |
| Application ID | Name | Cores | Memory per Executor | Resources Per Executor | Submitted Time | User | State | Duration |
|---|
| Application ID | Name | Cores | Memory per Executor | Resources Per Executor | Submitted Time | User | State | Duration |
|---|---|---|---|---|---|---|---|---|
| app-20251211082850-0015 | DataLakeHouseTransfer | 28 | 3.0 GiB | 2025/12/11 08:28:50 | spark | FINISHED | 18 min | |
| app-20251211081920-0014 | ProjectSubmissionMediaDetailsIngestion | 22 | 3.0 GiB | 2025/12/11 08:19:20 | spark | FINISHED | 21 min | |
| app-20251211081542-0013 | DataLakeHouseTransfer | 10 | 3.0 GiB | 2025/12/11 08:15:42 | spark | FINISHED | 2.1 min | |
| app-20251211080329-0012 | DataLakeHouseTransfer | 12 | 3.0 GiB | 2025/12/11 08:03:29 | spark | FINISHED | 3.3 min | |
| app-20251211080320-0011 | DataLakeHouseTransfer | 10 | 3.0 GiB | 2025/12/11 08:03:20 | spark | FINISHED | 2.8 min | |
| app-20251211080255-0010 | DataLakeHouseTransfer | 8 | 3.0 GiB | 2025/12/11 08:02:55 | spark | FINISHED | 2.7 min | |
| app-20251211080255-0009 | DataLakeHouseTransfer | 8 | 3.0 GiB | 2025/12/11 08:02:55 | spark | FINISHED | 2.3 min | |
| app-20251211080254-0008 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/11 08:02:54 | spark | FINISHED | 47 s | |
| app-20251211052924-0007 | DataLakeHouseTransfer | 26 | 3.0 GiB | 2025/12/11 05:29:24 | spark | FINISHED | 13 min | |
| app-20251211051753-0006 | ProjectSubmissionMediaDetailsIngestion | 22 | 3.0 GiB | 2025/12/11 05:17:53 | spark | FINISHED | 21 min | |
| app-20251211051536-0005 | DataLakeHouseTransfer | 10 | 3.0 GiB | 2025/12/11 05:15:36 | spark | FINISHED | 1.7 min | |
| app-20251211050510-0004 | DataLakeHouseTransfer | 10 | 3.0 GiB | 2025/12/11 05:05:10 | spark | FINISHED | 2.0 min | |
| app-20251211050259-0003 | DataLakeHouseTransfer | 8 | 3.0 GiB | 2025/12/11 05:02:59 | spark | FINISHED | 3.2 min | |
| app-20251211050258-0002 | DataLakeHouseTransfer | 8 | 3.0 GiB | 2025/12/11 05:02:58 | spark | FINISHED | 2.8 min | |
| app-20251211050250-0001 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/11 05:02:50 | spark | FINISHED | 2.3 min | |
| app-20251211050249-0000 | DataLakeHouseTransfer | 6 | 3.0 GiB | 2025/12/11 05:02:49 | spark | FINISHED | 1.6 min |