3.5.6 Spark Master at spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077

  • URL: spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077
  • Alive Workers: 8
  • Cores in use: 16 Total, 16 Used
  • Memory in use: 32.0 GiB Total, 24.0 GiB Used
  • Resources in use:
  • Applications: 2 Running, 6 Completed
  • Drivers: 0 Running, 0 Completed
  • Status: ALIVE

Workers (10)

Worker IdAddressStateCoresMemoryResources
worker-20251208101226-192.168.46.134-36197 192.168.46.134:36197 ALIVE 2 (2 Used) 4.0 GiB (3.0 GiB Used)
worker-20251208215947-192.168.16.80-34325 192.168.16.80:34325 ALIVE 2 (2 Used) 4.0 GiB (3.0 GiB Used)
worker-20251209041523-192.168.60.67-45289 192.168.60.67:45289 ALIVE 2 (2 Used) 4.0 GiB (3.0 GiB Used)
worker-20251209111643-192.168.173.208-44027 192.168.173.208:44027 DEAD 2 (2 Used) 4.0 GiB (3.0 GiB Used)
worker-20251209111834-192.168.89.133-34849 192.168.89.133:34849 DEAD 2 (2 Used) 4.0 GiB (3.0 GiB Used)
worker-20251209111956-192.168.128.231-43137 192.168.128.231:43137 ALIVE 2 (2 Used) 4.0 GiB (3.0 GiB Used)
worker-20251209112227-192.168.65.1-43005 192.168.65.1:43005 ALIVE 2 (2 Used) 4.0 GiB (3.0 GiB Used)
worker-20251209112402-192.168.112.197-33603 192.168.112.197:33603 ALIVE 2 (2 Used) 4.0 GiB (3.0 GiB Used)
worker-20251209112458-192.168.109.213-39575 192.168.109.213:39575 ALIVE 2 (2 Used) 4.0 GiB (3.0 GiB Used)
worker-20251209112540-192.168.112.201-39725 192.168.112.201:39725 ALIVE 2 (2 Used) 4.0 GiB (3.0 GiB Used)

Running Applications (2)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration
app-20251209112438-0007
(kill)
DataLakeHouseTransfer 0 3.0 GiB 2025/12/09 11:24:38 spark WAITING 10 min
app-20251209111722-0006
(kill)
ProjectSubmissionMediaDetailsIngestion 16 3.0 GiB 2025/12/09 11:17:22 spark RUNNING 17 min

Completed Applications (6)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration
app-20251209111449-0005 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 11:14:49 spark FINISHED 1.8 min
app-20251209110447-0004 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 11:04:47 spark FINISHED 2.1 min
app-20251209110345-0003 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 11:03:45 spark FINISHED 2.3 min
app-20251209110343-0002 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 11:03:43 spark FINISHED 1.8 min
app-20251209110249-0001 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 11:02:49 spark FINISHED 2.0 min
app-20251209110249-0000 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 11:02:49 spark FINISHED 1.6 min