3.5.6 Spark Master at spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077

  • URL: spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077
  • Alive Workers: 15
  • Cores in use: 30 Total, 0 Used
  • Memory in use: 60.0 GiB Total, 0.0 B Used
  • Resources in use:
  • Applications: 0 Running, 79 Completed
  • Drivers: 0 Running, 0 Completed
  • Status: ALIVE

Workers (16)

Worker IdAddressStateCoresMemoryResources
worker-20251208215947-192.168.16.80-34325 192.168.16.80:34325 DEAD 2 (2 Used) 4.0 GiB (3.0 GiB Used)
worker-20251209041523-192.168.60.67-45289 192.168.60.67:45289 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251209144214-192.168.32.55-33761 192.168.32.55:33761 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210001245-192.168.109.212-45477 192.168.109.212:45477 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210003221-192.168.192.221-43975 192.168.192.221:43975 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210003306-192.168.118.200-39529 192.168.118.200:39529 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210003356-192.168.209.222-36607 192.168.209.222:36607 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210003719-192.168.109.215-33269 192.168.109.215:33269 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210003904-192.168.209.229-44097 192.168.209.229:44097 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210005127-192.168.21.151-41565 192.168.21.151:41565 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210005215-192.168.118.213-34037 192.168.118.213:34037 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210005259-192.168.21.152-44483 192.168.21.152:44483 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210005410-192.168.0.72-33339 192.168.0.72:33339 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210005458-192.168.0.73-33875 192.168.0.73:33875 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210005918-192.168.192.227-43751 192.168.192.227:43751 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210011805-192.168.89.170-42903 192.168.89.170:42903 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)

Running Applications (0)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration

Completed Applications (79)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration
app-20251210011730-0078 MonolithCompaniesExportJob 30 4.0 GiB 2025/12/10 01:17:30 root FINISHED 1.3 min
app-20251210011612-0077 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:16:12 spark FINISHED 2.3 min
app-20251210011611-0076 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:16:11 spark FINISHED 1.5 min
app-20251210011559-0075 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:15:59 spark FINISHED 1.1 min
app-20251210011555-0074 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:15:55 spark FINISHED 40 s
app-20251210011246-0073 MonolithMediaCategoriesExportJob 30 4.0 GiB 2025/12/10 01:12:46 root FINISHED 2.2 min
app-20251210011245-0072 MonolithCategoriesExportJob 30 4.0 GiB 2025/12/10 01:12:45 root FINISHED 1.8 min
app-20251210011228-0071 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:12:28 spark FINISHED 1.6 min
app-20251210011205-0070 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:12:05 spark FINISHED 1.3 min
app-20251210011053-0069 DataLakeHouseTransfer-ProjectUsers 30 3.0 GiB 2025/12/10 01:10:53 spark FINISHED 1.8 min
app-20251210011040-0068 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:10:40 spark FINISHED 1.3 min
app-20251210005428-0067 DataLakeHouseTransfer 30 1024.0 MiB 2025/12/10 00:54:28 spark FINISHED 17 min
app-20251210005129-0066 MonolithAgenciesExportJob 30 4.0 GiB 2025/12/10 00:51:29 root FINISHED 19 min
app-20251210005128-0065 MonolithSalesExportJob 30 4.0 GiB 2025/12/10 00:51:28 root FINISHED 19 min
app-20251210004214-0064 DataLakeHouseTransfer 30 2.0 GiB 2025/12/10 00:42:14 spark FINISHED 27 min
app-20251210003917-0063 ProjectSubmissionMediaDetailsIngestion 30 3.0 GiB 2025/12/10 00:39:17 spark FINISHED 29 min
app-20251210003558-0062 DataLakeHouseTransfer 22 1024.0 MiB 2025/12/10 00:35:58 spark FINISHED 14 min
app-20251210003432-0061 MonolithUsersExportJob 24 4.0 GiB 2025/12/10 00:34:32 root FINISHED 15 min
app-20251210003431-0060 MonolithUsersUserDetailsExportJob 26 4.0 GiB 2025/12/10 00:34:31 root FINISHED 15 min
app-20251210002642-0059 DataLakeHouseTransfer 26 3.0 GiB 2025/12/10 00:26:42 spark FINISHED 15 min
app-20251210001638-0058 DataLakeHouseTransfer 22 3.0 GiB 2025/12/10 00:16:38 spark FINISHED 22 min
app-20251210000728-0057 DataLakeHouseTransfer 18 3.0 GiB 2025/12/10 00:07:28 spark FINISHED 29 min
app-20251210000305-0056 DataLakeHouseTransfer 16 2.0 GiB 2025/12/10 00:03:05 spark FINISHED 33 min
app-20251210000251-0055 DataLakeHouseTransfer 14 3.0 GiB 2025/12/10 00:02:51 spark FINISHED 32 min
app-20251210000237-0054 DataLakeHouseTransfer 14 3.0 GiB 2025/12/10 00:02:37 spark FINISHED 32 min
app-20251210000216-0053 DataLakeHouseTransfer 10 1024.0 MiB 2025/12/10 00:02:16 spark FINISHED 31 min
app-20251209235702-0052 MonolithMediaAgenciesMediaExportJob 10 4.0 GiB 2025/12/09 23:57:02 root FINISHED 36 min
app-20251209235522-0051 DataLakeHouseTransfer 10 2.0 GiB 2025/12/09 23:55:22 spark FINISHED 46 s
app-20251209235249-0050 MonolithMediaDetailsExportJob 10 4.0 GiB 2025/12/09 23:52:49 root FINISHED 2.7 min
app-20251209235246-0049 MonolithEthnicitiesExportJob 10 4.0 GiB 2025/12/09 23:52:46 root FINISHED 56 s
app-20251209234903-0048 DataLakeHouseTransfer 22 2.0 GiB 2025/12/09 23:49:03 spark FINISHED 2.9 min
app-20251209234709-0047 MonolithModelReleasesExportJob 22 4.0 GiB 2025/12/09 23:47:09 root FINISHED 4.0 min
app-20251209234601-0046 MonolithMediaReleaseExportJob 20 4.0 GiB 2025/12/09 23:46:01 root FINISHED 4.3 min
app-20251209234559-0045 MonolithPropertyReleasesExportJob 20 4.0 GiB 2025/12/09 23:45:59 root FINISHED 4.0 min
app-20251209230645-0044 DataLakeHouseTransfer 10 2.0 GiB 2025/12/09 23:06:45 spark FINISHED 39 min
app-20251209230106-0043 MonolithMediaExportJob 10 4.0 GiB 2025/12/09 23:01:06 root FINISHED 44 min
app-20251209230055-0042 MonolithKeywordsExportJob 8 4.0 GiB 2025/12/09 23:00:55 root FINISHED 39 min
app-20251209225517-0041 DataLakeHouseTransfer 24 2.0 GiB 2025/12/09 22:55:17 spark FINISHED 1.0 min
app-20251209224949-0040 DataLakeHouseTransfer 26 2.0 GiB 2025/12/09 22:49:49 spark FINISHED 38 s
app-20251209224657-0039 DataLakeHouseTransfer 26 2.0 GiB 2025/12/09 22:46:57 spark FINISHED 1.4 min
app-20251209223932-0038 DataLakeHouseTransfer 24 2.0 GiB 2025/12/09 22:39:32 spark FINISHED 1.3 min
app-20251209223206-0037 DataLakeHouseTransfer 16 2.0 GiB 2025/12/09 22:32:06 spark FINISHED 1.0 min
app-20251209222656-0036 DataLakeHouseTransfer 16 2.0 GiB 2025/12/09 22:26:56 spark FINISHED 36 s
app-20251209222254-0035 DataLakeHouseTransfer 6 2.0 GiB 2025/12/09 22:22:54 spark FINISHED 1.4 min
app-20251209220856-0034 DataLakeHouseTransfer 10 2.0 GiB 2025/12/09 22:08:56 spark FINISHED 37 s
app-20251209220546-0033 DataLakeHouseTransfer 6 2.0 GiB 2025/12/09 22:05:46 spark FINISHED 1.0 min
app-20251209213136-0032 AgenciesChannelManagerAgencyMediaExportJob 22 4.0 GiB 2025/12/09 21:31:36 root FINISHED 1.7 min
app-20251209212810-0031 AgenciesChannelManagerAgencyMediaExportJob 26 4.0 GiB 2025/12/09 21:28:10 root FINISHED 2.3 min
app-20251209212541-0030 sequential-editing3-mapping-load 22 3.0 GiB 2025/12/09 21:25:41 spark FINISHED 1.7 min
app-20251209212427-0029 AgenciesChannelManagerAgencyMediaMainExportJob 20 4.0 GiB 2025/12/09 21:24:27 root FINISHED 2.5 min
app-20251209210822-0028 DataLakeHouseTransfer 16 3.0 GiB 2025/12/09 21:08:22 spark FINISHED 17 min
app-20251209210500-0027 data-program-exports-load 14 3.0 GiB 2025/12/09 21:05:00 spark FINISHED 19 min
app-20251209210456-0026 AgenciesChannelManagerAgencyMediaExportJob 14 4.0 GiB 2025/12/09 21:04:56 root FINISHED 18 min
app-20251209210122-0025 exports-google-sheet 22 1024.0 MiB 2025/12/09 21:01:22 spark FINISHED 1.9 min
app-20251209210100-0024 AgenciesChannelManagerSaleExportJob 24 4.0 GiB 2025/12/09 21:01:00 root FINISHED 1.6 min
app-20251209203207-0023 ProjectSubmissionMediaDetailsIngestion 30 3.0 GiB 2025/12/09 20:32:07 spark FINISHED 23 min
app-20251209202845-0022 DataLakeHouseTransfer 18 3.0 GiB 2025/12/09 20:28:45 spark FINISHED 6.6 min
app-20251209202754-0021 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 20:27:54 spark FINISHED 2.2 min
app-20251209200619-0020 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:06:19 spark FINISHED 2.8 min
app-20251209200433-0019 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:04:33 spark FINISHED 3.9 min
app-20251209200408-0018 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:04:08 spark FINISHED 3.6 min
app-20251209200405-0017 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:04:05 spark FINISHED 3.0 min
app-20251209200404-0016 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:04:04 spark FINISHED 2.3 min
app-20251209160921-0015 DataLakeHouseTransfer 16 3.0 GiB 2025/12/09 16:09:21 spark FINISHED 4.2 min
app-20251209152936-0014 ProjectSubmissionMediaDetailsIngestion 14 3.0 GiB 2025/12/09 15:29:36 spark FINISHED 35 min
app-20251209152600-0013 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 15:26:00 spark FINISHED 2.1 min
app-20251209150311-0012 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 15:03:11 spark FINISHED 2.1 min
app-20251209150304-0011 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 15:03:04 spark FINISHED 1.5 min
app-20251209150217-0010 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 15:02:17 spark FINISHED 1.7 min
app-20251209150127-0009 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 15:01:27 spark FINISHED 1.8 min
app-20251209150115-0008 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 15:01:15 spark FINISHED 1.5 min
app-20251209112438-0007 DataLakeHouseTransfer 18 3.0 GiB 2025/12/09 11:24:38 spark FINISHED 26 min
app-20251209111722-0006 ProjectSubmissionMediaDetailsIngestion 16 3.0 GiB 2025/12/09 11:17:22 spark FINISHED 30 min
app-20251209111449-0005 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 11:14:49 spark FINISHED 1.8 min
app-20251209110447-0004 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 11:04:47 spark FINISHED 2.1 min
app-20251209110345-0003 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 11:03:45 spark FINISHED 2.3 min
app-20251209110343-0002 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 11:03:43 spark FINISHED 1.8 min
app-20251209110249-0001 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 11:02:49 spark FINISHED 2.0 min
app-20251209110249-0000 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 11:02:49 spark FINISHED 1.6 min