3.5.6 Spark Master at spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077

  • URL: spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077
  • Alive Workers: 8
  • Cores in use: 16 Total, 16 Used
  • Memory in use: 32.0 GiB Total, 32.0 GiB Used
  • Resources in use:
  • Applications: 1 Running, 140 Completed
  • Drivers: 0 Running, 0 Completed
  • Status: ALIVE

Workers (19)

Worker IdAddressStateCoresMemoryResources
worker-20251210021059-192.168.41.207-43125 192.168.41.207:43125 ALIVE 2 (2 Used) 4.0 GiB (4.0 GiB Used)
worker-20251210040540-192.168.91.243-34157 192.168.91.243:34157 ALIVE 2 (2 Used) 4.0 GiB (4.0 GiB Used)
worker-20251210213324-192.168.176.99-33465 192.168.176.99:33465 ALIVE 2 (2 Used) 4.0 GiB (4.0 GiB Used)
worker-20251210222706-192.168.150.83-40263 192.168.150.83:40263 DEAD 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210222912-192.168.70.227-38707 192.168.70.227:38707 DEAD 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210223146-192.168.82.232-34751 192.168.82.232:34751 ALIVE 2 (2 Used) 4.0 GiB (4.0 GiB Used)
worker-20251210223153-192.168.82.230-46145 192.168.82.230:46145 DEAD 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210223311-192.168.237.67-36229 192.168.237.67:36229 ALIVE 2 (2 Used) 4.0 GiB (4.0 GiB Used)
worker-20251210223612-192.168.166.207-33583 192.168.166.207:33583 DEAD 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210223733-192.168.47.195-39139 192.168.47.195:39139 DEAD 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210223816-192.168.216.90-38133 192.168.216.90:38133 DEAD 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210223959-192.168.143.197-45731 192.168.143.197:45731 DEAD 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210224440-192.168.143.210-41511 192.168.143.210:41511 ALIVE 2 (2 Used) 4.0 GiB (4.0 GiB Used)
worker-20251210224526-192.168.70.236-38565 192.168.70.236:38565 ALIVE 2 (2 Used) 4.0 GiB (4.0 GiB Used)
worker-20251210224700-192.168.58.1-39115 192.168.58.1:39115 ALIVE 2 (2 Used) 4.0 GiB (4.0 GiB Used)
worker-20251210224743-192.168.58.3-36103 192.168.58.3:36103 DEAD 2 (2 Used) 4.0 GiB (4.0 GiB Used)
worker-20251210224825-192.168.166.213-38191 192.168.166.213:38191 DEAD 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210224905-192.168.216.92-43055 192.168.216.92:43055 DEAD 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210224946-192.168.47.200-41271 192.168.47.200:41271 DEAD 2 (0 Used) 4.0 GiB (0.0 B Used)

Running Applications (1)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration
app-20251210225156-0140
(kill)
DataLakeHouseTransfer 16 2.0 GiB 2025/12/10 22:51:56 spark RUNNING 33 s

Completed Applications (140)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration
app-20251210224251-0139 DataLakeHouseTransfer 10 2.0 GiB 2025/12/10 22:42:51 spark FINISHED 1.1 min
app-20251210223319-0138 DataLakeHouseTransfer 16 2.0 GiB 2025/12/10 22:33:19 spark FINISHED 1.2 min
app-20251210222735-0137 DataLakeHouseTransfer 10 2.0 GiB 2025/12/10 22:27:35 spark FINISHED 39 s
app-20251210222250-0136 DataLakeHouseTransfer 6 2.0 GiB 2025/12/10 22:22:50 spark FINISHED 1.6 min
app-20251210220850-0135 DataLakeHouseTransfer 10 2.0 GiB 2025/12/10 22:08:50 spark FINISHED 41 s
app-20251210220554-0134 DataLakeHouseTransfer 6 2.0 GiB 2025/12/10 22:05:54 spark FINISHED 1.1 min
app-20251210213208-0133 AgenciesChannelManagerAgencyMediaExportJob 14 4.0 GiB 2025/12/10 21:32:08 root FINISHED 2.1 min
app-20251210212829-0132 AgenciesChannelManagerAgencyMediaExportJob 20 4.0 GiB 2025/12/10 21:28:29 root FINISHED 2.4 min
app-20251210212411-0131 AgenciesChannelManagerAgencyMediaMainExportJob 18 4.0 GiB 2025/12/10 21:24:11 root FINISHED 2.5 min
app-20251210210629-0130 sequential-editing3-mapping-load 12 3.0 GiB 2025/12/10 21:06:29 spark FINISHED 18 min
app-20251210210611-0129 DataLakeHouseTransfer 10 3.0 GiB 2025/12/10 21:06:11 spark FINISHED 18 min
app-20251210210400-0128 AgenciesChannelManagerAgencyMediaExportJob 10 4.0 GiB 2025/12/10 21:04:00 root FINISHED 19 min
app-20251210210339-0127 data-program-exports-load 6 3.0 GiB 2025/12/10 21:03:39 spark FINISHED 45 s
app-20251210210116-0126 AgenciesChannelManagerSaleExportJob 6 4.0 GiB 2025/12/10 21:01:16 root FINISHED 1.5 min
app-20251210210039-0125 exports-google-sheet 6 1024.0 MiB 2025/12/10 21:00:39 spark FINISHED 45 s
app-20251210203816-0124 DataLakeHouseTransfer 28 3.0 GiB 2025/12/10 20:38:16 spark FINISHED 8.3 min
app-20251210201702-0123 ProjectSubmissionMediaDetailsIngestion 22 3.0 GiB 2025/12/10 20:17:02 spark FINISHED 24 min
app-20251210201416-0122 DataLakeHouseTransfer 10 3.0 GiB 2025/12/10 20:14:16 spark FINISHED 2.0 min
app-20251210200433-0121 DataLakeHouseTransfer 10 3.0 GiB 2025/12/10 20:04:33 spark FINISHED 2.4 min
app-20251210200253-0120 DataLakeHouseTransfer 10 3.0 GiB 2025/12/10 20:02:53 spark FINISHED 3.3 min
app-20251210200251-0119 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 20:02:51 spark FINISHED 1.9 min
app-20251210200250-0118 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 20:02:50 spark FINISHED 1.3 min
app-20251210200248-0117 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 20:02:48 spark FINISHED 34 s
app-20251210173241-0116 AccountingLedgerEventsLoad 6 3.0 GiB 2025/12/10 17:32:41 spark FINISHED 1.4 min
app-20251210171750-0115 AccountLedgerEventsLoad 6 3.0 GiB 2025/12/10 17:17:50 spark FINISHED 37 s
app-20251210154417-0114 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 15:44:17 spark FINISHED 4.4 min
app-20251210152049-0113 ProjectSubmissionMediaDetailsIngestion 24 3.0 GiB 2025/12/10 15:20:49 spark FINISHED 22 min
app-20251210151739-0112 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 15:17:39 spark FINISHED 2.3 min
app-20251210150321-0111 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 15:03:21 spark FINISHED 2.8 min
app-20251210150321-0110 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 15:03:21 spark FINISHED 2.1 min
app-20251210150319-0109 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 15:03:19 spark FINISHED 40 s
app-20251210150300-0108 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 15:03:00 spark FINISHED 38 s
app-20251210150148-0107 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 15:01:48 spark FINISHED 45 s
app-20251210112916-0106 DataLakeHouseTransfer 24 3.0 GiB 2025/12/10 11:29:16 spark FINISHED 21 min
app-20251210112357-0105 ProjectSubmissionMediaDetailsIngestion 20 3.0 GiB 2025/12/10 11:23:57 spark FINISHED 22 min
app-20251210112120-0104 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 11:21:20 spark FINISHED 2.0 min
app-20251210110653-0103 MonolithReleasesExportJob 10 4.0 GiB 2025/12/10 11:06:53 root FINISHED 40 s
app-20251210110352-0102 DataLakeHouseTransfer 10 3.0 GiB 2025/12/10 11:03:52 spark FINISHED 2.1 min
app-20251210110315-0101 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 11:03:15 spark FINISHED 2.2 min
app-20251210110224-0100 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 11:02:24 spark FINISHED 2.4 min
app-20251210110222-0099 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 11:02:22 spark FINISHED 2.0 min
app-20251210110221-0098 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 11:02:21 spark FINISHED 1.3 min
app-20251210083515-0097 DataLakeHouseTransfer 20 3.0 GiB 2025/12/10 08:35:15 spark FINISHED 14 min
app-20251210081938-0096 ProjectSubmissionMediaDetailsIngestion 18 3.0 GiB 2025/12/10 08:19:38 spark FINISHED 26 min
app-20251210081653-0095 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 08:16:53 spark FINISHED 2.0 min
app-20251210080535-0094 DataLakeHouseTransfer 10 3.0 GiB 2025/12/10 08:05:35 spark FINISHED 1.9 min
app-20251210080432-0093 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 08:04:32 spark FINISHED 2.1 min
app-20251210080425-0092 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 08:04:25 spark FINISHED 49 s
app-20251210080337-0091 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 08:03:37 spark FINISHED 55 s
app-20251210080337-0090 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 08:03:37 spark FINISHED 34 s
app-20251210052701-0089 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 05:27:01 spark FINISHED 10 min
app-20251210051540-0088 ProjectSubmissionMediaDetailsIngestion 28 3.0 GiB 2025/12/10 05:15:40 spark FINISHED 18 min
app-20251210051255-0087 DataLakeHouseTransfer 12 3.0 GiB 2025/12/10 05:12:55 spark FINISHED 1.4 min
app-20251210050337-0086 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 05:03:37 spark FINISHED 2.6 min
app-20251210050325-0085 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 05:03:25 spark FINISHED 2.4 min
app-20251210050323-0084 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 05:03:23 spark FINISHED 1.9 min
app-20251210050249-0083 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 05:02:49 spark FINISHED 1.8 min
app-20251210050231-0082 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 05:02:31 spark FINISHED 1.4 min
app-20251210012333-0081 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:23:33 spark FINISHED 1.2 min
app-20251210012051-0080 MonolithUserEventsExportJob 30 4.0 GiB 2025/12/10 01:20:51 root FINISHED 2.6 min
app-20251210012035-0079 MonolithMediaAssignmentMediaLogExportJob 30 4.0 GiB 2025/12/10 01:20:35 root FINISHED 1.8 min
app-20251210011730-0078 MonolithCompaniesExportJob 30 4.0 GiB 2025/12/10 01:17:30 root FINISHED 1.3 min
app-20251210011612-0077 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:16:12 spark FINISHED 2.3 min
app-20251210011611-0076 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:16:11 spark FINISHED 1.5 min
app-20251210011559-0075 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:15:59 spark FINISHED 1.1 min
app-20251210011555-0074 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:15:55 spark FINISHED 40 s
app-20251210011246-0073 MonolithMediaCategoriesExportJob 30 4.0 GiB 2025/12/10 01:12:46 root FINISHED 2.2 min
app-20251210011245-0072 MonolithCategoriesExportJob 30 4.0 GiB 2025/12/10 01:12:45 root FINISHED 1.8 min
app-20251210011228-0071 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:12:28 spark FINISHED 1.6 min
app-20251210011205-0070 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:12:05 spark FINISHED 1.3 min
app-20251210011053-0069 DataLakeHouseTransfer-ProjectUsers 30 3.0 GiB 2025/12/10 01:10:53 spark FINISHED 1.8 min
app-20251210011040-0068 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:10:40 spark FINISHED 1.3 min
app-20251210005428-0067 DataLakeHouseTransfer 30 1024.0 MiB 2025/12/10 00:54:28 spark FINISHED 17 min
app-20251210005129-0066 MonolithAgenciesExportJob 30 4.0 GiB 2025/12/10 00:51:29 root FINISHED 19 min
app-20251210005128-0065 MonolithSalesExportJob 30 4.0 GiB 2025/12/10 00:51:28 root FINISHED 19 min
app-20251210004214-0064 DataLakeHouseTransfer 30 2.0 GiB 2025/12/10 00:42:14 spark FINISHED 27 min
app-20251210003917-0063 ProjectSubmissionMediaDetailsIngestion 30 3.0 GiB 2025/12/10 00:39:17 spark FINISHED 29 min
app-20251210003558-0062 DataLakeHouseTransfer 22 1024.0 MiB 2025/12/10 00:35:58 spark FINISHED 14 min
app-20251210003432-0061 MonolithUsersExportJob 24 4.0 GiB 2025/12/10 00:34:32 root FINISHED 15 min
app-20251210003431-0060 MonolithUsersUserDetailsExportJob 26 4.0 GiB 2025/12/10 00:34:31 root FINISHED 15 min
app-20251210002642-0059 DataLakeHouseTransfer 26 3.0 GiB 2025/12/10 00:26:42 spark FINISHED 15 min
app-20251210001638-0058 DataLakeHouseTransfer 22 3.0 GiB 2025/12/10 00:16:38 spark FINISHED 22 min
app-20251210000728-0057 DataLakeHouseTransfer 18 3.0 GiB 2025/12/10 00:07:28 spark FINISHED 29 min
app-20251210000305-0056 DataLakeHouseTransfer 16 2.0 GiB 2025/12/10 00:03:05 spark FINISHED 33 min
app-20251210000251-0055 DataLakeHouseTransfer 14 3.0 GiB 2025/12/10 00:02:51 spark FINISHED 32 min
app-20251210000237-0054 DataLakeHouseTransfer 14 3.0 GiB 2025/12/10 00:02:37 spark FINISHED 32 min
app-20251210000216-0053 DataLakeHouseTransfer 10 1024.0 MiB 2025/12/10 00:02:16 spark FINISHED 31 min
app-20251209235702-0052 MonolithMediaAgenciesMediaExportJob 10 4.0 GiB 2025/12/09 23:57:02 root FINISHED 36 min
app-20251209235522-0051 DataLakeHouseTransfer 10 2.0 GiB 2025/12/09 23:55:22 spark FINISHED 46 s
app-20251209235249-0050 MonolithMediaDetailsExportJob 10 4.0 GiB 2025/12/09 23:52:49 root FINISHED 2.7 min
app-20251209235246-0049 MonolithEthnicitiesExportJob 10 4.0 GiB 2025/12/09 23:52:46 root FINISHED 56 s
app-20251209234903-0048 DataLakeHouseTransfer 22 2.0 GiB 2025/12/09 23:49:03 spark FINISHED 2.9 min
app-20251209234709-0047 MonolithModelReleasesExportJob 22 4.0 GiB 2025/12/09 23:47:09 root FINISHED 4.0 min
app-20251209234601-0046 MonolithMediaReleaseExportJob 20 4.0 GiB 2025/12/09 23:46:01 root FINISHED 4.3 min
app-20251209234559-0045 MonolithPropertyReleasesExportJob 20 4.0 GiB 2025/12/09 23:45:59 root FINISHED 4.0 min
app-20251209230645-0044 DataLakeHouseTransfer 10 2.0 GiB 2025/12/09 23:06:45 spark FINISHED 39 min
app-20251209230106-0043 MonolithMediaExportJob 10 4.0 GiB 2025/12/09 23:01:06 root FINISHED 44 min
app-20251209230055-0042 MonolithKeywordsExportJob 8 4.0 GiB 2025/12/09 23:00:55 root FINISHED 39 min
app-20251209225517-0041 DataLakeHouseTransfer 24 2.0 GiB 2025/12/09 22:55:17 spark FINISHED 1.0 min
app-20251209224949-0040 DataLakeHouseTransfer 26 2.0 GiB 2025/12/09 22:49:49 spark FINISHED 38 s
app-20251209224657-0039 DataLakeHouseTransfer 26 2.0 GiB 2025/12/09 22:46:57 spark FINISHED 1.4 min
app-20251209223932-0038 DataLakeHouseTransfer 24 2.0 GiB 2025/12/09 22:39:32 spark FINISHED 1.3 min
app-20251209223206-0037 DataLakeHouseTransfer 16 2.0 GiB 2025/12/09 22:32:06 spark FINISHED 1.0 min
app-20251209222656-0036 DataLakeHouseTransfer 16 2.0 GiB 2025/12/09 22:26:56 spark FINISHED 36 s
app-20251209222254-0035 DataLakeHouseTransfer 6 2.0 GiB 2025/12/09 22:22:54 spark FINISHED 1.4 min
app-20251209220856-0034 DataLakeHouseTransfer 10 2.0 GiB 2025/12/09 22:08:56 spark FINISHED 37 s
app-20251209220546-0033 DataLakeHouseTransfer 6 2.0 GiB 2025/12/09 22:05:46 spark FINISHED 1.0 min
app-20251209213136-0032 AgenciesChannelManagerAgencyMediaExportJob 22 4.0 GiB 2025/12/09 21:31:36 root FINISHED 1.7 min
app-20251209212810-0031 AgenciesChannelManagerAgencyMediaExportJob 26 4.0 GiB 2025/12/09 21:28:10 root FINISHED 2.3 min
app-20251209212541-0030 sequential-editing3-mapping-load 22 3.0 GiB 2025/12/09 21:25:41 spark FINISHED 1.7 min
app-20251209212427-0029 AgenciesChannelManagerAgencyMediaMainExportJob 20 4.0 GiB 2025/12/09 21:24:27 root FINISHED 2.5 min
app-20251209210822-0028 DataLakeHouseTransfer 16 3.0 GiB 2025/12/09 21:08:22 spark FINISHED 17 min
app-20251209210500-0027 data-program-exports-load 14 3.0 GiB 2025/12/09 21:05:00 spark FINISHED 19 min
app-20251209210456-0026 AgenciesChannelManagerAgencyMediaExportJob 14 4.0 GiB 2025/12/09 21:04:56 root FINISHED 18 min
app-20251209210122-0025 exports-google-sheet 22 1024.0 MiB 2025/12/09 21:01:22 spark FINISHED 1.9 min
app-20251209210100-0024 AgenciesChannelManagerSaleExportJob 24 4.0 GiB 2025/12/09 21:01:00 root FINISHED 1.6 min
app-20251209203207-0023 ProjectSubmissionMediaDetailsIngestion 30 3.0 GiB 2025/12/09 20:32:07 spark FINISHED 23 min
app-20251209202845-0022 DataLakeHouseTransfer 18 3.0 GiB 2025/12/09 20:28:45 spark FINISHED 6.6 min
app-20251209202754-0021 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 20:27:54 spark FINISHED 2.2 min
app-20251209200619-0020 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:06:19 spark FINISHED 2.8 min
app-20251209200433-0019 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:04:33 spark FINISHED 3.9 min
app-20251209200408-0018 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:04:08 spark FINISHED 3.6 min
app-20251209200405-0017 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:04:05 spark FINISHED 3.0 min
app-20251209200404-0016 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:04:04 spark FINISHED 2.3 min
app-20251209160921-0015 DataLakeHouseTransfer 16 3.0 GiB 2025/12/09 16:09:21 spark FINISHED 4.2 min
app-20251209152936-0014 ProjectSubmissionMediaDetailsIngestion 14 3.0 GiB 2025/12/09 15:29:36 spark FINISHED 35 min
app-20251209152600-0013 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 15:26:00 spark FINISHED 2.1 min
app-20251209150311-0012 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 15:03:11 spark FINISHED 2.1 min
app-20251209150304-0011 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 15:03:04 spark FINISHED 1.5 min
app-20251209150217-0010 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 15:02:17 spark FINISHED 1.7 min
app-20251209150127-0009 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 15:01:27 spark FINISHED 1.8 min
app-20251209150115-0008 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 15:01:15 spark FINISHED 1.5 min
app-20251209112438-0007 DataLakeHouseTransfer 18 3.0 GiB 2025/12/09 11:24:38 spark FINISHED 26 min
app-20251209111722-0006 ProjectSubmissionMediaDetailsIngestion 16 3.0 GiB 2025/12/09 11:17:22 spark FINISHED 30 min
app-20251209111449-0005 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 11:14:49 spark FINISHED 1.8 min
app-20251209110447-0004 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 11:04:47 spark FINISHED 2.1 min
app-20251209110345-0003 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 11:03:45 spark FINISHED 2.3 min
app-20251209110343-0002 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 11:03:43 spark FINISHED 1.8 min
app-20251209110249-0001 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 11:02:49 spark FINISHED 2.0 min
app-20251209110249-0000 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 11:02:49 spark FINISHED 1.6 min