3.5.6 Spark Master at spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077

  • URL: spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077
  • Alive Workers: 3
  • Cores in use: 6 Total, 0 Used
  • Memory in use: 12.0 GiB Total, 0.0 B Used
  • Resources in use:
  • Applications: 0 Running, 107 Completed
  • Drivers: 0 Running, 0 Completed
  • Status: ALIVE

Workers (3)

Worker IdAddressStateCoresMemoryResources
worker-20251209144214-192.168.32.55-33761 192.168.32.55:33761 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210021059-192.168.41.207-43125 192.168.41.207:43125 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251210040540-192.168.91.243-34157 192.168.91.243:34157 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)

Running Applications (0)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration

Completed Applications (107)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration
app-20251210112916-0106 DataLakeHouseTransfer 24 3.0 GiB 2025/12/10 11:29:16 spark FINISHED 21 min
app-20251210112357-0105 ProjectSubmissionMediaDetailsIngestion 20 3.0 GiB 2025/12/10 11:23:57 spark FINISHED 22 min
app-20251210112120-0104 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 11:21:20 spark FINISHED 2.0 min
app-20251210110653-0103 MonolithReleasesExportJob 10 4.0 GiB 2025/12/10 11:06:53 root FINISHED 40 s
app-20251210110352-0102 DataLakeHouseTransfer 10 3.0 GiB 2025/12/10 11:03:52 spark FINISHED 2.1 min
app-20251210110315-0101 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 11:03:15 spark FINISHED 2.2 min
app-20251210110224-0100 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 11:02:24 spark FINISHED 2.4 min
app-20251210110222-0099 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 11:02:22 spark FINISHED 2.0 min
app-20251210110221-0098 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 11:02:21 spark FINISHED 1.3 min
app-20251210083515-0097 DataLakeHouseTransfer 20 3.0 GiB 2025/12/10 08:35:15 spark FINISHED 14 min
app-20251210081938-0096 ProjectSubmissionMediaDetailsIngestion 18 3.0 GiB 2025/12/10 08:19:38 spark FINISHED 26 min
app-20251210081653-0095 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 08:16:53 spark FINISHED 2.0 min
app-20251210080535-0094 DataLakeHouseTransfer 10 3.0 GiB 2025/12/10 08:05:35 spark FINISHED 1.9 min
app-20251210080432-0093 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 08:04:32 spark FINISHED 2.1 min
app-20251210080425-0092 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 08:04:25 spark FINISHED 49 s
app-20251210080337-0091 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 08:03:37 spark FINISHED 55 s
app-20251210080337-0090 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 08:03:37 spark FINISHED 34 s
app-20251210052701-0089 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 05:27:01 spark FINISHED 10 min
app-20251210051540-0088 ProjectSubmissionMediaDetailsIngestion 28 3.0 GiB 2025/12/10 05:15:40 spark FINISHED 18 min
app-20251210051255-0087 DataLakeHouseTransfer 12 3.0 GiB 2025/12/10 05:12:55 spark FINISHED 1.4 min
app-20251210050337-0086 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 05:03:37 spark FINISHED 2.6 min
app-20251210050325-0085 DataLakeHouseTransfer 8 3.0 GiB 2025/12/10 05:03:25 spark FINISHED 2.4 min
app-20251210050323-0084 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 05:03:23 spark FINISHED 1.9 min
app-20251210050249-0083 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 05:02:49 spark FINISHED 1.8 min
app-20251210050231-0082 DataLakeHouseTransfer 6 3.0 GiB 2025/12/10 05:02:31 spark FINISHED 1.4 min
app-20251210012333-0081 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:23:33 spark FINISHED 1.2 min
app-20251210012051-0080 MonolithUserEventsExportJob 30 4.0 GiB 2025/12/10 01:20:51 root FINISHED 2.6 min
app-20251210012035-0079 MonolithMediaAssignmentMediaLogExportJob 30 4.0 GiB 2025/12/10 01:20:35 root FINISHED 1.8 min
app-20251210011730-0078 MonolithCompaniesExportJob 30 4.0 GiB 2025/12/10 01:17:30 root FINISHED 1.3 min
app-20251210011612-0077 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:16:12 spark FINISHED 2.3 min
app-20251210011611-0076 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:16:11 spark FINISHED 1.5 min
app-20251210011559-0075 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:15:59 spark FINISHED 1.1 min
app-20251210011555-0074 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:15:55 spark FINISHED 40 s
app-20251210011246-0073 MonolithMediaCategoriesExportJob 30 4.0 GiB 2025/12/10 01:12:46 root FINISHED 2.2 min
app-20251210011245-0072 MonolithCategoriesExportJob 30 4.0 GiB 2025/12/10 01:12:45 root FINISHED 1.8 min
app-20251210011228-0071 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:12:28 spark FINISHED 1.6 min
app-20251210011205-0070 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:12:05 spark FINISHED 1.3 min
app-20251210011053-0069 DataLakeHouseTransfer-ProjectUsers 30 3.0 GiB 2025/12/10 01:10:53 spark FINISHED 1.8 min
app-20251210011040-0068 DataLakeHouseTransfer 30 3.0 GiB 2025/12/10 01:10:40 spark FINISHED 1.3 min
app-20251210005428-0067 DataLakeHouseTransfer 30 1024.0 MiB 2025/12/10 00:54:28 spark FINISHED 17 min
app-20251210005129-0066 MonolithAgenciesExportJob 30 4.0 GiB 2025/12/10 00:51:29 root FINISHED 19 min
app-20251210005128-0065 MonolithSalesExportJob 30 4.0 GiB 2025/12/10 00:51:28 root FINISHED 19 min
app-20251210004214-0064 DataLakeHouseTransfer 30 2.0 GiB 2025/12/10 00:42:14 spark FINISHED 27 min
app-20251210003917-0063 ProjectSubmissionMediaDetailsIngestion 30 3.0 GiB 2025/12/10 00:39:17 spark FINISHED 29 min
app-20251210003558-0062 DataLakeHouseTransfer 22 1024.0 MiB 2025/12/10 00:35:58 spark FINISHED 14 min
app-20251210003432-0061 MonolithUsersExportJob 24 4.0 GiB 2025/12/10 00:34:32 root FINISHED 15 min
app-20251210003431-0060 MonolithUsersUserDetailsExportJob 26 4.0 GiB 2025/12/10 00:34:31 root FINISHED 15 min
app-20251210002642-0059 DataLakeHouseTransfer 26 3.0 GiB 2025/12/10 00:26:42 spark FINISHED 15 min
app-20251210001638-0058 DataLakeHouseTransfer 22 3.0 GiB 2025/12/10 00:16:38 spark FINISHED 22 min
app-20251210000728-0057 DataLakeHouseTransfer 18 3.0 GiB 2025/12/10 00:07:28 spark FINISHED 29 min
app-20251210000305-0056 DataLakeHouseTransfer 16 2.0 GiB 2025/12/10 00:03:05 spark FINISHED 33 min
app-20251210000251-0055 DataLakeHouseTransfer 14 3.0 GiB 2025/12/10 00:02:51 spark FINISHED 32 min
app-20251210000237-0054 DataLakeHouseTransfer 14 3.0 GiB 2025/12/10 00:02:37 spark FINISHED 32 min
app-20251210000216-0053 DataLakeHouseTransfer 10 1024.0 MiB 2025/12/10 00:02:16 spark FINISHED 31 min
app-20251209235702-0052 MonolithMediaAgenciesMediaExportJob 10 4.0 GiB 2025/12/09 23:57:02 root FINISHED 36 min
app-20251209235522-0051 DataLakeHouseTransfer 10 2.0 GiB 2025/12/09 23:55:22 spark FINISHED 46 s
app-20251209235249-0050 MonolithMediaDetailsExportJob 10 4.0 GiB 2025/12/09 23:52:49 root FINISHED 2.7 min
app-20251209235246-0049 MonolithEthnicitiesExportJob 10 4.0 GiB 2025/12/09 23:52:46 root FINISHED 56 s
app-20251209234903-0048 DataLakeHouseTransfer 22 2.0 GiB 2025/12/09 23:49:03 spark FINISHED 2.9 min
app-20251209234709-0047 MonolithModelReleasesExportJob 22 4.0 GiB 2025/12/09 23:47:09 root FINISHED 4.0 min
app-20251209234601-0046 MonolithMediaReleaseExportJob 20 4.0 GiB 2025/12/09 23:46:01 root FINISHED 4.3 min
app-20251209234559-0045 MonolithPropertyReleasesExportJob 20 4.0 GiB 2025/12/09 23:45:59 root FINISHED 4.0 min
app-20251209230645-0044 DataLakeHouseTransfer 10 2.0 GiB 2025/12/09 23:06:45 spark FINISHED 39 min
app-20251209230106-0043 MonolithMediaExportJob 10 4.0 GiB 2025/12/09 23:01:06 root FINISHED 44 min
app-20251209230055-0042 MonolithKeywordsExportJob 8 4.0 GiB 2025/12/09 23:00:55 root FINISHED 39 min
app-20251209225517-0041 DataLakeHouseTransfer 24 2.0 GiB 2025/12/09 22:55:17 spark FINISHED 1.0 min
app-20251209224949-0040 DataLakeHouseTransfer 26 2.0 GiB 2025/12/09 22:49:49 spark FINISHED 38 s
app-20251209224657-0039 DataLakeHouseTransfer 26 2.0 GiB 2025/12/09 22:46:57 spark FINISHED 1.4 min
app-20251209223932-0038 DataLakeHouseTransfer 24 2.0 GiB 2025/12/09 22:39:32 spark FINISHED 1.3 min
app-20251209223206-0037 DataLakeHouseTransfer 16 2.0 GiB 2025/12/09 22:32:06 spark FINISHED 1.0 min
app-20251209222656-0036 DataLakeHouseTransfer 16 2.0 GiB 2025/12/09 22:26:56 spark FINISHED 36 s
app-20251209222254-0035 DataLakeHouseTransfer 6 2.0 GiB 2025/12/09 22:22:54 spark FINISHED 1.4 min
app-20251209220856-0034 DataLakeHouseTransfer 10 2.0 GiB 2025/12/09 22:08:56 spark FINISHED 37 s
app-20251209220546-0033 DataLakeHouseTransfer 6 2.0 GiB 2025/12/09 22:05:46 spark FINISHED 1.0 min
app-20251209213136-0032 AgenciesChannelManagerAgencyMediaExportJob 22 4.0 GiB 2025/12/09 21:31:36 root FINISHED 1.7 min
app-20251209212810-0031 AgenciesChannelManagerAgencyMediaExportJob 26 4.0 GiB 2025/12/09 21:28:10 root FINISHED 2.3 min
app-20251209212541-0030 sequential-editing3-mapping-load 22 3.0 GiB 2025/12/09 21:25:41 spark FINISHED 1.7 min
app-20251209212427-0029 AgenciesChannelManagerAgencyMediaMainExportJob 20 4.0 GiB 2025/12/09 21:24:27 root FINISHED 2.5 min
app-20251209210822-0028 DataLakeHouseTransfer 16 3.0 GiB 2025/12/09 21:08:22 spark FINISHED 17 min
app-20251209210500-0027 data-program-exports-load 14 3.0 GiB 2025/12/09 21:05:00 spark FINISHED 19 min
app-20251209210456-0026 AgenciesChannelManagerAgencyMediaExportJob 14 4.0 GiB 2025/12/09 21:04:56 root FINISHED 18 min
app-20251209210122-0025 exports-google-sheet 22 1024.0 MiB 2025/12/09 21:01:22 spark FINISHED 1.9 min
app-20251209210100-0024 AgenciesChannelManagerSaleExportJob 24 4.0 GiB 2025/12/09 21:01:00 root FINISHED 1.6 min
app-20251209203207-0023 ProjectSubmissionMediaDetailsIngestion 30 3.0 GiB 2025/12/09 20:32:07 spark FINISHED 23 min
app-20251209202845-0022 DataLakeHouseTransfer 18 3.0 GiB 2025/12/09 20:28:45 spark FINISHED 6.6 min
app-20251209202754-0021 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 20:27:54 spark FINISHED 2.2 min
app-20251209200619-0020 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:06:19 spark FINISHED 2.8 min
app-20251209200433-0019 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:04:33 spark FINISHED 3.9 min
app-20251209200408-0018 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:04:08 spark FINISHED 3.6 min
app-20251209200405-0017 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:04:05 spark FINISHED 3.0 min
app-20251209200404-0016 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 20:04:04 spark FINISHED 2.3 min
app-20251209160921-0015 DataLakeHouseTransfer 16 3.0 GiB 2025/12/09 16:09:21 spark FINISHED 4.2 min
app-20251209152936-0014 ProjectSubmissionMediaDetailsIngestion 14 3.0 GiB 2025/12/09 15:29:36 spark FINISHED 35 min
app-20251209152600-0013 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 15:26:00 spark FINISHED 2.1 min
app-20251209150311-0012 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 15:03:11 spark FINISHED 2.1 min
app-20251209150304-0011 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 15:03:04 spark FINISHED 1.5 min
app-20251209150217-0010 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 15:02:17 spark FINISHED 1.7 min
app-20251209150127-0009 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 15:01:27 spark FINISHED 1.8 min
app-20251209150115-0008 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 15:01:15 spark FINISHED 1.5 min
app-20251209112438-0007 DataLakeHouseTransfer 18 3.0 GiB 2025/12/09 11:24:38 spark FINISHED 26 min
app-20251209111722-0006 ProjectSubmissionMediaDetailsIngestion 16 3.0 GiB 2025/12/09 11:17:22 spark FINISHED 30 min
app-20251209111449-0005 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 11:14:49 spark FINISHED 1.8 min
app-20251209110447-0004 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 11:04:47 spark FINISHED 2.1 min
app-20251209110345-0003 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 11:03:45 spark FINISHED 2.3 min
app-20251209110343-0002 DataLakeHouseTransfer 8 3.0 GiB 2025/12/09 11:03:43 spark FINISHED 1.8 min
app-20251209110249-0001 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 11:02:49 spark FINISHED 2.0 min
app-20251209110249-0000 DataLakeHouseTransfer 6 3.0 GiB 2025/12/09 11:02:49 spark FINISHED 1.6 min