3.5.6 Spark Master at spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077

  • URL: spark://spark-master-0.spark-headless.data-engineering.svc.cluster.local:7077
  • Alive Workers: 3
  • Cores in use: 6 Total, 0 Used
  • Memory in use: 12.0 GiB Total, 0.0 B Used
  • Resources in use:
  • Applications: 0 Running, 123 Completed
  • Drivers: 0 Running, 0 Completed
  • Status: ALIVE

Workers (3)

Worker IdAddressStateCoresMemoryResources
worker-20251215101519-192.168.127.197-40647 192.168.127.197:40647 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251215124203-192.168.179.239-37143 192.168.179.239:37143 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)
worker-20251216170633-192.168.26.130-38531 192.168.26.130:38531 ALIVE 2 (0 Used) 4.0 GiB (0.0 B Used)

Running Applications (0)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration

Completed Applications (123)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration
app-20251216153157-0122 ProjectSubmissionMediaDetailsIngestion 30 3.0 GiB 2025/12/16 15:31:57 spark FINISHED 22 min
app-20251216152939-0121 DataLakeHouseTransfer 16 3.0 GiB 2025/12/16 15:29:39 spark FINISHED 7.7 min
app-20251216152838-0120 DataLakeHouseTransfer 8 3.0 GiB 2025/12/16 15:28:38 spark FINISHED 2.5 min
app-20251216150437-0119 DataLakeHouseTransfer 10 3.0 GiB 2025/12/16 15:04:37 spark FINISHED 2.5 min
app-20251216150437-0118 DataLakeHouseTransfer 8 3.0 GiB 2025/12/16 15:04:37 spark FINISHED 1.8 min
app-20251216150429-0117 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 15:04:29 spark FINISHED 1.3 min
app-20251216150253-0116 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 15:02:53 spark FINISHED 2.1 min
app-20251216150239-0115 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 15:02:39 spark FINISHED 1.9 min
app-20251216141805-0114 DataLakeHouseTransfer 30 3.0 GiB 2025/12/16 14:18:05 spark FINISHED 15 min
app-20251216140442-0113 ProjectSubmissionMediaDetailsIngestion 30 3.0 GiB 2025/12/16 14:04:42 spark FINISHED 24 min
app-20251216140118-0112 DataLakeHouseTransfer 10 3.0 GiB 2025/12/16 14:01:18 spark FINISHED 2.4 min
app-20251216134629-0111 DataLakeHouseTransfer 10 3.0 GiB 2025/12/16 13:46:29 spark FINISHED 3.1 min
app-20251216134552-0110 DataLakeHouseTransfer 10 3.0 GiB 2025/12/16 13:45:52 spark FINISHED 3.1 min
app-20251216134536-0109 DataLakeHouseTransfer 8 3.0 GiB 2025/12/16 13:45:36 spark FINISHED 1.7 min
app-20251216134530-0108 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 13:45:30 spark FINISHED 1.2 min
app-20251216134530-0107 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 13:45:30 spark FINISHED 48 s
app-20251216130740-0106 ProjectSubmissionMediaDetailsIngestion 20 3.0 GiB 2025/12/16 13:07:40 spark FINISHED 27 min
app-20251216125006-0105 ProjectSubmissionMediaDetailsIngestion 12 3.0 GiB 2025/12/16 12:50:06 spark FINISHED 38 s
app-20251216124736-0104 ProjectSubmissionMediaDetailsIngestion 6 3.0 GiB 2025/12/16 12:47:36 spark FINISHED 48 s
app-20251216121952-0103 ProjectSubmissionMediaDetailsIngestion 6 3.0 GiB 2025/12/16 12:19:52 spark FINISHED 1.7 min
app-20251216115220-0102 ProjectSubmissionMediaDetailsIngestion 14 3.0 GiB 2025/12/16 11:52:20 spark FINISHED 1.6 min
app-20251216114600-0101 ProjectSubmissionMediaDetailsIngestion 6 3.0 GiB 2025/12/16 11:46:00 spark FINISHED 1.2 min
app-20251216101209-0100 ProjectSubmissionMediaDetailsIngestion 10 3.0 GiB 2025/12/16 10:12:09 spark FINISHED 1.1 min
app-20251216100842-0099 DataLakeHouseTransfer 8 3.0 GiB 2025/12/16 10:08:42 spark FINISHED 2.8 min
app-20251216091543-0098 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 09:15:43 spark FINISHED 50 s
app-20251216082228-0097 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 08:22:28 spark FINISHED 49 s
app-20251216080317-0096 DataLakeHouseTransfer 10 3.0 GiB 2025/12/16 08:03:17 spark FINISHED 3.9 min
app-20251216080316-0095 DataLakeHouseTransfer 8 3.0 GiB 2025/12/16 08:03:16 spark FINISHED 3.2 min
app-20251216080302-0094 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 08:03:02 spark FINISHED 1.8 min
app-20251216080302-0093 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 08:03:02 spark FINISHED 1.3 min
app-20251216080302-0092 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 08:03:02 spark FINISHED 37 s
app-20251216052848-0091 DataLakeHouseTransfer 16 3.0 GiB 2025/12/16 05:28:48 spark FINISHED 5.5 min
app-20251216051647-0090 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 05:16:47 spark FINISHED 50 s
app-20251216050418-0089 DataLakeHouseTransfer 10 3.0 GiB 2025/12/16 05:04:18 spark FINISHED 2.0 min
app-20251216050339-0088 DataLakeHouseTransfer 8 3.0 GiB 2025/12/16 05:03:39 spark FINISHED 1.9 min
app-20251216050228-0087 DataLakeHouseTransfer 8 3.0 GiB 2025/12/16 05:02:28 spark FINISHED 2.5 min
app-20251216050227-0086 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 05:02:27 spark FINISHED 2.1 min
app-20251216050225-0085 DataLakeHouseTransfer 6 3.0 GiB 2025/12/16 05:02:25 spark FINISHED 1.5 min
app-20251216004006-0084 MonolithMediaAssignmentMediaLogExportJob 30 4.0 GiB 2025/12/16 00:40:06 root FINISHED 5.8 min
app-20251216004004-0083 MonolithReleasesExportJob 30 4.0 GiB 2025/12/16 00:40:04 root FINISHED 4.8 min
app-20251216003956-0082 MonolithUserEventsExportJob 30 4.0 GiB 2025/12/16 00:39:56 root FINISHED 4.5 min
app-20251216003904-0081 DataLakeHouseTransfer 30 3.0 GiB 2025/12/16 00:39:04 spark FINISHED 4.3 min
app-20251216003721-0080 DataLakeHouseTransfer 30 1024.0 MiB 2025/12/16 00:37:21 spark FINISHED 2.1 min
app-20251216003656-0079 MonolithCompaniesExportJob 30 4.0 GiB 2025/12/16 00:36:56 root FINISHED 1.6 min
app-20251216003654-0078 MonolithCategoriesExportJob 30 4.0 GiB 2025/12/16 00:36:54 root FINISHED 1.2 min
app-20251216003646-0077 MonolithMediaCategoriesExportJob 30 4.0 GiB 2025/12/16 00:36:46 root FINISHED 52 s
app-20251216003342-0076 MonolithAgenciesExportJob 30 4.0 GiB 2025/12/16 00:33:42 root FINISHED 2.0 min
app-20251216003341-0075 MonolithSalesExportJob 30 4.0 GiB 2025/12/16 00:33:41 root FINISHED 1.6 min
app-20251216002804-0074 DataLakeHouseTransfer 30 1024.0 MiB 2025/12/16 00:28:04 spark FINISHED 6.0 min
app-20251216002658-0073 DataLakeHouseTransfer 30 2.0 GiB 2025/12/16 00:26:58 spark FINISHED 6.4 min
app-20251216002304-0072 MonolithUsersUserDetailsExportJob 30 4.0 GiB 2025/12/16 00:23:04 root FINISHED 9.1 min
app-20251216002302-0071 MonolithUsersExportJob 26 4.0 GiB 2025/12/16 00:23:02 root FINISHED 4.9 min
app-20251216001611-0070 DataLakeHouseTransfer 24 3.0 GiB 2025/12/16 00:16:11 spark FINISHED 11 min
app-20251216000947-0069 AccountingLedgerEventsLoad 22 3.0 GiB 2025/12/16 00:09:47 spark FINISHED 16 min
app-20251216000536-0068 DataLakeHouseTransfer 20 3.0 GiB 2025/12/16 00:05:36 spark FINISHED 20 min
app-20251216000153-0067 DataLakeHouseTransfer 20 1024.0 MiB 2025/12/16 00:01:53 spark FINISHED 22 min
app-20251216000129-0066 DataLakeHouseTransfer 18 3.0 GiB 2025/12/16 00:01:29 spark FINISHED 22 min
app-20251216000118-0065 DataLakeHouseTransfer 16 3.0 GiB 2025/12/16 00:01:18 spark FINISHED 22 min
app-20251215235433-0064 DataLakeHouseTransfer 12 2.0 GiB 2025/12/15 23:54:33 spark FINISHED 27 min
app-20251215235030-0063 MonolithMediaAgenciesMediaExportJob 10 4.0 GiB 2025/12/15 23:50:30 root FINISHED 30 min
app-20251215234849-0062 DataLakeHouseTransfer 18 2.0 GiB 2025/12/15 23:48:49 spark FINISHED 1.1 min
app-20251215234627-0061 MonolithMediaDetailsExportJob 18 4.0 GiB 2025/12/15 23:46:27 root FINISHED 2.7 min
app-20251215234626-0060 MonolithEthnicitiesExportJob 18 4.0 GiB 2025/12/15 23:46:26 root FINISHED 49 s
app-20251215234232-0059 DataLakeHouseTransfer 16 2.0 GiB 2025/12/15 23:42:32 spark FINISHED 3.5 min
app-20251215234050-0058 MonolithMediaReleaseExportJob 18 4.0 GiB 2025/12/15 23:40:50 root FINISHED 4.4 min
app-20251215234046-0057 MonolithPropertyReleasesExportJob 18 4.0 GiB 2025/12/15 23:40:46 root FINISHED 3.9 min
app-20251215234029-0056 MonolithModelReleasesExportJob 16 4.0 GiB 2025/12/15 23:40:29 root FINISHED 1.3 min
app-20251215230347-0055 DataLakeHouseTransfer 12 2.0 GiB 2025/12/15 23:03:47 spark FINISHED 36 min
app-20251215230054-0054 MonolithKeywordsExportJob 10 4.0 GiB 2025/12/15 23:00:54 root FINISHED 38 min
app-20251215230052-0053 MonolithMediaExportJob 12 4.0 GiB 2025/12/15 23:00:52 root FINISHED 8.3 min
app-20251215225416-0052 DataLakeHouseTransfer 30 2.0 GiB 2025/12/15 22:54:16 spark FINISHED 1.0 min
app-20251215224927-0051 DataLakeHouseTransfer 30 2.0 GiB 2025/12/15 22:49:27 spark FINISHED 53 s
app-20251215224402-0050 DataLakeHouseTransfer 28 2.0 GiB 2025/12/15 22:44:02 spark FINISHED 1.4 min
app-20251215223642-0049 DataLakeHouseTransfer 24 2.0 GiB 2025/12/15 22:36:42 spark FINISHED 1.2 min
app-20251215222924-0048 DataLakeHouseTransfer 16 2.0 GiB 2025/12/15 22:29:24 spark FINISHED 1.2 min
app-20251215222423-0047 DataLakeHouseTransfer 12 2.0 GiB 2025/12/15 22:24:23 spark FINISHED 39 s
app-20251215222044-0046 DataLakeHouseTransfer 6 2.0 GiB 2025/12/15 22:20:44 spark FINISHED 1.4 min
app-20251215220829-0045 DataLakeHouseTransfer 10 2.0 GiB 2025/12/15 22:08:29 spark FINISHED 40 s
app-20251215220552-0044 DataLakeHouseTransfer 8 2.0 GiB 2025/12/15 22:05:52 spark FINISHED 56 s
app-20251215212706-0043 AgenciesChannelManagerAgencyMediaExportJob 14 4.0 GiB 2025/12/15 21:27:06 root FINISHED 1.4 min
app-20251215212418-0042 AgenciesChannelManagerAgencyMediaExportJob 16 4.0 GiB 2025/12/15 21:24:18 root FINISHED 1.7 min
app-20251215212115-0041 sequential-editing3-mapping-load 14 3.0 GiB 2025/12/15 21:21:15 spark FINISHED 1.9 min
app-20251215212023-0040 AgenciesChannelManagerAgencyMediaMainExportJob 14 4.0 GiB 2025/12/15 21:20:23 root FINISHED 2.3 min
app-20251215210756-0039 DataLakeHouseTransfer 8 3.0 GiB 2025/12/15 21:07:56 spark FINISHED 12 min
app-20251215210337-0038 data-program-exports-load 8 3.0 GiB 2025/12/15 21:03:37 spark FINISHED 15 min
app-20251215210304-0037 AgenciesChannelManagerAgencyMediaExportJob 8 4.0 GiB 2025/12/15 21:03:04 root FINISHED 15 min
app-20251215210100-0036 AgenciesChannelManagerSaleExportJob 8 4.0 GiB 2025/12/15 21:01:00 root FINISHED 1.1 min
app-20251215210038-0035 exports-google-sheet 6 1024.0 MiB 2025/12/15 21:00:38 spark FINISHED 37 s
app-20251215204143-0034 DataLakeHouseTransfer 18 3.0 GiB 2025/12/15 20:41:43 spark FINISHED 5.3 min
app-20251215202511-0033 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 20:25:11 spark FINISHED 48 s
app-20251215200259-0032 DataLakeHouseTransfer 10 3.0 GiB 2025/12/15 20:02:59 spark FINISHED 3.1 min
app-20251215200240-0031 DataLakeHouseTransfer 10 3.0 GiB 2025/12/15 20:02:40 spark FINISHED 2.7 min
app-20251215200237-0030 DataLakeHouseTransfer 8 3.0 GiB 2025/12/15 20:02:37 spark FINISHED 1.3 min
app-20251215200236-0029 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 20:02:36 spark FINISHED 56 s
app-20251215200206-0028 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 20:02:06 spark FINISHED 44 s
app-20251215154917-0027 DataLakeHouseTransfer 18 3.0 GiB 2025/12/15 15:49:17 spark FINISHED 5.9 min
app-20251215151439-0026 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 15:14:39 spark FINISHED 49 s
app-20251215150344-0025 DataLakeHouseTransfer 8 3.0 GiB 2025/12/15 15:03:44 spark FINISHED 2.3 min
app-20251215150223-0024 DataLakeHouseTransfer 8 3.0 GiB 2025/12/15 15:02:23 spark FINISHED 2.9 min
app-20251215150159-0023 DataLakeHouseTransfer 8 3.0 GiB 2025/12/15 15:01:59 spark FINISHED 2.9 min
app-20251215150155-0022 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 15:01:55 spark FINISHED 1.1 min
app-20251215150146-0021 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 15:01:46 spark FINISHED 43 s
app-20251215114303-0020 DataLakeHouseTransfer 16 3.0 GiB 2025/12/15 11:43:03 spark FINISHED 5.7 min
app-20251215112422-0019 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 11:24:22 spark FINISHED 52 s
app-20251215110410-0018 DataLakeHouseTransfer 8 3.0 GiB 2025/12/15 11:04:10 spark FINISHED 2.6 min
app-20251215110410-0017 DataLakeHouseTransfer 8 3.0 GiB 2025/12/15 11:04:10 spark FINISHED 1.9 min
app-20251215110324-0016 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 11:03:24 spark FINISHED 1.8 min
app-20251215110238-0015 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 11:02:38 spark FINISHED 2.2 min
app-20251215110226-0014 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 11:02:26 spark FINISHED 1.5 min
app-20251215083027-0013 DataLakeHouseTransfer 18 3.0 GiB 2025/12/15 08:30:27 spark FINISHED 5.2 min
app-20251215081805-0012 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 08:18:05 spark FINISHED 55 s
app-20251215080255-0011 DataLakeHouseTransfer 10 3.0 GiB 2025/12/15 08:02:55 spark FINISHED 3.4 min
app-20251215080255-0010 DataLakeHouseTransfer 8 3.0 GiB 2025/12/15 08:02:55 spark FINISHED 2.7 min
app-20251215080240-0009 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 08:02:40 spark FINISHED 1.5 min
app-20251215080226-0008 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 08:02:26 spark FINISHED 1.1 min
app-20251215080226-0007 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 08:02:26 spark FINISHED 31 s
app-20251215052654-0006 DataLakeHouseTransfer 16 3.0 GiB 2025/12/15 05:26:54 spark FINISHED 5.4 min
app-20251215051409-0005 DataLakeHouseTransfer 12 3.0 GiB 2025/12/15 05:14:09 spark FINISHED 42 s
app-20251215050321-0004 DataLakeHouseTransfer 10 3.0 GiB 2025/12/15 05:03:21 spark FINISHED 7.2 min
app-20251215050240-0003 DataLakeHouseTransfer 8 3.0 GiB 2025/12/15 05:02:40 spark FINISHED 7.2 min
app-20251215050240-0002 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 05:02:40 spark FINISHED 6.8 min
app-20251215050236-0001 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 05:02:36 spark FINISHED 6.1 min
app-20251215050233-0000 DataLakeHouseTransfer 6 3.0 GiB 2025/12/15 05:02:33 spark FINISHED 5.6 min