Storage

RDDs (44)

ID RDD Name Storage Level Cached Partitions Fraction Cached Size in Memory Size on Disk
6602 Delta Table State #7 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-product-productplant/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 5.0 KiB 0.0 B
6636 Delta Table State #499 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-sourceofsupply-sourceofsupply/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 5.9 KiB 0.0 B
6661 Delta Table State with Stats #7 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-product-productplant/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 2.5 KiB 0.0 B
6667 Delta Table State with Stats #499 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-sourceofsupply-sourceofsupply/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 2.7 KiB 0.0 B
6682 Delta Table State #2 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-product-product-v2/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 3.1 KiB 0.0 B
6686 Delta Table State with Stats #2 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-product-product-v2/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 1985.0 B 0.0 B
6769 Delta Table State #146 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/order-grouping-profile/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 5.1 KiB 0.0 B
6773 Delta Table State with Stats #146 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/order-grouping-profile/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 2.7 KiB 0.0 B
7127 Delta Table State #384 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 8.2 KiB 0.0 B
7131 Delta Table State with Stats #384 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 2.4 KiB 0.0 B
7182 Delta Table State #145 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/constraint-profile/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 4.7 KiB 0.0 B
7201 Delta Table State #2 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-common-unitofmeasurecodes-v2/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 2.0 KiB 0.0 B
7226 Delta Table State #164 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/supplier-minimum-profile/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 11.3 KiB 0.0 B
7421 Delta Table State #9 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/uom-category/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 4.3 KiB 0.0 B
7425 Delta Table State with Stats #9 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/uom-category/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 3.0 KiB 0.0 B
7442 Delta Table State #311 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/insight-configuration/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 6.9 KiB 0.0 B
7446 Delta Table State with Stats #311 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/insight-configuration/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 1799.0 B 0.0 B
7559 Delta Table State #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000002104/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 18.4 KiB 0.0 B
7563 Delta Table State with Stats #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000002104/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 10.6 KiB 0.0 B
7793 Delta Table State #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/order-proposal-snapshot/10000002104/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 5.5 KiB 0.0 B
7797 Delta Table State with Stats #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/order-proposal-snapshot/10000002104/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 4.0 KiB 0.0 B
7810 Delta Table State #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/common-data-snapshot/10000002104/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 1947.0 B 0.0 B
8433 Delta Table State with Stats #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/common-data-snapshot/10000002104/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 1275.0 B 0.0 B
11507 Delta Table State #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000002105/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 202.4 KiB 0.0 B
11511 Delta Table State with Stats #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000002105/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 133.6 KiB 0.0 B
11740 Delta Table State #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/order-proposal-snapshot/10000002105/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 41.5 KiB 0.0 B
11744 Delta Table State with Stats #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/order-proposal-snapshot/10000002105/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 32.9 KiB 0.0 B
11757 Delta Table State #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/common-data-snapshot/10000002105/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 1947.0 B 0.0 B
12403 Delta Table State with Stats #0 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/common-data-snapshot/10000002105/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 1275.0 B 0.0 B
17303 MapPartitionsRDD Disk Memory Serialized 2x Replicated 20 100.00% 26.1 KiB 0.0 B
17563 MapPartitionsRDD Disk Memory Serialized 2x Replicated 20 100.00% 21.6 KiB 0.0 B
18451 MapPartitionsRDD Disk Memory Serialized 2x Replicated 20 100.00% 26.3 KiB 0.0 B
18711 MapPartitionsRDD Disk Memory Serialized 2x Replicated 20 100.00% 20.6 KiB 0.0 B
19599 MapPartitionsRDD Disk Memory Serialized 2x Replicated 20 100.00% 26.5 KiB 0.0 B
19859 MapPartitionsRDD Disk Memory Serialized 2x Replicated 20 100.00% 21.1 KiB 0.0 B
20653 MapPartitionsRDD Disk Memory Serialized 2x Replicated 20 100.00% 26.6 KiB 0.0 B
20913 MapPartitionsRDD Disk Memory Serialized 2x Replicated 20 100.00% 21.3 KiB 0.0 B
21703 MapPartitionsRDD Disk Memory Serialized 2x Replicated 20 100.00% 26.7 KiB 0.0 B
21771 *(3) Project [shardId#454625, worklistShardItemId#454703L, version#454712, product#454773, plant#454768, availabilityDateTime#454775 AS periodStart#454812, nextAvailabilityDateTime#454776 AS periodEnd#454813, qty#454708] +- *(3) BroadcastHashJoin [worklistShardItemId#454703L], [worklistShardItemId#454787L], LeftOuter, BuildRight, (shardId#454625 = 0_1_10000002105), false :- *(3) Project [shardId#454625, worklistShardItemId#454703L, qty#454708, element_at([1], ((cast(array_position([0_1_10000002105], shardId#454625) as int) - 1) + 1), None, false) AS version#454712] : +- *(3) Generate explode(requestedQuantities#454706), [shardId#454625, worklistShardItemId#454703L], false, [qty#454708] : +- *(3) Project [shardId#454625, item#454702.worklistShardItemId AS worklistShardItemId#454703L, item#454702.requestedQuantities AS requestedQuantities#454706] : +- *(3) Filter ((size(item#454702.requestedQuantities, true) > 0) AND isnotnull(item#454702.requestedQuantities)) : +- *(3) G... Disk Memory Serialized 2x Replicated 20 100.00% 25.2 KiB 0.0 B
21963 MapPartitionsRDD Disk Memory Serialized 2x Replicated 20 100.00% 21.4 KiB 0.0 B
22002 *(1) Filter (isnotnull(shardId#456966) AND (shardId#456966 = 0_1_10000002105)) +- *(1) Scan ExistingRDD[shardId#456966,orderProposalId#456967L,items#456968,optimizationGroups#456969,isOptimal#456970,lastModified#456971,optimizationInsights#456972] Disk Memory Serialized 2x Replicated 20 100.00% 41.5 KiB 0.0 B
22069 Delta Table State #10 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/out/order-proposal-quantities/10000002105/stream-10000002105-1/shardId=0_1_10000002105/_delta_log Disk Memory Serialized 1x Replicated 50 100.00% 67.2 KiB 0.0 B
22178 Project [shardId#456966, named_struct(orderProposalId, _extract_orderProposalId#460074L, originalReplenishmentRunId, _extract_originalReplenishmentRunId#460066L, supplierGroup, _extract_supplierGroup#460067, optimizationGroups, coalesce(optimizationGroups#459319, []), supplier, _extract_supplier#460068, supplyingPlant, _extract_supplyingPlant#460069, orderDateTime, _extract_orderDateTime#460070, itemGroups, _extract_itemGroups#460071, previousOrderProposals, _extract_previousOrderProposals#460072, parentItems, _extract_parentItems#460073) AS orderProposal#459426] +- SortMergeJoin [coalesce(shardId#456966, ), isnull(shardId#456966), coalesce(_extract_orderProposalId#460074L, 0), isnull(_extract_orderProposalId#460074L)], [coalesce(shardId#459322, ), isnull(shardId#459322), coalesce(orderProposalId#459323L, 0), isnull(orderProposalId#459323L)], LeftOuter :- Sort [coalesce(shardId#456966, ) ASC NULLS FIRST, isnull(shardId#456966) ASC NULLS FIRST, coalesce(_extract_orderProposalId#460074L, 0) ASC NULLS FIRS... Disk Memory Serialized 2x Replicated 20 100.00% 840.0 B 0.0 B
22198 ObjectHashAggregate(keys=[shardId#456966, resultSeparationId#461178L], functions=[collect_list(orderProposal#459426, 0, 0)], output=[shardId#456966, resultSeparationId#461178L, orderProposals#461182]) +- Exchange hashpartitioning(shardId#456966, resultSeparationId#461178L, 20), ENSURE_REQUIREMENTS, [plan_id=192380] +- ObjectHashAggregate(keys=[shardId#456966, resultSeparationId#461178L], functions=[partial_collect_list(orderProposal#459426, 0, 0)], output=[shardId#456966, resultSeparationId#461178L, buf#461218]) +- Project [shardId#456966, orderProposal#459426, CASE WHEN (size(orderProposal#459426.parentItems, true) > 2000) THEN xxhash64(orderProposal#459426.orderProposalId, 42) ELSE xxhash64(pmod(cast(orderProposal#459426.orderProposalId as decimal(20,0)), 0), 42) END AS resultSeparationId#461178L] +- InMemoryTableScan [orderProposal#459426, shardId#456966] +- InMemoryRelation [shardId#456966, orderProposal#459426], StorageLevel(disk, memory, 2 replicas) ... Disk Memory Serialized 2x Replicated 20 100.00% 840.0 B 0.0 B