crp-order-qty-opt-service - Details for Query 3867

Submitted Time: 2026/08/10 12:27:25
Duration: 3 s
Succeeded Jobs: 5854 5855 5856 5858 5859 5860 5861 5862 5863

Plan Visualization

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [id="node0" labelType="html" label=" AdaptiveSparkPlan " tooltip="AdaptiveSparkPlan isFinalPlan=false"]; 1 [id="node1" labelType="html" label="ObjectHashAggregate number of output rows: 18 time in aggregation build: 51 ms spill size: 0.0 B number of sort fallback tasks: 0" tooltip="ObjectHashAggregate(keys=[supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905804, productGroup#905227], functions=[collect_list(struct#905378, 0, 0)])"]; 2 [id="node2" labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 9.2 KiB number of coalesced partitions: 1" tooltip="AQEShuffleRead coalesced"]; 3 [id="node3" labelType="html" label="Exchange shuffle records written: 21 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 21 local bytes read: 2.8 KiB merged fetch fallback count: 0 local blocks read: 6 remote merged chunks fetched: 0 remote blocks read: 15 data size total (min, med, max (stageId: taskId)) 9.3 KiB (1152.0 B, 1296.0 B, 2.5 KiB (stage 76134.0: task 185513)) local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 3 ms (0 ms, 0 ms, 0 ms (stage 76134.0: task 185510)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 6.0 KiB number of partitions: 25 remote reqs duration: 1 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 8.7 KiB (1107.0 B, 1281.0 B, 2.5 KiB (stage 76134.0: task 185513))" tooltip="Exchange hashpartitioning(supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905804, productGroup#905227, 25), ENSURE_REQUIREMENTS, [plan_id=352552]"]; 4 [id="node4" labelType="html" label="ObjectHashAggregate number of output rows: 21 time in aggregation build total (min, med, max (stageId: taskId)) 624 ms (0 ms, 0 ms, 105 ms (stage 76134.0: task 185513)) spill size total (min, med, max (stageId: taskId)) 0.0 B (0.0 B, 0.0 B, 0.0 B (stage 76134.0: task 185510)) number of sort fallback tasks: 0" tooltip="ObjectHashAggregate(keys=[supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null AS null#905804, productGroup#905227], functions=[partial_collect_list(struct#905378, 0, 0)])"]; subgraph cluster5 { isCluster="true"; id="cluster5"; label="WholeStageCodegen (7)\n \nduration: total (min, med, max (stageId: taskId))\n879 ms (0 ms, 0 ms, 129 ms (stage 76134.0: task 185510))"; tooltip="WholeStageCodegen (7)"; 6 [id="node6" labelType="html" label=" Project " tooltip="Project [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, productGroup#905227, struct(product, product#905365, orderDateTime, orderDateTime#905369, availabilityDateTime, availabilityDateTime#905371, nextAvailabilityDateTime, nextAvailabilityDateTime#905373, mrpController, mrpController#905176, sourceOfSupplyUuid, sourceOfSupplyUuid#905368, purchasingOrg, purchasingOrg#905208, purchasingGroup, purchasingGroup#905207, isFallbackOrderOnly, isFallbackOrderOnly#905375) AS struct#905378]"]; 7 [id="node7" labelType="html" label="BroadcastHashJoin number of output rows: 24" tooltip="BroadcastHashJoin [product#905365], [product#905226], LeftOuter, BuildRight, false"]; 8 [id="node8" labelType="html" label=" Project " tooltip="Project [sourceOfSupplyUuid#905368, plant#905366, product#905365, supplier#905367, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375, mrpController#905176, subrange#905206, purchasingGroup#905207, purchasingOrg#905208]"]; 9 [id="node9" labelType="html" label="BroadcastHashJoin number of output rows: 24" tooltip="BroadcastHashJoin [sourceOfSupplyUuid#905368], [sourceOfSupplyUuid#905205], LeftOuter, BuildRight, false"]; 10 [id="node10" labelType="html" label=" Project " tooltip="Project [plant#905366, product#905365, supplier#905367, sourceOfSupplyUuid#905368, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375, mrpController#905176]"]; 11 [id="node11" labelType="html" label="BroadcastHashJoin number of output rows: 24" tooltip="BroadcastHashJoin [plant#905366, product#905365], [plant#905175, product#905174], LeftOuter, BuildRight, false"]; } 12 [id="node12" labelType="html" label="Exchange shuffle records written: 24 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 24 local bytes read total (min, med, max (stageId: taskId)) 2041.0 B (313.0 B, 328.0 B, 418.0 B (stage 76134.0: task 185512)) merged fetch fallback count: 0 local blocks read: 6 remote merged chunks fetched: 0 remote blocks read: 1 data size total (min, med, max (stageId: taskId)) 5.2 KiB (648.0 B, 672.0 B, 1344.0 B (stage 76121.0: task 185380)) local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 3 ms (0 ms, 0 ms, 0 ms (stage 76121.0: task 185375)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 76134.0: task 185510)) remote bytes read: 327.0 B number of partitions: 25 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 2.3 KiB (313.0 B, 327.0 B, 418.0 B (stage 76121.0: task 185380))" tooltip="Exchange hashpartitioning(product#905365, plant#905366, 25), REPARTITION_BY_NUM, [plan_id=351980]"]; subgraph cluster13 { isCluster="true"; id="cluster13"; label="WholeStageCodegen (1)\n \nduration: total (min, med, max (stageId: taskId))\n1.2 s (153 ms, 169 ms, 179 ms (stage 76121.0: task 185378))"; tooltip="WholeStageCodegen (1)"; 14 [id="node14" labelType="html" label="ColumnarToRow number of output rows: 24 number of input batches: 7" tooltip="ColumnarToRow"]; } 15 [id="node15" labelType="html" label="Scan parquet number of files read: 7 scan time total (min, med, max (stageId: taskId)) 880 ms (115 ms, 125 ms, 143 ms (stage 76121.0: task 185375)) metadata time: 0 ms size of files read: 28.8 KiB number of output rows: 24" tooltip="FileScan parquet [product#905365,plant#905366,supplier#905367,sourceOfSupplyUuid#905368,orderDateTime#905369,deliveryDateTime#905370,availabilityDateTime#905371,supplierGroup#905372,nextAvailabilityDateTime#905373,isFallBackOrderOnly#905375] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanac..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<product:string,plant:string,supplier:string,sourceOfSupplyUuid:string,orderDateTime:timest..."]; 16 [id="node16" labelType="html" label="BroadcastExchange time to broadcast: 2 ms time to build: 8 ms time to collect: 47 ms number of output rows: 2,747 data size: 2.1 MiB" tooltip="BroadcastExchange HashedRelationBroadcastMode(List(input[1, string, true], input[0, string, true]),false), [plan_id=352454]"]; 17 [id="node17" labelType="html" label="Exchange shuffle records written: 2,747 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 2,747 local bytes read total (min, med, max (stageId: taskId)) 134.8 KiB (5.2 KiB, 5.4 KiB, 5.8 KiB (stage 76132.0: task 185494)) merged fetch fallback count: 0 local blocks read: 25 remote merged chunks fetched: 0 remote blocks read: 0 data size: 318.9 KiB local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 76132.0: task 185485)) remote bytes read: 0.0 B number of partitions: 25 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 134.8 KiB" tooltip="Exchange RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=351996]"]; subgraph cluster18 { isCluster="true"; id="cluster18"; label="WholeStageCodegen (2)\n \nduration: 98 ms"; tooltip="WholeStageCodegen (2)"; 19 [id="node19" labelType="html" label=" Project " tooltip="Project [product#905169.internalRefUUID AS product#905174, plant#905168.internalRefUUID AS plant#905175, productionAspect#905171.productPlanningPlants.mrpController.internalRefUUID AS mrpController#905176]"]; 20 [id="node20" labelType="html" label="Filter number of output rows: 2,747" tooltip="Filter (isnotnull(plant#905168.internalRefUUID) AND isnotnull(product#905169.internalRefUUID))"]; 21 [id="node21" labelType="html" label="ColumnarToRow number of output rows: 2,747 number of input batches: 1" tooltip="ColumnarToRow"]; } 22 [id="node22" labelType="html" label="Scan parquet number of files read: 1 scan time: 94 ms dynamic partition pruning time: 0 ms metadata time: 349 ms size of files read: 179.9 KiB number of output rows: 2,747 number of partitions read: 1" tooltip="FileScan parquet [plant#905168,product#905169,productionAspect#905171,systemId#905166] Batched: true, DataFilters: [isnotnull(plant#905168.internalRefUUID), isnotnull(product#905169.internalRefUUID)], Format: Parquet, Location: PreparedDeltaFileIndex(1 paths)[hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20...., PartitionFilters: [], PushedFilters: [IsNotNull(plant.internalRefUUID), IsNotNull(product.internalRefUUID)], ReadSchema: struct<plant:struct<internalRefUUID:string>,product:struct<internalRefUUID:string>,productionAspe..."]; 23 [id="node23" labelType="html" label="BroadcastExchange time to broadcast: 52 ms time to build: 14 ms time to collect: 105 ms number of output rows: 4,343 data size: 2.3 MiB" tooltip="BroadcastExchange HashedRelationBroadcastMode(List(input[0, string, true]),false), [plan_id=352294]"]; subgraph cluster24 { isCluster="true"; id="cluster24"; label="WholeStageCodegen (6)\n \nduration: total (min, med, max (stageId: taskId))\n0 ms (0 ms, 0 ms, 0 ms (stage 76129.0: task 185431))"; tooltip="WholeStageCodegen (6)"; 25 [id="node25" labelType="html" label=" Project " tooltip="Project [internalUUID#905182 AS sourceOfSupplyUuid#905205, supplierSubrange#905197 AS subrange#905206, _extract_internalRefUUID#905491 AS purchasingGroup#905207, _extract_internalRefUUID#905490 AS purchasingOrg#905208]"]; } 26 [id="node26" labelType="html" label="Exchange shuffle records written: 4,343 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 4,343 local bytes read total (min, med, max (stageId: taskId)) 177.8 KiB (7.0 KiB, 7.1 KiB, 7.2 KiB (stage 76129.0: task 185457)) merged fetch fallback count: 0 local blocks read: 25 remote merged chunks fetched: 0 remote blocks read: 0 data size: 522.9 KiB local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 76129.0: task 185431)) remote bytes read: 0.0 B number of partitions: 25 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 177.8 KiB" tooltip="Exchange RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=352018]"]; subgraph cluster27 { isCluster="true"; id="cluster27"; label="WholeStageCodegen (3)\n \nduration: 166 ms"; tooltip="WholeStageCodegen (3)"; 28 [id="node28" labelType="html" label=" Project " tooltip="Project [internalUUID#905182, purchasingGroup#905188.internalRefUUID AS _extract_internalRefUUID#905491, purchasingOrganization#905189.internalRefUUID AS _extract_internalRefUUID#905490, supplierSubrange#905197]"]; 29 [id="node29" labelType="html" label="Filter number of output rows: 4,343" tooltip="Filter isnotnull(internalUUID#905182)"]; 30 [id="node30" labelType="html" label="ColumnarToRow number of output rows: 4,343 number of input batches: 2" tooltip="ColumnarToRow"]; } 31 [id="node31" labelType="html" label="Scan parquet number of files read: 1 scan time: 158 ms dynamic partition pruning time: 0 ms metadata time: 0 ms size of files read: 315.0 KiB number of output rows: 4,343 number of partitions read: 1" tooltip="FileScan parquet [internalUUID#905182,purchasingGroup#905188,purchasingOrganization#905189,supplierSubrange#905197,systemId#905181] Batched: true, DataFilters: [isnotnull(internalUUID#905182)], Format: Parquet, Location: PreparedDeltaFileIndex(1 paths)[hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20...., PartitionFilters: [], PushedFilters: [IsNotNull(internalUUID)], ReadSchema: struct<internalUUID:string,purchasingGroup:struct<internalRefUUID:string>,purchasingOrganization:..."]; 32 [id="node32" labelType="html" label="BroadcastExchange time to broadcast: 1 ms time to build: 8 ms time to collect: 110 ms number of output rows: 159 data size: 2.0 MiB" tooltip="BroadcastExchange HashedRelationBroadcastMode(List(input[0, string, true]),false), [plan_id=352221]"]; subgraph cluster33 { isCluster="true"; id="cluster33"; label="WholeStageCodegen (5)\n \nduration: total (min, med, max (stageId: taskId))\n2 ms (0 ms, 0 ms, 1 ms (stage 76127.0: task 185424))"; tooltip="WholeStageCodegen (5)"; 34 [id="node34" labelType="html" label=" Project " tooltip="Project [internalUUID#905213 AS product#905226, null AS productGroup#905227]"]; } 35 [id="node35" labelType="html" label="Exchange shuffle records written: 159 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 159 local bytes read total (min, med, max (stageId: taskId)) 7.5 KiB (289.0 B, 299.0 B, 336.0 B (stage 76127.0: task 185446)) merged fetch fallback count: 0 local blocks read: 25 remote merged chunks fetched: 0 remote blocks read: 0 data size: 7.5 KiB local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time total (min, med, max (stageId: taskId)) 0 ms (0 ms, 0 ms, 0 ms (stage 76127.0: task 185424)) remote bytes read: 0.0 B number of partitions: 25 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 7.5 KiB" tooltip="Exchange RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=352041]"]; subgraph cluster36 { isCluster="true"; id="cluster36"; label="WholeStageCodegen (4)\n \nduration: 160 ms"; tooltip="WholeStageCodegen (4)"; 37 [id="node37" labelType="html" label=" Project " tooltip="Project [internalUUID#905213]"]; 38 [id="node38" labelType="html" label="Filter number of output rows: 159" tooltip="Filter isnotnull(internalUUID#905213)"]; 39 [id="node39" labelType="html" label="ColumnarToRow number of output rows: 159 number of input batches: 1" tooltip="ColumnarToRow"]; } 40 [id="node40" labelType="html" label="Scan parquet number of files read: 1 scan time: 152 ms dynamic partition pruning time: 0 ms metadata time: 0 ms size of files read: 36.0 KiB number of output rows: 159 number of partitions read: 1" tooltip="FileScan parquet [internalUUID#905213,systemId#905212] Batched: true, DataFilters: [isnotnull(internalUUID#905213)], Format: Parquet, Location: PreparedDeltaFileIndex(1 paths)[hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20...., PartitionFilters: [], PushedFilters: [IsNotNull(internalUUID)], ReadSchema: struct<internalUUID:string>"]; 1->0; 2->1; 3->2; 4->3; 6->4; 7->6; 8->7; 9->8; 10->9; 11->10; 12->11; 14->12; 15->14; 16->11; 17->16; 19->17; 20->19; 21->20; 22->21; 23->9; 25->23; 26->25; 28->26; 29->28; 30->29; 31->30; 32->7; 34->32; 35->34; 37->35; 38->37; 39->38; 40->39; }

Details

== Physical Plan ==
AdaptiveSparkPlan (67)
+- == Current Plan ==
   ResultQueryStage (42)
   +- ObjectHashAggregate (41)
      +- AQEShuffleRead (40)
         +- ShuffleQueryStage (39), Statistics(sizeInBytes=9.3 KiB, rowCount=21)
            +- Exchange (38)
               +- ObjectHashAggregate (37)
                  +- * Project (36)
                     +- * BroadcastHashJoin LeftOuter BuildRight (35)
                        :- * Project (25)
                        :  +- * BroadcastHashJoin LeftOuter BuildRight (24)
                        :     :- * Project (14)
                        :     :  +- * BroadcastHashJoin LeftOuter BuildRight (13)
                        :     :     :- ShuffleQueryStage (4), Statistics(sizeInBytes=5.2 KiB, rowCount=24)
                        :     :     :  +- Exchange (3)
                        :     :     :     +- * ColumnarToRow (2)
                        :     :     :        +- Scan parquet  (1)
                        :     :     +- BroadcastQueryStage (12), Statistics(sizeInBytes=2.1 MiB, rowCount=2.75E+3)
                        :     :        +- BroadcastExchange (11)
                        :     :           +- ShuffleQueryStage (10), Statistics(sizeInBytes=318.9 KiB, rowCount=2.75E+3)
                        :     :              +- Exchange (9)
                        :     :                 +- * Project (8)
                        :     :                    +- * Filter (7)
                        :     :                       +- * ColumnarToRow (6)
                        :     :                          +- Scan parquet  (5)
                        :     +- BroadcastQueryStage (23), Statistics(sizeInBytes=2.3 MiB, rowCount=4.34E+3)
                        :        +- BroadcastExchange (22)
                        :           +- * Project (21)
                        :              +- ShuffleQueryStage (20), Statistics(sizeInBytes=522.9 KiB, rowCount=4.34E+3)
                        :                 +- Exchange (19)
                        :                    +- * Project (18)
                        :                       +- * Filter (17)
                        :                          +- * ColumnarToRow (16)
                        :                             +- Scan parquet  (15)
                        +- BroadcastQueryStage (34), Statistics(sizeInBytes=2.0 MiB, rowCount=159)
                           +- BroadcastExchange (33)
                              +- * Project (32)
                                 +- ShuffleQueryStage (31), Statistics(sizeInBytes=7.5 KiB, rowCount=159)
                                    +- Exchange (30)
                                       +- * Project (29)
                                          +- * Filter (28)
                                             +- * ColumnarToRow (27)
                                                +- Scan parquet  (26)
+- == Initial Plan ==
   ObjectHashAggregate (66)
   +- Exchange (65)
      +- ObjectHashAggregate (64)
         +- Project (63)
            +- BroadcastHashJoin LeftOuter BuildRight (62)
               :- Project (56)
               :  +- BroadcastHashJoin LeftOuter BuildRight (55)
               :     :- Project (49)
               :     :  +- BroadcastHashJoin LeftOuter BuildRight (48)
               :     :     :- Exchange (43)
               :     :     :  +- Scan parquet  (1)
               :     :     +- BroadcastExchange (47)
               :     :        +- Exchange (46)
               :     :           +- Project (45)
               :     :              +- Filter (44)
               :     :                 +- Scan parquet  (5)
               :     +- BroadcastExchange (54)
               :        +- Project (53)
               :           +- Exchange (52)
               :              +- Project (51)
               :                 +- Filter (50)
               :                    +- Scan parquet  (15)
               +- BroadcastExchange (61)
                  +- Project (60)
                     +- Exchange (59)
                        +- Project (58)
                           +- Filter (57)
                              +- Scan parquet  (26)


(1) Scan parquet 
Output [10]: [product#905365, plant#905366, supplier#905367, sourceOfSupplyUuid#905368, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375]
Batched: true
Location: InMemoryFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-workload-determination-service/out/workload-determination-result/10000002110/results]
ReadSchema: struct<product:string,plant:string,supplier:string,sourceOfSupplyUuid:string,orderDateTime:timestamp,deliveryDateTime:timestamp,availabilityDateTime:timestamp,supplierGroup:string,nextAvailabilityDateTime:timestamp,isFallBackOrderOnly:boolean>

(2) ColumnarToRow [codegen id : 1]
Input [10]: [product#905365, plant#905366, supplier#905367, sourceOfSupplyUuid#905368, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375]

(3) Exchange
Input [10]: [product#905365, plant#905366, supplier#905367, sourceOfSupplyUuid#905368, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375]
Arguments: hashpartitioning(product#905365, plant#905366, 25), REPARTITION_BY_NUM, [plan_id=351980]

(4) ShuffleQueryStage
Output [10]: [product#905365, plant#905366, supplier#905367, sourceOfSupplyUuid#905368, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375]
Arguments: 0

(5) Scan parquet 
Output [4]: [plant#905168, product#905169, productionAspect#905171, systemId#905166]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-product-productplant]
PushedFilters: [IsNotNull(plant.internalRefUUID), IsNotNull(product.internalRefUUID)]
ReadSchema: struct<plant:struct<internalRefUUID:string>,product:struct<internalRefUUID:string>,productionAspect:struct<productPlanningPlants:struct<mrpController:struct<internalRefUUID:string>>>>

(6) ColumnarToRow [codegen id : 2]
Input [4]: [plant#905168, product#905169, productionAspect#905171, systemId#905166]

(7) Filter [codegen id : 2]
Input [4]: [plant#905168, product#905169, productionAspect#905171, systemId#905166]
Condition : (isnotnull(plant#905168.internalRefUUID) AND isnotnull(product#905169.internalRefUUID))

(8) Project [codegen id : 2]
Output [3]: [product#905169.internalRefUUID AS product#905174, plant#905168.internalRefUUID AS plant#905175, productionAspect#905171.productPlanningPlants.mrpController.internalRefUUID AS mrpController#905176]
Input [4]: [plant#905168, product#905169, productionAspect#905171, systemId#905166]

(9) Exchange
Input [3]: [product#905174, plant#905175, mrpController#905176]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=351996]

(10) ShuffleQueryStage
Output [3]: [product#905174, plant#905175, mrpController#905176]
Arguments: 1

(11) BroadcastExchange
Input [3]: [product#905174, plant#905175, mrpController#905176]
Arguments: HashedRelationBroadcastMode(List(input[1, string, true], input[0, string, true]),false), [plan_id=352454]

(12) BroadcastQueryStage
Output [3]: [product#905174, plant#905175, mrpController#905176]
Arguments: 6

(13) BroadcastHashJoin [codegen id : 7]
Left keys [2]: [plant#905366, product#905365]
Right keys [2]: [plant#905175, product#905174]
Join type: LeftOuter
Join condition: None

(14) Project [codegen id : 7]
Output [11]: [plant#905366, product#905365, supplier#905367, sourceOfSupplyUuid#905368, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375, mrpController#905176]
Input [13]: [product#905365, plant#905366, supplier#905367, sourceOfSupplyUuid#905368, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375, product#905174, plant#905175, mrpController#905176]

(15) Scan parquet 
Output [5]: [internalUUID#905182, purchasingGroup#905188, purchasingOrganization#905189, supplierSubrange#905197, systemId#905181]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-sourceofsupply-sourceofsupply]
PushedFilters: [IsNotNull(internalUUID)]
ReadSchema: struct<internalUUID:string,purchasingGroup:struct<internalRefUUID:string>,purchasingOrganization:struct<internalRefUUID:string>,supplierSubrange:string>

(16) ColumnarToRow [codegen id : 3]
Input [5]: [internalUUID#905182, purchasingGroup#905188, purchasingOrganization#905189, supplierSubrange#905197, systemId#905181]

(17) Filter [codegen id : 3]
Input [5]: [internalUUID#905182, purchasingGroup#905188, purchasingOrganization#905189, supplierSubrange#905197, systemId#905181]
Condition : isnotnull(internalUUID#905182)

(18) Project [codegen id : 3]
Output [4]: [internalUUID#905182, purchasingGroup#905188.internalRefUUID AS _extract_internalRefUUID#905491, purchasingOrganization#905189.internalRefUUID AS _extract_internalRefUUID#905490, supplierSubrange#905197]
Input [5]: [internalUUID#905182, purchasingGroup#905188, purchasingOrganization#905189, supplierSubrange#905197, systemId#905181]

(19) Exchange
Input [4]: [internalUUID#905182, _extract_internalRefUUID#905491, _extract_internalRefUUID#905490, supplierSubrange#905197]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=352018]

(20) ShuffleQueryStage
Output [4]: [internalUUID#905182, _extract_internalRefUUID#905491, _extract_internalRefUUID#905490, supplierSubrange#905197]
Arguments: 2

(21) Project [codegen id : 6]
Output [4]: [internalUUID#905182 AS sourceOfSupplyUuid#905205, supplierSubrange#905197 AS subrange#905206, _extract_internalRefUUID#905491 AS purchasingGroup#905207, _extract_internalRefUUID#905490 AS purchasingOrg#905208]
Input [4]: [internalUUID#905182, _extract_internalRefUUID#905491, _extract_internalRefUUID#905490, supplierSubrange#905197]

(22) BroadcastExchange
Input [4]: [sourceOfSupplyUuid#905205, subrange#905206, purchasingGroup#905207, purchasingOrg#905208]
Arguments: HashedRelationBroadcastMode(List(input[0, string, true]),false), [plan_id=352294]

(23) BroadcastQueryStage
Output [4]: [sourceOfSupplyUuid#905205, subrange#905206, purchasingGroup#905207, purchasingOrg#905208]
Arguments: 5

(24) BroadcastHashJoin [codegen id : 7]
Left keys [1]: [sourceOfSupplyUuid#905368]
Right keys [1]: [sourceOfSupplyUuid#905205]
Join type: LeftOuter
Join condition: None

(25) Project [codegen id : 7]
Output [14]: [sourceOfSupplyUuid#905368, plant#905366, product#905365, supplier#905367, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375, mrpController#905176, subrange#905206, purchasingGroup#905207, purchasingOrg#905208]
Input [15]: [plant#905366, product#905365, supplier#905367, sourceOfSupplyUuid#905368, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375, mrpController#905176, sourceOfSupplyUuid#905205, subrange#905206, purchasingGroup#905207, purchasingOrg#905208]

(26) Scan parquet 
Output [2]: [internalUUID#905213, systemId#905212]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-product-product-v2]
PushedFilters: [IsNotNull(internalUUID)]
ReadSchema: struct<internalUUID:string>

(27) ColumnarToRow [codegen id : 4]
Input [2]: [internalUUID#905213, systemId#905212]

(28) Filter [codegen id : 4]
Input [2]: [internalUUID#905213, systemId#905212]
Condition : isnotnull(internalUUID#905213)

(29) Project [codegen id : 4]
Output [1]: [internalUUID#905213]
Input [2]: [internalUUID#905213, systemId#905212]

(30) Exchange
Input [1]: [internalUUID#905213]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=352041]

(31) ShuffleQueryStage
Output [1]: [internalUUID#905213]
Arguments: 3

(32) Project [codegen id : 5]
Output [2]: [internalUUID#905213 AS product#905226, null AS productGroup#905227]
Input [1]: [internalUUID#905213]

(33) BroadcastExchange
Input [2]: [product#905226, productGroup#905227]
Arguments: HashedRelationBroadcastMode(List(input[0, string, true]),false), [plan_id=352221]

(34) BroadcastQueryStage
Output [2]: [product#905226, productGroup#905227]
Arguments: 4

(35) BroadcastHashJoin [codegen id : 7]
Left keys [1]: [product#905365]
Right keys [1]: [product#905226]
Join type: LeftOuter
Join condition: None

(36) Project [codegen id : 7]
Output [7]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, productGroup#905227, struct(product, product#905365, orderDateTime, orderDateTime#905369, availabilityDateTime, availabilityDateTime#905371, nextAvailabilityDateTime, nextAvailabilityDateTime#905373, mrpController, mrpController#905176, sourceOfSupplyUuid, sourceOfSupplyUuid#905368, purchasingOrg, purchasingOrg#905208, purchasingGroup, purchasingGroup#905207, isFallbackOrderOnly, isFallbackOrderOnly#905375) AS struct#905378]
Input [16]: [sourceOfSupplyUuid#905368, plant#905366, product#905365, supplier#905367, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375, mrpController#905176, subrange#905206, purchasingGroup#905207, purchasingOrg#905208, product#905226, productGroup#905227]

(37) ObjectHashAggregate
Input [7]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, productGroup#905227, struct#905378]
Keys [7]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null AS null#905804, productGroup#905227]
Functions [1]: [partial_collect_list(struct#905378, 0, 0)]
Aggregate Attributes [1]: [buf#905723]
Results [8]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905804, productGroup#905227, buf#905724]

(38) Exchange
Input [8]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905804, productGroup#905227, buf#905724]
Arguments: hashpartitioning(supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905804, productGroup#905227, 25), ENSURE_REQUIREMENTS, [plan_id=352552]

(39) ShuffleQueryStage
Output [8]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905804, productGroup#905227, buf#905724]
Arguments: 7

(40) AQEShuffleRead
Input [8]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905804, productGroup#905227, buf#905724]
Arguments: coalesced

(41) ObjectHashAggregate
Input [8]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905804, productGroup#905227, buf#905724]
Keys [7]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905804, productGroup#905227]
Functions [1]: [collect_list(struct#905378, 0, 0)]
Aggregate Attributes [1]: [collect_list(struct#905378, 0, 0)#905388]
Results [8]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null AS supplyingPlant#905377, productGroup#905227, collect_list(struct#905378, 0, 0)#905388 AS productOrderSchedule#905379]

(42) ResultQueryStage
Output [8]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, supplyingPlant#905377, productGroup#905227, productOrderSchedule#905379]
Arguments: 9

(43) Exchange
Input [10]: [product#905365, plant#905366, supplier#905367, sourceOfSupplyUuid#905368, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375]
Arguments: hashpartitioning(product#905365, plant#905366, 25), REPARTITION_BY_NUM, [plan_id=351891]

(44) Filter
Input [4]: [plant#905168, product#905169, productionAspect#905171, systemId#905166]
Condition : (isnotnull(plant#905168.internalRefUUID) AND isnotnull(product#905169.internalRefUUID))

(45) Project
Output [3]: [product#905169.internalRefUUID AS product#905174, plant#905168.internalRefUUID AS plant#905175, productionAspect#905171.productPlanningPlants.mrpController.internalRefUUID AS mrpController#905176]
Input [4]: [plant#905168, product#905169, productionAspect#905171, systemId#905166]

(46) Exchange
Input [3]: [product#905174, plant#905175, mrpController#905176]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=351895]

(47) BroadcastExchange
Input [3]: [product#905174, plant#905175, mrpController#905176]
Arguments: HashedRelationBroadcastMode(List(input[1, string, true], input[0, string, true]),false), [plan_id=351915]

(48) BroadcastHashJoin
Left keys [2]: [plant#905366, product#905365]
Right keys [2]: [plant#905175, product#905174]
Join type: LeftOuter
Join condition: None

(49) Project
Output [11]: [plant#905366, product#905365, supplier#905367, sourceOfSupplyUuid#905368, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375, mrpController#905176]
Input [13]: [product#905365, plant#905366, supplier#905367, sourceOfSupplyUuid#905368, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375, product#905174, plant#905175, mrpController#905176]

(50) Filter
Input [5]: [internalUUID#905182, purchasingGroup#905188, purchasingOrganization#905189, supplierSubrange#905197, systemId#905181]
Condition : isnotnull(internalUUID#905182)

(51) Project
Output [4]: [internalUUID#905182, purchasingGroup#905188.internalRefUUID AS _extract_internalRefUUID#905491, purchasingOrganization#905189.internalRefUUID AS _extract_internalRefUUID#905490, supplierSubrange#905197]
Input [5]: [internalUUID#905182, purchasingGroup#905188, purchasingOrganization#905189, supplierSubrange#905197, systemId#905181]

(52) Exchange
Input [4]: [internalUUID#905182, _extract_internalRefUUID#905491, _extract_internalRefUUID#905490, supplierSubrange#905197]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=351901]

(53) Project
Output [4]: [internalUUID#905182 AS sourceOfSupplyUuid#905205, supplierSubrange#905197 AS subrange#905206, _extract_internalRefUUID#905491 AS purchasingGroup#905207, _extract_internalRefUUID#905490 AS purchasingOrg#905208]
Input [4]: [internalUUID#905182, _extract_internalRefUUID#905491, _extract_internalRefUUID#905490, supplierSubrange#905197]

(54) BroadcastExchange
Input [4]: [sourceOfSupplyUuid#905205, subrange#905206, purchasingGroup#905207, purchasingOrg#905208]
Arguments: HashedRelationBroadcastMode(List(input[0, string, true]),false), [plan_id=351919]

(55) BroadcastHashJoin
Left keys [1]: [sourceOfSupplyUuid#905368]
Right keys [1]: [sourceOfSupplyUuid#905205]
Join type: LeftOuter
Join condition: None

(56) Project
Output [14]: [sourceOfSupplyUuid#905368, plant#905366, product#905365, supplier#905367, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375, mrpController#905176, subrange#905206, purchasingGroup#905207, purchasingOrg#905208]
Input [15]: [plant#905366, product#905365, supplier#905367, sourceOfSupplyUuid#905368, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375, mrpController#905176, sourceOfSupplyUuid#905205, subrange#905206, purchasingGroup#905207, purchasingOrg#905208]

(57) Filter
Input [2]: [internalUUID#905213, systemId#905212]
Condition : isnotnull(internalUUID#905213)

(58) Project
Output [1]: [internalUUID#905213]
Input [2]: [internalUUID#905213, systemId#905212]

(59) Exchange
Input [1]: [internalUUID#905213]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=351908]

(60) Project
Output [2]: [internalUUID#905213 AS product#905226, null AS productGroup#905227]
Input [1]: [internalUUID#905213]

(61) BroadcastExchange
Input [2]: [product#905226, productGroup#905227]
Arguments: HashedRelationBroadcastMode(List(input[0, string, true]),false), [plan_id=351923]

(62) BroadcastHashJoin
Left keys [1]: [product#905365]
Right keys [1]: [product#905226]
Join type: LeftOuter
Join condition: None

(63) Project
Output [7]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, productGroup#905227, struct(product, product#905365, orderDateTime, orderDateTime#905369, availabilityDateTime, availabilityDateTime#905371, nextAvailabilityDateTime, nextAvailabilityDateTime#905373, mrpController, mrpController#905176, sourceOfSupplyUuid, sourceOfSupplyUuid#905368, purchasingOrg, purchasingOrg#905208, purchasingGroup, purchasingGroup#905207, isFallbackOrderOnly, isFallbackOrderOnly#905375) AS struct#905378]
Input [16]: [sourceOfSupplyUuid#905368, plant#905366, product#905365, supplier#905367, orderDateTime#905369, deliveryDateTime#905370, availabilityDateTime#905371, supplierGroup#905372, nextAvailabilityDateTime#905373, isFallBackOrderOnly#905375, mrpController#905176, subrange#905206, purchasingGroup#905207, purchasingOrg#905208, product#905226, productGroup#905227]

(64) ObjectHashAggregate
Input [7]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, productGroup#905227, struct#905378]
Keys [7]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null AS null#905722, productGroup#905227]
Functions [1]: [partial_collect_list(struct#905378, 0, 0)]
Aggregate Attributes [1]: [buf#905723]
Results [8]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905722, productGroup#905227, buf#905724]

(65) Exchange
Input [8]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905722, productGroup#905227, buf#905724]
Arguments: hashpartitioning(supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905722, productGroup#905227, 25), ENSURE_REQUIREMENTS, [plan_id=351928]

(66) ObjectHashAggregate
Input [8]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905722, productGroup#905227, buf#905724]
Keys [7]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null#905722, productGroup#905227]
Functions [1]: [collect_list(struct#905378, 0, 0)]
Aggregate Attributes [1]: [collect_list(struct#905378, 0, 0)#905388]
Results [8]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, null AS supplyingPlant#905377, productGroup#905227, collect_list(struct#905378, 0, 0)#905388 AS productOrderSchedule#905379]

(67) AdaptiveSparkPlan
Output [8]: [supplierGroup#905372, supplier#905367, plant#905366, deliveryDateTime#905370, subrange#905206, supplyingPlant#905377, productGroup#905227, productOrderSchedule#905379]
Arguments: isFinalPlan=false

SQL / DataFrame Properties

Name	Value
spark.activity.hdlfsEnabled	true
spark.activity.isolateSession	true
spark.sql.parquet.fieldId.read.enabled	true
spark.sql.parquet.fieldId.write.enabled	true
temporal.activity.id	5a350f8f-313a-3aec-ad90-26839b82e5bc
temporal.activity.type	EnhanceWorklistByAttributes