== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (54)
+- WriteFiles (53)
+- Project (52)
+- * Generate (51)
+- * Project (50)
+- * Filter (49)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (48)
+- * SortMergeJoin LeftOuter (47)
:- * Project (39)
: +- * SortMergeJoin LeftOuter (38)
: :- * Project (30)
: : +- * SortMergeJoin LeftOuter (29)
: : :- * Sort (23)
: : : +- Exchange (22)
: : : +- * Project (21)
: : : +- * BroadcastHashJoin LeftOuter BuildRight (20)
: : : :- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- BroadcastExchange (19)
: : : +- * Project (18)
: : : +- Exchange (17)
: : : +- * Project (16)
: : : +- * Filter (15)
: : : +- * ColumnarToRow (14)
: : : +- Scan parquet (13)
: : +- * Sort (28)
: : +- Exchange (27)
: : +- * Project (26)
: : +- * Filter (25)
: : +- * Scan ExistingRDD (24)
: +- * Sort (37)
: +- ObjectHashAggregate (36)
: +- Exchange (35)
: +- ObjectHashAggregate (34)
: +- * Project (33)
: +- * Filter (32)
: +- * Scan ExistingRDD (31)
+- * Sort (46)
+- ObjectHashAggregate (45)
+- Exchange (44)
+- ObjectHashAggregate (43)
+- * Project (42)
+- * Filter (41)
+- * Scan ExistingRDD (40)
(1) InMemoryTableScan
Output [4]: [orderProposalId#935694L, orderProposalItemId#935695, quantityKpis#936468, shardId#935024]
Arguments: [orderProposalId#935694L, orderProposalItemId#935695, quantityKpis#936468, shardId#935024], [isnotnull(shardId#935024), (shardId#935024 = 0_1_10000002110), (size(quantityKpis#936468, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#935024, worklistShardItemId#935536L, quantityAfterProdPlantOptimization#935537, qty#935538, orderProposalId#935694L, originalReplenishmentRunId#935697L, supplierGroup#935704, supplier#935705, supplyingPlant#935735, productGroup#935736, product#935707, plant#935708, subrange#935706, orderDateTime#935712, deliveryDateTime#935713, availabilityDateTime#935714, nextAvailabilityDateTime#935715, constraintValues#935729, constraintOperators#935727, constraintLabels#935726, logisticUnits#935731, orderQuantityBaseUom#935717, orderQuantityBaseUomUuid#935718, splitIndicator#935699L, netPriceAmount#935722, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#935024, items#935026]
Arguments: [shardId#935024, items#935026], [(size(items#935026, true) > 0), isnotnull(items#935026)]
(4) InMemoryRelation
Arguments: [shardId#935024, orderProposalId#935025L, items#935026, optimizationGroups#935027, isOptimal#935028, optimizationInsights#935030], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#935024, orderProposalId#935025L, items#935026, optimizationGroups#935027, isOptimal#935028, optimizationInsights#935030]
Arguments: [shardId#935024, orderProposalId#935025L, items#935026, optimizationGroups#935027, isOptimal#935028, optimizationInsights#935030], [isnotnull(shardId#935024), (shardId#935024 = 0_1_10000002110)]
(6) InMemoryRelation
Arguments: [shardId#935024, orderProposalId#935025L, items#935026, optimizationGroups#935027, isOptimal#935028, lastModified#935029, optimizationInsights#935030], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#935024, orderProposalId#935025L, items#935026, optimizationGroups#935027, isOptimal#935028, lastModified#935029, optimizationInsights#935030]
Arguments: [shardId#935024, orderProposalId#935025L, items#935026, optimizationGroups#935027, isOptimal#935028, lastModified#935029, optimizationInsights#935030], MapPartitionsRDD[43911] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#935024, orderProposalId#935025L, items#935026, optimizationGroups#935027, isOptimal#935028, lastModified#935029, optimizationInsights#935030]
Condition : (isnotnull(shardId#935024) AND (shardId#935024 = 0_1_10000002110))
(9) Filter [codegen id : 1]
Input [6]: [shardId#935024, orderProposalId#935025L, items#935026, optimizationGroups#935027, isOptimal#935028, optimizationInsights#935030]
Condition : (isnotnull(shardId#935024) AND (shardId#935024 = 0_1_10000002110))
(10) Filter [codegen id : 3]
Input [2]: [shardId#935024, items#935026]
Condition : ((size(items#935026, true) > 0) AND isnotnull(items#935026))
(11) Generate [codegen id : 3]
Input [2]: [shardId#935024, items#935026]
Arguments: explode(items#935026), [shardId#935024], false, [item#935535]
(12) Project [codegen id : 3]
Output [4]: [shardId#935024, item#935535.worklistShardItemId AS worklistShardItemId#935536L, item#935535.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#935537, item#935535.qty AS qty#935538]
Input [2]: [shardId#935024, item#935535]
(13) Scan parquet
Output [38]: [orderProposalId#935737L, orderProposalItemId#935738, supplierGroup#935739, supplier#935740, plant#935741, deliveryDateTime#935742, subrange#935743, supplyingPlant#935744, productGroup#935745, product#935746, orderDateTime#935747, availabilityDateTime#935748, nextAvailabilityDateTime#935749, sourceOfSupplyUuid#935751, isFallbackOrderOnly#935754, splitIndicator#935756L, previousOrderProposal#935757L, worklistShardItemId#935760L, orderProposalItemGroupId#935761, externalProductId#935762, externalPlantId#935763, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, minimumOrderQuantity#935767, constraintLabels#935768, constraintOperators#935769, constraintValues#935770, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, measurements#935778, originalReplenishmentRunId#935779L, optimizationGroups#935780, shardId#935781, sequenceId#935759]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000002110]
PartitionFilters: [isnotnull(shardId#935781), isnotnull(sequenceId#935759), (shardId#935781 = 0_1_10000002110), (sequenceId#935759 = 0)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(14) ColumnarToRow [codegen id : 1]
Input [38]: [orderProposalId#935737L, orderProposalItemId#935738, supplierGroup#935739, supplier#935740, plant#935741, deliveryDateTime#935742, subrange#935743, supplyingPlant#935744, productGroup#935745, product#935746, orderDateTime#935747, availabilityDateTime#935748, nextAvailabilityDateTime#935749, sourceOfSupplyUuid#935751, isFallbackOrderOnly#935754, splitIndicator#935756L, previousOrderProposal#935757L, worklistShardItemId#935760L, orderProposalItemGroupId#935761, externalProductId#935762, externalPlantId#935763, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, minimumOrderQuantity#935767, constraintLabels#935768, constraintOperators#935769, constraintValues#935770, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, measurements#935778, originalReplenishmentRunId#935779L, optimizationGroups#935780, shardId#935781, sequenceId#935759]
(15) Filter [codegen id : 1]
Input [38]: [orderProposalId#935737L, orderProposalItemId#935738, supplierGroup#935739, supplier#935740, plant#935741, deliveryDateTime#935742, subrange#935743, supplyingPlant#935744, productGroup#935745, product#935746, orderDateTime#935747, availabilityDateTime#935748, nextAvailabilityDateTime#935749, sourceOfSupplyUuid#935751, isFallbackOrderOnly#935754, splitIndicator#935756L, previousOrderProposal#935757L, worklistShardItemId#935760L, orderProposalItemGroupId#935761, externalProductId#935762, externalPlantId#935763, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, minimumOrderQuantity#935767, constraintLabels#935768, constraintOperators#935769, constraintValues#935770, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, measurements#935778, originalReplenishmentRunId#935779L, optimizationGroups#935780, shardId#935781, sequenceId#935759]
Condition : isnotnull(worklistShardItemId#935760L)
(16) Project [codegen id : 1]
Output [36]: [orderProposalId#935737L, orderProposalItemId#935738, supplierGroup#935739, supplier#935740, plant#935741, deliveryDateTime#935742, subrange#935743, supplyingPlant#935744, productGroup#935745, product#935746, orderDateTime#935747, availabilityDateTime#935748, nextAvailabilityDateTime#935749, sourceOfSupplyUuid#935751, isFallbackOrderOnly#935754, splitIndicator#935756L, previousOrderProposal#935757L, worklistShardItemId#935760L, orderProposalItemGroupId#935761, externalProductId#935762, externalPlantId#935763, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, minimumOrderQuantity#935767, constraintLabels#935768, constraintOperators#935769, constraintValues#935770, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, measurements#935778, originalReplenishmentRunId#935779L, optimizationGroups#935780]
Input [38]: [orderProposalId#935737L, orderProposalItemId#935738, supplierGroup#935739, supplier#935740, plant#935741, deliveryDateTime#935742, subrange#935743, supplyingPlant#935744, productGroup#935745, product#935746, orderDateTime#935747, availabilityDateTime#935748, nextAvailabilityDateTime#935749, sourceOfSupplyUuid#935751, isFallbackOrderOnly#935754, splitIndicator#935756L, previousOrderProposal#935757L, worklistShardItemId#935760L, orderProposalItemGroupId#935761, externalProductId#935762, externalPlantId#935763, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, minimumOrderQuantity#935767, constraintLabels#935768, constraintOperators#935769, constraintValues#935770, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, measurements#935778, originalReplenishmentRunId#935779L, optimizationGroups#935780, shardId#935781, sequenceId#935759]
(17) Exchange
Input [36]: [orderProposalId#935737L, orderProposalItemId#935738, supplierGroup#935739, supplier#935740, plant#935741, deliveryDateTime#935742, subrange#935743, supplyingPlant#935744, productGroup#935745, product#935746, orderDateTime#935747, availabilityDateTime#935748, nextAvailabilityDateTime#935749, sourceOfSupplyUuid#935751, isFallbackOrderOnly#935754, splitIndicator#935756L, previousOrderProposal#935757L, worklistShardItemId#935760L, orderProposalItemGroupId#935761, externalProductId#935762, externalPlantId#935763, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, minimumOrderQuantity#935767, constraintLabels#935768, constraintOperators#935769, constraintValues#935770, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, measurements#935778, originalReplenishmentRunId#935779L, optimizationGroups#935780]
Arguments: hashpartitioning(worklistShardItemId#935760L, 20), REPARTITION_BY_NUM, [plan_id=368501]
(18) Project [codegen id : 2]
Output [36]: [worklistShardItemId#935760L, orderProposalId#935737L, orderProposalItemId#935738, orderProposalItemGroupId#935761, originalReplenishmentRunId#935779L, splitIndicator#935756L, previousOrderProposal#935757L, sourceOfSupplyUuid#935751, supplierGroup#935739, supplier#935740, subrange#935743, product#935746, plant#935741, orderDateTime#935747, deliveryDateTime#935742, availabilityDateTime#935748, nextAvailabilityDateTime#935749, isFallbackOrderOnly#935754, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, netPriceAmount#935773, netPriceCurrencyCode#935774, measurements#935778, minimumOrderQuantity#935767, constraintLabels#935768, constraintOperators#935769, constraintValues#935770, logisticUnits#935764, optimizationGroups#935780, externalProductId#935762, externalPlantId#935763, supplyingPlant#935744, productGroup#935745]
Input [36]: [orderProposalId#935737L, orderProposalItemId#935738, supplierGroup#935739, supplier#935740, plant#935741, deliveryDateTime#935742, subrange#935743, supplyingPlant#935744, productGroup#935745, product#935746, orderDateTime#935747, availabilityDateTime#935748, nextAvailabilityDateTime#935749, sourceOfSupplyUuid#935751, isFallbackOrderOnly#935754, splitIndicator#935756L, previousOrderProposal#935757L, worklistShardItemId#935760L, orderProposalItemGroupId#935761, externalProductId#935762, externalPlantId#935763, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, minimumOrderQuantity#935767, constraintLabels#935768, constraintOperators#935769, constraintValues#935770, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, measurements#935778, originalReplenishmentRunId#935779L, optimizationGroups#935780]
(19) BroadcastExchange
Input [36]: [worklistShardItemId#935760L, orderProposalId#935737L, orderProposalItemId#935738, orderProposalItemGroupId#935761, originalReplenishmentRunId#935779L, splitIndicator#935756L, previousOrderProposal#935757L, sourceOfSupplyUuid#935751, supplierGroup#935739, supplier#935740, subrange#935743, product#935746, plant#935741, orderDateTime#935747, deliveryDateTime#935742, availabilityDateTime#935748, nextAvailabilityDateTime#935749, isFallbackOrderOnly#935754, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, netPriceAmount#935773, netPriceCurrencyCode#935774, measurements#935778, minimumOrderQuantity#935767, constraintLabels#935768, constraintOperators#935769, constraintValues#935770, logisticUnits#935764, optimizationGroups#935780, externalProductId#935762, externalPlantId#935763, supplyingPlant#935744, productGroup#935745]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, true]),false), [plan_id=368505]
(20) BroadcastHashJoin [codegen id : 3]
Left keys [1]: [worklistShardItemId#935536L]
Right keys [1]: [worklistShardItemId#935760L]
Join type: LeftOuter
Join condition: (shardId#935024 = 0_1_10000002110)
(21) Project [codegen id : 3]
Output [39]: [shardId#935024, worklistShardItemId#935536L, quantityAfterProdPlantOptimization#935537, qty#935538, orderProposalId#935737L, originalReplenishmentRunId#935779L, supplierGroup#935739, supplier#935740, supplyingPlant#935744, productGroup#935745, product#935746, plant#935741, subrange#935743, orderDateTime#935747, deliveryDateTime#935742, availabilityDateTime#935748, nextAvailabilityDateTime#935749, constraintValues#935770, constraintOperators#935769, constraintLabels#935768, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, splitIndicator#935756L, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, sourceOfSupplyUuid#935751, minimumOrderQuantity#935767, orderProposalItemId#935738, orderProposalItemGroupId#935761, optimizationGroups#935780, measurements#935778, externalProductId#935762, externalPlantId#935763, previousOrderProposal#935757L, isFallbackOrderOnly#935754]
Input [40]: [shardId#935024, worklistShardItemId#935536L, quantityAfterProdPlantOptimization#935537, qty#935538, worklistShardItemId#935760L, orderProposalId#935737L, orderProposalItemId#935738, orderProposalItemGroupId#935761, originalReplenishmentRunId#935779L, splitIndicator#935756L, previousOrderProposal#935757L, sourceOfSupplyUuid#935751, supplierGroup#935739, supplier#935740, subrange#935743, product#935746, plant#935741, orderDateTime#935747, deliveryDateTime#935742, availabilityDateTime#935748, nextAvailabilityDateTime#935749, isFallbackOrderOnly#935754, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, netPriceAmount#935773, netPriceCurrencyCode#935774, measurements#935778, minimumOrderQuantity#935767, constraintLabels#935768, constraintOperators#935769, constraintValues#935770, logisticUnits#935764, optimizationGroups#935780, externalProductId#935762, externalPlantId#935763, supplyingPlant#935744, productGroup#935745]
(22) Exchange
Input [39]: [shardId#935024, worklistShardItemId#935536L, quantityAfterProdPlantOptimization#935537, qty#935538, orderProposalId#935737L, originalReplenishmentRunId#935779L, supplierGroup#935739, supplier#935740, supplyingPlant#935744, productGroup#935745, product#935746, plant#935741, subrange#935743, orderDateTime#935747, deliveryDateTime#935742, availabilityDateTime#935748, nextAvailabilityDateTime#935749, constraintValues#935770, constraintOperators#935769, constraintLabels#935768, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, splitIndicator#935756L, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, sourceOfSupplyUuid#935751, minimumOrderQuantity#935767, orderProposalItemId#935738, orderProposalItemGroupId#935761, optimizationGroups#935780, measurements#935778, externalProductId#935762, externalPlantId#935763, previousOrderProposal#935757L, isFallbackOrderOnly#935754]
Arguments: hashpartitioning(shardId#935024, worklistShardItemId#935536L, 20), ENSURE_REQUIREMENTS, [plan_id=368510]
(23) Sort [codegen id : 4]
Input [39]: [shardId#935024, worklistShardItemId#935536L, quantityAfterProdPlantOptimization#935537, qty#935538, orderProposalId#935737L, originalReplenishmentRunId#935779L, supplierGroup#935739, supplier#935740, supplyingPlant#935744, productGroup#935745, product#935746, plant#935741, subrange#935743, orderDateTime#935747, deliveryDateTime#935742, availabilityDateTime#935748, nextAvailabilityDateTime#935749, constraintValues#935770, constraintOperators#935769, constraintLabels#935768, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, splitIndicator#935756L, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, sourceOfSupplyUuid#935751, minimumOrderQuantity#935767, orderProposalItemId#935738, orderProposalItemGroupId#935761, optimizationGroups#935780, measurements#935778, externalProductId#935762, externalPlantId#935763, previousOrderProposal#935757L, isFallbackOrderOnly#935754]
Arguments: [shardId#935024 ASC NULLS FIRST, worklistShardItemId#935536L ASC NULLS FIRST], false, 0
(24) Scan ExistingRDD [codegen id : 5]
Output [6]: [shardId#936433, worklistShardItemId#936434L, qty#936435, demandChannel#936436, demandStream#936437, kpis#936438]
Arguments: [shardId#936433, worklistShardItemId#936434L, qty#936435, demandChannel#936436, demandStream#936437, kpis#936438], MapPartitionsRDD[43985] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(25) Filter [codegen id : 5]
Input [6]: [shardId#936433, worklistShardItemId#936434L, qty#936435, demandChannel#936436, demandStream#936437, kpis#936438]
Condition : (((isnull(qty#936435) AND isnull(demandChannel#936436)) AND isnull(demandStream#936437)) AND (isnotnull(shardId#936433) AND isnotnull(worklistShardItemId#936434L)))
(26) Project [codegen id : 5]
Output [3]: [shardId#936433, worklistShardItemId#936434L, coalesce(kpis#936438, []) AS prodLocSpecificKpis#936439]
Input [6]: [shardId#936433, worklistShardItemId#936434L, qty#936435, demandChannel#936436, demandStream#936437, kpis#936438]
(27) Exchange
Input [3]: [shardId#936433, worklistShardItemId#936434L, prodLocSpecificKpis#936439]
Arguments: hashpartitioning(shardId#936433, worklistShardItemId#936434L, 20), ENSURE_REQUIREMENTS, [plan_id=368516]
(28) Sort [codegen id : 6]
Input [3]: [shardId#936433, worklistShardItemId#936434L, prodLocSpecificKpis#936439]
Arguments: [shardId#936433 ASC NULLS FIRST, worklistShardItemId#936434L ASC NULLS FIRST], false, 0
(29) SortMergeJoin [codegen id : 7]
Left keys [2]: [shardId#935024, worklistShardItemId#935536L]
Right keys [2]: [shardId#936433, worklistShardItemId#936434L]
Join type: LeftOuter
Join condition: None
(30) Project [codegen id : 7]
Output [40]: [shardId#935024, worklistShardItemId#935536L, quantityAfterProdPlantOptimization#935537, qty#935538, orderProposalId#935737L, originalReplenishmentRunId#935779L, supplierGroup#935739, supplier#935740, supplyingPlant#935744, productGroup#935745, product#935746, plant#935741, subrange#935743, orderDateTime#935747, deliveryDateTime#935742, availabilityDateTime#935748, nextAvailabilityDateTime#935749, constraintValues#935770, constraintOperators#935769, constraintLabels#935768, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, splitIndicator#935756L, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, sourceOfSupplyUuid#935751, minimumOrderQuantity#935767, orderProposalItemId#935738, orderProposalItemGroupId#935761, optimizationGroups#935780, measurements#935778, externalProductId#935762, externalPlantId#935763, previousOrderProposal#935757L, isFallbackOrderOnly#935754, coalesce(prodLocSpecificKpis#936439, []) AS prodLocSpecificKpis#936440]
Input [42]: [shardId#935024, worklistShardItemId#935536L, quantityAfterProdPlantOptimization#935537, qty#935538, orderProposalId#935737L, originalReplenishmentRunId#935779L, supplierGroup#935739, supplier#935740, supplyingPlant#935744, productGroup#935745, product#935746, plant#935741, subrange#935743, orderDateTime#935747, deliveryDateTime#935742, availabilityDateTime#935748, nextAvailabilityDateTime#935749, constraintValues#935770, constraintOperators#935769, constraintLabels#935768, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, splitIndicator#935756L, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, sourceOfSupplyUuid#935751, minimumOrderQuantity#935767, orderProposalItemId#935738, orderProposalItemGroupId#935761, optimizationGroups#935780, measurements#935778, externalProductId#935762, externalPlantId#935763, previousOrderProposal#935757L, isFallbackOrderOnly#935754, shardId#936433, worklistShardItemId#936434L, prodLocSpecificKpis#936439]
(31) Scan ExistingRDD [codegen id : 8]
Output [6]: [shardId#936449, worklistShardItemId#936450L, qty#936451, demandChannel#936452, demandStream#936453, kpis#936454]
Arguments: [shardId#936449, worklistShardItemId#936450L, qty#936451, demandChannel#936452, demandStream#936453, kpis#936454], MapPartitionsRDD[43985] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(32) Filter [codegen id : 8]
Input [6]: [shardId#936449, worklistShardItemId#936450L, qty#936451, demandChannel#936452, demandStream#936453, kpis#936454]
Condition : ((((isnull(qty#936451) AND isnotnull(demandChannel#936452)) AND isnotnull(demandStream#936453)) AND (size(kpis#936454, true) > 0)) AND (isnotnull(shardId#936449) AND isnotnull(worklistShardItemId#936450L)))
(33) Project [codegen id : 8]
Output [5]: [shardId#936449, worklistShardItemId#936450L, demandChannel#936452, demandStream#936453, kpis#936454]
Input [6]: [shardId#936449, worklistShardItemId#936450L, qty#936451, demandChannel#936452, demandStream#936453, kpis#936454]
(34) ObjectHashAggregate
Input [5]: [shardId#936449, worklistShardItemId#936450L, demandChannel#936452, demandStream#936453, kpis#936454]
Keys [2]: [shardId#936449, worklistShardItemId#936450L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#936452, demandStream, demandStream#936453, kpis, kpis#936454), 0, 0)]
Aggregate Attributes [1]: [buf#936629]
Results [3]: [shardId#936449, worklistShardItemId#936450L, buf#936630]
(35) Exchange
Input [3]: [shardId#936449, worklistShardItemId#936450L, buf#936630]
Arguments: hashpartitioning(shardId#936449, worklistShardItemId#936450L, 20), ENSURE_REQUIREMENTS, [plan_id=368527]
(36) ObjectHashAggregate
Input [3]: [shardId#936449, worklistShardItemId#936450L, buf#936630]
Keys [2]: [shardId#936449, worklistShardItemId#936450L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#936452, demandStream, demandStream#936453, kpis, kpis#936454), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#936452, demandStream, demandStream#936453, kpis, kpis#936454), 0, 0)#936448]
Results [3]: [shardId#936449, worklistShardItemId#936450L, collect_list(struct(demandChannel, demandChannel#936452, demandStream, demandStream#936453, kpis, kpis#936454), 0, 0)#936448 AS channelStreamSpecificKpis#936441]
(37) Sort [codegen id : 9]
Input [3]: [shardId#936449, worklistShardItemId#936450L, channelStreamSpecificKpis#936441]
Arguments: [shardId#936449 ASC NULLS FIRST, worklistShardItemId#936450L ASC NULLS FIRST], false, 0
(38) SortMergeJoin [codegen id : 10]
Left keys [2]: [shardId#935024, worklistShardItemId#935536L]
Right keys [2]: [shardId#936449, worklistShardItemId#936450L]
Join type: LeftOuter
Join condition: None
(39) Project [codegen id : 10]
Output [41]: [shardId#935024, worklistShardItemId#935536L, quantityAfterProdPlantOptimization#935537, qty#935538, orderProposalId#935737L, originalReplenishmentRunId#935779L, supplierGroup#935739, supplier#935740, supplyingPlant#935744, productGroup#935745, product#935746, plant#935741, subrange#935743, orderDateTime#935747, deliveryDateTime#935742, availabilityDateTime#935748, nextAvailabilityDateTime#935749, constraintValues#935770, constraintOperators#935769, constraintLabels#935768, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, splitIndicator#935756L, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, sourceOfSupplyUuid#935751, minimumOrderQuantity#935767, orderProposalItemId#935738, orderProposalItemGroupId#935761, optimizationGroups#935780, measurements#935778, externalProductId#935762, externalPlantId#935763, previousOrderProposal#935757L, isFallbackOrderOnly#935754, prodLocSpecificKpis#936440, coalesce(channelStreamSpecificKpis#936441, []) AS channelStreamSpecificKpis#936455]
Input [43]: [shardId#935024, worklistShardItemId#935536L, quantityAfterProdPlantOptimization#935537, qty#935538, orderProposalId#935737L, originalReplenishmentRunId#935779L, supplierGroup#935739, supplier#935740, supplyingPlant#935744, productGroup#935745, product#935746, plant#935741, subrange#935743, orderDateTime#935747, deliveryDateTime#935742, availabilityDateTime#935748, nextAvailabilityDateTime#935749, constraintValues#935770, constraintOperators#935769, constraintLabels#935768, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, splitIndicator#935756L, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, sourceOfSupplyUuid#935751, minimumOrderQuantity#935767, orderProposalItemId#935738, orderProposalItemGroupId#935761, optimizationGroups#935780, measurements#935778, externalProductId#935762, externalPlantId#935763, previousOrderProposal#935757L, isFallbackOrderOnly#935754, prodLocSpecificKpis#936440, shardId#936449, worklistShardItemId#936450L, channelStreamSpecificKpis#936441]
(40) Scan ExistingRDD [codegen id : 11]
Output [6]: [shardId#936462, worklistShardItemId#936463L, qty#936464, demandChannel#936465, demandStream#936466, kpis#936467]
Arguments: [shardId#936462, worklistShardItemId#936463L, qty#936464, demandChannel#936465, demandStream#936466, kpis#936467], MapPartitionsRDD[43985] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(41) Filter [codegen id : 11]
Input [6]: [shardId#936462, worklistShardItemId#936463L, qty#936464, demandChannel#936465, demandStream#936466, kpis#936467]
Condition : ((isnotnull(qty#936464) AND isnotnull(kpis#936467)) AND (isnotnull(shardId#936462) AND isnotnull(worklistShardItemId#936463L)))
(42) Project [codegen id : 11]
Output [4]: [shardId#936462, worklistShardItemId#936463L, qty#936464, kpis#936467]
Input [6]: [shardId#936462, worklistShardItemId#936463L, qty#936464, demandChannel#936465, demandStream#936466, kpis#936467]
(43) ObjectHashAggregate
Input [4]: [shardId#936462, worklistShardItemId#936463L, qty#936464, kpis#936467]
Keys [2]: [shardId#936462, worklistShardItemId#936463L]
Functions [1]: [partial_collect_list(struct(qty, qty#936464, kpis, kpis#936467), 0, 0)]
Aggregate Attributes [1]: [buf#936631]
Results [3]: [shardId#936462, worklistShardItemId#936463L, buf#936632]
(44) Exchange
Input [3]: [shardId#936462, worklistShardItemId#936463L, buf#936632]
Arguments: hashpartitioning(shardId#936462, worklistShardItemId#936463L, 20), ENSURE_REQUIREMENTS, [plan_id=368539]
(45) ObjectHashAggregate
Input [3]: [shardId#936462, worklistShardItemId#936463L, buf#936632]
Keys [2]: [shardId#936462, worklistShardItemId#936463L]
Functions [1]: [collect_list(struct(qty, qty#936464, kpis, kpis#936467), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#936464, kpis, kpis#936467), 0, 0)#936461]
Results [3]: [shardId#936462, worklistShardItemId#936463L, map_from_entries(collect_list(struct(qty, qty#936464, kpis, kpis#936467), 0, 0)#936461) AS quantityKpis#936456]
(46) Sort [codegen id : 12]
Input [3]: [shardId#936462, worklistShardItemId#936463L, quantityKpis#936456]
Arguments: [shardId#936462 ASC NULLS FIRST, worklistShardItemId#936463L ASC NULLS FIRST], false, 0
(47) SortMergeJoin [codegen id : 13]
Left keys [2]: [shardId#935024, worklistShardItemId#935536L]
Right keys [2]: [shardId#936462, worklistShardItemId#936463L]
Join type: LeftOuter
Join condition: None
(48) Project [codegen id : 13]
Output [42]: [shardId#935024, worklistShardItemId#935536L, quantityAfterProdPlantOptimization#935537, qty#935538, orderProposalId#935737L, originalReplenishmentRunId#935779L, supplierGroup#935739, supplier#935740, supplyingPlant#935744, productGroup#935745, product#935746, plant#935741, subrange#935743, orderDateTime#935747, deliveryDateTime#935742, availabilityDateTime#935748, nextAvailabilityDateTime#935749, constraintValues#935770, constraintOperators#935769, constraintLabels#935768, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, splitIndicator#935756L, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, sourceOfSupplyUuid#935751, minimumOrderQuantity#935767, orderProposalItemId#935738, orderProposalItemGroupId#935761, optimizationGroups#935780, measurements#935778, externalProductId#935762, externalPlantId#935763, previousOrderProposal#935757L, isFallbackOrderOnly#935754, prodLocSpecificKpis#936440, channelStreamSpecificKpis#936455, coalesce(quantityKpis#936456, map(keys: [], values: [])) AS quantityKpis#936468]
Input [44]: [shardId#935024, worklistShardItemId#935536L, quantityAfterProdPlantOptimization#935537, qty#935538, orderProposalId#935737L, originalReplenishmentRunId#935779L, supplierGroup#935739, supplier#935740, supplyingPlant#935744, productGroup#935745, product#935746, plant#935741, subrange#935743, orderDateTime#935747, deliveryDateTime#935742, availabilityDateTime#935748, nextAvailabilityDateTime#935749, constraintValues#935770, constraintOperators#935769, constraintLabels#935768, logisticUnits#935764, orderQuantityBaseUom#935765, orderQuantityBaseUomUuid#935766, splitIndicator#935756L, netPriceAmount#935773, netPriceCurrencyCode#935774, netPriceQuantity#935775, netPriceQuantityUom#935776, netPriceQuantityUomUuid#935777, sourceOfSupplyUuid#935751, minimumOrderQuantity#935767, orderProposalItemId#935738, orderProposalItemGroupId#935761, optimizationGroups#935780, measurements#935778, externalProductId#935762, externalPlantId#935763, previousOrderProposal#935757L, isFallbackOrderOnly#935754, prodLocSpecificKpis#936440, channelStreamSpecificKpis#936455, shardId#936462, worklistShardItemId#936463L, quantityKpis#936456]
(49) Filter [codegen id : 1]
Input [4]: [orderProposalId#935694L, orderProposalItemId#935695, quantityKpis#936468, shardId#935024]
Condition : ((isnotnull(shardId#935024) AND (shardId#935024 = 0_1_10000002110)) AND (size(quantityKpis#936468, true) > 0))
(50) Project [codegen id : 1]
Output [3]: [orderProposalId#935694L, orderProposalItemId#935695, quantityKpis#936468]
Input [4]: [orderProposalId#935694L, orderProposalItemId#935695, quantityKpis#936468, shardId#935024]
(51) Generate [codegen id : 1]
Input [3]: [orderProposalId#935694L, orderProposalItemId#935695, quantityKpis#936468]
Arguments: explode(quantityKpis#936468), [orderProposalId#935694L, orderProposalItemId#935695], false, [orderQuantityInBaseUnit#940071, kpis#940072]
(52) Project
Output [7]: [orderProposalId#935694L, cast(orderProposalItemId#935695 as bigint) AS orderProposalItemId#940070L, orderQuantityInBaseUnit#940071, filter(kpis#940072, lambdafunction((lambda x_2462#940074.label = ServiceLevel), lambda x_2462#940074, false))[0].value AS serviceLevel#940073, filter(kpis#940072, lambdafunction((lambda x_2463#940076.label = RangeOfCoverage), lambda x_2463#940076, false))[0].value AS rangeOfCoverage#940075, filter(kpis#940072, lambdafunction((lambda x_2464#940078.label = ServiceLevelAtStartOfDelisting), lambda x_2464#940078, false))[0].value AS serviceLevelAtEndOfListing#940077, 10000002110 AS replenishmentRunId#940080L]
Input [4]: [orderProposalId#935694L, orderProposalItemId#935695, orderQuantityInBaseUnit#940071, kpis#940072]
(53) WriteFiles
Input [7]: [orderProposalId#935694L, orderProposalItemId#940070L, orderQuantityInBaseUnit#940071, serviceLevel#940073, rangeOfCoverage#940075, serviceLevelAtEndOfListing#940077, replenishmentRunId#940080L]
(54) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000002110/shardId=0_1_10000002110/sequenceId=0, false, Parquet, [path=hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000002110/shardId=0_1_10000002110/sequenceId=0], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, replenishmentRunId]