== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (54)
+- WriteFiles (53)
+- Project (52)
+- * Generate (51)
+- * Project (50)
+- * Filter (49)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (48)
+- * SortMergeJoin LeftOuter (47)
:- * Project (39)
: +- * SortMergeJoin LeftOuter (38)
: :- * Project (30)
: : +- * SortMergeJoin LeftOuter (29)
: : :- * Sort (23)
: : : +- Exchange (22)
: : : +- * Project (21)
: : : +- * BroadcastHashJoin LeftOuter BuildRight (20)
: : : :- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- BroadcastExchange (19)
: : : +- * Project (18)
: : : +- Exchange (17)
: : : +- * Project (16)
: : : +- * Filter (15)
: : : +- * ColumnarToRow (14)
: : : +- Scan parquet (13)
: : +- * Sort (28)
: : +- Exchange (27)
: : +- * Project (26)
: : +- * Filter (25)
: : +- * Scan ExistingRDD (24)
: +- * Sort (37)
: +- ObjectHashAggregate (36)
: +- Exchange (35)
: +- ObjectHashAggregate (34)
: +- * Project (33)
: +- * Filter (32)
: +- * Scan ExistingRDD (31)
+- * Sort (46)
+- ObjectHashAggregate (45)
+- Exchange (44)
+- ObjectHashAggregate (43)
+- * Project (42)
+- * Filter (41)
+- * Scan ExistingRDD (40)
(1) InMemoryTableScan
Output [4]: [orderProposalId#692558L, orderProposalItemId#692559, quantityKpis#693332, shardId#691888]
Arguments: [orderProposalId#692558L, orderProposalItemId#692559, quantityKpis#693332, shardId#691888], [isnotnull(shardId#691888), (shardId#691888 = 0_1_10000002107), (size(quantityKpis#693332, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#691888, worklistShardItemId#692400L, quantityAfterProdPlantOptimization#692401, qty#692402, orderProposalId#692558L, originalReplenishmentRunId#692561L, supplierGroup#692568, supplier#692569, supplyingPlant#692599, productGroup#692600, product#692571, plant#692572, subrange#692570, orderDateTime#692576, deliveryDateTime#692577, availabilityDateTime#692578, nextAvailabilityDateTime#692579, constraintValues#692593, constraintOperators#692591, constraintLabels#692590, logisticUnits#692595, orderQuantityBaseUom#692581, orderQuantityBaseUomUuid#692582, splitIndicator#692563L, netPriceAmount#692586, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#691888, items#691890]
Arguments: [shardId#691888, items#691890], [(size(items#691890, true) > 0), isnotnull(items#691890)]
(4) InMemoryRelation
Arguments: [shardId#691888, orderProposalId#691889L, items#691890, optimizationGroups#691891, isOptimal#691892, optimizationInsights#691894], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#691888, orderProposalId#691889L, items#691890, optimizationGroups#691891, isOptimal#691892, optimizationInsights#691894]
Arguments: [shardId#691888, orderProposalId#691889L, items#691890, optimizationGroups#691891, isOptimal#691892, optimizationInsights#691894], [isnotnull(shardId#691888), (shardId#691888 = 0_1_10000002107)]
(6) InMemoryRelation
Arguments: [shardId#691888, orderProposalId#691889L, items#691890, optimizationGroups#691891, isOptimal#691892, lastModified#691893, optimizationInsights#691894], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#691888, orderProposalId#691889L, items#691890, optimizationGroups#691891, isOptimal#691892, lastModified#691893, optimizationInsights#691894]
Arguments: [shardId#691888, orderProposalId#691889L, items#691890, optimizationGroups#691891, isOptimal#691892, lastModified#691893, optimizationInsights#691894], MapPartitionsRDD[32831] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#691888, orderProposalId#691889L, items#691890, optimizationGroups#691891, isOptimal#691892, lastModified#691893, optimizationInsights#691894]
Condition : (isnotnull(shardId#691888) AND (shardId#691888 = 0_1_10000002107))
(9) Filter [codegen id : 1]
Input [6]: [shardId#691888, orderProposalId#691889L, items#691890, optimizationGroups#691891, isOptimal#691892, optimizationInsights#691894]
Condition : (isnotnull(shardId#691888) AND (shardId#691888 = 0_1_10000002107))
(10) Filter [codegen id : 3]
Input [2]: [shardId#691888, items#691890]
Condition : ((size(items#691890, true) > 0) AND isnotnull(items#691890))
(11) Generate [codegen id : 3]
Input [2]: [shardId#691888, items#691890]
Arguments: explode(items#691890), [shardId#691888], false, [item#692399]
(12) Project [codegen id : 3]
Output [4]: [shardId#691888, item#692399.worklistShardItemId AS worklistShardItemId#692400L, item#692399.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#692401, item#692399.qty AS qty#692402]
Input [2]: [shardId#691888, item#692399]
(13) Scan parquet
Output [38]: [orderProposalId#692601L, orderProposalItemId#692602, supplierGroup#692603, supplier#692604, plant#692605, deliveryDateTime#692606, subrange#692607, supplyingPlant#692608, productGroup#692609, product#692610, orderDateTime#692611, availabilityDateTime#692612, nextAvailabilityDateTime#692613, sourceOfSupplyUuid#692615, isFallbackOrderOnly#692618, splitIndicator#692620L, previousOrderProposal#692621L, worklistShardItemId#692624L, orderProposalItemGroupId#692625, externalProductId#692626, externalPlantId#692627, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, minimumOrderQuantity#692631, constraintLabels#692632, constraintOperators#692633, constraintValues#692634, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, measurements#692642, originalReplenishmentRunId#692643L, optimizationGroups#692644, shardId#692645, sequenceId#692623]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000002107]
PartitionFilters: [isnotnull(shardId#692645), isnotnull(sequenceId#692623), (shardId#692645 = 0_1_10000002107), (sequenceId#692623 = 5)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(14) ColumnarToRow [codegen id : 1]
Input [38]: [orderProposalId#692601L, orderProposalItemId#692602, supplierGroup#692603, supplier#692604, plant#692605, deliveryDateTime#692606, subrange#692607, supplyingPlant#692608, productGroup#692609, product#692610, orderDateTime#692611, availabilityDateTime#692612, nextAvailabilityDateTime#692613, sourceOfSupplyUuid#692615, isFallbackOrderOnly#692618, splitIndicator#692620L, previousOrderProposal#692621L, worklistShardItemId#692624L, orderProposalItemGroupId#692625, externalProductId#692626, externalPlantId#692627, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, minimumOrderQuantity#692631, constraintLabels#692632, constraintOperators#692633, constraintValues#692634, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, measurements#692642, originalReplenishmentRunId#692643L, optimizationGroups#692644, shardId#692645, sequenceId#692623]
(15) Filter [codegen id : 1]
Input [38]: [orderProposalId#692601L, orderProposalItemId#692602, supplierGroup#692603, supplier#692604, plant#692605, deliveryDateTime#692606, subrange#692607, supplyingPlant#692608, productGroup#692609, product#692610, orderDateTime#692611, availabilityDateTime#692612, nextAvailabilityDateTime#692613, sourceOfSupplyUuid#692615, isFallbackOrderOnly#692618, splitIndicator#692620L, previousOrderProposal#692621L, worklistShardItemId#692624L, orderProposalItemGroupId#692625, externalProductId#692626, externalPlantId#692627, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, minimumOrderQuantity#692631, constraintLabels#692632, constraintOperators#692633, constraintValues#692634, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, measurements#692642, originalReplenishmentRunId#692643L, optimizationGroups#692644, shardId#692645, sequenceId#692623]
Condition : isnotnull(worklistShardItemId#692624L)
(16) Project [codegen id : 1]
Output [36]: [orderProposalId#692601L, orderProposalItemId#692602, supplierGroup#692603, supplier#692604, plant#692605, deliveryDateTime#692606, subrange#692607, supplyingPlant#692608, productGroup#692609, product#692610, orderDateTime#692611, availabilityDateTime#692612, nextAvailabilityDateTime#692613, sourceOfSupplyUuid#692615, isFallbackOrderOnly#692618, splitIndicator#692620L, previousOrderProposal#692621L, worklistShardItemId#692624L, orderProposalItemGroupId#692625, externalProductId#692626, externalPlantId#692627, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, minimumOrderQuantity#692631, constraintLabels#692632, constraintOperators#692633, constraintValues#692634, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, measurements#692642, originalReplenishmentRunId#692643L, optimizationGroups#692644]
Input [38]: [orderProposalId#692601L, orderProposalItemId#692602, supplierGroup#692603, supplier#692604, plant#692605, deliveryDateTime#692606, subrange#692607, supplyingPlant#692608, productGroup#692609, product#692610, orderDateTime#692611, availabilityDateTime#692612, nextAvailabilityDateTime#692613, sourceOfSupplyUuid#692615, isFallbackOrderOnly#692618, splitIndicator#692620L, previousOrderProposal#692621L, worklistShardItemId#692624L, orderProposalItemGroupId#692625, externalProductId#692626, externalPlantId#692627, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, minimumOrderQuantity#692631, constraintLabels#692632, constraintOperators#692633, constraintValues#692634, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, measurements#692642, originalReplenishmentRunId#692643L, optimizationGroups#692644, shardId#692645, sequenceId#692623]
(17) Exchange
Input [36]: [orderProposalId#692601L, orderProposalItemId#692602, supplierGroup#692603, supplier#692604, plant#692605, deliveryDateTime#692606, subrange#692607, supplyingPlant#692608, productGroup#692609, product#692610, orderDateTime#692611, availabilityDateTime#692612, nextAvailabilityDateTime#692613, sourceOfSupplyUuid#692615, isFallbackOrderOnly#692618, splitIndicator#692620L, previousOrderProposal#692621L, worklistShardItemId#692624L, orderProposalItemGroupId#692625, externalProductId#692626, externalPlantId#692627, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, minimumOrderQuantity#692631, constraintLabels#692632, constraintOperators#692633, constraintValues#692634, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, measurements#692642, originalReplenishmentRunId#692643L, optimizationGroups#692644]
Arguments: hashpartitioning(worklistShardItemId#692624L, 20), REPARTITION_BY_NUM, [plan_id=278803]
(18) Project [codegen id : 2]
Output [36]: [worklistShardItemId#692624L, orderProposalId#692601L, orderProposalItemId#692602, orderProposalItemGroupId#692625, originalReplenishmentRunId#692643L, splitIndicator#692620L, previousOrderProposal#692621L, sourceOfSupplyUuid#692615, supplierGroup#692603, supplier#692604, subrange#692607, product#692610, plant#692605, orderDateTime#692611, deliveryDateTime#692606, availabilityDateTime#692612, nextAvailabilityDateTime#692613, isFallbackOrderOnly#692618, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, netPriceAmount#692637, netPriceCurrencyCode#692638, measurements#692642, minimumOrderQuantity#692631, constraintLabels#692632, constraintOperators#692633, constraintValues#692634, logisticUnits#692628, optimizationGroups#692644, externalProductId#692626, externalPlantId#692627, supplyingPlant#692608, productGroup#692609]
Input [36]: [orderProposalId#692601L, orderProposalItemId#692602, supplierGroup#692603, supplier#692604, plant#692605, deliveryDateTime#692606, subrange#692607, supplyingPlant#692608, productGroup#692609, product#692610, orderDateTime#692611, availabilityDateTime#692612, nextAvailabilityDateTime#692613, sourceOfSupplyUuid#692615, isFallbackOrderOnly#692618, splitIndicator#692620L, previousOrderProposal#692621L, worklistShardItemId#692624L, orderProposalItemGroupId#692625, externalProductId#692626, externalPlantId#692627, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, minimumOrderQuantity#692631, constraintLabels#692632, constraintOperators#692633, constraintValues#692634, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, measurements#692642, originalReplenishmentRunId#692643L, optimizationGroups#692644]
(19) BroadcastExchange
Input [36]: [worklistShardItemId#692624L, orderProposalId#692601L, orderProposalItemId#692602, orderProposalItemGroupId#692625, originalReplenishmentRunId#692643L, splitIndicator#692620L, previousOrderProposal#692621L, sourceOfSupplyUuid#692615, supplierGroup#692603, supplier#692604, subrange#692607, product#692610, plant#692605, orderDateTime#692611, deliveryDateTime#692606, availabilityDateTime#692612, nextAvailabilityDateTime#692613, isFallbackOrderOnly#692618, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, netPriceAmount#692637, netPriceCurrencyCode#692638, measurements#692642, minimumOrderQuantity#692631, constraintLabels#692632, constraintOperators#692633, constraintValues#692634, logisticUnits#692628, optimizationGroups#692644, externalProductId#692626, externalPlantId#692627, supplyingPlant#692608, productGroup#692609]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, true]),false), [plan_id=278807]
(20) BroadcastHashJoin [codegen id : 3]
Left keys [1]: [worklistShardItemId#692400L]
Right keys [1]: [worklistShardItemId#692624L]
Join type: LeftOuter
Join condition: (shardId#691888 = 0_1_10000002107)
(21) Project [codegen id : 3]
Output [39]: [shardId#691888, worklistShardItemId#692400L, quantityAfterProdPlantOptimization#692401, qty#692402, orderProposalId#692601L, originalReplenishmentRunId#692643L, supplierGroup#692603, supplier#692604, supplyingPlant#692608, productGroup#692609, product#692610, plant#692605, subrange#692607, orderDateTime#692611, deliveryDateTime#692606, availabilityDateTime#692612, nextAvailabilityDateTime#692613, constraintValues#692634, constraintOperators#692633, constraintLabels#692632, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, splitIndicator#692620L, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, sourceOfSupplyUuid#692615, minimumOrderQuantity#692631, orderProposalItemId#692602, orderProposalItemGroupId#692625, optimizationGroups#692644, measurements#692642, externalProductId#692626, externalPlantId#692627, previousOrderProposal#692621L, isFallbackOrderOnly#692618]
Input [40]: [shardId#691888, worklistShardItemId#692400L, quantityAfterProdPlantOptimization#692401, qty#692402, worklistShardItemId#692624L, orderProposalId#692601L, orderProposalItemId#692602, orderProposalItemGroupId#692625, originalReplenishmentRunId#692643L, splitIndicator#692620L, previousOrderProposal#692621L, sourceOfSupplyUuid#692615, supplierGroup#692603, supplier#692604, subrange#692607, product#692610, plant#692605, orderDateTime#692611, deliveryDateTime#692606, availabilityDateTime#692612, nextAvailabilityDateTime#692613, isFallbackOrderOnly#692618, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, netPriceAmount#692637, netPriceCurrencyCode#692638, measurements#692642, minimumOrderQuantity#692631, constraintLabels#692632, constraintOperators#692633, constraintValues#692634, logisticUnits#692628, optimizationGroups#692644, externalProductId#692626, externalPlantId#692627, supplyingPlant#692608, productGroup#692609]
(22) Exchange
Input [39]: [shardId#691888, worklistShardItemId#692400L, quantityAfterProdPlantOptimization#692401, qty#692402, orderProposalId#692601L, originalReplenishmentRunId#692643L, supplierGroup#692603, supplier#692604, supplyingPlant#692608, productGroup#692609, product#692610, plant#692605, subrange#692607, orderDateTime#692611, deliveryDateTime#692606, availabilityDateTime#692612, nextAvailabilityDateTime#692613, constraintValues#692634, constraintOperators#692633, constraintLabels#692632, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, splitIndicator#692620L, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, sourceOfSupplyUuid#692615, minimumOrderQuantity#692631, orderProposalItemId#692602, orderProposalItemGroupId#692625, optimizationGroups#692644, measurements#692642, externalProductId#692626, externalPlantId#692627, previousOrderProposal#692621L, isFallbackOrderOnly#692618]
Arguments: hashpartitioning(shardId#691888, worklistShardItemId#692400L, 20), ENSURE_REQUIREMENTS, [plan_id=278812]
(23) Sort [codegen id : 4]
Input [39]: [shardId#691888, worklistShardItemId#692400L, quantityAfterProdPlantOptimization#692401, qty#692402, orderProposalId#692601L, originalReplenishmentRunId#692643L, supplierGroup#692603, supplier#692604, supplyingPlant#692608, productGroup#692609, product#692610, plant#692605, subrange#692607, orderDateTime#692611, deliveryDateTime#692606, availabilityDateTime#692612, nextAvailabilityDateTime#692613, constraintValues#692634, constraintOperators#692633, constraintLabels#692632, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, splitIndicator#692620L, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, sourceOfSupplyUuid#692615, minimumOrderQuantity#692631, orderProposalItemId#692602, orderProposalItemGroupId#692625, optimizationGroups#692644, measurements#692642, externalProductId#692626, externalPlantId#692627, previousOrderProposal#692621L, isFallbackOrderOnly#692618]
Arguments: [shardId#691888 ASC NULLS FIRST, worklistShardItemId#692400L ASC NULLS FIRST], false, 0
(24) Scan ExistingRDD [codegen id : 5]
Output [6]: [shardId#693297, worklistShardItemId#693298L, qty#693299, demandChannel#693300, demandStream#693301, kpis#693302]
Arguments: [shardId#693297, worklistShardItemId#693298L, qty#693299, demandChannel#693300, demandStream#693301, kpis#693302], MapPartitionsRDD[32905] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(25) Filter [codegen id : 5]
Input [6]: [shardId#693297, worklistShardItemId#693298L, qty#693299, demandChannel#693300, demandStream#693301, kpis#693302]
Condition : (((isnull(qty#693299) AND isnull(demandChannel#693300)) AND isnull(demandStream#693301)) AND (isnotnull(shardId#693297) AND isnotnull(worklistShardItemId#693298L)))
(26) Project [codegen id : 5]
Output [3]: [shardId#693297, worklistShardItemId#693298L, coalesce(kpis#693302, []) AS prodLocSpecificKpis#693303]
Input [6]: [shardId#693297, worklistShardItemId#693298L, qty#693299, demandChannel#693300, demandStream#693301, kpis#693302]
(27) Exchange
Input [3]: [shardId#693297, worklistShardItemId#693298L, prodLocSpecificKpis#693303]
Arguments: hashpartitioning(shardId#693297, worklistShardItemId#693298L, 20), ENSURE_REQUIREMENTS, [plan_id=278818]
(28) Sort [codegen id : 6]
Input [3]: [shardId#693297, worklistShardItemId#693298L, prodLocSpecificKpis#693303]
Arguments: [shardId#693297 ASC NULLS FIRST, worklistShardItemId#693298L ASC NULLS FIRST], false, 0
(29) SortMergeJoin [codegen id : 7]
Left keys [2]: [shardId#691888, worklistShardItemId#692400L]
Right keys [2]: [shardId#693297, worklistShardItemId#693298L]
Join type: LeftOuter
Join condition: None
(30) Project [codegen id : 7]
Output [40]: [shardId#691888, worklistShardItemId#692400L, quantityAfterProdPlantOptimization#692401, qty#692402, orderProposalId#692601L, originalReplenishmentRunId#692643L, supplierGroup#692603, supplier#692604, supplyingPlant#692608, productGroup#692609, product#692610, plant#692605, subrange#692607, orderDateTime#692611, deliveryDateTime#692606, availabilityDateTime#692612, nextAvailabilityDateTime#692613, constraintValues#692634, constraintOperators#692633, constraintLabels#692632, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, splitIndicator#692620L, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, sourceOfSupplyUuid#692615, minimumOrderQuantity#692631, orderProposalItemId#692602, orderProposalItemGroupId#692625, optimizationGroups#692644, measurements#692642, externalProductId#692626, externalPlantId#692627, previousOrderProposal#692621L, isFallbackOrderOnly#692618, coalesce(prodLocSpecificKpis#693303, []) AS prodLocSpecificKpis#693304]
Input [42]: [shardId#691888, worklistShardItemId#692400L, quantityAfterProdPlantOptimization#692401, qty#692402, orderProposalId#692601L, originalReplenishmentRunId#692643L, supplierGroup#692603, supplier#692604, supplyingPlant#692608, productGroup#692609, product#692610, plant#692605, subrange#692607, orderDateTime#692611, deliveryDateTime#692606, availabilityDateTime#692612, nextAvailabilityDateTime#692613, constraintValues#692634, constraintOperators#692633, constraintLabels#692632, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, splitIndicator#692620L, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, sourceOfSupplyUuid#692615, minimumOrderQuantity#692631, orderProposalItemId#692602, orderProposalItemGroupId#692625, optimizationGroups#692644, measurements#692642, externalProductId#692626, externalPlantId#692627, previousOrderProposal#692621L, isFallbackOrderOnly#692618, shardId#693297, worklistShardItemId#693298L, prodLocSpecificKpis#693303]
(31) Scan ExistingRDD [codegen id : 8]
Output [6]: [shardId#693313, worklistShardItemId#693314L, qty#693315, demandChannel#693316, demandStream#693317, kpis#693318]
Arguments: [shardId#693313, worklistShardItemId#693314L, qty#693315, demandChannel#693316, demandStream#693317, kpis#693318], MapPartitionsRDD[32905] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(32) Filter [codegen id : 8]
Input [6]: [shardId#693313, worklistShardItemId#693314L, qty#693315, demandChannel#693316, demandStream#693317, kpis#693318]
Condition : ((((isnull(qty#693315) AND isnotnull(demandChannel#693316)) AND isnotnull(demandStream#693317)) AND (size(kpis#693318, true) > 0)) AND (isnotnull(shardId#693313) AND isnotnull(worklistShardItemId#693314L)))
(33) Project [codegen id : 8]
Output [5]: [shardId#693313, worklistShardItemId#693314L, demandChannel#693316, demandStream#693317, kpis#693318]
Input [6]: [shardId#693313, worklistShardItemId#693314L, qty#693315, demandChannel#693316, demandStream#693317, kpis#693318]
(34) ObjectHashAggregate
Input [5]: [shardId#693313, worklistShardItemId#693314L, demandChannel#693316, demandStream#693317, kpis#693318]
Keys [2]: [shardId#693313, worklistShardItemId#693314L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#693316, demandStream, demandStream#693317, kpis, kpis#693318), 0, 0)]
Aggregate Attributes [1]: [buf#693493]
Results [3]: [shardId#693313, worklistShardItemId#693314L, buf#693494]
(35) Exchange
Input [3]: [shardId#693313, worklistShardItemId#693314L, buf#693494]
Arguments: hashpartitioning(shardId#693313, worklistShardItemId#693314L, 20), ENSURE_REQUIREMENTS, [plan_id=278829]
(36) ObjectHashAggregate
Input [3]: [shardId#693313, worklistShardItemId#693314L, buf#693494]
Keys [2]: [shardId#693313, worklistShardItemId#693314L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#693316, demandStream, demandStream#693317, kpis, kpis#693318), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#693316, demandStream, demandStream#693317, kpis, kpis#693318), 0, 0)#693312]
Results [3]: [shardId#693313, worklistShardItemId#693314L, collect_list(struct(demandChannel, demandChannel#693316, demandStream, demandStream#693317, kpis, kpis#693318), 0, 0)#693312 AS channelStreamSpecificKpis#693305]
(37) Sort [codegen id : 9]
Input [3]: [shardId#693313, worklistShardItemId#693314L, channelStreamSpecificKpis#693305]
Arguments: [shardId#693313 ASC NULLS FIRST, worklistShardItemId#693314L ASC NULLS FIRST], false, 0
(38) SortMergeJoin [codegen id : 10]
Left keys [2]: [shardId#691888, worklistShardItemId#692400L]
Right keys [2]: [shardId#693313, worklistShardItemId#693314L]
Join type: LeftOuter
Join condition: None
(39) Project [codegen id : 10]
Output [41]: [shardId#691888, worklistShardItemId#692400L, quantityAfterProdPlantOptimization#692401, qty#692402, orderProposalId#692601L, originalReplenishmentRunId#692643L, supplierGroup#692603, supplier#692604, supplyingPlant#692608, productGroup#692609, product#692610, plant#692605, subrange#692607, orderDateTime#692611, deliveryDateTime#692606, availabilityDateTime#692612, nextAvailabilityDateTime#692613, constraintValues#692634, constraintOperators#692633, constraintLabels#692632, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, splitIndicator#692620L, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, sourceOfSupplyUuid#692615, minimumOrderQuantity#692631, orderProposalItemId#692602, orderProposalItemGroupId#692625, optimizationGroups#692644, measurements#692642, externalProductId#692626, externalPlantId#692627, previousOrderProposal#692621L, isFallbackOrderOnly#692618, prodLocSpecificKpis#693304, coalesce(channelStreamSpecificKpis#693305, []) AS channelStreamSpecificKpis#693319]
Input [43]: [shardId#691888, worklistShardItemId#692400L, quantityAfterProdPlantOptimization#692401, qty#692402, orderProposalId#692601L, originalReplenishmentRunId#692643L, supplierGroup#692603, supplier#692604, supplyingPlant#692608, productGroup#692609, product#692610, plant#692605, subrange#692607, orderDateTime#692611, deliveryDateTime#692606, availabilityDateTime#692612, nextAvailabilityDateTime#692613, constraintValues#692634, constraintOperators#692633, constraintLabels#692632, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, splitIndicator#692620L, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, sourceOfSupplyUuid#692615, minimumOrderQuantity#692631, orderProposalItemId#692602, orderProposalItemGroupId#692625, optimizationGroups#692644, measurements#692642, externalProductId#692626, externalPlantId#692627, previousOrderProposal#692621L, isFallbackOrderOnly#692618, prodLocSpecificKpis#693304, shardId#693313, worklistShardItemId#693314L, channelStreamSpecificKpis#693305]
(40) Scan ExistingRDD [codegen id : 11]
Output [6]: [shardId#693326, worklistShardItemId#693327L, qty#693328, demandChannel#693329, demandStream#693330, kpis#693331]
Arguments: [shardId#693326, worklistShardItemId#693327L, qty#693328, demandChannel#693329, demandStream#693330, kpis#693331], MapPartitionsRDD[32905] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(41) Filter [codegen id : 11]
Input [6]: [shardId#693326, worklistShardItemId#693327L, qty#693328, demandChannel#693329, demandStream#693330, kpis#693331]
Condition : ((isnotnull(qty#693328) AND isnotnull(kpis#693331)) AND (isnotnull(shardId#693326) AND isnotnull(worklistShardItemId#693327L)))
(42) Project [codegen id : 11]
Output [4]: [shardId#693326, worklistShardItemId#693327L, qty#693328, kpis#693331]
Input [6]: [shardId#693326, worklistShardItemId#693327L, qty#693328, demandChannel#693329, demandStream#693330, kpis#693331]
(43) ObjectHashAggregate
Input [4]: [shardId#693326, worklistShardItemId#693327L, qty#693328, kpis#693331]
Keys [2]: [shardId#693326, worklistShardItemId#693327L]
Functions [1]: [partial_collect_list(struct(qty, qty#693328, kpis, kpis#693331), 0, 0)]
Aggregate Attributes [1]: [buf#693495]
Results [3]: [shardId#693326, worklistShardItemId#693327L, buf#693496]
(44) Exchange
Input [3]: [shardId#693326, worklistShardItemId#693327L, buf#693496]
Arguments: hashpartitioning(shardId#693326, worklistShardItemId#693327L, 20), ENSURE_REQUIREMENTS, [plan_id=278841]
(45) ObjectHashAggregate
Input [3]: [shardId#693326, worklistShardItemId#693327L, buf#693496]
Keys [2]: [shardId#693326, worklistShardItemId#693327L]
Functions [1]: [collect_list(struct(qty, qty#693328, kpis, kpis#693331), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#693328, kpis, kpis#693331), 0, 0)#693325]
Results [3]: [shardId#693326, worklistShardItemId#693327L, map_from_entries(collect_list(struct(qty, qty#693328, kpis, kpis#693331), 0, 0)#693325) AS quantityKpis#693320]
(46) Sort [codegen id : 12]
Input [3]: [shardId#693326, worklistShardItemId#693327L, quantityKpis#693320]
Arguments: [shardId#693326 ASC NULLS FIRST, worklistShardItemId#693327L ASC NULLS FIRST], false, 0
(47) SortMergeJoin [codegen id : 13]
Left keys [2]: [shardId#691888, worklistShardItemId#692400L]
Right keys [2]: [shardId#693326, worklistShardItemId#693327L]
Join type: LeftOuter
Join condition: None
(48) Project [codegen id : 13]
Output [42]: [shardId#691888, worklistShardItemId#692400L, quantityAfterProdPlantOptimization#692401, qty#692402, orderProposalId#692601L, originalReplenishmentRunId#692643L, supplierGroup#692603, supplier#692604, supplyingPlant#692608, productGroup#692609, product#692610, plant#692605, subrange#692607, orderDateTime#692611, deliveryDateTime#692606, availabilityDateTime#692612, nextAvailabilityDateTime#692613, constraintValues#692634, constraintOperators#692633, constraintLabels#692632, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, splitIndicator#692620L, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, sourceOfSupplyUuid#692615, minimumOrderQuantity#692631, orderProposalItemId#692602, orderProposalItemGroupId#692625, optimizationGroups#692644, measurements#692642, externalProductId#692626, externalPlantId#692627, previousOrderProposal#692621L, isFallbackOrderOnly#692618, prodLocSpecificKpis#693304, channelStreamSpecificKpis#693319, coalesce(quantityKpis#693320, map(keys: [], values: [])) AS quantityKpis#693332]
Input [44]: [shardId#691888, worklistShardItemId#692400L, quantityAfterProdPlantOptimization#692401, qty#692402, orderProposalId#692601L, originalReplenishmentRunId#692643L, supplierGroup#692603, supplier#692604, supplyingPlant#692608, productGroup#692609, product#692610, plant#692605, subrange#692607, orderDateTime#692611, deliveryDateTime#692606, availabilityDateTime#692612, nextAvailabilityDateTime#692613, constraintValues#692634, constraintOperators#692633, constraintLabels#692632, logisticUnits#692628, orderQuantityBaseUom#692629, orderQuantityBaseUomUuid#692630, splitIndicator#692620L, netPriceAmount#692637, netPriceCurrencyCode#692638, netPriceQuantity#692639, netPriceQuantityUom#692640, netPriceQuantityUomUuid#692641, sourceOfSupplyUuid#692615, minimumOrderQuantity#692631, orderProposalItemId#692602, orderProposalItemGroupId#692625, optimizationGroups#692644, measurements#692642, externalProductId#692626, externalPlantId#692627, previousOrderProposal#692621L, isFallbackOrderOnly#692618, prodLocSpecificKpis#693304, channelStreamSpecificKpis#693319, shardId#693326, worklistShardItemId#693327L, quantityKpis#693320]
(49) Filter [codegen id : 1]
Input [4]: [orderProposalId#692558L, orderProposalItemId#692559, quantityKpis#693332, shardId#691888]
Condition : ((isnotnull(shardId#691888) AND (shardId#691888 = 0_1_10000002107)) AND (size(quantityKpis#693332, true) > 0))
(50) Project [codegen id : 1]
Output [3]: [orderProposalId#692558L, orderProposalItemId#692559, quantityKpis#693332]
Input [4]: [orderProposalId#692558L, orderProposalItemId#692559, quantityKpis#693332, shardId#691888]
(51) Generate [codegen id : 1]
Input [3]: [orderProposalId#692558L, orderProposalItemId#692559, quantityKpis#693332]
Arguments: explode(quantityKpis#693332), [orderProposalId#692558L, orderProposalItemId#692559], false, [orderQuantityInBaseUnit#696951, kpis#696952]
(52) Project
Output [7]: [orderProposalId#692558L, cast(orderProposalItemId#692559 as bigint) AS orderProposalItemId#696950L, orderQuantityInBaseUnit#696951, filter(kpis#696952, lambdafunction((lambda x_1849#696954.label = ServiceLevel), lambda x_1849#696954, false))[0].value AS serviceLevel#696953, filter(kpis#696952, lambdafunction((lambda x_1850#696956.label = RangeOfCoverage), lambda x_1850#696956, false))[0].value AS rangeOfCoverage#696955, filter(kpis#696952, lambdafunction((lambda x_1851#696958.label = ServiceLevelAtStartOfDelisting), lambda x_1851#696958, false))[0].value AS serviceLevelAtEndOfListing#696957, 10000002107 AS replenishmentRunId#696960L]
Input [4]: [orderProposalId#692558L, orderProposalItemId#692559, orderQuantityInBaseUnit#696951, kpis#696952]
(53) WriteFiles
Input [7]: [orderProposalId#692558L, orderProposalItemId#696950L, orderQuantityInBaseUnit#696951, serviceLevel#696953, rangeOfCoverage#696955, serviceLevelAtEndOfListing#696957, replenishmentRunId#696960L]
(54) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000002107/shardId=0_1_10000002107/sequenceId=5, false, Parquet, [path=hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000002107/shardId=0_1_10000002107/sequenceId=5], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, replenishmentRunId]