== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (54)
+- WriteFiles (53)
+- Project (52)
+- * Generate (51)
+- * Project (50)
+- * Filter (49)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (48)
+- * SortMergeJoin LeftOuter (47)
:- * Project (39)
: +- * SortMergeJoin LeftOuter (38)
: :- * Project (30)
: : +- * SortMergeJoin LeftOuter (29)
: : :- * Sort (23)
: : : +- Exchange (22)
: : : +- * Project (21)
: : : +- * BroadcastHashJoin LeftOuter BuildRight (20)
: : : :- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- BroadcastExchange (19)
: : : +- * Project (18)
: : : +- Exchange (17)
: : : +- * Project (16)
: : : +- * Filter (15)
: : : +- * ColumnarToRow (14)
: : : +- Scan parquet (13)
: : +- * Sort (28)
: : +- Exchange (27)
: : +- * Project (26)
: : +- * Filter (25)
: : +- * Scan ExistingRDD (24)
: +- * Sort (37)
: +- ObjectHashAggregate (36)
: +- Exchange (35)
: +- ObjectHashAggregate (34)
: +- * Project (33)
: +- * Filter (32)
: +- * Scan ExistingRDD (31)
+- * Sort (46)
+- ObjectHashAggregate (45)
+- Exchange (44)
+- ObjectHashAggregate (43)
+- * Project (42)
+- * Filter (41)
+- * Scan ExistingRDD (40)
(1) InMemoryTableScan
Output [4]: [orderProposalId#713333L, orderProposalItemId#713334, quantityKpis#713930, shardId#712663]
Arguments: [orderProposalId#713333L, orderProposalItemId#713334, quantityKpis#713930, shardId#712663], [isnotnull(shardId#712663), (shardId#712663 = 0_1_10000002107), (size(quantityKpis#713930, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#712663, worklistShardItemId#713175L, quantityAfterProdPlantOptimization#713176, qty#713177, orderProposalId#713333L, originalReplenishmentRunId#713336L, supplierGroup#713343, supplier#713344, supplyingPlant#713374, productGroup#713375, product#713346, plant#713347, subrange#713345, orderDateTime#713351, deliveryDateTime#713352, availabilityDateTime#713353, nextAvailabilityDateTime#713354, constraintValues#713368, constraintOperators#713366, constraintLabels#713365, logisticUnits#713370, orderQuantityBaseUom#713356, orderQuantityBaseUomUuid#713357, splitIndicator#713338L, netPriceAmount#713361, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#712663, items#712665]
Arguments: [shardId#712663, items#712665], [(size(items#712665, true) > 0), isnotnull(items#712665)]
(4) InMemoryRelation
Arguments: [shardId#712663, orderProposalId#712664L, items#712665, optimizationGroups#712666, isOptimal#712667, optimizationInsights#712669], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#712663, orderProposalId#712664L, items#712665, optimizationGroups#712666, isOptimal#712667, optimizationInsights#712669]
Arguments: [shardId#712663, orderProposalId#712664L, items#712665, optimizationGroups#712666, isOptimal#712667, optimizationInsights#712669], [isnotnull(shardId#712663), (shardId#712663 = 0_1_10000002107)]
(6) InMemoryRelation
Arguments: [shardId#712663, orderProposalId#712664L, items#712665, optimizationGroups#712666, isOptimal#712667, lastModified#712668, optimizationInsights#712669], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#712663, orderProposalId#712664L, items#712665, optimizationGroups#712666, isOptimal#712667, lastModified#712668, optimizationInsights#712669]
Arguments: [shardId#712663, orderProposalId#712664L, items#712665, optimizationGroups#712666, isOptimal#712667, lastModified#712668, optimizationInsights#712669], MapPartitionsRDD[33617] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#712663, orderProposalId#712664L, items#712665, optimizationGroups#712666, isOptimal#712667, lastModified#712668, optimizationInsights#712669]
Condition : (isnotnull(shardId#712663) AND (shardId#712663 = 0_1_10000002107))
(9) Filter [codegen id : 1]
Input [6]: [shardId#712663, orderProposalId#712664L, items#712665, optimizationGroups#712666, isOptimal#712667, optimizationInsights#712669]
Condition : (isnotnull(shardId#712663) AND (shardId#712663 = 0_1_10000002107))
(10) Filter [codegen id : 3]
Input [2]: [shardId#712663, items#712665]
Condition : ((size(items#712665, true) > 0) AND isnotnull(items#712665))
(11) Generate [codegen id : 3]
Input [2]: [shardId#712663, items#712665]
Arguments: explode(items#712665), [shardId#712663], false, [item#713174]
(12) Project [codegen id : 3]
Output [4]: [shardId#712663, item#713174.worklistShardItemId AS worklistShardItemId#713175L, item#713174.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#713176, item#713174.qty AS qty#713177]
Input [2]: [shardId#712663, item#713174]
(13) Scan parquet
Output [38]: [orderProposalId#713376L, orderProposalItemId#713377, supplierGroup#713378, supplier#713379, plant#713380, deliveryDateTime#713381, subrange#713382, supplyingPlant#713383, productGroup#713384, product#713385, orderDateTime#713386, availabilityDateTime#713387, nextAvailabilityDateTime#713388, sourceOfSupplyUuid#713390, isFallbackOrderOnly#713393, splitIndicator#713395L, previousOrderProposal#713396L, worklistShardItemId#713399L, orderProposalItemGroupId#713400, externalProductId#713401, externalPlantId#713402, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, minimumOrderQuantity#713406, constraintLabels#713407, constraintOperators#713408, constraintValues#713409, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, measurements#713417, originalReplenishmentRunId#713418L, optimizationGroups#713419, shardId#713420, sequenceId#713398]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000002107]
PartitionFilters: [isnotnull(shardId#713420), isnotnull(sequenceId#713398), (shardId#713420 = 0_1_10000002107), (sequenceId#713398 = 6)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(14) ColumnarToRow [codegen id : 1]
Input [38]: [orderProposalId#713376L, orderProposalItemId#713377, supplierGroup#713378, supplier#713379, plant#713380, deliveryDateTime#713381, subrange#713382, supplyingPlant#713383, productGroup#713384, product#713385, orderDateTime#713386, availabilityDateTime#713387, nextAvailabilityDateTime#713388, sourceOfSupplyUuid#713390, isFallbackOrderOnly#713393, splitIndicator#713395L, previousOrderProposal#713396L, worklistShardItemId#713399L, orderProposalItemGroupId#713400, externalProductId#713401, externalPlantId#713402, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, minimumOrderQuantity#713406, constraintLabels#713407, constraintOperators#713408, constraintValues#713409, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, measurements#713417, originalReplenishmentRunId#713418L, optimizationGroups#713419, shardId#713420, sequenceId#713398]
(15) Filter [codegen id : 1]
Input [38]: [orderProposalId#713376L, orderProposalItemId#713377, supplierGroup#713378, supplier#713379, plant#713380, deliveryDateTime#713381, subrange#713382, supplyingPlant#713383, productGroup#713384, product#713385, orderDateTime#713386, availabilityDateTime#713387, nextAvailabilityDateTime#713388, sourceOfSupplyUuid#713390, isFallbackOrderOnly#713393, splitIndicator#713395L, previousOrderProposal#713396L, worklistShardItemId#713399L, orderProposalItemGroupId#713400, externalProductId#713401, externalPlantId#713402, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, minimumOrderQuantity#713406, constraintLabels#713407, constraintOperators#713408, constraintValues#713409, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, measurements#713417, originalReplenishmentRunId#713418L, optimizationGroups#713419, shardId#713420, sequenceId#713398]
Condition : isnotnull(worklistShardItemId#713399L)
(16) Project [codegen id : 1]
Output [36]: [orderProposalId#713376L, orderProposalItemId#713377, supplierGroup#713378, supplier#713379, plant#713380, deliveryDateTime#713381, subrange#713382, supplyingPlant#713383, productGroup#713384, product#713385, orderDateTime#713386, availabilityDateTime#713387, nextAvailabilityDateTime#713388, sourceOfSupplyUuid#713390, isFallbackOrderOnly#713393, splitIndicator#713395L, previousOrderProposal#713396L, worklistShardItemId#713399L, orderProposalItemGroupId#713400, externalProductId#713401, externalPlantId#713402, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, minimumOrderQuantity#713406, constraintLabels#713407, constraintOperators#713408, constraintValues#713409, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, measurements#713417, originalReplenishmentRunId#713418L, optimizationGroups#713419]
Input [38]: [orderProposalId#713376L, orderProposalItemId#713377, supplierGroup#713378, supplier#713379, plant#713380, deliveryDateTime#713381, subrange#713382, supplyingPlant#713383, productGroup#713384, product#713385, orderDateTime#713386, availabilityDateTime#713387, nextAvailabilityDateTime#713388, sourceOfSupplyUuid#713390, isFallbackOrderOnly#713393, splitIndicator#713395L, previousOrderProposal#713396L, worklistShardItemId#713399L, orderProposalItemGroupId#713400, externalProductId#713401, externalPlantId#713402, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, minimumOrderQuantity#713406, constraintLabels#713407, constraintOperators#713408, constraintValues#713409, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, measurements#713417, originalReplenishmentRunId#713418L, optimizationGroups#713419, shardId#713420, sequenceId#713398]
(17) Exchange
Input [36]: [orderProposalId#713376L, orderProposalItemId#713377, supplierGroup#713378, supplier#713379, plant#713380, deliveryDateTime#713381, subrange#713382, supplyingPlant#713383, productGroup#713384, product#713385, orderDateTime#713386, availabilityDateTime#713387, nextAvailabilityDateTime#713388, sourceOfSupplyUuid#713390, isFallbackOrderOnly#713393, splitIndicator#713395L, previousOrderProposal#713396L, worklistShardItemId#713399L, orderProposalItemGroupId#713400, externalProductId#713401, externalPlantId#713402, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, minimumOrderQuantity#713406, constraintLabels#713407, constraintOperators#713408, constraintValues#713409, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, measurements#713417, originalReplenishmentRunId#713418L, optimizationGroups#713419]
Arguments: hashpartitioning(worklistShardItemId#713399L, 20), REPARTITION_BY_NUM, [plan_id=283656]
(18) Project [codegen id : 2]
Output [36]: [worklistShardItemId#713399L, orderProposalId#713376L, orderProposalItemId#713377, orderProposalItemGroupId#713400, originalReplenishmentRunId#713418L, splitIndicator#713395L, previousOrderProposal#713396L, sourceOfSupplyUuid#713390, supplierGroup#713378, supplier#713379, subrange#713382, product#713385, plant#713380, orderDateTime#713386, deliveryDateTime#713381, availabilityDateTime#713387, nextAvailabilityDateTime#713388, isFallbackOrderOnly#713393, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, netPriceAmount#713412, netPriceCurrencyCode#713413, measurements#713417, minimumOrderQuantity#713406, constraintLabels#713407, constraintOperators#713408, constraintValues#713409, logisticUnits#713403, optimizationGroups#713419, externalProductId#713401, externalPlantId#713402, supplyingPlant#713383, productGroup#713384]
Input [36]: [orderProposalId#713376L, orderProposalItemId#713377, supplierGroup#713378, supplier#713379, plant#713380, deliveryDateTime#713381, subrange#713382, supplyingPlant#713383, productGroup#713384, product#713385, orderDateTime#713386, availabilityDateTime#713387, nextAvailabilityDateTime#713388, sourceOfSupplyUuid#713390, isFallbackOrderOnly#713393, splitIndicator#713395L, previousOrderProposal#713396L, worklistShardItemId#713399L, orderProposalItemGroupId#713400, externalProductId#713401, externalPlantId#713402, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, minimumOrderQuantity#713406, constraintLabels#713407, constraintOperators#713408, constraintValues#713409, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, measurements#713417, originalReplenishmentRunId#713418L, optimizationGroups#713419]
(19) BroadcastExchange
Input [36]: [worklistShardItemId#713399L, orderProposalId#713376L, orderProposalItemId#713377, orderProposalItemGroupId#713400, originalReplenishmentRunId#713418L, splitIndicator#713395L, previousOrderProposal#713396L, sourceOfSupplyUuid#713390, supplierGroup#713378, supplier#713379, subrange#713382, product#713385, plant#713380, orderDateTime#713386, deliveryDateTime#713381, availabilityDateTime#713387, nextAvailabilityDateTime#713388, isFallbackOrderOnly#713393, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, netPriceAmount#713412, netPriceCurrencyCode#713413, measurements#713417, minimumOrderQuantity#713406, constraintLabels#713407, constraintOperators#713408, constraintValues#713409, logisticUnits#713403, optimizationGroups#713419, externalProductId#713401, externalPlantId#713402, supplyingPlant#713383, productGroup#713384]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, true]),false), [plan_id=283660]
(20) BroadcastHashJoin [codegen id : 3]
Left keys [1]: [worklistShardItemId#713175L]
Right keys [1]: [worklistShardItemId#713399L]
Join type: LeftOuter
Join condition: (shardId#712663 = 0_1_10000002107)
(21) Project [codegen id : 3]
Output [39]: [shardId#712663, worklistShardItemId#713175L, quantityAfterProdPlantOptimization#713176, qty#713177, orderProposalId#713376L, originalReplenishmentRunId#713418L, supplierGroup#713378, supplier#713379, supplyingPlant#713383, productGroup#713384, product#713385, plant#713380, subrange#713382, orderDateTime#713386, deliveryDateTime#713381, availabilityDateTime#713387, nextAvailabilityDateTime#713388, constraintValues#713409, constraintOperators#713408, constraintLabels#713407, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, splitIndicator#713395L, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, sourceOfSupplyUuid#713390, minimumOrderQuantity#713406, orderProposalItemId#713377, orderProposalItemGroupId#713400, optimizationGroups#713419, measurements#713417, externalProductId#713401, externalPlantId#713402, previousOrderProposal#713396L, isFallbackOrderOnly#713393]
Input [40]: [shardId#712663, worklistShardItemId#713175L, quantityAfterProdPlantOptimization#713176, qty#713177, worklistShardItemId#713399L, orderProposalId#713376L, orderProposalItemId#713377, orderProposalItemGroupId#713400, originalReplenishmentRunId#713418L, splitIndicator#713395L, previousOrderProposal#713396L, sourceOfSupplyUuid#713390, supplierGroup#713378, supplier#713379, subrange#713382, product#713385, plant#713380, orderDateTime#713386, deliveryDateTime#713381, availabilityDateTime#713387, nextAvailabilityDateTime#713388, isFallbackOrderOnly#713393, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, netPriceAmount#713412, netPriceCurrencyCode#713413, measurements#713417, minimumOrderQuantity#713406, constraintLabels#713407, constraintOperators#713408, constraintValues#713409, logisticUnits#713403, optimizationGroups#713419, externalProductId#713401, externalPlantId#713402, supplyingPlant#713383, productGroup#713384]
(22) Exchange
Input [39]: [shardId#712663, worklistShardItemId#713175L, quantityAfterProdPlantOptimization#713176, qty#713177, orderProposalId#713376L, originalReplenishmentRunId#713418L, supplierGroup#713378, supplier#713379, supplyingPlant#713383, productGroup#713384, product#713385, plant#713380, subrange#713382, orderDateTime#713386, deliveryDateTime#713381, availabilityDateTime#713387, nextAvailabilityDateTime#713388, constraintValues#713409, constraintOperators#713408, constraintLabels#713407, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, splitIndicator#713395L, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, sourceOfSupplyUuid#713390, minimumOrderQuantity#713406, orderProposalItemId#713377, orderProposalItemGroupId#713400, optimizationGroups#713419, measurements#713417, externalProductId#713401, externalPlantId#713402, previousOrderProposal#713396L, isFallbackOrderOnly#713393]
Arguments: hashpartitioning(shardId#712663, worklistShardItemId#713175L, 20), ENSURE_REQUIREMENTS, [plan_id=283665]
(23) Sort [codegen id : 4]
Input [39]: [shardId#712663, worklistShardItemId#713175L, quantityAfterProdPlantOptimization#713176, qty#713177, orderProposalId#713376L, originalReplenishmentRunId#713418L, supplierGroup#713378, supplier#713379, supplyingPlant#713383, productGroup#713384, product#713385, plant#713380, subrange#713382, orderDateTime#713386, deliveryDateTime#713381, availabilityDateTime#713387, nextAvailabilityDateTime#713388, constraintValues#713409, constraintOperators#713408, constraintLabels#713407, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, splitIndicator#713395L, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, sourceOfSupplyUuid#713390, minimumOrderQuantity#713406, orderProposalItemId#713377, orderProposalItemGroupId#713400, optimizationGroups#713419, measurements#713417, externalProductId#713401, externalPlantId#713402, previousOrderProposal#713396L, isFallbackOrderOnly#713393]
Arguments: [shardId#712663 ASC NULLS FIRST, worklistShardItemId#713175L ASC NULLS FIRST], false, 0
(24) Scan ExistingRDD [codegen id : 5]
Output [6]: [shardId#713895, worklistShardItemId#713896L, qty#713897, demandChannel#713898, demandStream#713899, kpis#713900]
Arguments: [shardId#713895, worklistShardItemId#713896L, qty#713897, demandChannel#713898, demandStream#713899, kpis#713900], MapPartitionsRDD[33677] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(25) Filter [codegen id : 5]
Input [6]: [shardId#713895, worklistShardItemId#713896L, qty#713897, demandChannel#713898, demandStream#713899, kpis#713900]
Condition : (((isnull(qty#713897) AND isnull(demandChannel#713898)) AND isnull(demandStream#713899)) AND (isnotnull(shardId#713895) AND isnotnull(worklistShardItemId#713896L)))
(26) Project [codegen id : 5]
Output [3]: [shardId#713895, worklistShardItemId#713896L, coalesce(kpis#713900, []) AS prodLocSpecificKpis#713901]
Input [6]: [shardId#713895, worklistShardItemId#713896L, qty#713897, demandChannel#713898, demandStream#713899, kpis#713900]
(27) Exchange
Input [3]: [shardId#713895, worklistShardItemId#713896L, prodLocSpecificKpis#713901]
Arguments: hashpartitioning(shardId#713895, worklistShardItemId#713896L, 20), ENSURE_REQUIREMENTS, [plan_id=283671]
(28) Sort [codegen id : 6]
Input [3]: [shardId#713895, worklistShardItemId#713896L, prodLocSpecificKpis#713901]
Arguments: [shardId#713895 ASC NULLS FIRST, worklistShardItemId#713896L ASC NULLS FIRST], false, 0
(29) SortMergeJoin [codegen id : 7]
Left keys [2]: [shardId#712663, worklistShardItemId#713175L]
Right keys [2]: [shardId#713895, worklistShardItemId#713896L]
Join type: LeftOuter
Join condition: None
(30) Project [codegen id : 7]
Output [40]: [shardId#712663, worklistShardItemId#713175L, quantityAfterProdPlantOptimization#713176, qty#713177, orderProposalId#713376L, originalReplenishmentRunId#713418L, supplierGroup#713378, supplier#713379, supplyingPlant#713383, productGroup#713384, product#713385, plant#713380, subrange#713382, orderDateTime#713386, deliveryDateTime#713381, availabilityDateTime#713387, nextAvailabilityDateTime#713388, constraintValues#713409, constraintOperators#713408, constraintLabels#713407, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, splitIndicator#713395L, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, sourceOfSupplyUuid#713390, minimumOrderQuantity#713406, orderProposalItemId#713377, orderProposalItemGroupId#713400, optimizationGroups#713419, measurements#713417, externalProductId#713401, externalPlantId#713402, previousOrderProposal#713396L, isFallbackOrderOnly#713393, coalesce(prodLocSpecificKpis#713901, []) AS prodLocSpecificKpis#713902]
Input [42]: [shardId#712663, worklistShardItemId#713175L, quantityAfterProdPlantOptimization#713176, qty#713177, orderProposalId#713376L, originalReplenishmentRunId#713418L, supplierGroup#713378, supplier#713379, supplyingPlant#713383, productGroup#713384, product#713385, plant#713380, subrange#713382, orderDateTime#713386, deliveryDateTime#713381, availabilityDateTime#713387, nextAvailabilityDateTime#713388, constraintValues#713409, constraintOperators#713408, constraintLabels#713407, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, splitIndicator#713395L, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, sourceOfSupplyUuid#713390, minimumOrderQuantity#713406, orderProposalItemId#713377, orderProposalItemGroupId#713400, optimizationGroups#713419, measurements#713417, externalProductId#713401, externalPlantId#713402, previousOrderProposal#713396L, isFallbackOrderOnly#713393, shardId#713895, worklistShardItemId#713896L, prodLocSpecificKpis#713901]
(31) Scan ExistingRDD [codegen id : 8]
Output [6]: [shardId#713911, worklistShardItemId#713912L, qty#713913, demandChannel#713914, demandStream#713915, kpis#713916]
Arguments: [shardId#713911, worklistShardItemId#713912L, qty#713913, demandChannel#713914, demandStream#713915, kpis#713916], MapPartitionsRDD[33677] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(32) Filter [codegen id : 8]
Input [6]: [shardId#713911, worklistShardItemId#713912L, qty#713913, demandChannel#713914, demandStream#713915, kpis#713916]
Condition : ((((isnull(qty#713913) AND isnotnull(demandChannel#713914)) AND isnotnull(demandStream#713915)) AND (size(kpis#713916, true) > 0)) AND (isnotnull(shardId#713911) AND isnotnull(worklistShardItemId#713912L)))
(33) Project [codegen id : 8]
Output [5]: [shardId#713911, worklistShardItemId#713912L, demandChannel#713914, demandStream#713915, kpis#713916]
Input [6]: [shardId#713911, worklistShardItemId#713912L, qty#713913, demandChannel#713914, demandStream#713915, kpis#713916]
(34) ObjectHashAggregate
Input [5]: [shardId#713911, worklistShardItemId#713912L, demandChannel#713914, demandStream#713915, kpis#713916]
Keys [2]: [shardId#713911, worklistShardItemId#713912L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#713914, demandStream, demandStream#713915, kpis, kpis#713916), 0, 0)]
Aggregate Attributes [1]: [buf#714091]
Results [3]: [shardId#713911, worklistShardItemId#713912L, buf#714092]
(35) Exchange
Input [3]: [shardId#713911, worklistShardItemId#713912L, buf#714092]
Arguments: hashpartitioning(shardId#713911, worklistShardItemId#713912L, 20), ENSURE_REQUIREMENTS, [plan_id=283682]
(36) ObjectHashAggregate
Input [3]: [shardId#713911, worklistShardItemId#713912L, buf#714092]
Keys [2]: [shardId#713911, worklistShardItemId#713912L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#713914, demandStream, demandStream#713915, kpis, kpis#713916), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#713914, demandStream, demandStream#713915, kpis, kpis#713916), 0, 0)#713910]
Results [3]: [shardId#713911, worklistShardItemId#713912L, collect_list(struct(demandChannel, demandChannel#713914, demandStream, demandStream#713915, kpis, kpis#713916), 0, 0)#713910 AS channelStreamSpecificKpis#713903]
(37) Sort [codegen id : 9]
Input [3]: [shardId#713911, worklistShardItemId#713912L, channelStreamSpecificKpis#713903]
Arguments: [shardId#713911 ASC NULLS FIRST, worklistShardItemId#713912L ASC NULLS FIRST], false, 0
(38) SortMergeJoin [codegen id : 10]
Left keys [2]: [shardId#712663, worklistShardItemId#713175L]
Right keys [2]: [shardId#713911, worklistShardItemId#713912L]
Join type: LeftOuter
Join condition: None
(39) Project [codegen id : 10]
Output [41]: [shardId#712663, worklistShardItemId#713175L, quantityAfterProdPlantOptimization#713176, qty#713177, orderProposalId#713376L, originalReplenishmentRunId#713418L, supplierGroup#713378, supplier#713379, supplyingPlant#713383, productGroup#713384, product#713385, plant#713380, subrange#713382, orderDateTime#713386, deliveryDateTime#713381, availabilityDateTime#713387, nextAvailabilityDateTime#713388, constraintValues#713409, constraintOperators#713408, constraintLabels#713407, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, splitIndicator#713395L, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, sourceOfSupplyUuid#713390, minimumOrderQuantity#713406, orderProposalItemId#713377, orderProposalItemGroupId#713400, optimizationGroups#713419, measurements#713417, externalProductId#713401, externalPlantId#713402, previousOrderProposal#713396L, isFallbackOrderOnly#713393, prodLocSpecificKpis#713902, coalesce(channelStreamSpecificKpis#713903, []) AS channelStreamSpecificKpis#713917]
Input [43]: [shardId#712663, worklistShardItemId#713175L, quantityAfterProdPlantOptimization#713176, qty#713177, orderProposalId#713376L, originalReplenishmentRunId#713418L, supplierGroup#713378, supplier#713379, supplyingPlant#713383, productGroup#713384, product#713385, plant#713380, subrange#713382, orderDateTime#713386, deliveryDateTime#713381, availabilityDateTime#713387, nextAvailabilityDateTime#713388, constraintValues#713409, constraintOperators#713408, constraintLabels#713407, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, splitIndicator#713395L, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, sourceOfSupplyUuid#713390, minimumOrderQuantity#713406, orderProposalItemId#713377, orderProposalItemGroupId#713400, optimizationGroups#713419, measurements#713417, externalProductId#713401, externalPlantId#713402, previousOrderProposal#713396L, isFallbackOrderOnly#713393, prodLocSpecificKpis#713902, shardId#713911, worklistShardItemId#713912L, channelStreamSpecificKpis#713903]
(40) Scan ExistingRDD [codegen id : 11]
Output [6]: [shardId#713924, worklistShardItemId#713925L, qty#713926, demandChannel#713927, demandStream#713928, kpis#713929]
Arguments: [shardId#713924, worklistShardItemId#713925L, qty#713926, demandChannel#713927, demandStream#713928, kpis#713929], MapPartitionsRDD[33677] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(41) Filter [codegen id : 11]
Input [6]: [shardId#713924, worklistShardItemId#713925L, qty#713926, demandChannel#713927, demandStream#713928, kpis#713929]
Condition : ((isnotnull(qty#713926) AND isnotnull(kpis#713929)) AND (isnotnull(shardId#713924) AND isnotnull(worklistShardItemId#713925L)))
(42) Project [codegen id : 11]
Output [4]: [shardId#713924, worklistShardItemId#713925L, qty#713926, kpis#713929]
Input [6]: [shardId#713924, worklistShardItemId#713925L, qty#713926, demandChannel#713927, demandStream#713928, kpis#713929]
(43) ObjectHashAggregate
Input [4]: [shardId#713924, worklistShardItemId#713925L, qty#713926, kpis#713929]
Keys [2]: [shardId#713924, worklistShardItemId#713925L]
Functions [1]: [partial_collect_list(struct(qty, qty#713926, kpis, kpis#713929), 0, 0)]
Aggregate Attributes [1]: [buf#714093]
Results [3]: [shardId#713924, worklistShardItemId#713925L, buf#714094]
(44) Exchange
Input [3]: [shardId#713924, worklistShardItemId#713925L, buf#714094]
Arguments: hashpartitioning(shardId#713924, worklistShardItemId#713925L, 20), ENSURE_REQUIREMENTS, [plan_id=283694]
(45) ObjectHashAggregate
Input [3]: [shardId#713924, worklistShardItemId#713925L, buf#714094]
Keys [2]: [shardId#713924, worklistShardItemId#713925L]
Functions [1]: [collect_list(struct(qty, qty#713926, kpis, kpis#713929), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#713926, kpis, kpis#713929), 0, 0)#713923]
Results [3]: [shardId#713924, worklistShardItemId#713925L, map_from_entries(collect_list(struct(qty, qty#713926, kpis, kpis#713929), 0, 0)#713923) AS quantityKpis#713918]
(46) Sort [codegen id : 12]
Input [3]: [shardId#713924, worklistShardItemId#713925L, quantityKpis#713918]
Arguments: [shardId#713924 ASC NULLS FIRST, worklistShardItemId#713925L ASC NULLS FIRST], false, 0
(47) SortMergeJoin [codegen id : 13]
Left keys [2]: [shardId#712663, worklistShardItemId#713175L]
Right keys [2]: [shardId#713924, worklistShardItemId#713925L]
Join type: LeftOuter
Join condition: None
(48) Project [codegen id : 13]
Output [42]: [shardId#712663, worklistShardItemId#713175L, quantityAfterProdPlantOptimization#713176, qty#713177, orderProposalId#713376L, originalReplenishmentRunId#713418L, supplierGroup#713378, supplier#713379, supplyingPlant#713383, productGroup#713384, product#713385, plant#713380, subrange#713382, orderDateTime#713386, deliveryDateTime#713381, availabilityDateTime#713387, nextAvailabilityDateTime#713388, constraintValues#713409, constraintOperators#713408, constraintLabels#713407, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, splitIndicator#713395L, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, sourceOfSupplyUuid#713390, minimumOrderQuantity#713406, orderProposalItemId#713377, orderProposalItemGroupId#713400, optimizationGroups#713419, measurements#713417, externalProductId#713401, externalPlantId#713402, previousOrderProposal#713396L, isFallbackOrderOnly#713393, prodLocSpecificKpis#713902, channelStreamSpecificKpis#713917, coalesce(quantityKpis#713918, map(keys: [], values: [])) AS quantityKpis#713930]
Input [44]: [shardId#712663, worklistShardItemId#713175L, quantityAfterProdPlantOptimization#713176, qty#713177, orderProposalId#713376L, originalReplenishmentRunId#713418L, supplierGroup#713378, supplier#713379, supplyingPlant#713383, productGroup#713384, product#713385, plant#713380, subrange#713382, orderDateTime#713386, deliveryDateTime#713381, availabilityDateTime#713387, nextAvailabilityDateTime#713388, constraintValues#713409, constraintOperators#713408, constraintLabels#713407, logisticUnits#713403, orderQuantityBaseUom#713404, orderQuantityBaseUomUuid#713405, splitIndicator#713395L, netPriceAmount#713412, netPriceCurrencyCode#713413, netPriceQuantity#713414, netPriceQuantityUom#713415, netPriceQuantityUomUuid#713416, sourceOfSupplyUuid#713390, minimumOrderQuantity#713406, orderProposalItemId#713377, orderProposalItemGroupId#713400, optimizationGroups#713419, measurements#713417, externalProductId#713401, externalPlantId#713402, previousOrderProposal#713396L, isFallbackOrderOnly#713393, prodLocSpecificKpis#713902, channelStreamSpecificKpis#713917, shardId#713924, worklistShardItemId#713925L, quantityKpis#713918]
(49) Filter [codegen id : 1]
Input [4]: [orderProposalId#713333L, orderProposalItemId#713334, quantityKpis#713930, shardId#712663]
Condition : ((isnotnull(shardId#712663) AND (shardId#712663 = 0_1_10000002107)) AND (size(quantityKpis#713930, true) > 0))
(50) Project [codegen id : 1]
Output [3]: [orderProposalId#713333L, orderProposalItemId#713334, quantityKpis#713930]
Input [4]: [orderProposalId#713333L, orderProposalItemId#713334, quantityKpis#713930, shardId#712663]
(51) Generate [codegen id : 1]
Input [3]: [orderProposalId#713333L, orderProposalItemId#713334, quantityKpis#713930]
Arguments: explode(quantityKpis#713930), [orderProposalId#713333L, orderProposalItemId#713334], false, [orderQuantityInBaseUnit#717549, kpis#717550]
(52) Project
Output [7]: [orderProposalId#713333L, cast(orderProposalItemId#713334 as bigint) AS orderProposalItemId#717548L, orderQuantityInBaseUnit#717549, filter(kpis#717550, lambdafunction((lambda x_1915#717552.label = ServiceLevel), lambda x_1915#717552, false))[0].value AS serviceLevel#717551, filter(kpis#717550, lambdafunction((lambda x_1916#717554.label = RangeOfCoverage), lambda x_1916#717554, false))[0].value AS rangeOfCoverage#717553, filter(kpis#717550, lambdafunction((lambda x_1917#717556.label = ServiceLevelAtStartOfDelisting), lambda x_1917#717556, false))[0].value AS serviceLevelAtEndOfListing#717555, 10000002107 AS replenishmentRunId#717558L]
Input [4]: [orderProposalId#713333L, orderProposalItemId#713334, orderQuantityInBaseUnit#717549, kpis#717550]
(53) WriteFiles
Input [7]: [orderProposalId#713333L, orderProposalItemId#717548L, orderQuantityInBaseUnit#717549, serviceLevel#717551, rangeOfCoverage#717553, serviceLevelAtEndOfListing#717555, replenishmentRunId#717558L]
(54) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000002107/shardId=0_1_10000002107/sequenceId=6, false, Parquet, [path=hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000002107/shardId=0_1_10000002107/sequenceId=6], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, replenishmentRunId]