== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (54)
+- WriteFiles (53)
+- Project (52)
+- * Generate (51)
+- * Project (50)
+- * Filter (49)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (48)
+- * SortMergeJoin LeftOuter (47)
:- * Project (39)
: +- * SortMergeJoin LeftOuter (38)
: :- * Project (30)
: : +- * SortMergeJoin LeftOuter (29)
: : :- * Sort (23)
: : : +- Exchange (22)
: : : +- * Project (21)
: : : +- * BroadcastHashJoin LeftOuter BuildRight (20)
: : : :- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- BroadcastExchange (19)
: : : +- * Project (18)
: : : +- Exchange (17)
: : : +- * Project (16)
: : : +- * Filter (15)
: : : +- * ColumnarToRow (14)
: : : +- Scan parquet (13)
: : +- * Sort (28)
: : +- Exchange (27)
: : +- * Project (26)
: : +- * Filter (25)
: : +- * Scan ExistingRDD (24)
: +- * Sort (37)
: +- ObjectHashAggregate (36)
: +- Exchange (35)
: +- ObjectHashAggregate (34)
: +- * Project (33)
: +- * Filter (32)
: +- * Scan ExistingRDD (31)
+- * Sort (46)
+- ObjectHashAggregate (45)
+- Exchange (44)
+- ObjectHashAggregate (43)
+- * Project (42)
+- * Filter (41)
+- * Scan ExistingRDD (40)
(1) InMemoryTableScan
Output [4]: [orderProposalId#958706L, orderProposalItemId#958707, quantityKpis#959480, shardId#958036]
Arguments: [orderProposalId#958706L, orderProposalItemId#958707, quantityKpis#959480, shardId#958036], [isnotnull(shardId#958036), (shardId#958036 = 0_1_10000002110), (size(quantityKpis#959480, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#958036, worklistShardItemId#958548L, quantityAfterProdPlantOptimization#958549, qty#958550, orderProposalId#958706L, originalReplenishmentRunId#958709L, supplierGroup#958716, supplier#958717, supplyingPlant#958747, productGroup#958748, product#958719, plant#958720, subrange#958718, orderDateTime#958724, deliveryDateTime#958725, availabilityDateTime#958726, nextAvailabilityDateTime#958727, constraintValues#958741, constraintOperators#958739, constraintLabels#958738, logisticUnits#958743, orderQuantityBaseUom#958729, orderQuantityBaseUomUuid#958730, splitIndicator#958711L, netPriceAmount#958734, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#958036, items#958038]
Arguments: [shardId#958036, items#958038], [(size(items#958038, true) > 0), isnotnull(items#958038)]
(4) InMemoryRelation
Arguments: [shardId#958036, orderProposalId#958037L, items#958038, optimizationGroups#958039, isOptimal#958040, optimizationInsights#958042], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#958036, orderProposalId#958037L, items#958038, optimizationGroups#958039, isOptimal#958040, optimizationInsights#958042]
Arguments: [shardId#958036, orderProposalId#958037L, items#958038, optimizationGroups#958039, isOptimal#958040, optimizationInsights#958042], [isnotnull(shardId#958036), (shardId#958036 = 0_1_10000002110)]
(6) InMemoryRelation
Arguments: [shardId#958036, orderProposalId#958037L, items#958038, optimizationGroups#958039, isOptimal#958040, lastModified#958041, optimizationInsights#958042], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#958036, orderProposalId#958037L, items#958038, optimizationGroups#958039, isOptimal#958040, lastModified#958041, optimizationInsights#958042]
Arguments: [shardId#958036, orderProposalId#958037L, items#958038, optimizationGroups#958039, isOptimal#958040, lastModified#958041, optimizationInsights#958042], MapPartitionsRDD[44956] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#958036, orderProposalId#958037L, items#958038, optimizationGroups#958039, isOptimal#958040, lastModified#958041, optimizationInsights#958042]
Condition : (isnotnull(shardId#958036) AND (shardId#958036 = 0_1_10000002110))
(9) Filter [codegen id : 1]
Input [6]: [shardId#958036, orderProposalId#958037L, items#958038, optimizationGroups#958039, isOptimal#958040, optimizationInsights#958042]
Condition : (isnotnull(shardId#958036) AND (shardId#958036 = 0_1_10000002110))
(10) Filter [codegen id : 3]
Input [2]: [shardId#958036, items#958038]
Condition : ((size(items#958038, true) > 0) AND isnotnull(items#958038))
(11) Generate [codegen id : 3]
Input [2]: [shardId#958036, items#958038]
Arguments: explode(items#958038), [shardId#958036], false, [item#958547]
(12) Project [codegen id : 3]
Output [4]: [shardId#958036, item#958547.worklistShardItemId AS worklistShardItemId#958548L, item#958547.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#958549, item#958547.qty AS qty#958550]
Input [2]: [shardId#958036, item#958547]
(13) Scan parquet
Output [38]: [orderProposalId#958749L, orderProposalItemId#958750, supplierGroup#958751, supplier#958752, plant#958753, deliveryDateTime#958754, subrange#958755, supplyingPlant#958756, productGroup#958757, product#958758, orderDateTime#958759, availabilityDateTime#958760, nextAvailabilityDateTime#958761, sourceOfSupplyUuid#958763, isFallbackOrderOnly#958766, splitIndicator#958768L, previousOrderProposal#958769L, worklistShardItemId#958772L, orderProposalItemGroupId#958773, externalProductId#958774, externalPlantId#958775, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, minimumOrderQuantity#958779, constraintLabels#958780, constraintOperators#958781, constraintValues#958782, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, measurements#958790, originalReplenishmentRunId#958791L, optimizationGroups#958792, shardId#958793, sequenceId#958771]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000002110]
PartitionFilters: [isnotnull(shardId#958793), isnotnull(sequenceId#958771), (shardId#958793 = 0_1_10000002110), (sequenceId#958771 = 1)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(14) ColumnarToRow [codegen id : 1]
Input [38]: [orderProposalId#958749L, orderProposalItemId#958750, supplierGroup#958751, supplier#958752, plant#958753, deliveryDateTime#958754, subrange#958755, supplyingPlant#958756, productGroup#958757, product#958758, orderDateTime#958759, availabilityDateTime#958760, nextAvailabilityDateTime#958761, sourceOfSupplyUuid#958763, isFallbackOrderOnly#958766, splitIndicator#958768L, previousOrderProposal#958769L, worklistShardItemId#958772L, orderProposalItemGroupId#958773, externalProductId#958774, externalPlantId#958775, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, minimumOrderQuantity#958779, constraintLabels#958780, constraintOperators#958781, constraintValues#958782, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, measurements#958790, originalReplenishmentRunId#958791L, optimizationGroups#958792, shardId#958793, sequenceId#958771]
(15) Filter [codegen id : 1]
Input [38]: [orderProposalId#958749L, orderProposalItemId#958750, supplierGroup#958751, supplier#958752, plant#958753, deliveryDateTime#958754, subrange#958755, supplyingPlant#958756, productGroup#958757, product#958758, orderDateTime#958759, availabilityDateTime#958760, nextAvailabilityDateTime#958761, sourceOfSupplyUuid#958763, isFallbackOrderOnly#958766, splitIndicator#958768L, previousOrderProposal#958769L, worklistShardItemId#958772L, orderProposalItemGroupId#958773, externalProductId#958774, externalPlantId#958775, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, minimumOrderQuantity#958779, constraintLabels#958780, constraintOperators#958781, constraintValues#958782, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, measurements#958790, originalReplenishmentRunId#958791L, optimizationGroups#958792, shardId#958793, sequenceId#958771]
Condition : isnotnull(worklistShardItemId#958772L)
(16) Project [codegen id : 1]
Output [36]: [orderProposalId#958749L, orderProposalItemId#958750, supplierGroup#958751, supplier#958752, plant#958753, deliveryDateTime#958754, subrange#958755, supplyingPlant#958756, productGroup#958757, product#958758, orderDateTime#958759, availabilityDateTime#958760, nextAvailabilityDateTime#958761, sourceOfSupplyUuid#958763, isFallbackOrderOnly#958766, splitIndicator#958768L, previousOrderProposal#958769L, worklistShardItemId#958772L, orderProposalItemGroupId#958773, externalProductId#958774, externalPlantId#958775, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, minimumOrderQuantity#958779, constraintLabels#958780, constraintOperators#958781, constraintValues#958782, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, measurements#958790, originalReplenishmentRunId#958791L, optimizationGroups#958792]
Input [38]: [orderProposalId#958749L, orderProposalItemId#958750, supplierGroup#958751, supplier#958752, plant#958753, deliveryDateTime#958754, subrange#958755, supplyingPlant#958756, productGroup#958757, product#958758, orderDateTime#958759, availabilityDateTime#958760, nextAvailabilityDateTime#958761, sourceOfSupplyUuid#958763, isFallbackOrderOnly#958766, splitIndicator#958768L, previousOrderProposal#958769L, worklistShardItemId#958772L, orderProposalItemGroupId#958773, externalProductId#958774, externalPlantId#958775, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, minimumOrderQuantity#958779, constraintLabels#958780, constraintOperators#958781, constraintValues#958782, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, measurements#958790, originalReplenishmentRunId#958791L, optimizationGroups#958792, shardId#958793, sequenceId#958771]
(17) Exchange
Input [36]: [orderProposalId#958749L, orderProposalItemId#958750, supplierGroup#958751, supplier#958752, plant#958753, deliveryDateTime#958754, subrange#958755, supplyingPlant#958756, productGroup#958757, product#958758, orderDateTime#958759, availabilityDateTime#958760, nextAvailabilityDateTime#958761, sourceOfSupplyUuid#958763, isFallbackOrderOnly#958766, splitIndicator#958768L, previousOrderProposal#958769L, worklistShardItemId#958772L, orderProposalItemGroupId#958773, externalProductId#958774, externalPlantId#958775, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, minimumOrderQuantity#958779, constraintLabels#958780, constraintOperators#958781, constraintValues#958782, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, measurements#958790, originalReplenishmentRunId#958791L, optimizationGroups#958792]
Arguments: hashpartitioning(worklistShardItemId#958772L, 20), REPARTITION_BY_NUM, [plan_id=375217]
(18) Project [codegen id : 2]
Output [36]: [worklistShardItemId#958772L, orderProposalId#958749L, orderProposalItemId#958750, orderProposalItemGroupId#958773, originalReplenishmentRunId#958791L, splitIndicator#958768L, previousOrderProposal#958769L, sourceOfSupplyUuid#958763, supplierGroup#958751, supplier#958752, subrange#958755, product#958758, plant#958753, orderDateTime#958759, deliveryDateTime#958754, availabilityDateTime#958760, nextAvailabilityDateTime#958761, isFallbackOrderOnly#958766, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, netPriceAmount#958785, netPriceCurrencyCode#958786, measurements#958790, minimumOrderQuantity#958779, constraintLabels#958780, constraintOperators#958781, constraintValues#958782, logisticUnits#958776, optimizationGroups#958792, externalProductId#958774, externalPlantId#958775, supplyingPlant#958756, productGroup#958757]
Input [36]: [orderProposalId#958749L, orderProposalItemId#958750, supplierGroup#958751, supplier#958752, plant#958753, deliveryDateTime#958754, subrange#958755, supplyingPlant#958756, productGroup#958757, product#958758, orderDateTime#958759, availabilityDateTime#958760, nextAvailabilityDateTime#958761, sourceOfSupplyUuid#958763, isFallbackOrderOnly#958766, splitIndicator#958768L, previousOrderProposal#958769L, worklistShardItemId#958772L, orderProposalItemGroupId#958773, externalProductId#958774, externalPlantId#958775, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, minimumOrderQuantity#958779, constraintLabels#958780, constraintOperators#958781, constraintValues#958782, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, measurements#958790, originalReplenishmentRunId#958791L, optimizationGroups#958792]
(19) BroadcastExchange
Input [36]: [worklistShardItemId#958772L, orderProposalId#958749L, orderProposalItemId#958750, orderProposalItemGroupId#958773, originalReplenishmentRunId#958791L, splitIndicator#958768L, previousOrderProposal#958769L, sourceOfSupplyUuid#958763, supplierGroup#958751, supplier#958752, subrange#958755, product#958758, plant#958753, orderDateTime#958759, deliveryDateTime#958754, availabilityDateTime#958760, nextAvailabilityDateTime#958761, isFallbackOrderOnly#958766, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, netPriceAmount#958785, netPriceCurrencyCode#958786, measurements#958790, minimumOrderQuantity#958779, constraintLabels#958780, constraintOperators#958781, constraintValues#958782, logisticUnits#958776, optimizationGroups#958792, externalProductId#958774, externalPlantId#958775, supplyingPlant#958756, productGroup#958757]
Arguments: HashedRelationBroadcastMode(List(input[0, bigint, true]),false), [plan_id=375221]
(20) BroadcastHashJoin [codegen id : 3]
Left keys [1]: [worklistShardItemId#958548L]
Right keys [1]: [worklistShardItemId#958772L]
Join type: LeftOuter
Join condition: (shardId#958036 = 0_1_10000002110)
(21) Project [codegen id : 3]
Output [39]: [shardId#958036, worklistShardItemId#958548L, quantityAfterProdPlantOptimization#958549, qty#958550, orderProposalId#958749L, originalReplenishmentRunId#958791L, supplierGroup#958751, supplier#958752, supplyingPlant#958756, productGroup#958757, product#958758, plant#958753, subrange#958755, orderDateTime#958759, deliveryDateTime#958754, availabilityDateTime#958760, nextAvailabilityDateTime#958761, constraintValues#958782, constraintOperators#958781, constraintLabels#958780, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, splitIndicator#958768L, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, sourceOfSupplyUuid#958763, minimumOrderQuantity#958779, orderProposalItemId#958750, orderProposalItemGroupId#958773, optimizationGroups#958792, measurements#958790, externalProductId#958774, externalPlantId#958775, previousOrderProposal#958769L, isFallbackOrderOnly#958766]
Input [40]: [shardId#958036, worklistShardItemId#958548L, quantityAfterProdPlantOptimization#958549, qty#958550, worklistShardItemId#958772L, orderProposalId#958749L, orderProposalItemId#958750, orderProposalItemGroupId#958773, originalReplenishmentRunId#958791L, splitIndicator#958768L, previousOrderProposal#958769L, sourceOfSupplyUuid#958763, supplierGroup#958751, supplier#958752, subrange#958755, product#958758, plant#958753, orderDateTime#958759, deliveryDateTime#958754, availabilityDateTime#958760, nextAvailabilityDateTime#958761, isFallbackOrderOnly#958766, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, netPriceAmount#958785, netPriceCurrencyCode#958786, measurements#958790, minimumOrderQuantity#958779, constraintLabels#958780, constraintOperators#958781, constraintValues#958782, logisticUnits#958776, optimizationGroups#958792, externalProductId#958774, externalPlantId#958775, supplyingPlant#958756, productGroup#958757]
(22) Exchange
Input [39]: [shardId#958036, worklistShardItemId#958548L, quantityAfterProdPlantOptimization#958549, qty#958550, orderProposalId#958749L, originalReplenishmentRunId#958791L, supplierGroup#958751, supplier#958752, supplyingPlant#958756, productGroup#958757, product#958758, plant#958753, subrange#958755, orderDateTime#958759, deliveryDateTime#958754, availabilityDateTime#958760, nextAvailabilityDateTime#958761, constraintValues#958782, constraintOperators#958781, constraintLabels#958780, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, splitIndicator#958768L, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, sourceOfSupplyUuid#958763, minimumOrderQuantity#958779, orderProposalItemId#958750, orderProposalItemGroupId#958773, optimizationGroups#958792, measurements#958790, externalProductId#958774, externalPlantId#958775, previousOrderProposal#958769L, isFallbackOrderOnly#958766]
Arguments: hashpartitioning(shardId#958036, worklistShardItemId#958548L, 20), ENSURE_REQUIREMENTS, [plan_id=375226]
(23) Sort [codegen id : 4]
Input [39]: [shardId#958036, worklistShardItemId#958548L, quantityAfterProdPlantOptimization#958549, qty#958550, orderProposalId#958749L, originalReplenishmentRunId#958791L, supplierGroup#958751, supplier#958752, supplyingPlant#958756, productGroup#958757, product#958758, plant#958753, subrange#958755, orderDateTime#958759, deliveryDateTime#958754, availabilityDateTime#958760, nextAvailabilityDateTime#958761, constraintValues#958782, constraintOperators#958781, constraintLabels#958780, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, splitIndicator#958768L, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, sourceOfSupplyUuid#958763, minimumOrderQuantity#958779, orderProposalItemId#958750, orderProposalItemGroupId#958773, optimizationGroups#958792, measurements#958790, externalProductId#958774, externalPlantId#958775, previousOrderProposal#958769L, isFallbackOrderOnly#958766]
Arguments: [shardId#958036 ASC NULLS FIRST, worklistShardItemId#958548L ASC NULLS FIRST], false, 0
(24) Scan ExistingRDD [codegen id : 5]
Output [6]: [shardId#959445, worklistShardItemId#959446L, qty#959447, demandChannel#959448, demandStream#959449, kpis#959450]
Arguments: [shardId#959445, worklistShardItemId#959446L, qty#959447, demandChannel#959448, demandStream#959449, kpis#959450], MapPartitionsRDD[45030] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(25) Filter [codegen id : 5]
Input [6]: [shardId#959445, worklistShardItemId#959446L, qty#959447, demandChannel#959448, demandStream#959449, kpis#959450]
Condition : (((isnull(qty#959447) AND isnull(demandChannel#959448)) AND isnull(demandStream#959449)) AND (isnotnull(shardId#959445) AND isnotnull(worklistShardItemId#959446L)))
(26) Project [codegen id : 5]
Output [3]: [shardId#959445, worklistShardItemId#959446L, coalesce(kpis#959450, []) AS prodLocSpecificKpis#959451]
Input [6]: [shardId#959445, worklistShardItemId#959446L, qty#959447, demandChannel#959448, demandStream#959449, kpis#959450]
(27) Exchange
Input [3]: [shardId#959445, worklistShardItemId#959446L, prodLocSpecificKpis#959451]
Arguments: hashpartitioning(shardId#959445, worklistShardItemId#959446L, 20), ENSURE_REQUIREMENTS, [plan_id=375232]
(28) Sort [codegen id : 6]
Input [3]: [shardId#959445, worklistShardItemId#959446L, prodLocSpecificKpis#959451]
Arguments: [shardId#959445 ASC NULLS FIRST, worklistShardItemId#959446L ASC NULLS FIRST], false, 0
(29) SortMergeJoin [codegen id : 7]
Left keys [2]: [shardId#958036, worklistShardItemId#958548L]
Right keys [2]: [shardId#959445, worklistShardItemId#959446L]
Join type: LeftOuter
Join condition: None
(30) Project [codegen id : 7]
Output [40]: [shardId#958036, worklistShardItemId#958548L, quantityAfterProdPlantOptimization#958549, qty#958550, orderProposalId#958749L, originalReplenishmentRunId#958791L, supplierGroup#958751, supplier#958752, supplyingPlant#958756, productGroup#958757, product#958758, plant#958753, subrange#958755, orderDateTime#958759, deliveryDateTime#958754, availabilityDateTime#958760, nextAvailabilityDateTime#958761, constraintValues#958782, constraintOperators#958781, constraintLabels#958780, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, splitIndicator#958768L, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, sourceOfSupplyUuid#958763, minimumOrderQuantity#958779, orderProposalItemId#958750, orderProposalItemGroupId#958773, optimizationGroups#958792, measurements#958790, externalProductId#958774, externalPlantId#958775, previousOrderProposal#958769L, isFallbackOrderOnly#958766, coalesce(prodLocSpecificKpis#959451, []) AS prodLocSpecificKpis#959452]
Input [42]: [shardId#958036, worklistShardItemId#958548L, quantityAfterProdPlantOptimization#958549, qty#958550, orderProposalId#958749L, originalReplenishmentRunId#958791L, supplierGroup#958751, supplier#958752, supplyingPlant#958756, productGroup#958757, product#958758, plant#958753, subrange#958755, orderDateTime#958759, deliveryDateTime#958754, availabilityDateTime#958760, nextAvailabilityDateTime#958761, constraintValues#958782, constraintOperators#958781, constraintLabels#958780, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, splitIndicator#958768L, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, sourceOfSupplyUuid#958763, minimumOrderQuantity#958779, orderProposalItemId#958750, orderProposalItemGroupId#958773, optimizationGroups#958792, measurements#958790, externalProductId#958774, externalPlantId#958775, previousOrderProposal#958769L, isFallbackOrderOnly#958766, shardId#959445, worklistShardItemId#959446L, prodLocSpecificKpis#959451]
(31) Scan ExistingRDD [codegen id : 8]
Output [6]: [shardId#959461, worklistShardItemId#959462L, qty#959463, demandChannel#959464, demandStream#959465, kpis#959466]
Arguments: [shardId#959461, worklistShardItemId#959462L, qty#959463, demandChannel#959464, demandStream#959465, kpis#959466], MapPartitionsRDD[45030] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(32) Filter [codegen id : 8]
Input [6]: [shardId#959461, worklistShardItemId#959462L, qty#959463, demandChannel#959464, demandStream#959465, kpis#959466]
Condition : ((((isnull(qty#959463) AND isnotnull(demandChannel#959464)) AND isnotnull(demandStream#959465)) AND (size(kpis#959466, true) > 0)) AND (isnotnull(shardId#959461) AND isnotnull(worklistShardItemId#959462L)))
(33) Project [codegen id : 8]
Output [5]: [shardId#959461, worklistShardItemId#959462L, demandChannel#959464, demandStream#959465, kpis#959466]
Input [6]: [shardId#959461, worklistShardItemId#959462L, qty#959463, demandChannel#959464, demandStream#959465, kpis#959466]
(34) ObjectHashAggregate
Input [5]: [shardId#959461, worklistShardItemId#959462L, demandChannel#959464, demandStream#959465, kpis#959466]
Keys [2]: [shardId#959461, worklistShardItemId#959462L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#959464, demandStream, demandStream#959465, kpis, kpis#959466), 0, 0)]
Aggregate Attributes [1]: [buf#959641]
Results [3]: [shardId#959461, worklistShardItemId#959462L, buf#959642]
(35) Exchange
Input [3]: [shardId#959461, worklistShardItemId#959462L, buf#959642]
Arguments: hashpartitioning(shardId#959461, worklistShardItemId#959462L, 20), ENSURE_REQUIREMENTS, [plan_id=375243]
(36) ObjectHashAggregate
Input [3]: [shardId#959461, worklistShardItemId#959462L, buf#959642]
Keys [2]: [shardId#959461, worklistShardItemId#959462L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#959464, demandStream, demandStream#959465, kpis, kpis#959466), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#959464, demandStream, demandStream#959465, kpis, kpis#959466), 0, 0)#959460]
Results [3]: [shardId#959461, worklistShardItemId#959462L, collect_list(struct(demandChannel, demandChannel#959464, demandStream, demandStream#959465, kpis, kpis#959466), 0, 0)#959460 AS channelStreamSpecificKpis#959453]
(37) Sort [codegen id : 9]
Input [3]: [shardId#959461, worklistShardItemId#959462L, channelStreamSpecificKpis#959453]
Arguments: [shardId#959461 ASC NULLS FIRST, worklistShardItemId#959462L ASC NULLS FIRST], false, 0
(38) SortMergeJoin [codegen id : 10]
Left keys [2]: [shardId#958036, worklistShardItemId#958548L]
Right keys [2]: [shardId#959461, worklistShardItemId#959462L]
Join type: LeftOuter
Join condition: None
(39) Project [codegen id : 10]
Output [41]: [shardId#958036, worklistShardItemId#958548L, quantityAfterProdPlantOptimization#958549, qty#958550, orderProposalId#958749L, originalReplenishmentRunId#958791L, supplierGroup#958751, supplier#958752, supplyingPlant#958756, productGroup#958757, product#958758, plant#958753, subrange#958755, orderDateTime#958759, deliveryDateTime#958754, availabilityDateTime#958760, nextAvailabilityDateTime#958761, constraintValues#958782, constraintOperators#958781, constraintLabels#958780, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, splitIndicator#958768L, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, sourceOfSupplyUuid#958763, minimumOrderQuantity#958779, orderProposalItemId#958750, orderProposalItemGroupId#958773, optimizationGroups#958792, measurements#958790, externalProductId#958774, externalPlantId#958775, previousOrderProposal#958769L, isFallbackOrderOnly#958766, prodLocSpecificKpis#959452, coalesce(channelStreamSpecificKpis#959453, []) AS channelStreamSpecificKpis#959467]
Input [43]: [shardId#958036, worklistShardItemId#958548L, quantityAfterProdPlantOptimization#958549, qty#958550, orderProposalId#958749L, originalReplenishmentRunId#958791L, supplierGroup#958751, supplier#958752, supplyingPlant#958756, productGroup#958757, product#958758, plant#958753, subrange#958755, orderDateTime#958759, deliveryDateTime#958754, availabilityDateTime#958760, nextAvailabilityDateTime#958761, constraintValues#958782, constraintOperators#958781, constraintLabels#958780, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, splitIndicator#958768L, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, sourceOfSupplyUuid#958763, minimumOrderQuantity#958779, orderProposalItemId#958750, orderProposalItemGroupId#958773, optimizationGroups#958792, measurements#958790, externalProductId#958774, externalPlantId#958775, previousOrderProposal#958769L, isFallbackOrderOnly#958766, prodLocSpecificKpis#959452, shardId#959461, worklistShardItemId#959462L, channelStreamSpecificKpis#959453]
(40) Scan ExistingRDD [codegen id : 11]
Output [6]: [shardId#959474, worklistShardItemId#959475L, qty#959476, demandChannel#959477, demandStream#959478, kpis#959479]
Arguments: [shardId#959474, worklistShardItemId#959475L, qty#959476, demandChannel#959477, demandStream#959478, kpis#959479], MapPartitionsRDD[45030] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(41) Filter [codegen id : 11]
Input [6]: [shardId#959474, worklistShardItemId#959475L, qty#959476, demandChannel#959477, demandStream#959478, kpis#959479]
Condition : ((isnotnull(qty#959476) AND isnotnull(kpis#959479)) AND (isnotnull(shardId#959474) AND isnotnull(worklistShardItemId#959475L)))
(42) Project [codegen id : 11]
Output [4]: [shardId#959474, worklistShardItemId#959475L, qty#959476, kpis#959479]
Input [6]: [shardId#959474, worklistShardItemId#959475L, qty#959476, demandChannel#959477, demandStream#959478, kpis#959479]
(43) ObjectHashAggregate
Input [4]: [shardId#959474, worklistShardItemId#959475L, qty#959476, kpis#959479]
Keys [2]: [shardId#959474, worklistShardItemId#959475L]
Functions [1]: [partial_collect_list(struct(qty, qty#959476, kpis, kpis#959479), 0, 0)]
Aggregate Attributes [1]: [buf#959643]
Results [3]: [shardId#959474, worklistShardItemId#959475L, buf#959644]
(44) Exchange
Input [3]: [shardId#959474, worklistShardItemId#959475L, buf#959644]
Arguments: hashpartitioning(shardId#959474, worklistShardItemId#959475L, 20), ENSURE_REQUIREMENTS, [plan_id=375255]
(45) ObjectHashAggregate
Input [3]: [shardId#959474, worklistShardItemId#959475L, buf#959644]
Keys [2]: [shardId#959474, worklistShardItemId#959475L]
Functions [1]: [collect_list(struct(qty, qty#959476, kpis, kpis#959479), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#959476, kpis, kpis#959479), 0, 0)#959473]
Results [3]: [shardId#959474, worklistShardItemId#959475L, map_from_entries(collect_list(struct(qty, qty#959476, kpis, kpis#959479), 0, 0)#959473) AS quantityKpis#959468]
(46) Sort [codegen id : 12]
Input [3]: [shardId#959474, worklistShardItemId#959475L, quantityKpis#959468]
Arguments: [shardId#959474 ASC NULLS FIRST, worklistShardItemId#959475L ASC NULLS FIRST], false, 0
(47) SortMergeJoin [codegen id : 13]
Left keys [2]: [shardId#958036, worklistShardItemId#958548L]
Right keys [2]: [shardId#959474, worklistShardItemId#959475L]
Join type: LeftOuter
Join condition: None
(48) Project [codegen id : 13]
Output [42]: [shardId#958036, worklistShardItemId#958548L, quantityAfterProdPlantOptimization#958549, qty#958550, orderProposalId#958749L, originalReplenishmentRunId#958791L, supplierGroup#958751, supplier#958752, supplyingPlant#958756, productGroup#958757, product#958758, plant#958753, subrange#958755, orderDateTime#958759, deliveryDateTime#958754, availabilityDateTime#958760, nextAvailabilityDateTime#958761, constraintValues#958782, constraintOperators#958781, constraintLabels#958780, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, splitIndicator#958768L, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, sourceOfSupplyUuid#958763, minimumOrderQuantity#958779, orderProposalItemId#958750, orderProposalItemGroupId#958773, optimizationGroups#958792, measurements#958790, externalProductId#958774, externalPlantId#958775, previousOrderProposal#958769L, isFallbackOrderOnly#958766, prodLocSpecificKpis#959452, channelStreamSpecificKpis#959467, coalesce(quantityKpis#959468, map(keys: [], values: [])) AS quantityKpis#959480]
Input [44]: [shardId#958036, worklistShardItemId#958548L, quantityAfterProdPlantOptimization#958549, qty#958550, orderProposalId#958749L, originalReplenishmentRunId#958791L, supplierGroup#958751, supplier#958752, supplyingPlant#958756, productGroup#958757, product#958758, plant#958753, subrange#958755, orderDateTime#958759, deliveryDateTime#958754, availabilityDateTime#958760, nextAvailabilityDateTime#958761, constraintValues#958782, constraintOperators#958781, constraintLabels#958780, logisticUnits#958776, orderQuantityBaseUom#958777, orderQuantityBaseUomUuid#958778, splitIndicator#958768L, netPriceAmount#958785, netPriceCurrencyCode#958786, netPriceQuantity#958787, netPriceQuantityUom#958788, netPriceQuantityUomUuid#958789, sourceOfSupplyUuid#958763, minimumOrderQuantity#958779, orderProposalItemId#958750, orderProposalItemGroupId#958773, optimizationGroups#958792, measurements#958790, externalProductId#958774, externalPlantId#958775, previousOrderProposal#958769L, isFallbackOrderOnly#958766, prodLocSpecificKpis#959452, channelStreamSpecificKpis#959467, shardId#959474, worklistShardItemId#959475L, quantityKpis#959468]
(49) Filter [codegen id : 1]
Input [4]: [orderProposalId#958706L, orderProposalItemId#958707, quantityKpis#959480, shardId#958036]
Condition : ((isnotnull(shardId#958036) AND (shardId#958036 = 0_1_10000002110)) AND (size(quantityKpis#959480, true) > 0))
(50) Project [codegen id : 1]
Output [3]: [orderProposalId#958706L, orderProposalItemId#958707, quantityKpis#959480]
Input [4]: [orderProposalId#958706L, orderProposalItemId#958707, quantityKpis#959480, shardId#958036]
(51) Generate [codegen id : 1]
Input [3]: [orderProposalId#958706L, orderProposalItemId#958707, quantityKpis#959480]
Arguments: explode(quantityKpis#959480), [orderProposalId#958706L, orderProposalItemId#958707], false, [orderQuantityInBaseUnit#963083, kpis#963084]
(52) Project
Output [7]: [orderProposalId#958706L, cast(orderProposalItemId#958707 as bigint) AS orderProposalItemId#963082L, orderQuantityInBaseUnit#963083, filter(kpis#963084, lambdafunction((lambda x_2529#963086.label = ServiceLevel), lambda x_2529#963086, false))[0].value AS serviceLevel#963085, filter(kpis#963084, lambdafunction((lambda x_2530#963088.label = RangeOfCoverage), lambda x_2530#963088, false))[0].value AS rangeOfCoverage#963087, filter(kpis#963084, lambdafunction((lambda x_2531#963090.label = ServiceLevelAtStartOfDelisting), lambda x_2531#963090, false))[0].value AS serviceLevelAtEndOfListing#963089, 10000002110 AS replenishmentRunId#963092L]
Input [4]: [orderProposalId#958706L, orderProposalItemId#958707, orderQuantityInBaseUnit#963083, kpis#963084]
(53) WriteFiles
Input [7]: [orderProposalId#958706L, orderProposalItemId#963082L, orderQuantityInBaseUnit#963083, serviceLevel#963085, rangeOfCoverage#963087, serviceLevelAtEndOfListing#963089, replenishmentRunId#963092L]
(54) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000002110/shardId=0_1_10000002110/sequenceId=1, false, Parquet, [path=hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000002110/shardId=0_1_10000002110/sequenceId=1], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, replenishmentRunId]