== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (56)
+- WriteFiles (55)
+- Project (54)
+- * Generate (53)
+- * Project (52)
+- * Filter (51)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (50)
+- * SortMergeJoin LeftOuter (49)
:- * Project (41)
: +- * SortMergeJoin LeftOuter (40)
: :- * Project (32)
: : +- * SortMergeJoin LeftOuter (31)
: : :- * Sort (25)
: : : +- Exchange (24)
: : : +- * Project (23)
: : : +- * SortMergeJoin LeftOuter (22)
: : : :- * Sort (14)
: : : : +- Exchange (13)
: : : : +- * Project (12)
: : : : +- * Generate (11)
: : : : +- * Filter (10)
: : : : +- InMemoryTableScan (3)
: : : : +- InMemoryRelation (4)
: : : : +- * Filter (9)
: : : : +- InMemoryTableScan (5)
: : : : +- InMemoryRelation (6)
: : : : +- * Filter (8)
: : : : +- * Scan ExistingRDD (7)
: : : +- * Sort (21)
: : : +- * Project (20)
: : : +- Exchange (19)
: : : +- * Project (18)
: : : +- * Filter (17)
: : : +- * ColumnarToRow (16)
: : : +- Scan parquet (15)
: : +- * Sort (30)
: : +- Exchange (29)
: : +- * Project (28)
: : +- * Filter (27)
: : +- * Scan ExistingRDD (26)
: +- * Sort (39)
: +- ObjectHashAggregate (38)
: +- Exchange (37)
: +- ObjectHashAggregate (36)
: +- * Project (35)
: +- * Filter (34)
: +- * Scan ExistingRDD (33)
+- * Sort (48)
+- ObjectHashAggregate (47)
+- Exchange (46)
+- ObjectHashAggregate (45)
+- * Project (44)
+- * Filter (43)
+- * Scan ExistingRDD (42)
(1) InMemoryTableScan
Output [4]: [orderProposalId#778277L, orderProposalItemId#778278, quantityKpis#779051, shardId#777607]
Arguments: [orderProposalId#778277L, orderProposalItemId#778278, quantityKpis#779051, shardId#777607], [isnotnull(shardId#777607), (shardId#777607 = 0_1_10000002108), (size(quantityKpis#779051, true) > 0)]
(2) InMemoryRelation
Arguments: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121, orderProposalId#778277L, originalReplenishmentRunId#778280L, supplierGroup#778287, supplier#778288, supplyingPlant#778318, productGroup#778319, product#778290, plant#778291, subrange#778289, orderDateTime#778295, deliveryDateTime#778296, availabilityDateTime#778297, nextAvailabilityDateTime#778298, constraintValues#778312, constraintOperators#778310, constraintLabels#778309, logisticUnits#778314, orderQuantityBaseUom#778300, orderQuantityBaseUomUuid#778301, splitIndicator#778282L, netPriceAmount#778305, ... 17 more fields], StorageLevel(disk, memory, 2 replicas)
(3) InMemoryTableScan
Output [2]: [shardId#777607, items#777609]
Arguments: [shardId#777607, items#777609], [(size(items#777609, true) > 0), isnotnull(items#777609)]
(4) InMemoryRelation
Arguments: [shardId#777607, orderProposalId#777608L, items#777609, optimizationGroups#777610, isOptimal#777611, optimizationInsights#777613], StorageLevel(disk, memory, 2 replicas)
(5) InMemoryTableScan
Output [6]: [shardId#777607, orderProposalId#777608L, items#777609, optimizationGroups#777610, isOptimal#777611, optimizationInsights#777613]
Arguments: [shardId#777607, orderProposalId#777608L, items#777609, optimizationGroups#777610, isOptimal#777611, optimizationInsights#777613], [isnotnull(shardId#777607), (shardId#777607 = 0_1_10000002108)]
(6) InMemoryRelation
Arguments: [shardId#777607, orderProposalId#777608L, items#777609, optimizationGroups#777610, isOptimal#777611, lastModified#777612, optimizationInsights#777613], StorageLevel(disk, memory, 2 replicas)
(7) Scan ExistingRDD [codegen id : 1]
Output [7]: [shardId#777607, orderProposalId#777608L, items#777609, optimizationGroups#777610, isOptimal#777611, lastModified#777612, optimizationInsights#777613]
Arguments: [shardId#777607, orderProposalId#777608L, items#777609, optimizationGroups#777610, isOptimal#777611, lastModified#777612, optimizationInsights#777613], MapPartitionsRDD[36570] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(8) Filter [codegen id : 1]
Input [7]: [shardId#777607, orderProposalId#777608L, items#777609, optimizationGroups#777610, isOptimal#777611, lastModified#777612, optimizationInsights#777613]
Condition : (isnotnull(shardId#777607) AND (shardId#777607 = 0_1_10000002108))
(9) Filter [codegen id : 1]
Input [6]: [shardId#777607, orderProposalId#777608L, items#777609, optimizationGroups#777610, isOptimal#777611, optimizationInsights#777613]
Condition : (isnotnull(shardId#777607) AND (shardId#777607 = 0_1_10000002108))
(10) Filter [codegen id : 1]
Input [2]: [shardId#777607, items#777609]
Condition : ((size(items#777609, true) > 0) AND isnotnull(items#777609))
(11) Generate [codegen id : 1]
Input [2]: [shardId#777607, items#777609]
Arguments: explode(items#777609), [shardId#777607], false, [item#778118]
(12) Project [codegen id : 1]
Output [4]: [shardId#777607, item#778118.worklistShardItemId AS worklistShardItemId#778119L, item#778118.quantityAfterProdPlantOptimization AS quantityAfterProdPlantOptimization#778120, item#778118.qty AS qty#778121]
Input [2]: [shardId#777607, item#778118]
(13) Exchange
Input [4]: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121]
Arguments: hashpartitioning(worklistShardItemId#778119L, 20), ENSURE_REQUIREMENTS, [plan_id=308814]
(14) Sort [codegen id : 2]
Input [4]: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121]
Arguments: [worklistShardItemId#778119L ASC NULLS FIRST], false, 0
(15) Scan parquet
Output [38]: [orderProposalId#778320L, orderProposalItemId#778321, supplierGroup#778322, supplier#778323, plant#778324, deliveryDateTime#778325, subrange#778326, supplyingPlant#778327, productGroup#778328, product#778329, orderDateTime#778330, availabilityDateTime#778331, nextAvailabilityDateTime#778332, sourceOfSupplyUuid#778334, isFallbackOrderOnly#778337, splitIndicator#778339L, previousOrderProposal#778340L, worklistShardItemId#778343L, orderProposalItemGroupId#778344, externalProductId#778345, externalPlantId#778346, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, minimumOrderQuantity#778350, constraintLabels#778351, constraintOperators#778352, constraintValues#778353, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, measurements#778361, originalReplenishmentRunId#778362L, optimizationGroups#778363, shardId#778364, sequenceId#778342]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-qty-opt-service/internal/prod-plant-snapshot/10000002108]
PartitionFilters: [isnotnull(shardId#778364), isnotnull(sequenceId#778342), (shardId#778364 = 0_1_10000002108), (sequenceId#778342 = 1)]
PushedFilters: [IsNotNull(worklistShardItemId)]
ReadSchema: struct<orderProposalId:bigint,orderProposalItemId:string,supplierGroup:string,supplier:string,plant:string,deliveryDateTime:timestamp,subrange:string,supplyingPlant:string,productGroup:string,product:string,orderDateTime:timestamp,availabilityDateTime:timestamp,nextAvailabilityDateTime:timestamp,sourceOfSupplyUuid:string,isFallbackOrderOnly:boolean,splitIndicator:bigint,previousOrderProposal:bigint,worklistShardItemId:bigint,orderProposalItemGroupId:string,externalProductId:string,externalPlantId:string,logisticUnits:array<struct<uom:string,uomUuid:string,numerator:int,denominator:int,isOrderUnit:boolean,isPreferred:boolean>>,orderQuantityBaseUom:string,orderQuantityBaseUomUuid:string,minimumOrderQuantity:double,constraintLabels:array<string>,constraintOperators:array<string>,constraintValues:array<double>,netPriceAmount:double,netPriceCurrencyCode:string,netPriceQuantity:double,netPriceQuantityUom:string,netPriceQuantityUomUuid:string,measurements:array<struct<value:double,dimensionType:int,dimensionCode:string,dimensionCodeUuid:string,isoCode:string>>,originalReplenishmentRunId:bigint,optimizationGroups:array<string>>
(16) ColumnarToRow [codegen id : 3]
Input [38]: [orderProposalId#778320L, orderProposalItemId#778321, supplierGroup#778322, supplier#778323, plant#778324, deliveryDateTime#778325, subrange#778326, supplyingPlant#778327, productGroup#778328, product#778329, orderDateTime#778330, availabilityDateTime#778331, nextAvailabilityDateTime#778332, sourceOfSupplyUuid#778334, isFallbackOrderOnly#778337, splitIndicator#778339L, previousOrderProposal#778340L, worklistShardItemId#778343L, orderProposalItemGroupId#778344, externalProductId#778345, externalPlantId#778346, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, minimumOrderQuantity#778350, constraintLabels#778351, constraintOperators#778352, constraintValues#778353, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, measurements#778361, originalReplenishmentRunId#778362L, optimizationGroups#778363, shardId#778364, sequenceId#778342]
(17) Filter [codegen id : 3]
Input [38]: [orderProposalId#778320L, orderProposalItemId#778321, supplierGroup#778322, supplier#778323, plant#778324, deliveryDateTime#778325, subrange#778326, supplyingPlant#778327, productGroup#778328, product#778329, orderDateTime#778330, availabilityDateTime#778331, nextAvailabilityDateTime#778332, sourceOfSupplyUuid#778334, isFallbackOrderOnly#778337, splitIndicator#778339L, previousOrderProposal#778340L, worklistShardItemId#778343L, orderProposalItemGroupId#778344, externalProductId#778345, externalPlantId#778346, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, minimumOrderQuantity#778350, constraintLabels#778351, constraintOperators#778352, constraintValues#778353, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, measurements#778361, originalReplenishmentRunId#778362L, optimizationGroups#778363, shardId#778364, sequenceId#778342]
Condition : isnotnull(worklistShardItemId#778343L)
(18) Project [codegen id : 3]
Output [36]: [orderProposalId#778320L, orderProposalItemId#778321, supplierGroup#778322, supplier#778323, plant#778324, deliveryDateTime#778325, subrange#778326, supplyingPlant#778327, productGroup#778328, product#778329, orderDateTime#778330, availabilityDateTime#778331, nextAvailabilityDateTime#778332, sourceOfSupplyUuid#778334, isFallbackOrderOnly#778337, splitIndicator#778339L, previousOrderProposal#778340L, worklistShardItemId#778343L, orderProposalItemGroupId#778344, externalProductId#778345, externalPlantId#778346, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, minimumOrderQuantity#778350, constraintLabels#778351, constraintOperators#778352, constraintValues#778353, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, measurements#778361, originalReplenishmentRunId#778362L, optimizationGroups#778363]
Input [38]: [orderProposalId#778320L, orderProposalItemId#778321, supplierGroup#778322, supplier#778323, plant#778324, deliveryDateTime#778325, subrange#778326, supplyingPlant#778327, productGroup#778328, product#778329, orderDateTime#778330, availabilityDateTime#778331, nextAvailabilityDateTime#778332, sourceOfSupplyUuid#778334, isFallbackOrderOnly#778337, splitIndicator#778339L, previousOrderProposal#778340L, worklistShardItemId#778343L, orderProposalItemGroupId#778344, externalProductId#778345, externalPlantId#778346, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, minimumOrderQuantity#778350, constraintLabels#778351, constraintOperators#778352, constraintValues#778353, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, measurements#778361, originalReplenishmentRunId#778362L, optimizationGroups#778363, shardId#778364, sequenceId#778342]
(19) Exchange
Input [36]: [orderProposalId#778320L, orderProposalItemId#778321, supplierGroup#778322, supplier#778323, plant#778324, deliveryDateTime#778325, subrange#778326, supplyingPlant#778327, productGroup#778328, product#778329, orderDateTime#778330, availabilityDateTime#778331, nextAvailabilityDateTime#778332, sourceOfSupplyUuid#778334, isFallbackOrderOnly#778337, splitIndicator#778339L, previousOrderProposal#778340L, worklistShardItemId#778343L, orderProposalItemGroupId#778344, externalProductId#778345, externalPlantId#778346, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, minimumOrderQuantity#778350, constraintLabels#778351, constraintOperators#778352, constraintValues#778353, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, measurements#778361, originalReplenishmentRunId#778362L, optimizationGroups#778363]
Arguments: hashpartitioning(worklistShardItemId#778343L, 20), REPARTITION_BY_NUM, [plan_id=308824]
(20) Project [codegen id : 4]
Output [36]: [worklistShardItemId#778343L, orderProposalId#778320L, orderProposalItemId#778321, orderProposalItemGroupId#778344, originalReplenishmentRunId#778362L, splitIndicator#778339L, previousOrderProposal#778340L, sourceOfSupplyUuid#778334, supplierGroup#778322, supplier#778323, subrange#778326, product#778329, plant#778324, orderDateTime#778330, deliveryDateTime#778325, availabilityDateTime#778331, nextAvailabilityDateTime#778332, isFallbackOrderOnly#778337, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, netPriceAmount#778356, netPriceCurrencyCode#778357, measurements#778361, minimumOrderQuantity#778350, constraintLabels#778351, constraintOperators#778352, constraintValues#778353, logisticUnits#778347, optimizationGroups#778363, externalProductId#778345, externalPlantId#778346, supplyingPlant#778327, productGroup#778328]
Input [36]: [orderProposalId#778320L, orderProposalItemId#778321, supplierGroup#778322, supplier#778323, plant#778324, deliveryDateTime#778325, subrange#778326, supplyingPlant#778327, productGroup#778328, product#778329, orderDateTime#778330, availabilityDateTime#778331, nextAvailabilityDateTime#778332, sourceOfSupplyUuid#778334, isFallbackOrderOnly#778337, splitIndicator#778339L, previousOrderProposal#778340L, worklistShardItemId#778343L, orderProposalItemGroupId#778344, externalProductId#778345, externalPlantId#778346, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, minimumOrderQuantity#778350, constraintLabels#778351, constraintOperators#778352, constraintValues#778353, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, measurements#778361, originalReplenishmentRunId#778362L, optimizationGroups#778363]
(21) Sort [codegen id : 4]
Input [36]: [worklistShardItemId#778343L, orderProposalId#778320L, orderProposalItemId#778321, orderProposalItemGroupId#778344, originalReplenishmentRunId#778362L, splitIndicator#778339L, previousOrderProposal#778340L, sourceOfSupplyUuid#778334, supplierGroup#778322, supplier#778323, subrange#778326, product#778329, plant#778324, orderDateTime#778330, deliveryDateTime#778325, availabilityDateTime#778331, nextAvailabilityDateTime#778332, isFallbackOrderOnly#778337, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, netPriceAmount#778356, netPriceCurrencyCode#778357, measurements#778361, minimumOrderQuantity#778350, constraintLabels#778351, constraintOperators#778352, constraintValues#778353, logisticUnits#778347, optimizationGroups#778363, externalProductId#778345, externalPlantId#778346, supplyingPlant#778327, productGroup#778328]
Arguments: [worklistShardItemId#778343L ASC NULLS FIRST], false, 0
(22) SortMergeJoin [codegen id : 5]
Left keys [1]: [worklistShardItemId#778119L]
Right keys [1]: [worklistShardItemId#778343L]
Join type: LeftOuter
Join condition: (shardId#777607 = 0_1_10000002108)
(23) Project [codegen id : 5]
Output [39]: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121, orderProposalId#778320L, originalReplenishmentRunId#778362L, supplierGroup#778322, supplier#778323, supplyingPlant#778327, productGroup#778328, product#778329, plant#778324, subrange#778326, orderDateTime#778330, deliveryDateTime#778325, availabilityDateTime#778331, nextAvailabilityDateTime#778332, constraintValues#778353, constraintOperators#778352, constraintLabels#778351, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, splitIndicator#778339L, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, sourceOfSupplyUuid#778334, minimumOrderQuantity#778350, orderProposalItemId#778321, orderProposalItemGroupId#778344, optimizationGroups#778363, measurements#778361, externalProductId#778345, externalPlantId#778346, previousOrderProposal#778340L, isFallbackOrderOnly#778337]
Input [40]: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121, worklistShardItemId#778343L, orderProposalId#778320L, orderProposalItemId#778321, orderProposalItemGroupId#778344, originalReplenishmentRunId#778362L, splitIndicator#778339L, previousOrderProposal#778340L, sourceOfSupplyUuid#778334, supplierGroup#778322, supplier#778323, subrange#778326, product#778329, plant#778324, orderDateTime#778330, deliveryDateTime#778325, availabilityDateTime#778331, nextAvailabilityDateTime#778332, isFallbackOrderOnly#778337, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, netPriceAmount#778356, netPriceCurrencyCode#778357, measurements#778361, minimumOrderQuantity#778350, constraintLabels#778351, constraintOperators#778352, constraintValues#778353, logisticUnits#778347, optimizationGroups#778363, externalProductId#778345, externalPlantId#778346, supplyingPlant#778327, productGroup#778328]
(24) Exchange
Input [39]: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121, orderProposalId#778320L, originalReplenishmentRunId#778362L, supplierGroup#778322, supplier#778323, supplyingPlant#778327, productGroup#778328, product#778329, plant#778324, subrange#778326, orderDateTime#778330, deliveryDateTime#778325, availabilityDateTime#778331, nextAvailabilityDateTime#778332, constraintValues#778353, constraintOperators#778352, constraintLabels#778351, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, splitIndicator#778339L, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, sourceOfSupplyUuid#778334, minimumOrderQuantity#778350, orderProposalItemId#778321, orderProposalItemGroupId#778344, optimizationGroups#778363, measurements#778361, externalProductId#778345, externalPlantId#778346, previousOrderProposal#778340L, isFallbackOrderOnly#778337]
Arguments: hashpartitioning(shardId#777607, worklistShardItemId#778119L, 20), ENSURE_REQUIREMENTS, [plan_id=308833]
(25) Sort [codegen id : 6]
Input [39]: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121, orderProposalId#778320L, originalReplenishmentRunId#778362L, supplierGroup#778322, supplier#778323, supplyingPlant#778327, productGroup#778328, product#778329, plant#778324, subrange#778326, orderDateTime#778330, deliveryDateTime#778325, availabilityDateTime#778331, nextAvailabilityDateTime#778332, constraintValues#778353, constraintOperators#778352, constraintLabels#778351, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, splitIndicator#778339L, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, sourceOfSupplyUuid#778334, minimumOrderQuantity#778350, orderProposalItemId#778321, orderProposalItemGroupId#778344, optimizationGroups#778363, measurements#778361, externalProductId#778345, externalPlantId#778346, previousOrderProposal#778340L, isFallbackOrderOnly#778337]
Arguments: [shardId#777607 ASC NULLS FIRST, worklistShardItemId#778119L ASC NULLS FIRST], false, 0
(26) Scan ExistingRDD [codegen id : 7]
Output [6]: [shardId#779016, worklistShardItemId#779017L, qty#779018, demandChannel#779019, demandStream#779020, kpis#779021]
Arguments: [shardId#779016, worklistShardItemId#779017L, qty#779018, demandChannel#779019, demandStream#779020, kpis#779021], MapPartitionsRDD[36645] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(27) Filter [codegen id : 7]
Input [6]: [shardId#779016, worklistShardItemId#779017L, qty#779018, demandChannel#779019, demandStream#779020, kpis#779021]
Condition : (((isnull(qty#779018) AND isnull(demandChannel#779019)) AND isnull(demandStream#779020)) AND (isnotnull(shardId#779016) AND isnotnull(worklistShardItemId#779017L)))
(28) Project [codegen id : 7]
Output [3]: [shardId#779016, worklistShardItemId#779017L, coalesce(kpis#779021, []) AS prodLocSpecificKpis#779022]
Input [6]: [shardId#779016, worklistShardItemId#779017L, qty#779018, demandChannel#779019, demandStream#779020, kpis#779021]
(29) Exchange
Input [3]: [shardId#779016, worklistShardItemId#779017L, prodLocSpecificKpis#779022]
Arguments: hashpartitioning(shardId#779016, worklistShardItemId#779017L, 20), ENSURE_REQUIREMENTS, [plan_id=308839]
(30) Sort [codegen id : 8]
Input [3]: [shardId#779016, worklistShardItemId#779017L, prodLocSpecificKpis#779022]
Arguments: [shardId#779016 ASC NULLS FIRST, worklistShardItemId#779017L ASC NULLS FIRST], false, 0
(31) SortMergeJoin [codegen id : 9]
Left keys [2]: [shardId#777607, worklistShardItemId#778119L]
Right keys [2]: [shardId#779016, worklistShardItemId#779017L]
Join type: LeftOuter
Join condition: None
(32) Project [codegen id : 9]
Output [40]: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121, orderProposalId#778320L, originalReplenishmentRunId#778362L, supplierGroup#778322, supplier#778323, supplyingPlant#778327, productGroup#778328, product#778329, plant#778324, subrange#778326, orderDateTime#778330, deliveryDateTime#778325, availabilityDateTime#778331, nextAvailabilityDateTime#778332, constraintValues#778353, constraintOperators#778352, constraintLabels#778351, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, splitIndicator#778339L, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, sourceOfSupplyUuid#778334, minimumOrderQuantity#778350, orderProposalItemId#778321, orderProposalItemGroupId#778344, optimizationGroups#778363, measurements#778361, externalProductId#778345, externalPlantId#778346, previousOrderProposal#778340L, isFallbackOrderOnly#778337, coalesce(prodLocSpecificKpis#779022, []) AS prodLocSpecificKpis#779023]
Input [42]: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121, orderProposalId#778320L, originalReplenishmentRunId#778362L, supplierGroup#778322, supplier#778323, supplyingPlant#778327, productGroup#778328, product#778329, plant#778324, subrange#778326, orderDateTime#778330, deliveryDateTime#778325, availabilityDateTime#778331, nextAvailabilityDateTime#778332, constraintValues#778353, constraintOperators#778352, constraintLabels#778351, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, splitIndicator#778339L, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, sourceOfSupplyUuid#778334, minimumOrderQuantity#778350, orderProposalItemId#778321, orderProposalItemGroupId#778344, optimizationGroups#778363, measurements#778361, externalProductId#778345, externalPlantId#778346, previousOrderProposal#778340L, isFallbackOrderOnly#778337, shardId#779016, worklistShardItemId#779017L, prodLocSpecificKpis#779022]
(33) Scan ExistingRDD [codegen id : 10]
Output [6]: [shardId#779032, worklistShardItemId#779033L, qty#779034, demandChannel#779035, demandStream#779036, kpis#779037]
Arguments: [shardId#779032, worklistShardItemId#779033L, qty#779034, demandChannel#779035, demandStream#779036, kpis#779037], MapPartitionsRDD[36645] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(34) Filter [codegen id : 10]
Input [6]: [shardId#779032, worklistShardItemId#779033L, qty#779034, demandChannel#779035, demandStream#779036, kpis#779037]
Condition : ((((isnull(qty#779034) AND isnotnull(demandChannel#779035)) AND isnotnull(demandStream#779036)) AND (size(kpis#779037, true) > 0)) AND (isnotnull(shardId#779032) AND isnotnull(worklistShardItemId#779033L)))
(35) Project [codegen id : 10]
Output [5]: [shardId#779032, worklistShardItemId#779033L, demandChannel#779035, demandStream#779036, kpis#779037]
Input [6]: [shardId#779032, worklistShardItemId#779033L, qty#779034, demandChannel#779035, demandStream#779036, kpis#779037]
(36) ObjectHashAggregate
Input [5]: [shardId#779032, worklistShardItemId#779033L, demandChannel#779035, demandStream#779036, kpis#779037]
Keys [2]: [shardId#779032, worklistShardItemId#779033L]
Functions [1]: [partial_collect_list(struct(demandChannel, demandChannel#779035, demandStream, demandStream#779036, kpis, kpis#779037), 0, 0)]
Aggregate Attributes [1]: [buf#779212]
Results [3]: [shardId#779032, worklistShardItemId#779033L, buf#779213]
(37) Exchange
Input [3]: [shardId#779032, worklistShardItemId#779033L, buf#779213]
Arguments: hashpartitioning(shardId#779032, worklistShardItemId#779033L, 20), ENSURE_REQUIREMENTS, [plan_id=308850]
(38) ObjectHashAggregate
Input [3]: [shardId#779032, worklistShardItemId#779033L, buf#779213]
Keys [2]: [shardId#779032, worklistShardItemId#779033L]
Functions [1]: [collect_list(struct(demandChannel, demandChannel#779035, demandStream, demandStream#779036, kpis, kpis#779037), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(demandChannel, demandChannel#779035, demandStream, demandStream#779036, kpis, kpis#779037), 0, 0)#779031]
Results [3]: [shardId#779032, worklistShardItemId#779033L, collect_list(struct(demandChannel, demandChannel#779035, demandStream, demandStream#779036, kpis, kpis#779037), 0, 0)#779031 AS channelStreamSpecificKpis#779024]
(39) Sort [codegen id : 11]
Input [3]: [shardId#779032, worklistShardItemId#779033L, channelStreamSpecificKpis#779024]
Arguments: [shardId#779032 ASC NULLS FIRST, worklistShardItemId#779033L ASC NULLS FIRST], false, 0
(40) SortMergeJoin [codegen id : 12]
Left keys [2]: [shardId#777607, worklistShardItemId#778119L]
Right keys [2]: [shardId#779032, worklistShardItemId#779033L]
Join type: LeftOuter
Join condition: None
(41) Project [codegen id : 12]
Output [41]: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121, orderProposalId#778320L, originalReplenishmentRunId#778362L, supplierGroup#778322, supplier#778323, supplyingPlant#778327, productGroup#778328, product#778329, plant#778324, subrange#778326, orderDateTime#778330, deliveryDateTime#778325, availabilityDateTime#778331, nextAvailabilityDateTime#778332, constraintValues#778353, constraintOperators#778352, constraintLabels#778351, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, splitIndicator#778339L, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, sourceOfSupplyUuid#778334, minimumOrderQuantity#778350, orderProposalItemId#778321, orderProposalItemGroupId#778344, optimizationGroups#778363, measurements#778361, externalProductId#778345, externalPlantId#778346, previousOrderProposal#778340L, isFallbackOrderOnly#778337, prodLocSpecificKpis#779023, coalesce(channelStreamSpecificKpis#779024, []) AS channelStreamSpecificKpis#779038]
Input [43]: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121, orderProposalId#778320L, originalReplenishmentRunId#778362L, supplierGroup#778322, supplier#778323, supplyingPlant#778327, productGroup#778328, product#778329, plant#778324, subrange#778326, orderDateTime#778330, deliveryDateTime#778325, availabilityDateTime#778331, nextAvailabilityDateTime#778332, constraintValues#778353, constraintOperators#778352, constraintLabels#778351, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, splitIndicator#778339L, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, sourceOfSupplyUuid#778334, minimumOrderQuantity#778350, orderProposalItemId#778321, orderProposalItemGroupId#778344, optimizationGroups#778363, measurements#778361, externalProductId#778345, externalPlantId#778346, previousOrderProposal#778340L, isFallbackOrderOnly#778337, prodLocSpecificKpis#779023, shardId#779032, worklistShardItemId#779033L, channelStreamSpecificKpis#779024]
(42) Scan ExistingRDD [codegen id : 13]
Output [6]: [shardId#779045, worklistShardItemId#779046L, qty#779047, demandChannel#779048, demandStream#779049, kpis#779050]
Arguments: [shardId#779045, worklistShardItemId#779046L, qty#779047, demandChannel#779048, demandStream#779049, kpis#779050], MapPartitionsRDD[36645] at start at FileStorageAdapterImpl.java:592, ExistingRDD, UnknownPartitioning(0)
(43) Filter [codegen id : 13]
Input [6]: [shardId#779045, worklistShardItemId#779046L, qty#779047, demandChannel#779048, demandStream#779049, kpis#779050]
Condition : ((isnotnull(qty#779047) AND isnotnull(kpis#779050)) AND (isnotnull(shardId#779045) AND isnotnull(worklistShardItemId#779046L)))
(44) Project [codegen id : 13]
Output [4]: [shardId#779045, worklistShardItemId#779046L, qty#779047, kpis#779050]
Input [6]: [shardId#779045, worklistShardItemId#779046L, qty#779047, demandChannel#779048, demandStream#779049, kpis#779050]
(45) ObjectHashAggregate
Input [4]: [shardId#779045, worklistShardItemId#779046L, qty#779047, kpis#779050]
Keys [2]: [shardId#779045, worklistShardItemId#779046L]
Functions [1]: [partial_collect_list(struct(qty, qty#779047, kpis, kpis#779050), 0, 0)]
Aggregate Attributes [1]: [buf#779214]
Results [3]: [shardId#779045, worklistShardItemId#779046L, buf#779215]
(46) Exchange
Input [3]: [shardId#779045, worklistShardItemId#779046L, buf#779215]
Arguments: hashpartitioning(shardId#779045, worklistShardItemId#779046L, 20), ENSURE_REQUIREMENTS, [plan_id=308862]
(47) ObjectHashAggregate
Input [3]: [shardId#779045, worklistShardItemId#779046L, buf#779215]
Keys [2]: [shardId#779045, worklistShardItemId#779046L]
Functions [1]: [collect_list(struct(qty, qty#779047, kpis, kpis#779050), 0, 0)]
Aggregate Attributes [1]: [collect_list(struct(qty, qty#779047, kpis, kpis#779050), 0, 0)#779044]
Results [3]: [shardId#779045, worklistShardItemId#779046L, map_from_entries(collect_list(struct(qty, qty#779047, kpis, kpis#779050), 0, 0)#779044) AS quantityKpis#779039]
(48) Sort [codegen id : 14]
Input [3]: [shardId#779045, worklistShardItemId#779046L, quantityKpis#779039]
Arguments: [shardId#779045 ASC NULLS FIRST, worklistShardItemId#779046L ASC NULLS FIRST], false, 0
(49) SortMergeJoin [codegen id : 15]
Left keys [2]: [shardId#777607, worklistShardItemId#778119L]
Right keys [2]: [shardId#779045, worklistShardItemId#779046L]
Join type: LeftOuter
Join condition: None
(50) Project [codegen id : 15]
Output [42]: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121, orderProposalId#778320L, originalReplenishmentRunId#778362L, supplierGroup#778322, supplier#778323, supplyingPlant#778327, productGroup#778328, product#778329, plant#778324, subrange#778326, orderDateTime#778330, deliveryDateTime#778325, availabilityDateTime#778331, nextAvailabilityDateTime#778332, constraintValues#778353, constraintOperators#778352, constraintLabels#778351, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, splitIndicator#778339L, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, sourceOfSupplyUuid#778334, minimumOrderQuantity#778350, orderProposalItemId#778321, orderProposalItemGroupId#778344, optimizationGroups#778363, measurements#778361, externalProductId#778345, externalPlantId#778346, previousOrderProposal#778340L, isFallbackOrderOnly#778337, prodLocSpecificKpis#779023, channelStreamSpecificKpis#779038, coalesce(quantityKpis#779039, map(keys: [], values: [])) AS quantityKpis#779051]
Input [44]: [shardId#777607, worklistShardItemId#778119L, quantityAfterProdPlantOptimization#778120, qty#778121, orderProposalId#778320L, originalReplenishmentRunId#778362L, supplierGroup#778322, supplier#778323, supplyingPlant#778327, productGroup#778328, product#778329, plant#778324, subrange#778326, orderDateTime#778330, deliveryDateTime#778325, availabilityDateTime#778331, nextAvailabilityDateTime#778332, constraintValues#778353, constraintOperators#778352, constraintLabels#778351, logisticUnits#778347, orderQuantityBaseUom#778348, orderQuantityBaseUomUuid#778349, splitIndicator#778339L, netPriceAmount#778356, netPriceCurrencyCode#778357, netPriceQuantity#778358, netPriceQuantityUom#778359, netPriceQuantityUomUuid#778360, sourceOfSupplyUuid#778334, minimumOrderQuantity#778350, orderProposalItemId#778321, orderProposalItemGroupId#778344, optimizationGroups#778363, measurements#778361, externalProductId#778345, externalPlantId#778346, previousOrderProposal#778340L, isFallbackOrderOnly#778337, prodLocSpecificKpis#779023, channelStreamSpecificKpis#779038, shardId#779045, worklistShardItemId#779046L, quantityKpis#779039]
(51) Filter [codegen id : 1]
Input [4]: [orderProposalId#778277L, orderProposalItemId#778278, quantityKpis#779051, shardId#777607]
Condition : ((isnotnull(shardId#777607) AND (shardId#777607 = 0_1_10000002108)) AND (size(quantityKpis#779051, true) > 0))
(52) Project [codegen id : 1]
Output [3]: [orderProposalId#778277L, orderProposalItemId#778278, quantityKpis#779051]
Input [4]: [orderProposalId#778277L, orderProposalItemId#778278, quantityKpis#779051, shardId#777607]
(53) Generate [codegen id : 1]
Input [3]: [orderProposalId#778277L, orderProposalItemId#778278, quantityKpis#779051]
Arguments: explode(quantityKpis#779051), [orderProposalId#778277L, orderProposalItemId#778278], false, [orderQuantityInBaseUnit#782718, kpis#782719]
(54) Project
Output [7]: [orderProposalId#778277L, cast(orderProposalItemId#778278 as bigint) AS orderProposalItemId#782717L, orderQuantityInBaseUnit#782718, filter(kpis#782719, lambdafunction((lambda x_2075#782721.label = ServiceLevel), lambda x_2075#782721, false))[0].value AS serviceLevel#782720, filter(kpis#782719, lambdafunction((lambda x_2076#782723.label = RangeOfCoverage), lambda x_2076#782723, false))[0].value AS rangeOfCoverage#782722, filter(kpis#782719, lambdafunction((lambda x_2077#782725.label = ServiceLevelAtStartOfDelisting), lambda x_2077#782725, false))[0].value AS serviceLevelAtEndOfListing#782724, 10000002108 AS replenishmentRunId#782727L]
Input [4]: [orderProposalId#778277L, orderProposalItemId#778278, orderQuantityInBaseUnit#782718, kpis#782719]
(55) WriteFiles
Input [7]: [orderProposalId#778277L, orderProposalItemId#782717L, orderQuantityInBaseUnit#782718, serviceLevel#782720, rangeOfCoverage#782722, serviceLevelAtEndOfListing#782724, replenishmentRunId#782727L]
(56) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000002108/shardId=0_1_10000002108/sequenceId=1, false, Parquet, [path=hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/prp-op-traceability-results/raw/crp-order-qty-opt-service/additional-kpi-curves/10000002108/shardId=0_1_10000002108/sequenceId=1], Overwrite, [orderProposalId, orderProposalItemId, orderQuantityInBaseUnit, serviceLevel, rangeOfCoverage, serviceLevelAtEndOfListing, replenishmentRunId]