crp-order-qty-opt-service - Details for Query 3903

Submitted Time: 2026/08/10 12:28:49
Duration: 2 s
Succeeded Jobs: 5943 5944

Plan Visualization

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [id="node0" labelType="html" label=" AdaptiveSparkPlan " tooltip="AdaptiveSparkPlan isFinalPlan=true"]; subgraph cluster1 { isCluster="true"; id="cluster1"; label="WholeStageCodegen (2)\n \nduration: total (min, med, max (stageId: taskId))\n1 ms (0 ms, 0 ms, 1 ms (stage 76355.0: task 186423))"; tooltip="WholeStageCodegen (2)"; 2 [id="node2" labelType="html" label=" Project " tooltip="Project [minOrderQtySetting#913563, minOrderQtySettingInternal#913576, _extract_externalOrder#913587 AS externalOrder#913578, _extract_internalOrder#913588 AS internalOrder#913579, CASE WHEN isnull(_extract_negligibleQuantitiesThresholdPercent#913586) THEN 0.0 ELSE CASE WHEN (_extract_negligibleQuantitiesThresholdPercent#913586 > 100.00001) THEN 0.0 ELSE least(greatest((_extract_negligibleQuantitiesThresholdPercent#913586 / 100.0), 0.0), 1.0) END END AS negligibleQuantitiesThreshold#913580]"]; } 3 [id="node3" labelType="html" label="Exchange shuffle records written: 1 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1 local bytes read: 84.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 48.0 B local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time: 0 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 0.0 B number of partitions: 25 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 84.0 B" tooltip="Exchange RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=357588]"]; subgraph cluster4 { isCluster="true"; id="cluster4"; label="WholeStageCodegen (1)\n \nduration: 89 ms"; tooltip="WholeStageCodegen (1)"; 5 [id="node5" labelType="html" label=" Project " tooltip="Project [minOrderQtySetting#913563, preferredUomSource#913572.distributionCenter.externalOrder AS _extract_externalOrder#913587, preferredUomSource#913572.distributionCenter.internalOrder AS _extract_internalOrder#913588, negligibleQuantitiesThreshold#913574.distributionCenter.negligibleQuantitiesThresholdPercent AS _extract_negligibleQuantitiesThresholdPercent#913586, minOrderQtySettingInternal#913576]"]; 6 [id="node6" labelType="html" label="Filter number of output rows: 1" tooltip="Filter (marketUnit#913555 <=> KA_REVIEW_CW31)"]; 7 [id="node7" labelType="html" label="ColumnarToRow number of output rows: 51 number of input batches: 1" tooltip="ColumnarToRow"]; } 8 [id="node8" labelType="html" label="Scan parquet number of files read: 1 scan time: 89 ms metadata time: 0 ms size of files read: 29.8 KiB number of output rows: 51" tooltip="FileScan parquet [marketUnit#913555,minOrderQtySetting#913563,preferredUomSource#913572,negligibleQuantitiesThreshold#913574,minOrderQtySettingInternal#913576] Batched: true, DataFilters: [(marketUnit#913555 <=> KA_REVIEW_CW31)], Format: Parquet, Location: PreparedDeltaFileIndex(1 paths)[hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20...., PartitionFilters: [], PushedFilters: [EqualNullSafe(marketUnit,KA_REVIEW_CW31)], ReadSchema: struct<marketUnit:string,minOrderQtySetting:int,preferredUomSource:struct<distributionCenter:stru..."]; 2->0; 3->2; 5->3; 6->5; 7->6; 8->7; }

Details

== Physical Plan ==
AdaptiveSparkPlan (13)
+- == Final Plan ==
   ResultQueryStage (8), Statistics(sizeInBytes=8.0 EiB)
   +- * Project (7)
      +- ShuffleQueryStage (6), Statistics(sizeInBytes=48.0 B, rowCount=1)
         +- Exchange (5)
            +- * Project (4)
               +- * Filter (3)
                  +- * ColumnarToRow (2)
                     +- Scan parquet  (1)
+- == Initial Plan ==
   Project (12)
   +- Exchange (11)
      +- Project (10)
         +- Filter (9)
            +- Scan parquet  (1)


(1) Scan parquet 
Output [5]: [marketUnit#913555, minOrderQtySetting#913563, preferredUomSource#913572, negligibleQuantitiesThreshold#913574, minOrderQtySettingInternal#913576]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit]
PushedFilters: [EqualNullSafe(marketUnit,KA_REVIEW_CW31)]
ReadSchema: struct<marketUnit:string,minOrderQtySetting:int,preferredUomSource:struct<distributionCenter:struct<internalOrder:int,externalOrder:int>>,negligibleQuantitiesThreshold:struct<distributionCenter:struct<negligibleQuantitiesThresholdPercent:double>>,minOrderQtySettingInternal:int>

(2) ColumnarToRow [codegen id : 1]
Input [5]: [marketUnit#913555, minOrderQtySetting#913563, preferredUomSource#913572, negligibleQuantitiesThreshold#913574, minOrderQtySettingInternal#913576]

(3) Filter [codegen id : 1]
Input [5]: [marketUnit#913555, minOrderQtySetting#913563, preferredUomSource#913572, negligibleQuantitiesThreshold#913574, minOrderQtySettingInternal#913576]
Condition : (marketUnit#913555 <=> KA_REVIEW_CW31)

(4) Project [codegen id : 1]
Output [5]: [minOrderQtySetting#913563, preferredUomSource#913572.distributionCenter.externalOrder AS _extract_externalOrder#913587, preferredUomSource#913572.distributionCenter.internalOrder AS _extract_internalOrder#913588, negligibleQuantitiesThreshold#913574.distributionCenter.negligibleQuantitiesThresholdPercent AS _extract_negligibleQuantitiesThresholdPercent#913586, minOrderQtySettingInternal#913576]
Input [5]: [marketUnit#913555, minOrderQtySetting#913563, preferredUomSource#913572, negligibleQuantitiesThreshold#913574, minOrderQtySettingInternal#913576]

(5) Exchange
Input [5]: [minOrderQtySetting#913563, _extract_externalOrder#913587, _extract_internalOrder#913588, _extract_negligibleQuantitiesThresholdPercent#913586, minOrderQtySettingInternal#913576]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=357588]

(6) ShuffleQueryStage
Output [5]: [minOrderQtySetting#913563, _extract_externalOrder#913587, _extract_internalOrder#913588, _extract_negligibleQuantitiesThresholdPercent#913586, minOrderQtySettingInternal#913576]
Arguments: 0

(7) Project [codegen id : 2]
Output [5]: [minOrderQtySetting#913563, minOrderQtySettingInternal#913576, _extract_externalOrder#913587 AS externalOrder#913578, _extract_internalOrder#913588 AS internalOrder#913579, CASE WHEN isnull(_extract_negligibleQuantitiesThresholdPercent#913586) THEN 0.0 ELSE CASE WHEN (_extract_negligibleQuantitiesThresholdPercent#913586 > 100.00001) THEN 0.0 ELSE least(greatest((_extract_negligibleQuantitiesThresholdPercent#913586 / 100.0), 0.0), 1.0) END END AS negligibleQuantitiesThreshold#913580]
Input [5]: [minOrderQtySetting#913563, _extract_externalOrder#913587, _extract_internalOrder#913588, _extract_negligibleQuantitiesThresholdPercent#913586, minOrderQtySettingInternal#913576]

(8) ResultQueryStage
Output [5]: [minOrderQtySetting#913563, minOrderQtySettingInternal#913576, externalOrder#913578, internalOrder#913579, negligibleQuantitiesThreshold#913580]
Arguments: 1

(9) Filter
Input [5]: [marketUnit#913555, minOrderQtySetting#913563, preferredUomSource#913572, negligibleQuantitiesThreshold#913574, minOrderQtySettingInternal#913576]
Condition : (marketUnit#913555 <=> KA_REVIEW_CW31)

(10) Project
Output [5]: [minOrderQtySetting#913563, preferredUomSource#913572.distributionCenter.externalOrder AS _extract_externalOrder#913587, preferredUomSource#913572.distributionCenter.internalOrder AS _extract_internalOrder#913588, negligibleQuantitiesThreshold#913574.distributionCenter.negligibleQuantitiesThresholdPercent AS _extract_negligibleQuantitiesThresholdPercent#913586, minOrderQtySettingInternal#913576]
Input [5]: [marketUnit#913555, minOrderQtySetting#913563, preferredUomSource#913572, negligibleQuantitiesThreshold#913574, minOrderQtySettingInternal#913576]

(11) Exchange
Input [5]: [minOrderQtySetting#913563, _extract_externalOrder#913587, _extract_internalOrder#913588, _extract_negligibleQuantitiesThresholdPercent#913586, minOrderQtySettingInternal#913576]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=357570]

(12) Project
Output [5]: [minOrderQtySetting#913563, minOrderQtySettingInternal#913576, _extract_externalOrder#913587 AS externalOrder#913578, _extract_internalOrder#913588 AS internalOrder#913579, CASE WHEN isnull(_extract_negligibleQuantitiesThresholdPercent#913586) THEN 0.0 ELSE CASE WHEN (_extract_negligibleQuantitiesThresholdPercent#913586 > 100.00001) THEN 0.0 ELSE least(greatest((_extract_negligibleQuantitiesThresholdPercent#913586 / 100.0), 0.0), 1.0) END END AS negligibleQuantitiesThreshold#913580]
Input [5]: [minOrderQtySetting#913563, _extract_externalOrder#913587, _extract_internalOrder#913588, _extract_negligibleQuantitiesThresholdPercent#913586, minOrderQtySettingInternal#913576]

(13) AdaptiveSparkPlan
Output [5]: [minOrderQtySetting#913563, minOrderQtySettingInternal#913576, externalOrder#913578, internalOrder#913579, negligibleQuantitiesThreshold#913580]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.activity.hdlfsEnabled	true
spark.activity.isolateSession	true
spark.sql.parquet.fieldId.read.enabled	true
spark.sql.parquet.fieldId.write.enabled	true
temporal.activity.id	4ef9e077-47b8-3aa4-a76e-5115fb1d7f0a
temporal.activity.type	BufferDataSnapShot