crp-order-qty-opt-service - Details for Query 4277

Submitted Time: 2026/08/10 13:12:13
Duration: 0.8 s
Succeeded Jobs: 6507 6508

Plan Visualization

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [id="node0" labelType="html" label=" AdaptiveSparkPlan " tooltip="AdaptiveSparkPlan isFinalPlan=true"]; subgraph cluster1 { isCluster="true"; id="cluster1"; label="WholeStageCodegen (2)\n \nduration: total (min, med, max (stageId: taskId))\n0 ms (0 ms, 0 ms, 0 ms (stage 84398.0: task 202518))"; tooltip="WholeStageCodegen (2)"; 2 [id="node2" labelType="html" label=" Project " tooltip="Project [minOrderQtySetting#1000845, minOrderQtySettingInternal#1000858, _extract_externalOrder#1000868 AS externalOrder#1000860, _extract_internalOrder#1000869 AS internalOrder#1000861, CASE WHEN isnull(_extract_negligibleQuantitiesThresholdPercent#1000870) THEN 0.0 ELSE CASE WHEN (_extract_negligibleQuantitiesThresholdPercent#1000870 > 100.00001) THEN 0.0 ELSE least(greatest((_extract_negligibleQuantitiesThresholdPercent#1000870 / 100.0), 0.0), 1.0) END END AS negligibleQuantitiesThreshold#1000862]"]; } 3 [id="node3" labelType="html" label="Exchange shuffle records written: 1 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 1 local bytes read: 84.0 B merged fetch fallback count: 0 local blocks read: 1 remote merged chunks fetched: 0 remote blocks read: 0 data size: 48.0 B local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time: 0 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 0.0 B number of partitions: 25 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 84.0 B" tooltip="Exchange RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=389730]"]; subgraph cluster4 { isCluster="true"; id="cluster4"; label="WholeStageCodegen (1)\n \nduration: 180 ms"; tooltip="WholeStageCodegen (1)"; 5 [id="node5" labelType="html" label=" Project " tooltip="Project [minOrderQtySetting#1000845, preferredUomSource#1000854.distributionCenter.externalOrder AS _extract_externalOrder#1000868, preferredUomSource#1000854.distributionCenter.internalOrder AS _extract_internalOrder#1000869, negligibleQuantitiesThreshold#1000856.distributionCenter.negligibleQuantitiesThresholdPercent AS _extract_negligibleQuantitiesThresholdPercent#1000870, minOrderQtySettingInternal#1000858]"]; 6 [id="node6" labelType="html" label="Filter number of output rows: 1" tooltip="Filter (marketUnit#1000837 <=> IW_MU_CRP-127007_2)"]; 7 [id="node7" labelType="html" label="ColumnarToRow number of output rows: 51 number of input batches: 1" tooltip="ColumnarToRow"]; } 8 [id="node8" labelType="html" label="Scan parquet number of files read: 1 scan time: 179 ms metadata time: 0 ms size of files read: 29.8 KiB number of output rows: 51" tooltip="FileScan parquet [marketUnit#1000837,minOrderQtySetting#1000845,preferredUomSource#1000854,negligibleQuantitiesThreshold#1000856,minOrderQtySettingInternal#1000858] Batched: true, DataFilters: [(marketUnit#1000837 <=> IW_MU_CRP-127007_2)], Format: Parquet, Location: PreparedDeltaFileIndex(1 paths)[hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20...., PartitionFilters: [], PushedFilters: [EqualNullSafe(marketUnit,IW_MU_CRP-127007_2)], ReadSchema: struct<marketUnit:string,minOrderQtySetting:int,preferredUomSource:struct<distributionCenter:stru..."]; 2->0; 3->2; 5->3; 6->5; 7->6; 8->7; }

Details

== Physical Plan ==
AdaptiveSparkPlan (13)
+- == Final Plan ==
   ResultQueryStage (8), Statistics(sizeInBytes=8.0 EiB)
   +- * Project (7)
      +- ShuffleQueryStage (6), Statistics(sizeInBytes=48.0 B, rowCount=1)
         +- Exchange (5)
            +- * Project (4)
               +- * Filter (3)
                  +- * ColumnarToRow (2)
                     +- Scan parquet  (1)
+- == Initial Plan ==
   Project (12)
   +- Exchange (11)
      +- Project (10)
         +- Filter (9)
            +- Scan parquet  (1)


(1) Scan parquet 
Output [5]: [marketUnit#1000837, minOrderQtySetting#1000845, preferredUomSource#1000854, negligibleQuantitiesThreshold#1000856, minOrderQtySettingInternal#1000858]
Batched: true
Location: PreparedDeltaFileIndex [hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit]
PushedFilters: [EqualNullSafe(marketUnit,IW_MU_CRP-127007_2)]
ReadSchema: struct<marketUnit:string,minOrderQtySetting:int,preferredUomSource:struct<distributionCenter:struct<internalOrder:int,externalOrder:int>>,negligibleQuantitiesThreshold:struct<distributionCenter:struct<negligibleQuantitiesThresholdPercent:double>>,minOrderQtySettingInternal:int>

(2) ColumnarToRow [codegen id : 1]
Input [5]: [marketUnit#1000837, minOrderQtySetting#1000845, preferredUomSource#1000854, negligibleQuantitiesThreshold#1000856, minOrderQtySettingInternal#1000858]

(3) Filter [codegen id : 1]
Input [5]: [marketUnit#1000837, minOrderQtySetting#1000845, preferredUomSource#1000854, negligibleQuantitiesThreshold#1000856, minOrderQtySettingInternal#1000858]
Condition : (marketUnit#1000837 <=> IW_MU_CRP-127007_2)

(4) Project [codegen id : 1]
Output [5]: [minOrderQtySetting#1000845, preferredUomSource#1000854.distributionCenter.externalOrder AS _extract_externalOrder#1000868, preferredUomSource#1000854.distributionCenter.internalOrder AS _extract_internalOrder#1000869, negligibleQuantitiesThreshold#1000856.distributionCenter.negligibleQuantitiesThresholdPercent AS _extract_negligibleQuantitiesThresholdPercent#1000870, minOrderQtySettingInternal#1000858]
Input [5]: [marketUnit#1000837, minOrderQtySetting#1000845, preferredUomSource#1000854, negligibleQuantitiesThreshold#1000856, minOrderQtySettingInternal#1000858]

(5) Exchange
Input [5]: [minOrderQtySetting#1000845, _extract_externalOrder#1000868, _extract_internalOrder#1000869, _extract_negligibleQuantitiesThresholdPercent#1000870, minOrderQtySettingInternal#1000858]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=389730]

(6) ShuffleQueryStage
Output [5]: [minOrderQtySetting#1000845, _extract_externalOrder#1000868, _extract_internalOrder#1000869, _extract_negligibleQuantitiesThresholdPercent#1000870, minOrderQtySettingInternal#1000858]
Arguments: 0

(7) Project [codegen id : 2]
Output [5]: [minOrderQtySetting#1000845, minOrderQtySettingInternal#1000858, _extract_externalOrder#1000868 AS externalOrder#1000860, _extract_internalOrder#1000869 AS internalOrder#1000861, CASE WHEN isnull(_extract_negligibleQuantitiesThresholdPercent#1000870) THEN 0.0 ELSE CASE WHEN (_extract_negligibleQuantitiesThresholdPercent#1000870 > 100.00001) THEN 0.0 ELSE least(greatest((_extract_negligibleQuantitiesThresholdPercent#1000870 / 100.0), 0.0), 1.0) END END AS negligibleQuantitiesThreshold#1000862]
Input [5]: [minOrderQtySetting#1000845, _extract_externalOrder#1000868, _extract_internalOrder#1000869, _extract_negligibleQuantitiesThresholdPercent#1000870, minOrderQtySettingInternal#1000858]

(8) ResultQueryStage
Output [5]: [minOrderQtySetting#1000845, minOrderQtySettingInternal#1000858, externalOrder#1000860, internalOrder#1000861, negligibleQuantitiesThreshold#1000862]
Arguments: 1

(9) Filter
Input [5]: [marketUnit#1000837, minOrderQtySetting#1000845, preferredUomSource#1000854, negligibleQuantitiesThreshold#1000856, minOrderQtySettingInternal#1000858]
Condition : (marketUnit#1000837 <=> IW_MU_CRP-127007_2)

(10) Project
Output [5]: [minOrderQtySetting#1000845, preferredUomSource#1000854.distributionCenter.externalOrder AS _extract_externalOrder#1000868, preferredUomSource#1000854.distributionCenter.internalOrder AS _extract_internalOrder#1000869, negligibleQuantitiesThreshold#1000856.distributionCenter.negligibleQuantitiesThresholdPercent AS _extract_negligibleQuantitiesThresholdPercent#1000870, minOrderQtySettingInternal#1000858]
Input [5]: [marketUnit#1000837, minOrderQtySetting#1000845, preferredUomSource#1000854, negligibleQuantitiesThreshold#1000856, minOrderQtySettingInternal#1000858]

(11) Exchange
Input [5]: [minOrderQtySetting#1000845, _extract_externalOrder#1000868, _extract_internalOrder#1000869, _extract_negligibleQuantitiesThresholdPercent#1000870, minOrderQtySettingInternal#1000858]
Arguments: RoundRobinPartitioning(25), REPARTITION_BY_NUM, [plan_id=389712]

(12) Project
Output [5]: [minOrderQtySetting#1000845, minOrderQtySettingInternal#1000858, _extract_externalOrder#1000868 AS externalOrder#1000860, _extract_internalOrder#1000869 AS internalOrder#1000861, CASE WHEN isnull(_extract_negligibleQuantitiesThresholdPercent#1000870) THEN 0.0 ELSE CASE WHEN (_extract_negligibleQuantitiesThresholdPercent#1000870 > 100.00001) THEN 0.0 ELSE least(greatest((_extract_negligibleQuantitiesThresholdPercent#1000870 / 100.0), 0.0), 1.0) END END AS negligibleQuantitiesThreshold#1000862]
Input [5]: [minOrderQtySetting#1000845, _extract_externalOrder#1000868, _extract_internalOrder#1000869, _extract_negligibleQuantitiesThresholdPercent#1000870, minOrderQtySettingInternal#1000858]

(13) AdaptiveSparkPlan
Output [5]: [minOrderQtySetting#1000845, minOrderQtySettingInternal#1000858, externalOrder#1000860, internalOrder#1000861, negligibleQuantitiesThreshold#1000862]
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.activity.hdlfsEnabled	true
spark.activity.isolateSession	true
spark.sql.parquet.fieldId.read.enabled	true
spark.sql.parquet.fieldId.write.enabled	true
temporal.activity.id	7d0e9e9d-73ef-3836-b649-f168d8ff9802
temporal.activity.type	BufferDataSnapShot